A leading tech company is seeking a Principal Data/Software Engineer to design, implement, and support world-class infrastructure tools. This role offers an exciting opportunity for a self-motivated engineer who is passionate about building high-quality tools in a fast-paced, collaborative environment. You’ll work closely with developers and other stakeholders, leveraging cutting-edge open source and proprietary technologies to create scalable systems, data pipelines, and supporting services for advanced research and analytics.
Key Responsibilities
Build ETL pipelines and visualization tools on top of internal and external data sources to drive analytics and research.
Enhance frameworks to better leverage on-prem compute and storage clusters.
Improve maintainability and performance of data pipelines.
Contribute to the core Python data science platform, managing petabyte-scale datasets with APIs for granular interaction.
Develop, test, and document in-house tools to improve reliability and usability.
Automate support workflows to reduce operational overhead and increase efficiency.
Qualifications
Bachelor’s degree in Computer Science or related field from a top-tier institution.
5–10+ years of experience designing and improving information systems.
Strong proficiency with Python (NumPy/Arrow, Pandas/Polars, Cython, etc.) and data science/visualization frameworks.
Familiarity with distributed computing tools (Dask/Prefect), Kafka, SQL/NoSQL databases is a plus.
Experience with source control management and CI/CD pipelines; familiarity with observability tools (ELK, Grafana, OpenTelemetry) is a plus.
Excellent problem-solving skills, especially for high-availability, high-throughput, and low-latency systems.
Ability to learn new technologies quickly and thrive in a fast-paced environment.
Previous experience working with C++ is beneficial.
What We’re Looking For
Passion for new technologies and improving existing systems.
Proactive mindset to identify opportunities for efficiency and automation.
Strong attention to detail and ability to juggle multiple priorities.
Collaborative team player who can also work independently.