This role is for one of the Weekday's clients
Compensation:
$180,000-$280,000
Min Experience: 6 years
Location: USA, Texas City, California City, Austin, Dallas, Washington, San Francisco, US, San Francisco Bay Area, new york, Seattle, Boston, Los Angeles
JobType: full-time
We are seeking a highly experienced Python Software Engineer to lead backend development for large-scale, real-time data pipelines. The ideal candidate has deep expertise in Python, data ingestion frameworks, workflow orchestration, and performance optimization. This role involves building robust, high-throughput systems that correlate and process data across multiple streams in real time.
Requirements
*Key Responsibilities*
Architect and develop scalable backend services and data ingestion pipelines using Python.
Work with real-time data processing systems to ensure high performance, low latency, and reliability.
Build and optimize workflows using Celery, Temporal, or similar orchestration tools.
Apply advanced query optimization and data modeling techniques to support high-volume data operations.
Collaborate with data platform teams to improve ingestion, transformation, and processing layers.
Ensure smooth integration with third-party tools, security systems, and cloud-based environments.
Troubleshoot pipeline issues and drive system improvements for scalability and efficiency.
*Required Experience*
Extensive hands-on experience with Python for backend engineering.
Strong background in data ingestion pipelines and real-time data processing.
Expertise in Celery, Temporal, or other workflow automation/orchestration systems.
Solid understanding of distributed systems, query optimization, and data platform architecture.
Experience working with high-volume, high-frequency data streams