Jr Data Engineer.
Duration: 12 Months+
Location: Remote
W2/C2C Skills: Strong Python and Pyspark and Good with Data Structures and algorithms
Experience: 2 to 4 years
Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Provide technical support and usage guidance to the users of our platform's services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams..
Proficiency working in Linux environment
working knowledge of SQL, Python, and PySpark
Git/Bitbucket, Jenkins/CodeBuild, CodePipeline