👨🏻‍💻 postech.work

Big Data/Pyspark Engineer

Thrive IT Systems • 🌐 In Person

In Person Posted 1 day, 13 hours ago

Job Description

Hands on years of focused and in-depth experience in implementing complex business analytics applications using big data technologies.

A problem-solvers, with good analytical skills and a can-do attitude.

Experience of various programming technologies and has good development sense, modular coding experience.

Participated in various Hackathons and provided optimal \& impactful solution to a real-world problem.

Start-up mindset, has worked in big data start-ups using Spark or comes with boutique or captive firms knows for building big data solutions using Spark

Extensive experience as a Data engineer with experience in designing, developing, and managing complex data pipelines which collects, store, process, and analyses large volumes of data

Develop optimized data pipelines and make sure they are executed with high performance

Experience in Linux Bash, PowerShell, and Python scripting

Perform research to handle any problems faced while meeting the business objectives.

Believer of “Clean Code” follows importance of various clean code approaches

Conducts through unit test of the code, discover issues, and fix them diligently

Worked with version control tools such as Git and SVN.

Extensively worked on Python Programming, Spark coding using scala or PySpark

Knowledge of cloud technologies especially Azure, Databricks, and Devops (Git, development of CI/CD pipelines, containers) would be an added advantage

Design functional and technical architectures

A team player practices in Peer code reviews, Pair programming

Great communication abilities, both technically and non-technically.

Can work independently with little or no supervision.

Get job updates in your inbox

Subscribe to our newsletter and stay updated with the best job opportunities.