Job Description \& Requirements
This role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.
Role :
Help write analytics code, services and components in Java, Apache Spark and Kafka
Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities
Creating Technical design diagrams for business modules, code review with the peers.
Requirement gathering and understanding, Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates
Work proactively, independently and with global teams to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks
Providing expertise in technical analysis and solving technical issues during project delivery
Code reviews, test case reviews and ensure code developed meets the requirements
Responsibilities
Experience with Java essential.
Experience with Apache Spark streaming and batch framework
Experience with Kafka, Storm, Zookeeper
Agile/Scrum methodology experience is required.
Service oriented architecture, and data standards like JSON, Avro, Protobuf
Strong communication skills, should be able to communicate effectively with business and other stake holders
Demonstrate ownership and initiative taking
Qualifications:
Bachelor's degree in computer science, data science, or a related field
Experience with Apache Spark, Java, SAS, Hive, Hadoop, and the Hadoop ecosystem
Experience with data modeling, data wrangling, and data analysis
Experience with cloud computing platforms (e.g., AWS, Azure, GCP)
Strong problem-solving and analytical skills
Excellent communication and teamwork skills
Strong programming skills
Experience with data migration
Ability to work independently and as part of a team.
Benefits:
Opportunity to work on cutting-edge projects.
Collaborative and supportive work environment