Our Client is one of the United States' largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P\&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.
Position Overview
We are seeking a skilled and self-driven AWS Data Engineer to design, develop, and maintain scalable data ingestion frameworks that support enterprise analytics and reporting. The ideal candidate will have deep expertise in AWS technologies, data lake architecture, and cross-functional collaboration to deliver high-quality data solutions.
Key Responsibilities
Data Ingestion \& Framework Development
Design, build, and maintain reusable, modular, and configuration-driven frameworks for ingesting both historical and incremental data from diverse sources into Iceberg tables on AWS S3
Expose ingested data to Snowflake via Snowflake external tables, ensuring seamless integration and accessibility
Implement robust logging mechanisms to monitor all data processes, ensuring completeness, timeliness, accuracy, and validity (ABC metrics)
Configure automated notifications to alert support teams of process statuses and anomalies
Adhere to architectural standards and development best practices throughout the lifecycle
Solution Design \& Execution
Translate complex business requirements into scalable and efficient technical solutions
Independently plan and execute the implementation of new data capabilities, including:
Development of project plans with clear milestones and delivery timelines
Task breakdown, assignment, and management
Comprehensive documentation and tracking of work using Rally or equivalent tools
Identification and management of dependencies across cross-functional teams
Cross-Team Collaboration
Coordinate effectively with internal and external stakeholders, including:
Cloud Operations
Information Security
Business Units
Other Development Teams
Facilitate alignment and secure commitment from partner teams to meet project deliverables and dependency timelines
Proactive, Timely, Concise and Audience Appropriate Communication
Communicates complex technical concepts to technical and non-technical personnel.
Delivers routine progress and status to stakeholders
Communicates information in line with the target audience experience, background, and expectations; uses terms, examples, and analogies that are meaningful to the audience
Ensures accuracy of information communicated to effectively support project leadership decision making
Continuous Improvement
Proactively accumulates and maintains knowledge of current and emerging/evolving technologies, concepts, and trends in the IT field
Provides input on improving or enhancing existing organizational processes based on lessons learned and experiences from project work
Performs root cause analysis to quickly identify and resolve issues causing recurring technical problems
Self-Driven Problem Solving \& Initiative
Demonstrates a high degree of independence and ownership in driving initiatives from concept to completion
Proactively identifies challenges and inefficiencies, and takes swift action to resolve them without waiting for direction
Navigates complex organizational structures to engage the right stakeholders and ensure timely delivery
Maintains a solution-oriented mindset, continuously seeking opportunities to improve processes, enhance collaboration, and deliver value
Requirements
Professional Experience
Minimum of 2-4 years of hands-on experience in data engineering within the AWS ecosystem.
At least 4 years of total IT experience including demonstrated success as a software developer
Full English Fluency
Technical Proficiency
Data Processing \& Orchestration: Spark, AWS Glue, AWS Step Functions, and EMR. (MUST)
Storage \& Lakehouse Architecture: S3, Iceberg, and Snowflake External Tables
Security \& Access Management: IAM and Lake Formation
Monitoring \& Logging: CloudWatch for operational visibility and alerting
Development \& Automation: Python \& Jenkins programming skills and experience with CI/CD pipelines for automated deployment and testing
Architecture \& Design: Understanding of data lake and lakehouse architectures, modular and configuration-driven development, and scalable ingestion frameworks
Cloud certifications
Good exposure to Agile software development and DevOps practices such as Infrastructure as Code (IaC), Continuous Integration and automated deployment
Strong practical application development experience on Linux and Windows-based systems
Collaboration \& Communication
Proven ability to work independently and collaboratively across cross-functional teams, with excellent verbal and written communication skills
Agile Methodologies: Familiarity with Agile development practices and tools such as Rally or similar project tracking systems.
Experience working directly with customers, partners and third-party developers
Benefits
This position comes with competitive compensation and benefits package:
Competitive salary and performance-based bonuses
Comprehensive benefits package
Career development and training opportunities
Flexible work arrangements (remote and/or office-based)
Dynamic and inclusive work culture within a globally renowned group
Private Health Insurance
Pension Plan
Paid Time Off
Training \& Development
About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.