We are seeking a skilled and innovative Senior Data Engineer to join our team and drive the evolution of the Client's data architecture and strategy.
In this role, you will address critical challenges such as integrating diverse data sources and leading agile cloud migrations to support the decommissioning of cross-platform business intelligence. Your work will help advance the Client's Data Mesh architecture, democratize data products, and enhance analytics capabilities across BI, Machine Learning, AI, Deep Learning, and IoT.
Responsibilities
Build and implement data warehousing solutions and develop robust ETL/ELT processes to ensure data integrity and availability
Develop and optimize data pipelines using AWS tools, including Glue, Redshift, Athena, DynamoDB, and Amazon RDS
Create and maintain automation scripts for data pipelines, such as Glue scripts for generating parameterized parquet files
Lead the migration of data sources and processes to the cloud to enable decommissioning of cross-platform BI
Ensure seamless data integration across various systems, sources, and formats to support the transition to a Data Mesh architecture
Collaborate with software developers, data analysts, and system administrators to understand business needs and deliver effective data solutions
Partner with business teams to refine data requirements, estimate development efforts, and build pipelines for Data Lake ingestion
Support the development of data models in Redshift to enable BI visualization in Tableau Cloud/Server
Enhance the current BI layer while supporting the growth of advanced ML, AI, and Deep Learning capabilities
Document database designs, ETL/ELT workflows, security schemas, and architecture diagrams for clarity and reproducibility
Maintain high standards of data governance to ensure data accuracy, security, and accessibility
Build Glue Data Pipelines to integrate data from APIs, transform it, and ingest it into cloud storage
Develop Glue scripts to produce parameterized parquet files in JSON format with automated cloud storage
Design and implement Redshift data models for indicators to be visualized in Tableau
Assist business teams in scoping data requirements, estimating effort, and delivering data pipeline solutions for Data Lake ingestion
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field
Minimum 3 years of relevant experience in data engineering
Proven experience with cloud-based data solutions, specifically AWS services such as S3, Glue, Redshift, Lambda, DynamoDB, Athena, and RDS
Strong understanding of ETL/ELT development, data pipeline architecture, and modern data warehousing concepts
Proficiency in programming languages such as Python, SQL, or Scala
Experience designing, implementing, and optimizing data models in Redshift or similar platforms
Strong problem-solving skills and attention to detail
Excellent communication skills and the ability to collaborate effectively with both technical and non-technical teams
Fluent English skills, both written and spoken, at a B2+ level or higher
Nice to have
Familiarity with data visualization tools, especially Tableau Server or Tableau Cloud
Experience working with Data Mesh architecture
Knowledge of machine learning, deep learning, AI, and IoT concepts
Experience with tools such as Apache Spark and Hadoop
Familiarity with JSON schema design and cloud storage management
Experience with AWS Lambda and Amazon EC2
We offer
Career plan and real growth opportunities
Unlimited access to LinkedIn learning solutions
Constant training, mentoring, online corporate courses, eLearning and more
English classes with a certified teacher
Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
Flexible work schedule and dress code
Collaborate in a multicultural environment and share best practices from around the globe
Hired directly by EPAM \& 100% under payroll
Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
Major medical expenses insurance: Life, Major medical expenses with dental \& visual coverage (for the employee and direct family members)
13 % employee savings fund, capped to the law limit
Grocery coupons
30 days December bonus
Employee Stock Purchase Plan
12 vacations days
Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th \& 31st)
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.