HCL is looking for Data Engineer with the below skills:
SKILLS:
Data Engineers
The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines that collect, transform, and store data from various sources. Ensure data is clean, reliable, and readily accessible for analytics and decision-making. Key tasks include developing ETL/ELT workflows, optimizing performance, managing data warehouses and lakes, and ensuring data quality and integrity. Data Engineers will work with tools like Azure Data Factory, Databricks, and Synapse, and use languages such as SQL, Python, and PySpark. They collaborate with data scientists, analysts, and business teams to support data-driven initiatives and ensure efficient, secure, and compliant data infrastructure.
Essential Duties and Responsibilities
Design, build, and maintain scalable and efficient ETL/ELT data pipelines using
Azure Data Factory
and
Azure Databricks
.
Write complex, high-performance
SQL
queries and scripts for data extraction, transformation, and loading.
Implement data transformation logic using
Python
and
PySpark
(or Scala) within the Databricks environment.
Ensure pipeline reliability, scalability, and performance through monitoring, alerting, and proactive maintenance.
Collaborate closely with data architects, analysts, and business stakeholders to understand data requirements and deliver actionable solutions.
Enforce data governance and security best practices, ensuring compliance with organizational and regulatory standards.
Optimize data storage, compute, and processing resources in the Azure ecosystem to reduce costs and improve efficiency.
Document data flows, processes, and technical designs clearly and effectively.
Contribute to code reviews, technical discussions, and mentorship of junior engineers.
WORK ENVIRONMENT
Hybrid: This role is hybrid, and the associate is expected to perform assigned responsibilities from a home-based environment.
Minimum Qualifications
Bachelor’s degree in computer science, Engineering, Information Systems, or a related technical field.
6 to 9 years of professional experience as a Data Engineer or in a similar data-centric role.
Strong hands-on experience with
Azure Data Factory
and
Azure Databricks
.
Proficiency in
Python
and
SQL
for data processing and scripting.
Working experience with
PySpark
and/or
Scala
in distributed data processing.
Solid understanding of ETL/ELT methodologies and best practices.
Experience designing and managing data solutions in a cloud environment (Azure preferred).
Preferred Qualifications
Azure or Databricks certification related to Data Engineering.
Experience working with large-scale, real-time, or streaming data architectures.
Hands-on experience optimizing Spark jobs and tuning Databricks clusters.
Understanding data security practices, including encryption, masking, and role-based access controls.
Familiarity with DevOps tools, Infrastructure-as-Code (e.g., Terraform), or Azure DevOps.
Experience with Agile/Scrum development processes.
Strong written and verbal communication skills with the ability to explain complex technical topics to non-technical stakeholders.
Benefits:
Christmas bonus 30 days
Vacation bonus 25%
100% Payroll schema with Social security IMSS.
12 vacation days at first year
Life Insurance
Profit Sharing (PTU) (15 days to 1 month of salary)
Major medical insurance
13% Saving funds ($112,000 anuales aprox)
Meals Allowance ($3,400 mensuales aprox)