Azure Data Engineer \| Remote \| 5-12 years
Relevant experience - 5+ years
Strong coding expertise in SQL, Python, Pyspark
Excellent communication skills.
UK SHIFT - 2 pm to 10 pm
No. of Positions: 6
Primary Responsibilities
Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure Create data models for analytics purposes
Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations
Use Azure Data Factory and Databricks to assemble large, complex data sets
Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
Ensure data security and compliance
Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures
Required skills
Blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams
Azure DevOps
Apache Spark, Python
SQL proficiency
Azure Databricks knowledge
Big data technologies
The DEs should be well versed in coding, spark core and data ingestion using Azure. Moreover, they need to be decent in terms of communication skills. They should also have core Azure DE skills and coding skills (pyspark, python and SQL)
Job Type: Contractual / Temporary
Contract length: 6 months
Pay: ₹100,000.00 - ₹140,000.00 per month
Work Location: Remote