Position: Data Engineer
Location: Sydney
Duration: 6 months
Must Have Skills:
Hands On with advanced SQL, Python etc.
Hands On in data profiling
Hands On in working on Cloud like Azure and Cloud DW like Databricks
Hands On experience on Scheduling tools like Airflow, Control M etc.
Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase)
Knowledgeable in CICD processes – BitBucket/GitHub, Jenkins, Nexus etc.
Knowledgeable managing structured and unstructured data types.
Nice to have skills :
Experience in working with a team of data engineers working from different locations in different time zones.
Excellent communication.
Effective prioritisation
Pragmatic stakeholder management.Cloud Platform Familiarity: Understanding of cloud services (AWS, Azure, GCP) to analyze and optimize cloud-based systems.
Basic Scripting Knowledge: Ability to write simple scripts in Python, SQL, or R for data extraction, transformation, and analysis.