Job: - Databricks Data Engineer
Location: - Sydney (Hybrid)
Duration: - 6 Months (Possible Extension)
We are looking for an experienced
Databricks Data Engineer, with expertise in Databricks
and
AWS
for an upcoming project for one of the government organisations.
Required Skills
2+ years of experience in
Data Engineering
.
Demonstrated experience in
Databricks/AWS infrastructure
.
Demonstrated experience with
Azure Data Factory, SQL
and scripting languages like
Python
and
hands-on experience with AI/ML concepts and tools
.
Experience with
Microsoft Azure cloud platform
, including
Azure Data Lake Storage
Experience building
new pipelines
and
integration patterns
Excellent knowledge of
medallion architecture
and
data mesh concepts
Strong communication skills and the ability to adapt to shifting priorities
Responsibilities
Designing, building and maintaining scalable data pipelines using
Azure Data Factory, Databricks and Data Lakehouse.
Developing high-quality
data models, ETL/ELT processes
and
analytics solutions
Performing hands-on coding, debugging and optimisation across large, complex datasets
Identifying discrepancies and performance issues across data systems, and implementing improvements
Automating manual processes to increase efficiency and reliability
Supporting urgent data requests and collaborating across multiple internal teams
Translating technical concepts into clear, meaningful insights for non-technical audiences
Visa Status and Security Clearance
Candidates should have
Full Australian Work Rights