Job Title:
Cloud Data Engineer (AWS, Snowflake \& Redshift)
Location:
Sydney/Melbourne
Job Type:
Contract/fulltime
About the Role:
We are seeking a highly skilled
Senior Cloud Data Engineer
to join our client’s team. In this role, you will work with cutting-edge cloud technologies to design and implement high-performance data management solutions. You will collaborate closely with customers to build scalable data architectures using AWS and Snowflake, ensuring seamless integration and optimal performance.
Primary Skills:
AWS (S3, Redshift, Glue, Kinesis, Athena, EMR, RDS, EC2, DynamoDB, ElastiCache, etc.)
Snowflake (Snowpipe, SnowSQL, Data Loading)
DBT (Data Build Tool)
Secondary Skills:
Teradata (SQL, TPT, MLOAD, FASTEXPORT)
DataStage
Big Data (Hadoop, Cloudera)
-
Key Responsibilities:
Architecting Scalable Solutions:
Collaborate with customers to understand their requirements and design cloud-based data architectures on AWS and Snowflake that operate at large scale with high performance.
Snowflake Data Management:
Develop and monitor
Snowpipes
for continuous data ingestion and perform data loading into Snowflake tables using
SnowSQL
(CLI).
Data Platform Implementation:
Work with AWS services like
EMR, Redshift, Kinesis, Athena, Glue, Lake Formation, S3, RDS
to build and manage data platforms.
Security \& Compliance:
Ensure the security of cloud-based solutions, including the use of
KMS keys
for EMR clusters, and meet compliance standards.
Collaboration:
Work with customers to advise on best practices and help transition data systems to production. Assist with troubleshooting and optimization.
Automation \& DevOps:
Automate deployment and infrastructure using
CloudFormation
and other DevOps practices. Familiarity with containerization and serverless computing is a plus.
Best Practices \& Knowledge Sharing:
Contribute to the AWS solution architect community by sharing learnings, reference architectures, and best practices.
Basic Qualifications:
Education:
Technical degrees in
Computer Science
,
Software Engineering
, or
Mathematics
.
Experience:
5+ years of experience in Data Engineering and hands-on experience with
Snowflake
and
AWS Services
(e.g.,
S3, Glue, Redshift
).
Snowflake Expertise:
Strong understanding of
Snowflake architecture
and performance optimization.
Teradata/DataStage:
Understanding of
Teradata
or
DataStage
architecture and experience with tools like
TPT, MLOAD
, and
BTEQ
scripting.
Data Engineering Skills:
Solid experience in
data modelling
,
ETL processes
, and
data warehousing
.
Security \& Compliance:
Knowledge of
cloud security
and
compliance
requirements.
Methodologies:
Familiarity with
Agile development
and
version control systems
.
Communication \& Leadership:
Strong interpersonal, communication, and leadership skills.
Certifications:
AWS Certified Data Analytics – Specialty (preferred).
Cloud \& Migration Experience:
Background in
cloud and data engineering
, with a focus on
data migration
.