Title: Data Engineer - AWS
Location: Sydney
Permanent Role.
Job Description: · A hands-on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics, and distribution.
· Good knowledge of data modeling and how to structure data within a data warehousing environment, while following best practice data management standards.
· Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
· Experience in real-time streaming using Confluence Kafka and AWS services.
· Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift, and DataZone.
· Experience in Data visualization tools such as Tableau/Power BI/QuickSight.
· Solid experience in Python, Spark and Terraform/Terragrunt.
Nice to have
· Experience working within a platform/product operating model where frameworks and development kits are leveraged to achieve standardization, re-use, and scale.
· A working knowledge of data mesh/data product concepts with federated data ownership at the domain-level, but operating on centralized platforms and governance.
· Experience working in the Capital Markets domain and understanding of derivative products.
Interested Candidates can share their CVs at "kranthi.kumar@carecone.com.au"