Role: Senior Data Engineer
Location: Dublin, Ireland
Full time Employment
Tech Stack:
Programming language: Java/Scala/Python
Data processing framework: SparkBigData Hadoop
Frameworks: Hive, impala, oozie, airflow, HdfsAny cloud provider experience. Services like S3, Athena, EMR, Redshift, Glue, Lambda etc..
Data \& AI platform: Databricks
Role and Responsibilities:
- Build, optimize and maintain ETL pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark).
- Collaborate with teams to ensure efficient and reliable data processing.
- Perform data modelling, quality checks, and system performance tuning.
- Contribute to modernization efforts, including potential cloud or Databricks integration.