👨🏻‍💻 postech.work

Data Engineer MQ to Big Data

Pro Informatik AG • 🌐 In Person

In Person Posted 11 hours, 40 minutes ago

Job Description

Responsibilities

Data engineering to build a global data platform in a banking environment envisioned to be the bank-wide single source of truth for reporting and analytics purposes

Map data flows from traditional systems (mostly Oracle DWH) to Big Data datalake via IBM MQ and XML-based pipelines

Develop IBM MQ native based schemaless data ingestion

Develop XML based ingestion pipeline into Data Platform using Hive/S3

Build and prepare data pipelines

Data trouble-shooting

Support for the business side

Requirements

Several years of experience in data engineering (on traditional on-prem data warehouses and modern Big Data platforms and datalakes)

Experience in data mapping

Experience with Big Data platforms (Hadoop, Hive/S3, Spark)

Experience with traditional data warehouses (Oracle databases)

Advanced experience with IBM MQ and XML-based ingestion pipelines

Fluent in English

Nice to have

Experience with Trino, Airflow/Nifi and Kafka

Experience in banking IT platforms

Personality

Strong interpresonal skills

Resilient to working under pressure

Get job updates in your inbox

Subscribe to our newsletter and stay updated with the best job opportunities.