Data Engineer Azure / Databricks

Mission Overview:

This role involves building data pipelines (ingestion/transformation), industrializing ETL/ELT processes, scripting, automation, quality/observability, and participation in data extraction work packages.

Key Responsibilities:

Develop and optimize data pipelines using Databricks and associated technologies such as Spark and notebooks.

Implement data solutions utilizing Python and SQL within a Delta Lake environment.

Handle data orchestration through tools like Azure Data Factory (ADF) or Databricks jobs.

Ensure CI/CD processes and testing for data solutions, focusing on performance and reliability.

Collaborate closely with international teams, with a primary location in Belgium, and possible interactions with teams in Portugal or other countries.

The role offers flexibility as either an employee or freelance consultant, with immediate engagement as the architecture is established, followed by a ramp-up for migration.

Qualification Requirements:

Proficiency in Databricks, Spark, Python, SQL, and Delta Lake.

Experience with data orchestration and automation, with tools such as ADF and Databricks jobs.

Solid understanding of CI/CD processes in data contexts.

Fluency in English; additional proficiency in French or Dutch is considered a plus.

Minimum confirmed experience at a senior level, with at least one profile as a lead.

Consultancy Advantages Integration:

Consultancy Nature of Work:

Engage in on-site work at client locations as a Keystone Solutions consultant, providing specialized expertise and problem-solving capabilities.

Dynamic Projects:

Embrace the opportunity to work on diverse challenges across a variety of client projects, enhancing the breadth of your experience.

Turbo-Charged Learning and Development:

Benefit from Keystone Solutions’ strong support for your professional development through exposure to the latest industry technologies and practices.

Ambition Skyrocketing within a Consultancy Framework:

Experience career growth through engaging in varied client projects and contributing to innovative solutions, all while being supported by Keystone Solutions’ career development frameworks.

Emphasizing Keystone Solutions’ Values in a Consultancy Context:

As a “K-Stone,” bring Keystone Solutions’ core values—integrity, excellence, and collaboration—into every client engagement, ensuring impactful contributions and building lasting relationships.

Role-Specific Enhancements Reflecting Consultancy Work:

For professionals with a background in data science and/or electrical engineering, utilize your domain expertise across multiple client scenarios, offering unique solutions as a consultant while deepening your skills.

Comprehensive Review for Consultancy Clarity and Integrity:

This job description clearly communicates the consultancy model, specific role requirements, and the dynamic benefits of being a Keystone Solutions consultant.

Final Preparations for Publication:

If you are ready to tackle technical and strategic challenges in a dynamic consultancy environment, apply today at Keystone Solutions Career Portal.

Mission Overview:

This is a consultancy mission delivered by Keystone Solutions for our client in Belgium. As a Keystone Solutions consultant, you will build data pipelines (ingestion/transformation), industrialize ETL/ELT, perform scripting, drive automation, ensure data quality/observability, and participate in extraction work packages. All activities will be carried out in close collaboration with the client under Keystone Solutions’ consultancy model.

Key Responsibilities:

Build the pipelines (ingestion/transformation).

Industrialize ETL/ELT.

Scripting and automation.

Data quality and observability.

Participation in extraction work packages.

Required Technical Skills:

Databricks (Spark, notebooks).

Python/SQL.

Delta Lake.

Orchestration (e.g., Azure Data Factory/Databricks jobs).

Data CI/CD, testing, performance.

Seniority:

Confirmed to senior, with at least one lead profile required for the mission.

Languages:

English; French/Dutch is a plus.

Location:

Belgium, with possible interfaces with Portugal and other countries.

Contract Type:

Employee or freelance.

Timing:

Start as soon as the architecture is set, followed by a ramp-up on the migration.

Consultancy Model at Keystone Solutions:

As a Keystone Solutions consultant, you will work on-site at the client (and hybrid as appropriate), integrating with their teams while benefiting from Keystone’s methods, coaching, and community. You will deliver outcomes on the client’s platform and processes, bringing Keystone’s best practices in Databricks engineering, quality, and automation.

Dynamic Projects and Impact:

Join a mission where you will tackle real-world data challenges on modern platforms. Being part of Keystone Solutions means exposure to diverse client environments over time, enabling you to apply Databricks, Delta Lake, orchestration, and CI/CD expertise across multiple contexts while delivering measurable impact from ingestion to production.

Turbo-Charged Learning and Development:

Keystone Solutions supports your growth with hands-on mentoring, certifications (e.g., Databricks), knowledge-sharing sessions, and access to internal accelerators for data quality, observability, and deployment automation—so you can raise the bar on every client engagement.

Ambition Skyrocketing within a Consultancy Framework:

Whether you are a confirmed or senior engineer, or stepping into a lead role, our consultancy model gives you the runway to own work packages, guide best practices, and evolve into architecture and leadership responsibilities across missions.

Keystone Solutions’ Values in a Consultancy Context:

As a K-Stone, you bring craftsmanship, client partnership, curiosity, integrity, and tangible impact to every project. These values shape how we deliver: robust engineering, clear communication, and a relentless focus on outcomes for our clients.

Role-Specific Advantages for Databricks Data Engineers:

Apply Databricks, Spark, and Delta Lake at scale, from ingestion frameworks to optimized transformations.

Implement orchestration with ADF/Databricks Jobs, enforce data CI/CD, and embed testing and observability by design.

Drive performance tuning and industrialization to ensure reliable, production-grade data pipelines.

Collaborate with international stakeholders (including Portugal/abroad) while delivering on-site value in Belgium.

Work as a Keystone Solutions Consultant:

You will perform all listed responsibilities as a Keystone Solutions consultant, embedded with the client’s teams, contributing to their architecture (once set) and leading the ramp-up on migration with Keystone’s standards for quality, automation, and performance.

Ready to apply?

If you are ready to tackle technical and strategic challenges in a dynamic consultancy environment, apply today at Keystone Solutions Career Portal.