Data Engineer (Inside IR35)
£425 Per day
SC Cleared - A must to be considered for this opportunity
London
To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery.
Key Responsibilities
Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources.
Develop and manage data models, schemas, and metadata to support analytics and reporting needs.
Collaborate with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability.
Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability.
Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark).
Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow).
Ensure adherence to data governance, security, and privacy policies.
Document data architecture, pipelines, and processes to support transparency and knowledge sharing.
Contribute to the development of a modern data platform that supports both real-time and batch processing.