Senior Data Engineer
Company:
Celebal Technologies
Work Model:
Hybrid (No permanent remote)
Location:
Edmonton, Calgary Canada
Position Overview
Celebal Technologies is seeking an experienced
Senior Data Engineer
to design, build, and maintain scalable data infrastructure and systems. In this role, you will enable the collection, storage, and analysis of large and complex datasets while ensuring data is accessible, reliable, secure, and high quality. You will collaborate closely with data scientists, analysts, architects, and engineering teams to deliver robust data solutions that support analytics and business decision-making.
Key Responsibilities
Data Pipeline Development:
Design, develop, and maintain robust, scalable, and efficient data pipelines for processing large datasets.
Data Integration:
Integrate data from diverse sources, including databases, APIs, and third-party systems, ensuring data consistency and quality.
Data Warehousing:
Design and implement data warehousing solutions to support analytics, reporting, and business intelligence.
Performance Optimization:
Optimize and tune data processing systems for performance, scalability, and cost efficiency.
Data Quality \& Governance:
Implement data quality checks, monitoring, and governance practices to ensure data accuracy, integrity, and compliance.
Continuous Improvement:
Identify opportunities to enhance data quality, optimize pipelines, and improve overall data infrastructure efficiency.
Collaboration:
Work closely with data architects, data scientists, analysts, and stakeholders to understand data requirements and deliver effective solutions.
Documentation:
Maintain clear, accurate, and comprehensive documentation of data architectures, pipelines, and processes.
Cross-Functional Support:
Collaborate with application, security, infrastructure, and operational teams to resolve design, implementation, and operational issues.
Knowledge, Skills, and Abilities
Strong experience in
data modeling, database design, data storage, and data analytics
.
Proficiency in
Python, Java, or Scala
.
Hands-on experience with
data processing frameworks
such as Apache Spark, Hadoop, or similar technologies.
Advanced knowledge of
SQL
and experience with relational databases such as
MySQL
.
Experience designing and supporting
ETL architectures
using Oracle, SQL Server, and MySQL across multiple operating systems.
Experience with
cloud platforms
, preferably
Microsoft Azure
.
Knowledge of the
ITIL service delivery framework
, including change management and best practices.
Familiarity with
data governance principles and practices
.
Strong analytical, problem-solving, and troubleshooting skills.
Excellent verbal and written communication skills with strong attention to detail.
Commitment to data accuracy, integrity, and continuous improvement.
Continuous learning mindset with a desire to stay current with emerging data engineering and analytics trends.
Preferred Qualifications
Bachelor’s degree in
Computer Science, Information Technology
, or a related field.
7+ years
of experience in data engineering or a related role.
Relevant
data engineering or cloud certifications
.
Knowledge of
machine learning concepts, techniques, and tools
.