Job Summary
We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data warehouses to support advanced analytics and business intelligence initiatives. This role requires a strong understanding of big data technologies, cloud platforms, and database management to enable efficient data processing and analysis across the organization.
Duties
Design, develop, and optimize data pipelines using tools such as Apache Spark, Hadoop, and Informatica to handle large-scale datasets.
Build and maintain data warehouses utilizing SQL Server, Oracle, and other relational databases to facilitate seamless data retrieval and analysis.
Implement ETL processes with technologies like Apache Hive, VBA, Bash (Unix shell), Shell Scripting, ensuring data quality and integrity.
Collaborate with cross-functional teams in Agile environments to gather requirements and deliver scalable data solutions.
Develop automation scripts and workflows using Python, VBA, Bash, or Shell Scripting to streamline data processing tasks.
Manage cloud-based data infrastructure on AWS services for scalable storage and computing solutions.
Perform database design, schema modeling, and optimization for efficient query performance.
Conduct analysis of large datasets to extract insights that support strategic decision-making.
Ensure compliance with security standards and best practices for data governance.
Skills
Proficiency in AWS cloud services for data storage and processing.
Strong experience with big data technologies such as Hadoop, Spark, Apache Hive.
Expertise in SQL-based databases including Microsoft SQL Server, Oracle, and Data Warehouse architectures.
Hands-on experience with Java programming for data processing applications.
Familiarity with Informatica for ETL development.
Knowledge of analytics tools and techniques for deriving insights from complex datasets.
Strong understanding of database design principles and analysis skills.
Experience working within Agile development methodologies.
Programming skills in Python, VBA, Bash (Unix shell), Shell Scripting for automation tasks.
Knowledge of analytics frameworks and tools to support business intelligence initiatives. This position offers an exciting opportunity to work on innovative projects at the forefront of data technology while contributing to strategic organizational goals through advanced data engineering solutions.
Job Type: Fixed term contract
Contract length: 12 months
Pay: $69,656.02-$80,881.62 per year
Work Location: Remote