Your Role And Responsibilities
Data Engineer, IBM Corporation, Austin, TX (Up to 40% telecommuting permitted):
Apply engineering and business knowledge to help design data pipelines to feed analytics/AI solutions for Industrial sector clients.
Develop code for sourcing/extracting data required for the business use case in an automated fashion.
Launch high performance data pipelines in Python/Spark to process and transform extracted data.
Establish mechanisms to feed the processed data for AI and Business Analytics applications.
Update the finished data pipelines in production on public cloud platforms using modern orchestration and deployment tools.
Design AI and Analytics solutions for industrial sector clients.
Comprehend the business use case to be solved with AI/Analytics approaches and identify the potential data elements required to do so by performing ad-hoc data analysis as well as working with customer data stewards and business SMEs.
Gather industry knowledge to understand typical business processes at industrial sector clients and how they usually generate and store data.
Engage in transactional application that helps close vehicle sales to individual customers that generate data in a very different format and velocity compared to an application used for B2B (Business to Business) sales.
Analyze data for quality, reliability and any potential privacy/security considerations.
Identify potential data elements and formulate it by using the main tools.
Utilize: MySQL, PostgreSQL, Apache Cassandra, Power BI, Tableau.
Required: Master’s degree or equivalent in Computer Science, Engineering or related (employer will accept a Bachelor's degree plus five (5) years of progressive experience in lieu of a Master’s degree) and one (1) year of experience as a Data Engineer, Data Analyst or related. One (1) year of experience must include utilizing MySQL, PostgreSQL, Apache Cassandra, Power BI, Tableau. $174,533 to $190,000 per year. Full time. D165.
Required Technical And Professional Expertise
Master’s degree or equivalent in Computer Science, Engineering or related (employer will accept a Bachelor's degree plus five (5) years of progressive experience in lieu of a Master’s degree) and one (1) year of experience as a Data Engineer, Data Analyst or related. One (1) year of experience must include utilizing MySQL, PostgreSQL, Apache Cassandra, Power BI, Tableau