Overview
Our client has an exciting opportunity for somebody to take a lead role in a rapidly growing industry and with a rapidly growing company. They foster a fun environment and wonderful culture while offering a fully remote working environment.
As a Data Engineer, you will be the foremost authority on the data infrastructure and be responsible for the innovation, implementation, documentation, and education for the company regarding our data. Essential Functions include the following:
Duties
Design, develop, and maintain efficient, scalable data pipelines to process data from many sources.
Implement solutions to consolidate data from different sources into a centralized location, such as a data warehouse or data lake.
Maintain data security, quality, and integrity across all systems.
Work with key stakeholders to understand evolving data needs as it pertains to commerce data, reporting or marketing initiatives, and implement the proper architecture and tools to support analytics, reporting and dashboard requirements.
Integrate machine learning and AI tools into LNY to support secure, stable and efficient data systems.
Stay up-to-date with emerging technologies in data engineering and data modeling and recommend improvements to existing processes.
Implement APIs using popular frameworks and languages suited for web services, such as Flask or FastAPI for Python.
Oversee the development of high-quality Python code across data engineering and AI projects, enforcing best practices and standards through code reviews, pair programming, and maintaining documentation.
Expected Skills
Expert understanding of Python, or similar data programming languages (such as Java or Scala, etc.)
Experience with data integration tools and frameworks such as; Apache Airflow, Luigi, Dagster, Pandas, PySpark, Singer, or similar tools.
Strong proficiency in SQL and relational and non-relational databases.
Ability to create and maintain scalable cloud solutions utilizing AWS, Google Cloud Platform, or Azure.
Experience creating and utilizing RESTful APIs.
Experience working in an Agile development environment with Agile principles and methodologies.
Ability to troubleshoot and debug complex data integration and ETL issues.
Experience with e-commerce data and analytics requirements
Understanding of ERP, CRM, OMS, and other Commerce related concepts.
Familiarity with data visualization tools such as Tableau and PowerBI.
Pay: From $120,000.00 per year
Benefits:
401(k) matching
Dental insurance
Flexible schedule
Health insurance
Life insurance
Paid time off
Vision insurance
Experience:
Python: 4 years (Required)
Work Location: Remote