Key Responsibilities
Architect and implement robust, scalable data pipelines for ingesting, processing, and storing large volumes of e-commerce data, including sales transactions, customer behavior, inventory levels, and flash sale performance metrics.
Collaborate with cross-functional teams (e.g., product, marketing, and operations) to understand data needs and deliver high-quality ETL (Extract, Transform, Load) processes that enable real-time insights into luxury market trends and member preferences.
Optimize data storage and querying solutions using cloud-based technologies to handle peak traffic during flash sales events.
Ensure data quality, security, and compliance with regional regulations (e.g., GDPR equivalents in Asia), while implementing monitoring and alerting systems for data pipelines.
Integrate advanced analytics tools to support AI-driven recommendations, personalization, and sustainability reporting for our premium brand partners.
Troubleshoot and resolve complex data issues, ensuring minimal downtime in a high-availability e-commerce setting.
Stay abreast of emerging technologies in big data and e-commerce analytics to continuously improve our data ecosystem.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
Minimum of 10 years of professional experience in data engineering, with at least 5 years in a senior or lead role, preferably in e-commerce, retail, or high-volume transactional environments.
Expertise in building and maintaining data pipelines using tools such as Apache Kafka, Apache Spark, Airflow, or similar ETL frameworks.
Strong proficiency in programming languages like Python, Scala, or Java, with experience in SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, BigQuery).
Hands-on experience with cloud platforms such as AWS or Azure,
Proven track record of delivering scalable solutions in fast-paced, agile environments.
Excellent problem-solving skills, with a focus on performance optimization and reliability.