Data Engineer - Video Generation
About Us
We are a cutting-edge AI startup specializing in next-generation video generation technology based in Hong Kong. Our mission is to push the boundaries of what's possible in AI-driven video generation through innovation of foundation model. As a growing startup, we offer a dynamic environment where your research can have immediate impact on technology development.
Position Overview
We are seeking a skilled Data Engineer to design, build, and optimize our data pipelines and infrastructure. The ideal candidate will have strong experience in handling large-scale video datasets and building efficient data processing systems for machine learning applications.
Key Responsibilities
Design and implement scalable data pipelines for processing, storing, and managing large-scale video datasets
Build and maintain data infrastructure for training data preparation and feature engineering
Develop efficient ETL processes for various data sources including videos, images, and metadata
Create and optimize data storage solutions for high-performance data access
Implement data quality monitoring and validation systems
Collaborate with ML researchers to support model training and evaluation needs
Ensure data security and compliance across all data operations
Required Qualifications
Master's degree in Computer Science, Software Engineering, or related field
8+ years of experience in data engineering roles at tech companies
Strong programming skills in Python and SQL
Experience with big data technologies (Spark, Hadoop ecosystem)
Proven track record in building and maintaining data pipelines
Experience with cloud platforms (AWS/GCP/Azure or Alibaba Cloud/Tencent Cloud)
Strong understanding of data modeling and database design
Preferred Qualifications
Experience with video processing and storage systems
Knowledge of ML/AI data pipeline requirements
Familiarity with distributed computing systems
Experience with streaming data processing
Understanding of data privacy and security best practices
Experience with Cloud services and data infrastructure
Bilingual proficiency (English/Chinese)
Technical Skills
Data Processing \& Storage
Databases: PostgreSQL, MongoDB, Redis
Big Data: Spark, Hadoop, Hive
Data Warehousing: Snowflake, Amazon Redshift
Stream Processing: Kafka, Apache Flink
Cloud \& Infrastructure
Cloud Platforms: AWS/GCP/Azure, Alibaba Cloud/Tencent Cloud
Container Orchestration: Docker, Kubernetes
Infrastructure as Code: Terraform, Ansible
Programming \& Tools
Languages: Python, SQL, Shell scripting
ETL Tools: Airflow, Luigi
Version Control: Git
Monitoring: Prometheus, Grafana
Video Processing
FFmpeg, OpenCV
Video compression and optimization techniques
Video metadata extraction and management
What We Offer
Opportunity to build critical infrastructure for cutting-edge AI technology
Competitive salary and equity package
Flexible work arrangements
Professional development opportunities
Modern tech stack and tools
Collaborative and innovative work environment
Health and wellness benefits
Location
Hong Kong (on-site, Hong Kong Science and Technology Park)
Expected Impact
Shape the foundation of our data infrastructure
Influence architectural decisions
Build and mentor a world-class technology team
To Apply:
Please submit:
Detailed CV with publications and major projects
Brief description of the most complex data pipeline you've built
Links to any open-source contributions or technical blogs
To apply or learn more about this position, please contact career@videorebirth.com.