US citizens, Green Card Holders, and those authorized to work in the US are encouraged to apply. We are unable to sponsor H1b candidates at this time
Job Title:
GCP Data Engineer
Location: NYC
Duration:
Full\-time
Job Description:
Work closely with data scientists, data architects, business analysts, and other disciplines to understand data requirements and deliver accurate data solutions.
Analyze and document existing data system processes to identify opportunities for improvement.
Develop detailed process maps that describe data flow and integration across multiple systems.
Create a catalog of data fields and data structures across various databases and systems.
Compare data fields and structures to identify inconsistencies and discrepancies
Contribute towards gap analysis and recommend solutions for standardizing data fields and structures.
Recommend data directories to organize and manage data assets effectively.
Propose data standards and best practices.
Technical skills
Proven experience (5\+ years) in data engineering.
Proficiency in database management systems (e.g., SQL, NoSQL databases).
Experience with data warehousing and ETL (Extract, Transform, Load) processes.
Hands\-on experience working with cloud data platforms, with a strong preference for Google Cloud Platform (GCP) tools like BigQuery, Cloud Functions, and Dataproc.
Skilled in Python programming with working knowledge of Pyspark.
Experience developing ELT processes within a medallion architecture (Bronze, Silver, Gold layers).
Skilled in designing robust data validation and transformation processes to support downstream BI and analytics tools.
Knowledge of data modeling, data architecture, and data integration techniques.
A reasonable, good faith estimate of the minimum and maximum for this position is $110K/year to $120K/year with benefits