DemandTec is seeking a hands-on Data Engineer to design and build scalable data integration pipelines, maintain and optimize PostgreSQL databases, and develop RESTful services using the Spring framework. This role combines backend Java development, ETL orchestration, and database performance tuning to ensure reliable, performant data movement across systems. Ideal candidate will have performance and scalability front and center in design decisions and implementation. To succeed in this role, you need to be versatile, smart and have innate desire to build product features the right way. Finally, you should be able to collaborate and communicate with major stakeholders - product manager, other application teams, support and operations.
Responsibilities:
Develop APIs: Design and implement RESTful APIs and handle Java EE request/response lifecycle using the Spring framework (Spring Boot, Spring MVC).
Data Pipelines: Design and develop robust data integration pipelines to enable seamless data movement across systems.
SQL \& Procedures: Develop and optimize complex queries, stored procedures, and functions in PostgreSQL.
Database Optimization: Optimize PostgreSQL databases, including schema design, indexing, query optimization, and performance tuning.
Reliability: Ensure data integrity, performance, and availability of PostgreSQL databases.
ETL Development: Build, maintain, and enhance ETL workflows using tools such as Informatica, Talend, Apache NiFi, Azure Data Factory, or equivalent.
Support \& Troubleshooting: Provide ongoing support and troubleshooting for integration processes and database issues.
Security \& Best Practices: Apply best practices for secure data access and handling, and collaborate with teams to design scalable data architectures.
Requirements
Experience: 5+ years of hands-on Java development experience.
Java Proficiency: Strong proficiency in Java 8+ and core Java concepts (OOP, concurrency, collections).
Spring Ecosystem: Experience with Spring Boot, Spring MVC, Spring Data JPA, and Spring Security.
API Experience: Proven experience building and consuming REST APIs.
ETL \& Integration: 5+ years of experience in data integration and ETL development — preferably using PostgreSQL as a primary datastore.
SQL Skills: Strong understanding of SQL and relational database structures.
PostgreSQL Expertise: Strong expertise in PostgreSQL, including query optimization, database design, and stored procedures.
ETL Tooling: Proficiency in at least one ETL/orchestration tool (e.g., Apache Airflow, Azure Data Factory, Informatica, Talend, Apache NiFi).
Cloud Experience: Experience with cloud platforms (AWS, Azure, or Google Cloud) and their data services.
Scripting: Knowledge of scripting languages (Python, Shell, or Bash) for data processing and automation.
Autonomy \& Communication: Ability to set priorities and undertake complex tasks with minimal supervision; good written and verbal communication skills.