Databricks Engineer
Key Responsibilities:
Data Pipeline Development
o Develop and fine-tune data processing pipelines within Databricks.
o Implement performance optimization techniques.
Integration with Analytics Teams
o Work closely with data science and analytics teams to integrate data solutions.
o Support data architecture initiatives that incorporate Databricks technologies.
System Support and Troubleshooting
o Provide support for Databricks-based tools.
o Resolve operational and performance issues, ensuring system reliability.
Documentation and Knowledge Sharing
o Document technical processes and system behaviors.
o Lead knowledge transfer sessions to train team members on data processing techniques and tools.
Governance and Security Implementation
o Establish and enforce data governance and security protocols within Databricks.
o Ensure compliance with regulatory requirements related to data management.
Advanced english
remote