Job Summary
We are seeking a hands-on Databricks Data Engineer with experience building scalable data pipelines and supporting cloud-based data engineering initiatives. The ideal candidate will have strong expertise in Databricks, Apache Spark, Python, and SQL, with experience developing ETL/ELT workflows across cloud platforms.
Key Responsibilities
- Design, develop, and manage scalable data pipelines using Databricks.
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and integration.
- Utilize Apache Spark, Python, and SQL for data processing and analytics.
- Collaborate with data engineers, analysts, and business stakeholders to deliver reliable data solutions.
- Ensure data quality, performance optimization, and efficient pipeline execution.
- Support cloud-based data engineering initiatives across Azure, AWS, or GCP environments.
Required Skills & Experience
- Strong hands-on experience with Databricks.
- Proficiency in Apache Spark, Python, and SQL.
- Experience designing and maintaining ETL/ELT pipelines.
- Knowledge of cloud platforms such as Azure, AWS, or GCP.
- Strong understanding of data integration, transformation, and performance optimization.
- Excellent analytical, problem-solving, and collaboration skills.
Preferred Skills
- Experience working in modern cloud data platforms and analytics environments.
- Familiarity with data governance and best practices for scalable data engineering solutions