Databricks Developer – Python & Scala

dhanutek (Dallas TX, USA) Follow 6 hours ago

Apply Now

Position Title: Databricks Developer – Python & Scala
Location: Dallas, TX – onsite
Duration: 12+ Months with possible extension
Experience: 7+ years
Job Description We are looking for an experienced Databricks Developer with strong expertise in Python, Scala, Apache Spark, and cloud-based data engineering. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and data processing solutions using the Databricks platform.
Required Skills:

7+ years of experience in Data Engineering / Big Data development.
Strong hands-on experience with Databricks.
Strong programming experience in Python and Scala.
Excellent knowledge of Apache Spark / PySpark.
Strong experience with SQL and relational databases.
Hands-on experience with Delta Lake / Delta tables.
Experience developing and managing Databricks notebooks and workflows/jobs.
Strong understanding of ETL/ELT concepts and data pipeline architecture.
Experience with cloud platforms such as Azure or AWS.
Experience with Git and CI/CD.
Strong problem-solving and communication skills.

Preferred Skills:

Experience with Azure Data Factory (ADF).
Experience with Azure Data Lake Storage (ADLS).
Experience with AWS S3, Glue, EMR, or similar services.
Knowledge of Kafka or other streaming technologies.
Experience with Databricks Unity Catalog and data governance.
Knowledge of Terraform and Infrastructure as Code.
Experience with Jenkins/Azure DevOps.
Experience working in large enterprise environments, preferably telecommunications.