Databricks developer

TA Associate- APAC

Reach out to me on +61290559939 or [email protected]

Exp- 8+yrs

Job Type- Contract

Location- Sydney

JD-

• Minimum 8+ years of IT experience with 5+ years of hands‑on experience in designing, developing, implementing, and maintaining data solutions with Databricks.
• This role requires close collaboration with various teams to gather data requirements, build scalable data pipelines, and ensure the overall solution is reliable, available, and optimized for high performance.
• Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc.
• Integrating Databricks with various ETL/Orchestration tools and perform required operations.
• Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL with Python/Scala and SQL as language.
• Knowledge of latest Databricks features.
• Hands on knowledge on Databricks native features like Workflows, Delta Live Tables, Unity CatLog etc.
• Expertise in workspace and cluster configuration, performance tuning, cost optimization, data security, and log monitoring.
• Experience with Spark Structured Streaming jobs with Autoloader integrating with different streaming platforms.
• Experience in building optimal data pipeline architecture with knowledge and best practices from Databricks platform.
• Fair understanding of Data Modelling and defining conceptual logical and physical data models.
• Knowledge of different Azure Could services.
• Nice to have - exposure to AI/Gen AI skill and/or any associate or professional level Databricks/Cloud certifications.

Interested candidates can share their updated resumes on [email protected] OR reach out to me on +61 2 9055 9939.

Seniority level

Mid‑Senior level

Employment type

Contract

Job function

Information Technology