Position: Software Engineer Python / Databricks
Experience: 3 10 Years
Qualification: Bachelor's / Master's Degree in Computer Science, Engineering, or a related field
Work mode: Remote
Key Responsibilities
Databricks & Cloud Infrastructure
- Build and maintain multi-cloud Databricks infrastructure using Terraform, primarily across AWS and GCP.
- Support Unity Catalog administration, including metastores, workspaces, catalogs and schemas.
- Implement and maintain Databricks Asset Bundles (DABs).
- Develop deployment accelerators, templates and self-service tools for Databricks onboarding.
- Build scalable and reusable platform engineering solutions and golden paths.
Software & API Development
- Develop and maintain solutions using Python/PySpark and SQL.
- Design, develop and maintain RESTful APIs using frameworks such as FastAPI or Flask.
- Build automation and self-service tools to improve developer and data-team productivity.
- Contribute to data platform and infrastructure automation.
Data Engineering & MLOps
- Work with Spark, Delta Lake and MLflow.
- Support ETL/data engineering workflows and data pipeline development.
- Apply knowledge of data modeling and workflow orchestration.
- Contribute to MLOps and Data Engineering initiatives.
- Work with tools/frameworks such as Fivetran and Lakeflow Connect.
CI/CD & Operations
- Implement and maintain CI/CD pipelines and GitHub workflows.
- Support container versioning and deployment processes.
- Participate in incident management, monitoring and troubleshooting.
- Work with observability and incident-management tools such as PagerDuty.
- Contribute to platform documentation, training and cross-team knowledge sharing.
Preferred Experience - Experience working in infrastructure, platform engineering or data platform roles.
- Strong understanding of Databricks Medallion Architecture.
- Experience building self-service platforms, deployment templates and automation tools.
- Experience working in multi-cloud environments.
- Strong communication and collaboration skills with the ability to support and enable other engineering teams.