Title: Databricks Developer
Location: Plano, TX (Remote)
Type: Contract
Description:
- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.
Required Skills:
- Extensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experience
- Proficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experience
- Strong understanding of cloud data architectures (Azure Data Lake, AWS S3, GCP Storage) and related ecosystem - 5+ years of experience
- Experience with CI/CD tools and DevOps practices for data engineering - 5+ years of experience
- Familiarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experience
- Solid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experience
- Excellent communication and problem-solving skills - 5+ years of experience