Elevate your career as a Lead Data Engineer focusing on migrating from Glue/Redshift to Databricks. Utilize your expertise in Apache Spark and AWS services to drive impactful data platform transformations.
We are seeking a Lead Data Engineer with over 10 years of data engineering experience, including a minimum of 2 years in a tech-lead role. Your hands-on production experience with Databricks and strong SQL skills will be crucial as you lead substantial data migration efforts. You’ll work collaboratively with both technical and non-technical stakeholders to ensure a smooth transition and optimization of our data platforms.
Key Responsibilities:
• Direct the migration process from Glue and Redshift to Databricks
• Optimize performance using Apache Spark and Databricks features
• Oversee production jobs utilizing AWS Glue and Amazon Redshift
• Produce clear design documentation and migration plans
• Communicate effectively with team members and executives
Requirements:
• 10+ years of data engineering experience
• 2+ years in a lead engineer role
• Expert knowledge of SQL and Python
• Familiarity with data modeling and lakehouse architecture
• Proven migration experience with data platforms
Bring your leadership skills and AWS expertise to transform our data architecture and drive success.
#J-18808-Ljbffr