Chief Data Engineer with Python (Databricks, Aws)

If you possess advanced expertise in Python-based data workflows, have operated extensively with cutting-edge tools like Databricks, and excel in addressing the complexities of large-scale datasets, we would like to connect with you!
Responsibilities
- Drive the design and governance of enterprise-level data pipelines for scalable ingestion, transformation, and storage across multiple ecosystems
- Guide and own the use of Python and advanced data processing frameworks (e.g., Pandas, NumPy) for mission-critical exploratory data analysis (EDA)
- Oversee the adoption and operational alignment of advanced cloud tools and infrastructure, standardizing scalability and ensuring ongoing performance excellence
- Demonstrate expertise in Databricks, including full lifecycle oversight of Lakehouse architecture, workflows, and ETL optimization
Requirements :
- 7+ years in data engineering roles, demonstrating a high level of self-direction and strategic ownership
- Minimum of 2 years in leadership or managerial roles driving teams and data strategy at scale
- Participation in at least two full-cycle projects or multiple projects spanning various development phases
- Advanced proficiency in Python for complex data workflows and modeling using tools like Pandas, NumPy, and domain-specific libraries
- Extensive experience handling and strategizing for large-scale structured/unstructured datasets, particularly device, medical, IoT, or hardware-generated logs
- Comprehensive knowledge and practical experience with Databricks workflows, Lakehouse architecture, and ETL process optimization
- In-depth expertise working closely with device-derived data such as IoT logs, hardware diagnostics, or medical device outputs
- Exceptional communication and leadership capabilities coupled with fluency in English at a C1 level or higher
Nice to have
- Industry-recognized experience with PyTorch, TensorFlow, or equivalent advanced AI/ML processing systems
We offer
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.