Create Alert
Email me similar jobs

Lead Data Engineer with Python (Databricks, Aws)

Responsibilities
- Develop and maintain reliable data pipelines for ingesting, transforming, and storing data from multiple sources
- Manipulate complex datasets and preprocess large-scale logs and time-series data using state-of-the-art tools and frameworks
- Leverage your knowledge of Python (Pandas, NumPy, etc.) to perform exploratory data analysis (EDA) and prepare data for business and analytical use cases
- Work collaboratively with cloud-based tools and infrastructure, focusing on scalability and performance optimization
- Utilize tools like Databricks, if experienced, or demonstrate a willingness to quickly ramp up on Databricks’ Lakehouse, Workflow, and ETL functionalities
Requirements :
- Proven experience of over 5 years as a Data Engineer or in a similar role, demonstrating a self-driven and problem-solving mindset
- At least 1 year of relevant leadership experience
- Expertise in Python for data processing, analysis, and manipulation (e.g., Pandas, NumPy, and advanced libraries)
- Proven experience working with large-scale logs, time-series data, and structured/unstructured data in diverse formats, preferably hardware/device data logs
- Knowledge of Databricks, including workflows, ETL processes, and working with Lakehouse architecture, is highly desirable
- Experience working with device data manipulation, such as medical data, IoT device data, hardware data, or similar
- Excellent command of written and spoken English (B2+ level)
Nice to have
- Exposure to PyTorch or TensorFlow for advanced data processing and AI/ML tasks
We offer
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Similar jobs

More from EPAM Systems, Inc.
EPAM Systems, Inc. 3 hours ago
EPAM Systems, Inc. 3 hours ago
EPAM Systems, Inc. 2 hours ago

Lead Data Engineer with Python (Databricks, Aws)

Apply Now
Back to search page