We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions.
The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration.
This role requires a deep understanding of algorithms, data structures, and best practices for building scalable and efficient systems.
Key Responsibilities
- Develop and maintain applications using Python and PySpark.
- Implement ETL/ELT processes and integrate data pipelines.
- Utilize Databricks for data processing and analytics.
- Perform code testing and analysis using tools such as Pytest and Pylint.
- Collaborate with cross-functional teams to design and deliver high-quality solutions.
- Apply architectural design patterns and best practices throughout the SDLC.
- Consume APIs (REST and others) for data integration.
- Work in an Agile development environment and participate in sprint planning and reviews.
- Use version control, ticketing systems, and CI/CD workflows for efficient development.
Required Qualifications
- Overall 10+ years of software development experience.
- Minimum 6 years of hands-on Python development experience.
- Strong experience with PySpark and Databricks.
- Proficiency in Azure DevOps and CI/CD practices.
- Experience with Python testing and code analysis tools (Pytest, Pylint).
- At least 4 years of full-time development experience using Python.
- At least 4 years working with T-SQL, XML, and enterprise schedulers.
- Solid understanding of algorithms, data structures, and architectural design patterns.
- Extensive experience in software development and SDLC.
- Familiarity with frameworks such as Django, Flask, Pyramid, or Tornado.
- Integration experience (ETL, ELT) with Python; SSIS knowledge is a plus.
- Strong analytical mindset and ability to create high-level product specifications and design documents.
- Proven collaboration and influencing skills.
Preferred Qualifications
- Experience with API management and advanced data integration techniques.
- Familiarity with cloud platforms and distributed systems.
- Exposure to Agile methodologies and tools like Jira.
#J-18808-Ljbffr