Key Responsibilities
Data Engineering & Development
- Design, build, and maintain scalable data pipelines using Python
- Develop ETL/ELT workflows for batch and near real-time data processing
- Work with structured and unstructured data across cloud/platform ecosystems
- Implement data transformation, validation, and quality frameworks
CI/CD & DevOps (GitHub Actions)
- Build and maintain CI/CD pipelines using GitHub Actions to automate:
-
- Code builds and validations
- Unit/integration testing
- Deployment of data pipelines and services
- Implement branching strategies, code reviews, and version control using Git
- Enable automated testing and release management for data workflows
- Integrate CI/CD pipelines with cloud platforms and data services