ITProFound is a Global employer serving the USA, INDIA and Canada. The company develops Software Products and solutions, as well as Project Implementation, besides staff augment to the direct clients.
Job Description
We do have a job opening for DataOps/Cloud Data Engineer - Senior for our direct client Province of Ontario. The position details are given below:
Duration: 1 year + Extension
Type: Onsite
Responsibilities
- Design, develop, test, implement, and troubleshoot data pipelines using various tools such as Databricks, Azure Data Factory, AWS Glue, complex data transformation procedures, data models for data warehouses and lakehouses.
Experience and Skill Set Requirements
- Data manipulation/analysis using pandas and pyspark.
- Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data.
- AWS and/or Azure services.
- Cloud data warehouse solutions such as AWS Redshift.
- Data lakehouse solutions such as Databricks (Delta Lake).
- Data processing orchestration/automation.
- ETL tools such as Azure Data Factory, AWS Glue and cloud agnostic tools such as Informatica IDMC.
- Data modeling & architecture: relational and dimensional modeling.
- Full SDLC from requirements gathering, design, implementation, testing to deployment and production support.
- Project management (agile/scrum and waterfall).
- Change and Incident management.
- Communication, presentation and negotiation skills.
- Consulting, problem-solving and decision-making skills.
- Experience working in OPS and/or public sector in general.
MUST HAVES
- Experience using AWS Services such as Glue, Step Functions, Lambda, S3.
- Extract/Transform/Load data using tools such as Informatica IDMC.
#J-18808-Ljbffr
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
Similar jobs
Show more