Purpose
A Data Engineer is responsible for building and maintaining efficient, reliable, and automated data pipelines and systems to ensure seamless data flow across the IBDF. This role focuses on ensuring data infrastructure availability, performance, and scalability through the use of automation and monitoring tools. A DataOps Engineer collaborates with cross‑functional teams to optimize data operations and troubleshoot incidents.
Accountabilities
- Experience in building and maintaining data pipelines using tools like Data Bricks.
- Strong knowledge of database management systems (SQL and NoSQL, e.g., PostgreSQL, MySQL, MongoDB).
- Familiarity with automation and monitoring tools to ensure data infrastructure performance.
- Knowledge of agile methodologies for project management and delivery.
- Excellent collaboration skills with operational and infrastructure teams.
- Attention to detail to troubleshoot and fix system errors.
- Time‑management skills to respond to incidents efficiently.
- Proactive mindset to optimize and improve existing processes.
- 3‑5 years of experience in Data Engineer or data engineering roles focused on pipelines.
- Proven expertise in managing cloud‑based data infrastructure (AWS, Azure, GCP). Ideal experience with Azure.
- Previous experience working with DataOps or DataOps methodologies.
Reporting Relationships
Primary Manager: Director, International Analytics Engineering
Education / Experience
Education: Bachelor's degree in computer science, data engineering, or a related field.
Certifications: AWS Certified DevOps Engineer or Google Cloud Professional Data Engineer.
Key Tasks
- Design and implement highly automated data pipelines.
- Monitor and troubleshoot data flows in real time.
- Implement data‑driven DevOps practices for pipelines.
- Manage permissions and access to data in secure environments.
- Optimize infrastructure to handle large volumes of data.
- Document processes for ease of maintenance and scalability.
Working Conditions
Work in a standard office‑based environment; non‑standard hours are a common occurrence.
Location
Bogotá, Colombia
ScotiaTech is a business unit within ScotiaGBS, a Scotiabank Group company located in Bogotá, Colombia. The ScotiaTech hub supports different technology systems and processes of the Bank and offers an inclusive, positive work environment and competitive benefits.
We value the unique skills and experiences each individual brings and are committed to creating and maintaining an inclusive and accessible environment for everyone.
Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at ScotiaTech; however, only those candidates who are selected for an interview will be contacted.
#J-18808-Ljbffr
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
