(1710) data engineer - bstd

Job Description

The main purpose of this position is to build, maintain and optimise business intelligence (BI) data pipelines that feed from various data systems across the South African Reserve Bank (SARB) and enable the support of Data as a Service (Daa S) to the SARB.

Responsibilities Implement data service standards and frameworks across the SARB to ensure optimised solutions and adherence to best practice, that is, data operations, development and operations as well as machine learning and operations. Take responsibility for BI data pipelines and flows for domain specific analytic implementations across the SARB. Ensure understanding of client’s data requirements in order to drive continuous development of data services and address evolving business needs. Design and build data pipelines that are robust, modular, scalable, deployable, reproducible and versioned for analytics and reporting purposes. Continually monitor and optimise domain specific data pipelines to ensure data availability and optimal long-term performance of data pipelines. Perform root cause analysis and implement permanent fixes. Maintain SLA adherence for data availability and incident resolution. Support releases, deployments and environment stability. Ensure compliance with SARB Data governance frameworks, Security standards as well as Audit and regulatory requirements. Implement new data engineering features. Implement data sharing technology services for the SARB, in alignment with the BI and Business Solutions and Technology Department (BSTD) Strategy. Implement ingestion from structured, semi-structured and external data sources. Diagnose, manage and enhance the performance of BI data marts and warehouses across the SARB by applying data engineering techniques such as distributed computing and data optimisation. Resolve data issues across BI data marts, data warehouses and data lakes. Implement initiatives to ensure compliance and adherence to security and application standards with respect to all BI data services. Identify and manage the mitigation of risks relating to domain-specific BI data services. Proactively engage and problem-solve with cross functional stakeholders – from technical data teams to managers – to address their data needs in order to build impactful analytics solutions. Provide reporting and recommendations on data service performance, improvements and data availability for domain-specific solutions to management. Keep abreast of industry best practices and technologies and lead implementation thereof to optimise effective and efficient data pipelines and services. Impart knowledge of the technical environment to other data engineers, systems development, database administrator, infrastructure and enterprise architecture and enterprise information management teams. Qualifications

To be considered for this position, candidates must be in possession of:

A Bachelor’s degree (NQF 7) in Computer Science, Engineering, Mathematics, Information Management, Technology or an equivalent qualification. Five to eight years’ experience in building, maintaining and optimising data pipelines and services.

Additional requirements include:

Ability to write clean, maintainable, scalable and robust code in object-oriented language, e.g., Python, Scala, Java, in a professional setting. Proven experience building data pipelines in production for advanced analytics use cases. Experience working across structured, semi-structured and unstructured data. Experience with database technologies such as Microsoft SQL Server, Oracle Database, My SQL, Postgre SQL, IBM Db2 and No SQL. Familiarity with distributed computing frameworks (e.g., Spark, Dask), cloud platforms (e.g., AWS, Azure, GCP, containerization) and analytics libraries (e.g., pandas, Num Py, matplotlib). Familiarity with time-series and graph database types and related technologies (Druid, Influx DB, Neo4 J, etc.) would be considered a plus. Practical knowledge of software engineering concepts and best practices, including Dev Ops/Data/Ops practices, Development Security and Operations and Data Operations, would be considered a plus. Ability to scope projects, define workstreams and lead, and mentor more junior colleagues. Continuous improvement knowledge and skill. Industry, organisational and business awareness, knowledge and skill. Data governance, compliance and quality assurance knowledge and skill. Business continuity planning knowledge and skill. Information technology (IT) enablement planning knowledge and skill. IT transformation and innovation knowledge skills. Release management knowledge and skill. Infrastructure design and development knowledge and skill. Workload estimation knowledge and skill. Technical analysis knowledge and skill. Systems integration knowledge and skill. IT governance knowledge and skill. Continued learning and/or professional development knowledge and skill.

In line with the SARB’s commitment to diversifying its workforce, preference will be given to suitable candidates from designated groups. People with disabilities are welcome to apply.

The SARB offers remuneration and benefits commensurate with the level of the position and in line with the market. The level at which the successful applicant will be appointed will depend on his/her competence and experience. #J-18808-Ljbffr