SRBR is looking for a Data Engineer with experience in Big Data to help our team to produce exceptional insights based on data analytics. The ideal candidate excels in creating and improving solutions to process and analyze data of high volume and high heterogeneity. The candidate will also work with our team of researchers to scale our Artificial Intelligence systems to impact the daily life of millions of users.
1. Contribute to business management by effectively solving business-related problems through data modeling/analysis/prediction.
2. Establish/support infrastructure that continuously grows to strategically analyze big data.
Role and Responsibilities
Propose, implement, and maintain optimal data pipeline architectures;
Design, implement, install, test, and maintain data management and processing systems;
Collaborate and offer support to software developers, machine learning engineers, and data scientists on troubleshooting and scaling up data-related initiatives, ensuring optimal, consistent solutions;
Integrate large, heterogeneous, complex datasets in order to meet functional / non-functional domain requirements;
Efficiently benchmark, select, and combine technological tools, processing systems, databases, algorithms, and programming languages to fit requirements;
Plan, deploy and maintain data infrastructures;
Propose and automate data-quality evaluation processes;
Plan, install/configure, and implement disaster recovery procedures/tools.
Solid Computer Science, Statistics, Mathematics, Computer Engineering, Electrical Engineering or similar formal education;
Experience on developing and deploying data solutions using Python, Scala, Java;
Experience with Big Data processing engines (Apache Spark);
Experience with Big Data machine learning toolkits (SparkML);
Experience with AWS Big Data environment (EC2, EMR, RDS, Aurora, S3);
Experience with data pipeline and workflow management tools (Azkaban);
Proven 3+ years of experience applying required skills in advanced and meaningful set of projects;
Written and verbal fluency in both Portuguese and English.
BSc in Computer Science, Statistics, Mathematics, Computer Engineering, Electrical Engineering or other similar areas obtained from top-tier universities.
[nice to have] MSc or Ph.D. in Computer Science, Statistics, Mathematics, Computer Engineering, Electrical Engineering or similar areas obtained from a top-tier university.
Skills and Qualifications