Job Description

Versent is a rapidly growing services, product and platform company that works exclusively on AWS. We have offices in Sydney, Melbourne, Brisbane, Perth, Denver and Singapore and have grown to over 350 people in just five years! We are the Australian AWS Consulting partner for the Year for the 3rd time and recently became a Snowflake and Talend Partner.


We believe in bringing craftsmanship back to technology, because as technology artisans, we passionately care about the quality outcomes we leave behind.


We have some of the best techs in Australia and due to client demand, we're looking to expand our data team with a number of Lead Data Engineer(s) .

Our Data Engineers know their craft, and know it well. We will also need you to have the right soft skills to listen to and understand other ideas, plus know and see the patterns from your experience across a variation of complex implementations.


Our Lead Data Engineers build upon the skill set of the Senior Data Engineer role, Lead Engineers understand where and how to get going on issues, what discipline to ensure the team follows and what is an acceptable level of technical debt that the team is allowed to accumulate. A Lead Engineer understands how to implement Team Based Decisioning within a known framework and ensures that everyone is working.


The above and beyond skillset of the Senior Engineer is the ability to bring the customer on a journey, helping them understand they aren’t the first to build a scalable, reliable and auditable big data pipeline, to sit with them and help get things over the line and to help win “hearts and minds” across customers internally where Cloud or Big Data analytics is still a foreign term or used in name but not in practice.

Requirements

Our Lead Data Engineers exhibit the following behaviours;

  • Ability to lead change with customers
  • Lead engineers understand what requirements may be missing or required to complete a solution
  • Focus on delivery and outcomes with a customer
  • Has the experience to authentically tell the customer when something is an anti-pattern or will fail
  • Can design Data Patterns for re-use and re-implementation (factory based approach)
  • Continually strive toward optimal extraction, transformation, loading and management of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
  • Can lead small team (2 - 3) DataOps outcomes on a customer site
  • Understand traditional and emerging data pipeline delivery as well as CI and CD processes
  • Lead and mentor data engineers

People wanting to become Lead Data Engineers at Versent have the following skills;

  • From a development or operations background (or an existing DevOps Team)
  • Understanding what getting something done done looks like (documentation, testing, operational requirements, continuous improvement of process)
  • Have experience with the AWS ecosystem (particularity Kinesis, Glue, Redshift, EMR, RDS, Aurora, DMS, etc…)
  • Have exposure to the broader Hadoop and broader data warehouse ecosystems (Cloudera, Hortonworks, Exadata, Greenplum, Terradata, SAP Hana etc)
  • Have some experience with industry leading ETL tools, Informatica, Talend, Snowflake
  • Familiar with data modelling concepts
  • Familiar with end user analytic tools such as SAS, Tableau, etc
  • Can demonstrate what discipline looks like in the AWS ecosystem
  • Advanced experience in one or many of the following programming languages – SQL, Python, Java, SCALA etc

Example Tasks for a Lead Data Engineer;

  • Participating in agile rituals (stand ups, planning sessions, retros, etc...)
  • Working on stories and tasks
  • ·Conducing Code Reviews (PR's or Pair Programming)
  • Conduct and Participate in Technical Spikes
  • Take Ownership of their card moving to "done, done" which may include some ETL and Data Pipeline development, Infrastructure provisioning, DataOps, Security

Benefits

At the core of what we do, we're an engineering company. We value our people more than commercials and put culture at the centre of everything.


We do weekly internal tech meetups with food and drinks, host game nights, organise Hackathons, pay for your AWS training and certifications, and other relevant certs (if it's something you want to do).


We have many social events, often supporting charity initiatives such as TourXOz and RUOK Day. We also have family functions such as lawn bowls, company picnics etc. We have a paid parental leave program.


Save Job