Data Engineer

Quantium (Sydney NSW, Australia) 13 days ago

For over 18 years Quantium have combined the best of human and artificial intelligence to power possibilities for individuals, organisations and society. Our solutions make sense of what has happened and what will, could or should be done to re-shape industries and societies around the needs of the people they serve.

Times and technology have changed, but this remains our goal. Instead of wrangling single, SQL-based databases, our data technology stacks have evolved to include:

  • Snowflake + Matillion
  • Scala/Spark processing on both Hadoop and/or Kubernetes
  • Scaled scoring workloads on Kubernetes, based on Python or Scala/Spark
  • Microsoft SQL Server / Integration Services / Analysis Services

In this role you’ll be part of a team delivering high quality data processing pipelines quickly and reliably to enable Quantium to go-fast and go-wide without sacrificing engineering integrity and still building reliable, maintainable systems.

FAQ:

How do your teams work?

We work in multi-discipline teams so you’ll be working alongside Data Scientists, Analysts, Delivery Managers, Product Managers, Testers and DevOps

What are you looking for in the ideal candidate?

  • We’re looking for Data engineers who have experience working with large, complex data sets, knowledge and experience in one or more data processing technologies, and a solid understanding of data modelling concepts
  • Ideally you have started your career working with SQL server and traditional ETL technologies but have recently gained exposure / experience building data pipelines using Spark / Scala
  • You’re a pragmatist, a true engineer who loves to solve complex issues
  • You take a balanced approach between knowing that data processing is highly dependent on the business rules and characteristics inherent in data, but are also driven to find patterns, synergies and efficiencies to enable scale

Skills & experience

Do you have a bullet point checklist for me to check off my suitability?

We know people are not bullet points but sure thing!

We are looking for you to bring:

  • Experience implementing data warehousing solutions in a large, commercial environment using Microsoft SQL Server (T-SQL, SSIS) - This is a foundational requirement for this role
  • Experience working with large, complex data-sets
  • A solid foundation in: dimensional data mart modelling concepts, data architectures for analytical processing and data modelling abstraction approaches
  • An awareness of considerations around structuring data on distributed systems to support analytic use cases
  • Contribute to design decisions
  • Can work on stories autonomously
  • A love for knowledge sharing, you know what works, but you’re also happy to learn new methods and technology

More about Quantium

We are passionate about creating opportunities for ourselves and each other. You will have access to relevant, meaningful, and actionable learning. We are growing our technical, professional, and leadership capabilities through our robust internal learning curriculum, team knowledge-sharing sessions, and our mentoring program.

We also believe there is more to a successful career than just hard work and recognise the need to balance personal and family commitments with work. We enjoy weekly group fitness sessions (being done virtually at the moment), team sports (we are looking forward to these starting again), and well-being resources.

Quantium are an equal opportunity employer and values diversity. We are a multicultural team of various beliefs, sexual orientations, and gender identities. We celebrate our diversity of race, religion, colour, national origin, gender, sexual orientation, age, marital status, and disability status.

Data Engineer

Apply On Company Site
Back to search page
;