Manager, Data Engineering

IHS Markit (Gurgaon, HR, India) 5 hours ago

Position title: Manager Data Engineering

Years of Experience: 10+ years

Location: Gurgaon

Department: Automotive Mastermind

Shift Timings: 12 pm – 9 pm

Department overview

AutomotiveMastermind provides U.S. automotive dealers with AI/behavior prediction analytics software and marketing solutions that improve the vehicle purchase process and results. The company’s cloud-based technology helps dealers precisely predict automobile-buying behavior and automates the creation of microtargeted customer communications, leading to proven higher sales and more consistent customer retention. In 2017, we were acquired by IHS Markit.

Position summary

Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy, the reasons why, and the key offers and incentives most likely to close the sale. Its micro-marketing engine then delivers the right message at the right time to those customers, ensuring higher conversion rates and a stronger ROI.

What You'll Do

  • You will lead and manage one of our data engineering scrum team and be responsible for the delivery of the team goals.
  • Build & support data ingestion and processing pipelines. This will entail extract, load and transform of ‘big data’ from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies
  • Build real-time monitoring dashboards and alerting systems.
  • Partner with product and software engineering teams to assemble large, complex data sets that meet functional / non-functional business requirements, ensure build out of Data Dictionaries/data catalog and detailed documentation and knowledge around these data assets, metrics and KPIs.
  • Build efficient system to enable data integration systems across backend systems, service layer and UI
  • Coach and mentor other team members.

Who you are

  • 10+ years of industry experience with relevant experience in Big Data and Data Engineering.
  • Minimum 2+ years leading a team as Engineering Manager and doing people management (performance appraisals, career development) for the engineers in the team.
  • Experience working with a global team.
  • Ability to work hands-on with the data engineers in the team in design and development of the the solution using the relevant big data technologies and data warehouse concepts.
  • Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing.
  • Have strong experience in in modern data platform components such as Spark, Python, etc.
  • Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.) for an organization
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.
  • Experience with data pipeline and workflow management tools: Airflow, Dataflow, Dataproc, etc.
  • Experience with Distributed Versioning Control environments such as GIT, Azure DevOps
  • Building Docker images and fetch/promote and deploy to Production. Integrated Docker container orchestration framework using Kubernetes by creating pods, config Maps, deployments using terraform.
  • Should be able to convert business queries into technical documentation.
  • Strong problem solving and communication skills.
  • Bachelors or an advanced degree in Computer Science or related engineering discipline.

Good to have some exposure to

  • Good to have experience in one of the Cloud providers – GCP, Azure, AWS.
  • Agile software development methodologies.
  • Working in multi-functional, multi-location teams

What You'll Love About Us – Do ask us about these!

  • Total Rewards. Monetary, beneficial and developmental rewards!
  • Work Life Balance. You can't do a good job if your job is all you do!
  • Prepare for the Future.  Academy – we are all learners; we are all teachers!
  • Employee Assistance Program. Confidential and Professional Counselling and Consulting.
  • Diversity & Inclusion. HeForShe!
  • Internal Mobility. Grow with us!

Company overview

IHS Markit harnesses deep sources of information, analytics and expertise to forge solutions for the industries and markets that drive global economies. Our company partners with clients in business, finance and government to provide the unrivalled insights and perspectives that lead to well-informed, confident decisions. We call this The New Intelligence.

IHS Markit serves more than 50,000 key customers in more than 140 countries, including 80 percent of the Fortune Global 500.  We help decision makers apply higher-level thinking to daily tasks and strategic issues across a host of industries and disciplines including energy, finance, automotive, engineering, technology, maritime and trade, chemical, and economics and country risk. 

Headquartered in London, IHS Markit (Nasdaq: INFO) is committed to sustainable, profitable growth.


Inclusion and diversity are critical to the success of IHS Markit, and we actively encourage applications from people of all backgrounds. We are committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, status as a protected veteran, or any other protected category. For more information on the many ways in which we enthusiastically support inclusion and diversity efforts for both candidates and employees, please access our Inclusion & Diversity Statement here .

We are proud to provide reasonable accommodations to applicants with disabilities. If you are interested in applying for employment with IHS Markit and need special assistance or an accommodation to use our website or to apply for a position, please  contact  or call +1 212 849 0399. Determination on requests for reasonable accommodation are considered on a case-by-case basis.  This contact information (email and phone) is intended for application assistance and accommodation requests only.  We are unable to accept resumes or provide information about application status through the phone number or email address above. Resumes are only accepted through the online application process, and only qualified candidates will receive consideration and follow-up.

IHS Markit maintains a substance-free workplace; employees may be asked to submit to a drug test (where permitted by law).  In addition, as a federal contractor in the United States, the company participates in the E-Verify Program to confirm eligibility to work.

For information please click on the following links:

IHS Markit Business Code of Conduct
Right to Work
EEO is the Law
EEO is the Law Supplement
Pay Transparency


Current Colleagues

If you are currently employed by IHS Markit, please apply internally via the Workday internal careers site.

More from IHS Markit
Data Engineer
IHS Markit 5 days ago
Senior Data Engineer
IHS Markit 5 days ago
Data Engineer
IHS Markit 5 days ago

Manager, Data Engineering

Apply On Company Site
Back to search page