P osition: Data Engineer
Description of Duties
The Automotive Supply Chain and Technology team at IHS Markit is in search of a Data Engineer to support its global team's ongoing research and analysis efforts. The research team produces granular forecast dataset and written analyses on the supply chain of parts supplied to automakers with technology, supplier and logistic information. The team generate forecasts on technology trends through multiple research channels and by using many connected and disconnected data sources to drive the forecast.
The position covers an array of critical data-centric activities aimed at enhancing the efficiency of our 70+ strong research team, sustaining the increasing data complexity and most importantly supporting new product development at one of IHS Markit's fastest growing product lines. The position is based in Gurgaon or Bangalore , India and reports to our U.K.-based Data and Platform operations lead.
Responsibilities and duties
Understanding business requirements to create maintainable workflows e.g. inbound/input data from analysts and external sources to feed a set of interconnected data sets and calculations
ETL process design, implementation, maintenance and documentation for large inter-connected data sets
Data cleaning and manipulation of raw data to provide to Data Science team
Creation of logical and physical data models
Utilise existing database infrastructures as well as building new DB infrastructures as required
Data acquisition exploration
Create and maintain detailed documentation of workflows
Qualifications and skills
3+ years’ experience as a data engineer with data science touchpoints
At minimum, a d egree in c omputer s cience, computer engineering or a related quantitative field with proven work experience in the data engineering /scientist field
Proven experience with SQL and NoSQL databases like Oracle DB, SQL Server, Cassandra, MongoDB, MySQL , Hadoop, Spark, AWS (EC2 and S3)
Proven experience with one or more programming/scripting languages (e.g. Python, R) is highly desirable
Knowledge of OLAP and ETL processes
Familiarity with data science platforms such as KNIME is a bonus
Knowledge of API creation and maintenance
Familiar with techniques to manage large databases, including partitioning, compression and indexes as well as data mining
Ability to build models (e.g. Linear regression, logistic, Markov models) a plus
Established MS Office skills , O365 desirable
Good communication skills, collaborative team spirit, curiosity to constantly keep thi nking of unique approaches and solutions.
Ability to work independently.
Experience committing to deadlines whilst multi-tasking
IHS Markit is committed to providing equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by the laws and regulations in any of our locations.
We are proud to provide reasonable accommodations to applicants with disabilities. If you are interested in applying for employment with IHS Markit and need special assistance or an accommodation to use our website or to apply for a position, please or call +1 212 849 0399. Determination on requests for reasonable accommodation are considered on a case-by-case basis. This contact information (email and phone) is intended for application assistance and accommodation requests only. We are unable to accept resumes or provide information about application status through the phone number or email address above. Resumes are only accepted through the online application process, and only qualified candidates will receive consideration and follow-up.
IHS Markit maintains a substance-free workplace; employees may be asked to submit to a drug test (where permitted by law). In addition, as a federal contractor in the United States, the company participates in the E-Verify Program to confirm eligibility to work.
For information please click on the following links:
If you are currently employed by IHS Markit, please apply internally via the Workday internal careers site.