Big Data Engineer

47billion (Indore, MP, India) 22 days ago
Job Code: 47-IND-BDE-01

Fourty Seven Technologies Private Limited is hiring Big Data Engineers. The person should have proven hands-on experience leading the architecture, design, and development of large-scale high availability Big Data platforms and solutions. You will lead innovation by researching, recommending, benchmarking and implementing data-centric technologies.

Skill Required:

  • Minimum 2 years of strong experience in Core Java, Hadoop ecosystem and any NoSQL Database.
  • Minimum 1 Year of strong experience on Spark/Storm/Cassandra/Kafka.

Technical/Functional Skills:

  • Core Java, Python, Multi-Threading, OOPS
  • Hadoop/Hive/Pig/MapReduce
  • 3Spark/Storm/Kafka/Cassandra/Druid/ElasticSearch
  • SQL
  • Cloud Computing(AWS/Azure etc) Roles & Responsibilities: 1. Strong on Core Java, and/or Python – Multi-Threading, OOPS Concept, writing parsers in Core Java
  • Should have strong knowledge on Hadoop ecosystem such as Hive/Pig/MapReduce
  • Strong in SQL, NoSQL, RDBMS, and Data lake concepts
  • Writing complex MapReduce programs using Spark, Storm
  • Should have strong experience in pipeline building using Celery, Airflow
  • Designing efficient and robust ETL workflows using Airflow, Kafka, Spark, Druid
  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Creating Big Data reference architecture over Cloudera/Hortonworks
  • Performance optimization in a Big Data environment
More from 47billion
Lead Java Developer
47billion 1 day ago
Python Developer
47Billion Information Technologies Pvt Ltd 2 days ago
Python Developer
47Billion Information Technologies Pvt Ltd 2 days ago

Big Data Engineer

Apply On Company Site
Back to search page
;