Title: Lead Data Engineer
Location: Chandler, AZ / Charlotte, NC / Minneapolis, MN / Irving, TX (Hybrid)
Visa requirement- usc/gc/h4 ead /Gc ead
Duration: 12+ Months (Possible extension)
Required Qualifications
- 5+ years of experience in Data Engineering, including hands-on experience with Hadoop and Google Cloud data solutions.
- Experience creating and supporting Spark-based data processing and Kafka streaming solutions in a highly collaborative team environment.
- 2+ years of hands-on experience developing real-time data flows using Kafka, Flink, and Spark Streaming.
- 3+ years of experience with Data Lakehouse architecture and design.
- Hands-on experience with Python, PySpark, Apache Kafka, Airflow, SQL, Google Cloud Storage, BigQuery, Dataproc, and Cloud Composer.
- 2+ years of experience working with NoSQL databases, including columnar databases, graph databases, document databases, key-value stores, and associated data formats.
- Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics.
- Proven experience migrating data from on-premises environments to cloud-native platforms.
- Strong experience with the Hadoop ecosystem, including Hive, HDFS, Parquet, Iceberg, and Delta Tables.
- Deep understanding of data warehousing, cloud data architecture, data pipeline development, and workflow orchestration.
- Experience designing and implementing highly scalable and modular data pipelines with built-in data controls to automate data governance.
- Familiarity with GenAI frameworks such as LangChain and LangGraph for developing agent-based data capabilities.
- Experience with DevOps and CI/CD deployments using Git, Jenkins, Docker, and Kubernetes.
- Experience with web-based UI development using React and Node.js is a plus.
Warm Wishes!
Ravi Kumar || Sr. Technical Recruiter
St. Augustine, FL 32092
Email: [email protected] ||