Job Duties And Responsibilities
Requirements
or continue with email
- Build processes that support data transformation, data structures, metadata, dependency and workload management.
- Build and implement data ingestion and curation processes developed using Big data tools such as Spark (Scala/Python), Hive, HDFS, Sqoop, HBase, Kerberos, Sentry and Impala.
- Handle ingestion of large volumes of data from various platforms for analytics needs and write high-performance, reliable and maintainable ETL code. Demonstrate strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
- Write shell scripts along with complex SQL queries, Hadoop commands and use Git.
- Create database schemas and Hive tables (external and managed) with various file formats (Orc, Parquet, Avro, Text, etc.).
- Monitor performance of production jobs and advise on necessary infrastructure changes.
- Work on code versioning using Bitbucket and CI/CD pipeline.
Requirements
Bachelor’s degree in Computer Science, IT, Engineering or related field with at least 60 months of experience. Travel and relocation to various client locations throughout the United States may be required.
To apply, send resume to [email protected] including the JOB ID. Equal Opportunity Employer.
#J-18808-Ljbffr
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
Similar jobs
Show more