Role – Big Data Developer (Spark, Scala) Job Summary
Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design and implement scalable big data solutions within the Hadoop ecosystem.
Job Description
Extensive hands‑on experience with Apache Spark for large‑scale data processing and analytics.
Proficient in big data technologies within the Hadoop ecosystem.
Strong programming skills in Scala for data engineering tasks.
Deep understanding of distributed computing frameworks and performance optimization techniques.
Experience with batch and real‑time data processing pipelines.
Knowledge of data ingestion, transformation, and storage best practices.
Familiarity with data quality assurance, validation, and troubleshooting in big data environments.
Ability to work with complex data architectures and cloud‑based big data platforms.
Skilled in debugging and optimizing Spark jobs to ensure efficient resource utilization.
Understanding of data security compliance and governance within big data solutions.
Roles and Responsibilities
Design, develop, and maintain scalable and robust data pipelines using Apache Spark, SparkSQL, Scala, and related big data technologies.
Collaborate with cross‑functional teams to gather business requirements and translate them into technical solutions.
Optimize Spark applications for performance, scalability, and cost efficiency.
Lead the implementation of data processing workflows ensuring data quality and consistency.
Provide technical mentorship and guidance to junior team members and peers.
Participate in architectural reviews and recommend best practices for big data solution design.
Troubleshoot and resolve complex issues in data processing pipelines within defined SLAs.
Stay updated with emerging big data technologies and incorporate relevant advancements into existing systems.
Ensure adherence to organizational standards for data security, compliance, and governance.
Skills
Mandatory Skill: Apache Spark
Benefits and Perks
Comprehensive Medical Plan (Medical, Dental, Vision)
Health Care Spending Account
Short‑Term and Long‑Term Disability Coverage
Life Insurance
Annual vacation and other paid leaves
Maternity Leave Top‑Up Pay
LTM is an equal‑opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability, history of handicap or disability, genetic information, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
#J-18808-Ljbffr
or continue with email
Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design and implement scalable big data solutions within the Hadoop ecosystem.
Job Description
Extensive hands‑on experience with Apache Spark for large‑scale data processing and analytics.
Proficient in big data technologies within the Hadoop ecosystem.
Strong programming skills in Scala for data engineering tasks.
Deep understanding of distributed computing frameworks and performance optimization techniques.
Experience with batch and real‑time data processing pipelines.
Knowledge of data ingestion, transformation, and storage best practices.
Familiarity with data quality assurance, validation, and troubleshooting in big data environments.
Ability to work with complex data architectures and cloud‑based big data platforms.
Skilled in debugging and optimizing Spark jobs to ensure efficient resource utilization.
Understanding of data security compliance and governance within big data solutions.
Roles and Responsibilities
Design, develop, and maintain scalable and robust data pipelines using Apache Spark, SparkSQL, Scala, and related big data technologies.
Collaborate with cross‑functional teams to gather business requirements and translate them into technical solutions.
Optimize Spark applications for performance, scalability, and cost efficiency.
Lead the implementation of data processing workflows ensuring data quality and consistency.
Provide technical mentorship and guidance to junior team members and peers.
Participate in architectural reviews and recommend best practices for big data solution design.
Troubleshoot and resolve complex issues in data processing pipelines within defined SLAs.
Stay updated with emerging big data technologies and incorporate relevant advancements into existing systems.
Ensure adherence to organizational standards for data security, compliance, and governance.
Skills
Mandatory Skill: Apache Spark
Benefits and Perks
Comprehensive Medical Plan (Medical, Dental, Vision)
Health Care Spending Account
Short‑Term and Long‑Term Disability Coverage
Life Insurance
Annual vacation and other paid leaves
Maternity Leave Top‑Up Pay
LTM is an equal‑opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability, history of handicap or disability, genetic information, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
#J-18808-Ljbffr
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
Similar jobs
![Montréal [Hybrid] Big Data Java Developer BILINGUAL](https://pcdns.recruit.net/2.0/big-logos-100/10/10594479.png)
Show more