Spark Scala Developer – Hybrid / Leeds – £450-£550 | Damia Group Ltd

Damia Group Ltd

Job Title: Spark Scala Developer – Hybrid / Leeds – £450-£550
Employer: Damia Group Ltd
Location: Yorkshire, United Kingdom
Salary:
Employment Type: Contract
Reference Number: 23643_221798653

 

Job Details:

Spark Scala Developer – Scala / Apache Spark – Hybrid / Leeds – 450- 550

Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers, 20,000+ database instances, and over 150 PB of data.

As a Spark Scala Engineer, you will have the responsibility to refactor Legacy ETL code, for example DataStage into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues.

Your responsibilities;

As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for:

  • Designing, building, and maintaining data pipelines using Apache Spark and Scala
  • Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP).

Mandatory Skills;

  • At least 8+ Years of IT Experience with designing, building, and maintaining data pipelines.
  • At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala.
  • Programming languages: Proficiency in Scala and Spark is essential. Familiarity with Python and SQL is often a plus.
  • Big Data technologies: Understanding of HDFS, Kafka, Hive, and cloud platforms is valuable.
  • Data engineering concepts: Knowledge of data warehousing, data pipelines, data modeling, and data cleansing techniques is crucial.
  • Problem-solving and analytical skills: You should be able to analyze complex data problems, design efficient solutions, and troubleshoot issues.
  • Communication and collaboration: The ability to communicate effectively with data scientists, analysts, and business stakeholders is essential.

Good to have skills;

  • Machine learning libraries: Familiarity with Spark ML or other machine learning libraries in Scala can be advantageous.
  • Cloud computing experience: Experience with cloud platforms like AWS, Azure, or GCP for data pipelines deployment is a plus.
  • DevOps tools: Knowledge of DevOps tools like Git, CI/CD pipelines, and containerization tools (Docker, Kubernetes) can be beneficial.

Spark Scala Developer – Scala / Apache Spark – Hybrid / Leeds – 450- 550

Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found on our website.

Please note that no terminology in this advert is intended to discriminate on the grounds of a person’s gender, marital status, race, religion, colour, age, disability or sexual orientation. Every candidate will be assessed only in accordance with their merits, qualifications and ability to perform the duties of the job.

Damia Group is acting as an Employment Business in relation to this vacancy and in accordance to Conduct Regulations 2003.

 

NOTE TO JOB SEEKERS

Apply for this Spark Scala Developer – Hybrid / Leeds – £450-£550 job vacancy via Bubble Jobs today.  You can find other jobs like this Spark Scala Developer – Hybrid / Leeds – £450-£550 job vacancy in Yorkshire with our simple job search feature. As well as advertising vacancies like this Spark Scala Developer – Hybrid / Leeds – £450-£550 job vacancy, Bubble Jobs specialises in advertising web jobs, digital jobs, tech jobs and other specialist jobs for a wide range of employers and recruiters. If you’re looking for career advice or job searching tips, then make sure you check out our blog which is updated regularly with useful advice and resources.  Don’t forget to follow us on Twitter to get the latest job updates and addition career related news and posts. Thanks for using Bubble Jobs and good luck with your job search.

Skip to content