Data Engineer (Spark/Scala) Viseu

Data Engineer (Spark/Scala)
Viseu
Viseu, Viseu District, Portugal

? Who are we?

As the founding entity of RAINBOW PARTNERS, Quanteam is a consulting firm specializing in the fields of Banking, Finance, and Financial Services. Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 980 expert consultants, representing 35 different nationalities, collaborates across 12 international offices:

Paris, Lyon, New York, Montreal, London, Brussels, Geneva, Lisbon, Porto, Casablanca, Madrid and Singapore. Committed to sustainability (Ecovadis Gold), diversity (gender index:

92%), and quality of work life (Best Workplace Experience), Quanteam is a
- thinking enterprise.

? Our Expertise

With a dual expertise in both business and IT, Quanteam supports its corporate clients (investment banks, asset management companies, private and retail banks, custodians, etc. ) across the entire Front-to-Back spectrum in evolving their business activities and transformation projects.

Our teams are organized into 5 expertise areas:

➡ Quantitative Finance

➡ Risk, Compliance, and Regulatory

➡ Operations and Finance

➡ Transformation and Organization

➡ Information Systems

In 2023, Quanteam generated a revenue of €74. 6 million.

? We are looking for a Data Engineer (Spark/Scala)

MAIN TASKS:

• Design, develop, and maintain efficient data pipelines using Apache Spark and Scala.
• Optimize the performance of data processing workflows in Big Data environments.
• Create and maintain Shell scripts to automate routine tasks and data operations.
• Operate and troubleshoot within Unix/Linux environments to ensure reliability and stability of data processes.
• Write and optimize SQL queries for handling and analyzing large datasets.
• Collaborate with
  - functional teams to gather requirements and deliver scalable data solutions.

YOUR PROFILE AND SKILLS:

• Strong
  - on experience with Apache Spark and Scala, especially in
  - scale data environments.
• Proficiency in SQL, with a focus on performance in Big Data platforms.
• Practical experience with Shell scripting for automation and system tasks.
• Solid understanding of Unix/Linux systems, including basic administration and
  - line usage.
• Ability to work independently and as part of a team in a
  - paced, dynamic environment.
• Strong analytical skills and attention to detail when working with complex data.
• Fluency in English (written and spoken).

? Nice to have (not mandatory):

• Experience with data orchestration tools (e. G. , Airflow, Oozie).
• Familiarity with version control systems (e. G. , Git).
• Previous experience in cloud environments (AWS, Azure, GCP).

? If you feel this opportunity is for you, send your CV and join our team!