Data Engineer - Spark/Scala - Big Data Porto

Data Engineer - Spark/Scala - Big Data
Porto
Porto, Porto District, Portugal

At ALTEN, we are certain that the success of our projects is due to the people who make up our team. That’s why, if you have at least 4 years of experience as a Data Engineer we are committed to boosting your talent, meeting your professional expectations, and making you feel right at home. Do you want to build the world of tomorrow today? Keep reading!

Responsibilities:

• Develop and optimize
  - scale data pipelines using Spark and Scala.
• Work with SQL to manipulate and analyze data in Big Data environments.
• Create and maintain Shell scripts and automate processes using Unix.
• Collaborate with
  - functional teams to ensure efficient data integration across the organization.
• Diagnose and troubleshoot data and
  - related issues.
• Ensure the quality and reliability of processed data.

Requirements:

• Solid experience with Spark and Scala.
• Proficiency in SQL for working with large data sets.
• Knowledge of Shell scripting and process automation.
• Familiarity with Unix/Linux systems.
• Ability to work collaboratively and communicate effectively across teams.
• High level of English.

Nice to Have:

• Experience with Big Data tools and technologies, such as Hadoop, Kafka, etc.
• Additional knowledge in optimizing data system performance.

What can we offer you?

• Joining a competitive, multinational company that is constantly growing.
• Integration into a highly qualified team of professionals with a great work environment—innovative and dynamic.
• Specialized training and ongoing professional development.
• Social benefits.
• Competitive salary.

Who are we?

We are a team. We are part of ALTEN, a European multinational specializing in providing consulting, information technology, and engineering services to the leading companies in the Portuguese market.

If you like numbers, we can tell you that in Portugal we have a revenue of 10. 9 million euros, 2 headquarters, and a team of 215 professionals.

Moreover, at ALTEN, we take pride in offering equal opportunities regardless of gender, age, abilities, or country of origin. Our commitment is to talent and to the people who possess it.