Data Engineer-Azure Lisboa

Overview

Data Engineer-Azure role at Expleo Group.

Expleo is a trusted partner for your innovation journey. As a global engineering, technology and consulting service provider, we help you achieve your ambitions and
- proof your business. With a smart blend of bold thinking and reliable execution, we
- track innovation through each step of your value chain. We are strategically positioned to build value, with a global footprint across 30 countries. We are as global and local as you need us to be, with strong
-
- class
- European technological centres and unique
- shoring capabilities. We leverage a network of high
- adding affiliates in consulting and industrial excellence, and leading partners across multiple sectors to provide you with the most comprehensive services and solutions in an
- changing environment.

Responsibilities

• Design, build, and maintain scalable data platforms;
• Collect, process, and analyze large and complex data sets from various sources;
• Develop and implement data processing workflows using data processing framework technologies such as Spark, and Apache Beam;
• Collaborate with
  - functional teams to ensure data accuracy and integrity;
• Ensure data security and privacy through proper implementation of access controls and data encryption;
• Extraction of data from various sources, including databases, file systems, and APIs;
• Monitor system performance and optimize for high availability and scalability.

Essential Skills

• At least 5 years experience in a similar role;
• Experience with Azure cloud platforms and services;
• Proficiency in programming languages such as Python, Java or Scala;
• Good knowledge of Big Data tools (Spark, Kafka, Hadoop, Hive);
• Knowledge of data integration and ETL tools (e. g. Apache, Talend);
• Strong SQL skills;
• Familiarity with Azure Data Factory;
• Good knowledge of English.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting