Senior Data Engineer

Senior Data Engineer
Viseu
Viseu, Viseu District, Portugal

Job Title :: Sr. Data Engineer

Job Type :: Contract

Job location ::. 2 days a week, Madrid and Lisbon (Either one) & Local work hours should be fine. Okay to be onsite 2 months and then remote.

Job description::

Contract Duration 6-12 months+

Hybrid, 2 days in office.

• From a technological perspective, the roles are mostly similar. The primary distinction lies in the depth of expertise and the number of years of experience required
• Spanish is a must. 2 days a week, Madrid and Lisbon (Either one) & Local work hours should be fine. Okay to be onsite 2 months and then remote.

Qualification Area

Data Engineer (Mid-Level 06 to 12 years)

Senior Data Engineer (Senior M level12 to 16)

Cloud Environments

Familiarity with major cloud platforms (AWS, GCP, Azure)

Experience developing data systems on major cloud platforms (AWS, GCP, Azure)

Data Architecture

Experience with modern data architectures (data lakes, lakehouses, hubs)

Hands-on experience building modern data architectures (data lakes, lakehouses, hubs)

Data Ingestion

Proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)

Demonstrated proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)

Data Streaming

Knowledge of streaming architectures and tools (Kafka, Flink)

Experience developing pipelines with streaming architectures and tools (Kafka, Flink)

Data Modeling

Strong background in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow). Experience with SCD and schema evolution

Expertise in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow). Deep experience with SCD and schema evolution

Data Transformation (Spark)

Familiarity with Spark for transformation, streaming, tuning, debugging with Spark UI

Strong background with Spark for transformation, streaming, tuning, debugging with Spark UI

Programming

Proficient in Python, Java, Scala (or similar). Expert-level SQL

Advanced programming skills in Python, Java, Scala (or similar). Expert-level SQL

Dev
Ops

Demonstrated experience in Dev
Ops practices (code management, CI/CD, deployment)

Demonstrated experience in Dev
Ops practices (code management, CI/CD, deployment)

Data Governance

Understanding of governance principles (quality, privacy, security)

Strong background in governance principles (quality, privacy, security)