Data Engineer

Data Engineer
Setúbal
Setúbal, Setubal, Portugal

At Hexa Consulting we want to spread transparency and enable diverse tech careers.

Our mission is to build strong relationships, be a leading partner through a differentiated approach in IT consulting and contribute to the professional and personal development of our team.

We work with Nearshore projects, TM & Project Development, Service Management and Tech Academies.

We’re looking for a Data Engineer to join our team in Lisbon!

The Data Engineer will work with large and complex datasets, designing efficient, scalable data solutions that support key business objectives. The role involves building
- performance data pipelines, ensuring reliable ETL operations, and collaborating with
- functional teams to deliver
- quality data products. Strong experience with Python , Spark , or the Azure data ecosystem (Databricks, Data Factory, etc. ) is essential.

Key Responsibilities

• Explore, clean, transform, and analyze large datasets to support business needs.
• Design and implement scalable data processing pipelines optimized for performance, reliability, and cost efficiency.
• Develop and maintain high-performance ETL workflows using Python, Spark, and Azure technologies.
• Collaborate with data engineers, analysts, and business stakeholders to define use cases, test hypotheses, and design solutions.
• Participate in code reviews and ensure adherence to best engineering practices.
• Automate
  -
  - end deployment and release processes across environments.
• Perform daily ETL job monitoring and act promptly in coordination with production and functional support teams.
• Contribute to maintaining infrastructure integrity by defining priorities, tracking issues, and improving workflow efficiency.

Tech Stack (Core)

• Languages: Python, SQL
• Data Processing: Spark
• Azure: Databricks, Data Factory, Azure Storage, Azure Dev
  Ops
• ETL / Pipelines: Advanced ETL orchestration, automation, monitoring
• General: CI/CD concepts, software development lifecycle, version control