Data Engineering Tech Lead

Data Engineering Tech Lead
Viseu
Viseu, Viseu District, Portugal

We are looking for a Data Engineering Tech Lead to join our data engineering team. In this role, you will be responsible for leading the design, implementation, and evolution of scalable,
- based data solutions, while providing strong technical leadership and guidance to the engineering team.

If you are passionate about cloud data platforms, solution architecture, and mentoring engineers while delivering
- quality data systems in production, this opportunity is for you.

☁ What you will be doing

• Lead the design, implementation, and maintenance of scalable and reliable data solutions on AWS (and Azure where applicable).

• Act as a technical leader for the data engineering team, providing mentorship, guidance, and
- on support.

• Translate business requirements into technical solutions, break them down into actionable tasks, and distribute work effectively across the team.

• Design robust data architectures considering scalability, performance, security, and cost optimization.

• Build, optimize, and maintain data pipelines, ETL processes, and orchestration workflows using tools such as Apache Airflow, AWS Step Functions, AWS Glue, and Lambda.

• Apply Infrastructure as Code principles using Cloud
Formation (and Terraform when applicable) to manage and evolve cloud infrastructure.

• Work
- on with Python and SQL to develop, optimize, and troubleshoot data processing workflows.

• Design efficient data models and optimize query performance across platforms such as Amazon Redshift, Postgre
SQL, and My
SQL.

• Manage and optimize
- scale datasets, including the use of Iceberg tables for data consistency and performance.

• Ensure production readiness through monitoring, logging, and tracing using AWS services such as Cloud
Watch, Cloud
Trail, and AWS X-Ray.

• Collaborate closely with
- functional teams, including analytics, product, and business stakeholders.

• Produce clear solution designs, technical documentation, and provide training to team members.

• Continuously challenge requirements and propose innovative technical solutions to improve efficiency and performance.