Tech Lead in Data Engineering (M/F) Porto

Tech Lead in Data Engineering (M/F)
Porto
Porto, Porto District, Portugal

About the job Tech Lead in Data Engineering (M/F)

Tech Lead Data Engineering

Position Overview:

As a Tech Lead in Data Engineering, you will serve as a key technical advisor to stakeholders, own
-
- end data engineering initiatives, manage technical debt, and mentor junior engineers. You will play a critical role in designing, architecting, and building robust, scalable data solutions.

This role requires a strong software engineering mindset, with proven experience writing
- grade Python code, and solid expertise in Azure, Databricks (Py
Spark), and SQL.

Key Requirements:

• Lead the design and development of batch and
  - time data pipelines using tools like Databricks, Py
  Spark, and DBT.
• Optimize data storage formats (e. g. , Delta Lake, Parquet) and implement data quality checks.
• Collaborate with data scientists and analysts to provide seamless access to data for analytics and machine learning.
• Manage Azure cloud infrastructure and ensure compliance with data privacy regulations.
• Mentor junior team members and promote best practices in data engineering.

Requirements:

• Masters or Ph
  D in a related field.
• Python: minimum of 5 years of
  - level coding experience
• SQL: advanced level
• Azure (Data Factory, managed services): minimum of 2 years of experience
• Databricks with Py
  Spark: minimum of 3 years of experience
• Proven experience in building production pipelines, making technical decisions, and mentoring other engineer.
• Strong skills in data architecture, ETL processes, and cloud infrastructure management.
• Experience with CI/CD tools and data security best practices.