Data Engineer - Program Tech Lead Databricks Lisboa

Overview

Data Engineer - Program Tech Lead Databricks role at Grupo Data Portugal. Grupo Data aims to simplify clients' lives with innovative IT solutions. We operate at global scale and are expanding to Portugal. If you are passionate and want to make a difference, we’d like to get to know you and invite you to join this adventure.

Key Responsibilities

• Lead the migration of data pipelines from Snowflake to Databricks.
• Design, develop, and optimize ETL workflows and data pipelines.
• Collaborate with
  - functional teams to understand database requirements and ensure successful migration.
• Implement best practices for data engineering and ensure high performance and reliability of data systems.
• Identify opportunities to optimize and reduce costs associated with data storage and processing.

Skills & Qualifications

• Very good English - C1
• Minimum of 4 years of professional experience in data engineering, business intelligence, or a similar role
• Proficiency in Python or similar programming languages
• Over 7+ years of experience in ETL orchestration and workflow management tools (Airflow, Flink, Oozie, Azkaban) using AWS or GCP
• Expertise in database fundamentals, Tableau or SQL, and distributed computing
• At least 4 years of experience with distributed data ecosystems (Spark, Hive, Druid, Presto)
• Experience with Snowflake, Redshift, Postgre
  SQL, Tableau and/or other DBMS platforms
• Leadership and mentoring experience in a team of engineers
• Experience applying Scrum methodologies to manage project workflows and deliverables

Additional Information

• Sector: Communication Services
• Work arrangement: Full remote
• Employment type: Full-time
• Seniority level: Not Applicable
• Job function: Information Technology
• Industries: IT System Data Services