Data Engineering Lead Porto

Data Engineering Lead
Porto
Porto, Porto District, Portugal

Metyis is growing! We are looking for a Data Engineering Lead with 5-8 years of experience to join our Data and Analytics team in Porto.

Who we are

Metyis is a global and
- thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our
- term partnership model brings
- lasting impact and growth to our business partners and clients through extensive execution capabilities.

With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Imagine the things you can achieve with a team that encourages you to be the best version of yourself.

We are Metyis. Partners for Impact.

What we offer

• Interact with senior stakeholders at our clients on a regular basis to drive their business towards impactful change.
• Become the
  - to person for
  -
  - end data handling, management, and analytics processes.
• Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.
• Work with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
• Become part of a
  - growing international and diverse team.

What you will do

• Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
• Be responsible for the Architecture, ensuring that technical and
  - technical components work together in the product to deliver customer needs.
• Lead and develop the digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud, ideally with some Data Insights experience.
• Steer the technical excellence of the application and ensure consistency with relevant digital frameworks, best practices, and standards.
• Coach and enable other product team members to deliver
  -
  - class products.
• Deliver data platforms, data insights, and with the collaboration of the data science team – data products, such as recommendation systems, data lakes/hubs, data insights, and dashboards.
• Lead project activities and be responsible for the evaluation of business needs and objectives in collaboration with the project team and other stakeholders.

What you’ll bring

• 5-8 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure, GCP, or AWS.
• Solid knowledge of data warehousing principles, concepts, and best practices (e. g. ODS, data marts, data lakes, data vault, 3NF).
• Good understanding of common platforms and practices regarding digital development; Cloud-based setups, Advanced Analytics and computing environments, and Git
  Hub (or similar) and CI/CD workflows.
• Experience in setting up automated testing frameworks including unit tests and integration tests.
• Understanding of modern
  - based architecture (Lambda & Kappa architectures).
• Advanced SQL, data transformation, and data profiling skills.
• Experience in building production ETL/ELT pipelines at scale.
• Data governance experience.
• 3-5 years of
  - on experience with Azure: Data Factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
• Experience with Airflow, Kubernetes, Great expectations is a plus.
• Programming languages: Python (Py
  Spark), scripting languages like Bash.
• Basic knowledge of Power
  BI is a plus.
• Customer-centric, passionate about delivering great digital products and services.
• Demonstrating true engineering craftsmanship mindset.
• Passionate about continuous improvement and working collaboratively.
• Strong
  - solving skills coupled with the ability to convey designs and ideas to a wider audience.
• People management experience (at least 2 members team).
• Experience in service consulting and stakeholder management.
• Comfortable with ambiguity, highly autonomous.
• A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research, Statistics, Business, or other related technical disciplines (Master's Degree is a plus).

In a changing world, diversity and inclusion are core values for team
- being and performance. At Metyis, we want to welcome and retain all talents, regardless of gender, age, origin or sexual orientation, and irrespective of whether or not they are living with a disability, as each of them has their own experience and identity.