Data Engineering Tech Lead Porto

Data Engineering Tech Lead
Porto
Porto, Porto District, Portugal

Our Mission Ivy Partners is a Swiss consulting firm that helps businesses navigate their strategic, technological, and organizational challenges.

We are committed to providing our employees with a career that promotes both personal and professional growth. We support their skills development and offer them real opportunities for progression.

As a Data Engineering Tech Lead at Ivy Partners, you will be responsible for:
- Leveraging your expertise in AWS services like Lambda, Glue, and Step Functions to design, implement, and maintain scalable data solutions.
- Developing robust solution architectures with a focus on scalability, performance, security, and cost optimization.
- Managing ETL processes and integrating data into systems like Redshift, My
SQL, and Postgre
SQL.
- Implementing orchestration solutions using tools like Apache Airflow and AWS Step Functions to automate and manage data workflows.
- Providing technical leadership and mentorship, acting as a subject matter expert in AWS and data engineering technologies.
- Writing comprehensive solution documents and comprehensive technical documentation.
- Staying updated with emerging technologies and industry trends to continually propose innovative solutions for efficiency and performance improvement.

About You

You are our ideal candidate if:
- You possess extensive experience with AWS services, including Lambda, Glue, Step Functions, Cloud
Formation, and Cloud
Watch.
- You are proficient in Python and experienced with relational databases (My
SQL, Postgre
SQL, Redshift) and No
SQL databases.
- You have experience in orchestrating data workflows with tools such as Apache Airflow.
- You have a strong background in managing large datasets and are familiar with Iceberg tables.
- You have the capability to evolve into a technical leadership role, with excellent communication skills for effective team collaboration.
- You hold a proactive approach to production monitoring and troubleshooting.
- Your analytical and
- solving skills enable you to analyze requirements, define technical approaches, and implement innovative solutions to complex problems.
- Experience with Azure Databricks and knowledge of streaming data technologies like Apache Flink and Kafka would be beneficial.

Why Join Ivy Partners?

We are committed to:
Taking care of our collaborators | We offer a caring environment where everyone is valued, with training and career progression opportunities both in Switzerland and internationally.

Creating a climate of trust | Working with us means building a relationship based on transparency, professionalism, and commitment.

Encouraging innovation | We combine technology and creativity to achieve impactful digital transformations.

Upholding our responsibilities | The collective is at the heart of our actions, and we strive to make a positive impact.