Data Engineer

Our mission!

Ivy Partners is a Swiss consultancy that supports businesses in their strategic, technological, and organizational challenges.

We are dedicated to providing our employees with a career that enhances their personal and professional growth. We support them in their skill development and offer real opportunities for advancement.

Data Engineer – Lisbon, Portugal – Full‑time & Hybrid

Overview / Summary:

We are seeking a Data Engineer to design, implement, and maintain data processing solutions in cloud environments. This role focuses on building scalable pipelines and ensuring efficient data flow using modern big data technologies. The ideal professional has hands‑on experience with Python or Scala, Spark, Kafka, SQL, Databricks, and cloud platforms (Azure or GCP).

Responsibilities and Tasks:

• Design, develop, and maintain data pipelines using Spark, Kafka, and SQL.
• Implement scalable data processing solutions in cloud environments (Azure or GCP).
• Collaborate with data scientists and business teams to support analytics and reporting needs.
• Optimize data workflows for performance and reliability.
• Maintain documentation and ensure best practices in data engineering.

Mandatory Requirements:

• +3 years of experience in similar Data Engineer or Engineering roles.
• Experience with Python or Scala for data processing.
• Experience with Spark, Kafka, SQL, and Databricks.
• Experience with cloud platforms, preferably Azure or GCP.
• Ability to design scalable and maintainable data pipelines.
• English: +B2 level.

Benefits:

Important: Our company does not sponsor work visas or work permits. All applicants must have the legal right to work in the country where the position is based. Only candidates who meet the required qualifications and match the profile requested by our clients will be contacted.

Data Engineer – Lisbon, Portugal – Full‑time & Hybrid (2x office days)

Overview / Summary:

We’re looking for a Data Engineer to join our team. This role will focus on building, maintaining, and optimizing data pipelines and solutions in cloud environments. You should have hands‑on experience with AWS, Python, and SQL, and be comfortable working in a collaborative, hybrid setting.

Responsibilities and Tasks:

• Implement solutions using AWS, Python, SQL, and related cloud technologies.
• Design, build, and maintain scalable data pipelines and ETL processes.
• Support data analysis, reporting, and visualization efforts.

Mandatory Requirements:

• +1 year of experience as a Data Engineer.
• Experience with AWS, Python, and SQL.
• Knowledge of Dev
  Ops, ETL, and cloud technologies.
• English minimum B2 level.

Complementary Requirements:

• Experience with Py
  Spark.
• Experience with AWS Quick
  Sight.

Benefits:

Important: Our company does not sponsor work visas or work permits. All applicants must have the legal right to work in the country where the position is based. Only candidates who meet the required qualifications and match the profile requested by our clients will be contacted.

Data Engineer – Lisbon, Portugal – Remote

Overview / Summary:

We are looking for a skilled Data Engineer (AWS) to design, implement, and maintain cloud‑based data solutions using AWS services. The ideal candidate will have strong hands‑on experience in building and optimizing data pipelines, ensuring data reliability, scalability, and security across multiple AWS components.

Responsibilities and Tasks:

• Build and maintain ETL pipelines using AWS Glue.
• Manage and secure data storage in AWS S3 and AWS Lake Formation.
• Design data models and write optimized SQL queries in AWS Athena.
• Apply AWS security best practices and ensure performance tuning across services.
• Troubleshoot issues, improve system efficiency, and collaborate with cross‑functional teams.

Mandatory Requirements:

• Degree in Computer Science, Information Systems, Engineering, or equivalent experience.
• Experience working with AWS data services (Glue, S3, Lake Formation, Athena).
• Experience in data modeling, ETL processes, and cloud‑based data solutions.
• Experience with performance tuning and security best practices in AWS environments.
• Fluency in English (C1 level), Portuguese preferred but not required.

Complementary Requirements:

• Experience with AWS Redshift or AWS Aurora.
• Familiarity with CI/CD or infrastructure‑as‑code (Cloud
  Formation, Terraform).

Benefits:

Important: Our company does not sponsor work visas or work permits. All applicants must have the legal right to work in the country where the position is based. Only candidates who meet the required qualifications and match the profile requested by our clients will be contacted.

Senior Software & Data Engineer – Lisbon, Portugal – Full‑time & Hybrid

Responsibilities:

• Lead technical discussions and actively participate in development, with a particular focus on Spring Boot, Azure SQL, Azure Dev
  Ops, and Databricks/Scala/Spark.
• Support and drive architectural efforts, including High-Level Design (HLD) and Domain-Driven Design (DDD).
• Develop microservices, RESTful APIs, and ensure integration with databases.
• Collaborate closely with other developers, architects, and stakeholders to guarantee delivery excellence.
• Participate in troubleshooting, testing, and build processes, promoting Dev
  Ops best practices, observability, and CI/CD.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
• Proven experience in Spring Boot, microservices development, database integration, and RESTful API development.
• Strong knowledge of architectural design patterns, Dev
  Ops/CI‑CD pipelines, Git, build tools, testing, caching, message queuing, troubleshooting, and observability.
• Experience with Scrum methodology and associated tools.
• Proven cloud experience (Azure preferred, AWS also acceptable).
• Excellent communication skills, resilience, goal orientation, and a passion for technology and challenges.
• Fluency in English, both written and spoken.
• European Union Citizenship or Portuguese Working Visa / Portuguese Residency.
• Availability to go to the office, once or twice per week.

Nice to Have:

• Experience with Databricks.
• Knowledge of Azure SQL management.
• Experience with Spark, Py
  Spark, or Scala.

Nearshore Sector | Databricks Data Engineer – Portugal (Devoteam)

Data Pipeline Engineering:

• Design, develop, and deploy robust and scalable data pipelines using Databricks, incorporating data extraction from diverse sources (databases, APIs, streaming platforms), transformation and cleansing using Spark, and loading into target systems (data lakes, data warehouses, etc. ).

Databricks Ecosystem Expertise:

• Utilize the full capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, to orchestrate complex data workflows and ensure data quality and pipeline reliability.

Cloud Integration:

• Seamlessly integrate Databricks with cloud services (Azure, AWS, or GCP) for storage, compute, and security, leveraging services like Azure Data Lake Storage, AWS S3, Google Cloud Storage, and more.

Data Architecture and Modeling:

• Contribute to the design and implementation of robust data models and architectures for data lakes and data warehouses, ensuring data consistency, integrity, and accessibility for various use cases.

Data Quality Assurance:

• Implement rigorous data quality checks and validation procedures throughout the data pipeline to maintain high accuracy and reliability. Adhere to data governance policies and best practices.

Qualifications:

• Hold a University Degree in Computer Science, (Business) Engineering, or a specialized master's in Machine Learning or AI.
• At least 3+ years of experience as a Data Engineer with demonstrated expertise in Databricks.
• Hands‑on experience with at least one major cloud platform (Azure, AWS, or GCP), with a good understanding of cloud data services and infrastructure.
• Strong programming skills in Python or Scala, with experience in data manipulation libraries (e. g. , Py
  Spark, Spark SQL).
• Solid understanding of data warehousing principles, ETL processes, data modeling techniques, and database systems.
• Advanced SQL skills for data querying, transformation, and analysis.
• Excellent communication and interpersonal skills, with the ability to effectively collaborate with technical and non‑technical stakeholders.
• Strong analytical and problem‑solving abilities, with a proactive approach to identifying and resolving data‑related challenges.
• Fluent in English.

Additional Information:

The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fighting against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.