Data Engineer (Databricks) Lisboa

Syffer is an
- inclusive consulting company focused on talent, tech and innovation. We exist to elevate companies and humans all around the world, making change, from the inside to the outside.

We believe that technology + human kindness positively impacts every community around the world. Our approach is simple, we see a world without borders, and believe in equal opportunities. We are guided by our core principles of spreading positivity, good energy and promote equality and care for others.

Our hiring process is unique! People are selected by their value, education, talent and personality. We dont present ethnicity, religion, national origin, age, gender, sexual orientation or identity.

Its time to burst the bubble, and we will do it together!

Job Description:

• Design, build, and maintain data pipelines in Databricks with Py
  Spark (batch and streaming), following Medallion Architecture and ensuring performance optimization;
• Manage infrastructure with Terraform and Git
  Ops, orchestrate workflows with Airflow on AKS, and apply best practices for CI/CD, monitoring, and error handling;
• Collaborate with data architects, project managers, and stakeholders; participate in code reviews and knowledge sharing within the team;
• Define and execute tests to ensure data quality and pipeline reliability, and document technical specifications, workflows, and deployment processes;

Requirements:

• Proven experience with Databricks and Py
  Spark;
• Strong understanding of batch and streaming data processing;
• Experience with Azure Data Lake Storage Gen2 (ADLS);
• Solid experience with Airflow, preferably deployed in Kubernetes (AKS);
• Understanding of Medallion Architecture;
• Familiarity with data privacy, governance, and security standards;
• Working knowledge of Terraform and
  -
  - code;
• Fluent in Portuguese and English.

What We Offer:

• An inspiring work environment;
• Allocation of health insurance from the beginning of the employment;
• Delivery of work equipment adjusted to the performance of functions;
• Implementation of a hybrid work regime whenever possible;
• Payment of the food allowance in meal card (exempt from legal discounts);
• And others.

Work together with expert teams on projects of large magnitude and intensity, long term together with our clients, all leaders in their industries.

Are you ready to step into a diverse and inclusive world with us?

We are an equal opportunities employer and welcome applications from all qualified candidates.