Data Engineer Leiria

Data Engineer
Leiria
Leiria, Leiria District, Portugal

We’re looking for the special, unique and amazing YOU!

@ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work.

At KCS we stand for equality and value diversity. We create a safe, diverse environment where opportunities are equal for everyone! We do not discriminate based on age, ethnicity, sexual orientation, gender, disability or any factor other than merit. All applications with skills for the position are welcome!

We are looking for an Amazing: Data Engineer

The amazing you, will have:

• Bachelor's degree in Computer Science, Software Engineering, or a related field;
• Expertise on
  -
  - end Data Pipeline Development and ETL processes;
• Proficiency in programming languages such as Python, Java, or Scala ;
• Strong knowledge of SQL and No
  SQL databases;
• Experience with Big Data technologies such as Databricks, Hadoop, Apache Spark, Kafka;
• Fluency in English is mandatory .
• Availability for a hybrid regime at Porto or Lisbon (Portugal);

Who are we?

Founded in 2008 and based in Lisbon, KCS IT is a consulting company in the field of Information Technology and Services, focused on creating value for our clients through three main areas: Consulting, Outsourcing, Inovation and Training. Our commitment to talent development is unmistakable in the recent opening of the Porto and Azores hubs, which aims to develop technology for the national and international market. Since 2018 we have been elected one of the 10 major companies in the “Index of Excellence”, an initiative that aims to reward organizations that invest most in the development and satisfaction of their employees.

Are you looking to take a step forward in your career in IT and Telecommunications? Then you've come to the right place - Smart!

Technology, transformation and innovation are part of our DNA. We are a technology consulting company with more than a decade of experience in developing national and international projects in IT and Telecom and we want to be part of your story.

What do you need to be SMART Data Engineer?

• More than 5 years as a Data Engineer;

• Experienced in any cloud - for this position there is no preferance!

• Proficient in Databriks - able to discuss the Architecture;

• Experience in Python and SQL;

Why be SMART?

• We make the projects we take part in a reality.

• We love what we do and take pride in the results of our work.

• We are simple and efficient.

• We are a dynamic team, honest and reliable team.

Where can you be SMART?

Remote

Do you have a SMART profile?

Send your CV to

About Us

Planck Technologies is a company specialized in Software Development, dedicated to shaping futures and creating value through innovative IT solutions. By expanding teams and offering a comprehensive range of services—from Software Development and Infrastructure Management to Cybersecurity—we empower clients with all the expertise they need in one place. Inspired by the principles of quantum physics, we push beyond traditional boundaries to deliver customized solutions that redefine the IT landscape and drive shared success.

About the job

• Design, build, and optimize batch and streaming data pipelines in Databricks (Py
  Spark, Spark SQL);
• Implement scalable data transformations aligned with the Medallion Architecture (Bronze, Silver, Gold);
• Ensure data quality, reliability, and performance through testing and monitoring;
• Manage data infrastructure using Terraform and Git
  Ops principles;
• Operate workflows with Airflow on Azure Kubernetes Service (AKS);
• Collaborate with Data Architects, Project Managers, and stakeholders to align on solutions and delivery;
• Participate in code reviews and contribute to knowledge sharing within the engineering team;
• Document workflows, processes, and deployment standards.

What are we looking for?

• Strong experience with Databricks, Py
  Spark, and Spark SQL;
• Proven expertise in batch and streaming data processing;
• Hands-on experience with Azure Data Lake Storage Gen2 (ADLS);
• Solid knowledge of Airflow, preferably on Kubernetes (AKS);
• Understanding of Medallion Architecture principles;
• Familiarity with Terraform and
  -
  - code practices;
• Awareness of data privacy, governance, and security standards.

Nice to Have

• Experience with Talend and/or Fivetran;
• Knowledge of Databricks Asset Bundles;
• Familiarity with Vault, Helm charts, and Kafka monitoring tools.

Location: Remote, Portugal

We're waiting for you!

Hoje

Hoje

Ontem

team. it, back to basics!

Cargo

Ontem

Your connection with Aubay starts in the following lines:

Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as banking, insurance, telecommunications, services, energy and transports.

What are you going to do?

• Daily production checks are carried out to find any delays or mistakes in processes or flows and guarantee prompt action from the appropriate departments.
• Coordinating with IT OPS teams and subsidiaries to manage production incidents throughout their entire lifecycle.
• Keeping in constant contact with corporate entities to update them on the status of incidents.
• Supporting the resolution of issues pertaining to data.
• Creating reports on significant events and incidents, as well as suggesting enhancements for monitoring dashboards.
• Responding to requests for infrastructure (networks, databases, storage, etc. ).
• Deliveries, including CI/CD toolchains for
  - production and production settings, are coordinated with IT OPS.
• Keeping an eye on infrastructure expenses while working with the FINOPS group.
• Evaluating modifications and making suggestions.
• Encouraging the team to adopt a culture of constant improvement.

What are we looking for?

• Bachelor’s degree in Computer Science, Engineering, or a related field;
• Strong Dremio experience (at least one year is required);
• Technical expertise: Shell programming in SQL on Dremio Unix;
• Tools for monitoring: Grafana (ELK), Kibana, and Dynatrace;
• Tools for ITIL and incident management: Service
  Now, Jira CI/CD: Jenkins, DBT, Git
  Lab;
• Tools for orchestration: Airflow, Reflections, and Autosys;
• Lifecycle of Software Development (SDLC);
• Proficiency in English (at least C1 level);
• Based in Portugal (citizenship or Work Visa – mandatory).

What do we have to offer you?

• Health Insurance;
• Feedback&Coffee – the system that includes Aubay’s Performance Management Cycle, with regular moments of feedback and the Career Progression Model;
• A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring;
• Events and Teambuildings.

What makes us different?

• Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning;
• Reference prizes and birthday present;
• We don’t have a dress code;
• We know your name and all address each other informally;
• You will grow in good company. Isn’t this one of the ways in which to develop professionally?

If we got your attention, we now hope to spark your enthusiasm. Ready for the first phase?

We are waiting for you at

Personal Data collected by AUBAY PORTUGAL as Data Controller, regarding the identification, contact and professional capabilities of the candidates, in the present procedure, will be processed for the application analysis, having in consideration that the processing is conducted in order to to take the steps, at the request of the data subject, prior to entering into a contract;

Personal data sent through the present application will be kept by Aubay during the application procedure and will remain stored whilst updated (for two years period).

The collected data might be transferred or include other processing actitivites, as long as the data subject is informed, in the occurrence of a standard application and selection procedure, for the compliance of legal obligations for the time required by law.

For any queries or request regarding personal data protection rights, the Data Subject may contact AUBAY PORTUGAL’s headquarters in Avenida Duque D`Ávila, nº46 em Lisboa or use the DPO’s
- mail. The Data Subject also has the right to file a complaint with the National Data Protection Authority (please do not include data regarding racial or ethnical origins, political opinions, religion, philosophy, biometrical data, health data, sexual life and orientation, or relating to criminal convictions and offences. )

We’re looking for a Senior Data Engineer to join our team and support one of our clients – a leading company with a strong focus on Databricks.

What You’ll Do:

• Design, build, and optimize data pipelines using Databricks Py
  Spark in production environments;
• Work with large-scale and complex datasets , ensuring performance, scalability, and reliability;
• Collaborate with
  - functional teams to translate business requirements into technical solutions ;
• Apply best practices in data engineering , including testing, monitoring, and performance tuning;
• Leverage cloud platforms (Azure, AWS, or GCP) to deliver scalable,
  - performing solutions;
• Ensure data quality, governance, and compliance across the entire pipeline lifecycle.

What You Need to Succeed:

• Strong expertise in Python and SQL ;
• Proven track record of delivering Databricks Py
  Spark pipelines into production ;
• Solid,
  - on experience with Databricks ;
• Experience with at least one major cloud provider (Azure, AWS, or GCP);
• Demonstrated ability to work with large datasets and design robust, scalable pipelines.

What We Offer:

• Integration into a solid, international project with a Databricks-driven company;
• Opportunity to work on innovative,
  - scale data engineering solutions ;
• A dynamic and collaborative environment with
  - edge technologies;
• Competitive compensation package , aligned with your experience and impact;
• Continuous learning and career development opportunities in Data Engineering.