Data Engineer Gcp (Google Cloud Plataform) Lisboa

Data Engineer Gcp (Google Cloud Plataform)
Lisboa
Lisboa, Lisboa, Portugal

Social network you want to login/join with:

col-narrow-left

Client:

Alter Solutions

Location:

Lisboa, Portugal

Job Category:

Other

-$0-0/monthly

EU work permit required:

Yes

Job Views:

3

Posted:

18. 04. 2025

Expiry Date:

02. 06. 2025

Job Description:

Company Description

Alter Solutions Portugal is an IT Consultancy Company, promoter of Digital Transformation, part of the Alter Solutions Group, created in 2006, in Paris. In Portugal, we partner with over 120 clients and a team of over 500 people, working in projects for industries as diverse as banking, insurance, transportation, aviation, energy, and telecom. Headquarters of the Nearshore IT center, Alter Solutions Portugal has a dedicated team of around 30 specialized professionals, integrated into projects with several internationally renowned clients.

Job Description

We are looking for a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for understanding business and technological challenges, developing data pipelines tackling those challenges, and ensuring their smooth deployment. You will also be responsible for the applications of standard industry and
-
- company good practices, and the application and evolution of our various patterns. This is a remote position.

MAIN RESPONSIBILITIES

1. Projects understanding and Communication:

- Understand problems from a user perspective and communicate clearly to understand the issue.

- Ensure the architecture provided by the Data Architect is clearly understood.

- Communicate with the Data Architect and your peers on the technical solution you’re developing and communicate with the Project Manager in charge of the project you’re working on.

2. Development:

- Write and communicate on new or updated interface contracts.

- Develop data pipelines based on the defined architecture.

- Ensure the regular good practices are applied.

- Deploy requested infrastructure, particularly using Terraform.

- Make peer reviews and ask your peers to review your code when merging a new version of the codebase.

3. Testing:

- Define tests with your project manager, based on the functional and technical requirements of the pipeline you’re developing.

- Perform those tests and communicate regularly on the results.

- Regularly summarize the results of your tests in a dedicated document.

4. Deployments:

- Present to the Data Architect in charge of the architecture, and the Lead Data
Ops, the development that was performed through our Deployment Reviews.

- Track and communicate on any potential errors in the entire period of active monitoring following a deployment.

- Ensure diligent application of deployment process, logging, and monitoring strategy.

REQUESTED HARD SKILLS

• Google Cloud Platform:
  
  General knowledge of the platform and various services, and at least one year of experience with GCP.
• Azure Cloud Platform:
  
  A general knowledge of the platform is a plus.
• Apache Airflow:
  
  At least two years of experience with the Airflow orchestrator, experience with Google Composer is a plus.
• Google Big
  Query:
  
  Extensive experience (at least 2 years) with GBQ, know how to optimize tables and queries, and able to design database architecture. The candidate should know more than the regular creation of tables and should be aware of
  - offs in developing and deploying some infrastructure versus others.
• Terraform:
  
  At least one year of experience with Terraform.
• Apache Spark:
  
  This is an optional expertise we would highly value. Some of our pipelines are slowly being rewritten using py
  Spark, the Data Engineer should be able to maintain and evolve them.
• Additional knowledge and experience that are a plus:
  
  

- Pub/Sub

- Kafka

- Google Cloud Storage

- Dataflow (or Apache Beam)

#J-18808-Ljbffr