Data Engineer GCP (Google Cloud Plataform)

Job Title

Data Engineer GCP (Google Cloud Platform)

Company

act digital EMEA - Alter Solutions

Job Description

We are looking for a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for understanding business and technological challenges, develop data pipelines tackling those challenges, and ensuring their smooth deployment. You will also be responsible for applying standard industry and company good practices, and the evolution of our various patterns. This is a remote position.

Main Responsibilities

• Projects understanding and communication: understand problems from a user perspective and clearly articulate the issue.
• Ensure the architecture provided by the Data Architect is clearly understood by yourself and communicate with the Data Architect and your peers on the technical you’re developing. Coordinate with the Project Manager in charge of the project.
• Development: write and communicate on new or updated interface contracts; develop data pipelines based on the defined architecture; apply regular good practices; deploy requested infrastructure, particularly using Terraform; make peer reviews and ask your peers to review your code when merging a new version of the codebase.
• Testing: define tests with your project manager based on the functional and technical requirements of the pipeline you’re developing; perform those tests and communicate regularly on the results; regularly summarize the results of your tests in a dedicated document.
• Deployments: present to the Data Architect and the Lead Data
  Ops the development that was performed through our Deployment Reviews; track and communicate on any potential errors during active monitoring following a deployment; ensure diligent application of deployment process, logging, and monitoring strategy.

Requested Hard Skills

• Google Cloud Platform: general knowledge of the platform and various services, and at least one year of experience with GCP.
• Azure Cloud Platform: a general knowledge of the platform is a plus.
• Apache Airflow: at least two years of experience with the Airflow orchestrator; experience with Google Composer is a plus.
• Google Big
  Query: extensive experience (at least two years) with GBQ; optimize tables and queries; design database architecture; understand
  - offs in developing and deploying infrastructure.
• Terraform: at least one year of experience with Terraform.
• Apache Spark: optional expertise; maintain and evolve pipelines rewritten in py
  Spark.
• Additional knowledge and experience that are a plus: Pub/Sub, Kafka, Google Cloud Storage, Dataflow (or Apache Beam).

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Marketing and Product Management

Industries

Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at act digital EMEA - Alter Solutions by 2x.

Get notified about new Data Engineer jobs in Porto, Portugal.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.