Data Engineer - GCP Lisboa

Data Engineer - GCP
Lisboa
Lisboa, Lisboa, Portugal

Social network you want to login/join with:

Job Title: Data Engineer - GCP

As a Data Engineer specializing in GCP, you will play a crucial role in designing, implementing, and optimizing our data infrastructure. You will work closely with
- functional teams to drive impactful projects. This is an exciting opportunity to leverage your expertise in GCP while contributing to a company that values technological advancement and societal improvement.

Responsibilities

1. Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) to support business analytics and reporting needs.
2. Collaborate with
   - functional teams to gather and analyze requirements for data integration and transformation processes.
3. Implement data quality checks and validation routines to ensure the accuracy and reliability of data across all systems.
4. Optimize and monitor data workflows for performance and efficiency, ensuring minimal downtime and maximum throughput.
5. Stay updated with the latest GCP tools and technologies to continuously improve data infrastructure and processes.

Minimum Requirements

• Expertise in GCP, particularly
  - related services such as Big
  Query, Dataflow, and Dataproc
• Proficiency in SQL
• In-depth knowledge of one or more programming languages, preferably Python
• Expertise in database design and data modeling
• Experience with Dev
  Ops, Terraform, CI/CD
• Experience with Agile methodologies
• Familiarity with Kafka, Azure Servicebus, Airflow, and DBT is a big plus