Data Engineer (Cloudera) Vila Real

Overview

Data Engineer (Cloudera) role at Adentis Portugal. Join to apply for the Data Engineer (Cloudera) role at Adentis Portugal.

Responsibilities

• Distributed Data Processing: Develop and optimize distributed data pipelines using Apache Spark, ensuring efficient processing of large datasets
• Caching & Computation Optimization: Implement advanced caching techniques and optimize distributed computation workflows to improve data retrieval times and resource utilization
• Partition Key Join Optimization: Optimize partition keys joins to speed up query processing and enhance overall system performance in distributed environments
• SQL Query Optimization: Optimize SQL queries for better performance and scalability, particularly in
  - scale, distributed database systems
• Cloudera Ecosystem: If applicable, leverage the Cloudera platform to manage and scale data workflows in big data ecosystems, ensuring reliability and efficiency
• Wants to learn more about Dev
  Ops to be autonomous, with the following Dev
  Ops responsibilities (5-10% of the time)

Requirements

• Expertise in Apache Spark and distributed computation techniques
• Experience with advanced SQL optimization and caching strategies
• Knowledge of the Cloudera ecosystem is a valuable asset for managing big data platforms
• Ability to work independently and take initiative to solve technical problems
• Excellent communication skills to effectively collaborate with technical and
  - technical teams
• CI/CD Pipeline Automation
• Version Control & Branching
• Deployment Automation
• Artifact Management
• Containerization & Orchestration
• Automation & Monitoring
• Available to go to the office twice per week

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Adentis Portugal by 2x

Get notified about new Data Engineer jobs in Vila Real, Vila Real, Portugal.