Data Engineer (Cloudera) Setúbal

Data Engineer (Cloudera)
Setúbal
Setúbal, Setubal, Portugal

With just over 7 years of experience in the Portuguese market, we share our DNA with more than 200 workers and position our offer according to 3 lines of service:

Strategy

• Outsourcing
• Ne
  Xel
• Team as a Service
• Tech Academies

R&D

• Bootcamps
• Proof of Concept (Po
  C)
• Tech Lab

Nearshore

In ADENTIS, we focus on PEOPLE. This is our emotional salary:

• Great Work-Life balance
• Very flexible organizational routine
• Health benefits (for you and your family)
• Team Building activities
• Over 300 protocols offering discounts in various areas
• Continuous professional development sponsored by our Training and Certification Department
• Regular feedback on your performance through personalized plans
• Comprehensive career planning and progression involving performance reviews

Responsibilities

1. Distributed Data Processing: Develop and optimize distributed data pipelines using Apache Spark for efficient large dataset processing
2. Caching & Computation Optimization: Implement advanced caching techniques and optimize workflows to improve data retrieval and resource utilization
3. Partition Key Join Optimization: Enhance query processing speed and system performance through partition key joins
4. SQL Query Optimization: Improve performance and scalability of SQL queries in
   - scale, distributed database systems
5. Cloudera Ecosystem: Leverage the Cloudera platform to manage and scale data workflows, ensuring reliability and efficiency
6. Dev
   Ops Learning (5-10% of time): Develop autonomy in Dev
   Ops responsibilities

Requirements

• Expertise in Apache Spark and distributed computation techniques
• Experience with advanced SQL optimization and caching strategies
• Knowledge of the Cloudera ecosystem is a valuable asset
• Ability to work independently and solve technical problems proactively
• Excellent communication skills for collaboration across teams
• CI/CD pipeline automation
• Version control and branching
• Deployment automation
• Artifact management
• Containerization and orchestration
• Automation and monitoring
• Availability to work
  - office twice a week

If you want to be part of a real People First organization, join us! Send your CV to *