Linux / Big Data Platform Engineer

Linux / Big Data Platform Engineer
Beja
Beja, Beja, Portugal

We are looking for a Linux System Engineer with strong experience in Big Data environments to support and operate a Cloudera/Hadoop-based data platform in production.

Role Overview

You will be responsible for operating, monitoring and supporting a
- scale Big Data infrastructure, ensuring stability, performance, security and automation across the platform lifecycle. The role has a strong
- on and L3 support component.

Key Responsibilities

• Operate, monitor and support Cloudera/Hadoop production environments.

• Provide L3 incident response, deep troubleshooting and performance tuning.

• Automate operational tasks using Python and Ansible (monitoring, alerting, deployments, configuration).

• Manage HDFS clusters, ensuring data integrity, replication and capacity planning.

• Develop and maintain monitoring and alerting for services and node health.

• Onboard new workloads in collaboration with platform and data teams, ensuring correct resource allocation.

• Apply patches, upgrades and configuration changes to ensure platform security and stability.

• Manage security components: Kerberos authentication, Ranger/Sentry policies and TLS encryption.

• Work with storage, network and security teams to optimize performance, access control and backup strategies.

• Maintain technical documentation and promote knowledge sharing within the team.

Required Skills & Experience

• Strong Linux System Engineering background.

• Proven experience working in Big Data environments.

• Hands-on experience with Hadoop / Cloudera ecosystems and Data Lake operations.

• Experience with Big Data services and query engines.

• Solid knowledge of monitoring, automation and platform lifecycle management.

• Experience diagnosing and resolving complex Big Data platform issues.

• Scripting and automation skills (Python, Ansible).

Nice to Have

• Experience in
- scale production environments.

• Familiarity with security, networking and storage concepts in Big Data platforms.

Hybrid role, 2 days per week
- site at Parque das Nações, Lisbon.