Big Data Engineer Porto

Overview

Are you passionate about
- scale data engineering and
- performance data pipelines? We’re hiring a Big Data Engineer to work with
- edge Big Data technologies and cloud platforms.

What do you need to be a SMART Big Data Engineer?

• Degree in Computer Engineering, Information Systems, or a related field
• Strong experience with Big Data technologies: Hadoop, HDFS, Hive, Kerberos
• Proficiency in Python, Scala, and Spark (including Py
  Spark)
• Experience with Oracle and Hive
• Hands-on experience with Shell Script and analyzing Execution Plans for performance tuning
• Familiarity with Dev
  Ops concepts and CI/CD tools (Git, Azure Dev
  Ops)
• Analytical mindset to investigate and resolve complex data issues
• Minimum B2 level of English (fluency required)

What will your role at SMART be?

• Design, develop, and optimize
  - scale data pipelines and workflows
• Analyze and test different architecture and design solutions
• Investigate and resolve data quality and performance issues
• Collaborate with
  - functional teams to implement scalable data solutions
• Contribute to the continuous improvement of performance and reliability of data platforms
• Work closely with Dev
  Ops and QA to ensure stable delivery and deployment

Nice to Have

• Experience with performance optimization in distributed environments
• Exposure to cloud platforms (GCP, Azure, or AWS)
• Experience with data security concepts and authentication mechanisms (Kerberos)

Why be SMART?

• We make the projects we work on a reality
• We love what we do and take pride in the results
• We are simple, efficient, and focused

Where can you be SMART?

Work model: Hybrid (Porto or Lisbon)

Send us your English CV and become part of something SMART!

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Technology, Information and Media

Referrals increase your chances of interviewing at Smart Consulting by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.