Senior Data Porto

Overview

Fox IT is a Portuguese consulting company that for the 4th consecutive year is in the top 5% of best SMEs in Portugal. Our mission is to bring a new approach to the IT market, promoting a fairer exchange between us, our consultants and our customers.

We are seeking a Senior Data & Solution Architect to join our team in Oporto.

Role and Responsibilities

The role involves designing scalable and efficient data solutions on AWS, leading technical initiatives, and ensuring production readiness. Key responsibilities include:

• Collaborate with functional teams to translate business requirements into technical solutions and documentation.
• Design and implement data architectures on AWS using services such as Lambda, Glue, Step Functions, Cloud
  Formation, and Cloud
  Watch.
• Proactively monitor production systems and troubleshoot issues to minimize disruption.
• Provide technical leadership and guidance, with potential progression to a technical lead role.
• Develop solution documents and technical documentation; challenge and refine business requirements as needed.
• Work with orchestration and workflow tools (e. g. , Apache Airflow, AWS Step Functions) to automate and manage data workflows.
• Leverage ETL tools and experience with large data volumes; familiarity with Kafka is preferred.
• Experience with Iceberg tables for efficient management of large datasets and ACID transactions.
• Engage with Azure Databricks for data engineering and analytics tasks as appropriate.

Requirements

• Expertise in AWS: extensive experience with AWS services, including Lambda, Glue, Step Functions, Cloud
  Formation, and Cloud
  Watch.
• Strong Solution Architecture knowledge: ability to design scalable and efficient data solutions on AWS, adhering to cloud best practices.
• Proficiency in Python and databases: strong Python skills; experience with relational databases (My
  SQL, Postgre
  SQL, Redshift) and No
  SQL databases.
• Orchestration and workflow management: experience with tools such as Apache Airflow and AWS Step Functions.
• ETL tools and big data experience: familiarity with ETL tools and handling large data volumes; Kafka experience preferred.
• Experience with Iceberg tables.
• Production awareness and troubleshooting mindset.
• Technical leadership and communication: strong collaboration skills and potential to evolve into a technical lead role.
• Documentation and requirements analysis: ability to write solution documents and refine business requirements.
• Exposure to Azure Databricks.
• Fluent in written and spoken English.

Preferred Qualifications

• Experience with My
  SQL (note: also presented as My
  
  SQL in original).
• Knowledge in Apache Flink, Kafka, and other streaming data technologies.
• Experience with native architectures and serverless computing.
• Certification in AWS, Azure or relevant technologies.

Regime and Location

Regime: Hybrid (Needs to work at the office 3 times per week - Porto).

What we offer

• Collaborative, innovative work environment.
• Exciting projects with edge technologies.
• Continuous learning and career growth opportunities.