Data & Solution Architect Porto

Data & Solution Architect
Porto
Porto, Porto, Portugal

• Expertise in AWS: Extensive experience with AWS services, including Lambda, Glue, Step Functions, Cloud
  Formation, and Cloud
  Watch.
• Strong Solution Architecture Knowledge: Ability to design scalable and efficient data solutions on AWS, adhering to best practices for cloud architecture and infrastructure.
• Proficiency in Python and Databases: Strong programming skills in Python and experience with relational databases (My
  SQL, Postgre
  SQL, Redshift) and No
  SQL databases.
• Orchestration and Workflow Management: Experience with orchestration tools such as Apache Airflow and AWS Step Functions for automating and managing data workflows.
• ETL Tools and Big Data Experience: Knowledge of ETL tools and experience working with large volumes of data, with a preference for experience with Kafka.
• Experience with Iceberg Tables: Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions.
• Production Awareness and Troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.
• Technical Leadership and Communication: Capability to evolve into a technical lead role, with excellent communication and teamwork skills for effective collaboration with
  - functional teams.
• Documentation and Requirements Analysis: Experience in writing solution documents and technical documentation, with the ability to challenge and refine business requirements.
• Exposure to Azure Databricks: Familiarity with Databricks for data engineering and analytics tasks