Data Engineer Porto

Overview

We are looking for a Data Engineer with 5-6 years of previous experience in similar roles, with 8+ years in data engineering technical role to join our client. This is an immediate requirement. Max 30 days notice period. can be considered.

Employment details

Job Type: Contract-Full-time (40h in a week)

Model : Hybrid (3 days at office, 2 days WFH)

Key Responsibilities

• Utilize expert knowledge of AWS services like Lambda, Glue, and Step Functions to design, implement, and maintain scalable data solutions.
• Develop robust solution architectures considering scalability, performance, security, and cost optimization.
• Demonstrate proficiency in cloud networking, including VPCs, subnets, security groups, and routing tables.
• Write and optimize SQL queries and identify performance bottlenecks.
• Knowledge to manage ETL processes and data integration into Redshift, My
  SQL, and Postgre
  SQL
• Create documentation and provide training to team members.
• Set up and manage logging and tracing mechanisms in AWS using services like AWS Cloud
  Trail and AWS X-Ray.
• Implement orchestration solutions using Apache Airflow and AWS Step Functions.
• Utilize Athena for interactive query analysis of large datasets in Amazon S3.
• Provide technical leadership and guidance, acting as a subject matter expert in AWS and data engineering technologies.
• Write comprehensive solution documents and technical documentation.
• Stay updated on emerging technologies and industry trends.
• Challenge business requirements and propose innovative solutions for efficiency and performance improvement.

Qualifications / Good to have

• Knowledge in Apache Flink, Kafka, and other streaming data technologies.
• Experience with
  - native architectures and serverless computing.
• Certification in AWS, Azure or relevant technologies.

Seniority level

• Mid-Senior level

Job function

• Information Technology

Industries

• IT Services and IT Consulting