Senior Data Engineer Porto

Senior Data Engineer
Porto
Porto, Porto, Portugal

As a Data Engineer you will play a critical role in designing, building and maintaining our client's data infrastructure, ensuring efficient and accurate data processing, storage and retrieval. You will also be responsible for enhancing its data analytics platform. You will collaborate with
- functional, globally distributed teams to support the growth of our client's business.

Key Accountabilities

• Develop and maintain scalable, reliable, and
  - performance data pipelines to process, transform and load data into our data warehouse.
• Collaborate with software engineers, data scientists, business and product development teams
• Optimize data pipelines for performance and
  - efficiency, leveraging best practices and appropriate technologies.
• Implement data quality and validation checks to ensure accuracy and consistency of data.
• Document data pipelines, processes and workflows for internal reference and knowledge sharing.

Knowledge, Skills and Experience Required

• A degree in computer science, information systems or related field.
• At least 3 years’ experience as Data Engineer with track record of building and maintaining data pipelines.
• Proficiency in Python, including performance optimization techniques
• Knowledge of Py
  Spark is a plus
• Fluency in Linux shell scripting
• Expertise in processing and storage of
  - scale
  - series data and knowledge of related technologies.
• Strong SQL and relational database experience
• Familiarity with cloud compute platforms is a plus.
• Interest in automated testing and continuous integration
• A drive to learn and master new technologies and techniques
• Comfortable in a
  - paced, dynamic environment
• Excellent communication and collaboration skills
• Financial industry experience is preferred but not required