Data Engineer / Python Dev / Devops Lisboa

Data Engineer / Python Dev / Devops
Lisboa
Lisboa, Lisboa, Portugal

• You will be part of a team of 5 developers and will report to the Data domain manager;
  
  
• Analyze and refactor existing code primarily developed by data engineers;
  
  
• Establish and maintain modular and clean development standards;
  
  
• Experience withcode reviews and provide feedback to improve code quality and development practices;
  
  
• Write and execute unit tests, integration tests, performance tests, and regression tests to ensure code robustness and quality;
  
  
• Ensure migration and compatibility with recent versions of Python 3 while managing the existing code;
  
  
• Apply the SOLIDprinciples of
  - oriented design to ensure code quality and maintainability;
  
  
• Work with toolsand environments such as Cloudera to manage and optimize da
• Understand and apply distributed computing principles to optimize data processing and computation.

Dev
Ops responsibilities:

• Experience with Git
  Lab CI/CD for automation of build and deployment processes;
  
  
• Collaborate with data engineering teams to understand and improve existing data pipelines;
  
  
• Implement Continuous Integration (CI) using Jenkins and Jenkins files/groovy, Sonar
  Qube;
  
  
• Familiarity with Sonar
  Qube for code quality analysis;
  
  
• Develop, deploy, and manage containerized applications using Docker
• Understanding of deployment strategies using Virtuozzo Containers and Docker.
• Knowledge of Cloudera platform and its integration with Python applications;
  
  
• Experience withJira API for task and project management;
  
  
• Familiarity with Nexus Repository for artifact management;
  
  
• Strong troubleshooting skills and ability to optimize performance;
  
  
• Knowledge of package management with Py
  PI and pip;
  
  
• Auto feed DEV, SIM, UAT envs.

• Proven experience (3+ years) in Python development, with a strong understanding of
  - oriented and modular programming principles;
  
  
• Good knowledge of Python 3 and the challenges associated with migrating from older versions;
  
  
• Deep understanding of the SOLID principles of
  - oriented design;
  
  
• Expertise in code refactoring and improving code quality;
  
  
• Proficiency in unit testing, integration testing, performance testing, and regression testing;
  
  
• Experience withdistributed computing principles and optimizing data processing (for example:
  
  
• Understanding of data modelling and creating data structures on Hadoop;
  
  
• Experience withbig data environments, particularly Cloudera, is a significant plus.

If you’re interested in this job please send your CV in English to career@decskill.com with reference “SS / DEDOP)”

Decskill is committed to equality and
- discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being.