Senior Data Engineer (PySpark) - Portugal Lisboa

Senior Data Engineer (PySpark) - Portugal
Lisboa
Lisboa, Lisboa, Portugal

We are looking for a Senior Data Engineer with at least 2 years of recent Py
Spark experience to join a project with a customer in the financial services industry.

Py
Spark

As aSenior Data Engineer, be responsible for building
- quality, scalable data pipelines, defining robust data architectures, and driving quality and performance across the entire stack. More specifically, you will:

• Design, implement, and optimise robust data pipelines usingPy
  Spark and Apache Spark.
• Set up and guide architectural decisions using modern data platforms like Databricks.
• Apply best practices across batch and streaming data processing to support
  - driven initiatives
• Drive collaboration with
  - functional stakeholders in a large enterprise setting—ideally you have experience within banking, insurance, or financial services
• Collaborate within a
  - functional, international team in a
  - paced enterprise environment
• Possibly mentor and guide junior engineers

Position Requirements

We highly value individual experience and are not only interested in ticking boxes, nevertheless, there are some essential skills required to get the job done:

• Bachelor's degree in Computer Science or a relevant field.
• 5+ years of experience in Data Engineering, with strong expertise inPy
  Spark, Spark, and distributed computing
• Strong command of SQL , including optimisation, window functions, and complex transformations
• Experience with Databricks and or other
  - code enterprise data platforms.
• Deep familiarity with data architectures (data lakehouse, warehouse, streaming systems)
• Strong scripting skills in Python for data transformation and automation
• Solid understanding of data quality , schema evolution, and monitoring best practices.
• Experience with version control systems (Git).
• English Proficiency, both spoken and written
• Resident and eligible to work in Portugal

Nice skills to have will be

• Familiarity with Azure Cloud (certification preferred)
• Experience as a backend or
  - stack developer (e. g. Python / Node. js / Java / C# / C++)
• Understanding of Lambda/Kappa architectures and their application to
  - time analytics
• Solid grasp of CI/CD
• Experience with containerization (Docker, Kubernetes)
• Proven experience leading or mentoring teams in corporate environments

What’s in it for you?

• Competitive salary (negotiable based on experience) as we value top talent.
• Cutting-edge hardware: A
  - performance laptop with ample memory and processing power, along with any peripherals you need.
• A dynamic and collaborative work environment where your leadership will shape the team’s future.
• Opportunities for professional development and ongoing training to keep you at the forefront of technology.
• A comprehensive health insurance package and attractive benefits.
• Quarterly team
  - togethers for collaboration, innovation, and fun!
• A welcoming and inclusive workplace where we embrace diversity and creativity.

Work Setup

• You will have the option of working in either of our offices (Évora or Lisbon), or from the comfort of your home. Many of us work remotely.
• The main point is that you’ll be in touch with a great team who really enjoy working together.

Apply using the form below

First name

Last name

Email

Phone number

Message

Resume

Two Impulse needs the contact information provided to get back to you. You may unsubscribe from our communications at any time. For more information, please review our Privacy Policy.

SUBSCRIBE NEWSLETTER

Get awesome monthly updates about what’s going on in the Two Impulse world. This means company and team news, essential product information, blog articles and valuable insights, and much more.

First name

Email

I agree to receive the newsletter from Two Impulse.

I agree to receive the newsletter from Two Impulse.

By clicking subscribe, you consent us to store and process the information above to provide you the content requested. You may unsubscribe from our communications at any time. For more information, please review our Privacy Policy.