Senior Spark/Pyspark Lisboa

Senior Spark/Pyspark
Lisboa
Lisboa, Lisboa, Portugal

Social network you want to login/join with:

Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners.

We are looking for a Senior Spark/Pyspark (databricks) for an Oil Company

Requirements:
The data engineering team is asking for engineers to join the Data Engineering analytics team
- To focus on reworking and modernizing our python and pyspark ETL library and Delta tables.
o possibly leaning more toward software engineer than strict data engineer.
o if they have Databricks experience that would be great.
- To focus on data engineering to bring in new tables and curate them for end users.
o Candidate needs to have strong python/pyspark and SQL knowledge.
- To focus on building out our Data Quality framework with the Great Expectation spark library.

• Duration: Long Term Contract;
• Localization: Hybrid (with at least one time per week at the office. ), Lisbon, Coimbra or Braga. Candidates must be living in Portugal.