Lead Data Software Engineer Portugal

Responsibilities

• Lead modern data platforms implementation starting from requirements identification and up to production releases
• Design and develop highly scalable, maintainable and data centric solutions using Azure cloud and Databricks
• Design, create, optimize and maintain EL/ETL/ELT data pipelines and orchestration processes
• Design, create, optimize and maintain data models
• Ensure data quality processes, monitoring and data cleansing
• Contribute to data governance activities
• Collaborate with cross-functional teams to integrate data into various systems and applications
• Drive and facilitate direct communication with project sponsors and business stakeholders

Requirements

• Azure Data stack experience: Databricks, Data Lakehouse, Delta Lake, ADF, ADLS, Apache Spark, SQL/NoSQL, Key vault
• Strong experience with Python, PySpark
• Strong understanding of data processing design patterns: EL, ETL, ELT, incremental/delta loads and data streaming (optional)
• Strong knowledge of RDBMS, data marts and Lakehouse design concepts
• Ability to support infrastructure, security, network, and data exchange and distribution topics
• Ability to work collaboratively with cross-functional teams
• Excellent problem-solving skills and attention to detail
• Upper-Intermediate level of English, both spoken and written (B2+)

We Offer

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours