Job Summary: Lead the design, implementation, and integration of data solutions and Lakehouse architectures, ensuring data quality, governance, traceability, and availability, while supporting junior data engineers. Key Highlights: 1. Technical leadership in designing and implementing Lakehouse data solutions. 2. Opportunity for mentoring and team management of junior data engineers. 3. Focus on data quality, governance, and traceability in complex environments. Job Objective Lead the design, implementation, and integration of data solutions and Lakehouse architectures, ensuring quality, governance, traceability, and availability of data, and providing technical support to less senior data engineers. Scope / Responsibilities * Design and implementation of relational data models and ETL/ELT processes. * Processing on analytical platforms and publishing data for operational and analytical consumption. * Integration of multiple data sources and implementation of data architectures. * Ensuring data quality and enabling data for web applications, dashboards, and AI components; technical leadership of the data domain. Minimum Requirements (Mandatory) * Minimum 5 years of hands-on experience in projects using Databricks and cloud technologies, preferably in the mining industry. * Data Engineering solutions using Python, SQL, and Databricks under Lakehouse architectures (Delta Lake, Unity Catalog, Medallion architecture). * Building and optimizing ETL processes, relational modeling, and distributed processing (PySpark) with validation, traceability, and governance. * Orchestration using Databricks Workflows / DLT and Azure Data Factory; deployment using Databricks Asset Bundles (DAB). * Development and integration of APIs and data services; CI/CD, automated deployments, and environment management. * Software engineering best practices (modular, maintainable code with testing and documentation) and version control **with Git:** branches, pull requests, and code reviews. Certifications (Valued by the Client) * Required: Databricks Certified Data Engineer Associate (valued / differentiator in application). * Desired: Databricks Certified Associate Developer for Apache Spark (valued / differentiator in application). * Desired: DP\-750 — Azure Databricks Data Engineer Associate. * Desired (bonus): Databricks Certified Data Engineer Professional. Project, People, and Communication Management * Time management: plans and prioritizes own and team’s workloads, anticipating blockers. * Requirements management: independently gathers, translates, and negotiates requirements with stakeholders. * People/team management: provides technical leadership, distributes tasks, and mentors junior engineers. * Communication: clearly presents technical results and decisions to both technical and business counterparts. Desirable Requirements (Differentiators) * Specialization / postgraduate degree in Data Engineering or Data Architecture, Big Data, or Analytical Platforms. * Experience with industrial data sources: process historians (PI System or equivalents), LIMS, dispatch systems, or ERP (adds differentiation). * Prior experience in data projects within the mining industry (non-exclusive; no knowledge of mining processes required).
Sofía Muñoz
MyJob · HR
Sofía Muñoz
MyJob · HR
