Requirements: English
Company: Cavendish Professionals
Region: Madrid , Community of Madrid
Our client is looking for a remote Lead Data Engineer on a full-time, freelance basis
Qualifications
- Advanced Python knowledge and software engineering skills.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with Databricks for data ingestion and transformation.
- Hands-on experience with one or more cloud services (Azure - must, AWS, GCP).
- Experience with Azure Data Factory, Azure Cosmos DB, Azure functions, Event store, ADLS, Key Vault.
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
- Solid understanding of the software development life cycle.
- Strong communication, interpersonal and presentation skills.
- Experience leading teams.