TL;DR
Senior Staff Engineer - Cloud Architect (Azure Databricks): Designs and manages data platforms on Azure, leveraging Databricks for unified data science, engineering, and analytics with an accent on data governance (Unity Catalog), security (Entra ID, Key Vault), cost optimization. Focus on building reliable Lakehouse solutions using Microsoft's Well-Architected Framework principles for data pipelines and integration with other Azure services.
Company
Nagarro is a Digital Product Engineering company that builds products, services, and experiences that inspire and delight, with 17500+ experts across 36 countries.
What you will do
- Design end-to-end data solutions, from ingestion to consumption, using Databricks' Lakehouse Platform on Azure.
- Understand the separation of the Control Plane (Databricks managed backend) and the Data Plane (customer-owned compute and data).
- Implement Unity Catalog for centralized access control, lineage, and security across data assets.
- Integrate with Microsoft Entra ID for SSO, use Azure Key Vault for secrets, and use Microsoft Defender for Cloud for protection.
- Optimize cluster configurations, storage, and resource usage for cost efficiency.
Requirements
- Strong cloud development skills.
- Strong cloud architecture skills.
- Experience with Databricks.