Databricks Admin

Office in India: Chennai,

Data DevOps

Location-specific conditions & benefits*

Choose an option

We are seeking a skilled and experienced Databricks Admin to join our team and lead the deployment, management, and enhancement of our data infrastructure. The ideal candidate will have a strong background in Azure Databricks, Azure Datalake, and related cloud solutions, with a passion for driving innovation in data engineering through automation and technical expertise.

Responsibilities

Conceptualize the design and develop technical solutions for Azure Databricks architecture configuration
Implement Databricks Lakehouse architecture and provide technical leadership to enable its successful adoption
Manage Databricks infrastructure by integrating it seamlessly with existing network, security, messaging, and remote access components
Automate Databricks environment deployments through Infrastructure as Code (IaC) practices
Troubleshoot and resolve performance, connectivity, and security issues in Databricks environments, including providing on-call production support
Design and implement monitoring and alerting solutions for Databricks environments, along with standardizing access patterns and developing high-availability and disaster recovery solutions
Maintain comprehensive documentation for Databricks solutions, including design documents, data dictionaries, and operational procedures
Integrate Databricks with third-party applications such as Dataiku, Starburst, Immuta, Collibra, and Snowflake
Stay informed on advancements in the data engineering and big data ecosystems, identifying opportunities to evolve Databricks-based solutions
Advocate for Databricks and its capabilities, promoting its value across organizational teams
Lead, coach, and mentor team members by providing technical guidance and support
Foster collaborative relationships with technology teams and business partners to align technology initiatives with business objectives
Leverage agile methodologies to address challenges and contribute to technical decision-making

Requirements

8+ years of relevant experience
Hands-on experience in architecting, deploying, managing, and supporting Azure Databricks, Azure Datalake, and related solutions
Hands-on experience with cloud provider tools and architecture, particularly on Azure
Expertise using scripting languages and CLI tools such as Ansible, SQL, Terraform, Azure CLI, Databricks CLI, PowerShell, or Bash
Knowledge of data ingestion and pipeline patterns, including tools like Qlik Replicate, Qlik Compose, Databricks, Kafka, Matillion ELT, and Snowflake Services
Familiarity with working in an agile product development environment
Strong communication skills with the ability to articulate system designs and patterns across various organizational levels
English level of minimum B2 (Upper-Intermediate) for effective communication

Nice to have

Experience managing and tuning data platforms such as Azure ADLS Storage and Databricks
Proficiency with additional Azure services like Synapse Analytics, Key Vault, or DataFactory
Knowledge of maintaining CI/CD pipelines and versioning tools, such as Git

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job