Databricks & Snowflake Infrastructure Engineer

Databricks & Snowflake Infrastructure Engineer

Day to Day Job Duties
Design, build, and maintain Terraform templates and Infrastructure as Code (IaC) frameworks to automate the deployment of Databricks and Snowflake platforms on AWS.
Deploy and configure Databricks workspaces, account-level settings, workspace networking, cluster policies, service principals, and Unity Catalog environments using Terraform and platform APIs.
Configure and validate Unity Catalog metastore architecture, catalog/schema structure, external locations, storage credentials, privilege models, and data governance controls.
Deploy and validate Snowflake accounts, virtual warehouses, databases, schemas, roles, warehouses, resource monitors, and role-based access control (RBAC) configurations.
Implement secure AWS infrastructure, including VPCs, PrivateLink, security groups, IAM roles, KMS encryption, Secrets Manager, and network segmentation to support Databricks and Snowflake deployments.
Build CI/CD pipelines to automate environment provisioning, configuration management, testing, and promotion across development, QA, and production environments.
Perform platform validation and operational readiness testing, including authentication, authorization, networking, connectivity, data access, encryption, monitoring, and disaster recovery capabilities.
Partner with Cloud Architects, Security Engineers, and Data Platform teams to establish deployment standards, reference architectures, and platform governance controls.
Troubleshoot infrastructure, connectivity, identity, Unity Catalog, and Snowflake security configuration issues.
Create reusable deployment accelerators, Terraform modules, platform blueprints, and operational runbooks to support enterprise-scale platform rollouts.
Basic Qualifications
Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.
Minimum 5+ years of hands-on experience developing Infrastructure as Code (IaC) solutions using Terraform.
Minimum 5+ years of experience with AWS services, including VPCs, IAM, KMS, Secrets Manager, CloudTrail, networking, and cloud security.
Minimum 3+ years of experience deploying and administering Databricks on AWS, including workspace deployment, Unity Catalog, cluster policies, service principals, secrets management, and workspace networking.
Minimum 3+ years of experience deploying and administering Snowflake, including account setup, database architecture, warehouses, RBAC, data sharing, security policies, and resource governance.
Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.
Minimum 3+ years of experience implementing secure cloud architectures, including encryption, identity management, secrets management, and network isolation.
Minimum 2+ years of experience developing automation and deployment scripts using Python, Bash, or PowerShell.
Experience validating platform readiness, security controls, operational processes, monitoring, logging, and compliance requirements for production deployments.
Experience implementing DevSecOps practices, infrastructure governance, automated policy enforcement, and security compliance controls.
Experience working in Agile delivery environments with sprint-based development and stakeholder collaboration.
Strong client-facing communication skills with the ability to lead architecture reviews, deployment planning workshops, and technical validation sessions.
Preferred Qualifications
Experience deploying enterprise Databricks and Snowflake platforms supporting Data Engineering, Analytics, AI/ML, and governance workloads.
Experience implementing Unity Catalog governance models, multi-workspace architectures, and cross-account AWS deployment patterns.
Experience configuring Snowflake network policies, private connectivity, SSO integration, SCIM provisioning, and advanced security features.
Experience supporting regulated financial services, banking, healthcare, or other highly governed environments.
AWS, Terraform, Databricks, and Snowflake certifications preferred.

Experience Level

Senior Level