Position: Azure Databricks Administrator

Client Location: Boston, MA

Work Location: On-site Highly Preferred (Remote is OK for 100% match)

Duration: Long Term

Rate: Quote your best

Scope of Services:

Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.
Set up and manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS/ACI), Storage Accounts, and Networking.
Design and implement a monitoring and observability framework using tools like Azure Monitor, Log Analytics, and Prometheus/Grafana.
Collaborate with platform and data engineering teams to enable microservices-based architecture for scalable and modular data solutions.
Drive automation and CI/CD practices using Terraform, ARM templates, and GitHub Actions/Azure DevOps.

Required Skills:

Overall 9+ years of Data and Analytics experience
5+ years of experience as Databricks Administration and cloud engineering.
Should know how to Automate, and Performance Tuning the Databricks
Able to Install, Configure, and Maintain Databricks clusters and workspaces.
5+ years hands-on experience with DevOps tools.
Strong hands-on experience with Delta Lake, and Apache Spark.
Deep understanding of Azure services: Resource Manager, AKS, ACR, Key Vault, and Networking.
Proven experience in Microservices Architecture and Container orchestration.
Expertise in Infrastructure-as-code, scripting (Python, Bash), and DevOps tooling.
Familiarity with data governance, security, and cost optimization in cloud environments.
Experience with event-driven architectures (Kafka/Event Grid).
Knowledge of data mesh principles and distributed data ownership.

Job Type: Contract

Pay: $55.00 - $70.00 per hour

Expected hours: 40 per week

Work Location: Remote

WissenPro LLC

Latest Jobs