Skip to main content

Databricks

Setting up a Databricks connection

Updated over 6 months ago

Summary

This document explains the steps needed to prepare your Databricks environment for a dScribe connection.

Prerequisites

Before you get started, make sure you have access to a user with:

  • administrator access to your Azure Databricks platform

  • administrator access to your Azure AD (now called "Azure Entra ID") environment

  • compute up and running on your Databricks platform

Step-by-step guide

  1. Go to Azure Active Directory (AAD)

    b. Select Azure Entra ID (previously called Azure Active Directory):

  2. Create an app registration TIP 1: remember the name of your application, you will need it later

    TIP 2: (important!) Make sure there are no Databricks admin-consent-required permissions set on this application.

  3. Navigate back to your application via Azure Active Directory > App Registrations > Select your newly created App and copy the Application (client) ID somewhere safe. You will need it later.

  4. In your application, navigate to 'Certificates & secrets' and create a new client secret:

  5. Copy the client secret value (not the Secret ID).

  6. Set up the Service Principals in Databricks.

  7. Add service principal.

  8. Make sure to choose 'Microsoft Entra ID managed' and copy the Entra application ID and provide a Service Principle name.

  9. Using the Workspace URL (Databricks URL string ending with .net), Tenant ID, Application (client) ID and secret value, create a new Source in dScribe.

Reached the end? Congratulations! You’re a star!

Did this answer your question?