Help & Documentation
Open Support Ticket

Configuring Databricks and Collecting Data (v7.2.0)

This article describes the first step of Connecting to Databricks MCP Server. Enable the MCP Server usage, generate Token and copy all the important data from the Databricks account for authentication in Concierge.

Prerequisites:

  • Databricks Admin user account;
  • Ability to grant the Service Principal the SELECT and USE SCHEMA privileges.

In this article:

  1. Enable MCP Server Usage
  2. Create New Genie Space
  3. Create Joins (Optional)
  4. Copy Important Data
  5. Collect Data for Auth Type: Defined in Configuration
  6. Collect Data for Auth Type: Service Account Token

1. Enable MCP Server Usage

Access the Databricks account: open the user menu by clicking username icon in the upper right corner of the page and select Previews.

Find the Managed MCP Servers option and activate it.

2. Create New Genie Space

If you already have the Genie Space to use with Concierge, proceed to Step 4.

If not, go to the left-side menu and access the Genie settings page.

  1. [+ New]
  2. Select necessary data sources (tables).
  3. [Create]

3. Create Joins (Optional)

  1. Open Instructions tab.
  2. Go to Joins tab.
  3. [+Add]
  4. Define the relationship between tables.
  5. [Save]

4. Copy Important Data

In the Genie Space you created, open the Settings tab.

Copy:

  1. The Space ID from the settings information.
  2. The Server URL from your browsers navigation bar.

5. Collect Data for Auth Type: Defined in Configuration

If you have chosen "Defined in configuration" Auth Type, collect the Token.

5.1. Open the Token Management Page

Open the user menu and select Settings.

  1. Open the Developer settings page.
  2. Click [Manage] in the Access tokens section.

5.2. Generate Token

  1. [Generate new token]
  2. Comment: Give the token a description.
  3. [Generate]
  4. Copy the token, you won't be able to check it again later.
  5. [Done]
  6. Proceed to Configuring Databricks External Resource (v7.2.0)

6. Collect Data for Auth Type: Service Account Token

If you have chosen "Service Account Token" Auth Type, add a Service Principal, collect Application ID, Client Secret Value and Server URL. After that, give the newly created Service Principal the necessary Permissions and share it with your Genie Space(s).

6.1. Collect Application ID

Open the Databricks account and access User menu > Settings > Identity and access

Click [Manage] in Service principals section and create a new Service principal.

  1. [Add service principal]
  2. [Add new]
  3. Provide a Service principal name.
  4. [Add]

The new service principal will appear in the list. Copy the Application ID.

6.2. Collect Client Secret Value

Click the name of the created service principal to open its editor and go to Secrets tab.

  1. [Generate secret]
  2. Set the lifespan of the Secret.
  3. [Generate]
  4. Copy the Secret. You won't be able to see it again!
  5. [Done]

6.3. Collect the Server URL

It is the same that was collected in Step 4.

6.4. Give the Service Principal the required Permissions

Go to Catalog and open the specific data sources used by the Genie Spaces that will be used with Concierge. Open the Permissions tab.

  1. [Grant]
  2. Principals: Select the created service principal.
  3. Grant that principal the SELECT and USE SCHEMA privileges.
  4. [Confirm]

6.5. Share Genie Space with the Service Principal

Access Genie and click the Space name to be shared to open the editor.

  1. [Share]
  2. Select the created service principal.
  3. Select "Can Manage" option.
  4. [Add]
  5. Repeat for any other Spaces to be used in Concierge.
  6. Proceed to Configuring Databricks External Resource (v7.2.0)