Connecting to Databricks MCP Server

Metric Insights Concierge Service supports integration with Databricks Genie via the Model Context Protocol (MCP) Server. Establishing this connection allows Users to interact with Databricks resources directly from the Concierge interface.

This article outlines the configuration steps required to set up Databricks Genie and connect it to Concierge via MCP Server.

1. Enable MCP Server Usage

Access the Databricks account, open the user menu by clicking username icon in the upper right corner of the page and select Previews.

Find the Managed MCP Servers option and activate it.

2. Open Token Management Page

Open the user menu and select Settings.

  1. Open the Developer settings page.
  2. Click [Manage] in the Access tokens section.

3. Generate Token

  1. [Generate new token]
  2. Comment: Give the token a description.
  3. [Generate]
  4. Copy the token, you won't be able to check it again later.
  5. [Done]

4. Create New Genie Space

Go to the left-side menu and access the Genie settings page.

  1. [+ New]
  2. Select necessary data sources (tables).
  3. [Create]

5. Create Joins (Optional)

  1. Open Instructions tab.
  2. Go to Joins tab.
  3. [+Add]
  4. Define the relationship between tables.
  5. [Save]

6. Copy Important Data

Open Settings tab.

Copy the Space ID and the server URL.

7. Configure External Resource

Go to Metric Insights, access Admin > Concierge Setup and open the Content Sources tab

  1. [+ Add External Resource Configuration]
  2. Name: Give the external resource a descriptive name.
  3. Add a block of JSON code.

Code Example 

{
  "name": "databricks",
  "title": "Databricks",
  "display": "llm",
  "scenario_type": "mcp_single_tool",
  "scope": "Databricks talk to your data solution, questions about support tickets.",
  "mcp_server": {
      "url": "[DATABRICKS_HOST]/api/2.0/mcp/genie/[GENIE_SPACE_ID]",
      "name": "databricks",
      "auth": "[DATABRICKS_TOKEN]",
      "transport": "streamable_http"
    
  },
  "tool": "query_space_[GENIE_SPACE_ID]",
  "timeout": 300
}

7.1. Add Variables

Add the data copied from the Databricks account as Variables.

Click [+ Create Variable] and add Databricks token, Space ID and server URL as Variables.

Don't forget to [Save] the External Resource.

Databricks will appear in the All Sources menu after adding a Domain to its external resource.