Setting Up Azure AI Search Index for Concierge

If the customer uses Azure Services and wants to use those Services to index documents for Metric Insights Concierge to search, this article describes how to set up this index.

NOTE: The only models fully supported by the Metric Insights Concierge "external resource" feature for utilizing Azure AI Search are GPT-4o and GPT-4-Turbo deployed in Azure. It will not work for non-Azure models or non-OpenAI models deployed to Azure. This feature also has not been tested with any other OpenAI models available on Azure.

Prerequisites

1. Prepare the Documents

All the documents that will be indexed have to be downloaded locally for use. Upload all the documents that you want to search in Concierge into the Azure Index.

Recommended best practices:

  • Convert your PDF or DOCX documents to plain text or markdown. Review the conversion results before handing the document to Azure for indexing to avoid issues (e.g., data loss, unwanted artifacts, or the absence of support for tables)
  • Documents should be no longer than 65,000 characters. Azure will crop anything more than that
  • Shorter documents are preferred, especially if each document represents a self-contained unit of knowledge such as a single question and answer 
  • Each document should include a clear title or caption indicating its contents
  • If a document is divided into smaller parts, use the original title along with a specific title for each part

2. Create an Azure OpenAI Resource

If it wasn't done previously, create an Azure OpenAI Resource. For detailed instructions about how to do that, take a look at this article.

Set Up an Azure Index

1. Open Azure OpenAI Service Studio

Access Azure OpenAI Service

In the Resource drop-down menu, choose the Azure OpenAI Resource, created previously.

2. Create Deployment for the Latest GPT Model

Access Shared resources > Deployments

  1. [+Deploy model] and select "Deploy base model" from the drop-down menu to open the selection window
  2. Select gpt-4 model
  3. [Confirm]

3. Create Deployment for an Embedding Model

  1. [+Deploy model] and select "Deploy base model" from the drop-down menu to open the selection window
  2. Select an embedding model
  3. [Confirm]

NOTE: Copy the name of the embedding model; it will be needed later to set the Concierge External Resource.

4. Select Deployment in Chat

Access Playgrounds > Chat

Click the Deployment field and select the GPT-4 model that was deployed before.

5. Add a Data Source

5.1. Fill in the Basics

Scroll the Setup section, unfold Add your data and click [+Add data source]

  1. Select data source: Choose the "Upload files (preview)" option
  2. Subscription: Select the subscription
  3. Select Azure Blob storage resource: Select the data storage resource. If it wasn't done previously, the storage resource can be created using the link under the field. You can find detailed instructions about it in this article
  4. Select Azure AI Search resource: Select an Azure AI Search Service. If it wasn't done previously, the search resource can be created using the link under the field. You can find detailed instructions about it in this article
    • NOTE: An Azure AI Search resource is a paid resource. Creating one will add monthly fees to your current subscription
  5. Enter the index name: Type the name that will be used to reference this data source
    • Make a note of this index name, as you will need it for configuring your Metric Insights External Resource
  6. Select the Add vector search to this search resource checkbox
  7. Embedding model: Select the embedding model deployed previously
  8. [Next]

5.2. Upload Files

Drag and drop all the documents into the field, click [Upload files] and then [Next].

5.3. Deal with Data Management

  1. Search type: Select the "Vector" option
  2. Select a size: Choose the "1024" or"1536" option. Selecting smaller size is not recommended
  3. [Next]

5.4. Deal with Data Connection

  1. Select "API key" option
  2. [Next]

5.5. Review and Finish

Check everything and click [Save and close].

6. Check the Code

Click [View code] and note the search_endpoint and search_index , as well as Azure Search Resource Key after making is visible.

Configure Concierge External Resource

1. Open Concierge Settings Page

Access Admin > System > Search Setup and go to Concierge tab

External Resource Configuration section is at the bottom of the page.

2. Add New External Resource Configuration

Click [+Add External Resource Configuration] to open the pop-up window.

  1. Name: Give the Configuration a descriptive name
  2. Enter the Configuration code. You can use an example below, but don't forget to modify it according to your specific information
Configuration Code Example 
{
    "name": "azure_data_index", 
    "is_alternative_howto": true,
    "scope": "Governance Workflows", 
    "use_additional_data": true, //this is optional
    "llm_args": {
        "extra_body":{
                "data_sources": [
                    {
                        "type": "azure_search",
                        "parameters": {
                            "endpoint": "https://conciergedatasearch2.search.windows.net",
                            "index_name": "index-metrics-2024", 
                            "authentication": {
                                "type": "api_key",
                                "key": "[azure_search_api_key]"
                            },
                            "embedding_dependency": {
                                "type": "deployment_name",
                                "deployment_name": "text-embedding-ada-002" 
                            }
                        }
                    }
                ]
        }
    }
}

Modify the following:

  • "name": Enter that name that will identify this resource in the Metric Insights error logs. It does not have to match the name provided in the Add External Resource Configuration window Name field
  • "scope": This scope extends the “Scope of FAQ” that is defined on the Concierge Setup page. It helps the LLM to identify the correct scenario to use this resource for user questions
  • "endpoint": Insert search_endpoint copied from the Sample Code window
  • "index_name": Insert search_index copied from the Sample Code window
  • "deployment_name": Enter the embedding model deployment name

3. Set the API Key

In the Variables section of the Add External Resource Configuration window click [+Create Variable].

  1. Name: Give the Variable a "azure_search_api_key" name
  2. Value: Enter the Azure Search Resource Key copied earlier

[Save] the Configuration, [Update All Search Indexes], and that's all. The Concierge will now answer questions about the content of indexed data.