Help & Documentation
Open Support Ticket

Configure Log Analytics for Power BI Lineage Collection

IMPORTANT:

  • Configuring Log Analytics requires the following permissions:
  • To assign a role that grants access to the Log Analytics Workspace, the user must have at least the Application Administrator role.
    • This is required to configure the Azure App.

This article explains how to configure Log Analytics for Microsoft Power BI Cloud Lineage collection.

Before proceeding, ensure that all prerequisites are met and that initial configuration has been completed based on your selected authentication type. Then, enable Log Analytics integration in both Azure and the Power BI Admin Portal, and configure the required Azure App. Once setup in Azure is complete, return to Metric Insights to enable metadata collection and configure the Power BI Cloud Data Source.

NOTE: The easiest and cheapest way to get logs into a Workspace in Azure is to allow a Service Principal to have access to the Power BI Workspaces that must stream their logs into the Log Analytics Workspace. The other, more expensive way is to allow Power BI Workspaces to stream their logs into the Log Analytics Workspace in Azure.

PREREQUISITES:

Table of contents:

  1. Enable Log Analytics Integration in Azure and Power BI
    1. Check Log Export
  2. Copy Log Analytics Workspace ID from Azure
  3. Configure Azure App
  4. Grant Tenant.Read.All Permission
  5. Enable Metadata Collection with Log Analytics
  6. Enable Metadata Collection in Metric Insights
  7. Configure Power BI Cloud Data Source in Metric Insights
    1. Create a Microsoft Power BI Cloud Data Source
    2. Configure Auth Parameters
    3. Configure Other Data Source Parameters
    4. Configure Object List Refresh
      1. Manually Refresh Object List
      2. Add Object List Refresh Trigger
    5. Sync Metadata

1. Enable Log Analytics Integration in Azure and Power BI

NOTE: Log Analytics Workspace is not a Power BI workspace and needs to be created separately, as described in the Microsoft documentation referenced below.

Follow Microsoft’s official guidance to configure Log Analytics for use with Power BI.

To complete the setup described in the Microsoft article, you will:

Once done, logs will begin streaming to Azure, and you can confirm this by querying tables such as PowerBIDatasetsWorkspace in the Azure portal.

1.1. Check Log Export

Access Azure portal > Log Analytics workspace > Logs

If configured correctly, Log Analytics from Power BI activity logs are displayed.

2. Copy Log Analytics Workspace ID from Azure

Access Log Analytics workspace > Overview tab

  1. Copy the Workspace ID value

3. Configure Azure App

Set up authentication as described in the Microsoft documentation. The required steps are:

  • Configure Azure app:
    1. Register an app.
    2. Access API permissions > [+ Add a permission] > APIs my organization uses > Log Analytics API > Delegated permissions > Data.Read
    3. [Add permissions]
  • Grant app access to the Log Analytics workspace:
    1. Log Analytics Workspace > Access control (IAM) > [Add role assignment]  
    2. Select the Reader role.
    3. Access Members > [+ Select members] > Enter the name of your app in the Select box > Select > [Review + assign]

NOTE:To assign a role that grants access to the Log Analytics Workspace, the user must have at least the Application Administrator role.

  • Assign this role via Azure Portal > User > Select a User  > Assigned roles > [+ Add assignments] > Application Administrator

4. Grant Tenant.Read.All Permission

NOTE: See Why BI Optimizer Requires Tenant.Read.All Permission?

Access the Azure App to be used for the Data Source connection.

  1. Under Manage, click on API Permissions.
  2. [ + Add a permission]
  3. Scroll to and select Power BI Service.
  4. Click on Delegated permissions.
  5. Under "Tenant", find and check Tenant.Read.All
  6. [Add permissions]

5. Enable Metadata Collection in Metric Insights

Access Admin > System > System Variables

  1. Enter ENABLE_METADATA_COLLECTION in the search field
  2. Click the gear icon
  3. Assigned Value: Y
  4. [Save], then [Commit Changes]

NOTE: See Setting System Variables for information on System Variables configuration.

6. Enable Metadata Collection with Log Analytics

  1. Enter POWERBI_FETCH_METADATA_WITH_LOG_ANALYTICS in the search field.
  2. Click the gear icon.
  3. Assigned Value: Y.
  4. [Save], then [Commit Changes]

7. Configure Power BI Cloud Data Source in Metric Insights

7.1. Create a Microsoft Power BI Cloud Data Source

See the instructions on creating a new Microsoft Power BI Cloud Data Source for your Metric Insights version:

7.2. Configure Auth Parameters

Proceed with the Data Source parameters configuration based on the selected Auth Type:

Service Principal
v7.2.0+
  1. Auth Type: Service Principal.
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Client Secret: Enter the Client Secret Value of the previously configured Azure App.
  4. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App.
    • To find this value, open the Azure App > Overview tab.
Prior to v7.2.0
  1. Auth Type: Service Principal.
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Client Secret: Enter the Client Secret Value of the previously configured Azure App.
  4. Server: https://app.powerbi.com.
  5. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App.
    • To find this value, open the Azure App > Overview tab.
Password
v7.2.0+
  1. Auth Type: Password.
  2. Username, Plugin Password: Enter the credentials of a Fabric Administrator user.
  3. Application ID: Enter the Application ID of the previously configured Azure App.
Prior to v7.2.0
  1. Auth Type: Password.
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Server: https://app.powerbi.com.
  4. Username, Plugin Password: Enter the credentials of a Fabric Administrator user.
OAuth
v7.2.0+
  1. Auth Type: OAuth.
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App.
    • To find this value, open the Azure App > Overview tab.
  4. [Get Token], enter credentials of a Fabric Administrator in the pop-up window.
Prior to v7.2.0
  1. Auth Type: OAuth.
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Server: https://app.powerbi.com.
  4. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App.
    • To find this value, open the Azure App > Overview tab.
  5. [Get Token], enter credentials of a Fabric Administrator in the pop-up window.

7.3. Configure Other Data Source Parameters

See parameter configuration details specific to your MI version:

v7.2.0
  1. Select Log Analytics Dataset.
  2. Log Analytics Workspace ID: Enter the ID of the previously configured Log Analytics Workspace.
v7.1.1

 


Parameter NameValue
1Scope: Types to collect
DASHBOARD, TILE, SEMANTIC_MODEL, TABLE, REPORT, LOG
2Log Analytics: Workspace ID
The ID of the previously configured Log Analytics Workspace
Prior to v7.1.1

Parameter NameValue
1Log Analytics Workspace IDThe ID of the previously configured Log Analytics Workspace
2Object types to collectDASHBOARD, TILE, SEMANTIC_MODEL, TABLE, REPORT, LOG

7.4. Configure Object List Refresh

7.4.1. Manually Refresh Object List

Access Source Objects tab

  1. [Refresh list]
  2. Once the list is refreshed, the Log Analytics object is displayed.

7.4.2. Add Object List Refresh Trigger

Adding an Object List Refresh Trigger allows to automatically refresh the Object List at the configured time interval.

  1. Generate Object List: automatically.
  2. Object List Refresh Trigger: Select a daily Trigger.

7.5. Sync Metadata

Access Metadata tab

  1. [Sync Metadata]