Configure Search Across Data Catalog Tool Dataset for Analytics Marketplace
With the introduction of Analytics Marketplace in v7.1.0, discovery and search capabilities across multiple data catalog platforms has been significantly expanded.
You can search for third-party tools' assets without leaving the Metric Insights UI and without recreating them as objects in Metric Insights. Global Search will return the assets with the list of the available metadata and links to proceed to either the asset in the data catalog tool or the actual object in the associated BI tool like Tableau, Power BI, etc.
For now, this functionality is available for Atlan. Support for other data catalog tools is planned in future releases.
PREREQUISITES:
- Established connectivity with Atlan;
- Dataset created from the Atlan All Reporting Assets object;
- Dataset created based on the above mentioned Dataset (to surface additional metadata such as Glossary Terms in search, if needed). See instructions below.
Optionally, you can have Atlan metadata synced with Metric Insights before configuring search. This will help Glossary Terms appear tidier in the UI.
- Data Source: select the Data Source used as Data Storage when creating Dataset from the Atlan All Reporting Assets object;
-
Query: the query is intended to transform standard Atlan fields, such as Read me, and user-added fields into JSON objects. It must include the ID of Dataset created from the Atlan All Reporting Assets object in "
FROM dataset_datasetID".- This will ensure that metadata is searchable and appears in search properly formatted.
- NOTE: Atlan Tags are handled via the Dataset setup and do not require to be transformed into JSON objects.
For more details on how to create Datasets, refer to Understanding Datasets.
1. Add Dataset to Search
Access Admin > System > Search Setup
- Under Datasets to include in Search, [+Add Dataset].
- Dataset & View: choose the Dataset created at Step Create Dataset from All Reporting Assets Dataset.
- [Save]
2. Map Dataset Columns
Use the following mapping example with Allow click through to external tool enabled.
| Field | Dataset Column |
|---|---|
| Title Column | asset_name__string_ |
| Description Column | main_description__string_ |
| Object View URL | bi_tool_url__string_ |
| External Tool Type | Atlan |
| External Tool URL | asset_url__string_ |
| Content Type Column | connection_type__string_ |
| Object Type Column | mi_object_type__string_ |
| Tags Column | tag_s__string_ |
| Certification Flag Column | certification_status__string_ |
| Certified By Column | certificate_by__string_ |
| Certification Date Column | certificate_at__string_ |
For more details on configuring search across Datasets and Access, refer to Configure Search Across Specific Dataset (v7.1.0+).
3. Add Glossary and Custom Fields Mapping
- Under Dataset Columns for Glossary Terms, [+Add Dataset Columns].
- Dataset Column: choose the Glossary column from the Dataset.
-
Glossary Section: choose the corresponding Glossary Section from Metric Insights.
- NOTE: Fields will map better if Atlan Glossary has been synced with Metric Insights.
- [Save] and add as many as needed.
- Under Dataset Columns for Search, [+Add Dataset Columns].
-
Dataset Column: choose a custom field column from the Dataset.
- NOTE: Make sure to add the Tags column without checking Column data is formatted in JSON. This will make objects searchable by Tags.
- Enable Column data is formatted in JSON.
- [Save] and add as many as needed.
- [Back to Search Setup] and [Update All Search Indexes] at the upper right.
4. Verify Result
