Establish Connectivity to Local Filesystem

This article details how to establish connectivity to Local Filesystem to use it as Data Source for creating Elements in Metric Insights.

General instructions on establishing data sources based on plugins can be found in Create a New Plugin Data Source.

1. Create New Data Source

Access Admin > Collection & Storage > Data Sources

  1. [+New Data Source]
  2. Choose "Local Filesystem" from Plugin drop-down list
  3. [Next]

2. Provide Required Parameters

  1. Data Source Name: Enter a Data Source name
  2. [Create]
  3. Path: Provide the path to a folder. This folder can be located:
    • On a Windows server. You should consider an RDP installation on this Windows machine. Plugin will have access to any folder under C:\Program Files (x86)\Metric Insights. Example of the path: C:\Program Files (x86)\Metric Insights\Data Processor\my_folder

NOTE: To fetch data from another folder, add this folder's path to the access_dirs config parameter. There are two different ways of doing this. Try the UI-based approach first:

  • From the UI:
    1. Access <MI hostname>.com/admin/plugin-config
    2. [+ New Plugin Parameter]
    3. Provide Plugin Parameter Values:
      • Plugin: Local Filesystem
      • Parameter: access_dirs
      • Value: Enter the path(s) to the folder(s) from which you want to fetch data
    4. [Save]
  • From the web container:
    1. Connect to the Linux server via SSH
    2. Access the web container: sudo mi-web
    3. Access the dashboard database: mysql dashboard
    4. Update the folders list: update dp_config set access_dirs='<path(s) to the folder(s)>';
  • On a Linux server where MI app is deployed:
    1. A default folder is /opt/mi/shared
    2. You can mount your Windows folder to Data Processor container directory /opt/mi/shared. Make sure the directory permissions are 755 and folder files permissions are 644. The owner of the directory under Data Processor container should be dataprocessor. If you choose to proceed with this option and face any difficulties, address your issues to [email protected]
  1. Display Files: Select how files will be displayed in the External Content Viewer and Editor
    • Individually: Each file is displayed individually
    • Grouped within Each Folder: Files are grouped by their containing folder. In the External Content Viewer, the most recent file is displayed by default, with a drop-down menu allowing to select other files from the folder

Optionally, toggle on Enable On-Demand Element Creation and Enable Content Auto Synchronization.

3. Optional Parameters

  1. CSV Delimiter: Choose the delimiter character used in your CSV files
    • "," is the default value
  2. Extension filter: Provide a comma-separated list of file extensions to fetch only files with the specified file extensions
    • Supported extension values for filtering: json, avro, xml, proto, pdf, png, jpeg, txt, gz, csv, tar.gz, xlsx, xls, docx, doc, pptx, ppt, xlsb, xlsm
  3. Files filter: Collect only files that match the defined filters
    • "*" can be used as a wildcard
  4. Includes headers: Choose whether the first row of the CSV file should be treated as column headers ("true") or as a regular data row ("false")
    • Accepts "true"/"false"
    • "True" is the default value
  5. Include Excel sheets: Set to "true" to include both Excel files and their sheets as individual objects upon collection. 
    • NOTE: External Content won't be created for individual sheets upon Content Autosync, it is only available for Excel files.
  6. Retrieve empty folders: Set to "true" to retrieve empty folders
  7. Use absolute path as report Id: Select whether the Report ID displayed on the Source Objects tab should include the path from the Path parameter
    • The default value is "true"
  8. Display Files: Select how files will be displayed in the External Content Viewer and Editor
    • Individually: Each file is displayed individually
    • Grouped within Each Folder: Files are grouped by their containing folder. In the External Content Viewer, the most recent file is displayed by default, with a drop-down menu allowing to select other files from the folder

4. Advanced Configuration

Advanced Configuration settings can be set to default values unless Data Source requires more precise tuning. For more details on how to  proceed, refer to Advanced Data Source Configuration.

  1. [Test Connection] in the upper-right corner, this will also save your entries

5. Other Settings

Access Source Objects

  1. You can create Datasets and view all the elements or Datasets using this Data Source from the respective tabs
  2. Open the Access tab to assign Data Source access to Groups or Power Users