Establish connectivity to Elasticsearch

An Administrator can use the process described in this article to create a new Plugin Data Source to fetch data using Elasticsearch.


  1. Java 8 software must be installed and running on the same server as the Metric Insights' Data Collector.
  2. For clustered environments:
    • [prior to 5.6.1] Elasticsearch configuration file must be created and added to the /Insightd (Windows) or /datacollector (Linux) directory
    • See details below
Add the configuration file to /Insightd/plugins or /datacollector/plugins directory

The config file should contain the following Parameter Values:

  1. Cluster Name
  2. Cluster Headers
  3. Inner API Port
  4. Enabled SSL
  5. Transport Sniff

Place the Elasticsearch configuration file at:

  1. C:\Program Files (x86)\Metric Insights\Insightd\plugins (for Windows-based Data Collectors)
  2. opt/mi/datacollector/plugins (for Linux-based Data Collectors)

1. Access Admin > Data Sources

At the bottom of the screen click [+ New Data Source].

The Select the Type of New Data Source pop-up opens.

2. Select "Other" Data Source Type and choose "Elasticserach" from the drop-down list

Proceed with creating a Data Source by moving to the Next step.

3. Required Elasticsearch Parameters

  1. Data Source Name is defaulted but you may modify it
  2. Server: specify the endpoint server (can be local or remote)
  3. Username: Note that your Username must be in the same format that your Elasticsearch server uses for authentication
  4. Plugin Password: enter your password credential

4. Optional Elasticsearch Parameters (for clustered servers)

As of Release 5.6.1, additional Parameters for clustered servers can be configured in the Data Source connection profile (UI) instead of the Elasticsearch configuration file.

  1. Name of ElasticSearch cluster: provide the name of your Elasticsearch cluster
  2. Cluster Headers: specify the name(s) of the required Cluster Header(s)
  3. Trasport API port: input the API communication port
  4. Enable SSL (Cluster): set to 'yes'
  5. Transport Sniff (Cluster): set to 'yes'

5. Advanced Configuration

  1. Use Remote Data Collector: switch to "yes" and add a Remote Data Collector by clicking [+New Remote Collector] under Remote Collectors settings
  2. Generate Object List 
    • automatically: all Reports are going to be fetched by the system
    • manually: Reports may be added one-by-one or via CSV file
  3. Object List Refresh Trigger: from the dropdown, select the Trigger that will be used to fetch data via the Elasticsearch plugin
  4. Object Selection Method: specify how Elasticsearch Reports will be fetched
  5. Optionally, state the maximum number of concurrent Threads to utilize during data and/or image fetch to be used in background processing when the system updates Reports for this Data Source
    • If you do not specify any value for this setting, batch data collection processing will be single-threaded
  6. Test Connection: this will also Save your entries

6. Other Settings

  1. You can create Datasets directly from the respective tab
  2. Click Permissions to assign permissions to the Data Source to Groups or Power Users