Establish Connectivity to Amazon S3

This article describes how to connect to an Amazon S3 bucket with Metric Insights to fetch CSV, JPG and PNG files.

General instructions on establishing data sources based on plugins can be found in Create a New Plugin Data Source.

1. Access Admin > Collection & Storage > Data Sources

The list page containing all data sources available in the system opens.

Below the grid,  click [+ New Data Source].

2. Select Data Source Type

  1. Select Other
  2. Сhoose Amazon S3 from the drop-down list
  3. [Next Step]

3. Provide Required Parameters

  1. Access key: provide the S3 access key (log in to your S3 account, access My Security Credentials > AWS IAM Credentials > Access keys for CLI, SDK, & API access)
  2. Secret key: provide the S3 secret key that is generated when a new access key is created
  3. Bucket: provide the bucket name
  4. Path: provide path to the exact files/folders in the bucket. If this setting is empty, all files and folders in the bucket will be accessed.
  5. [Test Connection] and [Save]

4. Optional S3 Parameters

  1. Bucket Pattern: unused
  2. CSV Delimiter: confirm that the delimiter character is the same as used in your CSV file
  3. Files filter: collect only files that match the defined filters
    • "*" can be used as a wildcard
  4. Includes headers: choose whether to add default column headers to the CSV.
    • Accepts "true"/"false"
    • "True" is the default value.

5. Advanced Configuration

  1. Generate Object List: This setting influences options available in the Amazon S3 Objects tab:
    • automatically: select an Object List Refresh Trigger to fetch all objects
    • manually: selected objects can be added in the Amazon S3 Objects tab

6. Other Settings

  1. You can create Datasets and view all the elements or Datasets using this Data Source from the respective tabs
  2. Click Permissions to assign Data Source access to Groups or Power Users