Understanding Data Sources
There are two types of Data Sources in Metric Insights:
- Configurable: are Data Sources for which the source database and access credentials are user-defined. Each Metric Insights customer can establish and maintain SQL-based access to internal databases and Plugin connections to external sources, including Web Services and a wide range of data service providers.
- Non-Configurable: are received by all customers and require no customer maintenance or configuration
1. Configurable Data Sources (You can use either of the following to pull data into Metric Insights):
- SQL: Any source accessible through a JDBC driver is considered a SQL data source. This includes traditional databases as well as NoSQL sources with JDBC access; for example, Hadoop Hive. For more information, see: Create New SQL Data Source
- Plugin: Are used to obtain data that is not fetched using a JDBC driver and is collected using a plugin. Plugins are special components, built by Metric Insights, that send a native fetch command to a Data Source. Results are fetched in a way that allows Metric Insights to consume the data. A list of supported plug-ins can be found here. For more information, see: Create a New Plugin Data Source
NOTE: Web Services are considered to be a Plugin configured to access data from a custom Web Service
2. Non-Configurable Data Sources available to all customers are:
- Datasets: Datasets function as an additional layer between Data Sources and elements created in Metric Insights. For more information, see: Understanding Datasets OR Create a Dataset
- Manual/CSV Data: Enter Data Manually or Upload Data from CSV file
- External Process: Push data to Metric Insights (does not require a credential set, but can authenticate if required); a Data Posting URL is provided. For more information, see: Source Metric Data from an External Process
- Existing Datasets - SQL (introduced in Version 5.0.5 for fetching Reports and Version 5.1 - for Metrics): You can fetch data from any Dataset created in the system to source a new Report or Metric. For more information, see: Source elements from "Existing Datasets - SQL"
- Existing Reports - SQL: Use data in one or more Reports to populate a new Report. For more information, see: Source a Report from another Report
- Single Existing Report: A method similar to "Existing Reports - SQL" described above, but does not require writing a fetch command - the process is more automated. For more information, see: Source a Metric from an Single Existing Report
- Existing Metrics: Obtain data in one or more Metrics to populate a new Metric or Report. For more information, see: Source a Report from a Metric
- Aggregate a Metric: Build a new Metric by using various aggregation options. For more information, see: When is data recollected for Aggregate Metrics?
3. Remote Data Collectors
- If a Data Source requires a Remote Data Collector, see Configure a Remote Data Collector for more information
1. Data Source Editors
2. Select a Data Source on an Element Editor
When creating a new element, once you have provided the general information, you are directed to the element Editor > Data Collection tab.
- The Data Source drop-down list contains all of the SQL and Plug in Data Sources that have been defined for your instance as well as all non-configurable Data Sources.
- Select a Data Collection Trigger that fetches the data. Those are used to control when content should be updated. For more information refer to: Create a Data Collection Trigger (Scheduled / Externally Triggered)
- Based on your Data Source selection, you either see a Plugin Command / SQL Statement text box into which you enter the fetch command or other options for defining what data should be fetched from the respective source.
3. Data Source is defined in Dataset / Metric / Report / Event / Dimension and Data Dependency Editors
The Event, Dimension and Data Dependency Editors all have data collection settings similar to those on the element editors.
The example above shows the Dimension Editor.