What options are available for triggering Data Collection?

Data Collection can be initiated within Metric Insights via an external process or based upon a schedule.

Additional dependencies can be established based on:

  • Other data collection events (e.g., run the weekly metric collection once the daily collection has completed for the day)
  • Data dependencies (e.g., run the daily metric data collection only once there is a full day of data in the warehouse for the prior day)

Common Scenarios

The following common requirements would be satisfied with data collection trigger setup as follows:

  1. Trigger collection once ETL processing is complete:  Setup externally triggered dependency and include trigger URL as last step in ETL processing.
  2. Trigger collection when a full day of data exists in my sales table:  Setup schedule-based data collection trigger with a data dependency that checks that sales transactions for the prior day have been successfully collected at any time since the previous Trigger run.
  3. Trigger collection when a full day of data exists in my sales table processed during the current collection cycle:  Setup schedule-based data collection trigger with a data dependency that checks that sales transactions for the prior day have been successfully loaded within the current collection cycle of the Trigger's run.
  4. Trigger collection when ETL processing flags completion in a control table:  Setup scheduled data collection trigger with a data dependency that verifies that data in an ETL control table has been updated