Configure Data Dependencies for a Data Collection Trigger
Data Dependencies are typically associated with a Data Collection Trigger in order to ensure that data is available and current in the source system through the collection cycle specified in that Dependency.
- An enabled Data Collection Trigger
Examples of Data Dependency Checks:
- Check that data in a Warehouse Customer Order table contains records post midnight of the prior day (which indicates that all of the prior day's orders have been loaded).
- Verify that an ETL control table specifies that ETL processing has been completed since the last data collection cycle.
- Verify that volume in a data table is at least X% of the volume of data in a prior day as a data qualify check before loading data.
1. Add a New Data Dependency
- Click [+ New Data Dependency] in the Data Collection Trigger Editor Dependencies tab
- The Add Data Dependency pop-up opens
- From the drop-down list select the Add New Data Dependency option.
2. Define the basics for the New Data Dependency
3. Enter Data Dependency Specifications
- Make sure your Data Dependency is 'enabled'
- Specify the Data Source for the Data Dependency
- Provide a fetch command that will return a positive number when the dependency is satisfied (you can use :last_dependency_satisfied as a bind variable)
- Validate your fetch command
4. Below the statement specify when and how often to perform the Data Dependency check
This Data Dependency can now be added to the Data Collection Trigger
- A given dependency can be shared among multiple Data Collection Triggers
- Multiple dependencies can be specified for a Data Collection Trigger and all associated dependencies must be satisfied before the data collection trigger starts
Control when Data Dependency of Data Collection Trigger is Satisfied
If your Data Collection Trigger's interval is an hour or longer, you can control the circumstances under which an associated Data Dependency must be satisfied by accessing the Data Collection Trigger Editor and editing an existing dependency.