Dataset Viewer - Exception Detection (select fields / define derived fields and filters)
In the sections below, this article answers the following questions:
- How to limit results to selected fields?
- How to define filters?
- Apply a Rule versus a Group?
- How to use AND/OR operators?
- How to track data changes
- How to save changes as a separate View?
For release 5.0.5 and beyond:
- How to add Derived Fields to a Dataset's Result set?
- How to compare Dataset date fields to Snapshot (historical) dates?
1. Fields Selector
You can limit the display of Dataset's All Data only to those fields that are required for your data analysis.
Just select the fields you need in the Select Fields section, click Apply Changes in the right side of the screen and the Result set is going to be updated and only those columns that you have selected are going to be displayed.
2. [Version 5.0.5 and further] How to add Derived Fields to Dataset's Result set?
Derived fields include values that do not exist in a Data Source itself but are calculated from one or more existing numeric fields via basic arithmetic expressions and non-aggregate numeric functions.
For more details refer to:
3. Defining Filters
In addition to selecting specific fields, you can filter data using custom conditions. The process of creating a filter is similar to constructing a sentence: you choose a subject, comparison conditions and the values which are going to serve as a reference for filtering.
4. Types of Filters
You can use filters to seed out the required information using conditional filtering. You may mix and match several simple Rules or compound filters (Groups) as defined in Create a Dataset View aggregated via [ AND / OR ] operators to focus on a highly specific data slice. The Results set will be displayed right on the same page.
Rule (Simple Filter Criteria)
Group (Compound Filter Criteria)
5. AND / OR Operators
When you're using multiple Rules and Groups of conditions, you can use an AND / OR switches. You can not mix and match AND / OR for the set of applied filters but if you add a group of conditions, you may apply an alternative operator to it.
In the example below the following filters are applied to a dataset. All of them are aggregated by the AND operator, meaning that all of 3 filters should be TRUE:
- Simple Rule
- A Group of 3 conditions aggregated by the OR operator (ANY of 3 conditions should be TRUE)
- A Group of 2 conditions aggregated by the OR operator (ANY of 2 conditions should be TRUE)
6. [Version 5.0.5] How to compare Dataset date fields to Snapshot (historical) dates
In Versions prior to 5.0.5 date comparisons could be performed to a constant or if there is more than one date field in a Data Source - to other date fields.
In version 5.0.5 a new comparison option has been added - snapshot date. Snapshot date is the date when the Dataset has been collected or updated.
Datasets may be:
- Single Instance: show only when the Dataset has been collected (as shown in the picture below)
- Multi-Instance (Snapshot dataset): keeps history of Data updates.
User can filter on a date field by comparing the field to the dataset effective date for a single instance or multi-instance dataset.
7. How to track changes - comparing instances
You can compare the data from the current period to the prior period to highlight changes. For more details refer to this article: Snapshot Datasets: Comparing Instances.
8. Saving field selection and applied filters as a separate View
- There is no need to apply the same filters to review the same Results set later. You can save the Results set with selected fields and applied filters as a separate View. To learn more about Views, refer to: Create a Dataset View
- Dataset Views can serve to quickly create Reports / Metrics. Refer to Create a Report from a Dataset View or Create a Metric from a Dataset View for more details.