The Failure Criteria feature allows you to set your test's pass/fail criteria for various metrics, such as response time, errors, hits/s, latency, bandwidth, throughput etc.
How To Use
During creating or editing a test, you will find the Test Failure Settings tab.
After clicking the “+” icon, the following screen will appear.
Label - Specify here if you want to use this rule on a particular label from your script. It's set to "ALL" (all labels) by default.
Key Performance Indicator - Select the specific metric you'd like to apply a rule for. Click the down arrow on the right side of the field to open a drop-down menu and review available metrics to monitor.
Condition - The binary comparison operators for this rule, include; "Less than", "Greater than", "Equal to", and "Not Equal to". Click the down arrow on the right side of the field to open a drop-down menu.
Threshold - The numeric value you want this rule to apply to.
Stop Test - If this box is checked, the test will stop immediately when that criteria fails; otherwise, it will continue running uninterrupted.
Stop testing if the hits.count of all labels is greater than 3.
After saving the Failure Criteria, let's start the test and see the results. The test was stopped because the hits.count of all labels exceeded 3.
On the report screen, we can see the results in the Failure Criteria field.