Autumn Labs
DocsBlogCareers
P-KPIs

Failures

The count of units that didn't meet quality standards.

There are many P-KPIs that the platform could report to the dashboard for a given station. Depending on the type of station, a specific subset of P-KPIs might be more appropriate. If your station is reporting test data by using SDK functions that track the unit in and out of the station with a corresponding result, you might want to review the nuances how failures are counted.

Failure Counts

Failures represent the count of units that did not meet the specific test criteria at the station.

Failure calculations are based on the result parameter sent when a unit is tracked out of the station. Refer to the result parameter for the track_unit_out() method in the SDK for more details.

This means that if a unit was re-processed at the station, duplicate (retry) runs can influence the count for the type of failure you are viewing: Final Failure Count or Total Failure Count. Please see below for more details.

Note that when dashboard reports "Failures" it is referring to Final Failure Count.

Total Failures

The Total Failure count represents the number of unique units that have failed at least once within a given station, station group, or line. This measure captures all instances where a unit resulted is a fail, regardless of whether it later passed.

  1. Identify all occurrences of the unit at the specific station or station group.
  2. Count the unit if any occurrence reports a fail or failed result.
  3. Duplicates are ignored in counting — each unique unit is counted once even if it failed multiple times.

This is useful for understanding how many distinct units experience quality issues during the process

Final Failures

The Final Failure Count represents the number of unique units had a failure as its last known occurrence at a given station, station group, or line. In other words, these are the units that have not yet successfully passed through that point in the process.

  1. Identify the last occurrence of the unit at the specific station or station group.
  2. Evaluate the associated reported result:
    • A fail or failed result means the unit currently remains in a failed state.
    • If a previously failing unit has a final pass or passed result, it means that the unit was re-processed and fixed and will not be included in this count.

This is particularly valuable for identifying current bottlenecks or active quality issues that still need attention.

Examples

Example 1: Simple

In this example, we'll compute failures for one station with a simple product flow. We'll explore how flows with different retry policies will affect the numbers.

Unit Flow:

TimeUnit IDResultStation
occurrence
01:23:00Unit 1Pass1st
01:24:00Unit 2Fail1st
01:25:00Unit 2Pass2nd
01:26:00Unit 3Fail1st
01:27:00Unit 3Fail2nd
01:28:00Unit 4Pass1st
  • Total Failures: Units 2 and 3 both failed at least once, even though Unit 2 eventually passed.
Ftotal=count{unit 2, unit 3}=2F_{\text{total}} = \text{count}\left\{\text{unit 2, unit 3}\right\} = 2
  • Final Failures: Only Unit 3’s last result was a failure.
Flast=count{unit 3}=1F_{\text{last}} = \text{count}\left\{\text{unit 3}\right\} = 1

Example 2: Complex

In this example, we’ll compute failure counts at both the station and group level. Stations A and B are duplicate stations in the same station group, meaning they process units in parallel.

Station Group 1:

  • Station A:
TimeUnit IDResultStation
occurrence
Group
occurrence
01:23:00Unit 1Pass1st1st
01:24:00Unit 2Fail1st1st
01:25:00Unit 2Pass2nd2nd
01:26:00Unit 3Fail1st1st
01:27:00Unit 4Fail1st1st
01:28:00Unit 4Fail2nd2nd
01:29:00Unit 5Fail1st1st
01:30:00Unit 5Fail2nd2nd
01:31:00Unit 6Fail1st1st
01:32:00Unit 6Pass2nd3rd
01:33:00Unit 7Fail1st1st
01:34:00Unit 7Fail2nd3rd
  • Station B:
TimeUnit IDResultStation
occurrence
Group
occurrence
01:26:30Unit 3Pass1st2nd
01:28:30Unit 4Fail1st3rd
01:30:30Unit 5Pass1st3rd
01:31:30Unit 6Fail1st2nd
01:33:30Unit 7Pass1st2nd
01:36:00Unit 8Pass1st1st
01:37:00Unit 9Pass1st1st
01:38:00Unit 10Pass1st1st

Outcome

Group 1 consists of Station A and Station B.

Total Failures: Out of 10 units, 6 units failed at least once.

Group Ftotal=count{unit 2 ... 7}=6Group \space F_{\text{total}} = \text{count}\left\{\text{unit 2 ... 7}\right\} = 6

Final Failures: Out of 10 units, 2 units failed on their last occurrence.

Group Flast=count{unit 4, unit 7}=2Group \space F_{\text{last}} = \text{count}\left\{\text{unit 4, unit 7}\right\} = 2
  1. Unit 4 flowed: Station A [Fail] -> Station A [Fail] -> Station B [Fail].
  2. Unit 7 flowed: Station A [Fail] -> Station B [Pass] -> Station A [Fail].

Note: Unit 6 is not included in the final failure count because it passed in its last occurrence at Station A.

  1. Unit 6 flowed: Station A [Fail] -> Station B [Fail] -> Station A [Pass].

Let's look at the failure counts at the individual station level:

  • Station A:
    • Total Failures: Out of 7 units, 6 failed at least once at this station.
    Ftotal=count{unit 2 ... 7}=6F_{\text{total}} = \text{count}\left\{\text{unit 2 ... 7}\right\} = 6
    • Final Failures: Out of 7 units, 4 units failed on their last occurrence at this station.
    Ffinal=count{unit 3 ... 5, unit 7}=4F_{\text{final}} = \text{count}\left\{\text{unit 3 ... 5, unit 7}\right\} = 4
  • Station B:
    • Total Failures: Out of 8 units, 2 failed at least once at this station.
    Ftotal=count{unit 4, unit 6}=2F_{\text{total}} = \text{count}\left\{\text{unit 4, unit 6}\right\} = 2
    • Final Failures: Out of 8 units, 2 units failed on their last occurrence at this station.
    Ffinal=count{unit 4, unit 6}=2F_{\text{final}} = \text{count}\left\{\text{unit 4, unit 6}\right\} = 2

By tracking the results of each unit’s pass and fail events at each station, you can monitor Total Failure Count and Last Failure Count to identify where failures occur most frequently and which units remain unresolved. This enables data-driven quality improvement at every level of your production process.