Methodology

The igate package implements the initial Guided Analytics for parameter Testing and controland Extraction (iGATE) framework for manufacturing data. The goal of iGATE is to enable guided analytics in industry, that is, to provide a statistically sound framework for process optimization that is easy enough to be used and understood by employees without statistical training. The goal is to have simplicity and interpretability while maintaining statistical rigor.

Having identified a manufacturing ‘problem’ to be investigated, a data set is assembled for a ‘typical’ period of operation, i.e. excluding known disturbances such as maintenance or equipment failures. This data set includes the so called target variable, a direct indication or proxy for the problem under consideration and the variable whose variation we want to explain, and a number of parameters representing suspected sources of variation (SSVs), i.e. variables that we consider potentially influential for the value of the target. Parameters with known and explainable relationships with the target variable should be excluded from the analysis, although this can be addressed in an iterative manner though subsequent exclusion and repeating of the process. Care has been taken to robustify the approach against outliers and missing data, in order to make it a reliable tool that can be used with possibly messy or incomplete real-world data sets. The iGATE procedure consists of the following steps (detailed explanations follow below):

1. Select 8 Best of the Best (BOB) and 8 Worst of the Worst (WOW) products. The number of observations chosen can be changed using the versus argument of igate/ categorical.igate.
2. Perform the Tukey-Duckworth test for each SSV (see details below).
3. For each SSV selected by the said test, perform Wilcoxon Rank test.
4. Extract upper/ lower control limit for kept parameters.
5. Perform sanity check via regression plot; decide which parameters to keep.
6. Validate choice of parameters and control limits.
7. Report findings in standardized format.

Steps 1-4 are performed using the igate function for continuous target variables or the categorical.igate function for categorical target variables. Especially for categorical targets with few categories robust.categorical.igate is a robustified version of categorical.igate and should be considered.

When running igate/ categorical.igate with default settings, any outliers for the target variable are excluded and the observations corresponding to the best 8 (B) and worst 8 (W) instances of the target variable are identified. For each of these 16 observations, each SSV is inspected in turn. The distribution of the values of the SSV of the 8 BOB and 8 WOW are analyzed by applying the Tukey-Duckworth test (Tukey 1959). If the critical value returned by the test is larger than 6 (this corresponds to a p-value of less than 0.05), the SSV is retained as being potentially significant. This test was chosen for its simplicity and ease of interpretation and visualization. SSVs failing the test are highly unlikely to be influential whilst SSVs passing the test may be influential. The Wilcoxon-Rank test performed in step three of iGATE serves as a possibly more widely known alternative, that might, however, be harder to explain to non-statisticians. The main function of these steps is to facilitate dimensionality reduction in the data set to generate a manageable population for expert consideration.

Step 5 is performed by calling igate.regressions, resp. categorical.freqplot. These functions produce a regression (for continuous target) resp. frequency (for categorical targets) plot and save it to the current working directory. The domain expert should review these plots and decide which parameters to keep for further analysis based on goodness of fit of the data to the plot.

For the validation step, the production period from which the validation data is selected is dependent on the business situation, but should be from a period of operation consistent with that from which the initial population was drawn, i.e. similar product types, similar level of equipment status etc. The validation step then considers all the retained SSV as a collective in terms of good and bad bands, and extracts from the validation sample all the records which satisfy the condition that all retained SSVs lie within these bands. The expectation is that where all the SSVs lie within the good band, then the target should also correspond to the best performance, and vice versa where the retained SSVs all lie in the bad bands we expect to see bad performance. The application gives feedback on the extent to which this criterion is satisfied in order to help the user conclude the exploration and make recommendations for subsequent improvements. Validation is performed via the validate function.

We consider the last step, the reporting of the results in a standardized manner, an integral part of iGATE that ensures that knowledge about past analyses is retained within a company. This is achieved by calling the report function.

install.packages("igate")
library(igate)

set.seed(123)
n <- nrow(iris)*2/3
rows <- sample(1:nrow(iris), n)
df <- iris[rows, ]
results <- igate(df, target = "Sepal.Length", good_end = "high", savePlots = TRUE)
#> 0 outliers have been removed.
#> Retaining 100 observations.
#> Using pairwise comparison with 8 BOB vs. 8 WOW.
#> Using counting method with Wilcoxon rank test as follow up test.
#> Warning in wilcox.test.default(x, y): cannot compute exact p-value with
#> ties

#> Warning in wilcox.test.default(x, y): cannot compute exact p-value with
#> ties

results
#>         Causes Count     p.values good_lower_bound good_upper_bound
#> 1 Petal.Length    16 0.0008831660              6.1              6.9
#> 2  Petal.Width    16 0.0007638596              1.6              2.3
#>   bad_lower_bound bad_upper_bound na_removed ties_lower_end
#> 1             1.0             1.5          0              0
#> 2             0.1             0.3          0              0
#>   competition_lower_end ties_upper_end competition_upper_end
#> 1                     0              3                     1
#> 2                     0              3                     1
#>   adjusted.p.values
#> 1       0.001527719
#> 2       0.001527719

igate.regressions(df, target = "Sepal.Length", ssv = results$Causes, savePlots = TRUE)
#> 0 outliers have been removed.
#> Retaining 100 observations.

#>         Causes outliers_removed observations_retained regression_plot
#> 1 Petal.Length                0                   100            TRUE
#> 2  Petal.Width                0                   100            TRUE
#>   r_squared  gradient intercept
#> 1 0.7813656 0.4347797  4.196576
#> 2 0.6743999 0.9524464  4.690730

validation_df <- iris[-rows,]
val <- validate(iris, target = "Sepal.Length", causes = results$Causes, results_df = results)
#> Guessing that perfromed igate was continuous. Using type = 'continuous'.

head(val[[1]])
#>   Sepal.Length Petal.Length Petal.Width expected_quality
#> 1          7.6          6.6         2.1             good
#> 2          7.3          6.3         1.8             good
#> 3          7.7          6.7         2.2             good
#> 4          7.7          6.9         2.3             good
#> 5          7.7          6.7         2.0             good
#> 6          7.4          6.1         1.9             good

val[[2]]
#>          Cause Good_Count Bad_count
#> 1 Petal.Length          9        37
#> 2  Petal.Width         46        41

val[[3]]
#> # A tibble: 2 x 3
#>   expected_quality max_target min_target
#>   <chr>                 <dbl>      <dbl>
#> 1 good                    7.9        7.3
#> 2 bad                     5.8        4.3

validatedObs <- val[[1]]
validationCounts <- val[[2]]
validationSummary <- val[[3]]

# choose a directory you want to save the plot into.
output_dir <- "YOUR_DIRECTORY"

report(df = df, 
       target = "Sepal.Length",
       type = "continuous", 
       good_outcome = "high",
       results_path = "results", 
       validation = TRUE, 
       validation_path = "validatedObs",
       validation_counts = "validationCounts", 
       validation_summary = "validationSummary",
       output_name = "testing_igate",
       output_directory = output_dir)