4.3 Reference Score Table

The below score table is a reference score table that is derived from the study that was executed. This is a generic/standard score we would like to hold for the Algorithms and the Methods for reference. It still needs examination to finalize and standardize the score to use it as a reference score table for any reader or user who would like to score their model and make their preferences.

4.3.1 Reference Score Table - Interpretable Models/Model-Specific

Algorithm

Linearity

Monotonicity

Interaction

Parametric

Transparent

Algorithmic complexity

Logistic Regression

1

1

1

1

1

1

Generalized Linear

1

1

1

1

1

0.9

Gradient Boosting

0.5

0.7

0.7

1

1

0.8

XGBoost

0.1

0.4

0.7

0.9

0

0.7

Distributed Random Forest

0.1

0.4

0.7

1

0

0.9

Deep Learning

0

0

0

0.1

0

0.2

K-means

0.1

0.8

0.1

0.7

1

0.5

4.3.2 Reference Score Table - Model-Agnostic

Explanation Method

Feature summary

Model internals

Datapoint

A surrogate intrinsically interpretable model

Expressive power

Portability

Algorithmic complexity

Detailed

Correctness

Consistency

Stability

Certainty

Importance

Novelty

Representativeness

Variable Importance / Standardized Coefficient

1

1

0.5

/

1

1

1

1

1

0.3

1

1

1

0

1

PDP

1

0.1

0.9

/

1

1

0.9

0.5

1

0.8

1

0.8

0.8

1

0.1

ICE

1

0.2

1

/

1

0.5

0.5

1

1

0.8

1

0.9

1

0.9

0.1

ALE

1

0

0.9

/

1

1

1

0.6

1

0.9

1

0

1

1

0.1

NOTE: The above can be used for references. Though having said that, this table is yet to be standardized, and socred better with mathematical inferences.

Last updated

Was this helpful?