Additional Plots

This page contains additional plots.

Only ground truth

These plots and tables are based only on the ground truth, i.e., the manually classified commits, without use of a sequence classification model.

Size


Perfective Corrective
Metric p-value effect size p-value effect size
#lines added <0.0001 0.20 (s) <0.0001 0.20 (s)
#lines deleted <0.0001 0.13 (s) <0.0001 0.17 (s)
#files modified 0.2829 - <0.0001 0.22 (s)
#hunks 0.7009 - <0.0001 0.21 (s)

ColumbusQM Metrics

Perfective Corrective
Metric p-value effect size p-value effect size
McC <0.0001 0.37 (m) 1.0000 -
LLOC <0.0001 0.42 (m) 1.0000 -
NLE <0.0001 0.26 (s) 0.9577 -
NUMPAR <0.0001 0.24 (s) <0.0001 0.09 (n)
CC 1.0000 - <0.0001 0.12 (s)
CLOC <0.0001 0.19 (s) 0.1906 -
CD 0.9303 - <0.0001 0.15 (s)
AD 0.1556 - <0.0001 0.10 (s)
NOA <0.0001 0.08 (n) <0.0001 0.09 (n)
CBO <0.0001 0.18 (s) 0.0145 -
NII <0.0001 0.19 (s) 0.0005 -
Minor <0.0001 0.18 (s) 0.0005 -
Major <0.0001 0.10 (n) <0.0002 0.06 (n)
Critical <0.0001 0.06 (n) 0.1111 -

Metric values prior to change (mean per file)

Metric Median all Median perfective Median corrective
McCC 21.00 18.00 34.00
LOC 187.22 160.38 270.00
NLE 9.50 7.67 15.20
NUMPAR 16.00 14.67 21.00
CC 0.04 0.04 0.04
CLOC 48.22 55.00 55.00
CD 0.25 0.31 0.24
AD 0.50 0.63 0.49
NOA 1.00 1.00 1.00
CBO 9.50 8.00 14.00
NII 8.00 8.00 9.00
Minor 7.00 5.43 10.00
Major 2.00 1.25 2.67
Critical 0.00 0.00 0.00

Perfective Corrective
Metric p-value effect size p-value effect size
McC 0.0003 - 0.0016 -
LLOC 0.0005 - 0.1138 -
NLE 0.0003 - 0.0072 -
NUMPAR 0.5433 - 0.4704 -
CC 0.4142 - 0.0210 -
CLOC <0.0001 0.10 (s) 0.0111 -
CD <0.0001 0.15 (s) <0.0001 0.16 (s)
AD <0.0001 0.15 (n) <0.0001 0.15 (s)
NOA 0.6847 - 0.2103 -
CBO <0.0001 0.11 (n) 0.0190 -
NII 0.0510 - 0.0105 -
Minor 0.0006 - 0.6288 -
Major 0.0006 - 0.6288 -
Critical 0.0179 - 0.5730 -

Only Changed Files

These plots are only showing metrics from files which have changed excluding additions and deletions.

Size


Perfective Corrective
Metric p-value effect size p-value effect size
#lines added <0.0001 0.20 (s) <0.0001 0.21 (s)
#lines deleted <0.0001 0.15 (s) <0.0001 0.16 (s)
#files modified 0.2081 - <0.0001 0.22 (s)
#hunks <0.0001 0.01 (n) <0.0001 0.22 (s)

ColumbusQM Metrics

Perfective Corrective
Metric p-value effect size p-value effect size
McC <0.0001 0.35 (m) 1.0000 -
LLOC <0.0001 0.40 (m) 1.0000 -
NLE <0.0001 0.24 (s) 1.0000 -
NUMPAR <0.0001 0.22 (s) <0.0001 0.13 (n)
CC 1.0000 - <0.0001 0.13 (s)
CLOC <0.0001 0.13 (s) <0.0001 0.08 (n)
CD 1.0000 - <0.0001 0.18 (s)
AD 0.7499 - <0.0001 0.11 (s)
NOA <0.0001 0.06 (n) <0.0001 0.09 (n)
CBO <0.0001 0.16 (s) <0.0001 0.09 (n)
NII <0.0001 0.16 (s) <0.0001 0.05 (n)
Minor <0.0001 0.19 (s) <0.0001 0.07 (n)
Major <0.0001 0.10 (n) <0.0001 0.07 (n)
Critical <0.0001 0.04 (n) <0.0001 0.04 (n)

Metric values prior to change (mean per file)

Metric Median all Median perfective Median corrective
McCC 21.50 18.17 33.08
LOC 185.25 161.00 264.00
NLE 9.50 8.00 14.00
NUMPAR 16.00 15.00 22.00
CC 0.04 0.04 0.05
CLOC 46.00 54.00 54.00
CD 0.25 0.31 0.24
AD 0.48 0.64 0.46
NOA 1.00 1.00 1.00
CBO 9.50 7.67 14.00
NII 8.00 8.00 9.50
Minor 7.00 6.0 9.50
Major 2.00 1.14 3.00
Critical 0.00 0.00 0.00