23 lines
743 B
Plaintext
23 lines
743 B
Plaintext
|
<frame title="Evaluating your hyperparameter">
|
||
|
|
<list>
|
||
|
|
<e>My suggestion: Compare to normal parameters.</e>
|
||
|
|
<e>This means you get two lists of AUC scores</e>
|
||
|
|
<e>Your params: [0.80,0.75,0.73,....,0.95]</e>
|
||
|
|
<e>Pyod params: [0.82,0.71,0.48,....,0.95]</e>
|
||
|
|
<e>look at two values</e>
|
||
|
|
<e>$\sum_i your_i-pyod_i$</e>
|
||
|
|
<l2st>
|
||
|
|
<e>Total improvment. If positive, then your parameters help;)</e>
|
||
|
|
<e>But hard to see if this is significant </e>
|
||
|
|
</l2st>
|
||
|
|
<e>Fraction of $your_i>pyod_i$</e>
|
||
|
|
<l2st>
|
||
|
|
<e>Quantised, so does not care about improving your parameters further</e>
|
||
|
|
<e>But easy to see if this is significant</e>
|
||
|
|
<l3st>
|
||
|
|
<e>0.5->Probably just random</e>
|
||
|
|
<e>0.9->Probably quite significant</e>
|
||
|
|
</l3st>
|
||
|
|
</l2st>
|
||
|
|
</list>
|
||
|
|
</frame>
|