yano_pres/data/015statistics.txt

10 lines
627 B
Plaintext

<frame title="statistics">
<list>
<e>Friedman test to see if there is a difference between models</e>
<e>Nemenyi test to see which models are equal, mark those equal to the maximum</e>
<e>For 2 models, Friedman not defined -> use Wilcoxon test</e>
<e>Does this match your expectation from the table?</e>
<e>Two models are 'equal' if their probability of being from the same distribution is #LessThan(p_b,p)#, what value should #Eq(p_b,0.1)# have?</e>
<e>Do I need to correct for p hacking (n experiments, so increase the difficulty for each, or is that clear from the table)</e>
</list>
</frame>