Repository navigation
Relation between taking the best trial and variance of results #78
Unanswered
21kc-caracol
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Background
In "Creating a set of studies",
the chapter relates to comparing two optimizers, and eventually concludes that it will take the best trial from each optimizer:
My question
In case the best result was received for the
Adamoptimizer with a score of 0.9 , but the scores' variances were:Best trial's for
Adam(with a certain config) : [0.85, 0.9]Best trial's for
SGD(with a certain config): [0.84, 0.87]Can we still say that
Adamis better?Any reflections regarding "when can I conclude something is better- despite the variance" are more than welcomed.
Thanks,
Lev
All reactions