Skip to content

Conversation

@lucasart
Copy link

@lucasart lucasart commented Jan 4, 2015

STC

LLR: 2.96 (-2.94,2.94) [-0.50,4.50]
Total: 107289 W: 21851 L: 21325 D: 64113

LTC

LLR: 2.96 (-2.94,2.94) [0.00,5.00]
Total: 83837 W: 14378 L: 13916 D: 55543

bench 7604776

@mcostalba
Copy link
Contributor

Instead of

3 + depth / 4

We now have:

3.2 + depth / 3.8

The integer defaults are almost the same and of course easier, but test passed....

@lucasart
Copy link
Author

lucasart commented Jan 5, 2015

@zamar @glinscott: can you have a look ? I would like to test the 3 parameter tuned model against the new master: http://tests.stockfishchess.org/tests/view/54a895570ebc597e33447ece

@mcostalba: yes, it's called a tuning patch. you can't expect the tuned values to be very far from the initial ones, because the initial ones were already good. Note that I used SPRT(-0.5,4.5)+SPRT(0,5) to reduce the risk of regression (type I error), while leaving a sufficiently small resolution (5 bayeselo) to detect a small elo gain (type II error).

@zamar
Copy link

zamar commented Jan 5, 2015

It is a tuning patch and passed [0, 5], so

Approved.

@zamar
Copy link

zamar commented Jan 5, 2015

@lucasart: You can test the 3 parameters version against 2 parameters even before 2 param version is committed.

However I see one version where you hard coded max reductions to 10 plies. This is risky and I wouldn't recommed you doing that... The rule will kick in somewhere around depth 30, so we have no way of measuring the impact and it'll only affect very long time controls.

@glinscott
Copy link
Contributor

Looks good!

@zamar zamar closed this in b73ae56 Jan 5, 2015
@lucasart lucasart deleted the spsa branch January 11, 2015 00:44
niklasf pushed a commit to niklasf/Stockfish that referenced this pull request Jan 5, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants