Question about endgame databases
-
- Posts: 859
- Joined: Sat Apr 28, 2007 14:53
- Real name: Ed Gilbert
- Location: Morristown, NJ USA
- Contact:
Question about endgame databases
I have a general question about using the kingsrow endgame databases in computer draughts tournaments. At least 2 programmers have told me they are reluctant to use them because they think they will be criticized for not using all original code in their draughts engines.
I hope this is not the case. The algorithms for building the dbs have been published for a long time and in many places. It does not require any new, original work, just a lot of time and computing resources. Everyone who builds the dbs ends up with the exact same information. The correct WLD counts for the various subdb slices are published so we know this is true.
I feel that it is perfectly ok to use publicly available endgame dbs in draughts engines. I invite others to express their opinions about it here.
Krzysztof, what do you have to say about this? It seems that you are ok with it, as at least one other engine in the recent tournament uses a publicly available endgame db. Are you willing to write into the rules for your tournaments that this is acceptable?
-- Ed
I hope this is not the case. The algorithms for building the dbs have been published for a long time and in many places. It does not require any new, original work, just a lot of time and computing resources. Everyone who builds the dbs ends up with the exact same information. The correct WLD counts for the various subdb slices are published so we know this is true.
I feel that it is perfectly ok to use publicly available endgame dbs in draughts engines. I invite others to express their opinions about it here.
Krzysztof, what do you have to say about this? It seems that you are ok with it, as at least one other engine in the recent tournament uses a publicly available endgame db. Are you willing to write into the rules for your tournaments that this is acceptable?
-- Ed
Re: Question about endgame databases
Ed, first of all thanks for sharing this huge effort with the draughts community.
As, although it might not be rocket science, it takes lots of resources and time.
I guess your arguments make sense.
In the chess world this is already common practice, as all programs (or many) use the Syzygy tablebases.
As DBs, in general occupy much disk space, it has an advantage if we would standardize in this area.
But it remains fair to provide the credits to the person who made this possible, which is you in this case!
Bert
As, although it might not be rocket science, it takes lots of resources and time.
I guess your arguments make sense.
In the chess world this is already common practice, as all programs (or many) use the Syzygy tablebases.
As DBs, in general occupy much disk space, it has an advantage if we would standardize in this area.
But it remains fair to provide the credits to the person who made this possible, which is you in this case!
Bert
-
- Posts: 1368
- Joined: Thu Jun 20, 2013 17:16
- Real name: Krzysztof Grzelak
Re: Question about endgame databases
Honestly, I never really thought about it. I know that there was a proposal somewhere that all drafts engines should use one ending database during the next tournament.
-
- Posts: 67
- Joined: Wed Aug 12, 2015 17:45
- Real name: Jelle Wiersma
Re: Question about endgame databases
I think it is important to notice that in the ICGA tournaments of the World Computer Chess Championship and the Computer Olympiad, you are supposed to use original work, and if not, mention those who work you used; the credits!
And correct me if I'm wrong, but I thought Ed made his endgame database + driver available a few years ago. If so, you don't have to generate the 8-piece database at all, you can just use it.
The drawback I see when every program would use the 8-piece Kingsrow database, is that there will be more draws...
Personally I will likely not use the Kingsrow database.
In general, using stuff available and mentioning credits also applies to all parts of the program.
For example, the most important part; the evaluation of the position:
I would like programmers to mention if it was based upon open source, if they used tools of other people, and if they use an evaluation of another program.
Jelle
And correct me if I'm wrong, but I thought Ed made his endgame database + driver available a few years ago. If so, you don't have to generate the 8-piece database at all, you can just use it.
The drawback I see when every program would use the 8-piece Kingsrow database, is that there will be more draws...
Personally I will likely not use the Kingsrow database.
In general, using stuff available and mentioning credits also applies to all parts of the program.
For example, the most important part; the evaluation of the position:
I would like programmers to mention if it was based upon open source, if they used tools of other people, and if they use an evaluation of another program.
Jelle
-
- Posts: 190
- Joined: Sun Sep 13, 2009 23:33
- Real name: Jan-Jaap van Horssen
- Location: Zeist, Netherlands
Re: Question about endgame databases
I agree. By the way, Maximus does not use the (6 piece) Kingsrow databases anymore, but its own.Ed Gilbert wrote: ↑Sun Sep 19, 2021 18:06I have a general question about using the kingsrow endgame databases in computer draughts tournaments. At least 2 programmers have told me they are reluctant to use them because they think they will be criticized for not using all original code in their draughts engines.
I hope this is not the case. The algorithms for building the dbs have been published for a long time and in many places. It does not require any new, original work, just a lot of time and computing resources. Everyone who builds the dbs ends up with the exact same information. The correct WLD counts for the various subdb slices are published so we know this is true.
I feel that it is perfectly ok to use publicly available endgame dbs in draughts engines. I invite others to express their opinions about it here.
Krzysztof, what do you have to say about this? It seems that you are ok with it, as at least one other engine in the recent tournament uses a publicly available endgame db. Are you willing to write into the rules for your tournaments that this is acceptable?
-- Ed
-
- Posts: 190
- Joined: Sun Sep 13, 2009 23:33
- Real name: Jan-Jaap van Horssen
- Location: Zeist, Netherlands
Re: Question about endgame databases
I agree. That is what I said last year.Jelle Wiersma wrote: ↑Sun Sep 19, 2021 20:38I think it is important to notice that in the ICGA tournaments of the World Computer Chess Championship and the Computer Olympiad, you are supposed to use original work, and if not, mention those who work you used; the credits!
And correct me if I'm wrong, but I thought Ed made his endgame database + driver available a few years ago. If so, you don't have to generate the 8-piece database at all, you can just use it.
The drawback I see when every program would use the 8-piece Kingsrow database, is that there will be more draws...
Personally I will likely not use the Kingsrow database.
In general, using stuff available and mentioning credits also applies to all parts of the program.
For example, the most important part; the evaluation of the position:
I would like programmers to mention if it was based upon open source, if they used tools of other people, and if they use an evaluation of another program.
Jelle
-
- Posts: 67
- Joined: Wed Aug 12, 2015 17:45
- Real name: Jelle Wiersma
Re: Question about endgame databases
Ah, interesting, can you mention the topic? (as you probably know I'm not a frequent user of this forum)jj wrote: ↑Mon Sep 20, 2021 17:36I agree. That is what I said last year.Jelle Wiersma wrote: ↑Sun Sep 19, 2021 20:38I think it is important to notice that in the ICGA tournaments of the World Computer Chess Championship and the Computer Olympiad, you are supposed to use original work, and if not, mention those who work you used; the credits!
And correct me if I'm wrong, but I thought Ed made his endgame database + driver available a few years ago. If so, you don't have to generate the 8-piece database at all, you can just use it.
The drawback I see when every program would use the 8-piece Kingsrow database, is that there will be more draws...
Personally I will likely not use the Kingsrow database.
In general, using stuff available and mentioning credits also applies to all parts of the program.
For example, the most important part; the evaluation of the position:
I would like programmers to mention if it was based upon open source, if they used tools of other people, and if they use an evaluation of another program.
Jelle
-
- Posts: 190
- Joined: Sun Sep 13, 2009 23:33
- Real name: Jan-Jaap van Horssen
- Location: Zeist, Netherlands
Re: Question about endgame databases
viewtopic.php?f=53&t=8275&start=45#p128881Jelle Wiersma wrote: ↑Mon Sep 20, 2021 20:28Ah, interesting, can you mention the topic? (as you probably know I'm not a frequent user of this forum)
Re: Question about endgame databases
It was good that you brought up the subject Mr BertTuyt, I thought these days to create a topic to suggest something similar to your proposal, the online consultation of Ending Bases similar to Chess as the link: https://syzygy-tables.infoBertTuyt wrote: ↑Sun Sep 19, 2021 18:25Ed, first of all thanks for sharing this huge effort with the draughts community.
As, although it might not be rocket science, it takes lots of resources and time.
I guess your arguments make sense.
In the chess world this is already common practice, as all programs (or many) use the Syzygy tablebases.
As DBs, in general occupy much disk space, it has an advantage if we would standardize in this area.
But it remains fair to provide the credits to the person who made this possible, which is you in this case!
Bert
In TCEC-sponsored inter-engine tournaments, these online hosted bases often determine the end of the match according to the scoring mark.
Of course, I understand that to host our friend Ed Gilbert's endgame database, there would be an unfeasible fixed cost.
-
- Posts: 67
- Joined: Wed Aug 12, 2015 17:45
- Real name: Jelle Wiersma
Re: Question about endgame databases
@Jan-Jaap, I largely read the topic and like to answer your question of May 26, 2020: What do the others think? (Ed, Jelle, Michel, Harm, etc.):jj wrote: ↑Mon Sep 20, 2021 20:50viewtopic.php?f=53&t=8275&start=45#p128881Jelle Wiersma wrote: ↑Mon Sep 20, 2021 20:28Ah, interesting, can you mention the topic? (as you probably know I'm not a frequent user of this forum)
In my opinion using stuff of other people (source code, tools, data, evaluation, database, etc.) is allowed, but one should mention those who work you used; the credits.
Unfortunately, I never see this kind of information on tournament sites, also not on ICGA's..., which effectively kind of nullifies my opinion.
So, in general, I understand your frustration.
Re: Question about endgame databases
Sorry to interrupt this conversation.Jelle Wiersma wrote: ↑Tue Sep 21, 2021 07:50Unfortunately, I never see this kind of information on tournament sites, also not on ICGA's..., which effectively kind of nullifies my opinion.
So, in general, I understand your frustration.
A first step could be to agree on the components (opening book, endgames, optimization models, other libraries relevant to the strength of the engines) and where and how to list them. The version information seems a logical place to me. It is then easy for a tournament organizer to publish this data.