Does Movei 0.08.174 deserve a better opening book!?

Archive of the old Parsimony forum. Some messages couldn't be restored. Limitations: Search for authors does not work, Parsimony specific formats do not work, threaded view does not work properly. Posting is disabled.

Does Movei 0.08.174 deserve a better opening book!?

Postby Wael Deeb » 03 Mar 2004, 09:22

Geschrieben von: / Posted by: Wael Deeb at 03 March 2004 09:22:20:

Hi,
Well,it's too early to say but I might say YES :-)
I have started a new tournament for beta testing Patriot 1.0.5 b5!
Movei plays with 128 Mb hash table,once with it's own opening book and once with my Power_Book!
More engines will join the tournament lately!
Regards,
Dr.WAEL DEEB


BasicLeague_SE Patriot 1.0.5 b5
RankEngineScorePaMoMoS-B1Patriot 1.0.5 b5 1.5/2· · · · ·0.5/11.0/1 0,75 1Movei 0.08.174_PrBk1.5/20.5/1· · · · ·1.0/1 0,75 3Movei 0.08.174 0.0/20.0/10.0/1· · · · · 0,00 
3 of 12 games played
Tournament start: 2004.03.02, 23:22:36
Latest update: 2004.03.03, 08:01:56
Site/ Country: ,
Level: Blitz 120/0
Hardware: AMD Athlon(tm) Processor 1410 MHz
Operating system: Microsoft Windows XP Build 2600
Table created with: Arena 1.0
Wael Deeb
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Mogens Larsen » 03 Mar 2004, 09:39

Geschrieben von: / Posted by: Mogens Larsen at 03 March 2004 09:39:52:
Als Antwort auf: / In reply to: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Wael Deeb at 03 March 2004 09:22:20:
Hi,
Well,it's too early to say but I might say YES :-)
I have started a new tournament for beta testing Patriot 1.0.5 b5!
Movei plays with 128 Mb hash table,once with it's own opening book and once with my Power_Book!
Hey,
I've found a method to autogenerate extensions to the Movei book combining the options provided by Extract and Yace. Whether they'll make an improvement or not is too early to say.
Movei will participate in the KOT2 qualification tournament with that experiment.
Regards,
Mogens
Mogens Larsen
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Wael Deeb » 03 Mar 2004, 10:12

Geschrieben von: / Posted by: Wael Deeb at 03 March 2004 10:12:21:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Mogens Larsen at 03 March 2004 09:39:52:
Hi,
Well,it's too early to say but I might say YES :-)
I have started a new tournament for beta testing Patriot 1.0.5 b5!
Movei plays with 128 Mb hash table,once with it's own opening book and once with my Power_Book!
Hey,
I've found a method to autogenerate extensions to the Movei book combining the options provided by Extract and Yace. Whether they'll make an improvement or not is too early to say.
Movei will participate in the KOT2 qualification tournament with that experiment.
Regards,
Mogens
Hi Mogens,
Despite the author's claming,Uri,that the opening book is not a major factor in the engine performance,I'll prove the other side of the story!
Regards,
Dr.WAEL DEEB
P.S.Mogens,include the two versions of Movei in one tournament like I do!Only then you can have a clear picture about this very important item:a quality opening book!
Wael Deeb
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Uri Blass » 03 Mar 2004, 10:37

Geschrieben von: / Posted by: Uri Blass at 03 March 2004 10:37:07:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Wael Deeb at 03 March 2004 10:12:21:
Hi,
Well,it's too early to say but I might say YES :-)
I have started a new tournament for beta testing Patriot 1.0.5 b5!
Movei plays with 128 Mb hash table,once with it's own opening book and once with my Power_Book!
Hey,
I've found a method to autogenerate extensions to the Movei book combining the options provided by Extract and Yace. Whether they'll make an improvement or not is too early to say.
Movei will participate in the KOT2 qualification tournament with that experiment.
Regards,
Mogens
Hi Mogens,
Despite the author's claming,Uri,that the opening book is not a major factor in the engine performance,I'll prove the other side of the story!
Regards,
Dr.WAEL DEEB
P.S.Mogens,include the two versions of Movei in one tournament like I do!Only then you can have a clear picture about this very important item:a quality opening book!
When I see that movei(even without book) get good results against abrok and the baron in CCC when both are ranked higher than slightly older movei in the nunn rating list then I get the conclusion that book is not very important.
see http://www.husvankempen.de/nunn/ratings/ratingsnunn.htm

new movei is probably better than the movei in that ranking list and may be better than the baron but I doubt if it is also better than Abrok.
Maybe the conclusion should be different and the nunn openings are simply not good for movei or different time control caused different results.
Uri
Uri Blass
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Wael Deeb » 03 Mar 2004, 12:00

Geschrieben von: / Posted by: Wael Deeb at 03 March 2004 12:00:26:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Uri Blass at 03 March 2004 10:37:07:
Hi,
Well,it's too early to say but I might say YES :-)
I have started a new tournament for beta testing Patriot 1.0.5 b5!
Movei plays with 128 Mb hash table,once with it's own opening book and once with my Power_Book!
Hey,
I've found a method to autogenerate extensions to the Movei book combining the options provided by Extract and Yace. Whether they'll make an improvement or not is too early to say.
Movei will participate in the KOT2 qualification tournament with that experiment.
Regards,
Mogens
Hi Mogens,
Despite the author's claming,Uri,that the opening book is not a major factor in the engine performance,I'll prove the other side of the story!
Regards,
Dr.WAEL DEEB
P.S.Mogens,include the two versions of Movei in one tournament like I do!Only then you can have a clear picture about this very important item:a quality opening book!
When I see that movei(even without book) get good results against abrok and the baron in CCC when both are ranked higher than slightly older movei in the nunn rating list then I get the conclusion that book is not very important.
see http://www.husvankempen.de/nunn/ratings/ratingsnunn.htm

new movei is probably better than the movei in that ranking list and may be better than the baron but I doubt if it is also better than Abrok.
Maybe the conclusion should be different and the nunn openings are simply not good for movei or different time control caused different results.
Uri
Abrok is still slightly stronger than Movei.It's very interesting because I realy intended to include Abrok 5.0 in this tournament,now I'll do it
I fully agree with you
Once I told you that the nunn openings are not identical to the real game in a tournament considering the engine performance!
Regards,
Dr.WAEL DEEB
P.S.Please,we need more opinions about this subject!
Wael Deeb
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Thomas McBurney » 03 Mar 2004, 14:40

Geschrieben von: / Posted by: Thomas McBurney at 03 March 2004 14:40:03:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Wael Deeb at 03 March 2004 12:00:26:
new movei is probably better than the movei in that ranking list and may be better than the baron but I doubt if it is also better than Abrok.
Maybe the conclusion should be different and the nunn openings are simply not good for movei or different time control caused different results.
Uri
Abrok is still slightly stronger than Movei.It's very interesting because I realy intended to include Abrok 5.0 in this tournament,now I'll do it
I fully agree with you
Once I told you that the nunn openings are not identical to the real game in a tournament considering the engine performance!
Regards,
Dr.WAEL DEEB
P.S.Please,we need more opinions about this subject!
After playing around with opening books for a while with my engine, I have come to the conclusion that an opening book does provide an advantge over one that doesn't. But I don't think it is a clear advantage.
An opening can provide a time advantage. Lets say the game had a time control of 40/40 and the chess engine with an opening book played the first 10 moves from book. This means the engine can now play the next 30 moves in 40 minutes which will give it an average of an extra 20 seconds per move.
A chess engine with an opening book can vary the games it plays. I have seen chess engines play the exact same game over and over because it and the opponent didn't have an opening book. You also have to think about the person who simply uses your engine to play games against, you don't want to bore them with the same opening played every time.
Chess engines with a small opening book or no opening book can be exploited more easily by engines that have learning. A chess engine with a small opening book probably doesn't vary the games it plays as much as an engine that has a large opening book. So a chess engine with learning would not need as many games to learn which book moves lead to a win against engines with a small or non existant opening book.
Opening books can help an engine avoid or set traps/pit falls which the engine would otherwise have to perform a search to find. The faster the time control and/or the slower the computer, the less likely a search will find these solutions.
The problem with opening books is that the moves they contain were usually made by grandmasters. This sounds like a positive thing at first and I think it is generally but this often leads to some problems. Grandmasters do not play the same way as computers and this can lead to positions the chess engine does not understand. Gambits are probably a common source of problems for many engines. Generally, opening books are created by extracting moves from PGN's containing human vs human games, and the problem with humans is they do make mistakes. So it is very easy to add blunders to an opening book even if that particular move lead to a win and was made by a super grandmaster. An opening book containing thousands of moves can be very time consuming to check every move for blunders, which is why I guess many authors don't it.
So I have come to the conclusion that for a chess engine to benefit from an opening book, the author has to put in a bit of effort in to get it right. The author may even have to tailor the opening book for the engine. The goal is to come out of the opening book with a positive score and a good time advantage. Even if the author has put in a lot effort in the opening book, I think it only provides a small improvement overall to the engine, but then, you have to watch out for those engines that have learning. Once they find a hole, they will happily keep exploiting it.
Here is an experiment I completed today.
Kanguruh v1.82 vs TSCP (40 games @ 40/40, pondering off)
Kanguruh with learning off...
won 11, lost 22, draw 7
Kanguruh with learning on...
won 34, lost 2, draw 4
As you can see, Kanguruh benefitted from learning which was helped by TSCP's small opening book.

Cheers,
Tom.
Thomas McBurney
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Norm Pollock » 03 Mar 2004, 16:04

Geschrieben von: / Posted by: Norm Pollock at 03 March 2004 16:04:23:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Thomas McBurney at 03 March 2004 14:40:03:

There are three principles that I think are important about making an opening book. The first is to limit the book to 30 plies (15 moves), especially if the engine is strong and time is available. Books are not perfect, so let the engine take over as soon as possible. The second is that quick wins 1-0 or 0-1 that occur within 50 moves are likely to have been caused by an error in the opening, so those games should be eliminated from the opening book. However if the engine has a separate white book and black book, then 1-0 wins should only be eliminated from the black book, and 0-1 wins should only be eliminated from the white book. The third is to eliminate grandmaster draws, which I define as draws up to 20 moves (40 plies). They are not true draws.
I'm putting together a filtered pgn file of "twic" games that span about 9 years. I will also add the games from gm2600 on the bob hyatt site, and gm2001 from the arena site (o demille). I will filter out most of the games as follows:
remove draws to 20 moves (40 plies), remove wins to 50 moves (100 plies), remove players up to elo 2399, remove duplicates using scid with player name adjustments.
After this is finished I will make it downloadable. How to use the pgn file is another issue. Should you use depth (# of times a position appears). The higher the depth, the less positions in the book. Hopefully the book will have 99% good positions to start with, so depth=1 would be fine. Maybe if depth=3 for example, the book might have 99.5% good positions. But the number of positions will be 75% less.
Norm Pollock
 

Thank you for your excellent answer!

Postby Wael Deeb » 03 Mar 2004, 16:30

Geschrieben von: / Posted by: Wael Deeb at 03 March 2004 16:30:58:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Thomas McBurney at 03 March 2004 14:40:03:
new movei is probably better than the movei in that ranking list and may be better than the baron but I doubt if it is also better than Abrok.
Maybe the conclusion should be different and the nunn openings are simply not good for movei or different time control caused different results.
Uri
Abrok is still slightly stronger than Movei.It's very interesting because I realy intended to include Abrok 5.0 in this tournament,now I'll do it
I fully agree with you
Once I told you that the nunn openings are not identical to the real game in a tournament considering the engine performance!
Regards,
Dr.WAEL DEEB
P.S.Please,we need more opinions about this subject!
After playing around with opening books for a while with my engine, I have come to the conclusion that an opening book does provide an advantge over one that doesn't. But I don't think it is a clear advantage.
An opening can provide a time advantage. Lets say the game had a time control of 40/40 and the chess engine with an opening book played the first 10 moves from book. This means the engine can now play the next 30 moves in 40 minutes which will give it an average of an extra 20 seconds per move.
A chess engine with an opening book can vary the games it plays. I have seen chess engines play the exact same game over and over because it and the opponent didn't have an opening book. You also have to think about the person who simply uses your engine to play games against, you don't want to bore them with the same opening played every time.
Chess engines with a small opening book or no opening book can be exploited more easily by engines that have learning. A chess engine with a small opening book probably doesn't vary the games it plays as much as an engine that has a large opening book. So a chess engine with learning would not need as many games to learn which book moves lead to a win against engines with a small or non existant opening book.
Opening books can help an engine avoid or set traps/pit falls which the engine would otherwise have to perform a search to find. The faster the time control and/or the slower the computer, the less likely a search will find these solutions.
The problem with opening books is that the moves they contain were usually made by grandmasters. This sounds like a positive thing at first and I think it is generally but this often leads to some problems. Grandmasters do not play the same way as computers and this can lead to positions the chess engine does not understand. Gambits are probably a common source of problems for many engines. Generally, opening books are created by extracting moves from PGN's containing human vs human games, and the problem with humans is they do make mistakes. So it is very easy to add blunders to an opening book even if that particular move lead to a win and was made by a super grandmaster. An opening book containing thousands of moves can be very time consuming to check every move for blunders, which is why I guess many authors don't it.
So I have come to the conclusion that for a chess engine to benefit from an opening book, the author has to put in a bit of effort in to get it right. The author may even have to tailor the opening book for the engine. The goal is to come out of the opening book with a positive score and a good time advantage. Even if the author has put in a lot effort in the opening book, I think it only provides a small improvement overall to the engine, but then, you have to watch out for those engines that have learning. Once they find a hole, they will happily keep exploiting it.
Here is an experiment I completed today.
Kanguruh v1.82 vs TSCP (40 games @ 40/40, pondering off)
Kanguruh with learning off...
won 11, lost 22, draw 7
Kanguruh with learning on...
won 34, lost 2, draw 4
As you can see, Kanguruh benefitted from learning which was helped by TSCP's small opening book.

Cheers,
Tom.

Wael Deeb
 

Re: Does Movei 0.08.174 deserve a better opening book!?

Postby Carlos Pesce » 03 Mar 2004, 22:58

Geschrieben von: / Posted by: Carlos Pesce at 03 March 2004 22:58:40:
Als Antwort auf: / In reply to: Re: Does Movei 0.08.174 deserve a better opening book!? geschrieben von: / posted by: Norm Pollock at 03 March 2004 16:04:23:

Hi!
Sorry but im not agree.
Not all the book builders makes his books "colecting" GM games..more or less "copying and pasting". Moreover, the engine provides the method: are engines that allows to build good openings books (tuned for the engine) like Crafty, Yace, Comet, Queen, Baron, Chezzz, Exchess, Gaviota, Pharaon, Averno, WildCat, DeepSjeng, Pepito and others that only allows to "copy and paste" like Ruffian..of course, you can make good books with Ruffian method (like Djordjie´s) but are not the best.
About max-ply: depend (always depend), are you enough sure that with this max-ply, the engines are avoiding openings traps? In Grunfeld are traps in move 29 (!), or worse, are you sure that the engine can "continue" with the idea of the opening? Think in Kings Indian, if an engine plays this, im 100% sure that it makes a horrible blunder soon or later.
You can say: "your books are horribles", and for sure, you should be right, but Im always make books "thinking in the engine": Im not use the same book for Yace than Queen or Baron, because they dont like some different positions (open, closed, etc.), so the repertorie shoudnt the same.
My first aproach is simple: computers or humans are playing CHESS, so the opening book is a help for to be in a (at least) decent position: i dont see the fun in to enter in a bad position..im as chess player never like this..seems that are some people that loves to be in a bad position or a position that dont understand..well, for this reason, its importsnt an opening book, im sure that Rebel or Fritz dont discusse this things: things seems to be clear for Ed or Franz Morsch :-D
Yours
Carlos Pesce
Carlos Pesce
 


Return to Archive (Old Parsimony Forum)

Who is online

Users browsing this forum: No registered users and 40 guests