LCCRL - Lars Computer Chess Rating List

Everything what does not fit in the other forums. Chess related or not, trivial or sophisticated, but keep it civilized and respect others please.

Moderator: Andres Valverde

LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 06 Feb 2011, 15:54

This thread will gather all your testing results and build up a Lars Scale Rankings list.

If you have no idea what The Lars Scale of Lousiness rankings are, learn more about it in this thread.
If you want to start ranking engines, you'll need to download the Lars Points Calculator in this thread.
The official version used for this list is Lars Points Calculator v0.4.

REMINDER
The Lars Scale of Lousiness is intended to replace the now aging (and not lousy enough) Elo rating scale as this one doesn't reflect well the psychological impact the engine produces on the user's state of mind. Yes, Elo is quite accurate to rank human players, but when it comes to engines it just isn't. 99.99% of users, when playing an engine will just have the following opinion regarding its strength : "dude, this thing just screw*d me badly!", the engine being worth 1500 Elo or 3000 Elo just making no difference at all.
So we needed a vastly more accurate and adequate ranking system in order to really grasp the user experience. And what does a user really experience when playing against an engine? Well, many things can happen : "this sh*t just won"t run!", "gaahhh, this cr*p remains in memory now!", "huh? Since when can a Nb1 capture my Ke8???", and so on... This is all what really matters to the user, and this is what we aimed our new ranking system to when we designed it. Hopefully we reached our goal.

Also... It will be best if the author of the engine himself publish its Lars ranking in this list, as he has a better understanding of his engine's internals.


Here comes the list, now :

(this list is sorted from the funniest engines to the most boring ones. If you wondered.)

[*] 2840 - Moron 1.0
[*] 2458 - LUCI v3
[*] 2015 - ShouldntExist 0.1
[*] 2003 - GetClub chess
[*] 1960 - ShouldntExist 0.2
[*] 1446 - Youk
[*] 1368 - Tony 0.02
[*] 1228 - Sidonia 0073
[*] 0952 - Prédateur 2.1b
[*] 0826 - Firefly 2.5.7b8
[*] 0731 - Dirty 11D-27
[*] 0621 - EveAnn 1.64
[*] 0618 - Cheng 3
[*] 0493 - Myrdin 0.85
[*] 0416 - Bobcat 201102_dev
[*] 0408 - Frenzee
[*] 0372 - iCE 0.2
Last edited by JuLieN on 05 Jul 2012, 05:23, edited 11 times in total.
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby Volker Pittlik » 07 Feb 2011, 19:14

JuLieN wrote:... Lars Scale Rankings list..


I suspect ths rating list to be a clone of something... ^^
User avatar
Volker Pittlik
 
Posts: 1026
Joined: 24 Sep 2004, 10:14
Location: Murten / Morat, Switzerland

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 07 Feb 2011, 23:40

Volker Pittlik wrote:
JuLieN wrote:... Lars Scale Rankings list..


I suspect ths rating list to be a clone of something... ^^


I don't see at all where you're going to, my dear mister! :shock:
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby Justin Blanchard » 21 Feb 2011, 03:31

Hi! I am new to this board, but I think my engine has broken the illustrious record score. Here are my results:

ShouldntExist 0.1 scored 2015 Lars Points!
ShouldntExist 0.2 scored 1960 Lars Points!

I first released it via this CCC post. I linked to a bug-fix release one page later in the same thread. Even if I revert to the first public version, I have a lot of room for improved lousiness, but I probably cannot achieve the theoretical maximum without a rewrite. I wish my competitors the best of luck.

Justin
Justin Blanchard
 
Posts: 8
Joined: 20 Feb 2011, 23:25

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 21 Feb 2011, 12:38

Congrats, Justin! We have a new champion! Looong live the Lousy! :wink:

And btw, writing a UCI engine in BASH script language that actually plays according to the rules is a real tour de force! Well done! :shock:
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby Olivier Deville » 21 Feb 2011, 13:53

Hello Justin, it seems you really deserve to be number one of the LCCRL list :)

Code: Select all
ShouldntExist v0.2
Copyright 2010 Justin Blanchard <UncombedCoconut at gmail>
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
You are free to change and redistribute it.
(If you do something that foolish please drop me a line though!)
ShouldntExistv0.2.sh: syntax error near unexpected token `(('
ShouldntExistv0.2.sh: ShouldntExistv0.2.sh: line 335: `  for (( FROM_POS = 0; FR
OM_POS < 78; FROM_POS++)); do'


I am using win-bash as an interpreter.

Olivier
User avatar
Olivier Deville
 
Posts: 1175
Joined: 26 Sep 2004, 19:54
Location: Aurec, France

Re: LCCRL - Lars Computer Chess Rating List

Postby Olivier Deville » 21 Feb 2011, 14:20

We are making progress :)

Code: Select all
ShouldntExist v0.2
Copyright 2010 Justin Blanchard <UncombedCoconut at gmail>
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
You are free to change and redistribute it.
(If you do something that foolish please drop me a line though!)
ShouldntExistv0.2.sh: parse error near `(( FROM_POS = 0' [335]
ShouldntExistv0.2.sh: unrecognized modifier [336]
ShouldntExistv0.2.sh: parse error near `done' [374]
ShouldntExistv0.2.sh: parse error near `}' [377]
uci
id name ShouldntExist 0.2
id author Justin Blanchard
option name Root Depth type spin default 2 min 2 max 3
uciok


Using WinZsh now.

Olivier
User avatar
Olivier Deville
 
Posts: 1175
Joined: 26 Sep 2004, 19:54
Location: Aurec, France

Re: LCCRL - Lars Computer Chess Rating List

Postby Justin Blanchard » 21 Feb 2011, 20:24

Hello Olivier,
You are indeed having a lousier experience than I intended.
I think your best option is to try Cygwin's version of bash. (I haven't tested under Windows, but I bet that will work.)
win-bash says it's based on an ancient version of bash (1.14.2; latest version is 4.2). So it won't understand the shell features my program needs.
zsh is a great shell, but it uses a different syntax than bash. I wouldn't expect it to understand my script either.

The only other pitfall I know about is that Pastebin changed the line termination to DOS/Windows style ("\r\n"). Anyone who tries it under Linux should undo this change using fromdos or dos2unix, and set the script as executable.

Good luck, and I'm sorry in advance if you're disappointed with how the script rewards your persistence. ;)
Justin Blanchard
 
Posts: 8
Joined: 20 Feb 2011, 23:25

Re: LCCRL - Lars Computer Chess Rating List

Postby Olivier Deville » 21 Feb 2011, 21:03

Hi Justin :)

Julien told me on the chat to try Cygwin and it works, at least in console mode.

I still need to find a trick to have it working under Winboard + polyglot.

And don't worry, I love having trouble with engines :wink:

Olivier
User avatar
Olivier Deville
 
Posts: 1175
Joined: 26 Sep 2004, 19:54
Location: Aurec, France

Re: LCCRL - Lars Computer Chess Rating List

Postby Justin Blanchard » 21 Feb 2011, 21:49

That's great!
You might try creating a file with the name LaunchShouldntExist.bat and contents like:
Code: Select all
start c:\cygwin\bin\bash.exe -l C:\path\to\ShouldntExist

Once the path/file names are corrected, open a Windows command prompt (in the same folder) and see whether the command LaunchShouldntExist starts the engine. If so, you should be able to treat LaunchShouldntExist just like any other UCI program.
If you have any serious difficulties, I can borrow a friend's Windows XP machine to figure out more exact details.

All this makes me think a program should lose Lars points if it can run natively on several operating systems.
Justin Blanchard
 
Posts: 8
Joined: 20 Feb 2011, 23:25

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 22 Feb 2011, 00:23

Justin Blanchard wrote:All this makes me think a program should lose Lars points if it can run natively on several operating systems.


Nope, because it would mean that it's a script file, and Lars is really infuriated by anything that is not a solid windows exe (hence the special point against Java engines, for instance ;) ). You don't know Lars! ^^

As for me, I'm impressed by this performance, again! :) The only problem is that when I played it, (at depth 3, which requires some patience...) ShoulndtExist (SE) just didn't care that its king was in check and went to check mine. So I captured its King and, without seeming to miss it the less, it just took mine in return... is that normal? If so, ES won't be able to enter Olivier's ChessWar tournament, which would be too bad, considering how excited we are to have such an original work. :D

BTW, I run it on a Mac, and the default bash that comes with Snow Leopard just wouldn't run the script without complaining here and then for errors. I had to update it using a non-Apple port of the bash and now it works like a charm, both when used from inside the terminal and inside interfaces (like Sigma Chess, though another interface, in Java, Jose, reported an error when SE tried to play its move).

Here is the game (its SE v0.2) :

Code: Select all
 Julien - SouldntExist v02 :
1.e4,Nf6; 2.e5,Ne4; 3.d4,Nc6; 4.f3,Nxd4; 5.Qxd4,Nd6; 6.exd6,exd6; 7.Bc4,Rg8; 8.Nh3,Qe7+;
9.Be3,c5; 10.Qf4,a5; 11.Nc3,b6; 12.O-O-O,d5; 13.Nxd5,Qe6; 14.Nc7+,Qxe3+???; 15.Nxe8,Qxc1;
And there I stopped the game.


Do you thing you could correct this behavior?
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 22 Feb 2011, 01:53

I just wrote a simple tutorial to run ShouldntExist on MacOSX and Windows. You can read it on CC, at this address.
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby Justin Blanchard » 22 Feb 2011, 05:13

You're right. In order to simplify the program I tried to avoid teaching it about check; instead I made the king the most valuable piece. This of course means it's willing to accept a king trade, if it can see far enough ahead. :) I'll release a fixed version when I'm sure it works. Thanks!
Justin Blanchard
 
Posts: 8
Joined: 20 Feb 2011, 23:25

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 09 Oct 2011, 21:24

Added two new entries to the glorious LCCRL: Cheng, by Martin Sedlák and iCE, by Thomas Petzke. Welcome, Martin & Thomas! :D
Justin, just because you top our charts doesn't mean you must not deliver the promised debugged version! ^^
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby Jodiazio » 26 Oct 2011, 13:55

JuLieN wrote:Added two new entries to the glorious LCCRL: Cheng, by Martin Sedlák and iCE, by Thomas Petzke. Welcome, Martin & Thomas! :D

Those in the first post?
Jodiazio
 
Posts: 1
Joined: 26 Oct 2011, 13:09

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 28 Oct 2011, 00:31

Jodiazio wrote:
JuLieN wrote:Added two new entries to the glorious LCCRL: Cheng, by Martin Sedlák and iCE, by Thomas Petzke. Welcome, Martin & Thomas! :D

Those in the first post?


Yep, the list is updated as soon as someone tests his engine. :)
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby ZirconiumX » 28 Nov 2011, 18:35

Shouldn'tExist v0.1's reign is over...

LUCI v3 scored 2458 Lars Points!

Lol.

Matthew:out
ZirconiumX
 
Posts: 4
Joined: 07 Mar 2011, 19:09

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 13 Dec 2011, 06:21

Amazing achievement, Matthew! Your engine is the first one to officially reach the grade of International Master of Lousiness (IML), congrats! :D

@Justin: sorry for the loss of your title, you'll have to try less hard.
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)

Re: LCCRL - Lars Computer Chess Rating List

Postby JuLieN » 14 Feb 2012, 15:13

We have a new winner: Moron 1.0, by fernando Villegas! Congrats, Fern!

Image

Image
Why do always those who are wrong disagree with me?
User avatar
JuLieN
 
Posts: 61
Joined: 07 Jun 2008, 09:16
Location: Nantes (France)


Return to Anything else

Who is online

Users browsing this forum: No registered users and 1 guest

cron