It is currently Thu Mar 28, 2024 11:27 am

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 36 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: Graphics card
Post #1 Posted: Thu May 16, 2019 2:00 pm 
Beginner

Posts: 11
Liked others: 1
Was liked: 0
Rank: KGS 4 kyu
KGS: AaronB
What are the best graphic cards for baduk computing? Give a few options at different price ranges.

Thanks for any input.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #2 Posted: Sun May 19, 2019 11:48 pm 
Dies with sente

Posts: 113
Liked others: 11
Was liked: 27
Rank: 1d
Universal go server handle: iopq
Data point: my RTX 570 only gets 170 nps, I got it for $130 plus tax, but I will try to sell the games for about $50

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #3 Posted: Mon May 20, 2019 6:38 am 
Lives in sente

Posts: 1037
Liked others: 0
Was liked: 180
You should define that question better. Power consumption and heat play a role in choice. So what's best for a desktop/workstation not the same as for a laptop/workstation << I have "workstation" there because whether desktop or laptop, you are presumably talking about a device more powerful that the typical home computer.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #4 Posted: Mon May 20, 2019 6:58 am 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 33
Rank: KGS 2k
If you are a Leela Zero user, then a RTX series card from Nvidia is probably a good idea as Leela supports the tensor cores.
Leela Chess Zero also supports tensor cores (in case you are interested in chess as well).

So in case your power supply can handle it:

NVIDIA Geforce RTX 2060 (320e to 380e price range)
NVIDIA Geforce RTX 2070 (500e to 600e price range)
NVIDIA Geforce RTX 2080 (650e to 850 price range)
NVIDIA Geforce RTX 2080 Ti (1200e plus price range)

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #5 Posted: Tue May 21, 2019 3:59 pm 
Dies with sente

Posts: 113
Liked others: 11
Was liked: 27
Rank: 1d
Universal go server handle: iopq
Nvidia 1060 is 200 n/s, you could have gotten it for $170, maybe after AMD cards come out you can

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #6 Posted: Sun Jun 09, 2019 8:39 pm 
Beginner

Posts: 11
Liked others: 1
Was liked: 0
Rank: KGS 4 kyu
KGS: AaronB
Thanks for the input guys. I appreciate it.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #7 Posted: Thu Jun 20, 2019 10:01 am 
Lives with ko
User avatar

Posts: 151
Location: Belgium
Liked others: 11
Was liked: 48
Rank: 2d
KGS: LordVader
I collected some stats from various posts on LeeLa Zero's github page.

    GTX 760 2GB : 7489 ms/move
    GTX 760: 2912 ms/move
    K80 on google cloud: 2100ms/move
    GTX 780: 1720 ms/move
    GTX 1050 ti: 1333 ms/move
    GTX 1060 3GB: 1230 ms/move
    Titan V: 923 ms/move
    RX 480: 876ms/move
    GTX 1070 8GB: 845ms/move
    GTX 1080Ti : 792 ms/move
    GTX 1080 8GB: 733 ms/move
    GTX 1080: 701 ms / move (9% overclocked)
    GTX 1080 TI: 622 ms/move
    1060 6GB next: 570 ms/move
    2xGTX 1080 : 532 ms/move or 438ms/move
    1060 6GB winograd: 350 ms/move
    2xGTX 1080 : 260 ms/move
    GTX 1070 winograd: 255 ms/move
    2xGTX 1080 winograd: 202 ms/move ---> BEST

However, there is a lot of noise in this list.
And we have to be careful when taking conclusions.
(Aside from all the above, give your system enough RAM.)

Needless to say, I do think that ZBaduk can offer you better value for money.
If you haven't already, create a free account !

_________________
Enjoy LeeLaZero and KataGo from your webbrowser, without installing anything !
https://www.zbaduk.com

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #8 Posted: Sun Jun 23, 2019 5:59 am 
Dies with sente

Posts: 108
Location: France
Liked others: 14
Was liked: 18
Rank: FFG 1d
spook wrote:
I collected some stats from various posts on LeeLa Zero's github page.

    GTX 760 2GB : 7489 ms/move
    GTX 760: 2912 ms/move
    K80 on google cloud: 2100ms/move
    GTX 780: 1720 ms/move
    GTX 1050 ti: 1333 ms/move
    GTX 1060 3GB: 1230 ms/move
    Titan V: 923 ms/move
    RX 480: 876ms/move
    GTX 1070 8GB: 845ms/move
    GTX 1080Ti : 792 ms/move
    GTX 1080 8GB: 733 ms/move
    GTX 1080: 701 ms / move (9% overclocked)
    GTX 1080 TI: 622 ms/move
    1060 6GB next: 570 ms/move
    2xGTX 1080 : 532 ms/move or 438ms/move
    1060 6GB winograd: 350 ms/move
    2xGTX 1080 : 260 ms/move
    GTX 1070 winograd: 255 ms/move
    2xGTX 1080 winograd: 202 ms/move ---> BEST

However, there is a lot of noise in this list.
And we have to be careful when taking conclusions.
(Aside from all the above, give your system enough RAM.)

Needless to say, I do think that ZBaduk can offer you better value for money.
If you haven't already, create a free account !

What are those ms/move values?

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #9 Posted: Sun Jun 23, 2019 9:35 am 
Lives in gote

Posts: 617
Liked others: 154
Was liked: 117
Rank: OGS ddk
KGS: Ferran
IGS: Ferran
OGS: Ferran
explo wrote:
What are those ms/move values?


At a guess, miliseconds per move; the lower, the better.

Take care.

_________________
一碁一会

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #10 Posted: Sun Jun 23, 2019 11:01 am 
Dies with sente

Posts: 108
Location: France
Liked others: 14
Was liked: 18
Rank: FFG 1d
Ferran wrote:
explo wrote:
What are those ms/move values?


At a guess, miliseconds per move; the lower, the better.

Take care.

What are they a measure of?

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #11 Posted: Sun Jun 23, 2019 9:26 pm 
Lives in gote

Posts: 617
Liked others: 154
Was liked: 117
Rank: OGS ddk
KGS: Ferran
IGS: Ferran
OGS: Ferran
explo wrote:
What are they a measure of?


Speed. It's telling you how long it takes to evaluate a single move.You're going to have your computer calculate those by the hundreds of thousands. IIRC, Leela Z can reach 50000 move evaluations for every actual real move. 200 moves in a game is not that uncommon. So, 10 million move evaluations per game (not quite: endgame has less positions, you're going to be doing half of those yourself... Etc)

Take care

_________________
一碁一会

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #12 Posted: Mon Jun 24, 2019 3:40 am 
Dies with sente

Posts: 108
Location: France
Liked others: 14
Was liked: 18
Rank: FFG 1d
Ferran wrote:
explo wrote:
What are they a measure of?


Speed. It's telling you how long it takes to evaluate a single move.You're going to have your computer calculate those by the hundreds of thousands. IIRC, Leela Z can reach 50000 move evaluations for every actual real move. 200 moves in a game is not that uncommon. So, 10 million move evaluations per game (not quite: endgame has less positions, you're going to be doing half of those yourself... Etc)

Take care

You're completly misunderstanding my question. I know they are measure of speed. But the speed of what? Is it the average speed when running autogtp? Is it the average speed when playing LZ on lizzie asking for a billion visits? Those would bring very different speed on the same hardware.
I would assume those are autogtp values, but in this case I probably have 3 poorly set versions of autogtp at home.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #13 Posted: Mon Jun 24, 2019 3:48 am 
Lives in gote

Posts: 617
Liked others: 154
Was liked: 117
Rank: OGS ddk
KGS: Ferran
IGS: Ferran
OGS: Ferran
explo wrote:
You're completly misunderstanding my question. I know they are measure of speed.


Ah, sorry.

Take care.

_________________
一碁一会

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #14 Posted: Mon Jun 24, 2019 4:59 am 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 33
Rank: KGS 2k
Yepp, you should just ignore the table posted above with the ms/move, because it does not give any actual information.

The speed of which Leela generates a move depends on several things:

- You can run it on time settings, in which case it will generate moves according to time control, regardless of hardware strength
- You can run it at a set amount of visits, in which case it will generate a move once it has reached the amount of visits
- You can run it at play outs, in which case it will generate a move once it has reached the amount of play outs

The speed at which a graphics card is able to do one visit or play out depends on what network size you are running at (larger networks are slower),
and if you are running at FP16 or FP32. It also depends on if your graphics card has extra hardware for handling neural networks, such as tensor cores in the RTX series by NVIDIA.

Additionally it is good to note that most projects are heavily optimized for Nvidia cards, as those are usually the ones used in network training due to the very good Nvidia Tensorflow ecosystem and CUDA. So if you want a safe card which is more likely to work instantly with new projects (such as KataGo), get a Nvidia card.

You should note that Leela uses the tensor cores you can find on the Nvidia RTX cards, but that also, the GTX 1660 and GTX 1660 Ti cards support FP16 precision at a 2:1 speedup.
(While for example the older GTX 10xx cards only do FP16 at 1:2 speed, meaning half speed). This means that while the GTX 1660 and GTX 1660 Ti cards do not offer more speed with tensor cores, they do offer the option of running at a faster FP16 precision for a speedup.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #15 Posted: Tue Jun 25, 2019 5:28 am 
Lives with ko
User avatar

Posts: 151
Location: Belgium
Liked others: 11
Was liked: 48
Rank: 2d
KGS: LordVader
There is a more recent benchmark here:

http://www.flygo.net/bbs/forum.php?mod= ... tid=110194

The force is strong with RTX cards it seems.

_________________
Enjoy LeeLaZero and KataGo from your webbrowser, without installing anything !
https://www.zbaduk.com

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #16 Posted: Sun Jun 30, 2019 11:41 am 
Beginner

Posts: 19
Liked others: 0
Was liked: 2
My RTX 2060 is about 2.5 to 3x faster per playout than my old GTX 1060 6gb on Leela Zero. Furthermore, the power consumption is similar. For neural networks I believe it is worth the price, but ymmv.

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #17 Posted: Mon Jul 08, 2019 11:27 am 
Dies with sente

Posts: 113
Liked others: 11
Was liked: 27
Rank: 1d
Universal go server handle: iopq
Nvidia Tesla V100 has 1650 nps with 10 threads and batchsize of 5

Slightly more with 15 threads, but probably there's diminishing returns, so I don't increase the amount of threads (lower playing strength with too many threads)

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #18 Posted: Tue Jul 09, 2019 5:35 am 
Lives with ko
User avatar

Posts: 151
Location: Belgium
Liked others: 11
Was liked: 48
Rank: 2d
KGS: LordVader
Before we can talk about relevant numbers we need enough samples.
We should think about a platform to store, index and share this information.

Any ideas ?

_________________
Enjoy LeeLaZero and KataGo from your webbrowser, without installing anything !
https://www.zbaduk.com

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #19 Posted: Wed Jul 24, 2019 11:40 am 
Beginner

Posts: 1
Liked others: 0
Was liked: 0
Rank: KGS 3 kyu
Just ran leelaz benchmark on a RTX 2060.
Network #233 (40x256): 652 n/s
Network #157 (15x192): 1834 n/s

Top
 Profile  
 
Offline
 Post subject: Re: Graphics card
Post #20 Posted: Mon Aug 05, 2019 2:02 am 
Dies with sente

Posts: 113
Liked others: 11
Was liked: 27
Rank: 1d
Universal go server handle: iopq
toratujige wrote:
Just ran leelaz benchmark on a RTX 2060.
Network #233 (40x256): 652 n/s
Network #157 (15x192): 1834 n/s

Thanks for this, this is the data point I wanted. This is likely about the best performance per dollar, unless the 2060s is much faster.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 36 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group