It is currently Thu Mar 28, 2024 11:34 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 21 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: Power and Graphics question
Post #1 Posted: Tue Apr 17, 2018 1:29 pm 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
I hope you don't mind me posting here for a little advice:
I'm going to by a new PC and I'm really hoping that someone can help me to understand to what degree computing power and graphics are essential in computer go.

I'm really interested in experimenting with Leela zero, AQ, and whatever incredible strength AI is soon to be available for modest home computer. What kind of performance can I expect with what kind of spec? is this likely to change? is there a minimum spec that will deliver good performance that you recommend i should hit?

As an example I'm looking at:
an ASUS, i7-7500U, 8GB RAM, Nvidia GTX940MX
(£690 amazon.co.uk/dp/B073WH686H)

Would this graphics card offer a significant increase in the speed and performance of go programs over just a good processor? do I need to go for something more in the area of a gaming laptop to get good quick AI performance?

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #2 Posted: Tue Apr 17, 2018 2:34 pm 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
If you are serious about Go AI go for a desktop pc.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #3 Posted: Tue Apr 17, 2018 3:05 pm 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
Thanks very much for your input.

Unfortunately I'm very short on space so a desktop would be tricky. Would you say that I just can't get into decent strength go programs with a laptop set up?

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #4 Posted: Tue Apr 17, 2018 4:03 pm 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 9
Rank: 1k
Its all about the gpu cores/speed. A fast cpu will only do a few playouts per second. A modest gpu will be 10x the speed of the cpu doing the playouts.

You probably dont need an intel i7 processor, and i5 would do just fine.

This one is cheaper and may be comparable gpu
https://www.amazon.co.uk/dp/B0765CBZYN/

its got a gtx 1050 gpu which is a pretty decent gaming gpu.

myself i'd probably buy second hand but thats a pretty big discount and good price for the asus laptops at amazon.


This post by nasdaq was liked by: pnprog
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #5 Posted: Tue Apr 17, 2018 4:05 pm 
Lives in gote

Posts: 502
Liked others: 1
Was liked: 153
Rank: KGS 2k
GD Posts: 100
KGS: Tryss
Quote:
Would you say that I just can't get into decent strength go programs with a laptop set up?


What do you consider a "decent strength go program" ?

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #6 Posted: Tue Apr 17, 2018 4:16 pm 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 9
Rank: 1k
the gtx 1050 im guessing would give something like 10000 playouts in 10 seconds.

i dont have one but its somewhere in that ball park.

For the current leela zero this would be at pro level. mybe not very high pro. i'm really not sure.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #7 Posted: Tue Apr 17, 2018 5:32 pm 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
Tryss wrote:
Quote:
Would you say that I just can't get into decent strength go programs with a laptop set up?


What do you consider a "decent strength go program" ?


Thanks Tryss, that's a valid point - I'm not really qualifying what I'm looking for very clearly!

I suppose I'd really like to be able to do things like:
-review games at at a fast pace, but have some confidence that the Ai is really recommending well read out, high quality variations
-play faster games against a very strong Ai. I'm only 4k European, so pro strength is not necessary at all, but I'd like to be able to give the bot less thinking time and still be playing a strong Ai
-maybe have a play with some basic scripts and the APIs for these bots - see if I can do some automated game analysis

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #8 Posted: Tue Apr 17, 2018 5:38 pm 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
Thanks nasdaq.

You're insights on gtx 1050 vs i7 processor was exactly the kind of tip I was hoping for.

I will probably go for something with the 1050 as there seem to be a few options. The one you pointed out does look like a good pick.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #9 Posted: Wed Apr 18, 2018 2:09 am 
Dies in gote

Posts: 53
Liked others: 3
Was liked: 9
Rank: 1k
Hi Mike,

if you dont know already, Go Review partner is good for automated reviewing.

homepage:
http://ns1297.imingo.net/

sabaki also has a leela zero addon to add variations to the sgf file.


This post by nasdaq was liked by: sleepyEDB
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #10 Posted: Wed Apr 18, 2018 8:32 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
Number of visits is not a good indicator for strength. Bigger networks can be stronger at a lower number of visits.

Be careful with the notebook CPUs. I use an I7 notebook and love it for the things it has to do. But performance wise it is no match by far for my 7 year old I5 2500k desktop CPU. It is nice for internet, word processing and viewing some pdf files. I can run Zenith 7 (CPU only AI) on the notebook, but I have to be very very patient (I use it sometimes to analyse games with friends, but it is no fun for everyday AI supported reviewing)

Reviewing in realtime with Lizzie and a 1080Ti class graphics card has to be experienced (You can move through the game and view your mistakes and best alternatives in an instant no waiting at all, not 40 sec per move). Only Zenith offers a similar good user experience at a little bit lower strength. It is a joy to review your games and only takes a few minutes to do so on a capable GPU. (Notebook variants are significantly slower due to temperature throtteling). If you want to improve fast, reviewing every game with Lizzie is a very good way to do so.


This post by Gomoto was liked by: Bill Spight
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #11 Posted: Fri Apr 20, 2018 7:59 am 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
Thanks for the tips on tools. I'd heard some of these mentioned around the forum, but never had the spec to make them worth using.

Thanks Marcel, and also thanks for your post about the Zhao Baolong game - very interesting.

Looks like I'll have to compromise a little compered to a good desktop set up, but it looks like a fairly good result still.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #12 Posted: Fri May 18, 2018 9:12 am 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
I thought I'd tag onto this post as I'm also thinking about buying a new desktop PC, mainly for running Leela Zero etc. I've been out of the PC hardware game for ages (last bought a Pentium 4 in 2004!), so am acquainting myself with the current lingo. My use case is running LeelaZero, maybe AQ, PhoenixGo, Elf if possible, and maybe maybe doing some neural network development of my own. I don't care about playing PC games, so if a regular desktop without a gaming super duper CPU but with a fat GPU is the way to go that's fine.

- Processor:
1) Intel or AMD? (If Intel probably want i5+?)
2) Any compatibility things to think about?
3) Does it really matter much or is it just GPU power that's important?

- GPU:
4) Nvidia or AMD or is there anything else?
5) any compatibility issues? I think LZ works with both, but didn't Facebook's ELF only work on Nvidia?
6) If I were to play around with neural networks are there any commonly used frameworks which means I should use one or other?
7) Is a general GPU benchmark like "G3D Mark" here a good metric to judge go bot performance or is there some more specific benchmark I should look at which basically scales linearly with the answer to "How many playouts will a 15-block LZ network give me in 1 second?"
7) Could anyone please give some sample numbers e.g. I have a GTX 1050 and get 20k in ~10 seconds.

Other things like RAM don't seem so important and not much difference between boxes, though I might get an SSD for funzies.

Thanks


This post by Uberdude was liked by 2 people: Bill Spight, serbes
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #13 Posted: Fri May 18, 2018 10:18 am 
Beginner

Posts: 19
Liked others: 3
Was liked: 8
Uberdude wrote:
4) Nvidia or AMD or is there anything else?
5) any compatibility issues? I think LZ works with both, but didn't Facebook's ELF only work on Nvidia?


The important thing here is whether the applications use OpenCL or CUDA to run code on the GPU. OpenCL is an open standard that is supported by both AMD and Nvidia, whereas CUDA is Nvidia's own framework that only they support. Unfortunately CUDA is really the dominant option, supported strongly by Nvidia, which is why quite a lot of things are Nvidia-only. Also, although Nvidia's drivers support OpenCL, I think I've heard they tend to be some way behind the latest versions.

Leela Zero uses OpenCL, so it should work anywhere (but I don't know if it's more optimised for some devices).

Edit: Of course, this doesn't help much with actually choosing hardware. I'm quite interested in the answer myself, for exactly the same reasons!


This post by afar was liked by 2 people: Bill Spight, Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #14 Posted: Fri May 18, 2018 10:44 am 
Gosei

Posts: 1590
Liked others: 886
Was liked: 527
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
Uberdude wrote:
7) Could anyone please give some sample numbers e.g. I have a GTX 1050 and get 20k in ~10 seconds.

I have a GTX 1080 and get about 1k LZ visits (192x15 network) a second.

Quote:
Other things like RAM don't seem so important and not much difference between boxes, though I might get an SSD for funzies.

Especially these days when programs are memory hogs, you will notice it if you don't have enough RAM. I wouldn't skimp on it. Also, having an SSD makes a real qualitative difference, and now that I have one I really wouldn't want to go back.


This post by dfan was liked by: Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #15 Posted: Fri May 18, 2018 10:59 am 
Dies in gote

Posts: 38
Liked others: 4
Was liked: 20
Uberdude wrote:
5) any compatibility issues? I think LZ works with both, but didn't Facebook's ELF only work on Nvidia?


ELF is a nightmare to get up and running, however the weights were converted to the Leela Zero format, and they run very well on the Leela Zero engine. (This combination is by far the strongest thing you can easily get working. It is outrageously strong.)


This post by Amtiskaw was liked by: Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #16 Posted: Fri May 18, 2018 12:02 pm 
Lives in gote

Posts: 502
Liked others: 1
Was liked: 153
Rank: KGS 2k
GD Posts: 100
KGS: Tryss
If you're interested in machine learning these days, you really want a nvidia GPU. So, as you say you are possibly interested to try fiddle with neural network & deep learning, I suggest this option.

Too bad AMD seems to have missed the Deep Learning rush. :oops:


This post by Tryss was liked by: Uberdude
Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #17 Posted: Fri May 18, 2018 12:39 pm 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
dfan wrote:
Uberdude wrote:
7) Could anyone please give some sample numbers e.g. I have a GTX 1050 and get 20k in ~10 seconds.

I have a GTX 1080 and get about 1k LZ visits (192x15 network) a second.

Thanks, my work laptop (i3 3120M, couldn't get the GPU version to work and probably not so great) gets ~10 a second.

dfan wrote:
Quote:
Other things like RAM don't seem so important and not much difference between boxes, though I might get an SSD for funzies.

Especially these days when programs are memory hogs, you will notice it if you don't have enough RAM. I wouldn't skimp on it.

My initial browsing showed both a bog standard office PC and low-mid gaming came with 8GB of DDR4 RAM so thought that'd do. Or is the "8GB DDR4" hiding that one is faster or the higher end motherboard will make it faster?

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #18 Posted: Fri May 18, 2018 12:52 pm 
Gosei

Posts: 1590
Liked others: 886
Was liked: 527
Rank: AGA 3k Fox 3d
GD Posts: 61
KGS: dfan
Uberdude wrote:
dfan wrote:
Especially these days when programs are memory hogs, you will notice it if you don't have enough RAM. I wouldn't skimp on it.

My initial browsing showed both a bog standard office PC and low-mid gaming came with 8GB of DDR4 RAM so thought that'd do. Or is the "8GB DDR4" hiding that one is faster or the higher end motherboard will make it faster?

8GB should be fine; if you had said 4GB I would have tried to talk you up. My laptop has 16GB and I am glad that it does, but I also do things like run a virtual Windows machine inside macOS and run chess engines that use an arbitrary amount of RAM.

I don't think you have to worry much about exactly how fast the RAM is, just that you are using it instead of swapping to disk.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #19 Posted: Fri May 18, 2018 1:04 pm 
Lives with ko
User avatar

Posts: 205
Liked others: 49
Was liked: 36
Rank: EGF 2k
KGS: MKyle
To feedback my experience

I couldn't really get a desktop setup as I'm particularly short on space. I got a laptop - knowing, thanks to this thread that it would be a significant compromise compared to a desktop set up. I found a HP gaming machine (not that I play any other games) with an Nvidia 1050 card, an i7, 8gb, hdd(no funzies).

I find I can get around 150-300 play outs a second when running the ELF network in lizzie (this seems to vary hugely at different times.) I find that for most purposes I can review quite happily and Elf won't change it's mind much as it adds more reading. If I really want it to take a closer look at a position, I can be patient and wait for the extra play-outs.

Thanks very much to the contributors on this thread. I felt I made an informed decision and I'm really quite happy with the results.

Top
 Profile  
 
Offline
 Post subject: Re: Power and Graphics question
Post #20 Posted: Fri May 18, 2018 4:29 pm 
Judan

Posts: 6725
Location: Cambridge, UK
Liked others: 436
Was liked: 3719
Rank: UK 4 dan
KGS: Uberdude 4d
OGS: Uberdude 7d
So the difference between a GeForce GTX 1050 and 1080 is quite a lot, more than (1080-1050)/1050, 10 is the series and 50 or 80 the model number :) . So for my and others benefit, here are some benchmarks of various Nvidia graphics cards (from https://www.videocardbenchmark.net/gpu_list.php) which I am assuming for now is a decent proxy of LeelaZero performance.
Code:
- GeForce 256:      5       the hot new card all my gamer friends wanted when I was a 14 year old kid in 1999
- NVS 5200M:        653     in my 5-year old 'business premium' work laptop, a Dell Latitude E6530
- GeForce 1050      4559    Mike's? I thought a desktop vs laptop card of the same nominal model would be massively different, but apparently not, where does all the power/heat come/go? ~£150 for card on ebuyer
- GeForce 1050 Ti   5896    Ti means a bit better, ~£170
- GeForce 1060      8946    ~£200 for 3GB, £280 for 6 GB
- GeForce 1070      11152   ~£420
- GeForce 1080      12263   ~£510
- GeForce 1080 Ti   13984   ~£800
- Titan V           14257   I had the impression it was more above the 1080s
- Google TPU        ??????

So the 1060 looks around the sweet spot where the marginal performance / cost starts to go down. But do I wait a bit for the bitcoin fad to fade and prices drop more... Also as LZ keeps improving she'll get better with fewer visits.

P.S. Am I right in thinking it's GPU speed rather than video RAM that's most important for Go AIs, so a 3GB 1060 isn't much worse than the 6GB version?

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 21 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: Bing [Bot] and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group