It is currently Mon Mar 18, 2024 7:59 pm

All times are UTC - 8 hours [ DST ]




Post new topic Reply to topic  [ 30 posts ]  Go to page 1, 2  Next
Author Message
Offline
 Post subject: Desktop or Notebook?
Post #1 Posted: Sat Aug 13, 2022 1:27 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
As you know, I have tried to buy an RTX 3080 in vain and now await RTX 4070 to possibly become available at its MSRPs around January 2023. The alternative is a notebook. Desktops and notebooks have their advantages and disadvantages but a major difference is relative speed. Different benchmarks differ, cooling has a great impact etc. To simplify my decision-making, let me state these rough relative benchmarks for 2560x1440 Time Spy Graphics, which might not be the most meaningful benchmark for go AI but is also not the most meaningless:

Code:
169%   RTX 3080 desktop
100%   RTX 3070 TI laptop


So a desktop build might give roughly 69% faster speed. What does this mean in practice when using, say, KataGo? Suppose 3080 desktop enables next move suggestions at above-human level within 0,25s, would 3070 TI laptop then simply mean move suggestions at above-human level within 0,4s and still be more than good enough? Or would move suggestions at above-human level require 2.5s versus 4s for a drastic difference in usability?

AI suggestions at 9p level are insufficient for me - I want clearly above-human level. You know, 9p can make mistakes but it must be hard to detect any AI mistakes.

What do you recommend me? Is a well cooled RTX 3070 TI laptop graphics card good enough for me 5d seeking clearly above-human level AI moves or is at least 3080 desktop mandatory?

For good notebook cooling, imagine MSI Titan GT77 (too loud for my taste), Alienware 17" (too loud and awkward design) or XMG Neo 17 M22 (to be available next month, noise to be tested). Can such notebooks maintain many hours of maximum go AI load without overstraining the cooling system? Or must it be a large desktop tower with exceptional airflow?

I have comtemplated these things for two years but still cannot decide whether notebooks make sense at all for go AI at super-human level. Please advise!

***

On a related question, not every notebook has all navigation keys as dedicated keys. When using go AI software, which navigation keys are needed frequently? Arrows keys? Pos1 and End? PageUp and PageDown? Is a mouse needed or will any touchpad do?

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #2 Posted: Sat Aug 13, 2022 7:08 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
https://www.amazon.de/MSI-GeForce-GAMIN ... 603&sr=8-3

3080 are available and your best option in my opinion

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #3 Posted: Sat Aug 13, 2022 7:15 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
By the way I use my desktop in silent mode.

I use MSI Afterburner to set power and temp limit for my 3080 and I use Windows to set the CPU max performance level to achieve silent computing on my desktop. I am ready to increase the limits if I would need them, but I never feel the urge even during demanding tasks. I achieve much better performance on my silent desktop than on any of the high quality notebook computers I am using.

I enjoy reviewing games on my desktop much more than reviewing them on a notebook. Good keyboard, mouse and monitor are important to me.


Last edited by Gomoto on Sat Aug 13, 2022 7:23 am, edited 1 time in total.
Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #4 Posted: Sat Aug 13, 2022 7:21 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
Almost two years after launch, German 3080 10GB prices are at 120-140% MSRP but should be about 80%. Up to May 2021, I would have paid up to €970. Now, I pay up to €630. I rather wait for RTX 4000 than being ripped off.

So you say 3080 desktop was better for me - what are your reasons, please?

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #5 Posted: Sat Aug 13, 2022 7:25 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
Which exactly are your settings for undervolting, underclocking and Windows CPU? How much faster is your desktop and what japtops with what GPUs do you compare it to?

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #6 Posted: Sat Aug 13, 2022 7:26 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
I am not a numbers guy myself. It is just my opinion. I like using the desktop more. Could be different for you. In all honesty both options are viable.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #7 Posted: Sat Aug 13, 2022 7:28 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
I am using a 3600x at 80% max cpu.
Currently my 3080 is sitting at a power limit of 65% and a temp limit of 70.

I can not be bothered to do any benchmarks. It works just fine.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #8 Posted: Sat Aug 13, 2022 7:30 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
Thanks! What is the experience of others?

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #9 Posted: Sat Aug 13, 2022 2:10 pm 
Lives in sente

Posts: 896
Liked others: 22
Was liked: 168
Rank: panda 5 dan
IGS: kvasir
I think any laptop with this type of GPU will be loud and hot at times. I have a Lenovo laptop with a 3080 and it is pretty fast, it has shortcut keys to go into quiet mode but it will run hot and loud if you let it. I rarely if ever enable this quiet mode because I have noise cancelling headphones.

Here are some pointers:

  • The way that the cards are labeled is that the fastest laptop card and desktop card are both 3080 even though they don't have the same specs. I think I remember that the number of different compute units on the laptop 3080 is similar to the desktop 3060, but I am not going to double check that. I have seen similar marketing ploys for other hardware components too.
  • The number of playouts per second seems to vary a lot depending on many things, including the position. I did an analysis in katrain of a game I was watching last night (student honinbo) using the settings I happened to have configured. The game was 251 moves (252 positions) and my settings called for 10k playouts. This took 18 minutes and 5 seconds, which is just over 2300 playouts per second. When I tried 1k playouts per move instead, it took 2 minutes 22 seconds which is just under 1800 playouts per second. That is the performance is not very predictable.
  • It is slowest when you are waiting but it is still very fast.
  • The keyboard on this laptop is big and not missing the numpad or anything like that, but one could simply use a regular keyboard. It also came with a gaming mouse and has eye tracking hardware that I never tried.

It is probably safe to assume that a desktop with 3080 is more performance per euro than a laptop with 3080. The bottom line is that if you are willing to spend the money then laptop or desktop is probably more a question of if you wish to carry the computer with you or not than it is a question of which is faster.


==EDIT
I realized that I wasn't running in the much coveted high performance mode. When I analyzed the same game in the more coveted mode it took 12 minutes and 54 seconds, that is about 3250 playouts per seconds. It is simply fast.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #10 Posted: Sat Aug 13, 2022 2:46 pm 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
I have seen very many notebook tests. The major noise factors are cooling, CPU / GPU power maximums and software. While typical gamming notebooks with some reasonable cooling are around 50dB for about CPU 70W and GPU 120 ~ 150W, very few content creator / workstation notebooks with CPU 45W and GPU 80W (with RTX A2000 Laptop or the like) are in the 39 ~ 43dB range. This could be because power is low enough for the good cooling or because the wrong softwares were tested. There is no reason why gaming notebooks could not be designed modestly alike. But maybe you are right that every dGPU notebook can be loud at times. Desktop is the safer way towards relative silence down to circa 37dB.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #11 Posted: Sat Aug 13, 2022 10:54 pm 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
kvasir wrote:
Lenovo laptop with a 3080 [in] high performance mode [...] 3250 playouts per seconds


goame reported 2x RTX2080 TI KataGo 40-block 384 channel ~1667 playouts per second. To compare this to your number, which network (blocks, channels) have you used?

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #12 Posted: Sun Aug 14, 2022 12:42 am 
Lives with ko

Posts: 128
Liked others: 148
Was liked: 29
Rank: British 3 kyu
KGS: thirdfogie
Quote:
On a related question, not every notebook has all navigation keys as dedicated keys. When using go AI software, which navigation keys are needed frequently? Arrows keys? Pos1 and End? PageUp and PageDown? Is a mouse needed or will any touchpad do?


There are two different phases in my use of Lizzie and KataGo. First analyse the whole game, which takes about 90 minutes at 7000 visits per move. Then save the resulting SGF file which contains the analysed results so that it can be reviewed, also using Lizzie and KataGo. (Bad things happen if you analyse with LeelaZero and then try to review with KataGo, or vice versa.)

Lizzie has several single-key commands, but none that should be a problem on a laptop. For example: Up, Down, Left and Right arrow to move through variations; '.' to switch territory shading off and on, 'a' to start an analysis run, Space to switch analysis on and off at the current point in the game and Ctrl-1 or Ctrl-2 to switch between the two engines, which are LeelaZero and KataGo. PageUp and PageDown go forward or back 10 moves, but you can do without them if they are inconvenient on a laptop.

A mouse is used to select Lizzie's menu items and to move through the graph of results to focus on blunders etc. It is also useful to move the cursor off the board display during analysis, otherwise Lizzie thinks you only want to see the results of a move at the point under the cursor. As others have said, a plug-in USB mouse would be cheap and easy to carry around.

I have briefly used q5Go instead of Lizzie. From memory, it uses more mouse movements and fewer single-key commands than Lizzie, and also updates the screen less often. Indeed, Lizzie updates the screen rather manically.

It feels likely that a German-language installation would be little or no different to an English one, but you should be the expert there.

Whether you buy a laptop or a desktop really depends on your expected usage. Do you want to perform analysis at tournaments or in a summer house (Kleingartenhaeuschen)? If so, buy a laptop. If not, buy a desktop. In my experience, a desktop is likely to be better value, longer-lasting and more upgradeable. Your mileage may vary.

Here is an English proverb for you: There's nothing certain, save death and taxes.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #13 Posted: Sun Aug 14, 2022 1:18 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
My choice between desktop and notebook depends on availability of preferred hardware, price, noise, speed, ergonomics of keyboard / mouse / display, longivity, and flexibility at home (where the garden may be unrealistic without power cable). The decision is somewhat difficult for me because there are pros and cons.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #14 Posted: Sun Aug 14, 2022 11:04 am 
Lives in sente

Posts: 896
Liked others: 22
Was liked: 168
Rank: panda 5 dan
IGS: kvasir
RobertJasiek wrote:
kvasir wrote:
Lenovo laptop with a 3080 [in] high performance mode [...] 3250 playouts per seconds


goame reported 2x RTX2080 TI KataGo 40-block 384 channel ~1667 playouts per second. To compare this to your number, which network (blocks, channels) have you used?



40 block 256 channel (are there b40c384 networks, thought there were b40c256 and b60c320) and I use a katago built for the tensorRT backend. I also made a modest attempt to tune the batch size (96) and the number of threads (32) for higher performance, there is a command in katago to help with finding such a setting. The tensorRT backend has a big drawback that it takes forever to start katrain (but I have the habit of leaving it open).

I measured it again with the same sgf and this time it was 16 minutes and 12 seconds, which is about 2600 playouts per second. It is a different number every time for me. Maybe it is due to temperature throttling, I don't really know because it is a bit too large of a difference between the measurements for me to explain it.

The number of playouts depends a lot on the position, probably it comes down to the branching factor of the search and there is a also a cache that maybe speeds up things (I don't know how this cache works). This means it might not be directly comparable to benchmarks for a single position, for example an empty board, and to benchmark the analysis of every position in a game to 10k playouts.

Btw I might use less playouts, the thing is that the number of playouts in analysis and when playing katago in Katrain appears to be the same setting and I can't be bothered to change it back and forth. I have a project to practice playing certain positions against the computer and I have set the number of playouts for this activity It is too annoying when the computer responds instantly (I have hard enough time playing seriously against the machine as it is) and I rather prefer a stronger opponent for my little project anyway.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #15 Posted: Sun Aug 14, 2022 11:27 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
Interesting! So it is hard to distinguish numbers of playouts per second within a factor of roughly 2.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #16 Posted: Wed Sep 07, 2022 12:15 am 
Dies in gote

Posts: 44
Liked others: 2
Was liked: 14
Rank: EGF 1 kyu
KGS: finity
A few weeks old thread but still my 5 cents...

Yes I think that 100 % vs. 167 % difference will come down mostly to personal taste, mobility vs. slightly faster analysis.

If you do analysis interactively, getting to review the first moves in 2 seconds vs. 3 seconds is not a big deal. If you want "fully processed and deep analyzed SGF" like some do, then it might be different whether you need to wait 10 or 15 minutes, but similar change would happen if you decide that "700 visits per move is not enough for me, I want 1000 visits".

I think the exact depth of analyzing each move and the time you get those in is a lot less important than doing dedicated, serious study. I think even 9p players would find most obstacles to progress in their heads instead of their laptops/desktops -- RTX 3060 would be plenty good for them. At 1k level, I'd probably do great with 1 playout if I took the time to think about my previous game. :D

But people like to obsess with "having the best possible" and "fastest possible", otherwise there would be no sports cars on the streets, as it's really irrelevant whether the top speed is 180 km/h or 380 km/h or acceleration to 100 km/h takes 3 seconds or 4 seconds. As far as GPUs go, it's relatively cheap way to feel that thrill of performance vs. a Ferrari. :)

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #17 Posted: Wed Sep 07, 2022 9:08 am 
Gosei

Posts: 1733
Location: Earth
Liked others: 621
Was liked: 310
I switched from my desktop with 3080 to laptop use only (Still using the same keyboard, mouse and desktop monitor.)

For my game reviews I use now exclusivly AI Sensei. The basic plan is good enough for my purpose.

I save a lot of energy using my laptop over the desktop and enjoy the zero noise silent computing.

Katago/Lizzie on the desktop provides faster browsing through the variations, but lacks the excellent spaced repetition training mode provided by AI Sensei.

I would be ready to start my desktop when I feel the need to explore an issue extra deep. But until now my laptop fulfills all my go, work and leasure needs (Are there other pleasures than exploring go?). The change from desktop to laptop is instant and effortless today with cloud computing.

Actually the slower AI Sensei speed helped me to think more and deeper about the explored variations and mistakes.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #18 Posted: Sun Sep 11, 2022 1:16 pm 
Lives in gote

Posts: 575
Location: Adelaide, South Australia
Liked others: 207
Was liked: 262
Rank: Australian 2 dan
GD Posts: 200
Sorry to join the discussion so late...

My opinion is that if you're using the AI as a research tool, then the speed differences in your first post won't be significant. First of all you'll spend time choosing which games and positions to look at, and setting them up in your software. Then you'll want to "interrogate" the AI. This includes things such as observing whether or not the evaluations change with more playouts, comparing the policy values with the final evaluations, asking the AI to give a deeper evaluation of a second or third choice move (possibly including a "refutation" of those moves), exploring other variations, checking if two different AIs agree on the best move, ... You'll typically spend between two minutes and an hour exploring a position. Human judgement is the speed bottleneck, not GPU specs (as long as the GPUs you're comparing are within the same ballpark).

AI isn't yet good enough to consistently give superhuman results in all types of positions within a fraction of a second on consumer-grade hardware.

In many cases, the AI will choose a preferred move "at a glance" (within a fraction of a second), and the choice of best move won't change with deeper analysis; the only change is in the estimated winrate for that move. But sometimes the preferred move will change with more playouts. I've seen examples in pro games where the AI's "at a glance" suggestion is different from the human's move, but after a full minute of analysis the AI then agrees with the human choice. In other words, human judgement, at its best, in certain positions, can be better than the AI's "first instinct". But the opposite can also happen: the AI's "at a glance" move is the pro move, but a minute later the AI starts to suggest a different (presumably better) move.

Remember also that you can't tell just by looking at a move suggestion whether it's "superhuman" or on a par with pro judgement, or whether it represents a blind spot from the AI. You'll need more context to feel confident in the AI's suggestions, and you'll never be 100% sure. And there's not yet a consensus on how best to interrogate the AI.

So I would suggest giving only a small weight to the speed differences between notebook and desktop, and make the decision more on the basis of other factors (e.g. cost, convenience).

And I look forward to seeing how you approach the problem of using an AI to learn about go :-)

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #19 Posted: Mon Sep 12, 2022 7:31 am 
Judan

Posts: 6082
Liked others: 0
Was liked: 786
I expect to use it in different ways depending on study purposes (improving my play, teaching, finding new go theory, reevaluating earlier go theory, comparing AI play to mathematically proved perfect play) and AI mistakes I can identify.

Top
 Profile  
 
Offline
 Post subject: Re: Desktop or Notebook?
Post #20 Posted: Thu Sep 15, 2022 1:24 am 
Lives with ko

Posts: 131
Liked others: 0
Was liked: 7
RobertJasiek wrote:
As you know, I have tried to buy an RTX 3080 in vain and now await RTX 4070 to possibly become available at its MSRPs around January 2023. The alternative is a notebook. Desktops and notebooks have their advantages and disadvantages but a major difference is relative speed. Different benchmarks differ, cooling has a great impact etc. To simplify my decision-making, let me state these rough relative benchmarks for 2560x1440 Time Spy Graphics, which might not be the most meaningful benchmark for go AI but is also not the most meaningless:

Code:
169%   RTX 3080 desktop
100%   RTX 3070 TI laptop


So a desktop build might give roughly 69% faster speed. What does this mean in practice when using, say, KataGo? Suppose 3080 desktop enables next move suggestions at above-human level within 0,25s, would 3070 TI laptop then simply mean move suggestions at above-human level within 0,4s and still be more than good enough? Or would move suggestions at above-human level require 2.5s versus 4s for a drastic difference in usability?

AI suggestions at 9p level are insufficient for me - I want clearly above-human level. You know, 9p can make mistakes but it must be hard to detect any AI mistakes.

What do you recommend me? Is a well cooled RTX 3070 TI laptop graphics card good enough for me 5d seeking clearly above-human level AI moves or is at least 3080 desktop mandatory?

For good notebook cooling, imagine MSI Titan GT77 (too loud for my taste), Alienware 17" (too loud and awkward design) or XMG Neo 17 M22 (to be available next month, noise to be tested). Can such notebooks maintain many hours of maximum go AI load without overstraining the cooling system? Or must it be a large desktop tower with exceptional airflow?

I have comtemplated these things for two years but still cannot decide whether notebooks make sense at all for go AI at super-human level. Please advise!

***

On a related question, not every notebook has all navigation keys as dedicated keys. When using go AI software, which navigation keys are needed frequently? Arrows keys? Pos1 and End? PageUp and PageDown? Is a mouse needed or will any touchpad do?


If you want to be happy then buy the Apple MacBook Pro M1 MAX, 32 GPU cores and 64 GB RAM:
https://www.apple.com/shop/buy-mac/macb ... e-gpu-1tb#
It's stronger than every super-human.
It's quiet.
It's not hot.
It need only 1/40 of watt compared to other GPUs.
You can use macOS, Windows 11 ARM and Linux, you can even run iPadOS apps.
Parallels and CrossOver works finde too.
It has by far the best screen to look at.
It has by far the best sound speakers.
It runs always at full speed and is not throttling down the performance after 1 minute to only 30% like other not Apple devices.

Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 30 posts ]  Go to page 1, 2  Next

All times are UTC - 8 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group