linux vs others benchmarks
Tucker Balch
tucker at cc.gatech.edu
Thu Dec 1 13:22:04 EST 1994
[Greg Eisenhauer recently ran this benchmark on the KSR, a linux pentium
machine is included for comparision and does pretty well.
So if you don't mind an occasional wrong answer. . . .]
From: harold at cc (Harold Forbes)
From: eisen at cc.gatech.edu (Greg Eisenhauer)
Hi Folks,
Over the weekend Larry McVoy released V1.0 of lmbench, a portable set
of OS performance benchmarks. These measure common UNIX and system
characteristics that affect the performance of programs, context switch times,
file write times, pipe latency and bandwidth, memory read times from cache and
from main memory, etc. Just for fun I thought I'd run them on a single
processor on the KSR to see how it measured up. (Note, this is *not* a
multiprocessor benchmark suite. It measures only uniprocessor
characteristics, with a slight nod to networking measures. I didn't run the
networking stuff and couldn't run the RPC stuff since the KSR doesn't support
it. Also the file reread test uses /tmp. I made no attempt to localize the
cell to wherever the /tmp filesystem is located. This gives worse, but
probably more typical times.)
I ran the thing three times to try to compensate for lack of control
over traffic on the ring, etc. The results from all three runs appear
independently below. I always ran it in a single, allocated cell. The
results are below. They should provide interesting reading for anyone
wondering how things like compiles and links could possibly be so slow.
Basically, the KSR redefines the term "dog" when it comes to many uniprocessor
OS measures.... If this is the future of multiprocessor OS's, we might as
well throw in the hat now guys....
BTW, documentation on the nature of these tests exists in the form of
PostScript files in ~eisen/lmbench/PS and ~gt8027a/lmbench/PS on CoC and
Peregrine filesystems, respectively.
enjoy,
greg
L M B E N C H 1 . 0 S U M M A R Y
------------------------------------
Processor, Processes - times in microseconds
--------------------------------------------
Host OS Mhz Null Null Simple /bin/sh Mmap 2-proc 8-proc
Syscall Process Process Process lat ctxsw ctxsw
--------- ------------- ---- ------- ------- ------- ------- ---- ------ ------
rs6000 AIX 2 62 23 2.0K 7.3K 23K 3817 20 32
mako HP-UX A.09.01 65 22 2.7K 5.6K 17K 155 25 29
seahorse HP-UX A.09.03 99 14 3.6K 10.1K 18K 116 47 55
snake HP-UX A.09.01 66 21 2.6K 5.7K 17K 156 40 38
IP22 IRIX 5.3 198 11 3.1K 8.0K 19K 260 289 429
peregrine KSR peregrine 40 112 32.8K 49.2K 160K 924 279 420
peregrine KSR peregrine 40 79 33.2K 44.0K 162K 980 300 450
peregrine KSR peregrine 40 107 30.2K 42.0K 218K 967 66 94
pentium Linux 1.1.54 91 3 3.3K 15.4K 49K 33 25 42
alpha OSF1 V2.1 182 13 4.8K 16.1K 43K 172 54 85
ss20.50 SunOS 5.4 50 9 10.7K 57.5K 113K 130 37 52
ss20.61 SunOS 5.4 61 7 8.0K 45.8K 87K 104 0 0
*Local* Communication latencies in microseconds
-----------------------------------------------
Host OS Pipe UDP RPC/ TCP RPC/
UDP TCP
--------- ------------- ------- ------- ------- ------- -------
rs6000 AIX 2 143 385 820 498 1054
mako HP-UX A.09.01 288 412 1302 374 1156
seahorse HP-UX A.09.03 193 244 832 262 812
snake HP-UX A.09.01 296 403 1195 367 1142
IP22 IRIX 5.3 131 313 671 278 641
peregrine KSR peregrine 1410 658 1030 5800 1591
peregrine KSR peregrine 1400 404 718 6304 851
peregrine KSR peregrine 1270 590 935 6024 1196
pentium Linux 1.1.54 157 414 622 1164 784
alpha OSF1 V2.1 185 0 0 428 0
ss20.50 SunOS 5.4 194 0 0 560 0
ss20.61 SunOS 5.4 150 0 0 335 0
*Local* Communication bandwidths in megabytes/second
----------------------------------------------------
Host OS Pipe TCP File Mmap Bcopy Bcopy Mem Mem
reread reread (libc) (hand) read write
--------- ------------- ---- ---- ------ ------ ------ ------ ---- -----
rs6000 AIX 2 34 6.0 76.1 63.0 81 120 99 169
mako HP-UX A.09.01 27 18.7 34.4 22.5 22 24 45 39
seahorse HP-UX A.09.03 38 35.2 44.7 32.1 25 31 49 52
snake HP-UX A.09.01 19 17.8 34.4 22.3 22 24 45 39
IP22 IRIX 5.3 34 22.1 32.3 43.7 32 31 69 66
peregrine KSR peregrine 2 0.9 3.9 50.0 31 28 61 51
peregrine KSR peregrine 2 0.8 5.1 57.1 30 29 61 52
peregrine KSR peregrine 2 0.9 4.0 66.7 31 30 61 52
pentium Linux 1.1.54 13 2.4 9.8 4.7 18 18 48 32
alpha OSF1 V2.1 32 12.1 39.4 22.7 39 41 76 78
ss20.50 SunOS 5.4 11 11.0 22.9 30.0 26 31 80 62
ss20.61 SunOS 5.4 24 19.5 31.0 30.7 23 24 59 40
Memory latencies in nanoseconds
(WARNING - may not be correct, check graphs)
--------------------------------------------
Host OS Mhz L1 $ L2 $ Main mem TLB Guesses
--------- ------------- --- ---- ---- -------- --- -------
rs6000 AIX 2 61 15 229 247 776 No L2 cache?
mako HP-UX A.09.01 65 - - - - Bad mhz?
seahorse HP-UX A.09.03 98 10 10 393 481 No L1 cache?
snake HP-UX A.09.01 65 15 15 378 1051 No L1 cache?
IP22 IRIX 5.3 197 10 76 1018 1129
peregrine KSR peregrine 40 35 35 575 1135 No L1 cache?
peregrine KSR peregrine 40 35 35 575 1155 No L1 cache?
peregrine KSR peregrine 40 35 35 575 1135 No L1 cache?
pentium Linux 1.1.54 90 11 294 439 1254
alpha OSF1 V2.1 182 10 56 321 452
ss20.50 SunOS 5.4 49 20 284 291 575 No L2 cache?
ss20.61 SunOS 5.4 60 16 115 816 961
L M B E N C H 1 . 0 S U M M A R Y
------------------------------------
Comparison to best of the breed
-------------------------------
(Best numbers are starred, i.e., *123)
Processor, Processes - factor slower than the best
--------------------------------------------------
Host OS Mhz Null Null Simple /bin/sh Mmap 2-proc 8-proc
Syscall Process Process Process lat ctxsw ctxsw
--------- ------------- ---- ------- ------- ------- ------- ---- ------ ------
rs6000 AIX 2 62 7.7 *1.9K 1.3 1.4 116 *20 1.1
mako HP-UX A.09.01 65 7.3 1.4 *5.5K 1.0 4.7 1.2 *29
seahorse HP-UX A.09.03 99 4.7 1.8 1.8 1.1 3.5 2.4 1.9
snake HP-UX A.09.01 66 7.0 1.3 1.0 *16.4K 4.7 2.0 1.3
IP22 IRIX 5.3 198 3.7 1.6 1.4 1.1 7.9 14 15
peregrine KSR peregrine 40 37 17 8.8 9.5 28 14 14
peregrine KSR peregrine 40 26 17 7.9 9.7 30 15 16
peregrine KSR peregrine 40 36 15 7.5 13 29 3.3 3.2
pentium Linux 1.1.54 91 *3 1.7 2.7 3.0 *33 1.2 1.4
alpha OSF1 V2.1 182 4.3 2.4 2.9 2.6 5.2 2.7 2.9
ss20.50 SunOS 5.4 50 3.0 5.4 10 6.7 3.9 1.9 1.8
ss20.61 SunOS 5.4 61 2.3 4.0 8.2 5.2 3.2 ??? ???
*Local* Communication latencies - factor slower than the best
-------------------------------------------------------------
Host OS Pipe UDP RPC/ TCP RPC/
UDP TCP
--------- ------------- ------- ------- ------- ------- -------
rs6000 AIX 2 1.1 1.6 1.3 1.9 1.6
mako HP-UX A.09.01 2.2 1.7 2.1 1.4 1.8
seahorse HP-UX A.09.03 1.5 *244 1.3 *262 1.3
snake HP-UX A.09.01 2.3 1.7 1.9 1.4 1.8
IP22 IRIX 5.3 *131 1.3 1.1 1.1 *641
peregrine KSR peregrine 11 2.7 1.7 22 2.5
peregrine KSR peregrine 11 1.7 1.2 24 1.3
peregrine KSR peregrine 9.7 2.4 1.5 23 1.9
pentium Linux 1.1.54 1.2 1.7 *622 4.4 1.2
alpha OSF1 V2.1 1.4 ??? ??? 1.6 ???
ss20.50 SunOS 5.4 1.5 ??? ??? 2.1 ???
ss20.61 SunOS 5.4 1.1 ??? ??? 1.3 ???
*Local* Communication bandwidths - percentage of the best
---------------------------------------------------------
Host OS Pipe TCP File Mmap Bcopy Bcopy Mem Mem
reread reread (libc) (hand) read write
--------- ------------- ---- ---- ------ ------ ------ ------ ---- -----
rs6000 AIX 2 89% 17% *76 94% *80 *119 *98 *168
mako HP-UX A.09.01 69% 52% 45% 33% 27% 19% 45% 23%
seahorse HP-UX A.09.03 *38 *35 58% 48% 31% 25% 49% 30%
snake HP-UX A.09.01 49% 50% 45% 33% 27% 19% 45% 23%
IP22 IRIX 5.3 88% 62% 42% 65% 39% 25% 69% 38%
peregrine KSR peregrine 5% 2% 5% 74% 38% 23% 61% 30%
peregrine KSR peregrine 5% 2% 6% 85% 36% 24% 61% 30%
peregrine KSR peregrine 4% 2% 5% *66 38% 25% 61% 30%
pentium Linux 1.1.54 32% 6% 12% 7% 22% 14% 48% 19%
alpha OSF1 V2.1 83% 34% 51% 34% 48% 33% 76% 46%
ss20.50 SunOS 5.4 29% 31% 30% 44% 31% 25% 80% 36%
ss20.61 SunOS 5.4 62% 55% 40% 46% 28% 19% 59% 23%
Memory latencies in nanoseconds - factor slower than the best
(WARNING - may not be correct, check graphs)
-------------------------------------------------------------
Host OS Mhz L1 $ L2 $ Main mem TLB Guesses
--------- ------------- --- ---- ---- -------- --- -------
rs6000 AIX 2 61 1.5 ??? *247 1.7 No L2 cache?
mako HP-UX A.09.01 65 - - - - Bad mhz?
seahorse HP-UX A.09.03 98 ??? *10 1.6 1.1 No L1 cache?
snake HP-UX A.09.01 65 ??? 1.5 1.5 2.3 No L1 cache?
IP22 IRIX 5.3 197 *10 7.6 4.1 2.5
peregrine KSR peregrine 40 ??? 3.5 2.3 2.5 No L1 cache?
peregrine KSR peregrine 40 ??? 3.5 2.3 2.6 No L1 cache?
peregrine KSR peregrine 40 ??? 3.5 2.3 2.5 No L1 cache?
pentium Linux 1.1.54 90 1.1 29 1.8 2.8
alpha OSF1 V2.1 182 *10 5.6 1.3 *452
ss20.50 SunOS 5.4 49 2.0 ??? 1.2 1.3 No L2 cache?
ss20.61 SunOS 5.4 60 1.6 12 3.3 2.1
More information about the Ale
mailing list