I-Am-Bot » browsers

IE8 vs Opera 10

Srinath — Thu, 04 Jun 2009 09:11:44 +0000

A picture is worth a thousand words. Two are priceless.

Firefox 3.5 beta 4 released – benchmarked

Srinath — Tue, 28 Apr 2009 15:13:13 +0000

The next release of the immensely popular Firefox was initially versioned as FF 3.1, and now re badged as 3.5. After 3.1 beta 3, now comes 3.5 beta 4 and here is a glimpse of the performance numbers. Tests run on a macbook with 2.4ghz core2duo, 2gb ram and Mac OS X 10.5.6. All addons were disabled.

FF 3.1b3

============================================
RESULTS (means and 95% confidence intervals)
--------------------------------------------
Total:                 1476.2ms +/- 3.8%
--------------------------------------------

  3d:                   221.6ms +/- 11.5%
    cube:                74.8ms +/- 8.7%
    morph:               54.6ms +/- 31.4%
    raytrace:            92.2ms +/- 4.5%

  access:               215.8ms +/- 21.6%
    binary-trees:        48.6ms +/- 3.9%
    fannkuch:            60.8ms +/- 8.7%
    nbody:               27.0ms +/- 7.3%
    nsieve:              79.4ms +/- 59.2%

  bitops:                46.4ms +/- 10.1%
    3bit-bits-in-byte:    1.6ms +/- 42.6%
    bits-in-byte:        11.6ms +/- 50.6%
    bitwise-and:          2.4ms +/- 28.4%
    nsieve-bits:         30.8ms +/- 7.8%

  controlflow:           35.6ms +/- 3.1%
    recursive:           35.6ms +/- 3.1%

  crypto:               154.2ms +/- 4.9%
    aes:                114.8ms +/- 7.9%
    md5:                 27.0ms +/- 11.7%
    sha1:                12.4ms +/- 22.0%

  date:                 216.8ms +/- 3.4%
    format-tofte:        94.2ms +/- 6.1%
    format-xparb:       122.6ms +/- 3.1%

  math:                  43.6ms +/- 5.9%
    cordic:              20.0ms +/- 4.4%
    partial-sums:        14.4ms +/- 4.7%
    spectral-norm:        9.2ms +/- 30.8%

  regexp:                71.2ms +/- 4.0%
    dna:                 71.2ms +/- 4.0%

  string:               471.0ms +/- 1.3%
    base64:              26.8ms +/- 24.6%
    fasta:               97.4ms +/- 4.3%
    tagcloud:           114.0ms +/- 4.0%
    unpack-code:        176.6ms +/- 0.8%
    validate-input:      56.2ms +/- 2.4%

FF 3.5b4

============================================
RESULTS (means and 95% confidence intervals)
--------------------------------------------
Total:                 1209.4ms +/- 1.3%
--------------------------------------------

  3d:                   181.0ms +/- 3.1%
    cube:                55.2ms +/- 6.2%
    morph:               33.6ms +/- 21.7%
    raytrace:            92.2ms +/- 5.9%

  access:               154.0ms +/- 2.0%
    binary-trees:        50.4ms +/- 7.5%
    fannkuch:            61.6ms +/- 5.6%
    nbody:               28.4ms +/- 6.6%
    nsieve:              13.6ms +/- 5.0%

  bitops:                40.4ms +/- 3.5%
    3bit-bits-in-byte:    1.6ms +/- 42.6%
    bits-in-byte:         9.2ms +/- 6.0%
    bitwise-and:          3.2ms +/- 17.4%
    nsieve-bits:         26.4ms +/- 4.2%

  controlflow:           37.2ms +/- 4.4%
    recursive:           37.2ms +/- 4.4%

  crypto:                78.0ms +/- 6.3%
    aes:                 46.0ms +/- 8.1%
    md5:                 23.6ms +/- 20.9%
    sha1:                 8.4ms +/- 22.4%

  date:                 182.0ms +/- 8.0%
    format-tofte:       100.0ms +/- 12.7%
    format-xparb:        82.0ms +/- 4.7%

  math:                  41.0ms +/- 4.8%
    cordic:              19.6ms +/- 5.7%
    partial-sums:        13.8ms +/- 7.5%
    spectral-norm:        7.6ms +/- 14.6%

  regexp:                78.0ms +/- 9.0%
    dna:                 78.0ms +/- 9.0%

  string:               417.8ms +/- 1.1%
    base64:              23.2ms +/- 11.6%
    fasta:               94.4ms +/- 1.8%
    tagcloud:           115.0ms +/- 3.1%
    unpack-code:        143.2ms +/- 2.4%
    validate-input:      42.0ms +/- 4.7%

So there, its faster by almost 270 points, which is almost 18%. So far the next release seems to be very good indeed.

SunSpider Javascript Benchmark Results

Srinath — Tue, 03 Feb 2009 16:11:16 +0000

The benchmark by the webkit team is pretty old (about an year), but out of boredom, I decided to put a few browsers that I use through it for the kicks. It tests only the core javascript functions, and not other components like DOM, or other APIs, so promises to be consistent. A few interesting observations, and the scores below:

Test Platform:

The tests for Windows XP SP3 Professional 32 bit and Linux (Linux Mint 6 based on Ubuntu 8.10 32 bit were run on a Core2Duo Conroe 2.33 with 2gb of DD2-800 ram. The mac tests were performed on OSX 10.5.6 on a macbook with a 2.4ghz Core2Duo processor, and 2gb of DD2-677 ram. The test being core javascript focussed, I don't know to what extend the hardware will affect the scores. Anyway, the platforms aren't radically different, and are virtually the same. Also, all addons were disable in Firefox, as they negatively impacted considerably.

Windows XP:

Browser Time Link

Firefox 3.0.5 2340.8 ms Detailed

Firefox 3.1b2 1041.4 ms Detailed

Chrome Latest Dev 861 ms Detailed

IE 7 20193 ms Detailed

IE performs worst as expected, and Chrome is the fastest (considering it runs webkit). But the interesting point to note is the performance of FF 3.1b2. The next big version is based on the "TraceMonkey" javascript engine, and it performs more than TWICE as fast as the current iteration. That is a big increase! I'm sure the next iteration of tracemonkey will be able to close the gap with Chrome considerably.

Linux:

Browser Time Link

Firefox 3.0.5 2672 ms Detailed

The same browser is slower by 350 ms on linux, when compared to Windows. I was expecting it to be faster on Linux. This one beats me.

Mac:

Browser Time Link

Firefox 3.0.5 2988 ms Detailed

Safari 3.2.1 3164 ms Detailed

The performance of Firefox is even worse on Mac, and safari did bad too. Shows how important javascript optimization is, as both Chrome and Safari use the WebKit engine. Obviously the chrome team is way ahead of others currently.

The clear winner of this round : Google Chrome.