1 2010-01-11 Oliver Hunt <oliver (a] apple.com> 2 3 Reviewed by Darin Adler. 4 5 Sunspider parse-only tests don't run 6 https://bugs.webkit.org/show_bug.cgi?id=33489 7 8 Fix parse-only test list 9 10 * tests/parse-only/LIST: 11 12 2009-12-15 Maciej Stachowiak <mjs (a] apple.com> 13 14 Reviewed by Adele Peterson. 15 16 Make SunSpider version more prominent in the title 17 https://bugs.webkit.org/show_bug.cgi?id=32574 18 19 * hosted/sunspider.html: 20 * hosted/versions.html: 21 * resources/driver-TEMPLATE.html: 22 * resources/results-TEMPLATE.html: 23 24 2009-12-15 Maciej Stachowiak <mjs (a] apple.com> 25 26 Reviewed by Darin Adler. 27 28 Make SunSpider refuse to compare results across content versions 29 https://bugs.webkit.org/show_bug.cgi?id=32573 30 31 The results URL now includes a version indicator, and compare mode 32 will refuse to compare between versions. 33 34 * resources/driver-TEMPLATE.html: 35 * resources/results-TEMPLATE.html: 36 37 2009-12-14 Maciej Stachowiak <mjs (a] apple.com> 38 39 Reviewed by Darin Adler. 40 41 Some Browser-hosted SunSpider files are not valid HTML5 42 https://bugs.webkit.org/show_bug.cgi?id=32536 43 44 Made various fixes to validate as HTML5 with no warnings (mainly removing bogus 45 close tags and adding a meta charset declaration). 46 47 * hosted/sunspider.html: 48 * hosted/versions.html: 49 * resources/TEMPLATE.html: 50 * resources/driver-TEMPLATE.html: 51 * resources/results-TEMPLATE.html: 52 53 2009-12-14 Maciej Stachowiak <mjs (a] apple.com> 54 55 Reviewed by Eric Seidel. 56 57 Make sunspider-0.9.1 the default content set (both command-line and hosted) 58 https://bugs.webkit.org/show_bug.cgi?id=32537 59 60 * hosted/sunspider.html: Change default suite link. 61 * sunspider: Change default suite. 62 * sunspider-compare-results: Likewise. 63 64 2009-12-14 Maciej Stachowiak <mjs (a] apple.com> 65 66 Reviewed by Sam Weinig. 67 68 in-browser SunSpider suffers excessive penalty under power management 69 https://bugs.webkit.org/show_bug.cgi?id=32505 70 71 I have made a few changes to address this: 72 73 1) Change how browser-hosted SunSpider loads tests - preload the content and write it in with 74 document.write to reduce triggering of progress UI. 75 2) Reduce time between tests to 10ms from 500ms, so that power management doesn't keep the CPU 76 stepped all the way down the whole time. 77 3) Run the test cycle an extra time for warmup before the runs that count. 78 79 * hosted/sunspider-record-result.js: Removed. 80 * make-hosted: 81 * resources/TEMPLATE.html: 82 * resources/driver-TEMPLATE.html: 83 84 2009-12-13 Maciej Stachowiak <mjs (a] apple.com> 85 86 Reviewed by Gavin Barraclough. 87 88 SunSpider/tests/string-base64.js does not compute a valid base64 encoded string 89 https://bugs.webkit.org/show_bug.cgi?id=16806 90 91 Based on a patch by Eric Seidel. 92 93 Fix the base64 computation to actually compute correct results. The impact on runtime of 94 the test is pretty small, but noticeable for some browsers. But at least it's not 95 doing a wrong and meaningless computation any more. 96 97 * tests/sunspider-0.9.1/string-base64.js: 98 (): 99 (base64ToString): 100 101 2009-12-13 Maciej Stachowiak <mjs (a] apple.com> 102 103 Fixing commit error... 104 105 I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing. 106 107 * resources/driver-TEMPLATE.html: 108 109 2009-12-13 Maciej Stachowiak <mjs (a] apple.com> 110 111 Reviewed by Sam Weinig. 112 113 Use JSON.parse instead of eval for Web-hosted SunSpider results processing 114 https://bugs.webkit.org/show_bug.cgi?id=32490 115 116 * hosted/json2.js: Added. Incorporated from json.org 117 * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed. 118 * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process 119 results. 120 121 2009-12-12 Maciej Stachowiak <mjs (a] apple.com> 122 123 Reviewed by Oliver Hunt. 124 125 Enable Web-hosted version of SunSpider to handle multiple versions 126 https://bugs.webkit.org/show_bug.cgi?id=32478 127 128 * make-hosted: Now generate the hosted version to be able to run both the 129 0.9 and the 0.9.1 test suites. 130 * hosted: Modified property svn:ignore. 131 * hosted/sunspider-driver.html: Removed. 132 * hosted/sunspider-results.html: Removed. 133 * hosted/sunspider.html: 134 * hosted/versions.html: Added. 135 * resources/TEMPLATE.html: 136 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html. 137 * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html. 138 139 2009-12-12 Maciej Stachowiak <mjs (a] apple.com> 140 141 Reviewed by Oliver Hunt. 142 143 Give command-line sunspider the ability to handle multiple suites and versions 144 https://bugs.webkit.org/show_bug.cgi?id=32477 145 146 Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST 147 enumerating the tests. Current suites are: 148 149 sunspider-0.9 - riginal SunSpider content 150 sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come) 151 ubench - "ubench" microbenchmark suite 152 v8-v4 - version 4 of the v8 benchmark 153 parse-only - some parser tests 154 155 Sunspider can now be run with the --suite= parameter to select a 156 suite. The default is --suite=sunspider-0.9. 157 158 * .: Modified property svn:ignore to ignore new results directories. 159 * make-hosted: Generate based on sunspider-0.9 suite. 160 * resources/TEMPLATE.html: Fix an HTML compliance problem. 161 * resources/sunspider-standalone-driver.js: Become aware of suite names. 162 * sunspider: Modified to handle multiple suites as described above. 163 * sunspider-compare-results: ditto 164 * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/ 165 * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST 166 * tests/LIST-UBENCH: Removed. 167 * tests/LIST-V8: Removed. 168 * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1 169 * tests/3d-morph.js: ditto 170 * tests/3d-raytrace.js: ditto 171 * tests/access-binary-trees.js: ditto 172 * tests/access-fannkuch.js: ditto 173 * tests/access-nbody.js: ditto 174 * tests/access-nsieve.js: ditto 175 * tests/bitops-3bit-bits-in-byte.js: ditto 176 * tests/bitops-bits-in-byte.js: ditto 177 * tests/bitops-bitwise-and.js: ditto 178 * tests/bitops-nsieve-bits.js: ditto 179 * tests/controlflow-recursive.js: ditto 180 * tests/crypto-aes.js: ditto 181 * tests/crypto-md5.js: ditto 182 * tests/crypto-sha1.js: ditto 183 * tests/date-format-tofte.js: ditto 184 * tests/date-format-xparb.js: ditto 185 * tests/math-cordic.js: ditto 186 * tests/math-partial-sums.js: ditto 187 * tests/math-spectral-norm.js: ditto 188 * tests/regexp-dna.js: ditto 189 * tests/string-base64.js: ditto 190 * tests/string-fasta.js: ditto 191 * tests/string-tagcloud.js: ditto 192 * tests/string-unpack-code.js: ditto 193 * tests/string-validate-input.js: ditto 194 * tests/sunspider-0.9/: Added 195 * tests/sunspider-0.9/*.js: Moved from one level up 196 * tests/sunspider-0.9.1: Added. 197 * tests/sunspider-0.9.1/*.js: Moved from one level up. 198 * tests/v8-crypto.js: Moved to v8-v4/ directory. 199 * tests/v8-deltablue.js: ditto 200 * tests/v8-earley-boyer.js: ditto 201 * tests/v8-raytrace.js: ditto 202 * tests/v8-regexp.js: ditto 203 * tests/v8-richards.js: ditto 204 * tests/v8-splay.js: ditto 205 * tests/v8-v4: Added. 206 207 2009-09-30 Csaba Osztrogonac <oszi (a] inf.u-szeged.hu> 208 209 Reviewed by Darin Adler. 210 211 Platform specific null device replaced with a platform independent. 212 https://bugs.webkit.org/show_bug.cgi?id=29544 213 214 * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL. 215 216 2009-09-21 Csaba Osztrogonac <oszi (a] inf.u-szeged.hu> 217 218 Reviewed by Maciej Stachowiak. 219 220 [Qt] Make sunspider script work on Windows platform. 221 https://bugs.webkit.org/show_bug.cgi?id=29544 222 223 * sunspider: 224 Using platform specific null device instead of /dev/null. 225 226 2009-06-19 Adam Treat <adam.treat (a] torchmobile.com> 227 228 Reviewed by Oliver Hunt. 229 230 https://bugs.webkit.org/show_bug.cgi?id=26540 231 Currently the SunSpider test driver lacks an option to run a test suite that 232 will test JavaScriptCore parsing performance only. This patch adds just such 233 a test suite and option to SunSpider as well as the jsc test shell. I've included 234 three large javascript source files found in the wild: jquery, mootools and prototype. 235 Combined with the concatenation of all three, these form a new testsuite to measure 236 and test pure JavaScriptCore parsing performance. 237 238 * resources/sunspider-standalone-driver.js: 239 Load the js with parse-only flag if it is part of the parse-only suite. 240 * sunspider: 241 Add the parse-only suite to the list of options. 242 * sunspider-compare-results: 243 Add the parse-only suite to the list of options. 244 * tests/LIST-PARSE-ONLY: Added. 245 * tests/parse-only/concat-jquery-mootools-prototype.js: Added. 246 A very large concatenation of the scripts found below. This js takes ~30ms to parse on my machine. 247 * tests/parse-only/jquery-1.3.2.js: Added. 248 Latest version from jquery.com. 249 * tests/parse-only/mootools-1.2.2-core-nc.js: Added. 250 Latest version from mootools.net. 251 * tests/parse-only/prototype-1.6.0.3.js: Added. 252 Latest version from prototypejs.org. 253 254 2009-06-13 Steve Falkenburg <sfalken (a] apple.com> 255 256 Update V8 benchmark to version 4. 257 258 Reviewed by Cameron Zwarich. 259 260 * tests/LIST-V8: 261 * tests/v8-crypto.js: 262 * tests/v8-deltablue.js: 263 * tests/v8-earley-boyer.js: 264 * tests/v8-raytrace.js: 265 * tests/v8-regexp.js: Added. 266 * tests/v8-richards.js: 267 * tests/v8-splay.js: Added. 268 269 2009-05-26 Olivier DOLE <odole (a] pleyo.com> 270 271 Reviewed by Maciej. 272 273 Store sunspider test suite results in a specific directory for each 274 different type of benchmark (sunspider, V8 or ubench). 275 276 * sunspider: 277 * sunspider-compare-results: 278 279 2009-05-12 Steve Falkenburg <sfalken (a] apple.com> 280 281 Build fix. 282 283 * SunSpider.make: 284 285 2009-05-11 Steve Falkenburg <sfalken (a] apple.com> 286 287 Include SunSpider tests in production builds. 288 289 Reviewed by Adam Roben. 290 291 * SunSpider.make: Added. 292 * xcopy.excludes: Added. 293 294 2009-03-04 Oliver Hunt <oliver (a] apple.com> 295 296 Added a few more tests to ubench 297 298 RS=Gavin Barraclough 299 300 Adding a couple of test to cover too few and too many arguments. This 301 is needed to prevent regressions in all call paths from my current refactoring. 302 303 * tests/LIST-UBENCH: 304 * tests/ubench/function-correct-args.js: Added. 305 (f): 306 * tests/ubench/function-excess-args.js: Added. 307 (f): 308 309 2008-10-30 Zoltan Horvath <Horvath.Zoltan.6 (a] stud.u-szeged.hu> 310 311 Fix a bug where when V8's or UBENCH's test suite list file is missing 312 the error message is suggesting that SunSpider's list file is missing. 313 314 Reviewed by Sam Weinig. 315 316 * sunspider: 317 (loadTestsList): Fix the error message to use the right list name. 318 319 2008-10-07 David Hyatt <hyatt (a] apple.com> 320 321 https://bugs.webkit.org/show_bug.cgi?id=18989 322 323 Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and 324 we want all browsers to be doing the same thing on the test. 325 326 Reviewed by Maciej 327 328 * tests/regexp-dna.js: 329 330 2008-09-09 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 331 332 Rubber-stamped by Maciej Stachowiak. 333 334 The bleeding edge branch of V8 now supports passing fileanmes after 335 '-f', so the SunSpider script should be changed to do this again. 336 This allows all 3 major JavaScript engines to be used with the 337 unmodified SunSpider script. 338 339 * sunspider: 340 341 2008-09-04 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 342 343 Reviewed by Maciej Stachowiak. 344 345 Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey 346 and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and 347 correct the punctuation in its documentation. 348 349 * sunspider: 350 351 2008-09-04 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 352 353 Reviewed by Oliver Hunt. 354 355 Bug 20616: Incorporate V8 benchmarks in testing 356 <https://bugs.webkit.org/show_bug.cgi?id=20616> 357 358 This is a first attempt at running the V8 benchmarks within SunSpider, 359 with the --v8 option. The number of iterations is fixed for each 360 benchmark, and was chosen to make each of the benchmarks run between 361 500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro. 362 363 * sunspider: 364 * tests/LIST-V8: Added. 365 * tests/v8-crypto.js: Added. 366 * tests/v8-deltablue.js: Added. 367 * tests/v8-earley-boyer.js: Added. 368 * tests/v8-raytrace.js: Added. 369 * tests/v8-richards.js: Added. 370 371 2008-09-02 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 372 373 Not reviewed. 374 375 Remove a local change that was accidentally committed in r36034. 376 377 * resources/sunspider-standalone-driver.js: 378 379 2008-09-02 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 380 381 Rubber-stamped by Oliver Hunt. 382 383 Make SunSpider work with JavaScript shells that don't take filenames 384 after a '-f' argument. 385 386 * sunspider: 387 388 2008-06-07 Cameron Zwarich <cwzwarich (a] uwaterloo.ca> 389 390 Reviewed by Timothy. 391 392 Remove the --squirrelfish option from SunSpider, as it is no longer needed. 393 394 * sunspider: 395 * tests/LIST-SQUIRRELFISH: Removed. 396 397 2008-06-03 Alexey Proskuryakov <ap (a] webkit.org> 398 399 Rubber-stamped by Mark Rowe. 400 401 Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more. 402 403 * sunspider: 404 405 2008-04-15 Maciej Stachowiak <mjs (a] apple.com> 406 407 Rubber stamped by Oliver. 408 409 - add newly working tests to squirrelfish list 410 411 * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code 412 413 2008-04-14 Maciej Stachowiak <mjs (a] apple.com> 414 415 Rubber stamped by Oliver. 416 417 - move ubench tests properly. 418 419 * tests/ubench: Added. 420 * tests/ubench/function-closure.js: Added. 421 * tests/ubench/function-empty.js: Added. 422 * tests/ubench/function-missing-args.js: Added. 423 * tests/ubench/function-sum.js: Added. 424 * tests/ubench/loop-empty-resolve.js: Added. 425 * tests/ubench/loop-empty.js: Added. 426 * tests/ubench/loop-sum.js: Added. 427 428 2008-04-14 Maciej Stachowiak <mjs (a] apple.com> 429 430 Rubber stamped by Oliver. 431 432 * sunspider: Don't force --runs=1 in squirrelfish mode any more. 433 434 2008-04-14 Maciej Stachowiak <mjs (a] apple.com> 435 436 Reviewed by Oliver. 437 438 - make --squirrelfish mode use the real harness, but a reduced set of tests 439 440 Also add a new ubench mode which runs the older squirrelfish microbenchmarks. 441 442 * sunspider: 443 * tests/LIST-SQUIRRELFISH: 444 * tests/LIST-UBENCH: Added. 445 * tests/squirrelfish: Moved to tests/ubench 446 447 2008-04-14 Geoffrey Garen <ggaren (a] apple.com> 448 449 Reviewed by Maciej Stachowiak. 450 451 Removed an unused test. 452 453 * tests/squirrelfish/loop-resolve.js: Removed. 454 455 2008-04-10 Maciej Stachowiak <mjs (a] apple.com> 456 457 Reviewed by Oliver. 458 459 Add newly runnable tests to --squirrelfish mode. 460 461 * tests/LIST-SQUIRRELFISH: 462 463 2008-04-06 Geoffrey Garen <ggaren (a] apple.com> 464 465 Reviewed by Maciej Stachowiak. 466 467 A little more love for --squirrelfish mode: 468 469 Fixed a misplaced sort. Results properly sort now. 470 471 Added a test list just for squirrelfish, and updated it to include 472 all currently passing SunSpider tests. 473 474 Fixed the pruning regexp to match 3d-morph.js. 475 476 * sunspider: 477 478 2008-03-26 Geoffrey Garen <ggaren (a] apple.com> 479 480 Reviewed by Oliver Hunt. 481 482 --squirrelfish mode: pared down tests for squirrelfish to chew on. 483 484 * sunspider: 485 * tests/LIST: 486 * tests/squirrelfish: Added. 487 * tests/squirrelfish/function-closure.js: Added. 488 * tests/squirrelfish/function-empty.js: Added. 489 * tests/squirrelfish/function-missing-args.js: Added. 490 * tests/squirrelfish/function-sum.js: Added. 491 * tests/squirrelfish/loop-empty-resolve.js: Added. 492 * tests/squirrelfish/loop-empty.js: Added. 493 * tests/squirrelfish/loop-resolve.js: Added. 494 * tests/squirrelfish/loop-sum.js: Added. 495 496 2008-03-21 Alexey Proskuryakov <ap (a] webkit.org> 497 498 Reviewed by Geoff. 499 500 * sunspider: Pause update daemon on Darwin to make results reliable 501 again (workaround for <rdar://problem/5811127>). 502 503 2008-02-07 Eric Seidel <eric (a] webkit.org> 504 505 Reviewed by Sam. 506 507 * sunspider: add an error message when ./tests/LIST is not found 508 509 2007-12-29 Alp Toker <alp (a] atoker.com> 510 511 Fix typo. 512 513 * hosted/sunspider.html: 514 515 2007-12-29 Alp Toker <alp (a] atoker.com> 516 517 Reviewed by Maciej. 518 519 Provide the current URL in the SunSpider results page. Useful for 520 copying benchmark results out of browsers without a location bar or 521 where the location bar can't handle long URLs. 522 523 * hosted/sunspider-results.html: 524 525 2007-12-20 Eric Seidel <eric (a] webkit.org> 526 527 Reviewed by mjs. 528 529 * sunspider: increase default number of runs for more accurate numbers 530 531 2007-12-18 Mark Rowe <mrowe (a] apple.com> 532 533 Fix typo. 534 535 * hosted/sunspider.html: 536 537 2007-12-18 Maciej Stachowiak <mjs (a] apple.com> 538 539 Reviewed by Eric. 540 541 - give an extra digit of precision for small differences. 542 543 * resources/sunspider-compare-results.js: 544 545 2007-12-17 Maciej Stachowiak <mjs (a] apple.com> 546 547 Reviewed by Eric. 548 549 - work around IE layout bugs 550 551 * hosted/sunspider.css: 552 553 2007-12-17 Maciej Stachowiak <mjs (a] apple.com> 554 555 Reviewed by Mark. 556 557 - fix compare feature 558 559 * hosted/sunspider-results.html: 560 561 2007-12-17 Maciej Stachowiak <mjs (a] apple.com> 562 563 Reviewed by Mark. 564 565 - Change the format of the output URL to be shorter, to meet IE constraints 566 567 * hosted/sunspider-driver.html: 568 * hosted/sunspider-results.html: 569 570 2007-12-13 Maciej Stachowiak <mjs (a] apple.com> 571 572 Reviewed by Oliver. 573 574 - Add some explanatory test and a dumb logo to SunSpider web hosted version 575 576 * hosted/sunspider-driver.html: 577 * hosted/sunspider-results.html: 578 * hosted/sunspider.css: 579 * hosted/sunspider.html: 580 581 2007-12-13 Maciej Stachowiak <mjs (a] apple.com> 582 583 Reviewed by Oliver. 584 585 - Make the web-hosted version of SunSpider look a little bit less drab. 586 587 * hosted/sunspider-driver.html: 588 * hosted/sunspider-results.html: 589 * hosted/sunspider.css: Added. 590 * hosted/sunspider.html: 591 * resources/TEMPLATE.html: 592 593 2007-12-12 Maciej Stachowiak <mjs (a] apple.com> 594 595 Reviewed by Sam. 596 597 - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values. 598 599 A sample of what new-style results would look like: 600 601 TEST COMPARISON FROM TO DETAILS 602 ... 603 ** TOTAL **: 1.41x as fast 6613.6ms +/- 0.1% 4703.0ms +/- 0.1% significant 604 ... 605 3bit-bits-in-byte: *1.36x as slow* 88.8ms +/- 0.6% 121.1ms +/- 0.6% significant 606 607 * resources/sunspider-compare-results.js: 608 609 2007-11-14 Eric Seidel <eric (a] webkit.org> 610 611 Reviewed by Sam. 612 613 * sunspider: add --shark-cache for L2 Cache Miss profiling 614 615 2007-11-09 Alexey Proskuryakov <ap (a] webkit.org> 616 617 Reviewed by Darin Adler. 618 619 http://bugs.webkit.org/show_bug.cgi?id=15925 620 SunSpider should check for Shark being installed 621 622 * sunspider: Explicitly test that shark command line tool is installed. 623 624 2007-11-04 Darin Adler <darin (a] apple.com> 625 626 * hosted/sunspider.html: Tweaked formatting a bit. 627 628 2007-11-03 Maciej Stachowiak <mjs (a] apple.com> 629 630 Reviewed by Darin Adler. 631 632 - Add compare mode and a description of the benchmark to the hosted version. 633 634 * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL. 635 * hosted/sunspider.html: Added intro text. 636 * make-hosted: Copy new file. 637 * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in 638 a function. 639 * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode 640 expects. 641 * sunspider-compare-results: Use sunspider-standalone-compare.js. 642 643 2007-11-02 Darin Adler <darin (a] apple.com> 644 645 * sunspider: Changed "--base" to "--set-baseline". 646 647 2007-11-02 Darin Adler <darin (a] apple.com> 648 649 Reviewed by Maciej. 650 651 * sunspider: Added a "--base" option that records the current test as a baseline. 652 Moved the code to find the newest .mshark file into a function (since I needed to use 653 it in the other script and I prefer to copy/paste a function). 654 655 * sunspider-compare-results: Added logic to compare the baseline with the last 656 run when you don't pass any parameters. 657 658 2007-10-29 Maciej Stachowiak <mjs (a] apple.com> 659 660 Reviewed by Eric. 661 662 - Added list of ECMAScript3 features that SunSpider does not cover currently. 663 664 * UNCOVERED: Added. 665 666 2007-10-29 Maciej Stachowiak <mjs (a] apple.com> 667 668 Reviewed by Oliver. 669 670 - Give better error messages when sunspider-compare-results fails 671 672 * sunspider-compare-results: 673 674 2007-10-29 Maciej Stachowiak <mjs (a] apple.com> 675 676 Reviewed by Darin Adler. 677 678 - fix Date tests to work in command-line SpiderMonkey 679 680 * tests/date-format-tofte.js: 681 * tests/date-format-xparb.js: 682 683 2007-10-29 Darin Adler <darin (a] apple.com> 684 685 Reviewed by Maciej. 686 687 * sunspider: Added --shark20 option, to run Shark at its highest sample 688 resolution instead of its default. 689 690 2007-10-28 Adam Roben <aroben (a] apple.com> 691 692 Fix SunSpider on Windows 693 694 Reviewed by Eric. 695 696 * sunspider: Don't use colons in filenames. 697 698 2007-10-28 Darin Adler <darin (a] apple.com> 699 700 Reviewed by Adam. 701 702 * resources/sunspider-analyze-results.js: Tweak the output format a little. 703 Change so that when there's only one run we don't write out confidence 704 intervals at all rather than writing "NaN" over and over again. 705 706 * sunspider: Use the time and date as a suffix on the results file, that way 707 all the results are left behind in the tmp directory. This will make it easy 708 for us to add features that compare past results in the future. Also rename 709 the .mshark files using the same scheme. 710 711 * sunspider-compare-results: Relax the parsing rules so we can parse the 712 results file exactly as it's emitted from sunspider. 713 714 2007-10-25 Adam Roben <aroben (a] apple.com> 715 716 Strip carriage returns from results 717 718 Carriage returns were screwing up sunspider-compare-results on 719 Windows. 720 721 Rubberstamped by Oliver. 722 723 * sunspider: 724 725 2007-10-24 Darin Adler <darin (a] apple.com> 726 727 Reviewed by Eric. 728 729 * sunspider: Open the profile in shark after completing a run. 730 * sunspider-compare-results: Tiny perl tweaks. 731 732 2007-10-23 Maciej Stachowiak <mjs (a] apple.com> 733 734 Reviewed by Darin Adler. 735 736 - Don't hardcode my path to testkjs 737 738 * sunspider-compare-results: 739 740 2007-10-23 Maciej Stachowiak <mjs (a] apple.com> 741 742 Reviewed by Darin Adler. 743 744 - Add a compare script to compare results, and improve formatting of standard results a bit. 745 746 * resources/sunspider-analyze-results.js: 747 * resources/sunspider-compare-results.js: Added. 748 * sunspider-compare-results: Added. 749 750 2007-10-23 Maciej Stachowiak <mjs (a] apple.com> 751 752 Reviewed by Darin Adler. 753 754 * resources/sunspider-analyze-results.js: Do the error range 755 properly, using the t-distribution instead of 1.96 (which was 756 based on the normal distribution). 757 758 * sunspider: Print results in a way that will be friendlier to the 759 soon-to-come compare mode. 760 761 2007-10-22 Maciej Stachowiak <mjs (a] apple.com> 762 763 Reviewed by Review. 764 765 - add more tests (probably the final set for now) 766 767 Already balanced. Added date, regexp, control flow, and a few 768 more string and object/array access tests. 769 770 * tests/LIST: 771 * tests/access-fannkuch.js: Added. 772 * tests/access-nbody.js: Added. 773 * tests/controlflow-recursive.js: Added. 774 * tests/date-format-tofte.js: Added. 775 * tests/date-format-xparb.js: Added. 776 * tests/regexp-dna.js: Added. 777 * tests/string-validate-input.js: Added. 778 779 2007-10-21 Eric Seidel <eric (a] webkit.org> 780 781 Reviewed by mjs. 782 783 * sunspider: make --shark only sample from testkjs 784 785 2007-10-21 Maciej Stachowiak <mjs (a] apple.com> 786 787 Rubber stamped by Eric. 788 789 - added crypto tests (already balanced) 790 791 * tests/LIST: 792 * tests/crypto-aes.js: Added. 793 * tests/crypto-md5.js: Added. 794 * tests/crypto-sha1.js: Added. 795 796 2007-10-21 Maciej Stachowiak <mjs (a] apple.com> 797 798 Reviewed by Adam. 799 800 - rebalance new tests 801 802 Scaled the new tests so they take 400-600ms on a reasonably normal user setup: 803 804 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M 805 806 This balances them with the existing tests. 807 808 * tests/access-binary-trees.js: 809 * tests/access-nsieve.js: 810 * tests/bitops-nsieve-bits.js: 811 * tests/math-partial-sums.js: 812 * tests/math-spectral-norm.js: 813 * tests/string-fasta.js: 814 815 2007-10-20 Eric Seidel <eric (a] webkit.org> 816 817 Reviewed by darin. 818 819 Add improved argument handling to sunspider, including 820 --runs=<number>, --tests=<pattern, --shark, and --help 821 Also re-factor code into subroutines 822 823 * sunspider: improved argument handling 824 825 2007-10-20 Maciej Stachowiak <mjs (a] apple.com> 826 827 Reviewed by Mark. 828 829 - Add more new tests, mostly from the computer language shootout. Not normalized yet. 830 831 * TODO: 832 * tests/LIST: 833 * tests/access-binary-trees.js: Added. 834 * tests/access-nsieve.js: Added. 835 * tests/bitops-nsieve-bits.js: Added. 836 * tests/math-partial-sums.js: Added. 837 * tests/math-spectral-norm.js: Added. 838 * tests/string-fasta.js: Added. 839 840 2007-10-20 Maciej Stachowiak <mjs (a] apple.com> 841 842 Reviewed by Darin Adler. 843 844 * TODO: Updated to note areas that are now well-covered. 845 846 - Change the tests and the driver to avoid leaving large object 847 graphs hanging around, since that throws off the subsequent tests. 848 849 * resources/sunspider-standalone-driver.js: 850 * tests/3d-cube.js: 851 * tests/3d-morph.js: 852 * tests/3d-raytrace.js: 853 * tests/bitops-bitwise-and.js: 854 * tests/string-base64.js: 855 * tests/string-tagcloud.js: 856 857 2007-10-20 Maciej Stachowiak <mjs (a] apple.com> 858 859 Reviewed by Nikolas. 860 861 - Rebalance test complexity. 862 863 Scaled all the tests so they take 400-600ms on a reasonably normal user setup: 864 865 Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M 866 867 However, for some tests, IE7 was a huge outlier compared to other 868 major browsers. For those tests, I used Firefox 2.0.0.8 on the 869 same OS and hardware as a normalization basis. 870 871 * tests/3d-morph.js: 872 * tests/3d-raytrace.js: 873 * tests/bitops-3bit-bits-in-byte.js: 874 * tests/bitops-bits-in-byte.js: 875 * tests/bitops-bitwise-and.js: 876 * tests/math-cordic.js: 877 * tests/string-base64.js: 878 * tests/string-tagcloud.js: 879 * tests/string-unpack-code.js: 880 881 2007-10-20 Maciej Stachowiak <mjs (a] apple.com> 882 883 Reviewed by Oliver. 884 885 - Fix the browser-hosted driver to be compatible with Safari 2 886 887 * hosted/sunspider-driver.html: 888 889 2007-10-20 Maciej Stachowiak <mjs (a] apple.com> 890 891 Rubber stamped by Hyatt. 892 893 - Add BSD license notice to cordic test, the original author said to do so. 894 895 * tests/math-cordic.js: 896 897 2007-10-18 Maciej Stachowiak <mjs (a] apple.com> 898 899 Reviewed by Eric. 900 901 - Support Windows and Windows browsers. 902 903 * hosted/sunspider-results.html: Display results correctly in IE. 904 * sunspider: tweaks to work on Windows, and with spaces in the path. 905 906 2007-10-18 Maciej Stachowiak <mjs (a] apple.com> 907 908 Rubber stamped by Oliver. 909 910 * tests/string-tagcloud.js: Remove stray print() 911 912 2007-10-17 Maciej Stachowiak <mjs (a] apple.com> 913 914 Reviewed by Oliver. 915 916 Add some string test cases. 917 918 * tests/string-base64.js: Added. Does base64 encoding and decoding. 919 * tests/string-tagcloud.js: Added. Parses a JSON string and 920 generates tagcloud HTML markup based on the data. 921 * tests/string-unpack-code.js: Added. Unpack compressed versions of 922 four of the most popular JavaScript libraries. 923 * tests/LIST: Added the new tests. 924 925 2007-10-16 Maciej Stachowiak <mjs (a] apple.com> 926 927 Reviewed by Anders. 928 929 * TODO: Updated with info on how to do the stats properly. 930 931 * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to 932 avoid overly slowing down the benchmark. 933 934 Added some 3D-related test cases. 935 936 * tests/3d-cube.js: Added. 937 * tests/3d-morph.js: Added. 938 * tests/3d-raytrace.js: Added. 939 * tests/LIST: 940 941 2007-10-14 Maciej Stachowiak <mjs (a] apple.com> 942 943 Reviewed by Darin Adler. 944 945 - New JavaScript benchmark 946 http://bugs.webkit.org/show_bug.cgi?id=15515 947 948 A start on a new JavaScript benchmark, with standalone and 949 browser-hosted drivers. 950 951 The test content is still incomplete and the drivers could use 952 some more features but there is enough here to make a good start. 953 954 The drivers compute a 95% confidence interval on the mean for the 955 whole test, each category, and each individual test to make it 956 easier to tell whether differences are statistically 957 significant. The confidence interval can be narrowed by running 958 the test more times. 959 960 * TODO: Added. Remaining things that need to be done. 961 * sunspider: Added. Perl script that acts as the standalone test driver. 962 * resources/sunspider-standalone-driver.js: Added. JavaScript part 963 of standalone test driver. 964 * resources/sunspider-analyze-results.js: Added. JavaScript statistical 965 analysis code. 966 * resources/TEMPLATE.html: Added. Template for browser-hosted tests. 967 * make-hosted: Added. Script to generate browser-hosted tests. 968 * hosted/sunspider.html: Added. Start page for browser-hosted test. 969 * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests. 970 * hosted/sunspider-results.html: Added. Results page for browser-hosted 971 tests. 972 * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted 973 tests. 974 * tests/LIST: Added. List of tests to use. 975 * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content. 976 * tests/bitops-bits-in-byte.js: Added. Ditto. 977 * tests/bitops-bitwise-and.js: Added. Ditto. 978 * tests/math-cordic.js: Added. Ditto. 979 980
