http://www.designtechnica.com/article.php?sid=1305
News: How Flawed is PCMark2002?
Posted on Thursday, December 02 @ 00:00:03 PST by prod
MadOnions PCMark2002 is made with the help of BAPco. Now, BAPco makes its own benchmarks for PC usage as well, such as SysMark 2001-2002. Now, how fair would all these SYSTEM benchmarks be, if they where being funded, or even made by a cpu manufacturer? Well, BAPco., is nothing other than a front for Intel. They have flawed SysMark in the past, and now, it looks as if PCMark2002 is in the same boat. A benchmark cannot be fair for all PC users, if it is favouring a certain "type" of PC. Thus, PCMARK2002, should only be used by Intel cpu owners. I'll even say Pentium 4 owners, and should be only used as a comparison to other Intel cpu owners, at most.
DO NOT USE PCMARK2002
http://www.vanshardware.com/articles/2001/august/010814_Intel_SysMark/010814_Intel_SysMark.htm
Hardware reviewers rely on software tools to make performance analyses. Most often, the most crucial insights of reviews are dependent upon commercially derived benchmark suites. With Intel's help distributing their products, the CPU maker's alter ego, BAPCo, has seen its SysMark application level test suite become perhaps the most widely used CPU analysis tool in the industry.
By controlling the very lens through which all CPUs are viewed, Intel can show their processors in the best possible light while placing its rivals' products in the shadows.
There are many ways to skew benchmarks to make a particular CPU look good. One cheap and dirty method is to highlight a particular instruction set extension to the exclusion of the competitors' analog. We mentioned well over a year ago our belief that SysMark 2000 had Intel SSE optimizations to the exclusion of AMD's 3dNow! enhancements. However, testing this conjecture was difficult.
With the introduction of AMD's Palomino, this situation has changed. The Palomino is very similar to the Thunderbird version of the Athlon, but boasts full SSE compatibility. Although Palomino desktop chips are not available yet, we dropped a 1.2 GHz Athlon MP into an Epox 8KHA system and compared performance with a 1.4 GHz Thunderbird Athlon used in the same setup. The SysMark test we chose to examine was Photoshop since its filters were a prime candidate for SSE optimizations.