Benchmark (computing)

benchmarkbenchmarksbenchmarkingcomputer benchmarkbenchmark suitebenchmark testbenchmark testingperformance benchmarkbenchmark programbenchmark tests
In computing, a benchmark is the act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it.wikipedia
249 Related Articles

Megahertz myth

easily manipulable benchmarkever-increasing clock speedsMHz myth
See BogoMips and the megahertz myth.
A benchmark is a more thorough way of measuring and comparing computer performance.

PowerPC

PPCPower PCPowerPC 2.02
For example, Pentium 4 processors generally operated at a higher clock frequency than Athlon XP or PowerPC processors, which did not necessarily translate to more computational power; a processor with a slower clock frequency might perform as well as or even better than a processor operating at a higher frequency.
Throughout the mid-1990s, PowerPC processors achieved benchmark test scores that matched or exceeded those of the fastest x86 CPUs.

Pentium 4

Intel Pentium 4WillamettePrescott
For example, Pentium 4 processors generally operated at a higher clock frequency than Athlon XP or PowerPC processors, which did not necessarily translate to more computational power; a processor with a slower clock frequency might perform as well as or even better than a processor operating at a higher frequency.
While IPC is difficult to quantify due to dependence on the benchmark application's instruction mix, clock speed is a simple measurement yielding a single absolute number.

Performance per watt

Green500Green 500power efficiency
The performance and power consumption metrics used depend on the definition; reasonable measures of performance are FLOPS, MIPS, or the score for any performance benchmark.

Whetstone (benchmark)

WhetstoneWhetstone benchmarkwhetstones
The Whetstone benchmark is a synthetic benchmark for evaluating the performance of computers.

Dhrystone

DMIPSdhrystone 2.1Dhrystone benchmark
Dhrystone is a synthetic computing benchmark program developed in 1984 by Reinhold P. Weicker intended to be representative of system (integer) programming.

EEMBC

Embedded Microprocessor Benchmark Consortium (EEMBC)
EEMBC, the Embedded Microprocessor Benchmark Consortium, is a non-profit, member-funded organization formed in 1997, focused on the creation of standard benchmarks for the hardware and software used in embedded systems.

Algorithm

algorithmsalgorithm designcomputer algorithm
For example, if a benchmark extracts the key algorithms of an application, it will contain the performance-sensitive aspects of that application.
Benchmarks may be used to compare before/after potential improvements to an algorithm after program optimization.

SPECint

SPECint95_base
SPECint is a computer benchmark specification for CPU integer processing power.

SPECfp

SPECfp is a computer benchmark designed to test the floating point performance of a computer.

Standard Performance Evaluation Corporation

SPECSPEC CPUSpec CPU 2006
Prior to 2000, computer and microprocessor architects used SPEC to do this, although SPEC's Unix-based benchmarks were quite lengthy and thus unwieldy to use intact.
The Standard Performance Evaluation Corporation (SPEC) is an American non-profit corporation that aims to "produce, establish, maintain and endorse a standardized set" of performance benchmarks for computers.

Coremark

CoreMarks
CoreMark is a benchmark that measures the performance of central processing units (CPU) used in embedded systems.

Computer architecture

architecturearchitecturesCPU architecture
As computer architecture advanced, it became more difficult to compare the performance of various computer systems simply by looking at their specifications.
Benchmarking takes all these factors into account by measuring the time a computer takes to run through a series of test programs.

Processor design

CPU designhardware designarchitecture
Benchmarks are particularly important in CPU design, giving processor architects the ability to measure and make tradeoffs in microarchitectural decisions.
Benchmarking is a way of testing CPU speed.

Bonnie++

Bonnie
Bonnie++ is a free software file system benchmarking tool for Unix-like operating systems, developed by Russell Coker.

Computer performance

performanceprocessing powercomputing power
Because there are so many programs to test a CPU on all aspects of performance, benchmarks were developed.

Hierarchical INTegration

HINTQUIPS
Hierarchical INTegration, or HINT for short, is a computer benchmark that ranks a computer system as a whole (i.e. the entire computer instead of individual components).

NAS Parallel Benchmarks

NAS BenchmarksNAS Parallel Benchmarks (NPB)
NAS Parallel Benchmarks (NPB) are a set of benchmarks targeting performance evaluation of highly parallel supercomputers.

Livermore loops

Livermore loops (also known as the Livermore Fortran kernels or LFK) is a benchmark for parallel computers.

Iometer

It is used as a benchmark and troubleshooting tool and is easily configured to replicate the behaviour of many popular applications.

Fhourstones

In computer science, Fhourstones is an integer benchmark that efficiently solves positions in the game of Connect-4.

NBench

NBench, short for Native mode Benchmark and later known as BYTEmark, is a synthetic computing benchmark program developed in the mid-1990s by the now defunct BYTE magazine intended to measure a computer's CPU, FPU, and Memory System speed.

LINPACK benchmarks

LINPACK benchmarkLINPACKassociated benchmark
The latest version of these benchmarks is used to build the TOP500 list, ranking the world's most powerful supercomputers.

Phoronix Test Suite

PhoronixMichael LarabelLarabel
Phoronix Test Suite (PTS) is a free and open-source benchmark software for Linux and other operating systems which is developed by Michael Larabel and Matthew Tippett.

Transaction Processing over XML

TPoX
Transaction Processing over XML (TPoX) is a computing benchmark for XML database systems.