Click For Photo: https://3c1703fe8d.site.internapcdn.net/newman/gfx/news/hires/2019/capacitors.jpg
The microcomputer revolution of the 1970s triggered a Wild West-like expansion of personal computers in the 1980s. Over the course of the decade, dozens of personal computing devices, from Atari to Xerox Alto, flooded into the market. CPUs and microprocessors advanced rapidly, with new generations coming out on a monthly basis.
Amidst all that growth, there was no standard method to compare one computer's performance against another. Without this, not only would consumers not know which system was better for their needs but computer designers didn't have a standard method to test their systems.
Standard - Performance - Evaluation - Corporation - SPEC
That changed in 1988, when the Standard Performance Evaluation Corporation (SPEC) was established to produce, maintain and endorse a standardized set of performance benchmarks for computers. Think of benchmarks like standardized tests for computers. Like the SATs or TOEFL, benchmarks are meant to provide a method of comparison between similar participants by asking them to perform the same tasks.
Since SPEC, dozens of benchmarking organizations have sprung up to provide a method of comparing the performance of various systems across different chip and program architecture.
Today - Wild - West - Machine - Learning
Today, there is a new Wild West in machine learning. Currently, there are at least 40 different hardware companies poised to break ground in new AI processor architectures.
"Some of these companies will rise but many will fall," said Vijay Janapa Reddi, Associate Professor of Electrical Engineering at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS). "The challenge is how can we tell if one piece of hardware is better than another? That's where benchmark standards become important."
Janapa - Reddi - Leaders - MLPerf - Machine
Janapa Reddi is one of the leaders of MLPerf, a machine learning benchmarking suite. ML Perf began as a collaboration between researchers at Baidu, Berkeley, Google, Harvard, and Stanford and has grown to include many companies, a host of universities, along with hundreds of individual...
Wake Up To Breaking News!