Based on a workshop held in January 1999 in San Jose, California.
Includes bibliographical references.
1. Motivation and Overview. Realistic Benchmarks in Industry and Academia: Book Overview and Related Work / Rudolf Eigenmann. Performance Evaluation with Real Applications / Frederica Darema -- 2. Overview of SPEC Benchmarks. SPEC OSG Benchmarks: History, Use and Current Issues / Reinhold Weicker. SPEC HPG Benchmarks: Performance Evaluation with Large-Scale Science and Engineering Applications / Rudolf Eigenmann, Greg Gaertner and Faisal Saied / [et al.] -- 3. Use of SPEC Benchmarks in Research. How to Quantify Loop Nest Locality / Kathryn S. McKinley and Olivier Temam. The Allocation Behavior of the SPECjvm98 Java Benchmarks / Sylvia Dieckmann and Urs Holzle. A Methodology for Scientific Benchmarking with Large-Scale Applications / Brian Armstrong and Rudolf Eigenmann -- 4. Tools and Methodologies for Performance Evaluation and Benchmarking. A Framework for Performance Evaluation and Optimization of Parallel Applications / Shih-Hao Hung and Edward S. Davidson. Performance Coupling: Case Studies for Measuring the Interactions of Kernels in Modern Applications / Jonathan Geisler and Valerie Taylor -- 5. Related Benchmarking Efforts. Conventional Benchmarks as a Sample of the Performance Spectrum / John Gustafson and Rajat Todi. A National Trace Collection and Distribution Resource / J. Kelly Flanagan and Frank Sorenson -- 6. Needs for new Benchmarks. Need for Trace Benchmarks / Reinhard Riedl. Universal Benchmark Suites - A Quantitative Approach to Benchmark Design / Jozo J. Dujmovic