Project Goals Required Skills Lab Repository Related Papers Collaborators Feedback
|
| Integrating Empirical Methods into Computer Science | |
|
Project Goals Required Skills Lab Repository Related Papers Collaborators Feedback |
||
Empirical Lab RepositoryTitle: Performance Evaluation with Benchmarking Author: Grant W. Braught, Dickinson College, braught@dickinson.edu Possible courses: Computer Organization and Architecture Empirical Concepts Used: arithmetic mean, geometric mean, harmonic mean, weighted means, normalization, isolation of variables Empirical Concepts Introduced: none Computer Science Concepts Used: benchmarking Summary: In this assignment students are asked to create a benchmark and use it to compare the performance of a specific aspect of several different Java virtual machines. Students are free to select any aspect of JVM performance to benchmark (e.g. graphics, integer operations, string operations). Note that students do not create their benchmark from scratch. Rather, they identify at least three existing benchmarks that measure their chosen aspect of performance and combine the results from these benchmarks to produce a new composite benchmark. In creating their composite benchmark, students must understand how the results of the existing benchmarks are reported and determine how to combine those results into a single benchmark score. Completing this assignment provides students with practice executing benchmarks and interpreting benchmark results. Variations: If several different (but compatible) hardware platforms are available, students could be asked to benchmark a specific aspect of the actual hardware using existing benchmarks. Links:
|