Project

General

Profile

Bug #5985

miniruby skews "make benchmark" results

Added by normalperson (Eric Wong) over 8 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Normal
Target version:
ruby -v:
-
Backport:
[ruby-core:42443]

Description

miniruby has fewer objects and a smaller heap than the normal "ruby",
benchmarks that are affected by GC performance is skewed heavily.
This is most noticeable with the vm3_gc benchmark using the same
Ruby revision/build but different executables (miniruby vs ruby):

$ make
$ make install
$ make benchmark-each ITEM=vm3_gc
ruby ../benchmark/driver.rb -v \
--executables="ruby; ./miniruby -I../lib -I. -I.ext/common ../tool/runruby.rb --extout=.ext -- --disable-gems" \
--pattern=vm3_gc --directory=../benchmark
total: 1 trial(s) (1 trial(s) for 1 benchmark(s))
2012-02-08 18:57:12 +0000
target 0: ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux]
target 1: ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux]


vm3_gc

#! /usr/bin/ruby
5000.times do
100.times do
{"xxxx"=>"yyyy"}
end
GC.start
end

ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux] .2.752270221710205
ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux] .1.857623815536499


raw data:

"vm3_gc", [[2.752270221710205], [1.857623815536499]]

Elapesed time: 4.611220872 (sec)

benchmark results:
name ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux] ruby 2.0.0dev (2012-02-08 trunk 34493) [x86_64-linux] average difference

vm3_gc 2.752 1.858 -0.895

average total difference is -0.894646406173706

Also available in: Atom PDF