Follow @Openwall on Twitter for new release announcements and other news
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date: Sat, 23 Jun 2012 19:17:50 +0200
From: Frank Dittrich <frank_dittrich@...mail.com>
To: john-dev@...ts.openwall.com
Subject: Several enhancements for relbench

The attached patch implements several enhancements for the relbench script.

The first enhancement only makes sense when the patch that adds the
benchmark-unify script gets applied to magnum-jumbo, but I hope this
will be the case.
(See http://openwall.com/lists/john-dev/2012/06/22/53)

The following patch description is just copied from the commit to my
local test branch:

Several enhancements for relbench

1.
If there are benchmarks that exist only in file 1 and benchmarks
that exist only in file 2, point out the possibility to convert
both benchmark files using benchmark-unify, so that more
benchmarks might be compared

2.
If a particular benchmark appears several times in the same file,
print a message to STDERR, and pick the higher values for
comparision (higher real value is considered here, only if the
real values are the same, the higher virtual value is considered).

3.
Add support for an optional verbose mode:

./relbench -v file1 file2
instead of
./relbench file1 file2

With verbose mode, for each benchmark that exists in both files,
the ratio of real / virtual c/s rate is printed like this:

Ratio:	0.95543 real, 0.96987 virtual	generic crypt(3) DES:Only one salt
Ratio:	1.00379 real, 1.00388 virtual	HalfLM C/R DES:Many salts
Ratio:	1.06590 real, 1.06586 virtual	FreeBSD MD5:Raw
Ratio:	2.92454 real, 1.47022 virtual	Invision Power Board 2.x salted
MD5:Only one salt
Ratio:	0.97287 real, 0.97287 virtual	dynamic_20: Cisco PIX (MD5
salted):Many salts

This allows to use

./relbench -v file1 file2 |grep "^Ratio:"|cut -f 2-|sort -nr

This way, the benchmarks with the best performance improvement and the
benchmarks
with the worst performance regression can easily be identified.


Frank

View attachment "0001-Several-enhancements-for-relbench.patch" of type "text/x-patch" (4295 bytes)

Powered by blists - more mailing lists

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.