Openwall GNU/*/Linux - a small security-enhanced Linux distro for servers
[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Date: Mon, 6 Jul 2015 20:46:12 +0800
From: Lei Zhang <zhanglei.april@...il.com>
To: john-dev@...ts.openwall.com
Subject: Re: tuning OMP_SCALE on MIC (was: Lei's weekly report #7)


> On Jun 24, 2015, at 9:53 AM, Solar Designer <solar@...nwall.com> wrote:
> 
>> dynamic_1023    [577188, 673663, 650376, 672000, 551764]
>> dahua           [21644, 42613, 75956, 136439, 212831]
>> Panama          [1284096, 1146880, 1819648, 2035712, 1872896]
>> skein-256       [1482752, 1631232, 2254848, 2530304, 2923520]
>> skein-512       [1440768, 1711104, 1936384, 2379776, 3183616]
>> HAVAL-256-3     [1345536, 1452032, 1657856, 2137088, 2437120]
>> Tiger           [1288192, 1433600, 1645568, 1949696, 2394112]
>> mdc2            [16717, 26401, 45405, 78721, 133338]
>> Raw-Keccak-256  [1235968, 1449984, 1841152, 2293760, 3083264]
>> HAVAL-128-4     [1486848, 1712128, 2068480, 2915328, 3301376]
>> ripemd-128      [1531904, 1748992, 2014208, 2372608, 2898944]
>> whirlpool       [988752, 1098752, 1144832, 1500160, 1599488]
>> ripemd-160      [1400832, 808941, 1857536, 2558976, 3176448]
>> Snefru-128      [934574, 951920, 1077248, 1479680, 1494016]
>> Raw-Keccak      [1060864, 1133568, 1645568, 1911808, 1969152]
>> has-160         [987089, 1037312, 1164288, 1376256, 1532928]
>> Snefru-256      [918178, 1142784, 1081344, 1432576, 1611776]
>> MD2             [547485, 612705, 735058, 872554, 933647]
>> VNC             [3179520, 4987904, 6769664, 8011776, 8549376]
>> MongoDB         [3656704, 5729280, 7598080, 9051136, 10071040]
>> OpenVMS         [3147776, 4302848, 5317632, 5926912, 6306816]
>> Raw-Blake2      [1141760, 1236992, 1360896, 1832960, 2039808]
> 
> Most of these are fast crap (even if they appear slow at this test).
> 
> Please sanity-check against speeds you obtain on CPU.  And no, I am not
> asking you to post more data in here - I am merely suggesting what
> checks to perform when you work on this.

To get a feeling of what performance to anticipate from MIC, I compared the single-threaded performance of every format between MIC and CPU (my laptop). Listed below are the "relatively" fastest formats and slowest formats on MIC:

Panama          0.025
Oracle12C       0.029
scrypt          0.036
django-scrypt   0.042
Clipperz,       0.051
(...)
mscash2,        0.318
sha1crypt,      0.328
Citrix_NS10,    0.332
xsha,           0.336
Office,         0.354

The numbers on the second column denote <performance on MIC>/<performance on CPU>. At its best, MIC runs about 1/3 as fast as CPU; at its worst, it's only 1/40 as fast. Formats on top of the list are obviously poorly optimized for MIC.


>> tc_whirlpool    [545, 685, 1177, 680, 680]
>> vtp             [464, 922, 1794, 3654, 7112]
>> keyring         [26713, 34285, 42666, 46900, 47627]
> 
> Out of them, tc_whirlpool and vtp show surprisingly low speeds, whereas
> keyring isn't that bad.  (Comparing to speeds seen on CPU.)

For those three formats, the ratios are 0.056, 0.148 and 0.285, respectively. Compared to the highest ratio of 0.354, vtp and keyring are not so bad as they seemed. BTW, MIC's benchmark result in this message is obtained with tuned OMP_SCALEs (not yet in my previous benchmarking).

OTOH, single-thread performance may not reflect scalability, so the relatively fast formats here are not necessarily fast when OMP_NUM_THREADS is increased to 240. But still, I think it's relevant to consider single-threaded performance of MIC. Perhaps I should first investigate those relatively slowest formats first, and then move on down the list.

In case it's useful, I attached the full list.


Lei


Panama	0.025
Oracle12C	0.029
scrypt	0.036
django-scrypt	0.042
Clipperz,	0.051
osc,	0.055
WoWSRP,	0.055
NT-old	0.056
tc_whirlpool,	0.056
whirlpool	0.057
dynamic_100	0.059
dynamic_1030	0.059
Bitcoin	0.067
mssql12,	0.067
wbb3,	0.068
Siemens-S7	0.068
known_hosts,	0.068
dynamic_80	0.069
xsha512,	0.069
HMAC-SHA384	0.070
7z,	0.070
OpenVMS,	0.070
eCryptfs	0.070
Raw-SHA512	0.070
dynamic_70	0.070
tc_aes_xts,	0.070
Drupal7,	0.070
Raw-SHA3	0.071
tc_sha512,	0.071
PBKDF2-HMAC-MD4	0.071
Raw-SHA384	0.071
PBKDF2-HMAC-SHA512,	0.071
SSHA512,	0.071
Fortigate,	0.071
gpg,	0.071
keystore,	0.071
dominosec8,	0.072
EPiServer	0.072
HMAC-SHA512	0.072
PFX,	0.072
o5logon,	0.072
dragonfly3-32,	0.073
dragonfly3-64,	0.073
mysqlna,	0.074
EPI,	0.074
Raw-SHA,	0.074
sha1-gen,	0.075
kwallet,	0.075
sha512crypt,	0.075
rar,	0.076
Raw-Blake2	0.076
openssl-enc,	0.077
pomelo	0.077
Raw-Keccak-256	0.077
Raw-Keccak	0.078
PuTTY,	0.078
Blackberry-ES10	0.078
Mozilla,	0.079
dynamic_15	0.079
dragonfly4-32,	0.079
dragonfly4-64,	0.079
skein-256,	0.080
dynamic_2011	0.080
skein-512,	0.080
aix-ssha512,	0.081
dynamic_2014	0.082
oracle,	0.082
cloudkeychain,	0.082
Raw-SHA512-ng	0.083
dahua,	0.083
VNC	0.083
has-160	0.084
dynamic_1505	0.085
HAVAL-256-3	0.088
mysql,	0.088
nethalflm,	0.088
mdc2,	0.088
dynamic_2010	0.089
RACF	0.089
dynamic_2009	0.089
cq,	0.089
bcrypt	0.090
dynamic_16	0.090
rsvp,	0.091
net-md5,	0.092
Tiger	0.093
dynamic_33	0.094
dynamic_32	0.096
netlm,	0.096
SSH	0.096
HAVAL-128-4	0.096
SSH-ng	0.097
plaintext,	0.097
dynamic_110	0.097
dynamic_22	0.097
KeePass	0.097
md5ns,	0.098
IKE,	0.099
krb5,	0.100
dynamic_39	0.100
krb4,	0.100
dynamic_1401	0.100
PST,	0.101
dynamic_1003	0.101
CRC32	0.101
dynamic_1400	0.102
dynamic_2004	0.102
netntlm,	0.103
dynamic_2003	0.103
crypt,	0.103
MSCHAPv2,	0.104
dynamic_1016	0.105
dynamic_31	0.105
PBKDF2-HMAC-SHA1	0.107
PBKDF2-HMAC-MD5	0.108
dynamic_1022	0.108
dynamic_40	0.108
Raw-SHA1-ng,	0.108
dynamic_2001	0.108
dynamic_2005	0.109
dynamic_2002	0.110
dynamic_1021	0.111
dynamic_1032	0.111
dynamic_1018	0.111
ripemd-128,	0.111
ripemd-160,	0.111
dynamic_1020	0.112
dynamic_150	0.112
net-sha1,	0.112
AFS,	0.113
dynamic_120	0.113
nk,	0.114
dynamic_2008	0.114
dynamic_140	0.114
dynamic_1	0.114
pufferfish,	0.114
tc_ripemd160,	0.115
dynamic_1017	0.115
dynamic_36	0.115
dynamic_30	0.115
dynamic_35	0.116
dynamic_23	0.117
lotus5,	0.117
hMailServer	0.117
krb5pa-md5,	0.118
whirlpool0	0.119
dynamic_25	0.120
dynamic_8	0.120
dynamic_1024	0.120
FormSpring	0.121
dynamic_14	0.121
whirlpool1	0.121
postgres,	0.121
dynamic_1019	0.122
dynamic_1026	0.122
md4-gen,	0.123
oldoffice,	0.123
dynamic_37	0.123
dynamic_1504	0.124
dynamic_10	0.124
dynamic_11	0.124
dominosec,	0.125
MongoDB,	0.125
aix-smd5,	0.125
dynamic_24	0.126
gost,	0.126
dynamic_38	0.126
dynamic_20	0.126
dynamic_1013	0.126
tripcode	0.126
dynamic_1027	0.127
dynamic_2000	0.128
SIP	0.128
pix-md5,	0.129
dynamic_19	0.130
dynamic_130	0.130
dynamic_90	0.130
dynamic_5	0.131
Blockchain,	0.131
dynamic_1031	0.131
dynamic_1025	0.131
dynamic_1023	0.131
Sybase-PROP	0.132
dynamic_61	0.132
tcp-md5,	0.133
eigrp,	0.133
dmd5,	0.134
dynamic_1008	0.134
asa-md5,	0.134
skey,	0.135
dynamic_1300	0.135
dynamic_13	0.135
dynamic_12	0.135
dynamic_1028	0.135
dynamic_1014	0.135
dynamic_9	0.136
dynamic_29	0.136
dynamic_18	0.136
dynamic_1029	0.137
hsrp,	0.137
PDF	0.137
MediaWiki	0.137
chap,	0.138
mscash,	0.138
dynamic_4	0.139
hdaa,	0.140
dynamic_1588	0.140
dynamic_2006	0.140
netntlmv2,	0.141
descrypt,	0.142
dynamic_26	0.143
RAdmin,	0.144
po,	0.144
dynamic_34	0.145
vtp,	0.148
dynamic_1501	0.148
netlmv2,	0.149
dynamic_1350	0.150
dynamic_1506	0.150
dynamic_50	0.150
dynamic_1009	0.151
dynamic_60	0.151
bsdicrypt,	0.152
LM	0.155
NT	0.155
Raw-MD4	0.157
sapb,	0.157
dynamic_1502	0.160
dynamic_1012	0.161
bfegg,	0.162
dynamic_1015	0.163
sapg,	0.165
dynamic_1001	0.165
dynamic_1004	0.166
dynamic_1002	0.168
dynamic_1010	0.168
dynamic_3	0.171
dynamic_1005	0.173
dynamic_2	0.174
dynamic_1011	0.175
dynamic_1006	0.179
dynamic_0	0.186
dynamic_6	0.189
oracle11,	0.190
PHPS2	0.194
Raw-SHA256-ng	0.194
dynamic=	0.196
PHPS	0.197
dummy	0.202
dmg,	0.204
lotus85,	0.205
sha256crypt,	0.205
LastPass,	0.206
dynamic_1503	0.207
dynamic_1007	0.208
aix-ssha256,	0.209
Raw-MD5	0.210
Raw-MD5u	0.210
PKZIP	0.210
lp,	0.214
sxc,	0.217
Raw-SHA256	0.218
PBKDF2-HMAC-SHA256	0.218
ODF	0.218
Snefru-128	0.219
RAR5	0.219
Snefru-256	0.223
Salted-SHA1	0.229
netntlm-naive,	0.232
Raw-SHA224	0.232
mschapv2-naive,	0.234
LUKS	0.238
aix-ssha1,	0.239
SybaseASE,	0.241
Raw-SHA1	0.245
saph,	0.246
SunMD5	0.246
OpenBSD-SoftRAID	0.248
Raw-SHA1-Linkedin	0.249
Django	0.252
krb5pa-sha1,	0.254
HMAC-SHA224	0.254
ZIP,	0.255
krb5-18,	0.256
STRIP,	0.256
fde,	0.257
EncFS	0.258
HMAC-SHA256	0.261
nsldap,	0.261
pwsafe,	0.264
keychain,	0.270
mssql,	0.278
mssql05,	0.280
mysql-sha1,	0.284
keyring,	0.285
md5crypt,	0.294
phpass	0.298
agilekeychain,	0.298
HMAC-MD5	0.299
HMAC-SHA1	0.306
EFS	0.310
dynamic_17	0.310
wpapsk,	0.313
ipb2,	0.316
RAKP,	0.317
MD2	0.317
mscash2,	0.318
sha1crypt,	0.328
Citrix_NS10,	0.332
xsha,	0.336
Office,	0.354



Powered by blists - more mailing lists

Your e-mail address:

Powered by Openwall GNU/*/Linux - Powered by OpenVZ