Follow @Openwall on Twitter for new release announcements and other news
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-Id: <756282BB-38A4-48E1-BFA2-DC52DB58AB63@gmail.com>
Date: Wed, 18 Mar 2015 17:27:45 +0800
From: Lei Zhang <zhanglei.april@...il.com>
To: john-dev@...ts.openwall.com
Subject: Re: [GSoC] building JtR for MIC

Hi,

I tweaked with OMP_SCALE in several formats, according to magnum's advices, and their memory usage on MIC is much more reasonable now. With OpenMP enabled, john-jumbo won't abort anymore when running the benchmark, although 126 of the tests still FAILED.

Next I want to figure out how those tests failed, but I have a few questions first: (forgive me if they look stupid...)
1. What exactly does it mean for a format to FAIL the test?
2. There're two kind of numbers in the output, real and virtual. What's their difference?


Thanks,
Lei


> On Mar 18, 2015, at 12:22 AM, magnum <john.magnum@...hmail.com> wrote:
> 
> On 2015-03-17 10:38, Lei Zhang wrote:
>> I reran the benchmarks on MIC, with or without OpenMP, and got some statistics.
>> 
>> *With OpenMP:*
>> The result is a bit different from last time. The program didn't get killed when 
>> running /mschapv2-naive/, but aborted later when running /mysql/, with error 
>> message: *****mem_alloc(): Cannot allocate memory trying to allocate 5190451200 
>> bytes*****
> 
> Wow that's pretty heavy for a single allocation. Note the following
> lines in mysql_fmt_plug.c:
> 
> #define OMP_SCALE			81920
> (...)
> #define MAX_KEYS_PER_CRYPT		8
> 
> This is your problem. You will ending up allocating 81920*8*240*33 bytes
> for the plaintext buffer (btw the "33" is [PLAINTEXT_LENGTH + 1]).
> 
> So this OMP_SCALE is obviously not suitable for MIC. Try something like this
> 
> + #ifdef __MIC__
> + #define OMP_SCALE			128
> + #else
>   #define OMP_SCALE			81920
> + endif
> 
> Then you may tweak it by doubling it until it doesn't get faster (or
> just gets silly high).
> 
> Nearly all OpenMP formats use this exact scheme so you can fix most
> formats the same way. I'm pretty sure the NETLM* and NETNTLM* formats
> are just as bad or worse.
> 
> magnum
> 
> 

Powered by blists - more mailing lists

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.