Follow @Openwall on Twitter for new release announcements and other news
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date: Thu, 26 May 2011 15:42:01 +0200
From: magnum <rawsmooth@...dband.net>
To: john-dev@...ts.openwall.com
Subject: Re: SSE bug still there in Jumbo-5-RC6++

I tried 33*MMX_COEF using a tailored test file with length 32 among 
shorter, seems to work fine.

magnum

On 2011-05-26 15:22, magnum wrote:
> That's a good cause, but your patch fails selftest for me. Something
> must be wrong about it. Maybe I should debug it (since you don't see the
> problem)?
>
> Wouldn't 33*MMX_COEF be enough?
>
> magnum
>
>
> On 2011-05-26 15:10, JimF wrote:
>> The patch was due to the password length being 32 bytes, and the 0x80
>> being stored in the buffer also. It will only show up if cracking a 32
>> byte password (there are non in the test suite, yet. If we go back to 32
>> byte memcpy, then we should set max password length to 31 bytes (so the
>> 0x80 'fits') in the dword contained in the first 32.
>>
>> One thing that should be added to the test suite input files is another
>> 20 candidates (sprinkled through the file), that are the MAX size of the
>> password allowed for the format (removing 20 other's or simply going to
>> 1340). Also, we need to add some words to pw.dic that are LONG
>> passwords, longer than any format can handle, and again spread
>> throughout the file. Those longer PW'd will hopefully smoke out
>> overwrite issues. The one where we have the most likelyhood of
>> overwrites is in md5-gen, since there is no easy way to set a max sized
>> input password.
>>
>> Jim.
>>
>> ----- Original Message ----- From: "magnum" <rawsmooth@...dband.net>
>> To: <john-dev@...ts.openwall.com>
>> Sent: Thursday, May 26, 2011 5:37 AM
>> Subject: Re: [john-dev] SSE bug still there in Jumbo-5-RC6++
>>
>>
>>> Erik, Jim,
>>>
>>> Please try the attached rawMD5unicode_fmt.c
>>>
>>> It solves ALL problems for me on x86-64, x86-sse2 and x86-mmx and the
>>> OpenLDAPS can be enabled again. Everything passes self tests and test
>>> suite. It also speed things up as I dropped saved_plain completely and
>>> rebuild it from the key buffer instead.
>>>
>>> However, I must also revert the following hunk in Jim's latest SSE2
>>> patch in order to get NSLDAP going:
>>>
>>> --- john-1.7.7-jumbo-5-RC6/src/NSLDAP_fmt.c 2011-05-23
>>> 18:51:00.000000000 +0000
>>> +++ john-1.7.7-jumbo-5/src/NSLDAP_fmt.c 2011-05-24 05:20:43.625000000
>>> +0000
>>> @@ -225,7 +225,8 @@ static int cmp_one(void * binary, int in
>>> static void
>>> crypt_all(int count) {
>>> #ifdef MMX_COEF
>>> - memcpy(buffer, saved_key, 32*MMX_COEF);
>>> + // 32 byte password (max), plus the 0x80. We need to copy 36*MMXCOEF
>>> to make sure we get it all.
>>> + memcpy(buffer, saved_key, 36*MMX_COEF);
>>> shammx((unsigned char *) crypt_key, buffer, total_len);
>>> #else
>>> static SHA_CTX ctx;
>>>
>>>
>>> Jim, was that really a correct patch? I get 1320 found on all platforms
>>> without that and self test fail with it.
>>>
>>> magnum
>>>
>>>
>>> On 2011-05-26 05:45, JFoug wrote:
>>>> I get a crash on OpenLDAPS. Same type. Only MMX/SSE builds (from
>>>> cygwin/mingw). It also only crashes on -test not on -test
>>>> -format=openssha The format_init has been commented out in john.c for a
>>>> couple of releases, but this is the same type of bug, and really needs
>>>> to be found.
>>>>
>>>> Jim.
>>>>
>>>> ----- Original Message ----- From: "Erik Winkler" <ewinkler@...ls.com>
>>>> To: <john-dev@...ts.openwall.com>
>>>> Sent: Wednesday, May 25, 2011 10:00 AM
>>>> Subject: Re: [john-dev] SSE bug still there in Jumbo-5-RC6++
>>>>
>>>>
>>>> Jumbo-5-RC6++ works great on MacOS X for 64-bit build. No issues.
>>>>
>>>> On MacOS X using the sse2 build, I get the following error for NSLDAP
>>>> benchmarking:
>>>>
>>>> Benchmarking: Netscape LDAP SHA SSE2 [SHA-1]... FAILED (get_hash[0](3))
>>>>
>>>> Now this only occurs when running ./john -test. If I run ./john -test
>>>> -format:nsldap, it works correctly:
>>>>
>>>> ../run/john -test -format:nsldap
>>>> Benchmarking: Netscape LDAP SHA SSE2 [SHA-1]... DONE
>>>> Raw: 7837K c/s real, 7837K c/s virtual
>>>>
>>>> Not sure why.
>>>>
>>>> Erik
>>>>
>>>> On May 24, 2011, at 1:58 PM, magnum wrote:
>>>>
>>>>> Even after applying all incremental patches posted to the wiki, there
>>>>> are some problems left in Jumbo-5-RC6:
>>>>>
>>>>> 1. Raw-MD4 segfaults for me on linux-x86-sse2:
>>>>> * Using linux-x86-mmx I saw no problem.
>>>>> * It segfaults when running "--test"
>>>>> * It does NOT segfault when running eg. "--test --fo:raw-MD4"
>>>>> * Test suit does NOT segfault and all 1320 is found
>>>>>
>>>>> This led me to believe the problem was in the format running right
>>>>> before raw-MD4 on a --test run, namely salted-sha1. I did find a bug
>>>>> in that format (fix included in patch just posted) but that was not
>>>>> the cause of this.
>>>>>
>>>>> 2. NSLDAP has a problem on linux-x86-sse2 and linux-x86-mmx:
>>>>> Benchmarking: Netscape LDAP SHA MMX [SHA-1]... FAILED (get_hash[0](1))
>>>>>
>>>>> I have no time to investigate further right now.
>>>>>
>>>>> magnum
>>>>
>>>
>>>
>>
>

Powered by blists - more mailing lists

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.