Date: Thu, 10 Sep 2020 14:52:42 +0200 From: magnum <john.magnum@...hmail.com> To: john-users@...ts.openwall.com Subject: Re: rar-opencl performance On 2020-09-08 00:22, Axymeus wrote: > Is this what you're looking for? Sorry it's in french... > > Type: Fichier > Taille: 271933564 > Taille compressée: 268645888 > Taux: 98% > mtime: 2014-01-29 23:49:28,964786900 > Attributs: ..A.... > CRC32: CF45F153 > Système d'exploitation hôte: Windows > Compression: RAR 3.0(v29) -m3 -md=4M > Drapeaux: chiffré So it's not a "stored" file but compressed. This means you should get proper early rejection and the problem is simply your file is so large (rar2john will pick the smallest possible file from each archive). Even with few false candidates *not* getting rejected early, the CPU post-processing take so long it hits overall performance as we need a full decompress of all 300 MB (per candidate, picture that) in order to see the false CRC and finally reject them. I did some testing: Created a 3 KB file, a 3 MB file and a 300 MB one, all from /dev/urandom data, and rar'ed them with password. This on a 4-core, 8-thread Intel CPU and nvidia 2080ti: John Jumbo 30-sec run at length 8: 3 KB: 40K p/s, util ~ 77%, end temp 51C 3 MB: 27K p/s, util ~ 60%, end temp 46C 300 MB: 2.9K p/s, util most often 0% seen, best 41%, end temp 40C Even the 3 KB one did not show any utilization from JtR status line, I repeatedly ran nvidia-smi during run to get figures. I got (much) worse performance from cRARk 5.5 for all sizes, not quite sure I used it properly. Admittedly I used the OpenCL version and not the CUDA one. There is one thing we could try to get a little better performance: Moving the early rejection Huffman checks to GPU. I'm not sure it will fly but it I think it could do some good. Even so, the worst case false candidates will always hit us hard. https://github.com/openwall/john/issues/4269 magnum > On Tue, Sep 8, 2020 at 12:00 AM magnum <john.magnum@...hmail.com> wrote: >> >> On 2020-09-07 17:37, Axymeus wrote: >>> On Sat, Sep 5, 2020 at 9:17 PM magnum <john.magnum@...hmail.com> wrote: >>>> Axymeus, please post the result of "unrar vt <archive name>". My guess >>>> is this is a very large "stored" file. I believe cRARk will process >>>> such files fully on GPU if possible, while we will not - as of now. We >>>> could definitely implement that, I just never considered it worthwhile >>>> because it's so uncommon. >>> >>> Can't find unrar, not even within cygwin, where should I get it? >>> The archive does contain a single large file (~300 MB) >> >> So use "rar vt <archive name>", it's the same thing. >> >> magnum >> >
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.