Date: Sat, 18 Aug 2012 10:57:51 +0400 From: Solar Designer <solar@...nwall.com> To: john-users@...ts.openwall.com Subject: Re: Passphrase Creation Hi Kevin, Thank you for posting, as well as for being with us for the contest. What hash types did you test this on in the contest? On Fri, Aug 17, 2012 at 10:04:35AM -0600, Kevin Young wrote: > I also create a no-space version at the same time. (Is there a mangling > rule that can handle this?) Yes. It's either: @?w or: @ : depending on whether you want to remove all whitespace characters (both space and tabs) or just the space character. In the latter rule, the colon (a no-op command) prevents the would-be trailing space from being inadvertently removed when editing the conf file. > Step 6. Optimize and reduce > As expected there are lot of duplicates so my script performs a dictionary > sort and filters out the duplicates (sort and uniq). I also filter out > (grep) things like open source verbiage, distribution notices, credits, etc. FWIW, the "unique" program included with JtR is generally a lot faster than "sort -u" (or "sort | uniq"), but you may need to tune its memory usage (set it to the max of 2 GB with "-mem=25" in jumbo if you can afford that - which I guess you can given modern computers' RAM sizes). Of course, the result is different (not sorted), which may be good or bad depending on your input data and your needs. GNU sort may also be made a lot faster by letting it use more memory, e.g. "sort -S 14G" works well for me on a 16 GB RAM machine (and at this setting it may even outperform our "unique", which is limited to 2 GB, as long as the input is large enough). Alexander
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.