Date: Sun, 29 May 2011 12:14:02 -0500 From: "JFoug" <jfoug@....net> To: <john-dev@...ts.openwall.com> Subject: Re: John 1.7.7-jumbo-5 ----- Original Message ----- From: "Solar Designer" <solar@...nwall.com> To: <john-dev@...ts.openwall.com> Sent: Sunday, May 29, 2011 4:42 AM Subject: Re: [john-dev] John 1.7.7-jumbo-5 > One of these should be suitable for > posting to john-users and announce lists. Openwall release (may need touched up, but contains description of all changes in the patch file) Changes from 1.7.7-jumbo-1 to 1.7.7-jumbo-5 Even though this update is heavily loaded new functionality/enhancements, it should also hopefully prove over time to be a stable release as well. Intrinsic SSE code incorporated into the jumbo. Numerous formats patched (Listed below), and sse-intrinsics.c/.h files added (Simon) -utf8 (UTF-8 or full 16 bit Unicode) support, in several formats, and with rules support and other infrastructure support. Support code now all in unicode.c/h removed file smbencrypt.c (older support code) (magnum) MPI/OMP code and support added (magnum) Structural changes to fmt_main, including new prepare function (and changes to init and valid). prepare() allows format's to control format line morphing, which before was hacked into loader.c. These changes touched the source for every format file, and they will not be listed separately. (JimF) Changes to md5_gen so it appears as multiple individual formats, and not a format that morphs, required the fmt_main changes. Also all of the md5_gen specific code stripped out of formats.c and bench.c as that code is not needed any more. (JimF). md5_gen back and forth from X86 to MMX code (allows formats which used to not work no SSE builds to be used on them now) (JimF). md5_gen Added limited support for SHA1 hashing, uppercase, lowercase, ios-8859-1 to UTF-8 support, 'username', and support for any multiple salts, or any other GECOS field(s) (JimF). md5_gen Added new built-in formats (md5_gen(18) to md5_gen(28)). These include PO, PIX, salted PIX, HDAA, some SHA stuff, FreeBSD/Apache MD5 (JimF) md5_gen changed 'thin' format linking, thus had to update PHPS, PHPass, and raw-md5 to use the new methods (JimF). timer.c/.h added for portable high res timing 'class' used in some testing code for md5_gen. However, this code can be used in other parts of john. (JimF) Speed improvement for md5_gen for non-MMX/SSE builds. Now using MD5 and X2 MD5 from md5_std.c (JimF) New formats: mskrb5 (magnum), rawMD5unicode (magnum), salted_sha1 (Simon ???, this one is nsldaps, but using SSE2i). Enhancements to Markov engine, adding minlevel and minlen (Simon ???) ETA now working for -incremental runs. (magnum) format 'listing' in options.c now done dynamically (magnum) -mem-file-size=0 will load any sized wordfile into memory. Also -mem-file-size=1 or =2 for special MPI usage (magnum). New options (-inp=fname, -ex_file=fname, -ex_file_only=fname and -mem=num) added to unique program, for usability and performance (JimF). Removed DOS line endings from DMD5 source file (JimF) Increased max password length of HDAA from 16 to 32, and changed some #defines for STDC (JimF/magnum) Increased max password length of Netscreen from 15 to 25. (JimF) Increased max password length of mssql05/mssql from 20 to 25. (JimF) Fixed bug in mssql/mssql05 MMX/SSE2 builds crypt_all() function, which caused them to not work for more than 1 salt, even though they passed self test (JimF) In several formats, switch from malloc, to mem_alloc_tiny (JimF) prepare() in LM_fmt.c to handle pwdump format (was in loader.c) (JimF) SSE intrinsic added to md5_fmt.c, and got intrinsic working for both $1$ and $aprl$ (Simon / JimF) SSE intrisics also added to raw-md4, raw-sha1, and raw-md5 (through thin format to md5_gen(0)). Intrinsics also used in other formats (Simon). code moved from loader.c into 'prepare()' for: LM, NT, oracle, md5_gen, mscash2, mssql05, MSCHAPv2, NETLM, NETLMv2, NETNTLM, NETNTLMv2, NETHALFLM (JimF) utf8 support added to: MSCHAPv2, NETLMv2m NETNTLM, NETNTLMv2, NT, mscash, mscashv2, mskrb5. mssql, mssql05, oracle, sapG (magnum) OMP support added to: MSCHAPv2, NETHALFLM, NETLM, NETLMv2, NETNTLM, NETNTLMv2, bench.c (magnum) Fixed REQ_ALIGN crash problems in: HDAA, MSCHAPv2, NETLM, NETLMv2, NETNTLM, NETNTLMv2, NSLDAPS, NSLDAP, OPENLDAPS, mscash, mscashv2, mssql, mssql05, oracle, raw-md4 Note, some crash problems existed in Jumbo-1, and some were needed due to J1->J5 performance changes, and -utf8 support. (JimF) Changed NT's asm code (x86_sse.S) to properly work with UTF-8. (Alain Espinosa ????) Fixed compile problem in bench.c for Solaris (Solar) Additional information added to self-tests (helps in debugging) (magnum). Markov code, added minlevel and minlen. Bumped level=0 from 350 to 400 (Simon) hmac_md5 code sped up (but this turned up several REQ_ALIGNMENT issues that had to be addressed). (magnum) make check now working again (was broken in john.c). Also works for Win32 builds (JimF). loader.c stripped down, and code moved into proper format's prepare() function (JimF). -nolog option added (keeps data from being written to john.log file) (JimF) Made changes to md5_mmx.S/md5.h sha1_mmx.S/sha1.h so that the object files build by MinGW can be used by M$ Visual C. (JimF) changes to md5_go.c, added a MD5_Go2() function where the output buffer space is passed in (JimF) Added 'cleanup' code to mem_alloc_tiny() calls, allowing better checking for leaked memory at program exit (JimF) Added 'common' memory image dumping functions, for flat and for MMX buffers (magnum) Created a new shammx_nofinalbyteswap function that leaves result in LE format. (JimF) mysqlSHA1, reduced memset, and improved speed 10-15% Use new shammx_nofinalbyteswap function, and skip swap and unswap (2-3% speed increase) (JimF) raw-md5 converted to a 'thin' md5_gen format (Simon) Added new rules for is binary, and reject if (if not) -utf8 used. Changes made to x86-64.h (and some 32 bit arch.h files), so that different compilers would get different SSE_PARA values. Better tuning ability. May still need a little work, as values chosen were done so based upon assumptions from prior email discussions and not physical testing. (JimF). Created a new x86-sse2i.h to allow intrinsics to be used with 32 bit compilers, while still leaving the 32 bit .S SSE2 code working. This is more for testing, since most 32 bit builds are much slower with intrinsic vs .S builds (JimF).
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.