|
Date: Wed, 5 Jun 2013 22:08:09 -0700 From: Martin Leon <martinrleon@...oo.com> To: john-users@...ts.openwall.com Subject: Re: Problems using -opencl formats with bleeding-jumbo build Given that I now know several formats that DO work with OpenCL on my MacBook, is there a way to convert a wpapsk hash to one of the other formats that I can use OpenCL with? On Jun 5, 2013, at 10:05 PM, Martin Leon wrote: > I finally had time to do some more investigation into my problem and made following findings. > > Thanks to magnum for instructing me to run tests from the src directory, this eliminated the problem with 'header file not found'. > > The following formats work, i.e. they do not crash and the test completes: > > ssha-opencl nt-opencl agilekeychain-opencl cisco4-opencl dmg-opencl gpg-opencl keychain-opencl mysql-sha1-opencl odf-opencl odf-aes-opencl phpass-opencl pwsafe-opencl raw-md4-opencl raw-md5-opencl raw-sha1-opencl raw-sha256-opencl strip-opencl sxc-opencl zip-opencl bcrypt-opencl > > The following formats ran too slow for me to wait and see the outcome, not sure if they succeed or fail, but they do NOT crash the computer: > > md5crypt-opencl sha256crypt-opencl encfs-opencl rar-opencl > > The following formats fail but do NOT crash the computer: > > office2007-opencl office2010-opencl office2013-opencl raw-sha512-opencl raw-sha512-ng-opencl sha512crypt-opencl xsha512-opencl xsha512-ng-opencl > > *** TESTING descrypt-opencl *** > OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) > > Benchmarking: office2007-opencl, Office 2007 SHA-1 AES (50,000 iterations) [OpenCL]... FAILED (cmp_all(1)) > Benchmarking: office2010-opencl, Office 2010 SHA-1 AES (100,000 iterations) [OpenCL]... FAILED (cmp_all(1)) > Benchmarking: office2013-opencl, Office 2013 SHA-512 AES (100,000 iterations) [OpenCL]... FAILED (cmp_all(1)) > Benchmarking: raw-sha512-opencl, Raw SHA-512 [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0)) > Benchmarking: raw-sha512-ng-opencl, Raw SHA-512 (pwlen < 55) [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0)) > Benchmarking: xsha512-opencl, Mac OS X 10.7+ salted SHA-512 [OpenCL (efficient at "many salts" only)]... FAILED (get_hash[0](0)) > Benchmarking: xsha512-ng-opencl, Mac OS X 10.7+ salted SHA-512 (pwlen < 55) [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[1](0)) > Benchmarking: sha512crypt-opencl, sha512crypt (rounds=5000) [OpenCL]... FAILED (get_hash[0](0)) > > This was the only format that didn't produce any output but didn't crash the computer, had to kill the process: > > mscash2-opencl > > The following formats cause the hard crashes that require power button shut down: > > ntlmv2-opencl krb5pa-sha1-opencl wpapsk-opencl > > After restarting my computer, I observed the following messages occurred just prior to the crashes: > > FROM SYSTEM.LOG > > Jun 5 13:47:45 mymac com.apple.kextcache[491]: Created prelinked kernel /System/Library/Caches/com.apple.kext.caches/Startup/kernelcache. > Jun 5 13:47:46 mymac com.apple.launchctl.Background[573]: launchctl: Dubious ownership on file (skipping): /Library/LaunchAgents/com.realtek.wutility > Jun 5 13:48:12 mymac mdworker32[567]: kCGErrorFailure: Set a breakpoint @ CGErrorBreakpoint() to catch errors as they are logged. > > FROM KERNEL.LOG > > Jun 5 13:47:44 mymac kernel[0]: ** Device in slot: SLOT--1 ** > Jun 5 13:47:44 mymac kernel[0]: ** GPU Debug Info Start ** > Jun 5 13:47:44 mymac kernel[0]: 0x00006741 > Jun 5 13:47:44 mymac kernel[0]: 0x00000091 > Jun 5 13:47:44 mymac kernel[0]: 0x00000001 > Jun 5 13:47:44 mymac kernel[0]: 0x00000018 > Jun 5 13:47:44 mymac kernel[0]: 0x0000b080 > Jun 5 13:47:44 mymac kernel[0]: 0x00000001 > ....... > > > On Jun 2, 2013, at 1:17 PM, Martin wrote: > >> I am trying to see if using OpenCL will improve performance on my MacBook Pro. >> >> I build using the .macosx-x86-64-opencl target and I was initially getting a hard system hang, had to power down the laptop using the power button. >> >> Well, it's not hanging at this point. Not sure exactly why. It could be a conflict with something else that was running or maybe because I installed gfxCardStatus (http://gfx.io/) based on the discussion on issue 50 (https://github.com/magnumripper/JohnTheRipper/issues/50). >> >> Now with gfxCardStatus set to 'Discrete only' mode I get the errors below. The system did not hang, but the 'john' process became non-responsive when testing mscash2-opencl. Activity Monitor showed the process was alive and showed the following resources were open. I was able to kill the process and the test continued with the remaining formats. >> >> As you can see, it was able to test OpenCL for 5 of the formats (ssha-opencl, nt-opencl, phpass-opencl, raw-sha512-opencl and xsha512-opencl), but not the rest. So it looks to me like OpenCL is working, but something appears to be missing for specific formats. >> >> Can anyone help with getting OpenCL working on my MacBook Pro for the other formats? They all appear to have the same error. >> >> >> --- JOHN PROCESS STALLED WHEN TESTING mscash2-opencl ---- >> >> /shared/JohnTheRipper-bleeding-jumbo-with-pro-wordlist/run >> /shared/JohnTheRipper-bleeding-jumbo-with-pro-wordlist/run/john >> /System/Library/Frameworks/OpenCL.framework/Versions/A/Libraries/libcldcpuengine.dylib >> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib >> /System/Library/Extensions/ATIRadeonX3000GLDriver.bundle/Contents/MacOS/ATIRadeonX3000GLDriver >> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLProgrammability.dylib >> /System/Library/PrivateFrameworks/GPUSupport.framework/Versions/A/Libraries/libGPUSupport.dylib >> /System/Library/Frameworks/OpenGL.framework/Versions/A/Resources/GLRendererFloat.bundle/GLRendererFloat >> /private/var/folders/k9/jwhz00wj2vjd4jng8147zlz80000gp/C/com.apple.LaunchServices-034502.csstore >> /System/Library/Extensions/AppleIntelHD3000GraphicsGLDriver.bundle/Contents/MacOS/AppleIntelHD3000GraphicsGLDriver >> /usr/lib/dyld >> /private/var/db/dyld/dyld_shared_cache_x86_64 >> /dev/ttys007 >> /dev/ttys007 >> /dev/ttys007 >> count=1, state=0x2 >> >> --- TESTING ALL -OPENCL FORMATS ---- >> >> for f in ssha-opencl nt-opencl ntlmv2-opencl agilekeychain-opencl cisco4-opencl md5crypt-opencl sha256crypt-opencl sha512crypt-opencl dmg-opencl encfs-opencl gpg-opencl keychain-opencl krb5pa-sha1-opencl mscash2-opencl mysql-sha1-opencl odf-opencl odf-aes-opencl office2007-opencl office2010-opencl office2013-opencl phpass-opencl pwsafe-opencl rar-opencl raw-md4-opencl raw-md5-opencl raw-sha1-opencl raw-sha256-opencl raw-sha512-opencl raw-sha512-ng-opencl strip-opencl sxc-opencl wpapsk-opencl xsha512-opencl xsha512-ng-opencl zip-opencl bcrypt-opencl descrypt-opencl; do echo "*** TESTING $f ***"; ./john --test --format=$f; done >> >> *** TESTING ssha-opencl *** >> Device 1: ATI Radeon HD 6750M >> Local worksize (LWS) 128, Global worksize (GWS) 4194304 >> Benchmarking: ssha-opencl, Netscape LDAP salted SHA-1 [OpenCL (inefficient, development use mostly)]... DONE >> Many salts: 30783K c/s real, 335544K c/s virtual >> Only one salt: 25982K c/s real, 146800K c/s virtual >> >> *** TESTING nt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Local worksize (LWS) 64, Global worksize (GWS) 524288 >> Benchmarking: nt-opencl, NT MD4 [OpenCL (inefficient, development use only)]... DONE >> Raw: 19206K c/s real, 39589K c/s virtual >> >> *** TESTING ntlmv2-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:13:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING agilekeychain-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING cisco4-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:17:10: fatal error: 'opencl_rawsha256.h' file not found >> #include "opencl_rawsha256.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING md5crypt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:12:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING sha256crypt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:17:10: fatal error: 'opencl_cryptsha256.h' file not found >> #include "opencl_cryptsha256.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING sha512crypt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:17:10: fatal error: 'opencl_cryptsha512.h' file not found >> #include "opencl_cryptsha512.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING dmg-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING encfs-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING gpg-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:33:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING keychain-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING krb5pa-sha1-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:13:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING mscash2-opencl *** >> Device 1: ATI Radeon HD 6750M >> Session aborted >> *** TESTING mysql-sha1-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING odf-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING odf-aes-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING office2007-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:16:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING office2010-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:14:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING office2013-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:15:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING phpass-opencl *** >> Device 1: ATI Radeon HD 6750M >> Local worksize (LWS) 64, Global worksize (GWS) 24576 >> Benchmarking: phpass-opencl, phpass MD5 ($P$9 lengths 0 to 15) [OpenCL]... DONE >> Raw: 304818 c/s real, 7864K c/s virtual >> >> *** TESTING pwsafe-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:9:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING rar-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:22:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING raw-md4-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:18:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING raw-md5-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:18:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING raw-sha1-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING raw-sha256-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:17:10: fatal error: 'opencl_rawsha256.h' file not found >> #include "opencl_rawsha256.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING raw-sha512-opencl *** >> Device 1: ATI Radeon HD 6750M >> Local worksize (LWS) 64, Global worksize (GWS) 524288 >> Benchmarking: raw-sha512-opencl, Raw SHA-512 [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0)) >> >> *** TESTING raw-sha512-ng-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:18:10: fatal error: 'opencl_rawsha512-ng.h' file not found >> #include "opencl_rawsha512-ng.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING strip-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING sxc-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING wpapsk-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:11:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING xsha512-opencl *** >> Device 1: ATI Radeon HD 6750M >> Local worksize (LWS) 64, Global worksize (GWS) 524288 >> Benchmarking: xsha512-opencl, Mac OS X 10.7+ salted SHA-512 [OpenCL (efficient at "many salts" only)]... FAILED (get_hash[0](0)) >> >> *** TESTING xsha512-ng-opencl *** >> Device 1: ATI Radeon HD 6750M >> Building the kernel, this could take a while >> Build log: <program source>:18:10: fatal error: 'opencl_rawsha512-ng.h' file not found >> #include "opencl_rawsha512-ng.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING zip-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found >> #include "opencl_device_info.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING bcrypt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:10:10: fatal error: 'opencl_bf_WGS.h' file not found >> #include "opencl_bf_WGS.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> *** TESTING descrypt-opencl *** >> Device 1: ATI Radeon HD 6750M >> Build log: <program source>:60:10: fatal error: 'opencl_DES_WGS.h' file not found >> #include "opencl_DES_WGS.h" >> ^ >> >> Error -11 building kernel. DEVICE_INFO=1090 >> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.) >> >
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.