[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date: Wed, 5 Jun 2013 22:05:22 -0700
From: Martin Leon <martinrleon@...oo.com>
To: john-users@...ts.openwall.com
Subject: Re: Problems using -opencl formats with bleeding-jumbo build
I finally had time to do some more investigation into my problem and made following findings.
Thanks to magnum for instructing me to run tests from the src directory, this eliminated the problem with 'header file not found'.
The following formats work, i.e. they do not crash and the test completes:
ssha-opencl nt-opencl agilekeychain-opencl cisco4-opencl dmg-opencl gpg-opencl keychain-opencl mysql-sha1-opencl odf-opencl odf-aes-opencl phpass-opencl pwsafe-opencl raw-md4-opencl raw-md5-opencl raw-sha1-opencl raw-sha256-opencl strip-opencl sxc-opencl zip-opencl bcrypt-opencl
The following formats ran too slow for me to wait and see the outcome, not sure if they succeed or fail, but they do NOT crash the computer:
md5crypt-opencl sha256crypt-opencl encfs-opencl rar-opencl
The following formats fail but do NOT crash the computer:
office2007-opencl office2010-opencl office2013-opencl raw-sha512-opencl raw-sha512-ng-opencl sha512crypt-opencl xsha512-opencl xsha512-ng-opencl
*** TESTING descrypt-opencl ***
OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
Benchmarking: office2007-opencl, Office 2007 SHA-1 AES (50,000 iterations) [OpenCL]... FAILED (cmp_all(1))
Benchmarking: office2010-opencl, Office 2010 SHA-1 AES (100,000 iterations) [OpenCL]... FAILED (cmp_all(1))
Benchmarking: office2013-opencl, Office 2013 SHA-512 AES (100,000 iterations) [OpenCL]... FAILED (cmp_all(1))
Benchmarking: raw-sha512-opencl, Raw SHA-512 [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0))
Benchmarking: raw-sha512-ng-opencl, Raw SHA-512 (pwlen < 55) [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0))
Benchmarking: xsha512-opencl, Mac OS X 10.7+ salted SHA-512 [OpenCL (efficient at "many salts" only)]... FAILED (get_hash[0](0))
Benchmarking: xsha512-ng-opencl, Mac OS X 10.7+ salted SHA-512 (pwlen < 55) [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[1](0))
Benchmarking: sha512crypt-opencl, sha512crypt (rounds=5000) [OpenCL]... FAILED (get_hash[0](0))
This was the only format that didn't produce any output but didn't crash the computer, had to kill the process:
mscash2-opencl
The following formats cause the hard crashes that require power button shut down:
ntlmv2-opencl krb5pa-sha1-opencl wpapsk-opencl
After restarting my computer, I observed the following messages occurred just prior to the crashes:
FROM SYSTEM.LOG
Jun 5 13:47:45 mymac com.apple.kextcache[491]: Created prelinked kernel /System/Library/Caches/com.apple.kext.caches/Startup/kernelcache.
Jun 5 13:47:46 mymac com.apple.launchctl.Background[573]: launchctl: Dubious ownership on file (skipping): /Library/LaunchAgents/com.realtek.wutility
Jun 5 13:48:12 mymac mdworker32[567]: kCGErrorFailure: Set a breakpoint @ CGErrorBreakpoint() to catch errors as they are logged.
FROM KERNEL.LOG
Jun 5 13:47:44 mymac kernel[0]: ** Device in slot: SLOT--1 **
Jun 5 13:47:44 mymac kernel[0]: ** GPU Debug Info Start **
Jun 5 13:47:44 mymac kernel[0]: 0x00006741
Jun 5 13:47:44 mymac kernel[0]: 0x00000091
Jun 5 13:47:44 mymac kernel[0]: 0x00000001
Jun 5 13:47:44 mymac kernel[0]: 0x00000018
Jun 5 13:47:44 mymac kernel[0]: 0x0000b080
Jun 5 13:47:44 mymac kernel[0]: 0x00000001
.......
On Jun 2, 2013, at 1:17 PM, Martin wrote:
> I am trying to see if using OpenCL will improve performance on my MacBook Pro.
>
> I build using the .macosx-x86-64-opencl target and I was initially getting a hard system hang, had to power down the laptop using the power button.
>
> Well, it's not hanging at this point. Not sure exactly why. It could be a conflict with something else that was running or maybe because I installed gfxCardStatus (http://gfx.io/) based on the discussion on issue 50 (https://github.com/magnumripper/JohnTheRipper/issues/50).
>
> Now with gfxCardStatus set to 'Discrete only' mode I get the errors below. The system did not hang, but the 'john' process became non-responsive when testing mscash2-opencl. Activity Monitor showed the process was alive and showed the following resources were open. I was able to kill the process and the test continued with the remaining formats.
>
> As you can see, it was able to test OpenCL for 5 of the formats (ssha-opencl, nt-opencl, phpass-opencl, raw-sha512-opencl and xsha512-opencl), but not the rest. So it looks to me like OpenCL is working, but something appears to be missing for specific formats.
>
> Can anyone help with getting OpenCL working on my MacBook Pro for the other formats? They all appear to have the same error.
>
>
> --- JOHN PROCESS STALLED WHEN TESTING mscash2-opencl ----
>
> /shared/JohnTheRipper-bleeding-jumbo-with-pro-wordlist/run
> /shared/JohnTheRipper-bleeding-jumbo-with-pro-wordlist/run/john
> /System/Library/Frameworks/OpenCL.framework/Versions/A/Libraries/libcldcpuengine.dylib
> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib
> /System/Library/Extensions/ATIRadeonX3000GLDriver.bundle/Contents/MacOS/ATIRadeonX3000GLDriver
> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLProgrammability.dylib
> /System/Library/PrivateFrameworks/GPUSupport.framework/Versions/A/Libraries/libGPUSupport.dylib
> /System/Library/Frameworks/OpenGL.framework/Versions/A/Resources/GLRendererFloat.bundle/GLRendererFloat
> /private/var/folders/k9/jwhz00wj2vjd4jng8147zlz80000gp/C/com.apple.LaunchServices-034502.csstore
> /System/Library/Extensions/AppleIntelHD3000GraphicsGLDriver.bundle/Contents/MacOS/AppleIntelHD3000GraphicsGLDriver
> /usr/lib/dyld
> /private/var/db/dyld/dyld_shared_cache_x86_64
> /dev/ttys007
> /dev/ttys007
> /dev/ttys007
> count=1, state=0x2
>
> --- TESTING ALL -OPENCL FORMATS ----
>
> for f in ssha-opencl nt-opencl ntlmv2-opencl agilekeychain-opencl cisco4-opencl md5crypt-opencl sha256crypt-opencl sha512crypt-opencl dmg-opencl encfs-opencl gpg-opencl keychain-opencl krb5pa-sha1-opencl mscash2-opencl mysql-sha1-opencl odf-opencl odf-aes-opencl office2007-opencl office2010-opencl office2013-opencl phpass-opencl pwsafe-opencl rar-opencl raw-md4-opencl raw-md5-opencl raw-sha1-opencl raw-sha256-opencl raw-sha512-opencl raw-sha512-ng-opencl strip-opencl sxc-opencl wpapsk-opencl xsha512-opencl xsha512-ng-opencl zip-opencl bcrypt-opencl descrypt-opencl; do echo "*** TESTING $f ***"; ./john --test --format=$f; done
>
> *** TESTING ssha-opencl ***
> Device 1: ATI Radeon HD 6750M
> Local worksize (LWS) 128, Global worksize (GWS) 4194304
> Benchmarking: ssha-opencl, Netscape LDAP salted SHA-1 [OpenCL (inefficient, development use mostly)]... DONE
> Many salts: 30783K c/s real, 335544K c/s virtual
> Only one salt: 25982K c/s real, 146800K c/s virtual
>
> *** TESTING nt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Local worksize (LWS) 64, Global worksize (GWS) 524288
> Benchmarking: nt-opencl, NT MD4 [OpenCL (inefficient, development use only)]... DONE
> Raw: 19206K c/s real, 39589K c/s virtual
>
> *** TESTING ntlmv2-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:13:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING agilekeychain-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING cisco4-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:17:10: fatal error: 'opencl_rawsha256.h' file not found
> #include "opencl_rawsha256.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING md5crypt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:12:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING sha256crypt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:17:10: fatal error: 'opencl_cryptsha256.h' file not found
> #include "opencl_cryptsha256.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING sha512crypt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:17:10: fatal error: 'opencl_cryptsha512.h' file not found
> #include "opencl_cryptsha512.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING dmg-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING encfs-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING gpg-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:33:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING keychain-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING krb5pa-sha1-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:13:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING mscash2-opencl ***
> Device 1: ATI Radeon HD 6750M
> Session aborted
> *** TESTING mysql-sha1-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING odf-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING odf-aes-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING office2007-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:16:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING office2010-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:14:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING office2013-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:15:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING phpass-opencl ***
> Device 1: ATI Radeon HD 6750M
> Local worksize (LWS) 64, Global worksize (GWS) 24576
> Benchmarking: phpass-opencl, phpass MD5 ($P$9 lengths 0 to 15) [OpenCL]... DONE
> Raw: 304818 c/s real, 7864K c/s virtual
>
> *** TESTING pwsafe-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:9:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING rar-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:22:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING raw-md4-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:18:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING raw-md5-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:18:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING raw-sha1-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING raw-sha256-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:17:10: fatal error: 'opencl_rawsha256.h' file not found
> #include "opencl_rawsha256.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING raw-sha512-opencl ***
> Device 1: ATI Radeon HD 6750M
> Local worksize (LWS) 64, Global worksize (GWS) 524288
> Benchmarking: raw-sha512-opencl, Raw SHA-512 [OpenCL (inefficient, development use mostly)]... FAILED (get_hash[0](0))
>
> *** TESTING raw-sha512-ng-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:18:10: fatal error: 'opencl_rawsha512-ng.h' file not found
> #include "opencl_rawsha512-ng.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING strip-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING sxc-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING wpapsk-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:11:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING xsha512-opencl ***
> Device 1: ATI Radeon HD 6750M
> Local worksize (LWS) 64, Global worksize (GWS) 524288
> Benchmarking: xsha512-opencl, Mac OS X 10.7+ salted SHA-512 [OpenCL (efficient at "many salts" only)]... FAILED (get_hash[0](0))
>
> *** TESTING xsha512-ng-opencl ***
> Device 1: ATI Radeon HD 6750M
> Building the kernel, this could take a while
> Build log: <program source>:18:10: fatal error: 'opencl_rawsha512-ng.h' file not found
> #include "opencl_rawsha512-ng.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING zip-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:17:10: fatal error: 'opencl_device_info.h' file not found
> #include "opencl_device_info.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING bcrypt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:10:10: fatal error: 'opencl_bf_WGS.h' file not found
> #include "opencl_bf_WGS.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
> *** TESTING descrypt-opencl ***
> Device 1: ATI Radeon HD 6750M
> Build log: <program source>:60:10: fatal error: 'opencl_DES_WGS.h' file not found
> #include "opencl_DES_WGS.h"
> ^
>
> Error -11 building kernel. DEVICE_INFO=1090
> OpenCL error (CL_BUILD_PROGRAM_FAILURE) in file (common-opencl.c) at line (582) - (clBuildProgram failed.)
>
Powered by blists - more mailing lists
Confused about mailing lists and their use?
Read about mailing lists on Wikipedia
and check out these
guidelines on proper formatting of your messages.
