Openwall GNU/*/Linux - a small security-enhanced Linux distro for servers
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date: Thu, 23 Nov 2017 19:42:59 +0100
From: magnum <>
Subject: Re: OpenMPI and .rec files?

On 2017-11-23 19:09, Jeroen wrote:
> magnum wrote:
>> If you find out anything useful for others, please report here!
> First finding that narrows things down:
> - On the cluster, jobs seem to work fine with normal tasks (#.rec files = #jobs). It caps at 100 when --wordlist=<dict> is used.
> - I cannot reproduce this on the very basic lab setup (#.rec files = #jobs). However, the output is slightly different when a wordlist is used:
> ---
> bofh@...ncher:/opt/JohnTheRipper/run$ rm *rec; mpirun -np 120 ./john --format=raw-md4 /tmp/hashes
> <SNAP>
> Loaded 1200 password hashes with no different salts (Raw-MD4 [MD4 128/128 SSE4.1 4x3])
> Using default input encoding: UTF-8
> Node numbers 1-120 of 120 (MPI)
> Send SIGUSR1 to mpirun for status
> ---
> If the job uses a wordlist, "Send SIGUSR1 to mpirun for status" is missing.
>> Oh BTW it's very strange you can resume such session with (seemingly) no
>> problems. If you didn't already, you should look very closely in the log
>> file and see if there are any clues there. Perhaps there is some error seen
>> there that we should handle (or report) better.
> On the console everything looks normal:
> Remaining X password hashes with X different salts
> Cost 1 (iteration count) is X for all loaded hashes
> MPI in use, disabling OMP (see doc/README.mpi)
> Node numbers 1-640 of 640 (MPI)
> <session status messages>
> However, this message pops up in john.log for a number of workers: "Terminating on error, recovery.c:165".

In that case we do print an error to stderr also:

             fprintf(stderr, "Node %d@%s: Crash recovery file is"
                     " locked: %s\n", mpi_id + 1, mpi_name,

Line 165 is the "error()".

So now we have two questions:
  1) Why was it already locked? Some half-dead process still running?
  2) Why do you not see the error printed to stderr? Something with your 
OpenMPI wrapper script?


Powered by blists - more mailing lists

Your e-mail address:

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.