Date: Mon, 9 Apr 2018 13:37:30 -0400 From: Rich Rumble <richrumble@...il.com> To: john-users@...ts.openwall.com Subject: Re: Splitting workload on multiple hosts On Mon, Aug 4, 2014 at 7:31 PM, magnum <john.magnum@...hmail.com> wrote: > On 2014-08-04 16:44, Rich Rumble wrote: > >> On Mon, Aug 4, 2014 at 5:50 AM, magnum <john.magnum@...hmail.com> wrote: >> >>> Basically the syntax for MPI with --node is the same as for --fork with >>> --node. So these two examples are equivalent in terms of work space: >>> >>> ./john -fork=16 -node=1-16/10000 (...) >>> >>> mpirun -host=alpha,bravo -np 16 ./john -node=1-16/10000 (...) >>> >>> Since Fork is no good for Windows and i currently want to dumbforce >> something. I don't have network connectivity to most of the hosts I'm >> pooling, so I may have to go and use live CD's and use Fork after all, but >> in linux. I am using node like the example, but I'm not sure it will work >> on external modes as well as fork would. >> > > The key space distribution is 100% identical whether you use fork, MPI or > just manual instances of --node. > > magnum > Sorry to dredge this subject back up, I'm not convinced Fork is fully using all 24 CPU's in my single machine to the best if it's ability, on an "incremental" run I'm doing. Will some modes work better in fork than others? I know certain algorithms do, and mine is one of them (raw-sha1). I have a few (other)issues, one being the hashes I'm going after are enormous and I can't fit them all in ram at once (HaveIBeenPwnd v2) so I've split them up into 20 1Gb slices. Perhaps a new thread may be needed for the incremental issue I'm not sure, but using -fork=24 seems to only see 6-8 threads of 100% util, and status updates are also between 6-8 when pressing a key. So I have found I can load four 1Gb slices in ram (save-mem=2), and run fork=6 on those. In doing that I appear to have some overlap, in that some threads are being used twice for work, but I'm not 100% sure. But if I stop one of the four runs, as soon as it's stopped one or two of the remaining three start churning out passwords like crazy. I do not think this is a problem fork/node are there to solve, but was curious if there was a way to make sure work in cpu/threads 1-6 are only done by this john instance, and work for the other john instance 1-6 are only done by cpu/threads 7-12. Since I'm doing different work, I didn't think node would be the answer for that, I figured the potential for overlap would be the same even if I specified node=0-5 for each instance. -rich
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.