Date: Sun, 16 Sep 2018 21:28:42 +0200 From: Albert Veli <albert.veli@...il.com> To: john-users@...ts.openwall.com Subject: Re: good program for sorting large wordlists Hi! On Tue, Sep 11, 2018 at 5:19 PM JohnyKrekan <krekan@...nykrekan.com> wrote: > Hello, I would like to ask whether someone has experience with good tool > to sort large text files with possibilities such as gnu sort. I am using it > to sort wordlists but when I tried to sort 11 gb wordlist, it crashed while > writing final output file after writing around 7 gb of data and did not > delete some temp files. If you don't succeed with other methods, one thing that has worked for me is splitting the wordlist into smaller parts and sorting each one individually. Then you can merge the sorted lists together using for instance mli2 from hashcat-utils. That will put the big list in sorted order. But the parts must be sorted first, before merging. This is only necessary for very large wordlists. Like in your case. PS I think there is a tool in hashcat-utils for splitting too. Don't remember the name. Maybe gate.
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.