Solar Designer | 17 Feb 04:31 2011

1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

Hi,

I've just released John the Ripper 1.7.6-jumbo-12.  It is available both
as a tarball ready to be compiled:

http://www.openwall.com/john/

and as a patch against 1.7.6:

http://www.openwall.com/john/#contrib

The changes since -jumbo-11 are:

The bug causing self-tests of md5-gen "formats" to fail and then crash,
which was introduced in -jumbo-10, has now been fixed.  I did this by
relaxing the assumptions/requirements of the self-tests.  The property
of md5-gen that I did not expect was actually of no consequence to uses
by JtR itself, or at least this is the current understanding.

The MSCash and MSCash2 "formats" have been enhanced to adjust the number
of key slots according to the number of threads with OpenMP builds.
This appears to have resulted in some speedup.  Here are the new numbers
on a Core i7 (8 threads):

Benchmarking: M$ Cache Hash [Generic 1x]... DONE
Many salts:     71221K c/s real, 8891K c/s virtual
Only one salt:  19517K c/s real, 2436K c/s virtual

Benchmarking: M$ Cache Hash 2 [Generic 1x]... DONE
Raw:    392 c/s real, 49.2 c/s virtual
(Continue reading)

Robert Harris | 19 Feb 04:08 2011
Picon

RE: 1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

John-Users/Alex,

I get an error compiling this in cygwin.  I'm using the absolute latest
version.  It compiles just fine in 32-bit and 64-bit Linux.

It doesn't really look like a compile error, it looks like a file creation
error or something. See error below.

gcc -c  -DUNDERSCORES x86-sse.S
gcc -c  -DUNDERSCORES sha1-mmx.S
gcc -c  -DUNDERSCORES md5-mmx.S
gcc DES_fmt.o DES_std.o DES_bs.o DES_bs_b.o BSDI_fmt.o MD5_fmt.o MD5_std.o
MD5_apache_fmt.o BFEgg_fmt.o BF_fmt.o BF_std.o AFS_fmt.o LM_fmt.o NT_fmt.o
XSHA_fmt.o DOMINOSEC_fmt.o lotus5_fmt.o oracle_fmt.o oracle11_fmt.o MYSQ
L_fmt.o mysqlSHA1_fmt.o KRB4_fmt.o KRB4_std.o KRB5_fmt.o KRB5_std.o md5_go.o
rawMD5go_fmt.o md5_eq.o PO_fmt.o md5.o hmacmd5.o hmacMD5_fmt.o IPB2_fmt.o
rawSHA1_fmt.o sha1_gen_fmt.o rawMD4_fmt.o md4_gen_fmt.o NSLDAP_fmt.o NS
LDAPS_fmt.o OPENLDAPS_fmt.o base64.o md4.o smbencrypt.o mscash_fmt.o
mscash2_fmt.o NETLM_fmt.o NETNTLM_fmt.o NETLMv2_fmt.o NETNTLMv2_fmt.o
NETHALFLM_fmt.o MSCHAPv2_fmt.o mssql_fmt.o mssql05_fmt.o EPI_fmt.o
PHPS_fmt.o MYSQL
_fast_fmt.o pixMD5_fmt.o sapG_fmt.o sapB_fmt.o NS_fmt.o HDAA_fmt.o
phpassMD5_fmt.o md5_gen_fmt.o md5_gen_parser.o md5_gen_preloads.o DMD5_fmt.o
SKEY_fmt.o batch.o bench.o charset.o common.o compiler.o config.o cracker.o
cr
c32.o external.o formats.o getopt.o idle.o inc.o john.o list.o loader.o
logger.o math.o memory.o misc.o options.o params.o path.o recovery.o rpp.o
rules.o signals.o single.o status.o tty.o wordlist.o mkv.o mkvlib.o unshado
w.o unafs.o undrop.o unique.o x86.o x86-sse.o sha1-mmx.o md5-mmx.o
-lkernel32 -lcrypto -o ../run/john.exe
(Continue reading)

Solar Designer | 19 Feb 04:15 2011

Re: 1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

Robert,

On Fri, Feb 18, 2011 at 10:08:29PM -0500, Robert Harris wrote:
> It doesn't really look like a compile error, it looks like a file creation
> error or something. See error below.
[...]
> -lkernel32 -lcrypto -o ../run/john.exe
> /usr/lib/gcc/i686-pc-cygwin/4.3.4/../../../../i686-pc-cygwin/bin/ld: cannot
> open output file ../run/john.exe: No such file or directory

Does the ../run directory exist?  If not, why not?

You could want to try compiling an older version - such as clean 1.7.6 -
to make sure your Windows system and Cygwin install are sane.  Then try
compiling this new version again (start with extracting the tarball).

Alexander

Robert Harris | 19 Feb 04:28 2011
Picon

RE: 1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

Alex,

The run directory exists.

I was just able to compile JtR 1.7.6 with jumbo 11, just fine.

So, it looks like something else is going on.  It seems like this is the
first time I've seen this type of error in cygwin.

-Robert B. Harris from VA

-----Original Message-----
From: Solar Designer [mailto:solar@...] 
Sent: Friday, February 18, 2011 10:16 PM
To: john-users@...
Subject: Re: [john-users] 1.7.6-jumbo-12 fixes md5-gen self-test bug,
improves MSCash*/OpenMP

Robert,

On Fri, Feb 18, 2011 at 10:08:29PM -0500, Robert Harris wrote:
> It doesn't really look like a compile error, it looks like a file creation
> error or something. See error below.
[...]
> -lkernel32 -lcrypto -o ../run/john.exe
> /usr/lib/gcc/i686-pc-cygwin/4.3.4/../../../../i686-pc-cygwin/bin/ld:
cannot
> open output file ../run/john.exe: No such file or directory

Does the ../run directory exist?  If not, why not?
(Continue reading)

Robert Harris | 19 Feb 15:38 2011
Picon

RE: 1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

John-Users/Alex,

Problem solved.

I applied the jumbo 12 patch diff file to 1.7.6 and it compiled for me in
cygwin.

-Robert B. Harris from VA

-----Original Message-----
From: Robert Harris [mailto:rs904c@...] 
Sent: Friday, February 18, 2011 10:29 PM
To: john-users@...
Subject: RE: [john-users] 1.7.6-jumbo-12 fixes md5-gen self-test bug,
improves MSCash*/OpenMP

Alex,

The run directory exists.

I was just able to compile JtR 1.7.6 with jumbo 11, just fine.

So, it looks like something else is going on.  It seems like this is the
first time I've seen this type of error in cygwin.

-Robert B. Harris from VA

-----Original Message-----
From: Solar Designer [mailto:solar@...] 
Sent: Friday, February 18, 2011 10:16 PM
(Continue reading)

Solar Designer | 20 Feb 00:33 2011

Re: 1.7.6-jumbo-12 fixes md5-gen self-test bug, improves MSCash*/OpenMP

Robert, all -

On Sat, Feb 19, 2011 at 09:38:16AM -0500, Robert Harris wrote:
> I applied the jumbo 12 patch diff file to 1.7.6 and it compiled for me in
> cygwin.

Thanks!  Robert's build of John the Ripper 1.7.6-jumbo-12 may now be
downloaded from:

http://www.openwall.com/john/#contrib
http://download.openwall.net/pub/projects/john/contrib/win32/

Indeed, it's also found on the wiki, where Robert uploaded it to:

http://openwall.info/wiki/john/custom-builds#Compiled-for-Windows

but it is safer to download from the main Openwall website.

Alexander


Gmane