Some tests fail on the current/latest SNAP

classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
$ apps/openssl$ openssl version
OpenSSL 1.1.0-dev xx XXX xxxx
$ make test
testing...
make[1]: Entering directory `/media/uri/Src/openssl/test'
make[2]: Entering directory `/media/uri/Src/openssl'
making all in apps...
make[3]: Entering directory `/media/uri/Src/openssl/apps'
make[3]: Nothing to be done for `all'.
make[3]: Leaving directory `/media/uri/Src/openssl/apps'
make[2]: Leaving directory `/media/uri/Src/openssl'
TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
../test/recipes/00-check_testexes.t ....... ok
../test/recipes/05-test_bf.t .............. ok
../test/recipes/05-test_cast.t ............ ok
../test/recipes/05-test_des.t ............. ok
../test/recipes/05-test_hmac.t ............ ok
../test/recipes/05-test_idea.t ............ ok
../test/recipes/05-test_md2.t ............. ok
../test/recipes/05-test_md4.t ............. ok
../test/recipes/05-test_md5.t ............. ok
../test/recipes/05-test_mdc2.t ............ ok
../test/recipes/05-test_rand.t ............ ok
../test/recipes/05-test_rc2.t ............. ok
../test/recipes/05-test_rc4.t ............. ok
../test/recipes/05-test_rc5.t ............. ok
../test/recipes/05-test_rmd.t ............. ok
../test/recipes/05-test_sha1.t ............ ok
../test/recipes/05-test_sha256.t .......... ok
../test/recipes/05-test_sha512.t .......... ok
../test/recipes/05-test_wp.t .............. ok
../test/recipes/10-test_bn.t .............. ok
../test/recipes/10-test_exp.t ............. ok
../test/recipes/15-test_dh.t .............. ok
../test/recipes/15-test_dsa.t ............. ok
../test/recipes/15-test_ec.t .............. ok
../test/recipes/15-test_ecdh.t ............ ok
../test/recipes/15-test_ecdsa.t ........... ok
../test/recipes/15-test_rsa.t ............. ok
../test/recipes/20-test_enc.t ............. ok
../test/recipes/25-test_crl.t ............. ok
../test/recipes/25-test_gen.t ............. ok
../test/recipes/25-test_pkcs7.t ........... ok
../test/recipes/25-test_req.t ............. ok
../test/recipes/25-test_sid.t ............. ok
../test/recipes/25-test_verify.t .......... ok
../test/recipes/25-test_x509.t ............ ok
../test/recipes/30-test_engine.t .......... ok
../test/recipes/30-test_evp.t ............. ok
../test/recipes/30-test_evp_extra.t ....... ok
../test/recipes/30-test_pbelu.t ........... ok
../test/recipes/40-test_rehash.t .......... ok
../test/recipes/70-test_clienthello.t ..... ok
../test/recipes/70-test_packet.t .......... ok
Use of uninitialized value within %message_type in concatenation (.) or string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslextension.t .... 
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 1/1 subtests 
Use of uninitialized value within %message_type in concatenation (.) or string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslsessiontick.t .. 
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 5/5 subtests 
../test/recipes/70-test_sslskewith0p.t .... ok
Use of uninitialized value within %message_type in concatenation (.) or string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslvertol.t ....... 
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 2/2 subtests 
../test/recipes/70-test_verify_extra.t .... ok
../test/recipes/80-test_ca.t .............. ok
    # Looks like you planned 11 tests but ran 20.

#   Failed test 'CMS <=> CMS consistency tests, modified key parameters
# '
#   at ../test/recipes/80-test_cms.t line 460.
# Looks like you failed 1 test of 4.
../test/recipes/80-test_cms.t ............. 
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests 
../test/recipes/80-test_ocsp.t ............ ok
../test/recipes/80-test_ssl.t ............. ok
../test/recipes/80-test_tsa.t ............. ok
../test/recipes/90-test_constant_time.t ... ok
../test/recipes/90-test_gmdiff.t .......... ok
../test/recipes/90-test_gost2814789.t ..... ok
../test/recipes/90-test_heartbeat.t ....... ok
../test/recipes/90-test_ige.t ............. ok
../test/recipes/90-test_jpake.t ........... ok
../test/recipes/90-test_np.t .............. ok
../test/recipes/90-test_p5_crpt2.t ........ ok
../test/recipes/90-test_secmem.t .......... ok
../test/recipes/90-test_srp.t ............. ok
../test/recipes/90-test_v3name.t .......... ok

Test Summary Report
-------------------
../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 1 tests but ran 0.
../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 0.
../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 2 tests but ran 0.
../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
  Failed test:  4
  Non-zero exit status: 1
Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys + 18.40 cusr  8.32 csys = 27.09 CPU)
Result: FAIL
Failed 4/63 test programs. 1/324 subtests failed.
make[1]: *** [tests] Error 255
make[1]: Leaving directory `/media/uri/Src/openssl/test'
make: *** [tests] Error 2
$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 4.8.4-2ubuntu1~14.04' --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr --program-suffix=-4.8 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-gnu-unique-object --disable-libmudflap --enable-plugin --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --enable-java-home --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --with-tune=generic --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
-- 
Regards,
Uri Blumenthal

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Matt Caswell-2
Hmmm. I cannot reproduce this. Is anyone else seeing this?

Matt

On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:

> $ apps/openssl$ openssl version
> OpenSSL 1.1.0-dev xx XXX xxxx
> $ make test
> testing...
> make[1]: Entering directory `/media/uri/Src/openssl/test'
> make[2]: Entering directory `/media/uri/Src/openssl'
> making all in apps...
> make[3]: Entering directory `/media/uri/Src/openssl/apps'
> make[3]: Nothing to be done for `all'.
> make[3]: Leaving directory `/media/uri/Src/openssl/apps'
> make[2]: Leaving directory `/media/uri/Src/openssl'
> TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
> ../test/recipes/00-check_testexes.t ....... ok
> ../test/recipes/05-test_bf.t .............. ok
> ../test/recipes/05-test_cast.t ............ ok
> ../test/recipes/05-test_des.t ............. ok
> ../test/recipes/05-test_hmac.t ............ ok
> ../test/recipes/05-test_idea.t ............ ok
> ../test/recipes/05-test_md2.t ............. ok
> ../test/recipes/05-test_md4.t ............. ok
> ../test/recipes/05-test_md5.t ............. ok
> ../test/recipes/05-test_mdc2.t ............ ok
> ../test/recipes/05-test_rand.t ............ ok
> ../test/recipes/05-test_rc2.t ............. ok
> ../test/recipes/05-test_rc4.t ............. ok
> ../test/recipes/05-test_rc5.t ............. ok
> ../test/recipes/05-test_rmd.t ............. ok
> ../test/recipes/05-test_sha1.t ............ ok
> ../test/recipes/05-test_sha256.t .......... ok
> ../test/recipes/05-test_sha512.t .......... ok
> ../test/recipes/05-test_wp.t .............. ok
> ../test/recipes/10-test_bn.t .............. ok
> ../test/recipes/10-test_exp.t ............. ok
> ../test/recipes/15-test_dh.t .............. ok
> ../test/recipes/15-test_dsa.t ............. ok
> ../test/recipes/15-test_ec.t .............. ok
> ../test/recipes/15-test_ecdh.t ............ ok
> ../test/recipes/15-test_ecdsa.t ........... ok
> ../test/recipes/15-test_rsa.t ............. ok
> ../test/recipes/20-test_enc.t ............. ok
> ../test/recipes/25-test_crl.t ............. ok
> ../test/recipes/25-test_gen.t ............. ok
> ../test/recipes/25-test_pkcs7.t ........... ok
> ../test/recipes/25-test_req.t ............. ok
> ../test/recipes/25-test_sid.t ............. ok
> ../test/recipes/25-test_verify.t .......... ok
> ../test/recipes/25-test_x509.t ............ ok
> ../test/recipes/30-test_engine.t .......... ok
> ../test/recipes/30-test_evp.t ............. ok
> ../test/recipes/30-test_evp_extra.t ....... ok
> ../test/recipes/30-test_pbelu.t ........... ok
> ../test/recipes/40-test_rehash.t .......... ok
> ../test/recipes/70-test_clienthello.t ..... ok
> ../test/recipes/70-test_packet.t .......... ok
> Use of uninitialized value within %message_type in concatenation (.) or
> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
> Changed peer, but we still have fragment data
> # Looks like your test exited with 255 before it could output anything.
> ../test/recipes/70-test_sslextension.t ....
> Dubious, test returned 255 (wstat 65280, 0xff00)
> Failed 1/1 subtests
> Use of uninitialized value within %message_type in concatenation (.) or
> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
> Changed peer, but we still have fragment data
> # Looks like your test exited with 255 before it could output anything.
> ../test/recipes/70-test_sslsessiontick.t ..
> Dubious, test returned 255 (wstat 65280, 0xff00)
> Failed 5/5 subtests
> ../test/recipes/70-test_sslskewith0p.t .... ok
> Use of uninitialized value within %message_type in concatenation (.) or
> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
> Changed peer, but we still have fragment data
> # Looks like your test exited with 255 before it could output anything.
> ../test/recipes/70-test_sslvertol.t .......
> Dubious, test returned 255 (wstat 65280, 0xff00)
> Failed 2/2 subtests
> ../test/recipes/70-test_verify_extra.t .... ok
> ../test/recipes/80-test_ca.t .............. ok
>     # Looks like you planned 11 tests but ran 20.
>
> #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
> # '
> #   at ../test/recipes/80-test_cms.t line 460.
> # Looks like you failed 1 test of 4.
> ../test/recipes/80-test_cms.t .............
> Dubious, test returned 1 (wstat 256, 0x100)
> Failed 1/4 subtests
> ../test/recipes/80-test_ocsp.t ............ ok
> ../test/recipes/80-test_ssl.t ............. ok
> ../test/recipes/80-test_tsa.t ............. ok
> ../test/recipes/90-test_constant_time.t ... ok
> ../test/recipes/90-test_gmdiff.t .......... ok
> ../test/recipes/90-test_gost2814789.t ..... ok
> ../test/recipes/90-test_heartbeat.t ....... ok
> ../test/recipes/90-test_ige.t ............. ok
> ../test/recipes/90-test_jpake.t ........... ok
> ../test/recipes/90-test_np.t .............. ok
> ../test/recipes/90-test_p5_crpt2.t ........ ok
> ../test/recipes/90-test_secmem.t .......... ok
> ../test/recipes/90-test_srp.t ............. ok
> ../test/recipes/90-test_v3name.t .......... ok
>
> Test Summary Report
> -------------------
> ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
>   Non-zero exit status: 255
>   Parse errors: Bad plan.  You planned 1 tests but ran 0.
> ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
>   Non-zero exit status: 255
>   Parse errors: Bad plan.  You planned 5 tests but ran 0.
> ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
>   Non-zero exit status: 255
>   Parse errors: Bad plan.  You planned 2 tests but ran 0.
> ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
>   Failed test:  4
>   Non-zero exit status: 1
> Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys + 18.40 cusr
>  8.32 csys = 27.09 CPU)
> Result: FAIL
> Failed 4/63 test programs. 1/324 subtests failed.
> make[1]: *** [tests] Error 255
> make[1]: Leaving directory `/media/uri/Src/openssl/test'
> make: *** [tests] Error 2
> $ gcc -v
> Using built-in specs.
> COLLECT_GCC=gcc
> COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
> Target: x86_64-linux-gnu
> Configured with: ../src/configure -v --with-pkgversion='Ubuntu
> 4.8.4-2ubuntu1~14.04'
> --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
> --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr
> --program-suffix=-4.8 --enable-shared --enable-linker-build-id
> --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix
> --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
> --enable-nls --with-sysroot=/ --enable-clocale=gnu
> --enable-libstdcxx-debug --enable-libstdcxx-time=yes
> --enable-gnu-unique-object --disable-libmudflap --enable-plugin
> --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
> --enable-gtk-cairo
> --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
> --enable-java-home
> --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
> --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
> --with-arch-directory=amd64
> --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
> --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64
> --with-multilib-list=m32,m64,mx32 --with-tune=generic
> --enable-checking=release --build=x86_64-linux-gnu
> --host=x86_64-linux-gnu --target=x86_64-linux-gnu
> Thread model: posix
> gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
> --
> Regards,
> Uri Blumenthal
>
>
> _______________________________________________
> openssl-dev mailing list
> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
>
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Richard Levitte - VMS Whacker
I can't reproduce it either, but judging from the line number, it
looks like a surprise unknown message type.  Uri, the attached patch
and the following command line might help clear this up:

    HARNESS_VERBOSE=yes make TESTS=test_sslextension test

Cheers,
Richard

In message <[hidden email]> on Thu, 17 Sep 2015 22:55:01 +0100, Matt Caswell <[hidden email]> said:

matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
matt>
matt> Matt
matt>
matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
matt> > $ apps/openssl$ openssl version
matt> > OpenSSL 1.1.0-dev xx XXX xxxx
matt> > $ make test
matt> > testing...
matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
matt> > make[2]: Entering directory `/media/uri/Src/openssl'
matt> > making all in apps...
matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
matt> > make[3]: Nothing to be done for `all'.
matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
matt> > ../test/recipes/00-check_testexes.t ....... ok
matt> > ../test/recipes/05-test_bf.t .............. ok
matt> > ../test/recipes/05-test_cast.t ............ ok
matt> > ../test/recipes/05-test_des.t ............. ok
matt> > ../test/recipes/05-test_hmac.t ............ ok
matt> > ../test/recipes/05-test_idea.t ............ ok
matt> > ../test/recipes/05-test_md2.t ............. ok
matt> > ../test/recipes/05-test_md4.t ............. ok
matt> > ../test/recipes/05-test_md5.t ............. ok
matt> > ../test/recipes/05-test_mdc2.t ............ ok
matt> > ../test/recipes/05-test_rand.t ............ ok
matt> > ../test/recipes/05-test_rc2.t ............. ok
matt> > ../test/recipes/05-test_rc4.t ............. ok
matt> > ../test/recipes/05-test_rc5.t ............. ok
matt> > ../test/recipes/05-test_rmd.t ............. ok
matt> > ../test/recipes/05-test_sha1.t ............ ok
matt> > ../test/recipes/05-test_sha256.t .......... ok
matt> > ../test/recipes/05-test_sha512.t .......... ok
matt> > ../test/recipes/05-test_wp.t .............. ok
matt> > ../test/recipes/10-test_bn.t .............. ok
matt> > ../test/recipes/10-test_exp.t ............. ok
matt> > ../test/recipes/15-test_dh.t .............. ok
matt> > ../test/recipes/15-test_dsa.t ............. ok
matt> > ../test/recipes/15-test_ec.t .............. ok
matt> > ../test/recipes/15-test_ecdh.t ............ ok
matt> > ../test/recipes/15-test_ecdsa.t ........... ok
matt> > ../test/recipes/15-test_rsa.t ............. ok
matt> > ../test/recipes/20-test_enc.t ............. ok
matt> > ../test/recipes/25-test_crl.t ............. ok
matt> > ../test/recipes/25-test_gen.t ............. ok
matt> > ../test/recipes/25-test_pkcs7.t ........... ok
matt> > ../test/recipes/25-test_req.t ............. ok
matt> > ../test/recipes/25-test_sid.t ............. ok
matt> > ../test/recipes/25-test_verify.t .......... ok
matt> > ../test/recipes/25-test_x509.t ............ ok
matt> > ../test/recipes/30-test_engine.t .......... ok
matt> > ../test/recipes/30-test_evp.t ............. ok
matt> > ../test/recipes/30-test_evp_extra.t ....... ok
matt> > ../test/recipes/30-test_pbelu.t ........... ok
matt> > ../test/recipes/40-test_rehash.t .......... ok
matt> > ../test/recipes/70-test_clienthello.t ..... ok
matt> > ../test/recipes/70-test_packet.t .......... ok
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslextension.t ....
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 1/1 subtests
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslsessiontick.t ..
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 5/5 subtests
matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
matt> > Use of uninitialized value within %message_type in concatenation (.) or
matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
matt> > Changed peer, but we still have fragment data
matt> > # Looks like your test exited with 255 before it could output anything.
matt> > ../test/recipes/70-test_sslvertol.t .......
matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
matt> > Failed 2/2 subtests
matt> > ../test/recipes/70-test_verify_extra.t .... ok
matt> > ../test/recipes/80-test_ca.t .............. ok
matt> >     # Looks like you planned 11 tests but ran 20.
matt> >
matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
matt> > # '
matt> > #   at ../test/recipes/80-test_cms.t line 460.
matt> > # Looks like you failed 1 test of 4.
matt> > ../test/recipes/80-test_cms.t .............
matt> > Dubious, test returned 1 (wstat 256, 0x100)
matt> > Failed 1/4 subtests
matt> > ../test/recipes/80-test_ocsp.t ............ ok
matt> > ../test/recipes/80-test_ssl.t ............. ok
matt> > ../test/recipes/80-test_tsa.t ............. ok
matt> > ../test/recipes/90-test_constant_time.t ... ok
matt> > ../test/recipes/90-test_gmdiff.t .......... ok
matt> > ../test/recipes/90-test_gost2814789.t ..... ok
matt> > ../test/recipes/90-test_heartbeat.t ....... ok
matt> > ../test/recipes/90-test_ige.t ............. ok
matt> > ../test/recipes/90-test_jpake.t ........... ok
matt> > ../test/recipes/90-test_np.t .............. ok
matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
matt> > ../test/recipes/90-test_secmem.t .......... ok
matt> > ../test/recipes/90-test_srp.t ............. ok
matt> > ../test/recipes/90-test_v3name.t .......... ok
matt> >
matt> > Test Summary Report
matt> > -------------------
matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
matt> >   Non-zero exit status: 255
matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
matt> >   Failed test:  4
matt> >   Non-zero exit status: 1
matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys + 18.40 cusr
matt> >  8.32 csys = 27.09 CPU)
matt> > Result: FAIL
matt> > Failed 4/63 test programs. 1/324 subtests failed.
matt> > make[1]: *** [tests] Error 255
matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
matt> > make: *** [tests] Error 2
matt> > $ gcc -v
matt> > Using built-in specs.
matt> > COLLECT_GCC=gcc
matt> > COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
matt> > Target: x86_64-linux-gnu
matt> > Configured with: ../src/configure -v --with-pkgversion='Ubuntu
matt> > 4.8.4-2ubuntu1~14.04'
matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr
matt> > --program-suffix=-4.8 --enable-shared --enable-linker-build-id
matt> > --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix
matt> > --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
matt> > --enable-gnu-unique-object --disable-libmudflap --enable-plugin
matt> > --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
matt> > --enable-gtk-cairo
matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
matt> > --enable-java-home
matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
matt> > --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
matt> > --with-arch-directory=amd64
matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
matt> > --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64
matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
matt> > --enable-checking=release --build=x86_64-linux-gnu
matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
matt> > Thread model: posix
matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
matt> > --
matt> > Regards,
matt> > Uri Blumenthal
matt> >
matt> >
matt> > _______________________________________________
matt> > openssl-dev mailing list
matt> > To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
matt> >
matt> _______________________________________________
matt> openssl-dev mailing list
matt> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

diff --git a/test/recipes/70-test_sslextension.t b/test/recipes/70-test_sslextension.t
index 4aa3f61..6dc7c8b 100755
--- a/test/recipes/70-test_sslextension.t
+++ b/test/recipes/70-test_sslextension.t
@@ -69,7 +69,8 @@ $ENV{OPENSSL_ia32cap} = '~0x200000200000000';
 my $proxy = TLSProxy::Proxy->new(
     \&extension_filter,
     cmdstr(app(["openssl"])),
-    top_file("apps", "server.pem")
+    top_file("apps", "server.pem"),
+    1
 );
 
 plan tests => 1;
diff --git a/util/TLSProxy/Message.pm b/util/TLSProxy/Message.pm
index 6376219..7e227d9 100644
--- a/util/TLSProxy/Message.pm
+++ b/util/TLSProxy/Message.pm
@@ -199,7 +199,7 @@ sub get_messages
                                                substr($record->decrypt_data,
                                                       $recoffset));
                 $messlen = ($lenhi << 8) | $lenlo;
-                print "  Message type: $message_type{$mt}\n";
+                print "  Message type: $message_type{$mt} ($mt)\n";
                 print "  Message Length: $messlen\n";
                 $startoffset = $recoffset;
                 $recoffset += 4;

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
Richard,

Thank you for your help! Unfortunately, the problem persists:

testing...
make[1]: Entering directory `/media/uri/Src/openssl/test'
make[2]: Entering directory `/media/uri/Src/openssl'
making all in apps...
make[3]: Entering directory `/media/uri/Src/openssl/apps'
make[3]: Nothing to be done for `all'.
make[3]: Leaving directory `/media/uri/Src/openssl/apps'
make[2]: Leaving directory `/media/uri/Src/openssl'
TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
../test/recipes/00-check_testexes.t ....... ok
../test/recipes/05-test_bf.t .............. ok
../test/recipes/05-test_cast.t ............ ok
../test/recipes/05-test_des.t ............. ok
../test/recipes/05-test_hmac.t ............ ok
../test/recipes/05-test_idea.t ............ ok
../test/recipes/05-test_md2.t ............. ok
../test/recipes/05-test_md4.t ............. ok
../test/recipes/05-test_md5.t ............. ok
../test/recipes/05-test_mdc2.t ............ ok
../test/recipes/05-test_rand.t ............ ok
../test/recipes/05-test_rc2.t ............. ok
../test/recipes/05-test_rc4.t ............. ok
../test/recipes/05-test_rc5.t ............. ok
../test/recipes/05-test_rmd.t ............. ok
../test/recipes/05-test_sha1.t ............ ok
../test/recipes/05-test_sha256.t .......... ok
../test/recipes/05-test_sha512.t .......... ok
../test/recipes/05-test_wp.t .............. ok
../test/recipes/10-test_bn.t .............. ok
../test/recipes/10-test_exp.t ............. ok
../test/recipes/15-test_dh.t .............. ok
../test/recipes/15-test_dsa.t ............. ok
../test/recipes/15-test_ec.t .............. ok
../test/recipes/15-test_ecdh.t ............ ok
../test/recipes/15-test_ecdsa.t ........... ok
../test/recipes/15-test_rsa.t ............. ok
../test/recipes/20-test_enc.t ............. ok
../test/recipes/25-test_crl.t ............. ok
../test/recipes/25-test_gen.t ............. ok
../test/recipes/25-test_pkcs7.t ........... ok
../test/recipes/25-test_req.t ............. ok
../test/recipes/25-test_sid.t ............. ok
../test/recipes/25-test_verify.t .......... ok
../test/recipes/25-test_x509.t ............ ok
../test/recipes/30-test_engine.t .......... ok
../test/recipes/30-test_evp.t ............. ok
../test/recipes/30-test_evp_extra.t ....... ok
../test/recipes/30-test_pbelu.t ........... ok
../test/recipes/40-test_rehash.t .......... ok
../test/recipes/70-test_clienthello.t ..... ok
../test/recipes/70-test_packet.t .......... ok
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslextension.t ....
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 1/1 subtests
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslsessiontick.t ..
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 5/5 subtests
../test/recipes/70-test_sslskewith0p.t .... ok
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 202, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslvertol.t .......
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 2/2 subtests
../test/recipes/70-test_verify_extra.t .... ok
../test/recipes/80-test_ca.t .............. ok
    # Looks like you planned 11 tests but ran 20.

#   Failed test 'CMS <=> CMS consistency tests, modified key parameters
# '
#   at ../test/recipes/80-test_cms.t line 460.
# Looks like you failed 1 test of 4.
../test/recipes/80-test_cms.t .............
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests
../test/recipes/80-test_ocsp.t ............ ok
../test/recipes/80-test_ssl.t ............. ok
../test/recipes/80-test_tsa.t ............. ok
../test/recipes/90-test_constant_time.t ... ok
../test/recipes/90-test_gmdiff.t .......... ok
../test/recipes/90-test_gost2814789.t ..... ok
../test/recipes/90-test_heartbeat.t ....... ok
../test/recipes/90-test_ige.t ............. ok
../test/recipes/90-test_jpake.t ........... ok
../test/recipes/90-test_np.t .............. ok
../test/recipes/90-test_p5_crpt2.t ........ ok
../test/recipes/90-test_secmem.t .......... ok
../test/recipes/90-test_srp.t ............. ok
../test/recipes/90-test_v3name.t .......... ok

Test Summary Report
-------------------
../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 1 tests but ran 0.
../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 0.
../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 2 tests but ran 0.
../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
  Failed test:  4
  Non-zero exit status: 1
Files=63, Tests=324, 30 wallclock secs ( 0.31 usr  0.08 sys + 19.13 cusr
8.61 csys = 28.13 CPU)
Result: FAIL
Failed 4/63 test programs. 1/324 subtests failed.
make[1]: *** [tests] Error 255
make[1]: Leaving directory `/media/uri/Src/openssl/test'
make: *** [tests] Error 2



What can we (I :) do to either remedy it, or provide you more info to find
the cause?
--
Regards,
Uri Blumenthal





On 9/18/15, 2:27 , "Richard Levitte" <[hidden email]> wrote:

>I can't reproduce it either, but judging from the line number, it
>looks like a surprise unknown message type.  Uri, the attached patch
>and the following command line might help clear this up:
>
>    HARNESS_VERBOSE=yes make TESTS=test_sslextension test
>
>Cheers,
>Richard
>
>In message <[hidden email]> on Thu, 17 Sep 2015 22:55:01
>+0100, Matt Caswell <[hidden email]> said:
>
>matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
>matt>
>matt> Matt
>matt>
>matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
>matt> > $ apps/openssl$ openssl version
>matt> > OpenSSL 1.1.0-dev xx XXX xxxx
>matt> > $ make test
>matt> > testing...
>matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
>matt> > make[2]: Entering directory `/media/uri/Src/openssl'
>matt> > making all in apps...
>matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
>matt> > make[3]: Nothing to be done for `all'.
>matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
>matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
>matt> > ../test/recipes/00-check_testexes.t ....... ok
>matt> > ../test/recipes/05-test_bf.t .............. ok
>matt> > ../test/recipes/05-test_cast.t ............ ok
>matt> > ../test/recipes/05-test_des.t ............. ok
>matt> > ../test/recipes/05-test_hmac.t ............ ok
>matt> > ../test/recipes/05-test_idea.t ............ ok
>matt> > ../test/recipes/05-test_md2.t ............. ok
>matt> > ../test/recipes/05-test_md4.t ............. ok
>matt> > ../test/recipes/05-test_md5.t ............. ok
>matt> > ../test/recipes/05-test_mdc2.t ............ ok
>matt> > ../test/recipes/05-test_rand.t ............ ok
>matt> > ../test/recipes/05-test_rc2.t ............. ok
>matt> > ../test/recipes/05-test_rc4.t ............. ok
>matt> > ../test/recipes/05-test_rc5.t ............. ok
>matt> > ../test/recipes/05-test_rmd.t ............. ok
>matt> > ../test/recipes/05-test_sha1.t ............ ok
>matt> > ../test/recipes/05-test_sha256.t .......... ok
>matt> > ../test/recipes/05-test_sha512.t .......... ok
>matt> > ../test/recipes/05-test_wp.t .............. ok
>matt> > ../test/recipes/10-test_bn.t .............. ok
>matt> > ../test/recipes/10-test_exp.t ............. ok
>matt> > ../test/recipes/15-test_dh.t .............. ok
>matt> > ../test/recipes/15-test_dsa.t ............. ok
>matt> > ../test/recipes/15-test_ec.t .............. ok
>matt> > ../test/recipes/15-test_ecdh.t ............ ok
>matt> > ../test/recipes/15-test_ecdsa.t ........... ok
>matt> > ../test/recipes/15-test_rsa.t ............. ok
>matt> > ../test/recipes/20-test_enc.t ............. ok
>matt> > ../test/recipes/25-test_crl.t ............. ok
>matt> > ../test/recipes/25-test_gen.t ............. ok
>matt> > ../test/recipes/25-test_pkcs7.t ........... ok
>matt> > ../test/recipes/25-test_req.t ............. ok
>matt> > ../test/recipes/25-test_sid.t ............. ok
>matt> > ../test/recipes/25-test_verify.t .......... ok
>matt> > ../test/recipes/25-test_x509.t ............ ok
>matt> > ../test/recipes/30-test_engine.t .......... ok
>matt> > ../test/recipes/30-test_evp.t ............. ok
>matt> > ../test/recipes/30-test_evp_extra.t ....... ok
>matt> > ../test/recipes/30-test_pbelu.t ........... ok
>matt> > ../test/recipes/40-test_rehash.t .......... ok
>matt> > ../test/recipes/70-test_clienthello.t ..... ok
>matt> > ../test/recipes/70-test_packet.t .......... ok
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslextension.t ....
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 1/1 subtests
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslsessiontick.t ..
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 5/5 subtests
>matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
>matt> > Use of uninitialized value within %message_type in concatenation
>(.) or
>matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>matt> > Changed peer, but we still have fragment data
>matt> > # Looks like your test exited with 255 before it could output
>anything.
>matt> > ../test/recipes/70-test_sslvertol.t .......
>matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>matt> > Failed 2/2 subtests
>matt> > ../test/recipes/70-test_verify_extra.t .... ok
>matt> > ../test/recipes/80-test_ca.t .............. ok
>matt> >     # Looks like you planned 11 tests but ran 20.
>matt> >
>matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
>parameters
>matt> > # '
>matt> > #   at ../test/recipes/80-test_cms.t line 460.
>matt> > # Looks like you failed 1 test of 4.
>matt> > ../test/recipes/80-test_cms.t .............
>matt> > Dubious, test returned 1 (wstat 256, 0x100)
>matt> > Failed 1/4 subtests
>matt> > ../test/recipes/80-test_ocsp.t ............ ok
>matt> > ../test/recipes/80-test_ssl.t ............. ok
>matt> > ../test/recipes/80-test_tsa.t ............. ok
>matt> > ../test/recipes/90-test_constant_time.t ... ok
>matt> > ../test/recipes/90-test_gmdiff.t .......... ok
>matt> > ../test/recipes/90-test_gost2814789.t ..... ok
>matt> > ../test/recipes/90-test_heartbeat.t ....... ok
>matt> > ../test/recipes/90-test_ige.t ............. ok
>matt> > ../test/recipes/90-test_jpake.t ........... ok
>matt> > ../test/recipes/90-test_np.t .............. ok
>matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
>matt> > ../test/recipes/90-test_secmem.t .......... ok
>matt> > ../test/recipes/90-test_srp.t ............. ok
>matt> > ../test/recipes/90-test_v3name.t .......... ok
>matt> >
>matt> > Test Summary Report
>matt> > -------------------
>matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0
>Failed: 0)
>matt> >   Non-zero exit status: 255
>matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4
>Failed: 1)
>matt> >   Failed test:  4
>matt> >   Non-zero exit status: 1
>matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys +
>18.40 cusr
>matt> >  8.32 csys = 27.09 CPU)
>matt> > Result: FAIL
>matt> > Failed 4/63 test programs. 1/324 subtests failed.
>matt> > make[1]: *** [tests] Error 255
>matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
>matt> > make: *** [tests] Error 2
>matt> > $ gcc -v
>matt> > Using built-in specs.
>matt> > COLLECT_GCC=gcc
>matt> > COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
>matt> > Target: x86_64-linux-gnu
>matt> > Configured with: ../src/configure -v --with-pkgversion='Ubuntu
>matt> > 4.8.4-2ubuntu1~14.04'
>matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
>matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++
>--prefix=/usr
>matt> > --program-suffix=-4.8 --enable-shared --enable-linker-build-id
>matt> > --libexecdir=/usr/lib --without-included-gettext
>--enable-threads=posix
>matt> > --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
>matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
>matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
>matt> > --enable-gnu-unique-object --disable-libmudflap --enable-plugin
>matt> > --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
>matt> > --enable-gtk-cairo
>matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
>matt> > --enable-java-home
>matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
>matt> > --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
>matt> > --with-arch-directory=amd64
>matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
>matt> > --enable-multiarch --disable-werror --with-arch-32=i686
>--with-abi=m64
>matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
>matt> > --enable-checking=release --build=x86_64-linux-gnu
>matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
>matt> > Thread model: posix
>matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
>matt> > --
>matt> > Regards,
>matt> > Uri Blumenthal
>matt> >
>matt> >
>matt> > _______________________________________________
>matt> > openssl-dev mailing list
>matt> > To unsubscribe:
>https://mta.openssl.org/mailman/listinfo/openssl-dev
>matt> >
>matt> _______________________________________________
>matt> openssl-dev mailing list
>matt> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Richard Levitte - VMS Whacker
Did you apply the full patch?  The was a part for
test/recipes/70-test_sslextension.t that should have had it generate
debugging output...

In message <D221B126.1F30D%[hidden email]> on Fri, 18 Sep 2015 16:18:53 +0000, "Blumenthal, Uri - 0553 - MITLL" <[hidden email]> said:

uri> Richard,
uri>
uri> Thank you for your help! Unfortunately, the problem persists:
uri>
uri> testing...
uri> make[1]: Entering directory `/media/uri/Src/openssl/test'
uri> make[2]: Entering directory `/media/uri/Src/openssl'
uri> making all in apps...
uri> make[3]: Entering directory `/media/uri/Src/openssl/apps'
uri> make[3]: Nothing to be done for `all'.
uri> make[3]: Leaving directory `/media/uri/Src/openssl/apps'
uri> make[2]: Leaving directory `/media/uri/Src/openssl'
uri> TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
uri> ../test/recipes/00-check_testexes.t ....... ok
uri> ../test/recipes/05-test_bf.t .............. ok
uri> ../test/recipes/05-test_cast.t ............ ok
uri> ../test/recipes/05-test_des.t ............. ok
uri> ../test/recipes/05-test_hmac.t ............ ok
uri> ../test/recipes/05-test_idea.t ............ ok
uri> ../test/recipes/05-test_md2.t ............. ok
uri> ../test/recipes/05-test_md4.t ............. ok
uri> ../test/recipes/05-test_md5.t ............. ok
uri> ../test/recipes/05-test_mdc2.t ............ ok
uri> ../test/recipes/05-test_rand.t ............ ok
uri> ../test/recipes/05-test_rc2.t ............. ok
uri> ../test/recipes/05-test_rc4.t ............. ok
uri> ../test/recipes/05-test_rc5.t ............. ok
uri> ../test/recipes/05-test_rmd.t ............. ok
uri> ../test/recipes/05-test_sha1.t ............ ok
uri> ../test/recipes/05-test_sha256.t .......... ok
uri> ../test/recipes/05-test_sha512.t .......... ok
uri> ../test/recipes/05-test_wp.t .............. ok
uri> ../test/recipes/10-test_bn.t .............. ok
uri> ../test/recipes/10-test_exp.t ............. ok
uri> ../test/recipes/15-test_dh.t .............. ok
uri> ../test/recipes/15-test_dsa.t ............. ok
uri> ../test/recipes/15-test_ec.t .............. ok
uri> ../test/recipes/15-test_ecdh.t ............ ok
uri> ../test/recipes/15-test_ecdsa.t ........... ok
uri> ../test/recipes/15-test_rsa.t ............. ok
uri> ../test/recipes/20-test_enc.t ............. ok
uri> ../test/recipes/25-test_crl.t ............. ok
uri> ../test/recipes/25-test_gen.t ............. ok
uri> ../test/recipes/25-test_pkcs7.t ........... ok
uri> ../test/recipes/25-test_req.t ............. ok
uri> ../test/recipes/25-test_sid.t ............. ok
uri> ../test/recipes/25-test_verify.t .......... ok
uri> ../test/recipes/25-test_x509.t ............ ok
uri> ../test/recipes/30-test_engine.t .......... ok
uri> ../test/recipes/30-test_evp.t ............. ok
uri> ../test/recipes/30-test_evp_extra.t ....... ok
uri> ../test/recipes/30-test_pbelu.t ........... ok
uri> ../test/recipes/40-test_rehash.t .......... ok
uri> ../test/recipes/70-test_clienthello.t ..... ok
uri> ../test/recipes/70-test_packet.t .......... ok
uri> Use of uninitialized value within %message_type in concatenation (.) or
uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> Changed peer, but we still have fragment data
uri> # Looks like your test exited with 255 before it could output anything.
uri> ../test/recipes/70-test_sslextension.t ....
uri> Dubious, test returned 255 (wstat 65280, 0xff00)
uri> Failed 1/1 subtests
uri> Use of uninitialized value within %message_type in concatenation (.) or
uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> Changed peer, but we still have fragment data
uri> # Looks like your test exited with 255 before it could output anything.
uri> ../test/recipes/70-test_sslsessiontick.t ..
uri> Dubious, test returned 255 (wstat 65280, 0xff00)
uri> Failed 5/5 subtests
uri> ../test/recipes/70-test_sslskewith0p.t .... ok
uri> Use of uninitialized value within %message_type in concatenation (.) or
uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> Changed peer, but we still have fragment data
uri> # Looks like your test exited with 255 before it could output anything.
uri> ../test/recipes/70-test_sslvertol.t .......
uri> Dubious, test returned 255 (wstat 65280, 0xff00)
uri> Failed 2/2 subtests
uri> ../test/recipes/70-test_verify_extra.t .... ok
uri> ../test/recipes/80-test_ca.t .............. ok
uri>     # Looks like you planned 11 tests but ran 20.
uri>
uri> #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
uri> # '
uri> #   at ../test/recipes/80-test_cms.t line 460.
uri> # Looks like you failed 1 test of 4.
uri> ../test/recipes/80-test_cms.t .............
uri> Dubious, test returned 1 (wstat 256, 0x100)
uri> Failed 1/4 subtests
uri> ../test/recipes/80-test_ocsp.t ............ ok
uri> ../test/recipes/80-test_ssl.t ............. ok
uri> ../test/recipes/80-test_tsa.t ............. ok
uri> ../test/recipes/90-test_constant_time.t ... ok
uri> ../test/recipes/90-test_gmdiff.t .......... ok
uri> ../test/recipes/90-test_gost2814789.t ..... ok
uri> ../test/recipes/90-test_heartbeat.t ....... ok
uri> ../test/recipes/90-test_ige.t ............. ok
uri> ../test/recipes/90-test_jpake.t ........... ok
uri> ../test/recipes/90-test_np.t .............. ok
uri> ../test/recipes/90-test_p5_crpt2.t ........ ok
uri> ../test/recipes/90-test_secmem.t .......... ok
uri> ../test/recipes/90-test_srp.t ............. ok
uri> ../test/recipes/90-test_v3name.t .......... ok
uri>
uri> Test Summary Report
uri> -------------------
uri> ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
uri>   Non-zero exit status: 255
uri>   Parse errors: Bad plan.  You planned 1 tests but ran 0.
uri> ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
uri>   Non-zero exit status: 255
uri>   Parse errors: Bad plan.  You planned 5 tests but ran 0.
uri> ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
uri>   Non-zero exit status: 255
uri>   Parse errors: Bad plan.  You planned 2 tests but ran 0.
uri> ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
uri>   Failed test:  4
uri>   Non-zero exit status: 1
uri> Files=63, Tests=324, 30 wallclock secs ( 0.31 usr  0.08 sys + 19.13 cusr
uri> 8.61 csys = 28.13 CPU)
uri> Result: FAIL
uri> Failed 4/63 test programs. 1/324 subtests failed.
uri> make[1]: *** [tests] Error 255
uri> make[1]: Leaving directory `/media/uri/Src/openssl/test'
uri> make: *** [tests] Error 2
uri>
uri>
uri>
uri> What can we (I :) do to either remedy it, or provide you more info to find
uri> the cause?
uri> --
uri> Regards,
uri> Uri Blumenthal
uri>
uri>
uri>
uri>
uri>
uri> On 9/18/15, 2:27 , "Richard Levitte" <[hidden email]> wrote:
uri>
uri> >I can't reproduce it either, but judging from the line number, it
uri> >looks like a surprise unknown message type.  Uri, the attached patch
uri> >and the following command line might help clear this up:
uri> >
uri> >    HARNESS_VERBOSE=yes make TESTS=test_sslextension test
uri> >
uri> >Cheers,
uri> >Richard
uri> >
uri> >In message <[hidden email]> on Thu, 17 Sep 2015 22:55:01
uri> >+0100, Matt Caswell <[hidden email]> said:
uri> >
uri> >matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
uri> >matt>
uri> >matt> Matt
uri> >matt>
uri> >matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
uri> >matt> > $ apps/openssl$ openssl version
uri> >matt> > OpenSSL 1.1.0-dev xx XXX xxxx
uri> >matt> > $ make test
uri> >matt> > testing...
uri> >matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
uri> >matt> > make[2]: Entering directory `/media/uri/Src/openssl'
uri> >matt> > making all in apps...
uri> >matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
uri> >matt> > make[3]: Nothing to be done for `all'.
uri> >matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
uri> >matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
uri> >matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
uri> >matt> > ../test/recipes/00-check_testexes.t ....... ok
uri> >matt> > ../test/recipes/05-test_bf.t .............. ok
uri> >matt> > ../test/recipes/05-test_cast.t ............ ok
uri> >matt> > ../test/recipes/05-test_des.t ............. ok
uri> >matt> > ../test/recipes/05-test_hmac.t ............ ok
uri> >matt> > ../test/recipes/05-test_idea.t ............ ok
uri> >matt> > ../test/recipes/05-test_md2.t ............. ok
uri> >matt> > ../test/recipes/05-test_md4.t ............. ok
uri> >matt> > ../test/recipes/05-test_md5.t ............. ok
uri> >matt> > ../test/recipes/05-test_mdc2.t ............ ok
uri> >matt> > ../test/recipes/05-test_rand.t ............ ok
uri> >matt> > ../test/recipes/05-test_rc2.t ............. ok
uri> >matt> > ../test/recipes/05-test_rc4.t ............. ok
uri> >matt> > ../test/recipes/05-test_rc5.t ............. ok
uri> >matt> > ../test/recipes/05-test_rmd.t ............. ok
uri> >matt> > ../test/recipes/05-test_sha1.t ............ ok
uri> >matt> > ../test/recipes/05-test_sha256.t .......... ok
uri> >matt> > ../test/recipes/05-test_sha512.t .......... ok
uri> >matt> > ../test/recipes/05-test_wp.t .............. ok
uri> >matt> > ../test/recipes/10-test_bn.t .............. ok
uri> >matt> > ../test/recipes/10-test_exp.t ............. ok
uri> >matt> > ../test/recipes/15-test_dh.t .............. ok
uri> >matt> > ../test/recipes/15-test_dsa.t ............. ok
uri> >matt> > ../test/recipes/15-test_ec.t .............. ok
uri> >matt> > ../test/recipes/15-test_ecdh.t ............ ok
uri> >matt> > ../test/recipes/15-test_ecdsa.t ........... ok
uri> >matt> > ../test/recipes/15-test_rsa.t ............. ok
uri> >matt> > ../test/recipes/20-test_enc.t ............. ok
uri> >matt> > ../test/recipes/25-test_crl.t ............. ok
uri> >matt> > ../test/recipes/25-test_gen.t ............. ok
uri> >matt> > ../test/recipes/25-test_pkcs7.t ........... ok
uri> >matt> > ../test/recipes/25-test_req.t ............. ok
uri> >matt> > ../test/recipes/25-test_sid.t ............. ok
uri> >matt> > ../test/recipes/25-test_verify.t .......... ok
uri> >matt> > ../test/recipes/25-test_x509.t ............ ok
uri> >matt> > ../test/recipes/30-test_engine.t .......... ok
uri> >matt> > ../test/recipes/30-test_evp.t ............. ok
uri> >matt> > ../test/recipes/30-test_evp_extra.t ....... ok
uri> >matt> > ../test/recipes/30-test_pbelu.t ........... ok
uri> >matt> > ../test/recipes/40-test_rehash.t .......... ok
uri> >matt> > ../test/recipes/70-test_clienthello.t ..... ok
uri> >matt> > ../test/recipes/70-test_packet.t .......... ok
uri> >matt> > Use of uninitialized value within %message_type in concatenation
uri> >(.) or
uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> >matt> > Changed peer, but we still have fragment data
uri> >matt> > # Looks like your test exited with 255 before it could output
uri> >anything.
uri> >matt> > ../test/recipes/70-test_sslextension.t ....
uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
uri> >matt> > Failed 1/1 subtests
uri> >matt> > Use of uninitialized value within %message_type in concatenation
uri> >(.) or
uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> >matt> > Changed peer, but we still have fragment data
uri> >matt> > # Looks like your test exited with 255 before it could output
uri> >anything.
uri> >matt> > ../test/recipes/70-test_sslsessiontick.t ..
uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
uri> >matt> > Failed 5/5 subtests
uri> >matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
uri> >matt> > Use of uninitialized value within %message_type in concatenation
uri> >(.) or
uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
uri> >matt> > Changed peer, but we still have fragment data
uri> >matt> > # Looks like your test exited with 255 before it could output
uri> >anything.
uri> >matt> > ../test/recipes/70-test_sslvertol.t .......
uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
uri> >matt> > Failed 2/2 subtests
uri> >matt> > ../test/recipes/70-test_verify_extra.t .... ok
uri> >matt> > ../test/recipes/80-test_ca.t .............. ok
uri> >matt> >     # Looks like you planned 11 tests but ran 20.
uri> >matt> >
uri> >matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
uri> >parameters
uri> >matt> > # '
uri> >matt> > #   at ../test/recipes/80-test_cms.t line 460.
uri> >matt> > # Looks like you failed 1 test of 4.
uri> >matt> > ../test/recipes/80-test_cms.t .............
uri> >matt> > Dubious, test returned 1 (wstat 256, 0x100)
uri> >matt> > Failed 1/4 subtests
uri> >matt> > ../test/recipes/80-test_ocsp.t ............ ok
uri> >matt> > ../test/recipes/80-test_ssl.t ............. ok
uri> >matt> > ../test/recipes/80-test_tsa.t ............. ok
uri> >matt> > ../test/recipes/90-test_constant_time.t ... ok
uri> >matt> > ../test/recipes/90-test_gmdiff.t .......... ok
uri> >matt> > ../test/recipes/90-test_gost2814789.t ..... ok
uri> >matt> > ../test/recipes/90-test_heartbeat.t ....... ok
uri> >matt> > ../test/recipes/90-test_ige.t ............. ok
uri> >matt> > ../test/recipes/90-test_jpake.t ........... ok
uri> >matt> > ../test/recipes/90-test_np.t .............. ok
uri> >matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
uri> >matt> > ../test/recipes/90-test_secmem.t .......... ok
uri> >matt> > ../test/recipes/90-test_srp.t ............. ok
uri> >matt> > ../test/recipes/90-test_v3name.t .......... ok
uri> >matt> >
uri> >matt> > Test Summary Report
uri> >matt> > -------------------
uri> >matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0
uri> >Failed: 0)
uri> >matt> >   Non-zero exit status: 255
uri> >matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
uri> >matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0
uri> >Failed: 0)
uri> >matt> >   Non-zero exit status: 255
uri> >matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
uri> >matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0
uri> >Failed: 0)
uri> >matt> >   Non-zero exit status: 255
uri> >matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
uri> >matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4
uri> >Failed: 1)
uri> >matt> >   Failed test:  4
uri> >matt> >   Non-zero exit status: 1
uri> >matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys +
uri> >18.40 cusr
uri> >matt> >  8.32 csys = 27.09 CPU)
uri> >matt> > Result: FAIL
uri> >matt> > Failed 4/63 test programs. 1/324 subtests failed.
uri> >matt> > make[1]: *** [tests] Error 255
uri> >matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
uri> >matt> > make: *** [tests] Error 2
uri> >matt> > $ gcc -v
uri> >matt> > Using built-in specs.
uri> >matt> > COLLECT_GCC=gcc
uri> >matt> > COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
uri> >matt> > Target: x86_64-linux-gnu
uri> >matt> > Configured with: ../src/configure -v --with-pkgversion='Ubuntu
uri> >matt> > 4.8.4-2ubuntu1~14.04'
uri> >matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
uri> >matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++
uri> >--prefix=/usr
uri> >matt> > --program-suffix=-4.8 --enable-shared --enable-linker-build-id
uri> >matt> > --libexecdir=/usr/lib --without-included-gettext
uri> >--enable-threads=posix
uri> >matt> > --with-gxx-include-dir=/usr/include/c++/4.8 --libdir=/usr/lib
uri> >matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
uri> >matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
uri> >matt> > --enable-gnu-unique-object --disable-libmudflap --enable-plugin
uri> >matt> > --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk
uri> >matt> > --enable-gtk-cairo
uri> >matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
uri> >matt> > --enable-java-home
uri> >matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
uri> >matt> > --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
uri> >matt> > --with-arch-directory=amd64
uri> >matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc
uri> >matt> > --enable-multiarch --disable-werror --with-arch-32=i686
uri> >--with-abi=m64
uri> >matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
uri> >matt> > --enable-checking=release --build=x86_64-linux-gnu
uri> >matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
uri> >matt> > Thread model: posix
uri> >matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
uri> >matt> > --
uri> >matt> > Regards,
uri> >matt> > Uri Blumenthal
uri> >matt> >
uri> >matt> >
uri> >matt> > _______________________________________________
uri> >matt> > openssl-dev mailing list
uri> >matt> > To unsubscribe:
uri> >https://mta.openssl.org/mailman/listinfo/openssl-dev
uri> >matt> >
uri> >matt> _______________________________________________
uri> >matt> openssl-dev mailing list
uri> >matt> To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
On 9/18/15, 15:15 , "Richard Levitte" <[hidden email]> wrote:

>Did you apply the full patch?  The was a part for
>test/recipes/70-test_sslextension.t that should have had it generate
>debugging output...

Yes I’m sure I did. And I’m as surprised as you are to not see the
expected output from at least “Message.pm”…


In message <D221B126.1F30D%[hidden email]> on Fri, 18 Sep 2015 16:18:53
+0000, "Blumenthal, Uri - 0553 - MITLL" <[hidden email]> said:

>uri> Richard,
>uri>
>uri> Thank you for your help! Unfortunately, the problem persists:
>uri>
>uri> testing...
>uri> make[1]: Entering directory `/media/uri/Src/openssl/test'
>uri> make[2]: Entering directory `/media/uri/Src/openssl'
>uri> making all in apps...
>uri> make[3]: Entering directory `/media/uri/Src/openssl/apps'
>uri> make[3]: Nothing to be done for `all'.
>uri> make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>uri> make[2]: Leaving directory `/media/uri/Src/openssl'
>uri> TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
>uri> ../test/recipes/00-check_testexes.t ....... ok
>uri> ../test/recipes/05-test_bf.t .............. ok
>uri> ../test/recipes/05-test_cast.t ............ ok
>uri> ../test/recipes/05-test_des.t ............. ok
>uri> ../test/recipes/05-test_hmac.t ............ ok
>uri> ../test/recipes/05-test_idea.t ............ ok
>uri> ../test/recipes/05-test_md2.t ............. ok
>uri> ../test/recipes/05-test_md4.t ............. ok
>uri> ../test/recipes/05-test_md5.t ............. ok
>uri> ../test/recipes/05-test_mdc2.t ............ ok
>uri> ../test/recipes/05-test_rand.t ............ ok
>uri> ../test/recipes/05-test_rc2.t ............. ok
>uri> ../test/recipes/05-test_rc4.t ............. ok
>uri> ../test/recipes/05-test_rc5.t ............. ok
>uri> ../test/recipes/05-test_rmd.t ............. ok
>uri> ../test/recipes/05-test_sha1.t ............ ok
>uri> ../test/recipes/05-test_sha256.t .......... ok
>uri> ../test/recipes/05-test_sha512.t .......... ok
>uri> ../test/recipes/05-test_wp.t .............. ok
>uri> ../test/recipes/10-test_bn.t .............. ok
>uri> ../test/recipes/10-test_exp.t ............. ok
>uri> ../test/recipes/15-test_dh.t .............. ok
>uri> ../test/recipes/15-test_dsa.t ............. ok
>uri> ../test/recipes/15-test_ec.t .............. ok
>uri> ../test/recipes/15-test_ecdh.t ............ ok
>uri> ../test/recipes/15-test_ecdsa.t ........... ok
>uri> ../test/recipes/15-test_rsa.t ............. ok
>uri> ../test/recipes/20-test_enc.t ............. ok
>uri> ../test/recipes/25-test_crl.t ............. ok
>uri> ../test/recipes/25-test_gen.t ............. ok
>uri> ../test/recipes/25-test_pkcs7.t ........... ok
>uri> ../test/recipes/25-test_req.t ............. ok
>uri> ../test/recipes/25-test_sid.t ............. ok
>uri> ../test/recipes/25-test_verify.t .......... ok
>uri> ../test/recipes/25-test_x509.t ............ ok
>uri> ../test/recipes/30-test_engine.t .......... ok
>uri> ../test/recipes/30-test_evp.t ............. ok
>uri> ../test/recipes/30-test_evp_extra.t ....... ok
>uri> ../test/recipes/30-test_pbelu.t ........... ok
>uri> ../test/recipes/40-test_rehash.t .......... ok
>uri> ../test/recipes/70-test_clienthello.t ..... ok
>uri> ../test/recipes/70-test_packet.t .......... ok
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslextension.t ....
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 1/1 subtests
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslsessiontick.t ..
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 5/5 subtests
>uri> ../test/recipes/70-test_sslskewith0p.t .... ok
>uri> Use of uninitialized value within %message_type in concatenation (.)
>or
>uri> string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> Changed peer, but we still have fragment data
>uri> # Looks like your test exited with 255 before it could output
>anything.
>uri> ../test/recipes/70-test_sslvertol.t .......
>uri> Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> Failed 2/2 subtests
>uri> ../test/recipes/70-test_verify_extra.t .... ok
>uri> ../test/recipes/80-test_ca.t .............. ok
>uri>     # Looks like you planned 11 tests but ran 20.
>uri>
>uri> #   Failed test 'CMS <=> CMS consistency tests, modified key
>parameters
>uri> # '
>uri> #   at ../test/recipes/80-test_cms.t line 460.
>uri> # Looks like you failed 1 test of 4.
>uri> ../test/recipes/80-test_cms.t .............
>uri> Dubious, test returned 1 (wstat 256, 0x100)
>uri> Failed 1/4 subtests
>uri> ../test/recipes/80-test_ocsp.t ............ ok
>uri> ../test/recipes/80-test_ssl.t ............. ok
>uri> ../test/recipes/80-test_tsa.t ............. ok
>uri> ../test/recipes/90-test_constant_time.t ... ok
>uri> ../test/recipes/90-test_gmdiff.t .......... ok
>uri> ../test/recipes/90-test_gost2814789.t ..... ok
>uri> ../test/recipes/90-test_heartbeat.t ....... ok
>uri> ../test/recipes/90-test_ige.t ............. ok
>uri> ../test/recipes/90-test_jpake.t ........... ok
>uri> ../test/recipes/90-test_np.t .............. ok
>uri> ../test/recipes/90-test_p5_crpt2.t ........ ok
>uri> ../test/recipes/90-test_secmem.t .......... ok
>uri> ../test/recipes/90-test_srp.t ............. ok
>uri> ../test/recipes/90-test_v3name.t .......... ok
>uri>
>uri> Test Summary Report
>uri> -------------------
>uri> ../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>uri> ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>uri> ../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0
>Failed: 0)
>uri>   Non-zero exit status: 255
>uri>   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>uri> ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed:
>1)
>uri>   Failed test:  4
>uri>   Non-zero exit status: 1
>uri> Files=63, Tests=324, 30 wallclock secs ( 0.31 usr  0.08 sys + 19.13
>cusr
>uri> 8.61 csys = 28.13 CPU)
>uri> Result: FAIL
>uri> Failed 4/63 test programs. 1/324 subtests failed.
>uri> make[1]: *** [tests] Error 255
>uri> make[1]: Leaving directory `/media/uri/Src/openssl/test'
>uri> make: *** [tests] Error 2
>uri>
>uri>
>uri>
>uri> What can we (I :) do to either remedy it, or provide you more info
>to find
>uri> the cause?
>uri> --
>uri> Regards,
>uri> Uri Blumenthal
>uri>
>uri>
>uri>
>uri>
>uri>
>uri> On 9/18/15, 2:27 , "Richard Levitte" <[hidden email]> wrote:
>uri>
>uri> >I can't reproduce it either, but judging from the line number, it
>uri> >looks like a surprise unknown message type.  Uri, the attached patch
>uri> >and the following command line might help clear this up:
>uri> >
>uri> >    HARNESS_VERBOSE=yes make TESTS=test_sslextension test
>uri> >
>uri> >Cheers,
>uri> >Richard
>uri> >
>uri> >In message <[hidden email]> on Thu, 17 Sep 2015 22:55:01
>uri> >+0100, Matt Caswell <[hidden email]> said:
>uri> >
>uri> >matt> Hmmm. I cannot reproduce this. Is anyone else seeing this?
>uri> >matt>
>uri> >matt> Matt
>uri> >matt>
>uri> >matt> On 17/09/15 20:15, Blumenthal, Uri - 0553 - MITLL wrote:
>uri> >matt> > $ apps/openssl$ openssl version
>uri> >matt> > OpenSSL 1.1.0-dev xx XXX xxxx
>uri> >matt> > $ make test
>uri> >matt> > testing...
>uri> >matt> > make[1]: Entering directory `/media/uri/Src/openssl/test'
>uri> >matt> > make[2]: Entering directory `/media/uri/Src/openssl'
>uri> >matt> > making all in apps...
>uri> >matt> > make[3]: Entering directory `/media/uri/Src/openssl/apps'
>uri> >matt> > make[3]: Nothing to be done for `all'.
>uri> >matt> > make[3]: Leaving directory `/media/uri/Src/openssl/apps'
>uri> >matt> > make[2]: Leaving directory `/media/uri/Src/openssl'
>uri> >matt> > TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl
>alltests
>uri> >matt> > ../test/recipes/00-check_testexes.t ....... ok
>uri> >matt> > ../test/recipes/05-test_bf.t .............. ok
>uri> >matt> > ../test/recipes/05-test_cast.t ............ ok
>uri> >matt> > ../test/recipes/05-test_des.t ............. ok
>uri> >matt> > ../test/recipes/05-test_hmac.t ............ ok
>uri> >matt> > ../test/recipes/05-test_idea.t ............ ok
>uri> >matt> > ../test/recipes/05-test_md2.t ............. ok
>uri> >matt> > ../test/recipes/05-test_md4.t ............. ok
>uri> >matt> > ../test/recipes/05-test_md5.t ............. ok
>uri> >matt> > ../test/recipes/05-test_mdc2.t ............ ok
>uri> >matt> > ../test/recipes/05-test_rand.t ............ ok
>uri> >matt> > ../test/recipes/05-test_rc2.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rc4.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rc5.t ............. ok
>uri> >matt> > ../test/recipes/05-test_rmd.t ............. ok
>uri> >matt> > ../test/recipes/05-test_sha1.t ............ ok
>uri> >matt> > ../test/recipes/05-test_sha256.t .......... ok
>uri> >matt> > ../test/recipes/05-test_sha512.t .......... ok
>uri> >matt> > ../test/recipes/05-test_wp.t .............. ok
>uri> >matt> > ../test/recipes/10-test_bn.t .............. ok
>uri> >matt> > ../test/recipes/10-test_exp.t ............. ok
>uri> >matt> > ../test/recipes/15-test_dh.t .............. ok
>uri> >matt> > ../test/recipes/15-test_dsa.t ............. ok
>uri> >matt> > ../test/recipes/15-test_ec.t .............. ok
>uri> >matt> > ../test/recipes/15-test_ecdh.t ............ ok
>uri> >matt> > ../test/recipes/15-test_ecdsa.t ........... ok
>uri> >matt> > ../test/recipes/15-test_rsa.t ............. ok
>uri> >matt> > ../test/recipes/20-test_enc.t ............. ok
>uri> >matt> > ../test/recipes/25-test_crl.t ............. ok
>uri> >matt> > ../test/recipes/25-test_gen.t ............. ok
>uri> >matt> > ../test/recipes/25-test_pkcs7.t ........... ok
>uri> >matt> > ../test/recipes/25-test_req.t ............. ok
>uri> >matt> > ../test/recipes/25-test_sid.t ............. ok
>uri> >matt> > ../test/recipes/25-test_verify.t .......... ok
>uri> >matt> > ../test/recipes/25-test_x509.t ............ ok
>uri> >matt> > ../test/recipes/30-test_engine.t .......... ok
>uri> >matt> > ../test/recipes/30-test_evp.t ............. ok
>uri> >matt> > ../test/recipes/30-test_evp_extra.t ....... ok
>uri> >matt> > ../test/recipes/30-test_pbelu.t ........... ok
>uri> >matt> > ../test/recipes/40-test_rehash.t .......... ok
>uri> >matt> > ../test/recipes/70-test_clienthello.t ..... ok
>uri> >matt> > ../test/recipes/70-test_packet.t .......... ok
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslextension.t ....
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 1/1 subtests
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslsessiontick.t ..
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 5/5 subtests
>uri> >matt> > ../test/recipes/70-test_sslskewith0p.t .... ok
>uri> >matt> > Use of uninitialized value within %message_type in
>concatenation
>uri> >(.) or
>uri> >matt> > string at ../util/TLSProxy/Message.pm line 202, <> line 751.
>uri> >matt> > Changed peer, but we still have fragment data
>uri> >matt> > # Looks like your test exited with 255 before it could
>output
>uri> >anything.
>uri> >matt> > ../test/recipes/70-test_sslvertol.t .......
>uri> >matt> > Dubious, test returned 255 (wstat 65280, 0xff00)
>uri> >matt> > Failed 2/2 subtests
>uri> >matt> > ../test/recipes/70-test_verify_extra.t .... ok
>uri> >matt> > ../test/recipes/80-test_ca.t .............. ok
>uri> >matt> >     # Looks like you planned 11 tests but ran 20.
>uri> >matt> >
>uri> >matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
>uri> >parameters
>uri> >matt> > # '
>uri> >matt> > #   at ../test/recipes/80-test_cms.t line 460.
>uri> >matt> > # Looks like you failed 1 test of 4.
>uri> >matt> > ../test/recipes/80-test_cms.t .............
>uri> >matt> > Dubious, test returned 1 (wstat 256, 0x100)
>uri> >matt> > Failed 1/4 subtests
>uri> >matt> > ../test/recipes/80-test_ocsp.t ............ ok
>uri> >matt> > ../test/recipes/80-test_ssl.t ............. ok
>uri> >matt> > ../test/recipes/80-test_tsa.t ............. ok
>uri> >matt> > ../test/recipes/90-test_constant_time.t ... ok
>uri> >matt> > ../test/recipes/90-test_gmdiff.t .......... ok
>uri> >matt> > ../test/recipes/90-test_gost2814789.t ..... ok
>uri> >matt> > ../test/recipes/90-test_heartbeat.t ....... ok
>uri> >matt> > ../test/recipes/90-test_ige.t ............. ok
>uri> >matt> > ../test/recipes/90-test_jpake.t ........... ok
>uri> >matt> > ../test/recipes/90-test_np.t .............. ok
>uri> >matt> > ../test/recipes/90-test_p5_crpt2.t ........ ok
>uri> >matt> > ../test/recipes/90-test_secmem.t .......... ok
>uri> >matt> > ../test/recipes/90-test_srp.t ............. ok
>uri> >matt> > ../test/recipes/90-test_v3name.t .......... ok
>uri> >matt> >
>uri> >matt> > Test Summary Report
>uri> >matt> > -------------------
>uri> >matt> > ../test/recipes/70-test_sslextension.t  (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 1 tests but ran 0.
>uri> >matt> > ../test/recipes/70-test_sslsessiontick.t (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 5 tests but ran 0.
>uri> >matt> > ../test/recipes/70-test_sslvertol.t     (Wstat: 65280
>Tests: 0
>uri> >Failed: 0)
>uri> >matt> >   Non-zero exit status: 255
>uri> >matt> >   Parse errors: Bad plan.  You planned 2 tests but ran 0.
>uri> >matt> > ../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4
>uri> >Failed: 1)
>uri> >matt> >   Failed test:  4
>uri> >matt> >   Non-zero exit status: 1
>uri> >matt> > Files=63, Tests=324, 27 wallclock secs ( 0.32 usr  0.05 sys
>+
>uri> >18.40 cusr
>uri> >matt> >  8.32 csys = 27.09 CPU)
>uri> >matt> > Result: FAIL
>uri> >matt> > Failed 4/63 test programs. 1/324 subtests failed.
>uri> >matt> > make[1]: *** [tests] Error 255
>uri> >matt> > make[1]: Leaving directory `/media/uri/Src/openssl/test'
>uri> >matt> > make: *** [tests] Error 2
>uri> >matt> > $ gcc -v
>uri> >matt> > Using built-in specs.
>uri> >matt> > COLLECT_GCC=gcc
>uri> >matt> >
>COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/4.8/lto-wrapper
>uri> >matt> > Target: x86_64-linux-gnu
>uri> >matt> > Configured with: ../src/configure -v
>--with-pkgversion='Ubuntu
>uri> >matt> > 4.8.4-2ubuntu1~14.04'
>uri> >matt> > --with-bugurl=file:///usr/share/doc/gcc-4.8/README.Bugs
>uri> >matt> > --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++
>uri> >--prefix=/usr
>uri> >matt> > --program-suffix=-4.8 --enable-shared
>--enable-linker-build-id
>uri> >matt> > --libexecdir=/usr/lib --without-included-gettext
>uri> >--enable-threads=posix
>uri> >matt> > --with-gxx-include-dir=/usr/include/c++/4.8
>--libdir=/usr/lib
>uri> >matt> > --enable-nls --with-sysroot=/ --enable-clocale=gnu
>uri> >matt> > --enable-libstdcxx-debug --enable-libstdcxx-time=yes
>uri> >matt> > --enable-gnu-unique-object --disable-libmudflap
>--enable-plugin
>uri> >matt> > --with-system-zlib --disable-browser-plugin
>--enable-java-awt=gtk
>uri> >matt> > --enable-gtk-cairo
>uri> >matt> > --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre
>uri> >matt> > --enable-java-home
>uri> >matt> > --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64
>uri> >matt> >
>--with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64
>uri> >matt> > --with-arch-directory=amd64
>uri> >matt> > --with-ecj-jar=/usr/share/java/eclipse-ecj.jar
>--enable-objc-gc
>uri> >matt> > --enable-multiarch --disable-werror --with-arch-32=i686
>uri> >--with-abi=m64
>uri> >matt> > --with-multilib-list=m32,m64,mx32 --with-tune=generic
>uri> >matt> > --enable-checking=release --build=x86_64-linux-gnu
>uri> >matt> > --host=x86_64-linux-gnu --target=x86_64-linux-gnu
>uri> >matt> > Thread model: posix
>uri> >matt> > gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04)
>uri> >matt> > --
>uri> >matt> > Regards,
>uri> >matt> > Uri Blumenthal
>uri> >matt> >
>uri> >matt> >
>uri> >matt> > _______________________________________________
>uri> >matt> > openssl-dev mailing list
>uri> >matt> > To unsubscribe:
>uri> >https://mta.openssl.org/mailman/listinfo/openssl-dev
>uri> >matt> >
>uri> >matt> _______________________________________________
>uri> >matt> openssl-dev mailing list
>uri> >matt> To unsubscribe:
>https://mta.openssl.org/mailman/listinfo/openssl-dev

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Richard Levitte - VMS Whacker
In message <D221DC6B.1F354%[hidden email]> on Fri, 18 Sep 2015 19:23:09 +0000, "Blumenthal, Uri - 0553 - MITLL" <[hidden email]> said:

uri> On 9/18/15, 15:15 , "Richard Levitte" <[hidden email]> wrote:
uri>
uri> >Did you apply the full patch?  The was a part for
uri> >test/recipes/70-test_sslextension.t that should have had it generate
uri> >debugging output...
uri>
uri> Yes I’m sure I did. And I’m as surprised as you are to not see the
uri> expected output from at least “Message.pm”…

You can look for yourself, $proxy should be assigned like this:

my $proxy = TLSProxy::Proxy->new(
    \&extension_filter,
    cmdstr(app(["openssl"])),
    top_file("apps", "server.pem"),
    1        # <========= This is what turns on the debugging output
);

--
Richard Levitte                         [hidden email]
                                        http://richard.levitte.org/

"Life is a tremendous celebration - and I'm invited!"
-- from a friend's blog, translated from Swedish
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
Yes, it certainly is:

...

$ENV{OPENSSL_ENGINES} = top_dir("engines");
$ENV{OPENSSL_ia32cap} = '~0x200000200000000';
my $proxy = TLSProxy::Proxy->new(
    \&extension_filter,
    cmdstr(app(["openssl"])),
    top_file("apps", "server.pem"),
    1
);

plan tests => 1;

...


--
Regards,
Uri Blumenthal





On 9/18/15, 15:46 , "Richard Levitte" <[hidden email]> wrote:

>In message <D221DC6B.1F354%[hidden email]> on Fri, 18 Sep 2015 19:23:09
>+0000, "Blumenthal, Uri - 0553 - MITLL" <[hidden email]> said:
>
>uri> On 9/18/15, 15:15 , "Richard Levitte" <[hidden email]> wrote:
>uri>
>uri> >Did you apply the full patch?  The was a part for
>uri> >test/recipes/70-test_sslextension.t that should have had it generate
>uri> >debugging output...
>uri>
>uri> Yes I’m sure I did. And I’m as surprised as you are to not see the
>uri> expected output from at least “Message.pm”…
>
>You can look for yourself, $proxy should be assigned like this:
>
>my $proxy = TLSProxy::Proxy->new(
>    \&extension_filter,
>    cmdstr(app(["openssl"])),
>    top_file("apps", "server.pem"),
>    1        # <========= This is what turns on the debugging output
>);
>
>--
>Richard Levitte                         [hidden email]
>                                        http://richard.levitte.org/
>
>"Life is a tremendous celebration - and I'm invited!"
>-- from a friend's blog, translated from Swedish

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Matt Caswell-2
In reply to this post by Richard Levitte - VMS Whacker


On 18/09/15 20:46, Richard Levitte wrote:

> In message <D221DC6B.1F354%[hidden email]> on Fri, 18 Sep 2015 19:23:09 +0000, "Blumenthal, Uri - 0553 - MITLL" <[hidden email]> said:
>
> uri> On 9/18/15, 15:15 , "Richard Levitte" <[hidden email]> wrote:
> uri>
> uri> >Did you apply the full patch?  The was a part for
> uri> >test/recipes/70-test_sslextension.t that should have had it generate
> uri> >debugging output...
> uri>
> uri> Yes I’m sure I did. And I’m as surprised as you are to not see the
> uri> expected output from at least “Message.pm”…
>
> You can look for yourself, $proxy should be assigned like this:
>
> my $proxy = TLSProxy::Proxy->new(
>     \&extension_filter,
>     cmdstr(app(["openssl"])),
>     top_file("apps", "server.pem"),
>     1        # <========= This is what turns on the debugging output
> );
>

I encountered a problem with this the other day. Something in the
translation to the new test framework has borked debugging output. It
only seems to have affected stdout.

I had to additionally add this after the above line:
open(STDOUT, ">&STDERR");

Matt
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
On 9/18/15, 15:54 , "Matt Caswell" <[hidden email]> wrote:

>>You can look for yourself, $proxy should be assigned like this:
>>
>> my $proxy = TLSProxy::Proxy->new(
>>     \&extension_filter,
>>     cmdstr(app(["openssl"])),
>>     top_file("apps", "server.pem"),
>>     1        # <========= This is what turns on the debugging output
>> );
>>
>
>I encountered a problem with this the other day. Something in the
>translation to the new test framework has borked debugging output. It
>only seems to have affected stdout.
>
>I had to additionally add this after the above line:
>open(STDOUT, ">&STDERR");
Yes! Adding this line got the debugging output. Log file is attached, and
appended here (“About to run unpack()...” is my print/addition):

testing...
make[1]: Entering directory `/media/uri/Src/openssl/test'
make[2]: Entering directory `/media/uri/Src/openssl'
making all in apps...
make[3]: Entering directory `/media/uri/Src/openssl/apps'
make[3]: Nothing to be done for `all'.
make[3]: Leaving directory `/media/uri/Src/openssl/apps'
make[2]: Leaving directory `/media/uri/Src/openssl'
TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
../test/recipes/00-check_testexes.t ....... ok
../test/recipes/05-test_bf.t .............. ok
../test/recipes/05-test_cast.t ............ ok
../test/recipes/05-test_des.t ............. ok
../test/recipes/05-test_hmac.t ............ ok
../test/recipes/05-test_idea.t ............ ok
../test/recipes/05-test_md2.t ............. ok
../test/recipes/05-test_md4.t ............. ok
../test/recipes/05-test_md5.t ............. ok
../test/recipes/05-test_mdc2.t ............ ok
../test/recipes/05-test_rand.t ............ ok
../test/recipes/05-test_rc2.t ............. ok
../test/recipes/05-test_rc4.t ............. ok
../test/recipes/05-test_rc5.t ............. ok
../test/recipes/05-test_rmd.t ............. ok
../test/recipes/05-test_sha1.t ............ ok
../test/recipes/05-test_sha256.t .......... ok
../test/recipes/05-test_sha512.t .......... ok
../test/recipes/05-test_wp.t .............. ok
../test/recipes/10-test_bn.t .............. ok
../test/recipes/10-test_exp.t ............. ok
../test/recipes/15-test_dh.t .............. ok
../test/recipes/15-test_dsa.t ............. ok
../test/recipes/15-test_ec.t .............. ok
../test/recipes/15-test_ecdh.t ............ ok
../test/recipes/15-test_ecdsa.t ........... ok
../test/recipes/15-test_rsa.t ............. ok
../test/recipes/20-test_enc.t ............. ok
../test/recipes/25-test_crl.t ............. ok
../test/recipes/25-test_gen.t ............. ok
../test/recipes/25-test_pkcs7.t ........... ok
../test/recipes/25-test_req.t ............. ok
../test/recipes/25-test_sid.t ............. ok
../test/recipes/25-test_verify.t .......... ok
../test/recipes/25-test_x509.t ............ ok
../test/recipes/30-test_engine.t .......... ok
../test/recipes/30-test_evp.t ............. ok
../test/recipes/30-test_evp_extra.t ....... ok
../test/recipes/30-test_pbelu.t ........... ok
../test/recipes/40-test_rehash.t .......... ok
../test/recipes/70-test_clienthello.t ..... ok
../test/recipes/70-test_packet.t .......... ok
Proxy started on port 4453
Connection opened
Received client packet
Packet length = 374
Processing flight 0
 Record 1 (client -> server)
  Content type: HANDSHAKE
  Version: TLS1.0
  Length: 369
  About to run unpack()...
  Message length: 365
  Message type: ClientHello (1)
  Message Length: 365
    Client Version:771
    Session ID Len:0
    Ciphersuite len:230
    Compression Method Len:2
    Extensions Len:93


Forwarded packet length = 281


Received server packet
Packet length = 1113
Processing flight 1
 Record 1 (server -> client)
  Content type: HANDSHAKE
  Version: TLS1.2
  Length: 81
  About to run unpack()...
  Message length: 77
  Message type: ServerHello (2)
  Message Length: 77
    Server Version:771
    Session ID Len:32
    Ciphersuite:47
    Compression Method:1
    Extensions Len:5
 Record 2 (server -> client)
  Content type: HANDSHAKE
  Version: TLS1.2
  Length: 1013
  About to run unpack()...
  Message length: 1009
  Message type: Certificate (11)
  Message Length: 1009
 Record 3 (server -> client)
  Content type: HANDSHAKE
  Version: TLS1.2
  Length: 4
  About to run unpack()...
  Message length: 0
  Message type: ServerHelloDone (14)
  Message Length: 0


Forwarded packet length = 1113


Received client packet
Packet length = 342
Processing flight 2
 Record 1 (client -> server)
  Content type: HANDSHAKE
  Version: TLS1.2
  Length: 262
  About to run unpack()...
  Message length: 258
  Message type: ClientKeyExchange (16)
  Message Length: 258
 Record 2 (client -> server)
  Content type: CCS
  Version: TLS1.2
  Length: 1
 Record 3 (client -> server)
  Content type: HANDSHAKE
  Version: TLS1.2
  Length: 64
  About to run unpack()...
  Message length: 10228321
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 204, <> line 751.
  Message type:  (120)
  Message Length: 10228321


Forwarded packet length = 342


Received server packet
Packet length = 75
Processing flight 3
 Record 1 (server -> client)
  Content type: CCS
  Version: TLS1.2
  Length: 1
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslextension.t ....
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 1/1 subtests
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 204, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslsessiontick.t ..
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 5/5 subtests
../test/recipes/70-test_sslskewith0p.t .... ok
Use of uninitialized value within %message_type in concatenation (.) or
string at ../util/TLSProxy/Message.pm line 204, <> line 751.
Changed peer, but we still have fragment data
# Looks like your test exited with 255 before it could output anything.
../test/recipes/70-test_sslvertol.t .......
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 2/2 subtests
../test/recipes/70-test_verify_extra.t .... ok
../test/recipes/80-test_ca.t .............. ok
    # Looks like you planned 11 tests but ran 20.


#   Failed test 'CMS <=> CMS consistency tests, modified key parameters
# '
#   at ../test/recipes/80-test_cms.t line 460.
# Looks like you failed 1 test of 4.
../test/recipes/80-test_cms.t .............
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests
../test/recipes/80-test_ocsp.t ............ ok
../test/recipes/80-test_ssl.t ............. ok
../test/recipes/80-test_tsa.t ............. ok
../test/recipes/90-test_constant_time.t ... ok
../test/recipes/90-test_gmdiff.t .......... ok
../test/recipes/90-test_gost2814789.t ..... ok
../test/recipes/90-test_heartbeat.t ....... ok
../test/recipes/90-test_ige.t ............. ok
../test/recipes/90-test_jpake.t ........... ok
../test/recipes/90-test_np.t .............. ok
../test/recipes/90-test_p5_crpt2.t ........ ok
../test/recipes/90-test_secmem.t .......... ok
../test/recipes/90-test_srp.t ............. ok
../test/recipes/90-test_v3name.t .......... ok


Test Summary Report
-------------------
../test/recipes/70-test_sslextension.t  (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 1 tests but ran 0.
../test/recipes/70-test_sslsessiontick.t (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 5 tests but ran 0.
../test/recipes/70-test_sslvertol.t     (Wstat: 65280 Tests: 0 Failed: 0)
  Non-zero exit status: 255
  Parse errors: Bad plan.  You planned 2 tests but ran 0.
../test/recipes/80-test_cms.t           (Wstat: 256 Tests: 4 Failed: 1)
  Failed test:  4
  Non-zero exit status: 1
Files=63, Tests=324, 26 wallclock secs ( 0.33 usr  0.03 sys + 18.44 cusr
8.46 csys = 27.26 CPU)
Result: FAIL
Failed 4/63 test programs. 1/324 subtests failed.
make[1]: *** [tests] Error 255
make[1]: Leaving directory `/media/uri/Src/openssl/test'
make: *** [tests] Error 2



Thanks!


_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

make-test-out.txt (9K) Download Attachment
smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Matt Caswell-2


On 18/09/15 21:24, Blumenthal, Uri - 0553 - MITLL wrote:

> On 9/18/15, 15:54 , "Matt Caswell" <[hidden email]> wrote:
> Received server packet
> Packet length = 1113
> Processing flight 1
>  Record 1 (server -> client)
>   Content type: HANDSHAKE
>   Version: TLS1.2
>   Length: 81
>   About to run unpack()...
>   Message length: 77
>   Message type: ServerHello (2)
>   Message Length: 77
>     Server Version:771
>     Session ID Len:32
>     Ciphersuite:47

>     Compression Method:1

You have compiled in compression support? Can you try it without?

Thanks

Matt
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
In reply to this post by Blumenthal, Uri - 0553 - MITLL
I compiled with

  ./config threads shared zlib

Should I drop zlib and try again...?

Sent from my BlackBerry 10 smartphone on the Verizon Wireless 4G LTE network.
  Original Message  
From: Matt Caswell
Sent: Friday, September 18, 2015 18:01
To: Blumenthal, Uri - 0553 - MITLL; Richard Levitte
Cc: [hidden email]
Subject: Re: [openssl-dev] Some tests fail on the current/latest SNAP



On 18/09/15 21:24, Blumenthal, Uri - 0553 - MITLL wrote:

> On 9/18/15, 15:54 , "Matt Caswell" <[hidden email]> wrote:
> Received server packet
> Packet length = 1113
> Processing flight 1
> Record 1 (server -> client)
> Content type: HANDSHAKE
> Version: TLS1.2
> Length: 81
> About to run unpack()...
> Message length: 77
> Message type: ServerHello (2)
> Message Length: 77
> Server Version:771
> Session ID Len:32
> Ciphersuite:47

> Compression Method:1

You have compiled in compression support? Can you try it without?

Thanks

Matt


_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Matt Caswell-2


On 18/09/15 23:23, Blumenthal, Uri - 0553 - MITLL wrote:
> I compiled with
>
>   ./config threads shared zlib
>
> Should I drop zlib and try again...?

Yes please.

Thanks

Matt
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Matt Caswell-2
In reply to this post by Blumenthal, Uri - 0553 - MITLL
I've just pushed a partial fix for this issue. The TLS tests should now
pass for you in the latest master version in git. The new TLS test proxy
we are using does not support compression, but was failing to switch it
off if OpenSSL is configured for it.

However, this one is a different problem:

On 18/09/15 21:24, Blumenthal, Uri - 0553 - MITLL wrote

>     # Looks like you planned 11 tests but ran 20.
>
>
> #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
> # '
> #   at ../test/recipes/80-test_cms.t line 460.
> # Looks like you failed 1 test of 4.
> ../test/recipes/80-test_cms.t .............
> Dubious, test returned 1 (wstat 256, 0x100)
> Failed 1/4 subtests

This also seems to be related to Configuring with zlib in some way.

Matt


_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Richard Levitte - VMS Whacker
In message <[hidden email]> on Sat, 19 Sep 2015 20:35:13 +0100, Matt Caswell <[hidden email]> said:

matt> On 18/09/15 21:24, Blumenthal, Uri - 0553 - MITLL wrote
matt> >     # Looks like you planned 11 tests but ran 20.
matt> >
matt> >
matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key parameters
matt> > # '
matt> > #   at ../test/recipes/80-test_cms.t line 460.
matt> > # Looks like you failed 1 test of 4.
matt> > ../test/recipes/80-test_cms.t .............
matt> > Dubious, test returned 1 (wstat 256, 0x100)
matt> > Failed 1/4 subtests
matt>
matt> This also seems to be related to Configuring with zlib in some way.

FYI, problem fixed.  It was a typo in the compression test, so it used
the wrong array of parameters when trying to perform them.  However,
when OpenSSL is configured without zlib, that test is skipped, so the
fault went undetected for quite some time.

--
Richard Levitte                         [hidden email]
                                        http://richard.levitte.org/

"Life is a tremendous celebration - and I'm invited!"
-- from a friend's blog, translated from Swedish
_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev
Reply | Threaded
Open this post in threaded view
|

Re: Some tests fail on the current/latest SNAP

Blumenthal, Uri - 0553 - MITLL
Richard and Matt,

Thank you very much for your help. I confirm that the problems
disappeared, and all the tests now succeed:

$ make test
testing...
make[1]: Entering directory `/media/uri/Src/openssl/test'
make[2]: Entering directory `/media/uri/Src/openssl'
making all in apps...
make[3]: Entering directory `/media/uri/Src/openssl/apps'
make[3]: Nothing to be done for `all'.
make[3]: Leaving directory `/media/uri/Src/openssl/apps'
make[2]: Leaving directory `/media/uri/Src/openssl'
TOP=.. PERL=/usr/bin/perl /usr/bin/perl run_tests.pl alltests
../test/recipes/00-check_testexes.t ....... ok
../test/recipes/05-test_bf.t .............. ok
../test/recipes/05-test_cast.t ............ ok
../test/recipes/05-test_des.t ............. ok
../test/recipes/05-test_hmac.t ............ ok
../test/recipes/05-test_idea.t ............ ok
../test/recipes/05-test_md2.t ............. ok
../test/recipes/05-test_md4.t ............. ok
../test/recipes/05-test_md5.t ............. ok
../test/recipes/05-test_mdc2.t ............ ok
../test/recipes/05-test_rand.t ............ ok
../test/recipes/05-test_rc2.t ............. ok
../test/recipes/05-test_rc4.t ............. ok
../test/recipes/05-test_rc5.t ............. ok
../test/recipes/05-test_rmd.t ............. ok
../test/recipes/05-test_sha1.t ............ ok
../test/recipes/05-test_sha256.t .......... ok
../test/recipes/05-test_sha512.t .......... ok
../test/recipes/05-test_wp.t .............. ok
../test/recipes/10-test_bn.t .............. ok
../test/recipes/10-test_exp.t ............. ok
../test/recipes/15-test_dh.t .............. ok
../test/recipes/15-test_dsa.t ............. ok
../test/recipes/15-test_ec.t .............. ok
../test/recipes/15-test_ecdh.t ............ ok
../test/recipes/15-test_ecdsa.t ........... ok
../test/recipes/15-test_rsa.t ............. ok
../test/recipes/20-test_enc.t ............. ok
../test/recipes/25-test_crl.t ............. ok
../test/recipes/25-test_gen.t ............. ok
../test/recipes/25-test_pkcs7.t ........... ok
../test/recipes/25-test_req.t ............. ok
../test/recipes/25-test_sid.t ............. ok
../test/recipes/25-test_verify.t .......... ok
../test/recipes/25-test_x509.t ............ ok
../test/recipes/30-test_engine.t .......... ok
../test/recipes/30-test_evp.t ............. ok
../test/recipes/30-test_evp_extra.t ....... ok
../test/recipes/30-test_pbelu.t ........... ok
../test/recipes/40-test_rehash.t .......... ok
../test/recipes/70-test_clienthello.t ..... ok
../test/recipes/70-test_packet.t .......... ok
../test/recipes/70-test_sslextension.t .... ok
../test/recipes/70-test_sslsessiontick.t .. ok
../test/recipes/70-test_sslskewith0p.t .... ok
../test/recipes/70-test_sslvertol.t ....... ok
../test/recipes/70-test_verify_extra.t .... ok
../test/recipes/80-test_ca.t .............. ok
../test/recipes/80-test_cms.t ............. ok
../test/recipes/80-test_ocsp.t ............ ok
../test/recipes/80-test_ssl.t ............. ok
../test/recipes/80-test_tsa.t ............. ok
../test/recipes/90-test_constant_time.t ... ok
../test/recipes/90-test_gmdiff.t .......... ok
../test/recipes/90-test_gost2814789.t ..... ok
../test/recipes/90-test_heartbeat.t ....... ok
../test/recipes/90-test_ige.t ............. ok
../test/recipes/90-test_jpake.t ........... ok
../test/recipes/90-test_np.t .............. ok
../test/recipes/90-test_p5_crpt2.t ........ ok
../test/recipes/90-test_secmem.t .......... ok
../test/recipes/90-test_srp.t ............. ok
../test/recipes/90-test_v3name.t .......... ok
All tests successful.
Files=63, Tests=343, 29 wallclock secs ( 0.36 usr  0.05 sys + 19.63 cusr
8.62 csys = 28.66 CPU)
Result: PASS
make[1]: Leaving directory `/media/uri/Src/openssl/test'
OPENSSL_CONF=apps/openssl.cnf util/opensslwrap.sh version -a
OpenSSL 1.1.0-dev xx XXX xxxx
built on: reproducible build, date unspecified
platform: linux-x86_64
compiler: gcc -I. -I.. -I../include -Iinclude  -fPIC -DOPENSSL_PIC -DZLIB
-DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H
-Wa,--noexecstack -m64 -DL_ENDIAN -Wall -O3 -DOPENSSL_EXPERIMENTAL_JPAKE
-DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5
-DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM
-DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
-DECP_NISTZ256_ASM
OPENSSLDIR: "/usr/local/ssl"


--
Regards,
Uri Blumenthal





On 9/20/15, 14:09 , "Richard Levitte" <[hidden email]> wrote:

>In message <[hidden email]> on Sat, 19 Sep 2015 20:35:13
>+0100, Matt Caswell <[hidden email]> said:
>
>matt> On 18/09/15 21:24, Blumenthal, Uri - 0553 - MITLL wrote
>matt> >     # Looks like you planned 11 tests but ran 20.
>matt> >
>matt> >
>matt> > #   Failed test 'CMS <=> CMS consistency tests, modified key
>parameters
>matt> > # '
>matt> > #   at ../test/recipes/80-test_cms.t line 460.
>matt> > # Looks like you failed 1 test of 4.
>matt> > ../test/recipes/80-test_cms.t .............
>matt> > Dubious, test returned 1 (wstat 256, 0x100)
>matt> > Failed 1/4 subtests
>matt>
>matt> This also seems to be related to Configuring with zlib in some way.
>
>FYI, problem fixed.  It was a typo in the compression test, so it used
>the wrong array of parameters when trying to perform them.  However,
>when OpenSSL is configured without zlib, that test is skipped, so the
>fault went undetected for quite some time.
>
>--
>Richard Levitte                         [hidden email]
>                                        http://richard.levitte.org/
>
>"Life is a tremendous celebration - and I'm invited!"
>-- from a friend's blog, translated from Swedish

_______________________________________________
openssl-dev mailing list
To unsubscribe: https://mta.openssl.org/mailman/listinfo/openssl-dev

smime.p7s (5K) Download Attachment