export-validation in tests by default causing 32 bit Ubuntu to crash

classic Classic list List threaded Threaded
10 messages Options
slacka slacka
Reply | Threaded
Open this post in threaded view
|

export-validation in tests by default causing 32 bit Ubuntu to crash

Ever since
https://cgit.freedesktop.org/libreoffice/core/commit/?id=0868f670374cdcf6c2610d91ff8702f59b2e0bd3

With 32-bit Ubuntu 16.04, I'm getting the following build failure:

CUT] sw_ww8import
testTscp::Import_Export_Import finished in: 354ms
testFdo45724::Import finished in: 0ms
File tested,Execution Time (ms)
Segmentation fault (core dumped)

No core file identified in directory /core/workdir/CppunitTest/sw_ww8export.test.core
To show backtraces for crashes during test execution,
enable core files with:

   ulimit -c unlimited


Error: a unit test failed, please do one of:
make CppunitTest_sw_ww8export CPPUNITTRACE="gdb --args"
    # for interactive debugging on Linux
make CppunitTest_sw_ww8export VALGRIND=memcheck
    # for memory checking
make CppunitTest_sw_ww8export DEBUGCPPUNIT=TRUE
    # for exception catching

/core/solenv/gbuild/CppunitTest.mk:101: recipe for target '/core/workdir/CppunitTest/sw_ww8export.test' failed
make[1]: *** [/core/workdir/CppunitTest/sw_ww8export.test] Error 1
make[1]: *** Waiting for unfinished jobs....
Aborted (core dumped)
/core/test/source/bootstrapfixture.cxx:177:SdImportTest::testDocumentLayout
equality assertion failed
- Expected: 0
- Actual  : 34304
- failed to execute: sh /core/bin/officeotron.sh /tmp/lu16851plw1cl.tmp > /tmp/lu16851plw1cn.tmp

SdImportTest::testDocumentLayout finished in: 46233ms
SdImportTest::testSmoketest finished in: 200ms
SdImportTest::testN759180 finished in: 237ms
SdImportTest::testN778859 finished in: 253ms
...
SdImportTest::testTdf93868 finished in: 262ms
SdImportTest::testTdf95932 finished in: 230ms
SdImportTest::testTdf99030 finished in: 189ms
SdImportTest::testTdf49561 finished in: 105ms
bootstrapfixture.cxx:177:Assertion
Test name: SdImportTest::testDocumentLayout
equality assertion failed
- Expected: 0
- Actual  : 34304
- failed to execute: sh /core/bin/officeotron.sh /tmp/lu16851plw1cl.tmp > /tmp/lu16851plw1cn.tmp

Failures !!!
Run: 46   Failure total: 1   Failures: 1   Errors: 0

Error: a unit test failed, please do one of:
make CppunitTest_sd_import_tests CPPUNITTRACE="gdb --args"
    # for interactive debugging on Linux
make CppunitTest_sd_import_tests VALGRIND=memcheck
    # for memory checking
make CppunitTest_sd_import_tests DEBUGCPPUNIT=TRUE
    # for exception catching

/core/solenv/gbuild/CppunitTest.mk:101: recipe for target '/core/workdir/CppunitTest/sd_import_tests.test' failed
make[1]: *** [/core/workdir/CppunitTest/sd_import_tests.test] Error 1
Makefile:261: recipe for target 'build' failed
make: *** [build] Error 2

-----------------------

Vasily,
Is there anything else I can do to help you resolve this build failure?


_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice
Markus Mohrhard Markus Mohrhard
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

Hey Luke,

On Thu, Sep 8, 2016 at 6:44 PM, Luke Benes <[hidden email]> wrote:
Ever since
https://cgit.freedesktop.org/libreoffice/core/commit/?id=0868f670374cdcf6c2610d91ff8702f59b2e0bd3

With 32-bit Ubuntu 16.04, I'm getting the following build failure:

CUT] sw_ww8import
testTscp::Import_Export_Import finished in: 354ms
testFdo45724::Import finished in: 0ms
File tested,Execution Time (ms)
Segmentation fault (core dumped)

No core file identified in directory /core/workdir/CppunitTest/sw_ww8export.test.core
To show backtraces for crashes during test execution,
enable core files with:

   ulimit -c unlimited


Error: a unit test failed, please do one of:
make CppunitTest_sw_ww8export CPPUNITTRACE="gdb --args"
    # for interactive debugging on Linux
make CppunitTest_sw_ww8export VALGRIND=memcheck
    # for memory checking
make CppunitTest_sw_ww8export DEBUGCPPUNIT=TRUE
    # for exception catching

/core/solenv/gbuild/CppunitTest.mk:101: recipe for target '/core/workdir/CppunitTest/sw_ww8export.test' failed
make[1]: *** [/core/workdir/CppunitTest/sw_ww8export.test] Error 1
make[1]: *** Waiting for unfinished jobs....
Aborted (core dumped)
/core/test/source/bootstrapfixture.cxx:177:SdImportTest::testDocumentLayout
equality assertion failed
- Expected: 0
- Actual  : 34304
- failed to execute: sh /core/bin/officeotron.sh /tmp/lu16851plw1cl.tmp > /tmp/lu16851plw1cn.tmp

SdImportTest::testDocumentLayout finished in: 46233ms
SdImportTest::testSmoketest finished in: 200ms
SdImportTest::testN759180 finished in: 237ms
SdImportTest::testN778859 finished in: 253ms
...
SdImportTest::testTdf93868 finished in: 262ms
SdImportTest::testTdf95932 finished in: 230ms
SdImportTest::testTdf99030 finished in: 189ms
SdImportTest::testTdf49561 finished in: 105ms
bootstrapfixture.cxx:177:Assertion
Test name: SdImportTest::testDocumentLayout
equality assertion failed
- Expected: 0
- Actual  : 34304
- failed to execute: sh /core/bin/officeotron.sh /tmp/lu16851plw1cl.tmp > /tmp/lu16851plw1cn.tmp

Failures !!!
Run: 46   Failure total: 1   Failures: 1   Errors: 0

Error: a unit test failed, please do one of:
make CppunitTest_sd_import_tests CPPUNITTRACE="gdb --args"
    # for interactive debugging on Linux
make CppunitTest_sd_import_tests VALGRIND=memcheck
    # for memory checking
make CppunitTest_sd_import_tests DEBUGCPPUNIT=TRUE
    # for exception catching

/core/solenv/gbuild/CppunitTest.mk:101: recipe for target '/core/workdir/CppunitTest/sd_import_tests.test' failed
make[1]: *** [/core/workdir/CppunitTest/sd_import_tests.test] Error 1
Makefile:261: recipe for target 'build' failed
make: *** [build] Error 2

-----------------------

Vasily,
Is there anything else I can do to help you resolve this build failure?



Can you run:

make CppunitTest_sw_ww8export CPPUNITTRACE="gdb --args"

type "run" into the gdb window and when it crashes produce a backtrace that you send with: "thread apply all bt"

At least for the crash that should give an idea what is broken (under the assumption that you have at least symbols enabled in your build, one of --enable-symbols, --enable-debug or --enable-dbgutil in autogen.input).

Regards,
Markus


_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice
slacka slacka
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

with the following autogen.input:
--enable-ext-validator
--with-export-validation
--enable-symbols

I get a crash in bfbd66f151002af6f65b9c062cc511797690e625


Test name: SdImportTest::testDocumentLayout
equality assertion failed
- Expected: 0
- Actual  : 34304
- failed to execute: sh /media/luke/9e79b120-4914-425d-b6ec-97b55ef4c85e/home/luke/lo/core/bin/officeotron.sh /tmp/lu15504xl5v3v.tmp > /tmp/lu15504xl5v3x.tmp

Failures !!!
Run: 46   Failure total: 1   Failures: 1   Errors: 0
[Thread 0x4b2e3b40 (LWP 15536) exited]
[Thread 0x4b0e2b40 (LWP 15535) exited]
[Thread 0x49f1fb40 (LWP 15534) exited]
[Thread 0x49d1eb40 (LWP 15533) exited]
[Thread 0x40709b40 (LWP 15508) exited]
[Inferior 1 (process 15504) exited with code 01]
(gdb) thread apply all bt
(gdb) quit
luke@luke-Inspiron-5523:~/u64/lo/core$ ls *.log
config.log  hs_err_pid15539.log


I'm not sure where the bt went. Here is the hs_err_pid15539.log file:
http://pastebin.com/xxqGndMF


Here was the log from the original build:
http://pastebin.com/x983UT2t
slacka slacka
Reply | Threaded
Open this post in threaded view
|

404 Not Found: officeotron-0.7.4-master.jar

In reply to this post by slacka
I do not think by backtrace for:
http://nabble.documentfoundation.org/export-validation-in-tests-by-default-causing-32-bit-Ubuntu-to-crash-tp4192925p4193137.html

was useful, so I tried track down the cause of this regression by doing a build before https://cgit.freedesktop.org/libreoffice/core/commit/?id=0868f670374cdcf6c2610d91ff8702f59b2e0bd3

With

--enable-ext-validator
--with-export-validation
--enable-symbols

And I get the following Error:

cd /core/external/tarballs/tmp && bash -c 'wget --progress=dot:mega -4 -Q 0 -P "." -l 0 -nd -nH -N --no-use-server-timestamps http://dev-www.libreoffice.org/extern/a1adc7a47ed126ed029893c23c8bdd43-officeotron-0.7.4-master.jar 2>&1 | tee -a /core/external/tarballs/fetch.log && [ $PIPESTATUS -eq 0 ]' && SUM=`md5sum a1adc7a47ed126ed029893c23c8bdd43-officeotron-0.7.4-master.jar | sed "s/ .*//"` && if test "$SUM" != "a1adc7a47ed126ed029893c23c8bdd43"; then echo ERROR: expected checksum for a1adc7a47ed126ed029893c23c8bdd43-officeotron-0.7.4-master.jar is a1adc7a47ed126ed029893c23c8bdd43 2>&1 | tee -a /core/external/tarballs/fetch.log; false; fi && mv a1adc7a47ed126ed029893c23c8bdd43-officeotron-0.7.4-master.jar ../
--2016-09-10 15:50:38--  http://dev-www.libreoffice.org/extern/a1adc7a47ed126ed029893c23c8bdd43-officeotron-0.7.4-master.jar
Resolving dev-www.libreoffice.org (dev-www.libreoffice.org)... 195.135.221.70
Connecting to dev-www.libreoffice.org (dev-www.libreoffice.org)|195.135.221.70|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2016-09-10 15:50:39 ERROR 404: Not Found.

/core/Makefile.fetch:103: recipe for target '/core/workdir/download' failed
make: *** [/core/workdir/download] Error 1


Downloads after 0868f670374cdcf6c2610d91ff8702f59b2e0bd3 work
Downloads before 5dd8fdae4ad005481068852925aa5e4191c3a6bc fail

Is there any point in trying to further bisect this regression or should we focus on getting a good backtrace?

_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice
Thorsten Behrens-6 Thorsten Behrens-6
Reply | Threaded
Open this post in threaded view
|

Re: 404 Not Found: officeotron-0.7.4-master.jar

Luke Benes wrote:
> And I get the following Error:
>
[snip]

ah - somehow that particular jar was missing on dev-www. added a copy,
should work now. Sorry for the hassle.

Cheers,

-- Thorsten

_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice

signature.asc (968 bytes) Download Attachment
slacka slacka
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

In reply to this post by slacka

For Java 8 + 32 bit environments, should we disable the export-validation tests?


Java openjdk version "1.8.0_91"

OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-3ubuntu1~16.04.1-b14)
OpenJDK Server VM (build 25.91-b14, mixed mode)

results in the SdImportTest::testDocumentLayout test failing with the following Stacktrace:
http://pastebin.com/X9ZeTEaA

Java version "1.7.0_111" runs the tests without crashing.


_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice
Thorsten Behrens-6 Thorsten Behrens-6
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

Luke Benes wrote:
> OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-3ubuntu1~16.04.1-b14)
> OpenJDK Server VM (build 25.91-b14, mixed mode)
>
> results in the SdImportTest::testDocumentLayout test failing with the following Stacktrace:
> http://pastebin.com/X9ZeTEaA
>
> Java version "1.7.0_111" runs the tests without crashing.
>
Wow - interesting case. SdImportTest::testDocumentLayout does a
saveAndReload(), any chance to tease out the exact document that is
causing this? The bt is rather generic sadly.

Cheers,

-- Thorsten

_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice

signature.asc (968 bytes) Download Attachment
slacka slacka
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

The error "- failed to execute: sh /core/bin/officeotron.sh /tmp/lu16851plw1cl.tmp > /tmp/lu16851plw1cn.tmp" along with an apport crash report of openjdk 8, led me to believe this was a java issue.

Here are a summary of my results:
Ubuntu 16.04 64-bit - builds successfully
Ubuntu 16.04 32-bit - fails ww8export.test
Ubuntu 14.04 32-bit - builds successfully with Open JDK 7

I build an Ubuntu 16.04 32-bit with the export tests disabled. Then I opened all of the SdImportTest::testDocumentLayout tests and resaved and reloaded them. No problems.

What else can I do to try to help you track this issue down?
Thorsten Behrens-6 Thorsten Behrens-6
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

slacka wrote:
> What else can I do to try to help you track this issue down?
>
I'd need a full build log (unless you know where to chop it off), and
ideally the exact document that triggers this (in case it's not
obvious from the build log).

Re-running the failing test with the recipe at the bottom of the
output in a debugger would be ideal, that should have the loaded
document name a few stack frames above.

Happy to assist interactively, just grab me (thorsten) on irc!

Cheers,

-- Thorsten

_______________________________________________
LibreOffice mailing list
[hidden email]
https://lists.freedesktop.org/mailman/listinfo/libreoffice

signature.asc (968 bytes) Download Attachment
slacka slacka
Reply | Threaded
Open this post in threaded view
|

Re: export-validation in tests by default causing 32 bit Ubuntu to crash

In reply to this post by Thorsten Behrens-6
This appears to be an OpenJDK 1.8 bug that was fixed in 1.8.0_112. At least with 32-bit Arch, 1.8 can now pass all the Unit Tests without the need for "--without-export-validation".


Java version "1.7.0_111" : GOOD
OpenJDK Runtime Environment (build 1.8.0_91-8u91-b14-3ubuntu1~16.04.1-b14): SdImportTest::testDocumentLayout test FAIL
openjdk version "1.8.0_111": SdImportTest::testDocumentLayout test FAIL
openjdk version "1.8.0_112": Good