Bug 333041

test_Imap_Idle is unfortunately timing-sensitive because it needs to check that the code asks for IDLE within the expected timeframe. This probably happens under some QEMU instance or on native HW, right? If so, please consider disabling parallel execution of ctest and see if it helps. The code is set to ask for IDLE after 30ms and the timeout is 40ms. Do you have some data on what kind of latency we can expect on your build HW?

Regarding test_Composer_Submission and test_Html_formatting, these tests both actually require X. I would suggest further investigation on what makes it die -- perhaps your arm X server doesn't offer all extensions which the ARM build of Qt needs? Cannot help more, sorry.

I just disabled parallel tests and ran it in a armhf qemu build locally. I'll try to get answers from people who know more about the machinery we have.

cd obj*; xvfb-run -a ctest --output-on-failure
Test project /tmp/buildd/trojita-0.4.1+1/obj-arm-linux-gnueabihf
      Start  1: test_Composer_Submission
 1/26 Test  #1: test_Composer_Submission ....................***Exception: SegFault  0.31 sec
********* Start testing of ComposerSubmissionTest *********
Config: Using QtTest library 5.2.1, Qt 5.2.1
PASS   : ComposerSubmissionTest::initTestCase()
qemu: uncaught target signal 11 (Segmentation fault) - core dumped

      Start  2: test_Composer_responses
 2/26 Test  #2: test_Composer_responses .....................   Passed    0.19 sec
      Start  3: test_Html_formatting
 3/26 Test  #3: test_Html_formatting ........................***Exception: SegFault  0.49 sec
libEGL warning: GLX/DRI2 is not supported
libEGL warning: DRI2: failed to create any config
libEGL warning: GLX: failed to load GLX
qemu: uncaught target signal 11 (Segmentation fault) - core dumped

      Start  4: test_Imap_DisappearingMailboxes
 4/26 Test  #4: test_Imap_DisappearingMailboxes .............   Passed    0.41 sec
      Start  5: test_Imap_Idle
 5/26 Test  #5: test_Imap_Idle ..............................   Passed    1.10 sec
      Start  6: test_Imap_LowLevelParser
 6/26 Test  #6: test_Imap_LowLevelParser ....................   Passed    0.18 sec
      Start  7: test_Imap_Message
 7/26 Test  #7: test_Imap_Message ...........................   Passed    0.13 sec
      Start  8: test_Imap_Model
 8/26 Test  #8: test_Imap_Model .............................   Passed    0.15 sec
      Start  9: test_Imap_Parser_parse
 9/26 Test  #9: test_Imap_Parser_parse ......................   Passed    0.79 sec
      Start 10: test_Imap_Responses
10/26 Test #10: test_Imap_Responses .........................   Passed    0.11 sec
      Start 11: test_Imap_SelectedMailboxUpdates
11/26 Test #11: test_Imap_SelectedMailboxUpdates ............   Passed    0.54 sec
      Start 12: test_Imap_Tasks_CreateMailbox
12/26 Test #12: test_Imap_Tasks_CreateMailbox ...............   Passed    0.15 sec
      Start 13: test_Imap_Tasks_DeleteMailbox
13/26 Test #13: test_Imap_Tasks_DeleteMailbox ...............   Passed    0.26 sec
      Start 14: test_Imap_Tasks_ListChildMailboxes
14/26 Test #14: test_Imap_Tasks_ListChildMailboxes ..........   Passed    0.21 sec
      Start 15: test_Imap_Tasks_ObtainSynchronizedMailbox
15/26 Test #15: test_Imap_Tasks_ObtainSynchronizedMailbox ...   Passed   94.17 sec
      Start 16: test_Imap_Tasks_OpenConnection
16/26 Test #16: test_Imap_Tasks_OpenConnection ..............   Passed    0.42 sec
      Start 17: test_Imap_Threading
17/26 Test #17: test_Imap_Threading .........................   Passed  284.82 sec
      Start 18: test_Imap_BodyParts
18/26 Test #18: test_Imap_BodyParts .........................   Passed    0.71 sec
      Start 19: test_Imap_Offline
19/26 Test #19: test_Imap_Offline ...........................   Passed    0.22 sec
      Start 20: test_Imap_CopyAndFlagOperations
20/26 Test #20: test_Imap_CopyAndFlagOperations .............   Passed    0.23 sec
      Start 21: test_Rfc5322
21/26 Test #21: test_Rfc5322 ................................   Passed    0.07 sec
      Start 22: test_RingBuffer
22/26 Test #22: test_RingBuffer .............................   Passed    0.06 sec
      Start 23: test_SenderIdentitiesModel
23/26 Test #23: test_SenderIdentitiesModel ..................   Passed    0.20 sec
      Start 24: test_SqlCache
24/26 Test #24: test_SqlCache ...............................   Passed    0.22 sec
      Start 25: test_algorithms
25/26 Test #25: test_algorithms .............................   Passed    0.06 sec
      Start 26: test_rfccodecs
26/26 Test #26: test_rfccodecs ..............................   Passed    0.13 sec

92% tests passed, 2 tests failed out of 26

Total Test time (real) = 386.55 sec

The following tests FAILED:
	  1 - test_Composer_Submission (SEGFAULT)
	  3 - test_Html_formatting (SEGFAULT)
Errors while running CTest

We can probably close this bug. The tests pass just fine on real HW. The problem might be missing timer implementation in qemu-armhf(?).

For now an approach might be to just disable the two tests on armhf in the test package and run them on all other architectures.

The tests which are failing have, AFAIK, nothing to do with timers; the timing -related failure was in the test_Imap_Idle and it was worked around by not overloading the system by concurrent test execution.

Anyway, I'm fine with closing this one :).