[meego-releases] N900 Sanity testing Core September 20th.

[EXT-Jarno.1.Teivas at nokia.com]

Test Objective

--------------------------------------
Focus is to sanity test Meego OS middleware.

The ultimate goal is to test automatically daily or even hourly so we can ensure image sanity in every point of release schedule and so major disturbances can be solved before official weekly releases.

Test set is planned to contain 2 cases of each area. Some areas require more coverage, like ConnMan, so all vital areas are covered. 

More detailed test summary is available at <http://wiki.meego.com/Quality/CoreTestReports/weeklySanity20100920>


Image Location
--------------------------------------
N900: Core September 20th Trunk 

Test Environment
--------------------------------------
Hardware: N900

Test Result
--------------------------------------
Total Tcs: 65
Passed: 6
Failed: 27
Not testable (Blocked): 32
Run Rate: 51%
Pass rate of total: 9%
Pass rate of executed: 18%

Quality Summary
--------------------------------------
Highlights:

    * No highlights

Lowlights:

    * Image is severely broken
    
    * Device does not boot up to home screen

    * There is lots of not working cases, many of are propably due to bug 6967

    * We are not certain if Connman tests should be affected this bug, so new connman bug report may follow. Investigation ongoing.

    * Device was reflashed during testing, and ssh was not working after that. 4 cases were not run because of this. 




Related bugs
--------------------------------------

<http://bugs.meego.com/show_bug.cgi?id=6880> - USB send/Receive does not work

<http://bugs.meego.com/show_bug.cgi?id=6879> - PulseAudio load/unload

<http://bugs.meego.com/show_bug.cgi?id=6963> - N900: Device cannot boot up to homescreen with acceptance image

<http://bugs.meego.com/show_bug.cgi?id=6967> - [trunk:testing]Failed to start X due to "no screens found 

<http://bugs.meego.com/show_bug.cgi?id=6372> - Audio/video playback cannot be done on N900

<http://bugs.meego.com/show_bug.cgi?id=6403> - 3D graphics tests does not pass on N900

<http://bugs.meego.com/show_bug.cgi?id=6414> - Cannot show picture using QT libraries in N900

<http://bugs.meego.com/show_bug.cgi?id=5662> - Ofono Modem not running

<http://bugs.meego.com/show_bug.cgi?id=5818> - Tracker missing