[Meego-qa] MeeGo Netbook 1.2.0 Cedartrail System Functional & Dataflow Test Report -- 20111111 image

[Pan, LiangX]

Test Objective
-----------------------

System Functional Test focuses on testing the entire system and valuates the typical system usages from end users perspective. The test case is a set of combined user operations to cover different usage scenarios and hardware conditions, including peripherals, network environment and etc. The testing will give each test case a mark in 5 levels between 0 and 1 according to score criteria.

Dataflow is the flow of data to, from and within a device. Inputs are derived from system use cases and each core dataflow test case presents the basic instance of the use case in MeeGo core stack. The result of core dataflow could report the maturity level of MeeGo core os software and hardware integration on specific device. It’s a weekly testing cycle against weekly build.

Image Location
-----------------------
meego-netbook-ia32-20111111.1.img

Test Environment
-----------------------
Hardware: Cedartrail (Dual core)
Test equipment: wireless AP, USB disk, SD/MMC cards

Quality Summary
-----------------------
System functional test pass ratio: 85.14%. whole image quality is upgrade (84.42% ->85.14%), compared with 1104 image. Three old issues(Bug23689<https://bugs.meego.com/show_bug.cgi?id=23689>, Bug23799<https://bugs.meego.com/show_bug.cgi?id=23799>, Bug23381<https://bugs.meego.com/show_bug.cgi?id=23381>) have been disappeared. One new issues were found by QA.

•         Bug 24103<https://bugs.meego.com/show_bug.cgi?id=24103> - Subtitle shows on the "big_buck_bunny_240p" media
Dataflow Test pass ratio: 94.8 %. whole image quality is stable (94.8%->94.8%), compared with 1104 image. No new issue was found by QA. But some critical issues still exist, Such as:

 *   Bug 22862<https://bugs.meego.com/show_bug.cgi?id=22862> - ALSA driver is broken, confusing PulseAudio
Test Result
-----------------------
Result Overview:

System Functional Test
Total Test Case

Passed

Failed

Not testable

Run rate

Pass ratio

Pass rate of executed

138

117

21

0

100%

85.14 %

85.14 %


Dataflow Test
Total Test Case

Passed

Failed

Not testable

Run rate

Pass ratio

Pass rate of executed

58

55

3

0

100%

94.8 %

94.8%


Issue Summary:

•         Cedartrail New bugs:

•   [New]Bug 24103<https://bugs.meego.com/show_bug.cgi?id=24103> - Subtitle shows on the "big_buck_bunny_240p" media

•   Bug 23956<https://bugs.meego.com/show_bug.cgi?id=23956> - Select different themes there is no change

•   Bug 23957<https://bugs.meego.com/show_bug.cgi?id=23957> - Automatically switch to another application when the second open one tab.
•   Bug 23959<https://bugs.meego.com/show_bug.cgi?id=23959> - Turn on System tray, Take Screenshot doesn't work well

•   Bug 23960<https://bugs.meego.com/show_bug.cgi?id=23960> - System tray covers action buttons of Categories dialog

•   Bug 23797<https://bugs.meego.com/show_bug.cgi?id=23797> - Get through the slideshow of photos is not displayed on myzone panel

•   Bug 23654<https://bugs.meego.com/show_bug.cgi?id=23654> - [REG]In application panel there are two Internet Browser.

•   Bug 23456<https://bugs.meego.com/show_bug.cgi?id=23456> - The recent web pages should be recorded.

•   Bug 22854<https://bugs.meego.com/show_bug.cgi?id=22854> - Battery applet doesn't show correctly.

•   Bug 23650<https://bugs.meego.com/show_bug.cgi?id=23650> - The focus can't scroll down with press down(↓) key and disappeared.

•   Bug 23422<https://bugs.meego.com/show_bug.cgi?id=23422> - The dropdown menu of setting device type is covered on bluetooth panel.

•   Bug 23753<https://bugs.meego.com/show_bug.cgi?id=23753> - No audio and vedio's history report display on myzone panel.

•   Bug 23755<https://bugs.meego.com/show_bug.cgi?id=23755> - Unable to show photo thumbnail on ‘select a file’ panel.


•         Netbook v1.2.0 Old bugs:

 *   Bug 22828<https://bugs.meego.com/show_bug.cgi?id=22828> - Unable to send file by GTalk (Sending/Receiving progress stays at 0%).
 *   Bug 10584 <https://bugs.meego.com/show_bug.cgi?id=10584> - Fail to switch priority between wifi and wired connection.
 *   Bug 22862<https://bugs.meego.com/show_bug.cgi?id=22862> - ALSA driver is broken, confusing PulseAudio.
 *   Bug 23754<https://bugs.meego.com/show_bug.cgi?id=23754> - Cannot display previous screen after running xrandr command.
 *   Bug 23129<https://bugs.meego.com/show_bug.cgi?id=23129> - Too much noise can be heard from the recorded clip.



Detail Test Result Reference
System founctional Test
Please refer to  http://qa-reports.meego.com/1.2/Netbook/System%20Functional/Cedartrail/3384 for detailed test report

Dataflow Test
Please refer to http://qa-reports.meego.com/1.2/Core/Dataflow/Cedartrail/3385 for detailed test report

Thanks
Liang




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-qa/attachments/20111116/49914e02/attachment-0001.html>