[meego-releases] MeeGo Netbook v1.1(trunk) IA Sanity Test Report -20100809
Cao, Jenny Q
jenny.q.cao at intel.com
Mon Aug 9 03:28:24 PDT 2010
MeeGo Netbook v1.1(trunk) Sanity Test Report - 20100809
Test Objective
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.
Image Location/Kickstart file
meego-netbook-ia32-1.0.80.14.20100806.1.img<http://repo.meego.com/MeeGo/builds/trunk/1.0.80.4.20100806.1/netbook/images/meego-netbook-ia32/meego-netbook-ia32-1.0.80.143.20100806.1.img>
Test Environment
* Hardware: Pinetrail Netbook: Dell INSPIRON mini 1012/1G memory/1.66Ghz/160G HDD; Diamondville Netbook: Asus Eeepc901/1G memory/1.6Ghz/12G SSD
* Test equipment: Wireless AP
* Used Operator: N/A
Quality Summary
Highlights:
* Sanity checkpoints pass ratio: 93.1%.
* The quality of today's trunk image has improvement (89.7%->93.1%) media panel issue(3827<http://bugs.meego.com/show_bug.cgi?id=3827>) is resolved .
* around 7s boot time improvement on HDD disk(30.954s->23.873s)
Lowlights:
* chromium browser address search(Google search) function does not work (5075<http://bugs.meego.com/show_bug.cgi?id=5075>)
* X Segmentation fault when system shutdown (3821<http://bugs.meego.com/show_bug.cgi?id=3821>)
* System performance on boot and powertop are downgrade a lot due to the sysklog process (3810<http://bugs.meego.com/show_bug.cgi?id=3810>)
* Trash folder can't be opened from devices panel( 4862<http://bugs.meego.com/show_bug.cgi?id=4862> )
* Failed to resume from S3 sometimes (40%) on dellmini1012 (3932<http://bugs.meego.com/show_bug.cgi?id=3932>)
Performance data:
* Boot time is 23.873s on HDD disk, 19.594s on SSD disk
Test Result
Result Overview
Total TCs
Passed
Failed
Not testable
Run rate
Pass rate of total
Pass rate of executed
29
27
2
0
100%
93.1%
93.1%
Detailed Test Results
Category
Check points
Result
Notes (bugs)
Create Image
Create livecd type image by MIC2 on Fedora10 host
Pass
Install image
Boot and install
Pass
System startup & shutdown
Boot from live USB stick
Pass
Boot from local disk
Pass
Stopwatch:
24.563s on DELL mini
19.594s on Eeepc901;
Bootchart:
23.873s on Dell mini
3810<http://bugs.meego.com/show_bug.cgi?id=3810>
Shutdown
Pass
4.906s on DELL mini
Suspend & resume
Suspend via closing lid and cmd
Pass
1.796s on DELL mini
Resume
Fail
3.468s on DELL mini
Failed to resume from S3 sometimes on dellmini1012(40%)3932<http://bugs.meego.com/show_bug.cgi?id=3932>
Powertop Log
Cn state avg residency and Wakeup times
N/A
C4 mwait 1.1 ms (35.0%)
Wakeups/60Sec :444.6
Stability
Shutdown and Reboot system 10 times without failure or crash
Pass
Use multiple applications (>8, media player, browser, IM, email, and so on) based on scopes defined in other checkpoints
Pass
Network/connectivity - ethernet, wifi connection basic check
Check Ethernet connection
Pass
Wifi scan & associate (check from carrick)
Pass
UI shell - dropdown panels basic check , zones switch, application launcher to launch key applications
Dropdown panel: click icons on drop down panel to check corresponding panels could launched (Will not test the functionality of panels to avoid to many tests)
Pass
Zones: switch in zone panel; drag application to another zone; switch by alt+tab
Pass
App-launcher: check if the UI is correct; check if key applications (browser, media, MeeGo Help, settings) could be launched;
Pass
Myzone - web service, event, favorite apps basic check
Check if UI is correct;
Pass
Check if web services could be fetched;
Pass
Check if new dates&tasks could be displayed
Pass
Check media content, browser history and recent docs
Fail
29<http://bugs.meego.com/show_bug.cgi?id=29> - Played media history will not be shown in myzone
Internet Applications -- Multi-tabs websites surfing and flash plugin check
Open 2 tabs to surf 2 websites
Pass
Check if flash plugin could basically work
Pass
Multimedia -- audio/video/photo playback, and play views switch
Check if the UI is correct (top bar, side bar, play queue)
Pass
Check if sample audio/video/photo could playback successfully.
Pass
Check if thumbnail/index of sample picture/video works
Pass
Device Panel
Check if the device panel could basically work
Pass
Peripheral devices (touchpad, USB, SD, LCD)
Touchpad
Pass
USB keyboard/mouse
Pass
External monitor
Pass
USB stick/SD/LCD
Pass
Basic linux command such as yum install/zypper install/debuginfo-install
zypper install/default repo configuration
Pass
Issue Summary
* Top bugs
* 3932<http://bugs.meego.com/show_bug.cgi?id=3932> - Failed to resume from S3 sometimes (40%) on dellmini1012
* 3810<http://bugs.meego.com/show_bug.cgi?id=3810> - HDDdisk boottime is longer than 23s
* 5075<http://bugs.meego.com/show_bug.cgi?id=5075> - chromium browser address search(Google search) function does not work
* New bugs
* 5075<http://bugs.meego.com/show_bug.cgi?id=5075> - chromium browser address search(Google search) function does not work
* 3821<http://bugs.meego.com/show_bug.cgi?id=3821> - X Segmentation fault when system shutdown
Thanks
Meego QA teamv
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100809/5ed45c0c/attachment-0001.html>
More information about the Meego-releases
mailing list