[meego-releases] MeeGo v1.1 Netbook/Nettop/Notebook UX/Applications 2010-09-10 Test Report (for 1.0.90.1.20100907.1 image)
Tao, Daniel
daniel.tao at intel.com
Thu Sep 9 22:58:02 PDT 2010
Test Objective
--------------------------------------
This is QA weekly testing cycle for MeeGo v1.1 Netbook images released by distribution team. Our testing focus would be new features exploration, regression testing and bug verification, to ensure major issues for new features are exposed in timely fashion and changes introduced from the last build do not break working features. The test covers UI and applications (MeeGo UI shell, media player, web browser, networking, installation, setting etc).
Build Location
---------------------------------------
Netbook: http://repo.meego.com/MeeGo/builds/trunk/1.0.90.1.20100907.1/netbook/images/meego-netbook-ia32/meego-netbook-ia32-1.0.90.1.20100907.1.img
Test Environment
---------------------------------------
Hardware:
Pinetrail Netbook: HP mini, EeePC 1005PE
Nettop: MSI AE1900-B
Notebook: Calpella AspireOne 5740-6025
Test equipment:
bluetooth devices, wireless AP, USB disk, SD/MMC cards
Test Coverage
---------------------------------------
Test types:
Regression test
Bug verification
Test Result
---------------------------------------
Result Overview
Total TCs
Passed
Failed
Not testable (Blocked)
Run Rate
Pass rate of total
Pass rate of executed
96
89
7
0
100%
92.7%
92.7%
Quality Summary
Highlights:
Ø QA found there is no obvious quality improvement in this weekly image compared with 0831 image and one new major regression bug (6305<http://bugs.meego.com/show_bug.cgi?id=6305>) is involved;
Ø QA covered BAT test cases in this test cycle and the pass rate is 92.7%;
Ø Netbook, Nettop and Notebook platform are covered in this test cycle, and no regression issue for Nettop and Notebook;
Ø 2 bugs are fixed and verified(4895<http://bugs.meego.com/show_bug.cgi?id=4895>, 3666<http://bugs.meego.com/show_bug.cgi?id=3666>);
Lowlights:
Ø 6 new bugs are submitted;
Ø 4 major regression bugs (6159<http://bugs.meego.com/show_bug.cgi?id=6159>, 6139<http://bugs.meego.com/show_bug.cgi?id=6139>, 6151<http://bugs.meego.com/show_bug.cgi?id=6151>, 6305<http://bugs.meego.com/show_bug.cgi?id=6305>) for UI shell and installation will impact user experience strongly and should be fixed soon;
Ø [REG] fail to create user during installation (6305<http://bugs.meego.com/show_bug.cgi?id=6305>);
Ø [REG]Nothing happened after clicked "Open IM Settings" button of people panel (6159<http://bugs.meego.com/show_bug.cgi?id=6159>);
Ø [REG]Unable to find "setting" application from apps panel (6139<http://bugs.meego.com/show_bug.cgi?id=6139>);
Ø [REG]Unable to launch "add new web account" from status panel (6151<http://bugs.meego.com/show_bug.cgi?id=6151>);
Legend:
Low risk, most functions work well, minor bugs or limited normal bugs
Medium risk, main function work, normal bugs and limited major bugs
High risk, main functions loss, a few critical/major bugs
Not available/Not integrated
Components
Grading
Test Results
Comments (Top Issues)
Networking
BAT case are covered
Total TC: 6
Pass Rate: 83.3%
5635<http://bugs.meego.com/show_bug.cgi?id=5635> - Bluetooth "on/off" switch button of network panel is incorrect
System Installation
BAT case are covered
Total TC: 2
Pass Rate: 50%
6305<http://bugs.meego.com/show_bug.cgi?id=6305> - [REG] fail to create user during installation
MeeGo Help
BAT case are covered
Total TC: 2
Pass Rate: 100%
Evolution
BAT case are covered
Total TC: 26
Pass Rate: 92.3%
182<http://bugs.meego.com/show_bug.cgi?id=182> - Evolution unable to send/receive email via http proxy network
3489<http://bugs.meego.com/show_bug.cgi?id=3489> - Calendar hang after finishing creating an appointment with attendees
UI Shell
BAT case are covered
Total TC: 36
Pass Rate: 94.4%
6159<http://bugs.meego.com/show_bug.cgi?id=6159> - [REG]Nothing happened after clicked "Open IM Settings" button of people panel
6151<http://bugs.meego.com/show_bug.cgi?id=6151> - [REG]Unable to launch "add new web account" from status panel
6139<http://bugs.meego.com/show_bug.cgi?id=6139> - [REG]Unable to find "setting" application from apps panel
Software Management
BAT case are covered
Total TC: 5
Pass Rate: 100%
Bluetooth
BAT case are covered
Total TC: 2
Pass Rate: 100%
Setting
BAT case are covered
Total TC: 19
Pass Rate: 84.2%
3881<http://bugs.meego.com/show_bug.cgi?id=3881> - "date&time"setting application has nothing displayed
3880<http://bugs.meego.com/show_bug.cgi?id=3880> - Empty list in language settings window
3302<http://bugs.meego.com/show_bug.cgi?id=3302> - applications icon could not be displayed in setting UI
6356<http://bugs.meego.com/show_bug.cgi?id=6356> - Fail to launch panels from toolbar when add "custom shortcut" from "all settings" ->"keyboard"->"keyboard Shortcut"
Platform Coverage:
Platform
Grading
Comments (Top Issues)
Nettop
5558<http://bugs.meego.com/show_bug.cgi?id=5558> - [Nettop] Network panel indicate incorrect network connection except reboot
Notebook
5416<http://bugs.meego.com/show_bug.cgi?id=5416> - [Calpella Notebook] notebook will go to standby after being idle for a certain time and then failed to resume
Issue Summary
--------------------------------------
Top Issues:
Open UX/Application high bugs on Netbook v1.1: Here<http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Netbook_1.1_UX_open_high&sharer_id=391>
New issues (6):
6356<http://bugs.meego.com/show_bug.cgi?id=6356> - Fail to launch panels from toolbar when add "custom shortcut" from "all settings" ->"keyboard"->"keyboard Shortcut"
6376<http://bugs.meego.com/show_bug.cgi?id=6376> - "close" button in Chromium->"options" panel are truncated
6483<http://bugs.meego.com/show_bug.cgi?id=6483> - file shouldn't be able to be selected & set as wallpaper
6493<http://bugs.meego.com/show_bug.cgi?id=6493> - unable to change screen display resolution on netbook
6522<http://bugs.meego.com/show_bug.cgi?id=6522> - unable to make system to sleep when "Power and brightness"->"sleep" time is timeout
6528<http://bugs.meego.com/show_bug.cgi?id=6528> - The contents of capturing video by Cheese is incoherent
Verified fixed issues (2):
4895<http://bugs.meego.com/show_bug.cgi?id=4895> - removing glib2-devel from an installed system removes banshee player (yum remove)
3666<http://bugs.meego.com/show_bug.cgi?id=3666> - [PATCH] Way too many notifications
Conclusions and Recommendations From QA
--------------------------------------
QA found that there is no quality improvement in this weekly image compared with 0831 image and one new major regression bug (6305<http://bugs.meego.com/show_bug.cgi?id=6305>) is involved. This new regression issues happened during image installation and user will fail to create user and password. QA also met those major regression bugs for UI shell (6159<http://bugs.meego.com/show_bug.cgi?id=6159>, 6139<http://bugs.meego.com/show_bug.cgi?id=6139>, 6151<http://bugs.meego.com/show_bug.cgi?id=6151>) which reported in 0831 image. Those regression existed in people panel, status panel and application panel which will impact user experience, such as Nothing happened after clicked "Open IM Settings" button of people panel (6159<http://bugs.meego.com/show_bug.cgi?id=6159>),[REG]Unable to find "setting" application from apps panel (6139<http://bugs.meego.com/show_bug.cgi?id=6139>), and Unable to launch "add new web account" from status panel (6151<http://bugs.meego.com/show_bug.cgi?id=6151>). QA suggest that those 4 major regression issues (6159<http://bugs.meego.com/show_bug.cgi?id=6159>, 6139<http://bugs.meego.com/show_bug.cgi?id=6139>, 6151<http://bugs.meego.com/show_bug.cgi?id=6151>, 6305<http://bugs.meego.com/show_bug.cgi?id=6305>) which impact user experience strongly should be fixed asap.
Detailed Test Report
--------------------------------------
http://wiki.meego.com/Quality/NetbookTestReport/NetbookWeekly20100910
Thanks
--Daniel
MeeGo Netbook QA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100910/474845f4/attachment-0001.html>
More information about the Meego-releases
mailing list