[meego-releases] MeeGo-handset-ARM-N900-Sanity Test Report for Trunk:Daily-20100823
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Mon Aug 23 03:35:51 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
meego-handset-armv7l-n900acceptance-1.0.90.0.20100823.1-raw.tar
Kernel version:- kernel-n900.armv7l 2.6.35.2-6.2
Image created from: - http://repo.meego.com/MeeGo/builds/trunk/daily/
Test Environment
-----------------------
*
Hardware: N900
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
* VKB can be launched.
* "Pictures" folder can be found after ssh connection, and some sample pictures available for test.
Lowlights:
* Bug 4021<http://bugs.meego.com/show_bug.cgi?id=4021>- N900: Unable launch Browser
* Bug 5419<http://bugs.meego.com/show_bug.cgi?id=5419>- Video clip playback failed.
* Bug 5292<http://bugs.meego.com/show_bug.cgi?id=5292>- N900: Music player missing
* Bug 4872<http://bugs.meego.com/show_bug.cgi?id=4872>- [REG]Unable to detect display orientation change
* Bug 4992<http://bugs.meego.com/show_bug.cgi?id=4992>- [Trunk:testing] Lack of Email, Setting, Dialer and Fennec quick launch applications on app-launcher bar.
* Bug 3551<http://bugs.meego.com/show_bug.cgi?id=3551>- xterm doesn't launch correctly and doesn't work
* Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921>- [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks.
* Bug 5491<http://bugs.meego.com/show_bug.cgi?id=5491>- videoplayer in IVI: no GUI way to quit
* Bug 2453<http://bugs.meego.com/show_bug.cgi?id=2453>- [REG]Missing the send button in sms
* Bug 3670<http://bugs.meego.com/show_bug.cgi?id=3670>- [SMS] The SMS history cannot show
* Bug 3291<http://bugs.meego.com/show_bug.cgi?id=3291>- [REG] Wifi applet, connect to network is unstable, 1/2 failure rate
* Bug 4049<http://bugs.meego.com/show_bug.cgi?id=4049>- USB cannot be detected after being plugged in computer
* Bug 4048<http://bugs.meego.com/show_bug.cgi?id=4048>- Not able to shut down the Device(N900) via power button.
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985>- [REG]Touchscreen has a little deviation with touch point
* Bug 5650<http://bugs.meego.com/show_bug.cgi?id=5650%20>- Pictures cannot be seen in Photos viewer.
* Bug 5651<http://bugs.meego.com/show_bug.cgi?id=5650>- VKB exited automatically after tapping some characters in it.
* Bug 2260<http://bugs.meego.com/show_bug.cgi?id=2260>- Nokia N900 Battery charging support
Performance data:
* Bootup time: 59s
* Setting: 11s
* photo start time: 4s
* QT Examples: 5s
* people start time: 24s
* Video player start time: 11s
* SMS start time: 25s
* Dailer start time: 10s
* Xterm start time: 1s
Test Result
-----------------------
Result Overview
-----------------------
Total TCs Passed Failed Not testable Executable rate Pass rate of total Pass rate of executed
46 15 20 11 76.09% 32.61% 42.86%
Detailed Test Results
---------------------------
Category Details Test Results Comments
Create Image Create image with MIC2 Pass
System startup Image Boot from SD card Pass
Home screen Check if core applications can be launched from app-launcher ( Dialer, SMS, fennec browser, photo viewer, audio player, video player, contacts, email, Terminal) Fail Bug 3551 - xterm doesn't launch correctly and doesn't work
Bug 4021 - N900: Unable launch Browser
Bug 5292 - N900: Music player missing<http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5292%2C3551>
switch between different applications Pass
Check home screen theme and layout Fail Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
Bug 4992 - [Trunk:testing] Lack of Email, Setting, Dialer and Fennec quick launch applications on app-launcher bar.<http://bugs.meego.com/buglist.cgi?quicksearch=3921%2C4992>
Display orientation detection Fail Bug 4872 - [REG]Unable to detect display orientation change<http://bugs.meego.com/show_bug.cgi?id=4872>
Fennec browser Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Browsing website over 3G (WCDMA) N/A SIM function is not implemented yet.
Browser gesture support Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Dialer Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass Only Dialer application launching . SIM function is not implemented yet
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Display PhoneBook Pass
Check call history Pass Only can check call out history.
SMS Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass SMS application can be launched and SMS can be composed . SIM function is not implemented yet.
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Phonesim cannot be launched & SIM function is not implemented yet.
Check message history (received, sent, draft) Fail Bug 3670 - [SMS] The SMS history cannot show<http://bugs.meego.com/show_bug.cgi?id=3670>
Applets Add/remove weather/stock/news applet on applet library N/A Not implemented yet.
Connectivity scan wifi, check wifi connection and disconnection Fail Scan wifi function OK, but connection to WLAN for the first time is successful, connect to the WLAN again will fail.Connect any WLAN or Wi-Fi network unstable.
Bug 3291 - [REG] Wifi applet, connect to network is unstable, 1/2 failure rate<http://bugs.meego.com/show_bug.cgi?id=3921>
Browse website and download some files through wifi Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
check if wifi On/Off works Pass
check bluetooth connection (pairing and connect to bluetooth handset) N/A Not implemented yet.
Connect device to computer with usb cable, check the usb mass storage device is detected by computer Fail Bug 4049 - USB cannot be detected after being plugged in computer<http://bugs.meego.com/show_bug.cgi?id=4049>
Check sshd connection: connect board using usb gadget Pass
Run time status/Settings/Control Panel Check if runtime status are correct on toolbar Pass
Check if volume could be adjusted N/A Not implemented yet.
Check if time/date could be updated N/A Not implemented yet.
Check if phone setting mode (offline, etc) could be updated N/A Not implemented yet.
Virtual keyboard Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS) Pass Successful launched in SMS application.
Support text input Fail Bug 5651 - VKB exited automatically after tapping some characters in it.<http://bugs.meego.com/show_bug.cgi?id=5651>
Photo viewer Check if the UI is correct (top bar, menu, button, etc.) Pass
Check if photo thumbnail index works Fail Bug 5650 - Pictures cannot be seen in Photos viewer. <http://bugs.meego.com/show_bug.cgi?id=5650>
Check if photo could be played Fail Bug 5650 - Pictures cannot be seen in Photos viewer. <http://bugs.meego.com/show_bug.cgi?id=5650>
Audio Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Bug 5292- N900: Music player missing<http://bugs.meego.com/show_bug.cgi?id=5292>
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file) Fail Bug 5292- N900: Music player missing<http://bugs.meego.com/show_bug.cgi?id=5292>
Video Check if the UI is correct (top bar, menu, button, play queue etc.) Pass
Check if video thumbnail index works Fail Bug 5419- Video clip playback failed.<http://bugs.meego.com/show_bug.cgi?id=5419>
Check if video could be played (MP4, WMV & 3GP-H264) Fail Bug 5419- Video clip playback failed.<http://bugs.meego.com/show_bug.cgi?id=5419>
Contacts Check if it works with dialer, SMS Pass
Security & Power Check PIN activation/deactivation (Need GUI support) N/A No GUI support for PIN code setting.
PIN requested at boot N/A Not implemented yet.
Power Off / Power On Fail Bug 4048- Not able to shut down the Device(N900) via power button.<http://bugs.meego.com/show_bug.cgi?id=4048>
Touchscreen Use touch screen to operate the system Fail Bug 4985 - [REG]Touchscreen has a little deviation with touch point<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging Charging with Normal USB charger Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Charging with USB cable Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Installation Use zypper to install a package Pass
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5419%2C5292%2C3551%2C4872%2C4048%2C4049%2C4992%2C3670%2C3921%2C4985%2C5650%2C5651%2C3291%2C2260
No New bugs:
Sanity test trends
---------------------------
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/N900Sanity20100823
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100823/7e237e0f/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 40754 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/private/meego-releases/attachments/20100823/7e237e0f/attachment-0001.jpg>
More information about the Meego-releases
mailing list