[meego-releases] MeeGo-handset-ARM-N900-Acceptance Test Report for Trunk:Daily-20100817
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Tue Aug 17 07:53:33 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
meego-handset-armv7l-n900sanity-1.0.80.15.20100816.1-raw.tar
Kernel version:- kernel-n900.armv7l 2.6.35-10.5
Image created from: - http://repo.meego.com/MeeGo/builds/trunk/daily/
Test Environment
-----------------------
*
Hardware: N900
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
* Device charging with USB charger
Lowlights:
* Bug 5301<http://bugs.meego.com/show_bug.cgi?id=5301> - N900: Runtime status not shown on toolbar
* Bug 5292<http://bugs.meego.com/show_bug.cgi?id=5292> - N900: Music player missing
* Bug 4943<http://bugs.meego.com/show_bug.cgi?id=4943> - N900: Display orientation detection not working
* Bug 4021<http://bugs.meego.com/show_bug.cgi?id=4021> - Unable launch browser.
* Bug 3451<http://bugs.meego.com/show_bug.cgi?id=3451> - Unable connect any WLAN or Wi-Fi network
* Bug 5108<http://bugs.meego.com/show_bug.cgi?id=5108> - Device screen turn to white when try to launch Terminal application.
* Bug 5109<http://bugs.meego.com/show_bug.cgi?id=5109> - Unexpected characters will display when inputting using Fn key of hardware keyboard
* Bug 5419<http://bugs.meego.com/show_bug.cgi?id=5419> - Video clip playback failed.
* Many applications taking more time to launch. Such as SMS, People, Photos, Settings.
Performance data:
Boot time: 62s
Video player start time: 13s
Test Result
-----------------------
Result Overview
-----------------------
Total TCs Passed Failed Not testable Executable rate Pass rate of total Pass rate of executed
45 13 21 11 75.56% 28.89% 38.24%
Detailed Test Results
---------------------------
Category Details Test Results Comments
Create Image Create image with MIC2 Pass
System startup Image Boot from SD card Pass
Home screen Check if core applications can be launched from app-launcher ( Dialer, SMS, fennec browser, photo viewer, audio player, video player, contacts, email, Terminal) Fail Browser and music player can't be launched. Device turn to white when trying to launch Terminal.
Bug 4021 - N900: Unable launch Browser
Bug 5108 - Device screen turn to white when try to launch Terminal application.
Bug 5292 - N900: Music player missing <http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5108%2C5292>
switch between different applications Pass
Check home screen theme and layout Fail Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Display orientation detection Fail
Bug 4872 - [REG]Unable to detect display orientation change<http://bugs.meego.com/show_bug.cgi?id=4872>
Fennec browser Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) Fail Bug 4021 - N900: Unable launch Browser<http://bugs.meego.com/show_bug.cgi?id=4021>
Browsing website over 3G (WCDMA) N/A SIM function is not implemented yet.
Browser gesture support Fail Bug 4021 - N900: Unable launch Browser<http://bugs.meego.com/show_bug.cgi?id=4021>
Dialer Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass Only Dialer application launching . SIM function is not implemented yet.
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Display PhoneBook Pass
Check call history Pass Only can check call out history.
SMS Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass SMS application can be launched and SMS can be composed . SIM function is not implemented yet.
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Phonesim cannot be launched & SIM function is not implemented yet.
Check message history (received, sent, draft) Fail 3670 - [SMS] The SMS history cannot show.<http://bugs.meego.com/show_bug.cgi?id=3670>
Applets Add/remove weather/stock/news applet on applet library N/A Not implemented yet.
Connectivity scan wifi, check wifi connection and disconnection Fail Scan wifi function OK, but connection to WLAN for the first time is successful, connect to the WLAN again will fail.
Bug 3451 - Unable connect any WLAN or Wi-Fi network<http://bugs.meego.com/buglist.cgi?quicksearch=3451%2C5109>
Browse website and download some files through wifi Fail Bug 4021 - N900: Unable launch Browser<http://bugs.meego.com/show_bug.cgi?id=4021>
check if wifi On/Off works Pass
check bluetooth connection (pairing and connect to bluetooth handset) N/A Not implemented yet.
Connect device to computer with usb cable, check the usb mass storage device is detected by computer Fail Bug 3835 - [Aava] device cannot be detected as USB mass storage.<http://bugs.meego.com/show_bug.cgi?id=3835>
Check sshd connection: connect board using usb gadget Pass
Run time status/Settings/Control Panel Check if runtime status are correct on toolbar Pass
Check if volume could be adjusted N/A Not implemented yet.
Check if time/date could be updated N/A Not implemented yet.
Check if phone setting mode (offline, etc) could be updated N/A Not implemented yet.
Virtual keyboard Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS) Fail Virtual keyboard not launched.
Bug 3917 - [REG]Unable to launch VKB <http://bugs.meego.com/show_bug.cgi?id=3917>
Support text input Fail Virtual keyboard not launched.
Bug 3917 - [REG]Unable to launch VKB <http://bugs.meego.com/show_bug.cgi?id=3917>
Photo viewer Check if the UI is correct (top bar, menu, button, etc.) Pass Only Photo viewer application launching
Check if photo thumbnail index works Fail Photo Viewer UI displays but no functions can be checked since there is no sample pictures in Photo application.
Bug 5418 - N900: Pictures folder missing <http://bugs.meego.com/show_bug.cgi?id=5418>
Check if photo could be played Fail Photo Viewer UI displays but no functions can be checked since there is no sample pictures in Photo application.
Bug 5418 - N900: Pictures folder missing <http://bugs.meego.com/show_bug.cgi?id=5418>
Audio Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Bug 5292 - N900: Music player missing
<http://bugs.meego.com/show_bug.cgi?id=5292>
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file) Fail Bug 5292 - N900: Music player missing
<http://bugs.meego.com/show_bug.cgi?id=5292>
Video Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Video playback failed.
Bug 5419 - Video clip playback failed. <http://bugs.meego.com/show_bug.cgi?id=5419>
Check if video thumbnail index works Fail Video playback failed.
Bug 5419 - Video clip playback failed. <http://bugs.meego.com/show_bug.cgi?id=5419>
Check if video could be played (MP4, WMV & 3GP-H264) Fail Video playback failed.
Bug 5419 - Video clip playback failed. <http://bugs.meego.com/show_bug.cgi?id=5419>
Contacts Check if it works with dialer, SMS Pass
Security & Power Check PIN activation/deactivation (Need GUI support) N/A No GUI support for PIN code setting.
PIN requested at boot N/A Not implemented yet.
Power Off / Power On Fail Unable to poweroff the device via power key.
Bug 4048 - Not able to shut down the Device(N900) via power button.<http://bugs.meego.com/show_bug.cgi?id=4048>
Touchscreen Use touch screen to operate the system Fail Bug 4985 - [REG]Touchscreen has a little deviation with touch point<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging Charging with Normal USB charger Pass
Charging with USB cable Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5108%2C4872%2C3451%2C3835%2C3917%2C5418%2C5419%2C4048%2C4985%2C2260%2C5292
New bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=5418%2C5419
Sanity test trends
---------------------------
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/N900Sanity20100817
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100817/8e3d5a48/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 39636 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/private/meego-releases/attachments/20100817/8e3d5a48/attachment-0001.jpg>
More information about the Meego-releases
mailing list