[meego-releases] MeeGo-handset-ARM-N900-Sanity Test Report for Trunk:Daily-20100903
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Fri Sep 3 05:37:33 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
Internal Image:- meego-handset-armv7l-n900sanity-1.0.90.2.20100903.1-raw.tar
Kernel version: kernel-n900.armv7l 2.6.35.3-5.4
Image created from: - http://repo.meego.com/MeeGo/builds/trunk/daily/
Test Environment
-----------------------
*
Hardware: N900
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
Lowlights:
*
Bug 4021<http://bugs.meego.com/show_bug.cgi?id=4021>- N900: Unable launch Browser
* Bug 5419<http://bugs.meego.com/show_bug.cgi?id=5419>- Video clip playback failed.
* Bug 5292<http://bugs.meego.com/show_bug.cgi?id=5292>- N900: Music player missing
* Bug 3551<http://bugs.meego.com/show_bug.cgi?id=3551>- xterm doesn't launch correctly and doesn't work
* Bug 4048<http://bugs.meego.com/show_bug.cgi?id=4048>- Not able to shut down the Device (N900) via power button.
* Bug 4049<http://bugs.meego.com/show_bug.cgi?id=4049>- USB cannot be detected after being plugged in computer
* Bug 3670<http://bugs.meego.com/show_bug.cgi?id=3670>- [SMS] The SMS history cannot show
* Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921>- [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks.
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985>- [REG]Touchscreen has a little deviation with touch point
* Bug 5650<http://bugs.meego.com/show_bug.cgi?id=5650>- Pictures cannot be seen in Photos viewer.
* Bug 5651<http://bugs.meego.com/show_bug.cgi?id=5651>- VKB exited automatically after tapping some characters in it.
* Bug 2260<http://bugs.meego.com/show_bug.cgi?id=2260>- Nokia N900 Battery charging support
* Bug 5790<http://bugs.meego.com/show_bug.cgi?id=5790>- Bluetoth settings does not display properly after tapping Bluetooth from Settings
* Bug 5850<http://bugs.meego.com/show_bug.cgi?id=5850>- It takes long time to launch core applications at the first time.
* Bug 5031<http://bugs.meego.com/show_bug.cgi?id=5031>- ssh authentication fails over usb network
* Bug 5995<http://bugs.meego.com/show_bug.cgi?id=5995>- Settings and Mail applications are missing in application menu in landscape mode.
* Bug 5997<http://bugs.meego.com/show_bug.cgi?id=5997>- The bottom row applications' icons are not fully displayed in portrait mode.
* Bug 5301<http://bugs.meego.com/show_bug.cgi?id=5301>- N900: Runtime status not shown on toolbar
* Bug 6085<http://bugs.meego.com/show_bug.cgi?id=6085>- The character "0" and another two symbols are not fully displayed in virtual keyboard in landscape mode.
* Bug 6083<http://bugs.meego.com/show_bug.cgi?id=6083>- VKB does not hide automatically after opening hardware keyboard.
* Bug 3380<http://bugs.meego.com/show_bug.cgi?id=3380>- [REG] X button to close running application live thumbnail window is not always visible
* Bug 5988<http://bugs.meego.com/show_bug.cgi?id=5988>- Close button on full screened social networking window doesn't work.
* Bug 5197<http://bugs.meego.com/show_bug.cgi?id=5197>- [N900] Device does not shut down when battery is drained.
* Bug 6026<http://bugs.meego.com/show_bug.cgi?id=6026>- The email launched from quick lanch bar and app-lancher are not consistent
* Bug 5953<http://bugs.meego.com/show_bug.cgi?id=5953>- [QMF] account creation does not work
* Bug 3910<http://bugs.meego.com/show_bug.cgi?id=3910>- Keyboard behaving erratic
Performance data:
* Bootup time: 50s
* Photo start time: 6s
* Setting start time: 6s
* people start time: 11s
* SMS start time: 13s
* Video player start time: 11s
* Dialer start time: 11s
* Chat start time: 9s
* Email start time: 6s
* Social Networking start time: 9s
Test Result
-----------------------
Result Overview
-----------------------
Total TCs Passed Failed Not testable Executable rate Pass rate of total Pass rate of executed
45 14 22 9 80.00% 31.11% 38.89%
Detailed Test Results
---------------------------
Category Details Test Results Comments
Create Image Create image with MIC2 Pass
System startup Image Boot from SD card Pass
Home screen Check if core applications can be launched from app-launcher ( Dialer, SMS, fennec browser, photo viewer, audio player, video player, contacts, email, Terminal) Fail Bug 5850 - It takes long time to launch core applications at the first time.
Bug 3551 - xterm doesn't launch correctly and doesn't work
Bug 4021 - N900: Unable launch Browser
Bug 5292 - N900: Music player missing<http://bugs.meego.com/buglist.cgi?quicksearch=5850%2C3551%2C4021%2C5292>
switch between different applications Pass
Check home screen theme and layout Fail Bug 5995 - Settings and Mail applications are missing in application menu in landscape mode.
Bug 5997 - The bottom row applications' icons are not fully displayed in portrait mode.
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/buglist.cgi?quicksearch=5995%2C5997%2C3921>
Display orientation detection Pass
Fennec browser Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Browsing website over 3G (WCDMA) N/A Not support in MeeGo 1.1 release.
Browser gesture support Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Dialer Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass Only Dialer application launching . SIM function is not implemented yet.
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A SIM function is not implemented yet.
Display PhoneBook Pass
Check call history Pass Only can check call out history.
SMS Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass SMS application can be launched and SMS can be composed . SIM function is not implemented yet.
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Phonesim cannot be launched & SIM function is not implemented yet.
Check message history (received, sent, draft) Fail Bug 3670 - [SMS] The SMS history fail to show<http://bugs.meego.com/show_bug.cgi?id=3670>
Connectivity scan wifi, check wifi connection and disconnection Pass
Browse website and download some files through wifi Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
check if wifi On/Off works Pass
check bluetooth connection (pairing and connect to bluetooth handset) Fail Bug 5790 - Bluetooth settings does not display properly after tapping Bluetooth from Settings <http://bugs.meego.com/show_bug.cgi?id=5790>
Connect device to computer with usb cable, check the usb mass storage device is detected by computer Fail Bug 4049 - Unable to detect USB device after plugging it in computer<http://bugs.meego.com/show_bug.cgi?id=4049>
Check sshd connection: connect board using usb gadget Fail SSH connection only can be established if usb cable connected before device boot up.
Bug 5031 - ssh authentication fails over usb network<http://bugs.meego.com/show_bug.cgi?id=5031>
Run time status/Settings/Control Panel Check if runtime status are correct on toolbar Fail Bug 5301 - N900: Runtime status not shown on toolbar <http://bugs.meego.com/show_bug.cgi?id=5301>
Check if volume could be adjusted N/A Not implemented yet.
Check if time/date could be updated N/A Not implemented yet.
Check if phone setting mode (offline, etc) could be updated N/A Not implemented yet.
Virtual keyboard Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS) Pass Successful launched in SMS application
Support text input Fail Bug 5651 - VKB exited automatically after tapping some characters in it.
Bug 6085 - The character "0" and another two symbols are not fully displayed in virtual keyboard in landscape mode.
Bug 6083 - VKB does not hide automatically after opening hardware keyboard.<http://bugs.meego.com/buglist.cgi?quicksearch=5651%2C6085%2C6083>
Photo viewer Check if the UI is correct (top bar, menu, button, etc.) Pass
Check if photo thumbnail index works Fail Bug 5650 - Pictures are unable to be seen in Photos viewer. <http://bugs.meego.com/show_bug.cgi?id=5650>
Check if photo could be played Fail Bug 5650 - Pictures are unable to be seen in Photos viewer. <http://bugs.meego.com/show_bug.cgi?id=5650>
Audio Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Bug 5292- N900: Music player missing<http://bugs.meego.com/show_bug.cgi?id=5292>
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file) Fail Bug 5292- N900: Music player missing<http://bugs.meego.com/show_bug.cgi?id=5292>
Video Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Icons of "My Movies" "Films" "TV Shows" in topbar displayed as red blocks.
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Check if video thumbnail index works Fail Bug 5419- Video clip playback failed.<http://bugs.meego.com/show_bug.cgi?id=5419>
Check if video could be played (MP4, WMV & 3GP-H264) Fail Bug 5419- Video clip playback failed.<http://bugs.meego.com/show_bug.cgi?id=5419>
Contacts Check if it works with dialer, SMS Pass
Security & Power Check PIN activation/deactivation (Need GUI support) N/A Not implemented yet.
PIN requested at boot N/A Not implemented yet.
Power Off / Power On Fail Bug 4048- Not able to shut down the Device(N900) via power button.<http://bugs.meego.com/show_bug.cgi?id=4048>
Touchscreen Use touch screen to operate the system Fail Bug 4985 - [REG]touchscreen calibration issue<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging Charging with Normal USB charger Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Charging with USB cable Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Installation Use zypper to install a package Pass
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5419%2C5292%2C3551%2C4048%2C4049%2C3670%2C3921%2C4985%2C5650%2C5651%2C2260%2C5790%2C5850%2C5031%2C5995%2C5997%2C5301%2C6085%2C6083
No New bugs:
Sanity test trends
---------------------------
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/N900Sanity20100903
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100903/aaacf67c/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 44636 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100903/aaacf67c/attachment-0001.jpg>
More information about the Meego-releases
mailing list