[meego-releases] MeeGo-handset-ARM-N900-Sanity Test Report for Trunk:Daily-20100916
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Thu Sep 16 05:45:12 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
Internal Image:- meego-handset-armv7l-n900sanity-1.0.90.3.20100916.1-raw.tar
Kernel version: kernel-n900.armv7l 2.6.35.3-6.3
Image created from: - http://repo.meego.com/MeeGo/builds/trunk/daily/
Test Environment
-----------------------
*
Hardware: N900
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
Lowlights:
* Bug 4021<http://bugs.meego.com/show_bug.cgi?id=4021>- N900: Unable launch Browser
* Bug 5419<http://bugs.meego.com/show_bug.cgi?id=5419>- Video clip playback failed.
* Bug 5292<http://bugs.meego.com/show_bug.cgi?id=5292>- N900: Music player missing
* Bug 3551<http://bugs.meego.com/show_bug.cgi?id=3551>- xterm doesn't launch correctly and doesn't work
* Bug 4048<http://bugs.meego.com/show_bug.cgi?id=4048>- Not able to shut down the Device (N900) via power button
* Bug 4049<http://bugs.meego.com/show_bug.cgi?id=4049>- Unable to detect USB device after plugging it in computer
* Bug 3670<http://bugs.meego.com/show_bug.cgi?id=3670>- [SMS] The SMS history fail to show.
* Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921>- [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985>- [REG]touchscreen calibration issue
* Bug 2260<http://bugs.meego.com/show_bug.cgi?id=2260>- Nokia N900 Battery charging support
* Bug 5850<http://bugs.meego.com/show_bug.cgi?id=5850>- It takes long time to launch core applications at the first time.
* Bug 5031<http://bugs.meego.com/show_bug.cgi?id=5031>- ssh authentication fails over usb network
* Bug 5995<http://bugs.meego.com/show_bug.cgi?id=5995>- Settings and Mail applications are missing in application menu in landscape mode
* Bug 5997<http://bugs.meego.com/show_bug.cgi?id=5997>- The bottom row applications' icons are not fully displayed in portrait mode
* Bug 5301<http://bugs.meego.com/show_bug.cgi?id=5301>- N900: Runtime status not shown on toolbar
* Bug 6044<http://bugs.meego.com/show_bug.cgi?id=6044>- [SMS] Fails to launch Most of the time
* Bug 6482<http://bugs.meego.com/show_bug.cgi?id=6482>- Default theme is missing in home and app-launcher screen.
* Bug 6488<http://bugs.meego.com/show_bug.cgi?id=6488>- Missing plugin in Settings.
* Bug 6489<http://bugs.meego.com/show_bug.cgi?id=6489>- Fail to launch VKB.
* Bug 6382<http://bugs.meego.com/show_bug.cgi?id=6382>- Photos application crashes when sliding an image to view next one.
* Bug 2905<http://bugs.meego.com/show_bug.cgi?id=2905>- Modem doesn't work in Aava device
* Bug 6573<http://bugs.meego.com/show_bug.cgi?id=6573>- Home button doesn't work.
* Bug 6026<http://bugs.meego.com/show_bug.cgi?id=6026>- The email launched from quick lanch bar and app-lancher are not consistent
* Bug 5953<http://bugs.meego.com/show_bug.cgi?id=5953>- [QMF] account creation does not work
* Bug 6320<http://bugs.meego.com/show_bug.cgi?id=6320>- Close button does not work when email application window is in full screen
* Bug 6304<http://bugs.meego.com/show_bug.cgi?id=6304>- Calendar application failed to launch
* Bug 2922<http://bugs.meego.com/show_bug.cgi?id=2922>- Full phone number doesn't show after deleting all numbers
* Bug 6565<http://bugs.meego.com/show_bug.cgi?id=6565>- New contacts cannot be saved in People application.
* Bug 6566<http://bugs.meego.com/show_bug.cgi?id=6566>- Device freezes after closing applications
* Bug 6281<http://bugs.meego.com/show_bug.cgi?id=6281>- Alphabetical bar is not displayed properly in portrait mode in People application.
* Bug 6292<http://bugs.meego.com/show_bug.cgi?id=6292>- No number of characters displayed when composing a message.
Performance data:
* Bootup time: 56s
* Setting start time: 10s
* People start time: 15s
* Video start time: 9s
* Photo start time: 17s
* Chat start time: 14s
* Social Networking start time: 8s
* Widgets Gallery start time: 8s
* SMS start time: 14s
* Email start time: 5s
* Dialer start time: 10s
* Boot Charts<http://wiki.meego.com/File:Bootchart-long_Sanity_20100916.1.zip>
Test Result
-----------------------
Result Overview
-----------------------
Total TCs Passed Failed Not testable Executable rate Pass rate of total Pass rate of executed
45 10 24 11 75.56% 22.22% 29.41%
Detailed Test Results
---------------------------
Category Details Test Results Comments
Create Image Create image with MIC2 Pass
System startup Image Boot from SD card Pass
Home screen Check if core applications can be launched from app-launcher ( Dialer, SMS, fennec browser, photo viewer, audio player, video player, contacts, email, Terminal) Fail Bug 5850 - It takes long time to launch core applications at the first time.
Bug 6044 - [SMS] Fails to launch Most of the time
Bug 3551 - xterm doesn't launch correctly and doesn't work
Bug 4021 - N900: Unable launch Browser
Bug 5292 - N900: Music player missing<http://bugs.meego.com/buglist.cgi?quicksearch=5850%2C6044%2C3551%2C4021%2C5292>
switch between different applications N/A Blocked by Bug 6573 - Home button doesn't work. <http://bugs.meego.com/show_bug.cgi?id=6573>
Check home screen theme and layout Fail Bug 6482 - Default theme is missing in home and app-launcher screen.
Bug 5995 - Settings and Mail applications are missing in application menu in landscape mode.
Bug 5997 - The bottom row applications' icons are not fully displayed in portrait mode.
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/buglist.cgi?quicksearch=5995%2C5997%2C3921%2C6482>
Display orientation detection Pass
Fennec browser Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Browsing website over 3G (WCDMA) N/A Not support in meego 1.1 release.
Browser gesture support Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
Dialer Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) Fail Bug 2905 - Modem doesn't work in Aava device<http://bugs.meego.com/show_bug.cgi?id=2905>
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A
Display PhoneBook Pass
Check call history Pass Only can check call out history.
SMS Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass Fail to launch VKB, use hardware keyboard to enter and send SMS.
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Phonesim cannot be launched & SIM function is not implemented yet.
Check message history (received, sent, draft) Fail Bug 3670 - [SMS] The SMS history fail to show<http://bugs.meego.com/show_bug.cgi?id=3670>
Connectivity scan wifi, check wifi connection and disconnection Fail Bug 6488 - Missing plugin in Settings.<http://bugs.meego.com/show_bug.cgi?id=6488>
Browse website and download some files through wifi Fail Bug 4021 - N900: Unable launch Browser <http://bugs.meego.com/show_bug.cgi?id=4021>
check if wifi On/Off works Fail Bug 6488 - Missing plugin in Settings.<http://bugs.meego.com/show_bug.cgi?id=6488>
check bluetooth connection (pairing and connect to bluetooth handset) Fail Bug 6488 - Missing plugin in Settings.<http://bugs.meego.com/show_bug.cgi?id=6488>
Connect device to computer with usb cable, check the usb mass storage device is detected by computer Fail Bug 4049 - USB cannot be detected after being plugged in computer
Check sshd connection: connect board using usb gadget Fail SSH connection only can be established if usb cable connected before device boot up. Bug 5031- ssh authentication fails over usb network
Run time status/Settings/Control Panel Check if runtime status are correct on toolbar Fail Bug 5301 - Runtime status not shown on toolbar<http://bugs.meego.com/show_bug.cgi?id=5301>
Check if volume could be adjusted N/A
Check if time/date could be updated N/A
Check if phone setting mode (offline, etc) could be updated N/A
Virtual keyboard Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS) Fail Bug 6489 - Fail to launch VKB.<http://bugs.meego.com/show_bug.cgi?id=6489>
Support text input Fail Bug 6489 - Fail to launch VKB.<http://bugs.meego.com/show_bug.cgi?id=6489>
Photo viewer Check if the UI is correct (top bar, menu, button, etc.) Pass
Check if photo thumbnail index works Pass After tapped "All Photos", "Albums" etc buttons, correspond picture thumnails can be displayed.
Check if photo could be played Fail Bug 6382 - Photos application crashes when sliding an image to view next one.<http://bugs.meego.com/buglist.cgi?quicksearch=6382%2C6384>
Audio Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Bug 5292 - N900: Music player missing
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file) Fail Bug 5292 - N900: Music player missing
Video Check if the UI is correct (top bar, menu, button, play queue etc.) Fail Icons of "My Movies" "Films" "TV Shows" in topbar displayed as red blocks.
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Check if video thumbnail index works Pass After tapped "My Movies", "Films" & "TV Shows" buttons, corrspond Video thumbnails can be displayed.
Check if video could be played (MP4, WMV & 3GP-H264) Fail Bug 5419- Video clip playback failed.<http://bugs.meego.com/show_bug.cgi?id=5419>
Contacts Check if it works with dialer, SMS Pass
Security & Power Check PIN activation/deactivation (Need GUI support) N/A
PIN requested at boot N/A
Power Off / Power On Fail Bug 4048- Not able to shut down the Device(N900) via power button.<http://bugs.meego.com/show_bug.cgi?id=4048>
Touchscreen Use touch screen to operate the system Fail Bug 4985 - [REG][CDK] touchscreen calibration issue<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging Charging with Normal USB charger Fail Bug 2260 - Nokia N900 Battery charging support<http://bugs.meego.com/show_bug.cgi?id=2260>
Charging with USB cable Fail Bug 2260- Nokia N900 Battery charging suppor
Installation Use zypper to install a package N/A Blocked by Bug 6488 - Missing plugin in Settings.
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=4021%2C5419%2C5292%2C3551%2C4048%2C4049%2C3670%2C3921%2C4985%2C2260%2C5850%2C5031%2C5995%2C5997%2C5301%2C6044%2C6482%2C6488%2C6489%2C6382%2C2905
No New bugs:
Sanity test trends
---------------------------
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/N900Sanity20100916
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100916/d4985b41/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 47324 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100916/d4985b41/attachment-0001.jpg>
More information about the Meego-releases
mailing list