[meego-releases] MeeGo-handset-IA-Aava-Sanity Test Reportfor Trunk:Daily-20100903
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Fri Sep 3 06:41:17 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
* Kickstart File: handset-ia32-aava-mtf.ks
* Image crated from Trunk/daily
Test Environment
-----------------------
* Hardware: Aava Koski DV2
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
Lowlights:
* Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921> - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985> - [REG]touch screen calibration issue
* Bug 5670<http://bugs.meego.com/show_bug.cgi?id=5670> - Handset SW is unstable in Aava
* Bug 5856<http://bugs.meego.com/show_bug.cgi?id=5856> - Launching dialer fails
* Bug 5073<http://bugs.meego.com/show_bug.cgi?id=5073> - [REG]Fennec download failed.
* Bug 6017<http://bugs.meego.com/show_bug.cgi?id=6017> - unable to enter the web site address with VKB
* Bug 4813<http://bugs.meego.com/show_bug.cgi?id=4813> - [AAVA] audio driver playback error on aava
* Bug 2090<http://bugs.meego.com/show_bug.cgi?id=2090> - Powering off the phone fails
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985> - [REG]touchscreen calibration issue
* Bug 5790<http://bugs.meego.com/show_bug.cgi?id=5790> - Bluetooth settings does not display properly after tapping Bluetooth from Settings
* Bug 6097<http://bugs.meego.com/show_bug.cgi?id=6097> - Aava: No default images in trunk: daily image
* Some applications take long time to launch. Such as SMS, People, Photos, Settings.
Performance data:
* Boot time: 65s
* Browser start time:18s
* Audio player start time: 4s
* Video player start time: 4s
Test Result
-----------------------
Result Overview
-----------------------
Total TCs
Passed
Failed
Not testable
Executable rate
Pass rate of total
Pass rate of executed
45
14
15
16
64.44%
31.11%
48.28%
Detailed Test Results
---------------------------
Category
Details
Test Results
Comments
Create image
Create image with MIC2
Pass
System startup
Image Boot from SD card
Pass
Home screen
Check if core applications can be launched from app-launcher
Pass
switch between different applications
Pass
Check home screen theme and layout
Fail
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Display orientation detection
Pass
Fennec browser
Open 2 tabs to surf 2 websites contains flash plugin
Referenced websites:
Flash plugin:
http://www.adobe.com/flashplatform/
http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer
Chinese websites:
http://www.sina.com.cn
http://www.taobao.com
Web applications:
http://mail.google.com/
http://mail.yahoo.com/
http://maps.google.com/
Pass
Tested only with link found on fennec Front page because [REG]Unable to use VKB input any characters to applications <http://bugs.meego.com/show_bug.cgi?id=6017>
Browsing website over 3G (WCDMA)
N/A
Not support in meego 1.1 release.
Browser gesture support
Pass
Dialer
Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)
Fail
Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)
N/A
Lack Of OTG cable
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)
N/A
Lack Of OTG cable
Display PhoneBook
Fail
Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
Check call history
Fail
Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
SMS
Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support)
Pass
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support)
N/A
Lack Of OTG cable
Check message history (received, sent, draft)
N/A
Lack Of OTG cable
Connectivity
scan wifi, check wifi connection and disconnection
Pass
Browse website and download some files through wifi
Fail
Bug 6017 - unable to enter the web site address with VKB<http://bugs.meego.com/show_bug.cgi?id=6017>
check if wifi On/Off works
Pass
check bluetooth connection (pairing and connect to bluetooth handset)
Fail
Bug 5790 - Bluetooth settings does not display properly after tapping Bluetooth from Settings<http://bugs.meego.com/show_bug.cgi?id=5790>
Connect device to computer with usb cable, check the usb mass storage device is detected by computer
N/A
Lack Of OTG cable
Check sshd connection: connect board using usb gadget
N/A
Lack Of OTG cable
Run time status/Settings/Control Panel
Check if runtime status are correct on toolbar
Pass
Check if volume could be adjusted
N/A
Check if time/date could be updated
N/A
Check if phone setting mode (offline, etc) could be updated
N/A
Virtual keyboard
Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS)
Fail
Bug 6017 - [REG]Unable to use VKB input any characters to applications<http://bugs.meego.com/show_bug.cgi?id=6017>
Support text input
Fail
Bug 6017 - [REG]Unable to use VKB input any characters to applications<http://bugs.meego.com/show_bug.cgi?id=6017>
Photo viewer
Check if the UI is correct (top bar, menu, button, etc.)
Fail
Bug 6097 - Aava: No default images in trunk: daily image<http://bugs.meego.com/show_bug.cgi?id=6097>
Check if photo thumbnail index works
Fail
Bug 6097 - Aava: No default images in trunk: daily image<http://bugs.meego.com/show_bug.cgi?id=6097>
Check if photo could be played
Fail
Bug 6097 - Aava: No default images in trunk: daily image<http://bugs.meego.com/show_bug.cgi?id=6097>
Audio
Check if the UI is correct (top bar, menu, button, play queue etc.)
Pass
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file)
Fail
Bug 4813 - [AAVA] audio driver playback error on aava <http://bugs.meego.com/show_bug.cgi?id=4813>
Video
Check if the UI is correct (top bar, menu, button, play queue etc.)
Fail
Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Check if video thumbnail index works
N/A
Unable to copy content to DUT because Lack of OTG cable
Check if video could be played (MP4, WMV & 3GP-H264)
N/A
Unable to copy content to DUT because Lack of OTG cable
Contacts
Check if it works with dialer, SMS
Pass
Security & Power
Check PIN activation/deactivation (Need GUI support)
N/A
PIN requested at boot
N/A
Power Off / Power On
Fail
Bug 2090 - Powering off the phone fails<http://bugs.meego.com/show_bug.cgi?id=2090>
Touchscreen
Use touch screen to operate the system
Fail
Bug 4985 - [REG]touchscreen calibration issue<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging
Charging with Normal USB charger
Pass
Charging with USB(OTG) cable
N/A
Lack Of OTG cable
Installation
Use zypper to install a package
N/A
Lack Of OTG cable
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=3921,4985,5670,5417,5856,5073,5706,5652,4813,3640,6097,5790
New bugs:
Sanity test trends
---------------------------
[cid:image003.png at 01CB4B86.D4696950]
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/AavaSanity20100903
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100903/18b4af66/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 67090 bytes
Desc: image003.png
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100903/18b4af66/attachment-0001.png>
More information about the Meego-releases
mailing list