[meego-releases] MeeGo Handset IA Aava Sanity Test Report for Trunk - 20100817
srikanth.4.yarlagadda at nokia.com
srikanth.4.yarlagadda at nokia.com
Tue Aug 17 03:33:19 PDT 2010
Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.
Build (Image)
-----------------------
Kickstart File: handset-ia32-aava-mtf.ks
Image crated from Trunk/daily
Test Environment
-----------------------
* Hardware: Aava Koski DV2
* Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
Lowlights:
* Bug 5016<http://bugs.meego.com/show_bug.cgi?id=5016> - [REG]No response when clicking application home button of Fennec the second time
* Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921> - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
* Bug 4872<http://bugs.meego.com/show_bug.cgi?id=4872> - [REG]Unable to detect display orientation change
* Bug 3618<http://bugs.meego.com/show_bug.cgi?id=3618> - [MRST] Bluetooth driver cannot work
* Bug 3917<http://bugs.meego.com/show_bug.cgi?id=3917> - [REG]Unable to launch VKB
* Bug 4985<http://bugs.meego.com/show_bug.cgi?id=4985> - [REG]touch screen calibration issue
* Many applications taking more time to launch. Such as SMS, People, Photos, Settings.
* No Video or music applications, just place holders.
Performance data:
Boot time: 50s
Browser start time: 7s
Audio player start time: 4s
Video player start time: 4s
Test Result
-----------------------
Result Overview
-----------------------
Total TCs Passed Failed Not testable Executable rate Pass rate of total Pass rate of executed
45 20 8 17 62.22% 44.44% 71.43%
Detailed Test Results
---------------------------
Category Details Test Results Comments
Create image Create image with MIC2 Pass
System startup Image Boot from SD card Pass
Home screen Check if core applications can be launched from app-launcher Pass
switch between different applications Fail Bug 5016 - [REG]No response when clicking application home button of Fennec the second time<http://bugs.meego.com/show_bug.cgi?id=5016>
Check home screen theme and layout Fail Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
Display orientation detection Fail Bug 4872 - [REG]Unable to detect display orientation change<http://bugs.meego.com/show_bug.cgi?id=4872>
Fennec browser Open 2 tabs to surf 2 websites contains flash plugin
Referenced websites:
Flash plugin:
http://www.adobe.com/flashplatform/
http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer
Chinese websites:
http://www.sina.com.cn
http://www.taobao.com
Web applications:
http://mail.google.com/
http://mail.yahoo.com/
http://maps.google.com/ Pass Used only links found from browser
Browsing website over 3G (WCDMA) N/A
Browser gesture support Pass
Dialer Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass
Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Lack Of OTG cable
Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Lack Of OTG cable
Display PhoneBook Pass
Check call history Pass
SMS Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) Pass
Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support) N/A Lack Of OTG cable
Check message history (received, sent, draft) N/A Lack Of OTG cable
Applets Add/remove weather/stock/news applet on applet library N/A
Connectivity scan wifi, check wifi connection and disconnection Pass
Browse website and download some files through wifi Pass
check if wifi On/Off works Pass
check bluetooth connection (pairing and connect to bluetooth handset) Fail Bug 3618 - [MRST] Bluetooth driver is not enabled <http://bugs.meego.com/show_bug.cgi?id=3618>
Connect device to computer with usb cable, check the usb mass storage device is detected by computer N/A Lack Of OTG cable
Check sshd connection: connect board using usb gadget N/A Lack Of OTG cable
Run time status/Settings/Control Panel Check if runtime status are correct on toolbar Pass
Check if volume could be adjusted N/A
Check if time/date could be updated N/A
Check if phone setting mode (offline, etc) could be updated N/A
Virtual keyboard Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS) Fail Bug 3917 - [REG]Unable to launch VKB<http://bugs.meego.com/show_bug.cgi?id=3917>
Support text input Fail Bug 3917 - [REG]Unable to launch VKB<http://bugs.meego.com/show_bug.cgi?id=3917>
Photo viewer Check if the UI is correct (top bar, menu, button, etc.) Pass
Check if photo thumbnail index works Pass
Check if photo could be played pass
Audio Check if the UI is correct (top bar, menu, button, play queue etc.) Pass No player, just placeholder
Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file) N/A Unable to copy content to DUT because Lack of OTG cable
Video Check if the UI is correct (top bar, menu, button, play queue etc.) Pass No player, just placeholder
Check if video thumbnail index works N/A No player, just placeholder
Check if video could be played (MP4, WMV & 3GP-H264) N/A No player, just placeholder
Contacts Check if it works with dialer, SMS Pass
Security & Power Check PIN activation/deactivation (Need GUI support) N/A
PIN requested at boot N/A
Power Off / Power On Fail Bug 2090 - Powering off the phone fails<http://bugs.meego.com/show_bug.cgi?id=2090>
Touchscreen Use touch screen to operate the system Fail Bug 4985 - [REG]touchscreen calibration issue<http://bugs.meego.com/show_bug.cgi?id=4985>
Device Battery charging Charging with Normal USB charger Pass
Charging with USB(OTG) cable N/A Lack Of OTG cable
Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=5016%2C3921%2C4872%2C3618%2C3917%2C4985%2C2090
No New bugs:
Sanity test trends
---------------------------
Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/AavaSanity20100817
Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
“Try and fail but don’t fail to try”
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100817/0033a977/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 35856 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/private/meego-releases/attachments/20100817/0033a977/attachment-0001.jpg>
More information about the Meego-releases
mailing list