[meego-releases] MeeGo-handset-IA-Aava-Sanity Test Reportfor Trunk:Daily-20100908

srikanth.4.yarlagadda at nokia.com srikanth.4.yarlagadda at nokia.com
Wed Sep 8 08:46:49 PDT 2010 

Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionalities of the distribution.

Build (Image)
-----------------------
*

Kickstart File: handset-ia32-aava-mtf.ks
*       Image crated from Trunk/daily

Test Environment
-----------------------
*

Hardware: Aava Koski DV2
*       Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP

Quality Summary
---------------------------
Highlights:
*       Bluetooth pairing working.

Lowlights:
*       Bug 5856<http://bugs.meego.com/show_bug.cgi?id=5856>- Launching dialer fails
*       Bug 6047<http://bugs.meego.com/show_bug.cgi?id=6047>- [VKB] The typed content not displayed unless vkb is closed
*       Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921>- [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
*       Bug 5705<http://bugs.meego.com/show_bug.cgi?id=5705>- [REG] Unable to display home screen automatically unless tapping the screen
*       Bug 6304<http://bugs.meego.com/show_bug.cgi?id=6304>- Calendar application failed to launch.
*       Bug 6430<http://bugs.meego.com/show_bug.cgi?id=6430>- Sceen becomes to white or freezing after changing the orientation detection.
*       Bug 5301<http://bugs.meego.com/show_bug.cgi?id=5301>- Runtime status not shown on toolbar
*       Bug 4813<http://bugs.meego.com/show_bug.cgi?id=4813>- [AAVA] audio driver playback error on aava
*       Bug 2090<http://bugs.meego.com/show_bug.cgi?id=2090>- Powering off the phone fails
*       Bug 5587<http://bugs.meego.com/show_bug.cgi?id=5587>- home screen fails to load

Performance data:
*       bootup time: 67s
*       Setting: 2s
*       photo start time: 3s
*       people start time: 4.5s
*       Video player start time: 7s
*       SMS start time: 5s
*       Fennec start time: 6s
*       Music player time: 5s

Test Result
-----------------------

Result Overview
-----------------------
Total TCs       Passed  Failed  Not testable    Executable rate         Pass rate of total      Pass rate of executed
45      16      13      16      64.44%  35.56%  55.17%



Detailed Test Results
---------------------------

Category        Details Test Results    Comments
Create image    Create image with MIC2  Pass
System startup  Image Boot from SD card Fail
Bug 5705 - [REG] Unable to display home screen automatically unless tapping the screen <http://bugs.meego.com/show_bug.cgi?id=5705>
Home screen     Check if core applications can be launched from app-launcher    Fail     Bug 6304 - Calendar application failed to launch. <http://bugs.meego.com/show_bug.cgi?id=6304>
        switch between different applications   Pass
        Check home screen theme and layout      Fail    Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>

        Display orientation detection   Fail    Bug 6430 - Sceen becomes to white or freezing after changing the orientation detection.<http://bugs.meego.com/show_bug.cgi?id=6430>
Fennec browser  Open 2 tabs to surf 2 websites contains flash plugin
Referenced websites:
Flash plugin:
http://www.adobe.com/flashplatform/
http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer
Chinese websites:
http://www.sina.com.cn
http://www.taobao.com
Web applications:
http://mail.google.com/
http://mail.yahoo.com/
http://maps.google.com/         Pass    Tested only with link found on fennec Front page because unable to use VKB input any characters to applications
        Browsing website over 3G (WCDMA)        N/A     Not support in meego 1.1 release.
        Browser gesture support         Pass
Dialer  Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)     Fail    Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
         Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)  N/A
        Receive one call, reject this call without accepting the call(phonesim, GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)    N/A
        Display PhoneBook       Fail    Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
        Check call history      Fail    Bug 5856 - Launching dialer fails<http://bugs.meego.com/show_bug.cgi?id=5856>
SMS     Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support)     Pass
        Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support)  N/A     SIM function is not implemented yet.
        Check message history (received, sent, draft)   N/A     SIM function is not implemented yet.
Connectivity    scan wifi, check wifi connection and disconnection      Pass
        Browse website and download some files through wifi     Fail    Bug 6047 - [VKB] The typed content not displayed unless vkb is closed<http://bugs.meego.com/show_bug.cgi?id=6047>
        check if wifi On/Off works      Pass
        check bluetooth connection (pairing and connect to bluetooth handset)   Pass
        Connect device to computer with usb cable, check the usb mass storage device is detected by computer    N/A     Lack Of OTG cable
        Check sshd connection: connect board using usb gadget   N/A     Lack Of OTG cable
Run time status/Settings/Control Panel  Check if runtime status are correct on toolbar  Fail    Bug 5301 -  Runtime status not shown on toolbar<http://bugs.meego.com/show_bug.cgi?id=5301>
        Check if volume could be adjusted       N/A
        Check if time/date could be updated     N/A
        Check if phone setting mode (offline, etc) could be updated     N/A
Virtual keyboard        Check if virtual keyboard can be launched automatically with apps which  need input text field (fennec, SMS)    Pass    VKB launched successful.
        Support text input      Fail    Bug 6047 - [VKB] The typed content not displayed unless vkb is closed<http://bugs.meego.com/show_bug.cgi?id=6047>
Photo viewer    Check if the UI is correct (top bar, menu, button, etc.)        Pass
        Check if photo thumbnail index works    Pass
        Check if photo could be played  Pass
Audio   Check if the UI is correct (top bar, menu, button, play queue etc.)     Pass
        Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file)      Fail    Bug 4813 - [AAVA] audio driver playback error on aava <http://bugs.meego.com/show_bug.cgi?id=4813>
Video   Check if the UI is correct (top bar, menu, button, play queue etc.)     Fail    Bug 3921 - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks<http://bugs.meego.com/show_bug.cgi?id=3921>
        Check if video thumbnail index works    N/A     Unable to copy content to DUT because Lack of OTG cable
        Check if video could be played (MP4, WMV &  3GP-H264)   N/A     Unable to copy content to DUT because Lack of OTG cable
Contacts        Check if it works with dialer, SMS      Pass
Security & Power        Check PIN activation/deactivation (Need GUI support)    N/A
        PIN requested at boot   N/A
        Power Off / Power On    Fail    Bug 2090 - Powering off the phone fails<http://bugs.meego.com/show_bug.cgi?id=2090>
Touchscreen     Use touch screen to operate the system  Pass
Device Battery charging         Charging with Normal USB charger        Pass
        Charging with USB(OTG) cable    N/A     Lack Of OTG cable
Installation    Use zypper to install a package N/A     Lack Of OTG cable



Issue Summary
---------------------------
Top bugs:
http://bugs.meego.com/buglist.cgi?quicksearch=5856%2C6047%2C3921%2C5705%2C6304%2C6430%2C5301%2C4813%2C2090


New bugs:
 http://bugs.meego.com/show_bug.cgi?id=6430


Sanity test trends
-----------------------







Detailed Sanity Test Report for Trunk
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/AavaSanity20100908




Thanks and regards
Srikanth Yarlagadda
MeeGo Testing RST
Cell:-+358 ( 0)50 487 3519
"Try and fail but don't fail to try"



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100908/0f168fdb/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Picture (Device Independent Bitmap) 1.jpg
Type: image/jpeg
Size: 43257 bytes
Desc: Picture (Device Independent Bitmap) 1.jpg
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100908/0f168fdb/attachment-0001.jpg>

More information about the Meego-releases mailing list