[meego-releases] Handset-IA-Aava-Sanity Test Report for Trunk:Daily-20100930

Marko Saukko marko.saukko at cybercom.com
Thu Sep 30 06:03:19 PDT 2010


Hi,

I assume that this test report is MeeGo Handset 1.2 test report as it is 
from Trunk daily repo?

We might want to seperate the reports with the release number in 
addition to the date, e.g.,

1.1.80.0-20100930

ref: http://wiki.meego.com/Release_Engineering/Plans/1.2

Regards,
Marko

On 09/30/2010 03:58 PM, srikanth.4.yarlagadda at nokia.com wrote:
> *Test Objective*
> *-----------------------*
> Sanity test is a very brief run-through of the functionality of the
> entire MeeGo distribution, to assure that the basic health of the
> distribution and report major regressions at the earliest time. All the
> checkpoints in sanity test reflects the most important and basic
> functionalities of the distribution.
> *Build **(Image)*
> *-----------------------*
>
>     * Kickstart File: handset-ia32-aava-mtf.ks
>     * Image crated from Trunk/daily
>
> *Test Environment*
> *-----------------------*
>
>     * Hardware: Aava Koski DV2
>     * Test equipment (bluetooth devices, wlan devices, network
>       simulators, sim simulators etc): wireless AP
>
> *Quality Summary *
> *--------------------------- */* */
> *Improvements*
> *key issues*/* */
> Bug 7731- Unable to adjust volume by volume key.
> <http://bugs.meego.com/buglist.cgi?quicksearch=7731>
> Bug 5856- Launching dialer fails
> <http://bugs.meego.com/buglist.cgi?quicksearch=5856>
> Bug 7616- Music player can't launch after meegotouch-theme and
> meegotouch-theme-meego is updated in September 28th
> <http://bugs.meego.com/buglist.cgi?quicksearch=7616>
> Bug 7618- [REG]Crash when tap a video thumbnail or tap the 'play' button
> in the play control bar <http://bugs.meego.com/buglist.cgi?quicksearch=7618>
> Bug 7225- VKB keystroke response is very slow in Aava DV2
> <http://bugs.meego.com/buglist.cgi?quicksearch=7225>
> Bug 6007 <http://bugs.meego.com/show_bug.cgi?id=6007> - [REG] Contacts
> crashes when saving a contact with high possibility
> *Performance data:*
> bootup time: 50s
> SMS start time: 14s
> Calendar start time: 4s
> Social Networking start time: 4s
> photo start time: 4s
> MeeGo Music start time: NA
> people start time: 5s
> Chat start time: 4s
> Lock start time: 2s
> Fennec start time: 12s
> Video start time: 4s
> Setting start time: 2s
> Email start time: 2s
> *Test Result*
> *-----------------------*
> *Result Overview*
> /*-----------------------*/
> *Total TCs * 	*Passed * 	*Failed * 	*Not testable * 	*Executable rate
> * 	*Pass rate of total * 	*Pass rate of executed *
> 45 	21 	17 	7 	84,44 % 	46,67 % 	55,26 %
>
> *Detailed Test Results*
> *--------------------------- *
> *Category* 	*Details* 	*Test Results* 	*Comments*
> Create image 	Create image with MIC2 	Pass 	
> System startup 	Image Boot from SD card 	Fail 	
> _Bug 5705 - [REG] Unable to display home screen automatically unless
> tapping the screen _ <http://bugs.meego.com/show_bug.cgi?id=5705>
> Home screen 	Check if core applications can be launched from
> app-launcher 	Fail 	_Bug 5856 - Launching dialer fails
> __Bug 3551 - xterm doesn't launch correctly and doesn't work
> __Bug 7616 - Music player can't launch after meegotouch-theme and
> meegotouch-theme-meego is updated in September 28th_
> <http://bugs.meego.com/buglist.cgi?quicksearch=5856%2C3551>
> switch between different applications 	Pass 	_ _
> Check home screen theme and layout 	Fail 	_Bug 5107 -
> meegotouch-systemui no longer includes flat_drop_big_lock.png_
> <http://bugs.meego.com/show_bug.cgi?id=5107>
> Display orientation detection 	Pass 	_ _
> Fennec browser 	Open 2 tabs to surf 2 websites contains flash plugin
> Referenced websites:
> Flash plugin:
> http://www.adobe.com/flashplatform/
> http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer
> <http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer>
> Chinese websites:
> http://www.sina.com.cn
> http://www.taobao.com
> Web applications:
> http://mail.google.com/
> http://mail.yahoo.com/
> http://maps.google.com/ 	Pass 	Browsing websites successfuls, unable to
> find "Go" button, using OTG keybord "Enter" key instead.
> Browsing website over 3G (WCDMA) 	N/A 	Not support in meego 1.1 release.
> Browser gesture support 	Pass 	
> Dialer 	Dial one outgoing call, accept by other party, terminate this
> call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real
> modem supported,Will use phonesim to test before real modem support)
> Fail 	_Bug 5856 - Launching dialer fails_
> <http://bugs.meego.com/show_bug.cgi?id=5856>
> Receive a call, accept the call, terminate this call (phonesim, GSM &
> WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will
> use phonesim to test before real modem support) 	N/A 	Blocked by Bug
> 5856 - Launching dialer fails
> Receive one call, reject this call without accepting the call(phonesim,
> GSM & WCDMA)(GSM and WCDMA cannot be covered until real modem
> supported,Will use phonesim to test before real modem support) 	N/A
> Blocked by Bug 5856 - Launching dialer fails
> Display PhoneBook 	Fail 	_Bug 5856 - Launching dialer fails_
> <http://bugs.meego.com/show_bug.cgi?id=5856>
> Check call history 	Fail 	_Bug 5856 - Launching dialer fails_
> <http://bugs.meego.com/show_bug.cgi?id=5856>
> SMS 	Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until
> real modem supported,Will use phonesim to test before real modem
> support) 	Pass 	SMS application can be launched and SMS can be composed
> . SIM function is not implemented to test send/receive function.
> Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until
> real modem supported,Will use phonesim to test before real modem
> support) 	N/A 	SIM function is not implemented yet.
> Check message history (received, sent, draft) 	Pass 	Only can check
> drafted message history for SMS send/receive function does not work due
> to SIM function is not implemented.
> Connectivity 	scan wifi, check wifi connection and disconnection 	Fail
> _Bug 3291 - [REG] Wifi applet, connect to network is unstable, 1/2
> failure rate_ <http://bugs.meego.com/show_bug.cgi?id=3291>
> Browse website and download some files through wifi 	Pass 	Downloaded a
> mp3 file successful, but can not be played.
> check if wifi On/Off works 	Fail 	_Wifi list is not displayed properly.
> __Bug 811 - Click Failure network in WIFI network list crashes Settings_
> <http://bugs.meego.com/show_bug.cgi?id=811>
> check bluetooth connection (pairing and connect to bluetooth
> handset) 	Pass 	_ _
> Connect device to computer with usb cable, check the usb mass storage
> device is detected by computer 	Pass 	
> Check sshd connection: connect board using usb gadget 	Pass 	ssh package
> installed manually
> Run time status/Settings/Control Panel 	Check if runtime status are
> correct on toolbar 	Fail 	_Bug 2801 - [Aava] Battery driver reporting
> incorrect/incomplete information_
> <http://bugs.meego.com/show_bug.cgi?id=2801>
> Check if volume could be adjusted 	Fail 	_Bug 7731 - Unable to adjust
> volume by volume key._ <http://bugs.meego.com/show_bug.cgi?id=7731>
> Check if time/date could be updated 	N/A 	Not implement yet.
> Check if phone setting mode (offline, etc) could be updated 	Fail 	_ Bug
> 7064 - The settings' status of drop down menu can't be updated in time.
> _ <http://bugs.meego.com/show_bug.cgi?id=7064>
> Virtual keyboard 	Check if virtual keyboard can be launched
> automatically with apps which need input text field (fennec, SMS)
> Fail 	_Bug 7225 - VKB keystroke response is very slow in Aava DV2_
> <http://bugs.meego.com/show_bug.cgi?id=7225>
> Support text input 	Pass 	Input works fine in fennec.
> Photo viewer 	Check if the UI is correct (top bar, menu, button, etc.)
> Pass 	
> Check if photo thumbnail index works 	Pass 	
> Check if photo could be played 	Pass 	
> Audio 	Check if the UI is correct (top bar, menu, button, play queue
> etc.) 	Fail 	_Bug 7616 - Music player can't launch after
> meegotouch-theme and meegotouch-theme-meego is updated in September
> 28th_ <http://bugs.meego.com/show_bug.cgi?id=7616>
> Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker
> (play music by command line if audio player is not ready. aplay to play
> music file) 	Fail 	_Bug 7616 - Music player can't launch after
> meegotouch-theme and meegotouch-theme-meego is updated in September
> 28th_ <http://bugs.meego.com/show_bug.cgi?id=7616>
> Video 	Check if the UI is correct (top bar, menu, button, play queue
> etc.) 	Pass 	_ _
> Check if video thumbnail index works 	Pass 	
> Check if video could be played (MP4, WMV & 3GP-H264) 	Fail 	_Bug 7618 -
> [REG]Crash when tap a video thumbnail or tap the 'play' button in the
> play control bar_ <http://bugs.meego.com/show_bug.cgi?id=7618>
> Contacts 	Check if it works with dialer, SMS 	Pass 	For unable launch
> dialer(Bug 5856), only tested with SMS.
> Security & Power 	Check PIN activation/deactivation (Need GUI
> support) 	N/A 	_ _
> PIN requested at boot 	N/A 	
> Power Off / Power On 	Fail 	_Bug 2090 - Powering off the phone fails_
> <http://bugs.meego.com/show_bug.cgi?id=2090>
> Touchscreen 	Use touch screen to operate the system 	Pass 	
> Device Battery charging 	Charging with Normal USB charger 	Pass 	
> Charging with USB(OTG) cable 	Fail 	_Bug 2260- N900/Aava Battery
> charging support _ <http://bugs.meego.com/show_bug.cgi?id=2260>
> Installation 	Use zypper to install a package 	Pass 	
>
> *Issue Summary*
> *--------------------------- */* */
> /*Top bugs:*/
> _http://bugs.meego.com/buglist.cgi?quicksearch=5705%2C5856%2C7225%2C7616%2C3551%2C5107%2C7064%2C7618%2C2090%2C3291%2C811%2C2801%2C7731_
> /*New bugs:*/
> *Sanity test trends*
> ---------------------
> *Detailed Sanity Test Report for Trunk*
> *--------------------------- */* */
> _http://wiki.meego.com/Quality/HandsetTestReport/AavaSanity20100930_
> /Thanks and regards/
> /Srikanth Yarlagadda/
> /MeeGo Testing RST
> //Cell:-+358 ( 0)50 487 3519/
> /*“Try and fail but don’t fail to try”*/



More information about the Meego-releases mailing list