[meego-releases] Bug 5953 & Aava (RE: MeeGo-handset-IA-Aava-Acceptance Test Report for Trunk:Testing-20100903
harri.hakulinen at nokia.com
harri.hakulinen at nokia.com
Fri Sep 3 02:37:38 PDT 2010
Hello all,
I noticed that the ( Bug 5953- [QMF] account creation does not work ) has been originally detected on Aava, and then later found on N900 as well.
However, now it is visible on N900 testing report (as lowlight) but not in Aava testing report.
I am sure that testing people have calculated this in, so that the pass rate is correct, but still the reports are bit difficult to follow because the lowlights/higligts are not in sync.
Br,
//Harri
________________________________________
From: meego-releases-bounces at meego.com [meego-releases-bounces at meego.com] On Behalf Of ext Fu, Yi [yi.fu at intel.com]
Sent: Friday, September 03, 2010 9:11 AM
To: meego-releases at meego.com
Subject: [meego-releases] MeeGo-handset-IA-Aava-Acceptance Test Report for Trunk:Testing-20100903
Test Objective
-----------------------
Acceptance test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in acceptance test reflects the most important and basic functionalities of the distribution. We do the acceptance test against Trunk:Testing repo.
Build Location
-----------------------
Kickstart file is at: gitorious.org:meego-os-base/image-configurations.git
Kickstart File: handset-ia32-aava-mtf.ks
We have modified the kickstart file a little bit to point the core and handset repo to Trunk:Testing repo (http://download.meego.com/testing ) to create the sanity test image against Trunk:Testing
The packages list of image, please see the detail report in http://wiki.meego.com/Quality/HandsetTestReport/AavaAcceptance20100903
Key Packages
kernel-mrst.i586 2.6.35.3-8.1
xorg-x11-server-Xorg-setuid.i586 1.9.0-1.25
mesa-libGL.i586 7.8.99.1~gitb018ea19a3-3.1
glibc.i686 2.11.90-19.4
Test Environment
-----------------------
l Hardware: Aava Koski DV1/DV2
l Test equipment (bluetooth devices, wlan devices, network simulators, sim simulators etc): wireless AP
Quality Summary
---------------------------
Highlights:
n Touchscreen calibration issue doesn’t exist in this image.
Lowlights:
n Fennec detect display orientation failed(6244<http://bugs.meego.com/show_bug.cgi?id=6244>).
n Unable to display home screen automatically unless tapping the screen (5705<http://bugs.meego.com/show_bug.cgi?id=5705>).
n SMS history fail to display(3670<http://bugs.meego.com/show_bug.cgi?id=3670>).
n User may not find bluetooth device by about 2/3 possibility(5417<http://bugs.meego.com/show_bug.cgi?id=5417>)
n VKB launches incorrectly(5706<http://bugs.meego.com/show_bug.cgi?id=5706>).
Performance data:
Boot time:58s
Browser start time: 5s
Audio player start time: 4s
Video player start time: 4.5s
The other performance data, please see http://wiki.meego.com/Quality/HandsetTestReport/AavaAcceptance20100903
Test Result
-----------------------
Result Overview
-----------------------
Total TCs
Passed
Failed
Not testable
Executable rate
Pass rate of total
Pass rate of executed
36
22
11
3
91.67%
61.11%
66.67%
Detailed Test Results
---------------------------
The following cases are run with 2G of / file system size.
Create Image
• Create image with MIC2
Pass
System startup
• Image Boot from SD card
Pass
Home screen
• Check if core applications can be launched from app-launcher
Pass
• switch between different applications
Pass
• Check home screen theme and layout
Fail
Bug 3921<http://bugs.meego.com/show_bug.cgi?id=3921> - [REG] Some buttons (App-launcher, Home, Close) and app icons (Settings/Lock icons) are rendered as red blocks
Bug 5998<http://bugs.meego.com/show_bug.cgi?id=5998> - Launching indicator of applications in quick launch bar has calibration issue.
• Display orientation detection
Pass
Fennec browser
Browsing website over wifi (WEP secured by default, WPA is WEP is not testable)
Pass
• Browsing website over 3G (WCDMA)
N/A
Not support in meego 1.1 release.
• Browser gesture support
Fail
Bug 6244<http://bugs.meego.com/show_bug.cgi?id=6244> - [Trunk:testing][REG]Fennec web browser doesn't support display orientation.
Dialer
• Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM & WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use phonesim to test before real modem support)
Pass
• Display PhoneBook
Pass
• Check call history
Pass
SMS
• Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem supported,Will use phonesim to test before real modem support)
Pass
• Check message history (received, sent, draft)
Fail
Bug 3670<http://bugs.meego.com/show_bug.cgi?id=3670> - [SMS] The SMS history fail to show.
Connectivity
• scan wifi, check wifi connection and disconnection
Pass
• Browse website and download some files through wifi
Pass
• check bluetooth connection (pairing and connect to bluetooth handset)
Fail
Bug 5417<http://bugs.meego.com/show_bug.cgi?id=5417> - [Aava] when booting, user may not find bluetooth device by about 2/3 possibility
• Connect device to computer with usb cable, check the usb mass storage device is detected by computer
Fail
Bug 5034<http://bugs.meego.com/show_bug.cgi?id=5034> - [MRST] rmmod g_file_storage leads to panic
• Check sshd connection: connect board using usb gadget
Fail
Bug 5475<http://bugs.meego.com/show_bug.cgi?id=5475> - [AAVA] rmmod g_cdc leads to panic
Run time status/Settings/Control Panel
• Check if runtime status are correct on toolbar
Pass
Virtual keyboard
• Check if virtual keyboard can be launched automatically with apps which need input text field (fennec, SMS)
Fail
Bug 5706<http://bugs.meego.com/show_bug.cgi?id=5706> - VKB launched incorrectly with apps which need input text field.
• Support text input
Fail
Bug 5652<http://bugs.meego.com/show_bug.cgi?id=5652> - Some keys of VKB are rendered as red block
Photo viewer
• Check if the UI is correct (top bar, menu, button, etc.)
Pass
• Check if photo thumbnail index works
Pass
• Check if photo could be played
Pass
Audio
• Check if the UI is correct (top bar, menu, button, play queue etc.)
Pass
• Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music by command line if audio player is not ready. aplay to play music file)
Fail
Bug 150<http://bugs.meego.com/show_bug.cgi?id=150> - [Aava] [CDK] pulseaudio not work on CDK & Aava
Video
• Check if the UI is correct (top bar, menu, button, play queue etc.)
Fail
Bug 5782<http://bugs.meego.com/show_bug.cgi?id=5782> - [Video player]The "play/pause","forward/backward" icons in the control bar are rendered as red blocks
Bug 5786<http://bugs.meego.com/show_bug.cgi?id=5786> - [Video player]Some categories are not in the view menu, such as "My Movies", "Films", "TV shows", "Search"
• Check if video thumbnail index works
Pass
• Check if video could be played (MP4, WMV & 3GP-H264)
Fail
Bug 5712<http://bugs.meego.com/show_bug.cgi?id=5712> - Video playback is not working
Contacts
• Check if it works with dialer, SMS
Pass
Security & Power
• Check PIN activation/deactivation (Need GUI support)
N/A
• PIN requested at boot
N/A
• Power Off / Power On
Pass
Touchscreen
• Use touch screen to operate the system
Pass
Installation
• Use zypper to install a package
Pass
Issue Summary
---------------------------
Top bugs:
Bug 5417<http://bugs.meego.com/show_bug.cgi?id=5417> - [Aava] when booting, user may not find bluetooth device by about 2/3 possibility
Bug 3670<http://bugs.meego.com/show_bug.cgi?id=3670> - [SMS] The SMS history fail to show.
New bugs:
Bug 6244<http://bugs.meego.com/show_bug.cgi?id=6244> - [Trunk:testing][REG]Fennec web browser doesn't support display orientation.
Acceptance test trends
---------------------------
[cid:image002.png at 01CB4B6F.657FD2C0]
Detailed Acceptance Test Report
---------------------------
http://wiki.meego.com/Quality/HandsetTestReport/AavaAcceptance20100903
Best Regards
Yi
More information about the Meego-releases
mailing list