[meego-releases] IVI-IA-Milestone Test report for 1.0.99.2.20101019.1 img(1.1 RC 2)

Wed Oct 20 03:03:39 PDT 2010

Quality Summary
--------------------------------------
Improvements:
?        n/a

Key Issues:
?        meegovideo sometimes(>70%) is NOT with software rendering if launching from ivi menu, tracked in bug 8630<http://bugs.meego.com/show_bug.cgi?id=8630>
?        Dialer does NOT handle negative scenarios smoothly, new two bugs 8650<http://bugs.meego.com/show_bug.cgi?id=8650>, 8651<http://bugs.meego.com/show_bug.cgi?id=8651>
?        The 3 open issues of timberdale driver(8407<http://bugs.meego.com/show_bug.cgi?id=8407> - failure in obtaining Ethernet IP; 8410<http://bugs.meego.com/show_bug.cgi?id=8410> - snd-timbi2s not found; 8411<http://bugs.meego.com/show_bug.cgi?id=8411> - timb-video not found) still existing in pure 1.1 image.

Test Coverage
--------------------------------------
Fullfunctional test on RV
Basic Performance on RV
Sanity test on Crown Beach
Bug verification

Testing Summary
--------------------------------------
Russellville:
Total TCs

Passed

Failed

Not testable

Executable rate

Pass rate of total

Pass rate of executed

378

319

25

34

91.0%

84.4%

92.7%

Crown Beach:
Total TCs

Passed

Failed

Not testable

Executable rate

Pass rate of total

Pass rate of executed

36

35

1

0

100%

97.2%

97.2%

Category

Components

Quality

Comments/Bug summary

MeeGo Core

Common/Core

897<http://bugs.meego.com/show_bug.cgi?id=897> - Analog Device AD1986A is muted by default

Timberdale Drivers

8407<http://bugs.meego.com/show_bug.cgi?id=8407> - Russellville networking: ks8842: receive queue is dropping packets
8410<http://bugs.meego.com/show_bug.cgi?id=8410> - Russellville: snd-timbi2s not found
8411<http://bugs.meego.com/show_bug.cgi?id=8411> - Russellville: Unable to find video device

IVIHome

taskbar/menu

2582<http://bugs.meego.com/show_bug.cgi?id=2582> - startx from console should result in ividesktop

text-to-speech

5496<http://bugs.meego.com/show_bug.cgi?id=5496> - audio easily becomes busy, blocking text-to-speech

speech recognition

7557<http://bugs.meego.com/show_bug.cgi?id=7557> - [Speech Recognition] unable to recognize input "CLOSE VIDEO"
8642<http://bugs.meego.com/show_bug.cgi?id=8642> - [Speech Recognition] unable to recognize input "CLOSE DIALER"

Multimedia controller

Connect

hfdialer

[Dialer] Several audio route and status sync(7062<http://bugs.meego.com/show_bug.cgi?id=7062>, 7432<http://bugs.meego.com/show_bug.cgi?id=7432>, 7436<http://bugs.meego.com/show_bug.cgi?id=7436>);
[Contacts] history calls are not recorded(7398<http://bugs.meego.com/show_bug.cgi?id=7398>, upstream 2088<http://bugs.meego.com/show_bug.cgi?id=2088>); 8485<http://bugs.meego.com/show_bug.cgi?id=8485> - People crashes when launching hfdialer

Contacts

App crashes when Tapping "show recent/show favorite"(6397<http://bugs.meego.com/show_bug.cgi?id=6397>), when searching contacts(7683<http://bugs.meego.com/show_bug.cgi?id=7683>), when calling a contact(8194<http://bugs.meego.com/show_bug.cgi?id=8194>), and when launching hfdialer(8485<http://bugs.meego.com/show_bug.cgi?id=8485>)

Connectivity

wired

8407<http://bugs.meego.com/show_bug.cgi?id=8407> - Russellville networking: ks8842: receive queue is dropping packets

wifi

bluetooth

Navigation

Navit

Browser-QT

7561<http://bugs.meego.com/show_bug.cgi?id=7561> - fennec-qt: location bar and webpage NOT full screen
7654<http://bugs.meego.com/show_bug.cgi?id=7654> - black screen when playing flash using fennec

Media

Photo Viewer

7395<http://bugs.meego.com/show_bug.cgi?id=7395> - [REG] Photo viewer crashes when clicking on an album
6644<http://bugs.meego.com/show_bug.cgi?id=6644> - [REG] meegophotos crashes when closing it after viewing photos in single mode
UI layouts are not fit for IVI resolution(6561<http://bugs.meego.com/show_bug.cgi?id=6561>, 6563<http://bugs.meego.com/show_bug.cgi?id=6563>, 8251<http://bugs.meego.com/show_bug.cgi?id=8251>)

Music Player

Video Player

System functions

Installer(GUI/text)

8078<http://bugs.meego.com/show_bug.cgi?id=8078> - liveinst from IVI menu failed to find hard drive

USB/SD auto mounter

3780<http://bugs.meego.com/show_bug.cgi?id=3780> - IVI: failed to auto mount SD

Settings

5232<http://bugs.meego.com/show_bug.cgi?id=5232> - IVI: no GUI to configure date and time

Package Manager

File Manager

Others

5302<http://bugs.meego.com/show_bug.cgi?id=5302> - IVI: System can't boot after date/time is changed backward
3979<http://bugs.meego.com/show_bug.cgi?id=3979> - move gnome-packagekit from netbook repo to core repo (repo arch issue)

Testing Details
--------------------------------------
Test Objective
=================
QA did fullpass tests for IVI 1.1 release, which covered all required features of IVI, including timberdale driver, hfdialer, ivihome, sample MTF applications, system update and also some other connman used system functions.

Builds
=================
meego-ivi-ia32-noemgd-1-1.0.99.2.20101019.1.img

Test Environment
=================
Hardware: Russellville, Crown Beach
Firmware Version: FPGA 3.9.0 on Russellville
Test equipment: Intel wifi Link 5100, Bluetooth usb dongle, SE C905 for hfdialer, Wireless AP, USB disk, SD/MMC cards

 Detailed Test Results
=================
System performance test data on RV:
Disk footprint: 1462M; MEM: 96M; X-MEM: 15M
System cold boot time: 15.698s(attached bootchart)
Powertop: log attached.

Issue Summary
=================
New
8630<http://bugs.meego.com/show_bug.cgi?id=8630> - meegovideo sometimes(>70%) is NOT with software rendering if launching from ivi menu
8642<http://bugs.meego.com/show_bug.cgi?id=8642> - [Speech Recognition] unable to recognize input "CLOSE DIALER"
8650<http://bugs.meego.com/show_bug.cgi?id=8650> - Dialer crashes when ending a call after pulseaudio is terminated
8651<http://bugs.meego.com/show_bug.cgi?id=8651> - [hdialer] module-loopback not unloadded when ending a call after bt chip is down
8685<http://bugs.meego.com/show_bug.cgi?id=8685> - Rename trunk.repo to core.repo

Verified
n/a

See IVI_1.1_Open<http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=IVI_1.1_Open&sharer_id=234> bugs.

Conclusions and Recommendations From QA
--------------------------------------
This image has little changes comparing last the last RC build.

Thanks,
Yanshuang
Open Source Technology Center
Intel Corporation
+86-21-6116-6497

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20101020/472dd5f3/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: bootchart-20101019-Russellville.svg
Type: application/octet-stream
Size: 450549 bytes
Desc: bootchart-20101019-Russellville.svg
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20101020/472dd5f3/attachment-0002.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: powertop-20101019-Russellville.log
Type: application/octet-stream
Size: 37946 bytes
Desc: powertop-20101019-Russellville.log
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20101020/472dd5f3/attachment-0003.obj>