[meego-releases] MeeGo v1.1 Handset UX/Applications (Extended Feature) 2010-09-26 Aava Test Report (for 1.0.90.4.20100924.1 images)

[Fu, Yi]

Test Objective
--------------------------------------

This round of testing is *extended feature testing*. The cases in the *extended feature testing* scope are the ready test cases which are NOT included in the key feature basic testing scope because their priority is lower considering 1.1 POR or they are not directly mapped to the 50 1.1 key features. The purpose of extended feature testing is to ensure big testing coverage, and to expose as many bugs as possible before code freeze, although it doesn’t mean all the bugs detected would be treated as release blockers. The test covers the all applications integrated in the image.


Build Location
---------------------------------------
Aava:  http://repo.meego.com/MeeGo/builds/trunk/1.0.90.4.20100924.1/handset/images/meego-handset-ia32-aava-mtf/

Test Environment
---------------------------------------
Hardware:
Aava
Test equipment: bluetooth devices, phonesim simulators, wireless AP

Test Coverage
---------------------------------------
Test types:
Extended feature test
Bug verification

Updated UX/Applications Components:
MTF, Music, Video, Dialer, SMS, Browser, Settings, Contacts, Theme, Social networking, Email, IM

Quality Summary
---------------------------------------

Ø  We have found 30 new issues during the *extended feature testing*. Among them 4 are proposed as 1.1 release blockers and waiting for CCB to review.

         7487<http://bugs.meego.com/show_bug.cgi?id=7487> - no setting for volume control

7467 <http://bugs.meego.com/show_bug.cgi?id=7467> - Unable to make an outgoing call by pressing the call icon in call history

         7469 <http://bugs.meego.com/show_bug.cgi?id=7469> - Unable to make an outgoing call by pressing the call icon in dialer people page

         7494<http://bugs.meego.com/show_bug.cgi?id=7494> - [REG] The miss call notification does not display

Test Result
---------------------------------------
Result Overview

Ø  Extended Feature test results:
Total TC

Passed

Failed

Blocked

Not Supported

Executable Rate

Pass rate of total

Pass rate of executed

637

326

127

44

140

78.02%

51.18%

65.59%


Detailed Test Results:

Group

Use Case

Total TCs

Passed

Failed

Blocked

N/A

Executable rate

Pass rate of total

Pass rate of executed

Media

Audio Playback

98

75

20

0

3

96.90%

76.50%

78.90%

(Music Player)

Video Playback

60

26

25

0

9

85.00%

43.30%

50.90%

(Video Player)

　

　

Telephony

Make/Receive 3G Call

60

21

4

0

35

41.74%

35.00%

84.00%

(3G modem is not available in Aava. Test results based on phonesim simulator)

(Dialer)

　

　

　

　

　

　

　

Send / Receive SMS

52

16

3

2

31

40.40%

30.80%

84.20%

　

(SMS)

　

　

　

　

Web browser

Browse Internet

19

13

1

4

1

73.70%

68.40%

92.90%

(3G modem is not available in Aava. Test results based on WLAN connection)

(Browser)

VKB

Virtual Keyboard

28

0

15

8

5

53.60%

0.00%

0.00%


Core UX

Home screen/ Theme/ System UI/ libmeegotouch

59

43

16

0

0

100.00%

72.88%

72.88%


Contacts

Contacts

105

74

16

5

10

85.70%

70.50%

82.20%


Setting

Settings

38

6

2

0

32

21.10%

15.80%

75.00%


Sync UI

Sync UI

2

0

0

0

0

0.00%

0.00%

0.00%

Photo viewer

View photo

42

25

7

0

10

76.20%

59.50%

78.10%

Email

Send/receive email

34

5

12

17

0

100.00%

14.70%

14.70%

Instant Messaging

Chat with friends

1

1

0

0

0

100.00%

100.00%

100.00%

Social networking

Social Networking

16

7

1

8

0

100.00%

43.75%

43.75%

Calendar

Calendar

23

14

5

0

4

82.60%

60.90%

73.30%


Issue Summary
--------------------------------------
Key Issues:
Handset 1.1 UX/applications release blocker bugs: Here<http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=HandsetUX_1.1_Release_BlockerApproved&sharer_id=43>

New issues: 30 new issues are detected, Here<http://bugs.meego.com/buglist.cgi?bug_id=7478,7479,7481,7483,7485,7460,7416,7443,7444,7445,7447,7453,7462,7465,7466,7539,7446,7449,7463,7498,7487,7535,7467,7469,7476,7537,7536,7493,7494,7540,7537>

Verified fixed bugs: 27 bugs are verified fixed, Here<http://bugs.meego.com/buglist.cgi?bug_id=6675,6287,220,2601,2925,6316,6419,6775,2452,6026,6017,7003,7316,7327,840,5281,5991,6005,6390,6391,6406,6413,6486,6642,6395,2636,3670>

Detailed Test Report
--------------------------------------
http://wiki.meego.com/Quality/HandsetTestReport/UXWeekly20100924

Best Regards
Yi
MeeGo Handset QA

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/pipermail/meego-releases/attachments/20100929/18d330fd/attachment-0001.html>