Bluez/Obexd upstream test result_20120529

["Zhang, Jingke" <jingke.zhang@xxxxxxxxx>]

Hi all,
This is test report for bluez-4.99.162.ga705c53 and obexd-0.46.20.gab9d3e0. 
Against last, OBEX is changed from 0.45 to 0.46. 

In this test, we ran 101 case: 76 Pass, 5 Fail. Other 20 are blocked or unavailable (some cases validation method is still in investigating). 
The pass rate is from 67% to 94% (pass / <pass + fail>), because we took following enhancements to upstream test:
* Update Linux kernel to latest. 
* Update pulseaudio to newer version to overcome A2DP crash bug. 
(The result template update as PTS standard pattern, is still in progressing)

I want to highlight the obexd bug (see 25158). This is obexd-0.46 regression towards obexd-0.45.

New bugs (2):
===============================================
https://bugs.meego.com/show_bug.cgi?id=25189
PBAP Server has segmentation fault during responding to client PullAll

https://bugs.meego.com/show_bug.cgi?id=25158 
[Regression] obex-0.46 client is unable to request pb.vcf file

Re-open bugs:
===============================================
N/A

Verified bugs (1):
===============================================
https://bugs.meego.com/show_bug.cgi?id=25109
[Regression to 0.44] obexd-0.45 FTP-Server failed to accept file transfer request


Testing Environment
==============================================
Hardware:  netbook Eeepc 1005HA | Acer AspireOne NAV50
Image:     netbook-ia32-pinetrail-tizen_20120424.2
Linux Kernel: v3.4-rc7
ConnMan: connman-1.0.74.g5288916-1.1.i586
Ofono:   ofono-1.6.50.gce395cd-1.1.i586
Bluez:    bluez-4.99.162.ga705c53-3.1.i586
Obexd:   obexd-0.46.20.gab9d3e0-1.1.i586
Pulseaudio: pulseaudio-1.1-3.4.i586

For detailed test results, please see attached file. 

Thanks
Jingke

== Detail Result ==
=== Audio-A2DP ===
  [PASS] A2DP_001: audio sink connect/re-connect 
  [PASS] A2DP_002: stereo headset playback 
  [PASS] A2DP_003: stereo headset voice record 
  [PASS] A2DP_004: Codec support: SBC 
  [PASS] A2DP_005: Playback music on line
  [PASS] A2DP_006: SINK role, as speaker for other device music playing

=== Audio-AVRCP ===
  [PASS] AVRCP_001: Play/Pause 
  [PASS] AVRCP_002: Volume Up/Down
  [PASS] AVRCP_003: Next/Privious 
  [PASS] AVRCP_004: Connection Establish/Release
  *** DUT is only setup as TG part (headset is CT) ***
  [N/A] AVRCP_005: Audio metadata get.

=== Audio-HFP ===
  [PASS] HFP_001: RFCOMM connection on AG 
  [PASS] HFP_002: list (ofono) hfp modem 
  [PASS] HFP_003: HFP modem establishment (Ofono)
  Below 3 failures are due to PA problem. [https://bugs.meego.com/show_bug.cgi?id=25159 Bug#25159, HFGW will disappear after voice-call establishment soon]
  [FAIL] HFP_004: Audio SNK and SRC establishment  
  [FAIL] HFP_005: voicecall, audio creates BT SNK/SRC 
  [FAIL] HFP_006: redirect AG SNK/SRC to local SRC/SNK
  [PASS] HFP_007: Check AT-commands from HF part
  [PASS] HFP_008: Connect BT Headset to HFP phone

=== Audio-HSP ===
  [PASS] HSP_001: Use mono headset to play music
  *** DUT is a Netbook, unable to take phone ***
  [N/A] HSP_002: Take incoming call by button-press
  [N/A] HSP_003: Audio transfer between AG and HS
  [PASS] HSP_004: Adjust Volume Up/Down

=== OBEX-FTP ===
  [PASS] FTP_001: pull/push files from/to server.
  [PASS] FTP_002: browse server files 
  [PASS] FTP_003: Client "create folder", "delete file", "rename file"
  [PASS] FTP_004: Server enables FTP parameter  
  [PASS] FTP_005: Server sets sharing root path
  [PASS] FTP_006: Server handles all requirements
  [PASS] FTP_007: Server has ability to set permission for FTP
  [PASS] FTP_008: FTP data-rate about 30k/s~230k/s
  [PASS] FTP_009: Big size file transferred stable

=== OBEX-OPP ===
  [PASS] OPP_001: pull un-patterned object from server. 
  [PASS] OPP_002: Server enables OPP parameter
  [PASS] OPP_003: During object transferring, the progress is clear
  [N/A] OPP_004: OPP supports vCard2.1, vCard3.0, vCal1.0 and iCal2.0.

=== OBEX-PBAP ===
  [PASS] PBAP_001: Client gets phone book entries from server
  [PASS] PBAP_002: Client gets ICH, OCH, MCH and CCH from server
  [FAIL] PBAP_003: PSE can provide PBAP daemon by enabling corresponding parameter
  Case failed due to [https://bugs.meego.com/show_bug.cgi?id=25189 Bug#25189, PBAP Server has segmentation fault during responding to client PullAll]
  [PASS] PBAP_004: Both sides support vCard2.1/vCard3.0

=== OBEX-SYNC ===
  [PASS] SYNC_001: Server enables SYNC daemon
  [PASS] SYNC_002: During sync, Server can show "syncing..."
  [FAIL] SYNC_003: client can set PIM fetching from INT
  Above failure is due to [https://bugs.meego.com/show_bug.cgi?id=25158 Bug#25158, Regression obex-0.46 client is unable to request pb.vcf file ]
  [N/A] SYNC_004: Server get/put entire phonebook from/to client. 
  [PASS] SYNC_005: Client can support vCard2.1, vCard3.0

=== OBEX-MAP MCE ===
  map-client parameter cannot be used to test MAP. 
  [PASS] MAP_001: MCE can browse message/folder list on MSE 
  [N/A] MAP_002: MCE can upload local message to MSE
  [N/A] MAP_003: MCE can delete the message on MSE side
  [N/A] MAP_004: MCE can take use of MSE to send message

=== Network-PAN ===
  [PASS] PAN_001: PANU can init nap0 device connect to NAP
  [PASS] PAN_002: PANU can get ip address or assigned static ip
  [PASS] PAN_003: PANU can logon internet website 
  [PASS] PAN_004: NAP can init bridge bnep 
  [PASS] PAN_005: NAP can support one or multiple PANU connection
  [N/A] PAN_006: NAP can have DHCP responding to each PANU
  Corrent connman does not support DHCP functions.

=== Network-BNEP ===
  [PASS] BNEP_001: Check BNEP support on DUT

=== Networl-DUN ===
 The DUN test method is still in investigating. So, cases are N/A. 
  [N/A] DUN_001: GW (DUT) can parse a series of AT commands from the data terminal. 
  [N/A] DUN_002: DT can build up rfcomm device by bluetooth and DUN modem by Ofono.
  [N/A] DUN_003: DT can use Ofono to dial up special service number (for China Mobile, it is "*99***1#").
  [N/A] DUN_004: When network connected, DT can log on website in internet.

=== SIM-SAP ===
  QA does not find SAP profile API. 
  [N/A] SAP_001: Server can enable a module to register Client
  [N/A] SAP_002: Server can power on/off SIM Card or reset it 
  [N/A] SAP_003: Server can disconnect Client  
  [N/A] SAP_004: Server can disconnect SIM
  [N/A] SAP_005: Client can connect to Server SIM
  [N/A] SAP_006: Client can power on Server SIM
  [N/A] SAP_007: Client can disconnect Server

=== Generic-GAP ===
  [PASS] GAP_001: PSCAN/ISCAN mode setting.
  [PASS] GAP_002: Active pairing to another bluetooth device.
  [PASS] GAP_003: Passive pairing, accepte pair master requirement
  [PASS] GAP_004: SSP supports 
  [PASS] GAP_005: If lost link-key, it needs re-pair 
  [PASS] GAP_006: reboot DUT with link-key restored, no need to re-pair 
  [PASS] GAP_007: Pair can be released

=== Generic-SDP ===
  [PASS] SDP_001: browse available service list in local
  [PASS] SDP_002: browse available service list from remote
  [PASS] SDP_003: browse service by RecHandle for detail info
  [PASS] SDP_004: Server can answer SDP searching request
  [PASS] SDP_005: Server can add/del/update service records

=== Others-HID ===
  [PASS] HID_001: Host can search nearby HID device.
  [PASS] HID_002: [BAT] Host can connect to HID device.
  [PASS] HID_003: Host can handle multiple human input/output devices.

=== HCI ===
  [PASS] HCI_001: Build hci connection between Dev_A and Dev_B.
  [PASS] HCI_002: Receive ACL data with HCI.
  [PASS] HCI_003: Send ACL data with HCI.
  [PASS] HCI_004: Change name of remote Dev by HCI.
  [PASS] HCI_005: Change class of remote Dev by HCI.
  [PASS] HCI_006: Read local HCI controller information.
  [PASS] HCI_007: Read remote HCI controller information.

=== L2CAP ===
  [PASS] L2CAP_001: Build l2cap connection between Dev_A and Dev_B.  
  [PASS] L2CAP_002: Dev_A and Dev_B take l2cap protocol to do pingpong.

=== RFCOMM ===
  [PASS] RFCOMM_001: Build rfcomm connection between Dev_A and Dev_B.  
  [PASS] RFCOMM_002: Dev_A and Dev_B take rfcomm protocol to do pingpong.

=== Settings ===
  [PASS] SET_001: [BAT] No error output during bluetoothd startup process.

=== Bluetooth Utils ===
Some basic checking for hciconfig, hcitool, sdptool commands. 
  [PASS] BTCMD_001: hciconfig -a
  [PASS] BTCMD_002: hciconfig <adapter> piscan
  [PASS] BTCMD_003: hciconfig <adapter> up/down  
  [PASS] BTCMD_004: hcitool scan
  [PASS] BTCMD_005: sdptool browse local
  [PASS] BTCMD_006: sdptool browse <ermote MAC>
  [PASS] BTCMD_007: sdptool add/del