In this session we will talk about the Linaro Android QA process.

Description

The Android QA process tests high-level functionality, characterizes failures and files bugs against likely subsystems.

The current set of tests are listed here:

ADB
ADB over USB

ADB over Ethernet

All ADB commands

Boot and Basics
u-boot serial support

android console output over serial

android console shell over serial

android boots to console shell

android boots to UI

Audio
HDMI audio

Audio output on jacks

Audio input on jacks

Video Out - HDMI
All resolutions work

Monitor recognized

Best resolution automatically chosen

Monitor hot-plug

Video Out - DVI
All resolutions work

Monitor recognized

Best resolution automatically chosen

Monitor hot-plug

Graphics
Not-Accellerated

Accellerated 2D

Accellerated 3D

Ethernet
Ethernet configurable from command line

Ethernet auto-configured at boot

Ethernet integrated into Android connection manager

Wireless
Onboard wireless configurable from the command line

Onboard wireless auto-configured at boot

Onboard wireless integrated into Android connection manager

Bluetooth
Bluetooth available from command line

Bluetooth integrated into Android Bluetooth framework

Scanning devices in UI works

Pairing with headset in UI works

Modem
USB modem works for the command line

USB modem works with the connection manager

SD
SD-card mounted through fstab

SD-card can be accessed through gallery

Camera
Capture works

Save works

Gallery display

Video Playback
Software Playback

Hardware accellerated playback

Playback all supported formats

Powermanagement
Suspend and resume

Wakelock works

clock tree in debugfs

P-states (cpufreq driver)

C-states (cpuidle driver)

powertop

App Support
Can install apps

Browser

Calculator

Calendar

Camera

Clock

Contacts

Email

Gallery

Messaging

Phone

USB Host
USB Keyboard

USB Mouse

USB Device
Gadget driver loaded

Mass storage function (sdcard export)

Ethernet function (tethering)

Agenda

1. Introduce the current QA process


2. Brainstorm

Goal of this Session

To share the current QA practice and get input on how to make it better.