Voice Assistant

Overview

Voice Assistant allows you to use intuitive voice commands to perform specific tasks on a device.

You can activate Voice Assistant in the Settings menu or by direct access (triple taps with two fingers). You can also activate Usage hints in the Vision setting to be able to hear additional feature description.

  • Voice Assistant rules
    • No looping.
    • Voice: Read from the top.
    • Highlight order is from top to bottom and left to right.
    • No highlight for the notification bar.
  • Screen type: Page
    • A page screen stops at the last control on the current screen.
    • A page screen provides a sound effect when it reaches the last control.

      Example 1: Home

      Example 2: Apps

  • Screen type: Scroll
    • A scroll screens stops at the last list item.
    • If the highlighted item scrolls off the screen, the screen scrolls automatically.
    • A scroll screen provides a sound effect when it reaches the last list item.

      Example: Settings


Basic interaction rules

  • One finger tap
    Provides voice feedback for the selected control.
  • One finger double-tap
    Activate the selected item by double-tapping anywhere on the screen with one finger.
  • One finger swipe: Move to previous/next
    Swipe right anywhere on the screen with one finger to move to the next control.

    Highlight order: Title > Contents > Bottom button (looping)

  • Two fingers swipe up or down, or Turn the bezel: scroll upward or downward

    User can scroll up or down screens by swiping upward or downward with two fingers.

    There are no highlighted list controls.

    When the scroll reaches the end, the device reads the highlighted control.

    Note: During scrolling, the highlight does not move.

    When the highlighted control disappears after the user swipes up or down with two fingers, the highlight moves to the next or previous control, and the device reads out loud.

    When the swipe direction is upward or a clockwise When the swipe direction is downward or counterclockwise

    When all controls are out of the screen, the device highlights and reads the first or last control in the content area of the current screen.

    When the swipe direction is upward or a clockwise

    When the swipe direction is downward or counterclockwise

  • Two fingers swipe left and right: Change pages and screens

    Swipe left or right anywhere on the screen with two finger to move to the previous or next page.

                Notification                                               Watch face                                                  Widget                                                 Watch face


Highlights

All Voice Assistant UI controls have highlights.

  • Highlight display

    Display the outline without the background color (this rule applies to all Samsung devices).

  • Highlight control

    Highlight appears on the UI element at the top left corner of the uppermost screen layer by default, and moves from left to right and from top to bottom.

    The highlight’s horizontal movement takes priority over the vertical one.

    Tip
    • Highlight is initialized after applications are closed.
    • The Voice Assistant highlight is different from the Highlight UI.
  • Highlight order

    Do not highlight a list button individually if that button belongs to the list.

Rotary selector (also known as the More option, Options selector)

Winset

Highlight order

Reading

Remark

Rotary selector

  1. Option name 1 ~ 11
  1. %s (Option name 1~11)
  2. %s (Option name 3) , %s (Subtext), Double-tap to change.
    - Support the toggle action option
  1. The highlight of items moves clockwise.
  2. Default label: More options, Turn bezel to navigate through items
Title bar, More options (visual cue)

Winset

Highlight order

Reading

Remark

Title bar

  1. Title
  1. %s (Text)

More options

  1. Title
  2. More options
  1. %s (Text)
  2. More options, Button
Rotary-index

Winset

Highlight order

Reading

Remark

Rotary-index

  1. Rotary-index
  1. %s (Option name 1~11)
  2. %s(B), Rotary index, Rotate bezel to search index.
List

Winset

Highlight order

Reading

Remark

List

  1. List 1
  1. %s (List 1), %s (Subtext)

Group Index

  1. Title
  2. Group index
  3. List 1
  1. %s (Title)
  2. %s (Group index), Header
  3. %s (List 1)

Divider

  1. List 1
  2. Icon
  1. %s (List 1), %s (Subtext)
  2. %s (Icon), Button

Title bar

  1. Button 1
  2. Button 2
  3. Button 3
  1. %s (Button 1), Button
  2. %s (Button 2), Button
  3. %s (Button 3), Button
Thumbnails

Winset

Highlight order

Reading

Remark

Thumbnail

  1. image
  1. %s (Image file name)

Thumbnails

  1. image 1
  2. image 2
  3. image 4
  4. image 5
  5. image 6
  6. image 7
  7. image 8
  8. image 9
  1. %s (Image 1 file name), Double-tap to view.
  2. %s (Image 2 file name), Double-tap to view.
  3. %s (Image 3 file name), Double-tap to view.
  4. %s (Image 4 file name), Double-tap to view.
  5. %s (Image 5 file name), Double-tap to view.
  6. %s (Image 6 file name), Double-tap to view.
  7. %s (Image 7 file name), Double-tap to view.
  8. %s (Image 8 file name), Double-tap to view.
  9. %s (Image 9 file name), Double-tap to view.
Progress

Winset

Highlight order

Reading

Remark

Progress indicator (full)

  1. Progressing
  1. Progressing, %d percent

Progress indicator (small)

  1. Progressing
  1. Progressing

Activity indicator (full)

  1. Progressing
  1. Progressing

Activity indicator (small)

  1. Progressing
  1. Progressing
Bottom button / Text button

Winset

Highlight order

Reading

Remark

Bottom button

  1. Bottom button 1
  1. %s (Button 1), Button

Text button

  1. Text button 1
  1. %s (Button 1), Button
Selection mode

Winset

Highlight order

Reading

Remark

Select mode action button

  1. Title
  2. Floating button (%d) Floating button (n/N)
  3. List 1, Checkbox
  4. List 2, Checkbox
  5. Delete button
  6. More options
  1. %s (Text)
  2. %d selected, Button %d of %d selected, Button
  3. %s (List 1), Selected
  4. %s (List 2), Not selected
  5. %s (DELETE), Button
  6. More options, Button
  • If the highlight is moved to the list, it move from the first item to the last item, whether or not the item was showed on the screen.

Select mode action button

  1. Outline
  2. List 1
  3. List 2
  1. Select mode pop-up, Double-tap to close the pop-up.
  2. Double-tap to select all.
  3. Double-tap to deselect all.

Select mode action button

  1. Outline
  2. List 1
  1. Select mode pop-up, Double-tap to close the pop-up.
  2. Double tap to select all. Double-tap to deselect all.
On/Off switch / Checkbox / Radio button

Winset

Highlight order

Reading

Remark

On/Off switch

  1. List 1, Switch
  1. %s (List 1), Switch, On/Off

Checkbox

  1. List 1, Checkbox
  1. %s (List 1), Checkbox, Checked/Not checked

Radio button

  1. List 1, Radio button
  1. %s (List 1), Radio button, Selected/Not selected
Text field

Winset

Highlight order

Reading

Remark

Text Input

  1. Text field
  1. %s (guide text), Edit box, Double-tap to edit.

Text field

  1. Text field
  1. %s (Main text), Edit field, Editing,
    Swipe up and down to adjust position.
Number picker

Winset

Highlight order

Reading

Remark

Number picker

  1. Title
  2. 12
  3. Button
  1. %s(Title)
  2. 12, %s (unit), Turn bezel to adjust %s.(unit)
  3. SET, Button
Date picker / Time picker

Winset

Highlight order

Reading

Remark

Date picker

  1. Title
  2. May
  3. 12
  4. 2014
  5. Button
  1. %s(Title)
  2. May, %s (Month), Turn bezel to adjust %s. (month).
  3. 12,%s (Date), Turn bezel to adjust %s. (date).
  4. 2014,%s (Year), Turn bezel to adjust %s. (year).
  5. SET, Button
  • Default label is not supported.

Time picker

  1. Title
  2. 12
  3. 23
  4. AM/PM
  5. Button
  1. %s(Title)
  2. 12,%s (Hour), Turn bezel to adjust %s. (hour).
  3. 23,%s (Minute), Turn bezel to adjust %s. (minute) .
  4. PM, Double-tap to change.
  5. SET, Button
  • If AM and PM are changed by rotating the bezel when hour is focused, then say AM or PM after saying the hour.
  • Default label is not supported.
Color picker

Winset

Highlight order

Reading

Remark

Color picker

  1. Color picker, Guide text
  2. Color name 1 ~ 11
  1. Color picker, Turn bezel to navigate through items.
  2. %s (Color name 1 ~ 11)
  • Read ‘1.’ text only once (at the first entrance). After, read “%1$d of %2$d” when a page transition occurs.
  • Highlight order: Clockwise direction.
Pop-up

Winset

Highlight order

Reading

Remark

Dialog: General

  1. Title
  2. Text
  3. Button 1
  4. Button 2
  1. Alert, %s (Title)
  2. %s (Text)
  3. CANCEL, Button
  4. OK, Button

Dialog: Single button

  1. Title
  2. Text
  3. Button
  1. Alert, %s (Title)
  2. %s (Text)
  3. %s (Button), Button

Custom pop-up

  1. Text
  2. Button
  1. %s (Text)
  2. Action name, Button
  • For customized pop-ups, each app should define the highlight and reading order based on accessibility principles.
Progress (Overlay) / Toast pop-up / Graphic toast pop-up

Winset

Highlight order

Reading

Remark

Progress(Overlay)

None

  1. %s (Message)

Toast pop-up

None

  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Graphic toast pop-up

None

  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Speak rules

Voice feedback for control

Voice feedback for control describes the currently selected (highlighted) control. Each control has its own description, which consists of three properties, shown as follows. Voice feedback is provided based on each property’s setting.

  • Label (Name): Component label (for example, buttons labeled of OK and CANCEL.
  • Traits (Role): Component type (for example, a button component).
  • State: Component value or status (for example, disabled status).
  • Optional attributes (Description): An explanation of the component (for example, “this button closes the application” for the Close button).
Tip
  • When a control is highlighted, the device automatically reads a description of highlighted control out loud. If the highlight is then moved, the voice description stops.
  • A control is not required to provide content for traits or optional attributes if these attributes do not apply to the control. For example, a control that does not perform an action does not need to provide a hint.
  • A control provides information for the optional attributes only when the control’s contents are changeable and cannot be described by the label.

Voice feedback for control

Voice feedback for control describes the results of all types of actions.

  • Task performed by user: Describes a changed setting value, pressed hardware keys, and whether an item has been moved.
  • Event interrupted by system or application: Notification or message from the system or applications.
Task performed by user            Event interrupted by system or application