Voice Assistant

Overview

Voice Assistant allows you to use intuitive voice commands to perform specific tasks on a device.

You can activate Voice Assistant in the Settings menu or by direct access (triple tap with two fingers). You can also activate Usage hints in the Vision setting to be able to hear additional feature description.

  • Voice Assistant rules
    • No looping.
    • Voice: Read from the top.
    • Highlight order is from top to bottom and left to right.
    • No highlight for the notification bar.
  • Screen type: Page
    • A page screen stops at the last control on the current screen.
    • A page screen provides a sound effect when it reaches the last control.

      Example 1: Home

      Example 2: Apps

  • Screen type: Scroll
    • A scroll screens stops at the last list item.
    • If the highlighted item scrolls off the screen, the screen scrolls automatically.
    • A scroll screen provides a sound effect when it reaches the last list item.

      Example: Settings


Basic interaction rules

  • One finger tap
    Provides voice feedback for the selected control.
  • One finger double-tap
    Activate the selected item by double-tapping anywhere on the screen with one finger.
  • One finger swipe left or right : Move to previous/next
    Swipe right anywhere on the screen with one finger to move to the next control. The highlight will be fixed to the center when moving to the next control.

    Highlight order: Title > Contents > Bottom button (looping)

  • One finger swipe up or down

    In general, a one finger swipe up or down will adjust the accessibility volume up or down. With an adjustable item is highlighted, the swipe will change the actual value of the highlighted item instead.

    On all screens, a one finger swipe will adjust the accessibility volume.

    With an adjustable item highlighted, its value will be changed instead.

  • Two fingers swipe up or down, or turn the bezel: scroll upward or downward

    User can scroll up or down screens by swiping upward or downward with two fingers.

    As with the one finger swipe, the highlight will remain fixed at the center.

    When the scroll reaches the end, the device reads the highlighted control.

    Note: During scrolling, the highlight does not move.

    When the highlighted control disappears after the user swipes up or down with two fingers, the highlight moves to the next or previous control, and the device reads out loud.

    When the swipe direction is upward or the bezel is
    rotated clockwise

    When the swipe direction is downward or the bezel is
    rotated counterclockwise

     

    When all controls are out of the screen, the device highlights and reads the first or last control in the content area of the current screen.

    When the swipe direction is upward or the bezel is rotated clockwise

    When the swipe direction is downward or the bezel is rotated counterclockwise

  • Two fingers swipe left and right: Change pages and screens

    Swipe left or right anywhere on the screen with two fingers to move to the previous or next page.

                Notification                                               Watch face                                                  Widget                                                 Watch face


Highlights

All Voice Assistant UI controls have highlights.

  • Highlight display

    Display the outline without the background color (this rule applies to all Samsung devices).

  • Highlight control

    Highlight appears on the UI element at the top left corner of the uppermost screen layer by default, and moves from left to right and from top to bottom.

    The highlight’s horizontal movement takes priority over the vertical one.

    Tip
    • Highlight is initialized after applications are closed.
    • The Voice Assistant highlight is different from the Highlight UI.
  • Highlight order

    Do not highlight a list button individually if that button belongs to the list.

Rotary selector (also known as the More option, Options selector)

Winset

Highlight order

Reading

Remark

Rotary selector

  1. Option name 1 ~ 11
  1. %s (Option name 1~11)
  2. %s (Option name 3) , %s (Subtext), Double-tap to change.
    - Support the toggle action option
  1. The highlight of items moves clockwise.
  2. Default label: More options, Turn bezel to navigate through items
Title bar, More options (visual cue)

Winset

Highlight order

Reading

Remark

Title bar

  1. Title
  1. %s (Text)

More options

  1. Title
  2. More options
  1. %s (Text)
  2. More options, Button
Rotary-index

Winset

Highlight order

Reading

Remark

Rotary-index

  1. Rotary-index
  1. %s(B), Index scroll, Rotate bezel to search index.
List

Winset

Highlight order

Reading

Remark

List

  1. List 1
  1. %s (List 1), %s (Subtext)

Group Index

  1. Title
  2. Group index
  3. List 1
  1. %s (Title)
  2. %s (Group index), Header
  3. %s (List 1)

Divider

  1. List 1
  2. Icon
  1. %s (List 1), %s (Subtext)
  2. %s (Icon), Button

Title bar

  1. Button 1
  2. Button 2
  3. Button 3
  1. %s (Button 1), Button
  2. %s (Button 2), Button
  3. %s (Button 3), Button
Thumbnails

Winset

Highlight order

Reading

Remark

Thumbnail

  1. image
  1. %s (Image file name)

Thumbnails

  1. image 1
  2. image 2
  3. image 4
  4. image 5
  5. image 6
  6. image 7
  7. image 8
  8. image 9
  1. %s (Image 1 file name), Double-tap to view.
  2. %s (Image 2 file name), Double-tap to view.
  3. %s (Image 3 file name), Double-tap to view.
  4. %s (Image 4 file name), Double-tap to view.
  5. %s (Image 5 file name), Double-tap to view.
  6. %s (Image 6 file name), Double-tap to view.
  7. %s (Image 7 file name), Double-tap to view.
  8. %s (Image 8 file name), Double-tap to view.
  9. %s (Image 9 file name), Double-tap to view.
The thumbnail highlight’s vertical movement takes priority over the horizontal one.
Progress

Winset

Highlight order

Reading

Remark

Progress indicator (full)

  1. Progressing
  1. Progressing, %d percent

Progress indicator (small)

  1. Progressing
  1. Progressing

Activity indicator (full)

  1. Progressing
  1. Progressing

Activity indicator (small)

  1. Progressing
  1. Progressing

Sending effect

  1. Sending
  1. Sending
Bottom button / Text button

Winset

Highlight order

Reading

Remark

Bottom button

  1. Bottom button 1
  1. %s (Button 1), Button

Text button

  1. Text button 1
  1. %s (Button 1), Button
Selection mode

Winset

Highlight order

Reading

Remark

Select mode action button

  1. Title
  2. Floating button (%d) Floating button (n/N)
  3. List 1, Checkbox
  4. List 2, Checkbox
  5. Delete button
  6. More options
  1. %s (Text)
  2. %d selected, Button %d of %d selected, Button
  3. %s (List 1), Selected
  4. %s (List 2), Not selected
  5. %s (DELETE), Button
  6. More options, Button
  • If the highlight is moved to the list, it moves from the first item to the last item, whether or not the item was shown on the screen.

Select mode action button

  1. Outline
  2. List 1
  3. List 2
  1. Select mode pop-up.
  2. Select all, button.
  3. Deselect all, button.

Select mode action button

  1. Outline
  2. List 1
  1. Select mode pop-up.
  2. Select all, button.
  3. Deselect all, button.
On/Off switch / Checkbox / Radio button

Winset

Highlight order

Reading

Remark

On/Off switch

  1. List 1, Switch
  1. %s (List 1), Switch, On/Off

Checkbox

  1. List 1, Checkbox
  1. %s (List 1), Checkbox, Selected/Not selected

Radio button

  1. List 1, Radio button
  1. %s (List 1), Radio button, Selected/Not selected
Text field

Winset

Highlight order

Reading

Remark

Text Input

  1. Text field
  1. %s (guide text), Edit box, Double-tap to edit.

Text field

  1. Text field
  1. %s (Main text), Edit box, Editing,
    Swipe up and down to adjust position.
Number picker

Winset

Highlight order

Reading

Remark

Number picker

  1. Title
  2. 12
  3. Button
  1. %s(Title)
  2. 12, %s (unit)
  3. Set, Button
Date picker / Time picker

Winset

Highlight order

Reading

Remark

Date picker

  1. Title
  2. May
  3. 12
  4. 2014
  5. Button
  1. %s(Title).
  2. May, %s (Month).
  3. 12,%s (Date).
  4. 2014,%s (Year).
  5. Set, Button.
  • Default label is not supported.

Time picker

  1. Title
  2. 12
  3. 23
  4. AM/PM
  5. Button
  1. %s(Title).
  2. 12,%s (Hour).
  3. 23,%s (Minute).
  4. AM/PM
  5. Done, Button
  • If AM and PM are changed by rotating the bezel when hour is focused, then say AM or PM after saying the hour.
  • Default label is not supported.
Color picker

Winset

Highlight order

Reading

Remark

Color picker

  1. Color picker, Guide text
  2. Color name 1 ~ 11
  1. Color picker.
  2. %s (Color name 1 ~ 11)
  • Read ‘1.’ text only once (at the first entrance). After, read “%1$d of %2$d” when a page transition occurs.
  • Highlight order: Clockwise direction.
Pop-up

Winset

Highlight order

Reading

Remark

Dialog: General

  1. Title
  2. Text
  3. Button 1
  4. Button 2
  1. Alert, %s (Title)
  2. %s (Text)
  3. CANCEL, Button
  4. OK, Button

Dialog: Single button

  1. Title
  2. Text
  3. Button
  1. Alert, %s (Title)
  2. %s (Text)
  3. %s (Button), Button

Custom pop-up

  1. Text
  2. Button
  1. %s (Text)
  2. Action name, Button
  • For customized pop-ups, each app should define the highlight and reading order based on accessibility principles.
Progress (Overlay) / Toast pop-up / Graphic toast pop-up

Winset

Highlight order

Reading

Remark

Progress(Overlay)

None

  1. %s (Message)

Toast pop-up

None

  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Graphic toast pop-up

None

  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Speak rules

Voice feedback for control

Voice feedback for control describes the currently selected (highlighted) control. Voice feedback is provided based on each property’s setting. Each control has its own description, which consists of four properties:

  • Label (Name): Component label (for example, buttons labeled with OK or CANCEL.
  • Traits (Role): Component type (for example, a button component).
  • State: Component value or status (for example, disabled status).
  • Optional attributes (Description): An explanation of the component (for example, “this button closes the application” for the Close button).
Tip
  • When a control is highlighted, the device automatically reads a description of the highlighted control out loud. If the highlight is then moved, the voice description stops.
  • A control is not required to provide content for optional attributes if they do not apply to the control. For example, a control that does not perform an action does not need to provide a description.
  • A control provides information for the optional attributes only when the control’s contents are changeable and cannot be described by the label.

Voice feedback for control

Voice feedback for control describes the results of all types of actions.

  • Task performed by user: Describes a changed setting value, pressed hardware keys, and if an item has been moved.
  • Event interrupted by system or application: Notification or message from the system or applications.
Task performed by user            Event interrupted by system or application