Voice Assistant

Overview

Voice Assistant allows you to use intuitive voice commands to perform specific tasks on a device.

You can activate Voice Assistant in the Settings menu or by direct access (triple tap with two fingers). You can also activate Usage hints in the Vision setting to be able to hear additional feature description.

  • Voice Assistant rules

    • No looping.
    • Voice: Read from the top.
    • Highlight order is from top to bottom and left to right.
    • No highlight for the notification bar.

  • Screen type: Page

    • A page screen stops at the last control on the current screen.

    • A page screen provides a sound effect when it reaches the last control.

      Example 1: Home

      Example 2: Apps

  • Screen type: Scroll

    • A scroll screens stops at the last list item.

    • If the highlighted item scrolls off the screen, the screen scrolls automatically.

    • A scroll screen provides a sound effect when it reaches the last list item.

      Example: Settings

Basic interaction rules

  • One finger tap
    Provides voice feedback for the selected control.

  • One finger double-tap
    Activate the selected item by double-tapping anywhere on the screen with one finger.

  • One finger swipe: Move to previous/next
    Swipe right anywhere on the screen with one finger to move to the next control. The highlight is fixed to the center when moving to the next control.

    Highlight order: Title > Contents > Bottom button (looping)

  • One finger swipe up or down

    In general, a one finger swipe up or down adjusts the accessibility volume up or down. When an adjustable item is highlighted, the swipe changes the actual value of the highlighted item instead.

    On all screens, a one finger swipe adjusts the accessibility volume.

    With an adjustable item highlighted, its value is changed instead.

  • Two fingers swipe up or down, or turn the bezel: scroll upward or downward

    Users can scroll up or down screens by swiping upward or downward with two fingers.

    As with the one finger swipe, the highlight remains fixed at the center.

    When the scroll reaches the end, the device reads the highlighted control.

    Note: During scrolling, the highlight does not move.

    When the highlighted control disappears after the user swipes up or down with two fingers, the highlight moves to the next or previous control, and the device reads out loud.

    When all controls are out of the screen, the device highlights and reads the first or last control in the content area of the current screen.

    When the swipe direction is upward or the bezel is rotated clockwise

    When the swipe direction is downward or the bezel is rotated counterclockwise

  • Two fingers swipe left and right: Change pages and screens

    Swipe left or right anywhere on the screen with two fingers to move to the previous or next page.

Highlights

All Voice Assistant UI controls have highlights.

  • Highlight display

    Display the outline without the background color (this rule applies to all Samsung devices).

  • Highlight control

    By default, the highlight appears on the UI element at the top left corner of the uppermost screen layer and moves from left to right and from top to bottom.

    The highlight’s horizontal movement takes priority over the vertical one.

  • Highlight order

    Do not highlight a list button individually if that button belongs to the list.

Rotary selector (also known as the More option, Options selector)

Winset

Highlight order

Reading

Remark

Rotary selector
  1. Option name 1 ~ 11
  1. %s (Option name 1~11)
  2. %s (Option name 3) , %s (Subtext), Double-tap to change.
    - Support the toggle action option
  1. The highlight of items moves clockwise.
  2. Default label: More options, Turn bezel to navigate through items

Title bar, More options (visual cue)

Winset

Highlight order

Reading

Remark

Title bar

  1. Title
  1. %s (Text)

More options
  1. Title
  2. More options
  1. %s (Text)
  2. More options, Button

Rotary-index

Winset

Highlight order

Reading

Remark

Rotary-index
  1. Rotary-index
  1. %s(B), Index scroll, Rotate bezel to search index.

List

Winset

Highlight order

Reading

Remark

List

  1. List 1
  1. %s (List 1), %s (Subtext)

Group Index

  1. Title
  2. Group index
  3. List 1
  1. %s (Title)
  2. %s (Group index), Header
  3. %s (List 1)

Divider
  1. List 1
  2. Icon
  1. %s (List 1), %s (Subtext)
  2. %s (Icon), Button

Title bar
  1. Button 1
  2. Button 2
  3. Button 3
  1. %s (Button 1), Button
  2. %s (Button 2), Button
  3. %s (Button 3), Button

Thumbnails

Winset

Highlight order

Reading

Remark

Thumbnail
  1. image
  1. %s (Image file name)

Thumbnails
  1. image 1
  2. image 2
  3. image 4
  4. image 5
  5. image 6
  6. image 7
  7. image 8
  8. image 9
  1. %s (Image 1 file name), Double-tap to view.
  2. %s (Image 2 file name), Double-tap to view.
  3. %s (Image 3 file name), Double-tap to view.
  4. %s (Image 4 file name), Double-tap to view.
  5. %s (Image 5 file name), Double-tap to view.
  6. %s (Image 6 file name), Double-tap to view.
  7. %s (Image 7 file name), Double-tap to view.
  8. %s (Image 8 file name), Double-tap to view.
  9. %s (Image 9 file name), Double-tap to view.
 The thumbnail highlight’s vertical movement takes priority over the horizontal one.

Progress

Winset

Highlight order

Reading

Remark

Progress indicator (full)
  1. Progressing
  1. Progressing, %d percent

Progress indicator (small)
  1. Progressing
  1. Progressing

Activity indicator (full)
  1. Progressing
  1. Progressing

Activity indicator (small)
  1. Progressing
  1. Progressing

Sending effect
  1. Sending
  1. Sending

Bottom button / Text button sua toi day roi

Winset

Highlight order

Reading

Remark

Bottom button

  1. Bottom button 1
  1. %s (Button 1), Button

Text button

  1. Text button 1
  1. %s (Button 1), Button

Selection mode

Winset

Highlight order

Reading

Remark

Select mode action button
  1. Title
  2. Floating button (%d) Floating button (n/N)
  3. List 1, Checkbox
  4. List 2, Checkbox
  5. Delete button
  6. More options
  1. %s (Text)
  2. %d selected, Button %d of %d selected, Button
  3. %s (List 1), Selected
  4. %s (List 2), Not selected
  5. %s (DELETE), Button
  6. More options, Button
  • If the highlight is moved to the list, it moves from the first item to the last item, whether or not the item was shown on the screen.

On/Off switch / Checkbox / Radio button

Winset

Highlight order

Reading

Remark

On/Off switch
  1. List 1, Switch
  1. %s (List 1), Switch, On/Off

Checkbox
  1. List 1, Checkbox
  1. %s (List 1), Checkbox, Selected/Not selected

Radio button
  1. List 1, Radio button
  1. %s (List 1), Radio button, Selected/Not selected

Text field

Winset

Highlight order

Reading

Remark

Text Input
  1. Text field
  1. %s (guide text), Edit box, Double-tap to edit.

Text field
  1. Text field
  1. %s (Main text), Edit box, Editing,
    Swipe up and down to adjust position.

Number picker

Winset

Highlight order

Reading

Remark

Number picker
  1. Title
  2. 8
  3. Button
  1. %s(Title)
  2. 8, %s (unit)
  3. SET, Button

Date picker / Time picker

Winset

Highlight order

Reading

Remark

Date picker
  1. Title
  2. Dec
  3. 20
  4. 2020
  5. Button
  1. %s(Title)
  2. Dec, %s (Month).
  3. 20,%s (Date).
  4. 2020,%s (Year).
  5. SET, Button
  • Default label is not supported.

Time picker
  1. Title
  2. 8
  3. 20
  4. AM/PM
  5. Button
  1. %s(Title)
  2. 8,%s (Hour).
  3. 20,%s (Minute).
  4. AM/PM
  5. Done, Button
  • If AM and PM are changed by rotating the bezel when hour is focused, then say AM or PM after saying the hour.
  • Default label is not supported.

Pop-up

Winset

Highlight order

Reading

Remark

Dialog: General
  1. Title
  2. Text
  3. Button 1
  4. Button 2
  1. Alert, %s (Title)
  2. %s (Text)
  3. CANCEL, Button
  4. OK, Button

Dialog: Single button
  1. Title
  2. Text
  3. Button
  1. Alert, %s (Title)
  2. %s (Text)
  3. %s (Button), Button

Custom pop-up
  1. Text
  2. Button
  1. %s (Text)
  2. Action name, Button
  • For customized pop-ups, each app should define the highlight and reading order based on accessibility principles.

Progress (Overlay) / Toast pop-up / Graphic toast pop-up

Winset

Highlight order

Reading

Remark

Progress(Overlay)

 None
  1. %s (Message)

Toast pop-up

 None
  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Graphic toast pop-up

 None
  1. %s (Message)
  • Toast disappears after text is read.
  • If a user taps the toast, display the highlight and remove the toast after text is read.

Speak rules

Voice feedback for control

Voice feedback for control describes the currently selected (highlighted) control. Voice feedback is provided based on each property’s setting. Each control has its own description, which consists of four properties:

  • Label (Name): Component label (for example, buttons labeled with OK or CANCEL).
  • Traits (Role): Component type (for example, a button component).
  • State: Component value or status (for example, disabled status).
  • Optional attributes (Description): An explanation of the component (for example, “this button closes the application” for the Close button).


Voice feedback for control

Voice feedback for control describes the results of all types of actions.

  • Task performed by user: Describes a changed setting value, pressed hardware keys, and if an item has been moved.
  • Event interrupted by system or application: Notification or message from the system or applications.