Common

This topic describes test cases and pass criteria related to common application features.

General

Test Case ID Definition Related Info
CO-GE-01 Check that application pages load and the application responds to clicked keys within a reasonable amount of time. Launch Time Optimization
  • The application responds in at most 30 seconds.
Test Case ID Definition
CO-GE-02 Check that the supported languages listed in the application description are properly supported.
  • All languages listed in the application description are supported.
Test Case ID Definition
CO-GE-03 Check that the application works normally after being left running for a long time.
  • After being left running for a long time, the application remains responsive and works normally.
Test Case ID Definition
CO-GE-04 Check that all menus and features are implemented as described in the application description.
  • All menus and features are implemented and work as described.
Test Case ID Definition Related Info
CO-GE-05 Close the application by clicking the exit key, then relaunch it from Smart Hub. Check that the application works properly and does not initiate unnecessary content updates.
Note: Test both the on-screen and the remote control exit keys.

 Terminating Applications
  • The application runs normally.
  • Unnecessary updates are not initiated.
Test Case ID Definition
CO-GE-06 Check that the TV recovers from being switched off while content is loading.
  • While content is loading in the application, switch the TV off using the power key. After a few seconds, click the power key again. The TV switches on.
Test Case ID Definition Related Info
CO-GE-07 After launching the application from the Smart Hub first screen, check that application termination and multitasking works properly. Multitasking
Terminating Applications
  • When the return or exit key is clicked, the application is terminated.
  • When the Smart Hub key is clicked, the application is moved to the background and the Smart Hub first screen is shown.
  • For TV models that do not support multitasking, when the Smart Hub key is clicked, the application is terminated and the Smart Hub first screen is shown.
Test Case ID Definition Related Info
CO-GE-08 During media playback, switch off the device. When the device is switched on again, check that the application's previous screen or detail page is shown. Multitasking
  • The application's previous screen or detail page is shown.

Connection

Test Case ID Definition Related Info
CO-CN-01 After network disconnection and reconnection, including during media playback, check that the application resumes working normally. Checking Network Status
  • The application does not freeze when the network connection is lost.
  • If the network is disconnected and reconnected, while the application is launching, it is not stuck on loading and the return key is functional.
  • When the network is reconnected, the network disconnected message is dismissed.
Test Case ID Definition Related Info
CO-CN-02 If the network connection is lost while the application is running, including during media playback, check that a notification message is shown. Checking Network Status
  • When the network connection is lost, a message is shown.
  • When the network disconnected message is shown, the application does not lock up the device or cause it to reboot.
Test Case ID Definition Related Info
CO-CN-03 While loading or buffering content, check that a loading or progress indicator is shown. Progress Indicators
  • A loading or progress indicator is present.

Installation

Test Case ID Definition
CO-IN-01 For 2016 and newer models, if the application supports Smart Hub Preview, check that during installation, the application icon and preview can be automatically added to the Smart Hub Apps Preview.
  • When installing the application, if "Add to Home" is selected, the application icon and preview are added to the Smart Hub Apps Preview.
Test Case ID Definition
CO-IN-02 Check that the application can be run immediately after installation.
  • After installing the application, when "Run Now" or the application icon in Smart Hub is clicked, the application launches.
Test Case ID Definition
CO-IN-03 If the application requires privileges, on the application details page, check that the following paragraph is shown below the "Install" button:
"Check the app permissions by selecting More in the information area. By selecting Install, you agree to grant those permissions to this app."
  • On the application details page, the required text is present.
Test Case ID Definition Related Info
CO-IN-04 If the application requires privileges, check that the privileges required by the application match those listed on the application details page. Configuring TV Applications
  • The privileges required by the application match those listed on the application details page.

Keyboard/IME

Test Case ID Definition
CO-KI-01 When using the Samsung IME, if the entered text exceeds the character limit, check that the application works properly.
  • Exceeding the character limit does not cause unexpected behavior or lock up the device.
Test Case ID Definition
CO-KI-02 When entering text, check that the text does not overflow the bounds of the input box.
  • The entered text stays inside the input box.
Test Case ID Definition
CO-KI-03 When the Samsung or application IME language is changed, check that the IME is changed accordingly.
  • Language-specific characters are input correctly.
Test Case ID Definition Related Info
CO-KI-04 Check that special characters and spacing can be input and displayed correctly in the application. Keyboard/IME
  • Special character input does not cause the application to freeze or crash.
  • Special characters are displayed correctly.
  • Special character input stays inside the input box.
  • Search works properly with special characters.
Test Case ID Definition
CO-KI-05 When using the Samsung IME with the XT9 predictive text feature, if the entered word exceeds the 64-character length limit, check that the application works properly.
  • Exceeding the character limit does not cause unexpected behavior or lock up the device.
Test Case ID Definition Related Info
CO-KI-06 Connect a physical keyboard to the device and launch the application. If the application does not support external keyboards, only the keyboard keys with remote control key equivalents are functional. Keyboard/IME
  • Only the keyboard keys with remote control key equivalents are functional.
Test Case ID Definition Related Info
CO-KI-07 While the application is running, connect, disconnect, and reconnect a physical keyboard to the device. Check that the keyboard works properly. Keyboard/IME
  • The physical keyboard is detected properly.
  • Keyboard input works properly.
Test Case ID Definition Related Info
CO-KI-08 If the application supports physical keyboards, check that all keyboard characters can be input correctly, including modified characters.
Note: When modifier keys (such as "Ctrl" and "AltGr") are pressed, the virtual IME does not show the modified characters.

 Keyboard/IME
  • All keyboard characters can be input correctly, including modified characters.
Test Case ID Definition Related Info
CO-KI-09 If the application implements special functions for specific keyboard keys, check that they work as described in the application description. Keyboard/IME
  • Keyboard keys with special functions work as described.
Test Case ID Definition Related Info
CO-KI-10 Connect a physical keyboard to the device and launch the application. Check that the keyboard keys with remote control key equivalents work correctly.
Note: During text input, these keys can function as normal keyboard keys instead of remote control keys.

 Keyboard/IME
  • When the keyboard key is clicked, the corresponding remote control key function, if applicable, is activated.

Multitasking

Test Case ID Definition Related Info
CO-MT-01 During media playback, send the application to the background by clicking the Smart Hub key. Check that the application resumes properly from the Apps panel or the Smart Hub first screen. Multitasking
  • When the application resumes, media playback resumes in the same state as before, or the application shows the previous page.
  • If the application implements a shortcut key for resuming playback, it works properly.
Test Case ID Definition Related Info
CO-MT-02 While viewing a TV channel, launch the application. Click the Smart Hub key to send the application to the background. Check that the same TV channel is shown. Multitasking
  • The same TV channel is shown before launching the application and after sending it to the background.
Test Case ID Definition Related Info
CO-MT-03 During media playback, click the Smart Hub key to send the application to the background. Disconnect and reconnect the network, then resume the application. Check that media playback resumes correctly. Multitasking
  • After resuming the application, audio and video playback work normally.
Test Case ID Definition
CO-MT-04 While the application is in use, such as during media playback or showing a detail page, send the application to the background. Uninstall and reinstall the application. Check that the application is reinitialized.
  • After reinstalling the application, when it is launched, it opens to the first page.

Prelaunching

Test Case ID Definition Related Info
CO-PL-01 For TV models that support prelaunching, check that it works properly. Add the application to the left side of the Smart Hub launcher and power cycle the TV. After 3 minutes, launch the application. Prelaunching Applications
  • After the TV has been switched back on, the audio and video work properly.
  • The application launches immediately without showing a loading screen.
  • When the application is launched, it works normally.

Privacy

Test Case ID Definition
CO-PR-01 Check that all personally-identifiable information is deleted with application deletion. The term "personally-identifiable information" is used as defined in the Online Privacy Protection Act.
  • After deleting the application, reinstall it. No personally-identifiable information from the previous installation is available.
Test Case ID Definition
CO-SE-01 Check that searching with an empty search box is handled appropriately.
  • A "no search results" message is shown.
  • The application does not crash.
Test Case ID Definition
CO-SE-02 Check that keyword search finds keyword-related results.
  • Keyword search finds results related to the keyword in addition to those containing the keyword.

Slideshow

Test Case ID Definition
CO-SL-01 Check that the slideshow transition time setting is applied properly.
  • The slideshow transition time is applied properly.
Test Case ID Definition
CO-SL-02 Check that slideshow transition effects (such as fade, puzzle, or random) are applied properly.
  • Slideshow transition effects are applied properly.
Test Case ID Definition
CO-SL-03 When a slideshow reaches the end, check that it repeats properly.
  • The slideshow repeats from the beginning.
  • The slideshow does not cause the application to crash.
Test Case ID Definition
CO-SL-04 When creating a slideshow from selected images or image categories, check that the selected images are shown.
  • During image selection, the application does not crash.
  • Only the selected images are included in the slideshow.
Test Case ID Definition
CO-SL-05 When launching a slideshow, check that all images can be loaded.
  • All slideshow images can be loaded.
Test Case ID Definition
CO-SL-06 During a slideshow, check that the user can browse through the images using the arrow keys (or other assigned keys).
  • Slideshow images can be browsed using the arrow keys (or other assigned keys).

Sound

Test Case ID Definition
CO-SO-01 If the application uses the Samsung OSD, after clicking various remote control keys (except the return, exit, and search keys), check that the volume and mute keys work properly.
  • The sound bar displays the correct volume level.
  • If mute is switched on, it stays on when entering or exiting the application.
Test Case ID Definition
CO-SO-02 Check that volume controls work properly in the application.
  • The sound output is adjustable throughout an appropriate range.
  • When the volume keys are clicked, mute is not switched on or off.
Test Case ID Definition
CO-SO-03 Check that running the application switches off the TV channel audio.
  • While the application is running, the TV channel audio cannot be heard.
Test Case ID Definition
CO-SO-04 Switch mute on, then launch the application. Check that mute works properly in the application.
  • Sound is muted.
  • Only 1 copy of the mute UI is shown.
  • While muted, when the application is closed, mute stays switched on.
  • While muted, when the mute key or the volume keys are clicked, mute is switched off.
Test Case ID Definition
CO-SO-05 Check that the mute and volume UIs are functional.
  • The mute and volume keys are functional.
  • The appropriate mute or volume UI is shown.
Test Case ID Definition
CO-SO-06 Check that mute is not unintentionally switched on when launching or closing the application.
  • If mute is switched off, when the application is closed, mute stays switched off.
Test Case ID Definition
CO-SO-07 Launch the application, then switch mute on. Check that mute works properly.
  • When the mute key or the volume keys are clicked, mute is switched off.
  • While mute is switched on, when the application is closed, mute stays on and the mute UI is shown.

UI

Test Case ID Definition Related Info
CO-UI-01 Check that the application icon displays properly in Smart Hub. App Icon
  • The icon is shown in Smart Hub properly.
  • The icon and name do not overlap.
  • The icon is the correct size.
  • The icon is identical in Samsung Apps and in Smart Hub.
  • The icon highlight is consistent with that of other application icons.
Test Case ID Definition
CO-UI-02 Check that the help bar keys are shown in the correct order.
  • The help bar keys are shown in the following order:
    1. Color keys: Red (A), Green (B), Yellow (C), and Blue (D)
    2. Playback control keys
    3. Tools key
    4. Arrow keys
    5. Enter key
    6. Return key
Test Case ID Definition Related Info
CO-UI-03 Hover the cursor over the application icon in the Smart Hub Apps Preview. Check that the preview panel and its deep links work properly. Smart Hub Preview
  • The preview tiles display properly.
  • When a preview tile is clicked, the indicated content or detail page in the application launches directly.
Test Case ID Definition Related Info
CO-UI-04 Check that list or content navigation using the arrow keys works properly. Remote Control
  • The focus can move between all items in a list.
  • When the focus moves to the beginning or ending of a list or content, the arrow keys for directions in which it is not possible to navigate are deactivated.
  • The focus does not disappear.
Test Case ID Definition
CO-UI-05 Check that UI elements do not move around unintentionally when remote control keys are clicked.
  • The UI elements stay in place.
Test Case ID Definition
CO-UI-06 Check that focus can be moved to all selectable parts of the UI.
  • Focus can be moved to all selectable parts of the UI.
Test Case ID Definition
CO-UI-07 When entering and leaving the page multiple times, using the enter and return keys, check that the UI works properly.
  • The UI is shown correctly.
  • No error messages appear.
  • The application does not crash, nor causes the device to lock up or reboot.
Test Case ID Definition
CO-UI-08 Check that all UI text, including special characters and symbols, is displayed properly.
  • All UI text is displayed properly.
  • Special characters and symbols are not corrupted.
  • All HTML code is valid and rendered correctly.
Test Case ID Definition
CO-UI-09 When the arrow keys are clicked multiple times, check that the UI works properly.
  • The UI is shown correctly.
  • The UI elements do not unintentionally move around or overlap.
  • The focus does not disappear.
  • There is no double focus.
  • The application does not crash, nor causes the device to lock up or reboot.
Test Case ID Definition
CO-UI-10 If the application has multiple category pages, check that the arrow keys navigate between the pages properly.
  • All category pages can be selected.
  • When a category is selected, the correct page is shown.
Test Case ID Definition Related Info
CO-UI-11 On pages with too much content to fit on 1 screen, check that the full content can be viewed using a scroll bar. Position Indicators
  • The scroll bar is displayed properly.
  • The scroll bar is functional.
Test Case ID Definition Related Info
CO-UI-12 Check that the control buttons on scroll bars are displayed properly. Position Indicators
  • The control buttons on scroll bars are displayed properly.
Test Case ID Definition
CO-UI-13 Check that image thumbnails are displayed properly. If the media has no image, or the image is not supported, check that an alternative image is shown.
  • Image thumbnails are displayed properly.
  • If the media has no video image, or the image is not supported, an alternative image is shown.

User Controls

Test Case ID Definition Related Info
CO-US-01 In the application, check that all remote control keys work properly. Remote Control
  • In the application, all remote control keys function properly, including during media playback.
  • If the remote control has a search key, clicking it closes the application and shows the search box on the TV channel screen.
    For 2014 models, the search box is shown in the following locations:
    • On TVs: On the application screen
    • On BD players: On the main menu
    • On BD PVRs: On the DTV screen
  • If there are keys which are not defined in the application description, they must not respond to clicks.
  • The screen does not flicker when keys are clicked.
  • While video playback is paused, skipping the video forward or backward does not cause double focus.
Test Case ID Definition Related Info
CO-US-02 While loading or buffering media content, check that the remote control keys work properly. Remote Control
  • When the remote control keys are clicked, the application does not lock up the device or cause it to reboot.
  • When the return key is clicked, the focus does not disappear.
  • When the return key is clicked, the application goes back to the previous page.
  • When the stop key is clicked, playback is stopped.
  • When the return or stop key is clicked, the loading indicator disappears.
Test Case ID Definition
CO-US-03 Check that all help bar keys work properly.
  • All help bar keys work as described.
Test Case ID Definition Related Info
CO-US-04 Check that the exit key works correctly. Remote Control
  • If a popup or the IME is open, clicking the exit key closes it.
  • The exit key works during media playback.
  • On an application page, clicking the exit key closes the application and shows the TV channel screen. The TV channel outputs normally.
  • On BD players, clicking the exit key closes the application and shows the main menu.
Test Case ID Definition Related Info
CO-US-05 Check that the return key works according to the return key policy. Terminating Applications
  • If a popup is open, clicking the return key closes the popup.
  • On an application page, clicking the return key goes to the previous page.
  • On the application home page, clicking the return key closes the application and shows the Smart Hub.
  • Since 2016 models, on the application home page, clicking the return key closes the application and shows the TV channel screen.
  • Launch the application from the Samsung Apps screen. Clicking the return key closes the application and shows the Smart Hub.
Test Case ID Definition Related Info
CO-US-06 Check that the channel list, channel guide, and number keys work properly. Remote Control
  • When the channel list, channel guide, and number keys are clicked, unexpected behavior does not occur.
  • If the number keys are assigned to actions in the application description, they work as described.
Test Case ID Definition Related Info
CO-US-07 Check that the color (red, yellow, green, and blue) keys work as described in the application description. Remote Control
  • The color keys work as described in the application description.
  • If the color keys are not assigned to actions, they do not respond to clicks.