Television use evaluation system

Abstract

A television usage evaluation system includes a television decoder operably connected to a television and configured to receive a signal, decode the received signal, and provide an output to be presented on the television; a remote controller configured to receive an input from a user and transmit an input signal to the television decoder; wherein the television decoder is configured to receive the input signal from the remote controller, and perform one or more functions encoded within the input signal; a camera configured to record a user's interaction with the system; a performance evaluation device is configured to receive a record with an interaction made by the user with the system and analyze the record to generate an evaluation of the user interaction.

Description

Technical Field

[0001] The present disclosure relates to a television usage evaluation system, particularly a television training and usage evaluation system. Background Art

[0002] In daily life, the penetration rate of televisions is extremely high. Many users still use a television decoder on the television to receive signals and decode the received signals. A set-top box (or STB) is still a common example of a television decoder. The set-top box is connected to the television and is configured in use to receive satellite or digital signals or Internet data and convert them into television signals so that video content can be presented on the television.

[0003] A remote control is typically used to provide input signals to interact with the set-top box and control the operation of the set-top box. Many impaired users, especially the elderly, cannot use the touch screen or cursor-based applications (Apps) in smart devices (such as mobile phones or tablets) well. The user interface of most set-top boxes uses an App on a smart device or navigates by using the cursor buttons on a remote control (such as a standard television remote control). Various functions and options of the set-top box are navigated and selected through the cursor function, from an App on a remote control or a smart device. Elderly users usually lack dexterity or have visual impairments and it is difficult to control the cursor through an App or a remote control. This makes the usability of the set-top box very poor or even unusable in some cases. The resulting frustration sometimes makes the elderly bored. For other impaired users (such as those with poor dexterity of fingers and / or hands and unable to control the cursor on a remote control device or the cursor provided by an application on a smart device), it may bring them similar frustration.

[0004] Currently, there is no common method to objectively evaluate the usage of a set-top box by impaired users (such as elderly users). Currently, there is also no general method to objectively evaluate the performance of users interacting with a set-top box using a remote control or an App. Current set-top box evaluation systems use a camera to capture videos of users using the set-top box. The captured videos are uploaded to a backend system for therapists (such as physical therapists or occupational therapists or physiotherapists) to watch. The user performance is subjectively evaluated by the therapist and there is no objective evaluation or objective comparison among users. Summary of the Invention

[0005] According to one aspect of the present disclosure, there is provided a television usage evaluation system, comprising:

[0006] A television decoder operably connected to a television, configured to receive signals, decode the received signals and provide an output to be presented on the television;

[0007] A remote control configured to receive input from a user and send an input signal to the television decoder;

[0008] Wherein, the television decoder is configured to receive the input signal from the remote control and execute one or more functions encoded in the input signal;

[0009] A camera configured to record the interaction of the user with the system;

[0010] A performance evaluation device configured to receive the record of the interaction of the user with the system and analyze the record to generate an evaluation of the user interaction.

[0011] In one example, the performance evaluation is a performance score indicating the interaction of the user with the system, and the performance score is generated by the performance evaluation device.

[0012] In one example:

[0013] The television decoder is configured to output a training video to be displayed on the television;

[0014] The camera is configured to record the interaction with the system;

[0015] The performance evaluation device is configured to:

[0016] Receive the recorded interaction,

[0017] Compare the recorded interaction with the training video,

[0018] Based on the comparison of the recorded interaction with the training video, generate the performance score, display the performance score on a display, or send the performance score to a therapist device.

[0019] In one example, the television decoder may be configured to communicate wirelessly with the performance evaluation device, and the television decoder is configured to receive the training data from the performance evaluation device.

[0020] In one example, the performance evaluation device is further configured to:

[0021] Compare the performance score with a performance threshold;

[0022] If the performance score is less than the performance threshold, generate an alert;

[0023] Transmit the alert and the performance score to a therapist device, and / or present the alert and the performance score on the television or on the display of the performance evaluation device.

[0024] In one example, a performance score below the performance threshold indicates that the user is at risk of injury.

[0025] In one example, the performance evaluation device includes:

[0026] A scoring module configured to calculate the performance score based on a comparison between the recorded interaction and the training video; and

[0027] A risk module configured to calculate a risk profile of the user based on the performance score calculated by the scoring module, the risk profile indicating the likelihood of the user being injured.

[0028] In one example, the risk module is configured to calculate the risk profile based on the difference between the user's performance score and the performance threshold, wherein the higher the performance score, the lower the risk profile.

[0029] In one example, the camera is configured to detect a video of the user interacting with the remote control and provide an input to the TV decoder.

[0030] In one example, the recorded interaction is a video of the user's interaction with the system, and the performance evaluation device is configured to perform object recognition processing on the recorded video and the training video to: identify the user or one or more limbs of the user, identify the movements performed by the user, and compare the identified movements with the training video.

[0031] In one example, the performance evaluation device may include a machine learning model or an AI model that is trained to perform object detection on the received record (i.e., the received video record) and identify the interaction between the user, the remote control, and the TV decoder.

[0032] In one example, the performance score is an objective score calculated by the performance evaluation device.

[0033] In one example, the TV decoder includes:

[0034] An application interface presented on the TV during use;

[0035] wherein the application interface defines one or more functions of the TV decoder,

[0036] The application programming interface includes one or more buttons, where each button includes alphanumeric characters or symbols,

[0037] Each button corresponds to one of the one or more functions,

[0038] Each button is selectable from user input at the remote control.

[0039] In one example, the application interface includes at least 12 buttons, at least 2 of the buttons include symbols, and at least 10 of the buttons include numbers.

[0040] In one example, the remote control includes a plurality of physical buttons;

[0041] The application interface buttons are activatable virtual buttons, where each virtual button is associated with a specific function of the TV decoder;

[0042] Wherein, the application interface buttons are virtual buttons corresponding to the arrangement of the physical buttons of the remote control, such that pressing a physical button on the remote control is configured to activate the corresponding application interface button;

[0043] The TV decoder is configured to execute a function associated with the activated application interface button.

[0044] In one example, the application interface virtual buttons are arranged in a configuration that substantially matches the button configuration of a landline phone, and the remote control physical buttons are arranged in a configuration that substantially matches the button configuration of the landline phone; wherein, the virtual buttons and the physical buttons are the same in configuration.

[0045] In one example, the TV decoder is a set-top box, and the camera is integrated in the TV decoder.

[0046] In one example, the TV usage evaluation system includes a speaker, which is operably connected to the TV decoder and is controlled to provide voice commands to the user to guide the user to use the remote control to control the application interface.

[0047] In one example, the speaker may be integrated in the TV decoder. In one example, the speaker may be the speaker of the TV, which is controlled by the TV decoder. In one example, the TV decoder may be configured to communicate with a user device, such as a mobile phone or a tablet, and the speaker may be the speaker of the user device.

[0048] According to another aspect of the present disclosure, there is provided a remote control used in a TV usage evaluation system, including:

[0049] A body;

[0050] A transmitter configured to send a signal to a TV decoder of the TV usage evaluation system;

[0051] A plurality of physical buttons, where at least 2 of the physical buttons include symbols and at least 2 of the physical buttons include alphanumeric characters;

[0052] Among them, activating the physical button causes an input signal to be sent to the TV decoder, so that the TV decoder executes a preset function associated with the button.

[0053] In one example, the remote control may include a power source, such as a battery. The remote control may optionally include a receiver for receiving communications from a user device or a TV decoder. In one example, the remote control may be configured to communicate wirelessly with the performance evaluation device.

[0054] In one example, the physical buttons include at least 12 buttons, where at least 10 of the buttons each include a digit, the digits being from 0 to 9, and at least 2 of the buttons include different symbols, where one button includes the symbol * and the other button includes the symbol #.

[0055] In one example, the physical buttons are arranged in a configuration that matches the configuration of the buttons on a landline phone.

[0056] According to a third aspect of the present disclosure, there is provided a computer-implemented method for evaluating TV usage, including the following steps:

[0057] Receiving the recorded interaction of the user with the remote control and the TV decoder;

[0058] Comparing the recorded interaction with the training video;

[0059] Generating the performance score based on the comparison of the recorded interaction with the training video;

[0060] Displaying the performance score on a display, or sending the performance score to a therapist device. In one example, the performance score indicates the user's interaction with the system, and the performance score is generated by the performance evaluation device.

[0061] In one example, the method includes:

[0062] Comparing the performance score with a performance threshold;

[0063] If the performance score is less than the performance threshold, generating an alert;

[0064] Transmitting the alert and the performance score to a therapist device, and / or presenting the alert and the performance score on the TV or on the display of the performance evaluation device. In one example, a performance score less than the performance threshold indicates that the user is at risk of injury.

[0065] There is provided a computer program including instructions, where when the program is executed by a computer, the instructions cause the computer to execute the TV usage evaluation method as described above.

[0066] A computer-readable medium including instructions which, when executed by a computer, cause the computer to perform the television usage assessment method as described above.

[0067] A data processing device is provided, including a processing device or a processor for performing the television usage assessment method.

[0068] As used herein, the term "comprising" (and its grammatical variants) is used in an inclusive sense of "having" or "including", rather than in the sense of "consisting only of".

[0069] It should be understood that if any information of the prior art is cited herein, such citation does not mean admitting that such information forms a part of the common general knowledge in this field in any country. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Embodiments of the present disclosure will be described hereinafter by way of example with reference to the drawings.

[0071] Figure 1 An exemplary embodiment of a television usage assessment system is shown.

[0072] Figure 2 Shows Figure 1 An example of a remote control that forms part of the system and an exemplary button configuration of the remote control.

[0073] Figure 3 A known landline telephone and its button configuration are shown.

[0074] Figure 4 Shows Figure 1 A schematic diagram of a television decoder of the system.

[0075] Figure 5 An application interface of a television decoder presented on a television screen with virtual buttons having defined functions is shown.

[0076] Figure 6 An application interface having a training video and related functions presented on the interface is shown.

[0077] Figure 7 A schematic diagram of an exemplary performance assessment device is shown.

[0078] Figure 8 Shows Figure 1 A method for television usage assessment implemented by the system. DETAILED DESCRIPTION

[0079] The present disclosure relates to a television usage evaluation system, particularly a television training and usage evaluation system for training impaired users and evaluating user performance. The television usage evaluation system is particularly suitable for evaluating the use of a set-top box by impaired users. Impaired users can be users who are mentally and / or physically impaired, such as the elderly or those suffering from arthritis or other chronic conditions. The advantage of this evaluation system is that it provides an objective assessment of how users use the television decoder. The evaluation system can also provide an objective comparison between different users.

[0080] The present disclosure also relates to a remote control that provides a simplified user interface, which is configured to communicate with a television decoder during use. The remote control with a simplified user interface includes a plurality of buttons, where each button corresponds to a specific control function of the television decoder. The remote control serves as part of the television usage evaluation system. The remote control is advantageous because it provides a simpler and more usable interface to allow impaired users (e.g., elderly users) to interact with the television decoder (i.e., the set-top box) and operate the television decoder.

[0081] Reference Figure 1 , an embodiment of the present disclosure is shown. This embodiment provides a television usage evaluation system 100. The system 100 includes: a television decoder 102 operably coupled to a television 10, a remote control 104, a camera 106, and a performance evaluation device 110. The television decoder 102 is operably connected to the television 10, configured to receive signals, decode the received signals, and provide an output to be presented on the television 10. The remote control 104 is configured to receive input from a user and send the input signal to the television decoder 102. The television decoder 102 is configured to receive the input signal from the remote control 104 and execute one or more functions encoded in the input signal; the camera 106 is configured to record the interaction with the system 100. The performance evaluation device 110 is configured to receive the record of the interaction between the user and the system and analyze the record to generate an evaluation of the user interaction. The performance evaluation device 110 is configured to communicate with a therapist device 108, and preferably the communication method is through a portal.

[0082] The performance evaluation is a performance score indicating the user's interaction with the system, and the performance score is generated by the performance evaluation device. The performance score can be transmitted to the therapist device 108. The performance score can be presented on the television 10. The television 10 can be any suitable television, such as an LCD or LED television.

[0083] The TV decoder 102 can be a device that is operably connected to the TV 10 and converts cable, satellite, or digital signals or Internet data into TV signals, so that video content can be displayed or presented on the TV 10 for the user to view. The TV decoder 102 can be a device separate from the TV. Alternatively, the TV decoder 102 can be integrated into the TV 10. The TV decoder 102 can be a TV set-top box. The TV set-top box 102 is configured to receive signals from the remote control 104. The TV set-top box 102 is used to execute one or more preset functions associated with the buttons of the remote control 104.

[0084] The remote control 104 includes a body and a transmitter configured to send signals to the TV decoder 102. The remote control 104 includes a plurality of physical buttons. The remote control 104 includes at least 2 physical buttons including symbols and at least 2 physical buttons including alphanumeric characters. Activating a physical button causes an input signal to be sent to the TV decoder, causing the TV decoder to execute a preset function associated with the button.

[0085] Figure 2 An example of the remote control 104 is shown. Refer to Figure 2 , the physical buttons include at least 12 buttons. The remote control 104 includes at least 10 buttons. Each button includes a number from 0 to 9, and at least 2 buttons include different symbols, where one button includes the symbol *, and the other button includes the symbol #. One button can include the < symbol. In the example shown, the remote control 104 includes 10 buttons, each with a number. The numbers are 0 to 9. One button includes the symbol #, and one button includes the symbol *. The remote control 104 can include additional buttons.

[0086] The remote control 104 can include a power source, such as a battery. The remote control can optionally include a receiver for receiving communications from a user device or the TV decoder 102. In one example, the remote control can be configured to communicate wirelessly with a performance evaluation device 110.

[0087] The physical buttons of the remote control are arranged to have a configuration that basically matches the button configuration of a landline phone. Figure 3 An example of a landline phone 200 is shown. The schematic box 300 surrounds the buttons and the button configuration. The schematic box 302 surrounds the buttons of the remote control 104. As Figure 2 and Figure 3 shown, the button configuration of the remote control 104 matches the button configuration of the landline phone.

[0088] The advantage of the button configuration of the remote control 104 that matches the landline button configuration is that it is user-friendly for the elderly. Given the popularity of landline phones that have been used for decades, most impaired users (e.g., elderly users) are also familiar with this button configuration. AsFigure 2 As shown, the button configuration of the remote controller 104 makes the remote controller 104 intuitive for impaired users.

[0089] Figure 4 The figure shows a schematic diagram of an exemplary television decoder 102. The television decoder 102 (e.g., a set-top box for a television) includes a main CPU 400, a power supply 402, a memory 404, a video decoder 406, and an audio decoder 408. The television decoder 102 may further include a graphics engine 410 and a mixer 412. The mixer 412 is electrically connected to the graphics engine 410 and the video decoder 406. The audio decoder 408 may be connected to an audio output 414, such as a digital or analog output. The mixer 412 is connected to a video output 416 that may be an analog or digital output. The video output and the audio output are connected to the television and provide video and audio content to the television. The video content is presented on the television, while the audio content is output through the television speakers.

[0090] The decoder 102 includes a camera 106, a speaker 418, a microphone 419, and a communication module 420. The communication module 420 may be a Wi-Fi module or a Bluetooth module or a cellular module. The communication module 420 allows the decoder 102 to communicate using a suitable communication network. Optionally, the decoder 102 may include a microphone configured to capture sound inputs such as commands or voices from a user, for example.

[0091] The television decoder 102 may include an application interface 500, as Figure 5 and Figure 6 shown. In use, the application interface 500 is presented on the television 10. The application interface 500 defines one or more functions of the television decoder 102. The application programming interface 500 provides a screen that allows a user to interact with the decoder 102 and control the operation of the decoder 102.

[0092] Referring Figure 5 , the application interface 500 may include one or more buttons, where each button includes alphanumeric characters or symbols or a combination thereof. Each button may correspond to one of one or more functions. This means that each button is associated with a single function. Selecting a button on the application interface 500 may cause the decoder 102 to perform a specific associated function. Each button may be selected from user input at the remote controller 104.

[0093] The application interface buttons are activatable virtual buttons, where each virtual button is associated with a specific function of the television decoder 102. The application interface buttons are virtual buttons corresponding to the arrangement of the physical buttons of the remote controller.

[0094] In one example, the virtual buttons on the application interface are arranged in a configuration that substantially matches the button configuration of a landline telephone. In one example, the virtual buttons of the application interface 500 and the physical buttons of the remote control 104 may be the same in configuration.

[0095] The physical buttons pressed on the remote control 104 are configured to activate the corresponding application interface buttons. The TV decoder 102 is configured to execute the functions associated with the activated application interface buttons. Refer to Figure 5 , for exemplary application program interfaces and virtual buttons 501 - 512. The buttons may also include numbers that match the remote control buttons. As Figure 5 shown, button 501 has the number 1, and the associated function is to watch a video, such as a training video. Button 502 has the number 2 and has the function of scheduling a specified function. Button 503 has the number 3 and has the function of performing a health check. Button 511 has the number 0 and has the associated function of performing a video call or a teleconference. Button 510 has the symbol < and can implement the return function. Other virtual buttons may have unspecified functions programmable into the decoder 102. The programming of the functions can be performed through the remote control 104, or can be loaded into the memory, or the decoder 102 can receive updated functions through the communication module 420.

[0096] Refer to Figure 6 , which shows another screen with additional virtual buttons. Each button includes a number representing the corresponding physical button on the remote control. For example, as Figure 6 shown, button 513 has the number 3 and corresponds to turning on the video. Button 514 has the number 6 and corresponds to the function of replaying the video. These functions of the decoder 102 can be executed by pressing the appropriate physical button with the corresponding number or symbol. For example, in Figure 5 , the user can press 0 on the remote control 104 to start a video call. In the example of Figure 6 , a person can press the button 3 on the remote control 104 to start the video.

[0097] The user can register to use the TV usage assessment system 100. The user may be required to register with the performance assessment device 110 by following an appropriate registration process. Key user information such as name, age, physical or mental impairment, etc. can be captured and stored in the performance assessment device 110. The user can selectively log in to the system 100 through the remote control, although logging in may not be required in most home usage scenarios. The login can be captured by the decoder 102, and the username 516 can be displayed on the application program interface, as shown in Figure 6 . Logging in allows the decoder to appropriately track the user's performance.

[0098] The performance assessment device 110 can be used by one or more therapists (e.g., a physiotherapist, an occupational therapist, a physical therapist, or an appropriate practicing physician) to monitor the user's interaction with the system 100 and evaluate the user's performance. The performance assessment device 110 can be configured to evaluate the degree of the user's interaction with the remote control 104 and control the functions of the decoder 102. The performance assessment can include a performance score indicating how well the user interacts with the system. The performance score is generated by the performance assessment device 110. The performance score can indicate the user's injury risk. The performance score can also indicate the user's physical health, such as dexterity and hand-eye coordination. Additionally, the performance score can also indicate cognitive functions, e.g., the user can activate the appropriate functions or replicate the functions presented in the training video. The performance score can indicate physical and mental health.

[0099] A training video is presented to the user on the television 10 as part of determining the performance assessment. The decoder 102 can include one or more preset training videos that can be stored in the decoder (e.g., memory). A specific training video can be presented on the television. Figure 6 An exemplary application interface 500 with a training video 515 presented on the interface 500 is shown. The video can include a specific number of actions that the user has to perform. The user can control the video with appropriate functions (e.g., virtual buttons 513, 514).

[0100] The television decoder 102 is configured to output the training video presented on the television. The camera 106 is configured to record the user's interaction with the system. The camera 106 is configured to record how well the user can follow the training video and use the remote control to select the functions indicated in the training video. The decoder 102 can also record the buttons pressed by the user and the accuracy and / or speed at which the buttons are pressed. The recorded video is stored in the decoder 102 and sent to the performance assessment device 110. The performance assessment device 110 is configured to receive the recorded interaction from the decoder 102. The performance assessment device 110 is also configured to compare the recorded interaction with the training video and generate a performance score based on the comparison of the recorded interaction with the training video. The performance assessment device 110 is configured to present the performance score on a display or transmit the performance score to the therapist device.

[0101] In one exemplary embodiment, the performance evaluation device 110 may be or may be implemented by a computing device 600 having a processor, a memory, and other components. The performance evaluation device may be implemented by any computing architecture, including: a portable computer, a tablet computer, a stand-alone personal computer (PC), a smart device, an Internet of Things (IoT) device, an edge computing device, a client / server architecture, a "dumb" terminal / host architecture, a cloud computing-based architecture, or any other suitable architecture. The computing device 600 may be appropriately programmed to implement the present disclosure. The device 600 may be appropriately programmed to receive a record of a user's interaction with the system and analyze the record to generate an evaluation of the user interaction and perform other functions.

[0102] As Figure 7 shown, a schematic diagram of a computing device or a computer server 600 is illustrated. The computing device or the computer server 100 is used to be implemented as an exemplary performance evaluation device 110. The performance evaluation device 110 may be implemented as a cloud-based server. In Figure 7 the illustrated embodiment, the computer server 600 includes appropriate components necessary for receiving, storing, and executing appropriate computer instructions. These components may include: a processor 602, which includes a central processing unit (CPU), a math co-processing unit (Math Processor), a graphics processing unit (GPU), or a tensor processing unit (TPU) for tensor or multi-dimensional array computing or manipulation operations; a read-only memory (ROM) 604; a random-access memory (RAM) 606; an input / output (I / O) device (e.g., a disk drive 608); an input device 610 (e.g., an Ethernet port, a USB port, etc.). The decoder 102 interacts with a television display and may also include a communication link 612, such as a communication module. The computer server 600 may include a user database 620, which is configured to store user information after the user registers with the system 100.

[0103] The computer server 600 (i.e., the performance evaluation device 110) may include instructions. These instructions may be included in the memory and may be executed by the processor 602. A plurality of communication links 612 may be provided, which may be differently connected to one or more computing devices, such as servers, personal computers, terminals, wireless or handheld computing devices, IoT devices, smart devices, and edge computing devices. In one example, the communication links 612 allow communication with one or more decoders 102 and one or more therapist devices 108. At least one of the plurality of communication links may be connected to an external computing network via a telephone line or other type of communication link. The performance evaluation device 110 may be configured to communicate with a plurality of decoders, each decoder associated with a specific user to evaluate the performance of a plurality of users. The evaluation device 110 may be configured to communicate with a plurality of therapists via the therapist device. The server 600 (i.e., the performance evaluation device 110) may also have an appropriate operating system residing on a disk drive or in the ROM of the server 100.

[0104] The computing device 600 (or server) may also provide the necessary computing power to operate or interface with a machine learning network or AI model, such as a neural network, to provide various functions and outputs. The neural network may be implemented locally or may also be accessed or partially accessed via a server or cloud-based service. The machine learning network may also be untrained, partially trained, or fully trained, and / or may also be retrained, modified, or updated over time. The evaluation device 110 may have the computing power to implement one or more object recognition models. The object recognition model may be designed to detect objects, such as a person or a person's hand, and also detect and recognize various actions being performed by the person.

[0105] The performance evaluation device 110 is configured to receive a training video or may store the training video, for example, in the memory. In one example, the therapist may select a specific training video or upload a training video for a specific user. The training video may be downloaded by the decoder 102 from the evaluation device 110 via the communication module 420. Alternatively, the performance evaluation device 110 may send a specified training video to the decoder 102 of a specific user. The performance evaluation device 110 may be configured to compare the performance score with a performance threshold. The performance evaluation device 110 is further configured to generate an alert if the performance score is less than the performance threshold. The performance evaluation device 110 may be configured to send the alert and the performance score to the therapist device and / or present the alert and the performance score on a television or on the display of the performance evaluation device.

[0106] In one example, a performance score less than the performance threshold indicates that the user is at risk of injury.

[0107] In one example, the performance evaluation device 110 may include a scoring module 630 and a risk module 632. The scoring module 630 is configured to calculate the performance score based on a comparison between the recorded interaction and the training video. The risk module 632 is configured to calculate a risk profile of the user based on the performance score calculated by the scoring module, the risk profile indicating the likelihood of the user getting injured.

[0108] The scoring module 630 and the risk module 632 may be software modules or part of software code executable by a processor of the performance evaluation device. Alternatively, the scoring module and the risk module may be hardware elements, such as a microprocessor or a programmable logic device or an FPGA, etc.

[0109] Figure 8 A television usage evaluation method 800 implemented by the system 100 is shown. Refer Figure 8 , the method 800 includes the following steps: Step 802: Receive the recorded interaction of the user with the remote control 104 and the television decoder 102. The interaction may include recording the physical use of the remote control 104 and / or function selections on the remote and application interfaces, as shown in the training video. The camera 106 may capture these interactions, and the decoder 102 may transmit the recorded interactions to the evaluation device 110.

[0110] Step 804: Receive or access the training video presented to the user through the application interface 500. Step 806: Compare the recorded interaction with the training video. In step 806, the performance evaluation device 110 may be configured to perform object recognition on the recorded video and the training video to identify the user or one or more limbs of the user, identify the movements performed by the user, and compare the identified movements with the training video. The comparison may be based on evaluating the degree to which the user performs the actions shown in the training video by pressing the buttons on the remote control. In one example, the performance evaluation may include a machine learning model or an AI model that is trained to perform object detection on the received record (i.e., the received video record) and identify the interaction of the user with the remote control and the television decoder.

[0111] The training video may be presented on the television 10. Optionally, the speaker may be controlled to provide voice commands to guide the user to use the television remote control to control the application interface. The voice commands may be paired with the training video presented on the screen.

[0112] Step 808: Generate a performance score based on the comparison between the recorded interaction and the training video. As Figure 8 shown, steps 806 and 808 are performed in the evaluation system 110. Step 808 may be performed by the scoring module 630.

[0113] Step 810: Present the performance score on a display or transmit the performance score to the therapist device. In one example, the performance score indicates the quality of the user's interaction with the system. The performance score is an objective score calculated by the performance assessment device.

[0114] The risk module 632 can be configured to calculate a risk profile of the user based on the performance score calculated by the scoring module, where the risk profile indicates the likelihood of the user getting injured. In one example, the risk module 632 is configured to calculate the risk profile based on the difference between the user's performance score and a performance threshold. The higher the performance score, the lower the risk profile.

[0115] Method 800 may further include step 812: Generate an alert if the performance score is less than the performance threshold. The alert can be transmitted to the therapist device. Additionally, the alert and the performance score can be presented on a television. A performance score less than the performance threshold indicates that the user is at risk of injury. Displaying the score on the television 10 allows the user to self-manage and evaluate their own improvement or deterioration.

[0116] The advantage of the television usage assessment system 100 is that the assessment device 110 generates an objective performance score. The objective score is based on an automatic assessment of how the user performs the functions presented in the training video. The advantage of this system is that it provides an objective score and an objective performance assessment. This makes it easier for the therapist to track the user's current condition and the user's improvement or deterioration, rather than using subjective assessments (such as opinions) as in current practice. Since it provides an objective score, the television usage assessment system 100 also allows multiple users to compare with each other. The system provides a robust system that is easy for users and therapists to use. The advantage of system 100 is that it is an automated system that can be used in the user's home. This means that users, such as elderly users, do not need to go to a clinic or rely on any other external facilities. The assessment system 100 is beneficial for therapists because they can receive the performance score and assessment on a phone or device. Additionally, system 100 allows the therapist to delete the user's performance assessment, thus saving time and making the assessment and evaluation process simpler, faster, cheaper, and more effective.

[0117] Although not required, the embodiments described with reference to the accompanying drawings can be implemented as an application programming interface (API) or a series of libraries used by developers, or can be included in another software application, such as an operating system of a terminal or a personal computer or an operating system of a portable computing device. Generally, since program modules include routines, programs, objects, components, and data files that help execute specific functions, those skilled in the art will understand that the functions of a software application can be distributed among multiple routines, objects, or components to achieve the same functions required herein.

[0118] It should also be understood that, in cases where the methods and systems of the present disclosure are implemented entirely or in part by a computing system, any suitable computing system architecture may be used. This will include standalone computers, network computers, and dedicated hardware devices. In cases where the terms "computing system" and "computing device" are used, these terms are intended to include any suitable configuration of computer hardware capable of implementing the described functions.

[0119] Those skilled in the art will understand that various changes and / or modifications can be made to the present disclosure as shown in the specific embodiments without departing from the spirit or scope of the present disclosure as broadly described. Accordingly, the present embodiments are considered illustrative in all respects and not restrictive.

[0120] Unless otherwise specified, any reference to prior art contained herein should not be construed as an admission that such information is common general knowledge.

[0121] In addition, it should be noted that embodiments may be described as processes, which are depicted as flowcharts, process flow diagrams, structural diagrams, or block diagrams. Although a flowchart may describe operations as a sequential process, many operations may be performed in parallel or simultaneously. In addition, the order of the operations may be rearranged. A process terminates when its operations are completed. A process may correspond to a method, function, procedure, subroutine, subprogram, etc. in a computer program. When a process corresponds to a function, its termination corresponds to the function returning to the calling function or the main function.

Claims

1. A television usage evaluation system, characterized in that, Comprising: A television decoder operably connected to a television and configured to receive a signal, decode the received signal, and provide an output to be presented on the television; A remote control configured to receive input from a user and send an input signal to the television decoder; Wherein the television decoder is configured to receive the input signal from the remote control and execute one or more functions encoded within the input signal; A camera configured to record the interaction of the user with the system; A performance evaluation device configured to receive a record of the interaction of the user with the system and analyze the record to generate an evaluation of the user interaction.

2. The television usage evaluation system according to claim 1, wherein Wherein, The performance evaluation is a performance score indicating the situation of the user's interaction with the system; the performance score is generated by the performance evaluation device.

3. The television usage evaluation system according to claim 2, wherein Wherein: The television decoder is configured to output a training video to be displayed on the television; The camera is configured to record the interaction with the system; The performance evaluation device is configured to: Receive the recorded interaction, Compare the recorded interaction with the training video, Generate the performance score based on the comparison of the recorded interaction with the training video, Display the performance score on a display, or send the performance score to a therapist device.

4. The television usage evaluation system according to claim 3, wherein Wherein, The performance evaluation device is further configured to: Compare the performance score with a performance threshold; If the performance score is less than the performance threshold, generate an alarm; Transmit the alarm and the performance score to a therapist device, and / or present the alarm and the performance score on the television or on a display of the performance evaluation device.

5. The television usage evaluation system according to claim 4, wherein Wherein, A performance score less than the performance threshold indicates that the user is at risk of injury.

6. The television usage evaluation system according to claim 4, wherein Wherein, The performance evaluation device includes: A scoring module configured to calculate the performance score based on the comparison between the recorded interaction and the training video; A risk module configured to calculate a risk profile of the user based on the performance score calculated by the scoring module, the risk profile indicating the likelihood of the user being injured.

7. The television usage evaluation system according to claim 6, wherein Wherein, The risk module is configured to calculate the risk profile based on the difference between the performance score of the user and the performance threshold; wherein, the higher the performance score, the lower the risk profile.

8. The television usage evaluation system according to claim 4, characterized in that, Wherein, The camera is configured to detect a video of the user interacting with the remote control and provide an input to the television decoder.

9. The television usage evaluation system according to claim 8, wherein Wherein, The recorded interaction is a video of the user's interaction with the system, and the performance evaluation device is configured to perform object recognition processing on the recorded video and the training video to: identify the user or one or more limbs of the user, identify the movement performed by the user, and compare the identified movement with the training video.

10. The television usage evaluation system according to claim 9, wherein Wherein, The performance score is an objective score calculated by the performance evaluation device.

11. The television usage evaluation system according to claim 10, wherein, Wherein, The television decoder includes: An application interface presented on the television during use; Wherein the application interface defines one or more functions of the television decoder, The application program interface includes one or more buttons; wherein each button includes alphanumeric characters or symbols, Each button corresponds to one of the one or more functions. Each button can be selected from user input at the remote control.

12. The television usage evaluation system according to claim 11, characterized in that, Among them, The application interface includes at least 12 buttons, at least 2 buttons include symbols, and at least 10 buttons include numbers.

13. The television usage evaluation system according to claim 12, wherein, Among them, The remote control includes a plurality of physical buttons; The application interface buttons are activatable virtual buttons, where each virtual button is associated with a specific function of the TV decoder; Among them, the application interface buttons are virtual buttons corresponding to the arrangement of the physical buttons of the remote control, such that pressing a physical button on the remote control is configured to activate the corresponding application interface button; The TV decoder is configured to execute the function associated with the activated application interface button.

14. The television usage evaluation system according to claim 13, characterized in that, Among them, The application interface virtual buttons are arranged in a configuration that substantially matches the button configuration of a landline phone, and the remote control physical buttons are arranged in a configuration that substantially matches the button configuration of the landline phone, where the virtual buttons and the physical buttons are the same in configuration.

15. The television usage evaluation system according to claim 14, wherein Among them, The TV decoder is a set-top box, and the camera is integrated in the TV decoder.

16. The television usage evaluation system according to claim 15, wherein Including a speaker, the speaker is operably connected to the TV decoder and is controlled to provide voice commands to the user to guide the user to use the remote control to control the application interface.

17. A remote control used in a television usage evaluation system, characterized in that, Including: A body; A transmitter configured to send a signal to the TV decoder of the TV usage evaluation system; A plurality of physical buttons, where at least 2 of the physical buttons include symbols, and at least 2 of the physical buttons include alphanumeric characters; Among them, activating a physical button causes an input signal to be sent to the TV decoder, so that the TV decoder executes a preset function associated with the button.

18. The remote controller according to claim 17, wherein Among them, The physical buttons include at least 12 buttons; Among them, at least 10 of the buttons each include a number, the numbers are from 0 to 9, and at least 2 of the buttons include different symbols, where one button includes the symbol *, and the other button includes the symbol #.

19. The remote controller according to claim 18, wherein Among them, The physical buttons are arranged in a configuration that matches the configuration of the buttons on a landline phone.

Images