Voice control method, device, terminal device and computer-readable storage medium
By controlling the smart TV with voice, receiving user voice to determine control parameters and thread identifiers, and generating functional control commands, solving the problem that users cannot manually touch or control the remote control, improving the intelligence of the smart TV.
Patent Information
- Application Number
- CN202011326408.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-11-23
- Publication Date
- 2025-07-04
- Estimated Expiration
- 2040-11-23
AI Technical Summary
In some cases, users cannot control smart TVs through manual touch or remote control, resulting in the inability to operate.
Through the voice control method, users' voices are received, control parameters and thread identification are determined, function control commands are generated, smart TVs are controlled to perform operations, and prompt voices are broadcast.
It realizes the intelligence of smart TVs without manual touch or remote control, and can complete operations and broadcast prompt information based on user voice.
Smart Images

Figure CN112435665B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of voice processing, and in particular, to a method and apparatus for controlling voice, a terminal device, and a computer-readable storage medium. Background Art
[0002] Currently, with the rapid development of smart TV technology, smart TVs are becoming more and more widely used, and users are increasingly accustomed to listening to news, watching movies, TV shows, etc. through smart TVs.
[0003] When users need to listen to news, watch movies, TV shows, etc. through a smart TV, they need to manually touch or use a remote control to operate the smart TV. However, in some scenarios, users cannot operate the smart TV through manual touch or the remote control, and thus cannot perform the corresponding operations. Therefore, in such scenarios, users can control the smart TV through voice to perform the corresponding operations. For example, in a cooking scenario, the user's hands are occupied and cannot operate the smart TV through touch or the remote control, and the user can control the smart TV through voice to perform the corresponding operations.
[0004] The above content is only used to assist in understanding the technical solution of the present invention, and does not represent an admission that the above content is prior art. Summary of the Invention
[0005] The main purpose of the present application is to provide a method and apparatus for controlling voice, a terminal device, and a computer-readable storage medium, aiming to improve the intelligence of controlling a smart TV.
[0006] To achieve the above object, an embodiment of the present application provides a method for controlling voice, which is applied to a projection device, and the method for controlling voice includes:
[0007] Respond to a user's start instruction, receive the user's voice based on the start instruction, and determine corresponding control parameters and a thread identifier based on the user's voice;
[0008] Determine a corresponding function control instruction based on the thread identifier, and control the smart TV to perform corresponding operations based on the function control instruction and the control parameters;
[0009] Generate corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice.
[0010] Optionally, the step of determining a corresponding function control instruction based on the thread identifier, and controlling the smart TV to perform corresponding operations based on the function control instruction and the control parameters includes:
[0011] If the function control instruction corresponding to the thread identifier is an application control instruction, determine the application to be operated and the operation instruction corresponding thereto in the control parameters;
[0012] Based on the operation instruction, control the application to be operated to perform the corresponding operation, and control the smart TV to switch the current interface to the interface after the operation instruction is executed.
[0013] Optionally, the step of controlling the application to be operated to perform the corresponding operation based on the operation instruction includes:
[0014] If the operation instruction is an application start instruction, detect whether there is a function name corresponding to the application to be operated in the control parameters;
[0015] If it is detected that there is a function name corresponding to the application to be operated in the control parameters, start the function corresponding to the function name in the application to be operated; or,
[0016] If it is detected that there is no function name corresponding to the application to be operated in the control parameters, start the application to be operated.
[0017] Optionally, the step of determining the corresponding function control instruction based on the thread identifier and controlling the smart TV to perform the corresponding operation based on the function control instruction and the control parameters includes:
[0018] If the function control instruction corresponding to the thread identifier is a channel control instruction, determine the system time in the control parameters, and detect whether the system time is within a preset time;
[0019] If it is detected that the system time is within the preset time, obtain the preset channel information corresponding to the preset time, and control the smart TV to display the preset channel information.
[0020] Optionally, the step of determining the corresponding function control instruction based on the thread identifier and controlling the smart TV to perform the corresponding operation based on the function control instruction and the control parameters includes:
[0021] If the function control instruction corresponding to the thread identifier is an analog remote control instruction, determine the remote control command in the control parameters;
[0022] Based on the remote control command, determine the corresponding target switching interface, and control the smart TV to switch the current interface to the target switching interface.
[0023] Optionally, the step of determining the corresponding function control instruction based on the thread identifier and controlling the smart TV to perform the corresponding operation based on the function control instruction and the control parameters includes:
[0024] If the function control instruction corresponding to the thread identifier is a volume control instruction, determine the target volume value in the control parameters, and control the smart TV to adjust the current volume value to the target volume value.
[0025] Optionally, the step of determining the corresponding control parameter and thread identifier based on the user voice includes:
[0026] Convert the user voice into corresponding descriptive text, and parse the descriptive text according to the text features to obtain the control parameter and the first keyword in the user voice;
[0027] Match the first keyword with the preset keywords in the database, determine the second keyword that matches the first keyword, and determine the target thread identifier corresponding to the second keyword;
[0028] Determine the target thread identifier as the thread identifier corresponding to the user voice.
[0029] An embodiment of the present application further provides a voice control device, where the voice control device includes:
[0030] A receiving module, configured to receive the user voice of the user based on the start instruction in response to the start instruction of the user;
[0031] A determining module, configured to determine the corresponding control parameter and thread identifier based on the user voice;
[0032] The determining module is further configured to determine the corresponding function control instruction based on the thread identifier;
[0033] A control module, configured to control the smart TV to perform corresponding operations based on the function control instruction and the control parameter;
[0034] The control module is further configured to generate corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice.
[0035] An embodiment of the present application further provides a terminal device, where the terminal device includes a memory, a processor, and a voice control program stored on the memory and running on the processor. When the voice control program is executed by the processor, the steps of the voice control method described above are implemented.
[0036] An embodiment of the present application further provides a computer-readable storage medium, where a voice control program is stored on the computer-readable storage medium. When the voice control program is executed by a processor, the steps of the voice control method described above are implemented.
[0037] The voice control method, device, terminal device and computer-readable storage medium provided by the embodiments of the present application respond to a user's start instruction, receive the user's voice based on the start instruction, and determine corresponding control parameters and thread identifiers based on the user's voice; determine corresponding function control instructions based on the thread identifiers, and control an intelligent TV to execute corresponding operations based on the function control instructions and the control parameters; generate corresponding prompt voices based on the execution results corresponding to the operations, and control the intelligent TV to broadcast the prompt voices. It can be seen that in the process of voice control of the present application, corresponding control parameters and thread identifiers are determined according to the received user voice, then corresponding function control instructions are determined according to the thread identifiers, and then the intelligent TV is controlled to execute corresponding operations according to the function control instructions and the control parameters, so that corresponding operations can be controlled without manual touch or remote control. After the corresponding operations are completed, corresponding prompt information is broadcast, improving the intelligence of controlling the intelligent TV. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 is a schematic structural diagram of a terminal device in a hardware operating environment related to the solution of the embodiments of the present application;
[0039] Figure 2 is a schematic diagram of the implementation of the voice control method of the present application;
[0040] Figure 3 is a schematic flowchart of the first embodiment of the voice control method of the present application;
[0041] Figure 4 is a schematic framework diagram of the implementation of the voice control method of the present application;
[0042] Figure 5 is a schematic flowchart of another embodiment of the voice control method of the present application;
[0043] Figure 6 is a schematic flowchart of another embodiment of the voice control method of the present application;
[0044] Figure 7 is a schematic diagram of the functional modules of the voice control device of the main application.
[0045] The implementation, functional features and advantages of the objectives of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0046] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0047] The main solution of the embodiment of the present application is as follows: by responding to the user's startup instruction, receiving the user's voice based on the startup instruction, and determining the corresponding control parameters and thread identifier based on the user's voice; determining the corresponding function control instruction based on the thread identifier, and controlling the smart TV to execute the corresponding operation based on the function control instruction and the control parameters; generating the corresponding prompt voice based on the execution result corresponding to the operation, and controlling the smart TV to broadcast the prompt voice. It can be seen that in the process of voice control of the present application, the corresponding control parameters and thread identifier are determined according to the received user's voice, then the corresponding function control instruction is determined according to the thread identifier, and then the smart TV is controlled to execute the corresponding operation according to the function control instruction and the control parameters, so that the corresponding operation of the smart TV can be controlled without manual touch or remote control. After the corresponding operation is completed, the corresponding prompt information is broadcast, which improves the intelligence of controlling the smart TV.
[0048] Specifically, referring to Figure 1 , Figure 1 is a schematic structural diagram of a terminal device for the hardware operating environment involved in the solution of the embodiment of the present application.
[0049] The terminal device of the embodiment of the present application can be a smart mobile terminal with data processing functions such as a mobile phone or a tablet computer, and can also be a fixed terminal device with data processing functions or a smart TV, etc.
[0050] As Figure 1 shown, the terminal device may include: a processor 1001, such as a CPU (Central Processing Unit, central processor), a memory 1005, a user interface 1003, a network interface 1004, and a communication bus 1002. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (board). Optionally, the user interface 1003 may further include a standard wired interface (such as a USB (Universal Serial Bus, universal serial bus) interface) and a wireless interface (such as a Bluetooth interface). The network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI ((Wireless-Fidelity)) interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001. Optionally, the terminal device may further include an RF (Radio Frequency, radio frequency) circuit, sensors, a WiFi module, etc.
[0051] Those skilled in the art can understand that Figure 1The terminal device structure shown does not limit the terminal device, which may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0052] As Figure 1 shown, in the memory 1005 as a computer storage medium, there may be an operating device, a network communication module, a user interface module, and a control program for voice. Among them, the operating device is a program that manages and controls the hardware and software resources of the terminal device, and supports the operation of the control program for voice and other software or programs.
[0053] In Figure 1 the terminal device shown, the network interface 1004 is mainly used to connect to the background server and communicate with the background server for data; the user interface 1003 is mainly used to connect to the client and communicate with the client for data; among them, the processor 1001 can be used to call the control program for voice stored in the memory 1005 and perform the following operations:
[0054] In response to the user's start instruction, receive the user's voice based on the start instruction, and determine the corresponding control parameters and thread identifier based on the user's voice;
[0055] Determine the corresponding function control instruction based on the thread identifier, and control the smart TV to perform the corresponding operation based on the function control instruction and the control parameters;
[0056] Generate a corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice.
[0057] Further, the processor 1001 can call the control program for voice stored in the memory 1005 and also perform the following operations:
[0058] If the function control instruction corresponding to the thread identifier is an application control instruction, determine the application to be operated and the operation instruction corresponding to the control parameters;
[0059] Control the application to be operated to perform the corresponding operation based on the operation instruction, and control the smart TV to switch the current interface to the interface after the operation instruction is executed.
[0060] Further, the processor 1001 can call the control program for voice stored in the memory 1005 and also perform the following operations:
[0061] If the operation instruction is an application start instruction, detect whether there is a function name corresponding to the application to be operated in the control parameters;
[0062] If a function name corresponding to the to-be-operated application is detected in the control parameter, the function corresponding to the function name in the to-be-operated application is started; or,
[0063] If a function name corresponding to the to-be-operated application is not detected in the control parameter, the to-be-operated application is started.
[0064] Further, the processor 1001 may call the voice control program stored in the memory 1005 and further perform the following operations:
[0065] If the function control instruction corresponding to the thread identifier is a channel control instruction, the system time in the control parameter is determined, and it is detected whether the system time is within a preset time;
[0066] If it is detected that the system time is within the preset time, the preset channel information corresponding to the preset time is obtained, and the smart TV is controlled to display the preset channel information.
[0067] Further, the processor 1001 may call the voice control program stored in the memory 1005 and further perform the following operations:
[0068] If the function control instruction corresponding to the thread identifier is an analog remote control instruction, the remote control command in the control parameter is determined;
[0069] Based on the remote control command, the corresponding target switching interface is determined, and the smart TV is controlled to switch the current interface to the target switching interface.
[0070] Further, the processor 1001 may call the voice control program stored in the memory 1005 and further perform the following operations:
[0071] If the function control instruction corresponding to the thread identifier is a volume control instruction, the target volume value in the control parameter is determined, and the smart TV is controlled to adjust the current volume value to the target volume value.
[0072] Further, the processor 1001 may call the voice control program stored in the memory 1005 and further perform the following operations:
[0073] Convert the user voice into corresponding description text, and parse the description text according to the text features to obtain the control parameter and the first keyword in the user voice;
[0074] Match the first keyword with the preset keywords in the database, determine the second keyword that matches the first keyword, and determine the target thread identifier corresponding to the second keyword;
[0075] Determine the target thread identifier as the thread identifier corresponding to the user voice.
[0076] In an embodiment of the present application, by responding to a user's start instruction, receiving the user's voice based on the start instruction, and determining corresponding control parameters and thread identifiers based on the user voice; determining corresponding function control instructions based on the thread identifiers, and controlling the smart TV to execute corresponding operations based on the function control instructions and control parameters; generating corresponding prompt voices based on the execution results corresponding to the operations, and controlling the smart TV to broadcast the prompt voices. It can be seen that in the process of voice control in the present application, corresponding control parameters and thread identifiers are determined according to the received user voice, then corresponding function control instructions are determined according to the thread identifiers, and then the smart TV is controlled to execute corresponding operations according to the function control instructions and control parameters, so that it is not necessary to manually touch or control with a remote control to control the smart TV to execute corresponding operations. After the corresponding operations are completed, corresponding prompt information is broadcast, which improves the intelligence of controlling the smart TV.
[0077] Based on the above terminal device architecture but not limited to the above architecture, embodiments of the voice control method are provided in the present application. It should be noted that although the logical order is shown in the flowchart, under certain data, the steps shown or described can be completed in a different order from here.
[0078] The execution subject of the method in this embodiment of the present application can be a voice control device or a smart TV. In this embodiment, a smart TV is used as the execution subject for illustration.
[0079] Such as Figure 2 , Figure 2 is a schematic diagram of the implementation of the voice control method of the present application. The participant (user) can perform voice interaction with the smart TV through voice. The participant can control the TV channels, volume, remote control simulation, and application control of the smart TV through voice. Among them, the application control includes starting the corresponding application or starting a certain function corresponding to the application.
[0080] Refer to Figure 3 , Figure 3 is a schematic flowchart of the first embodiment of the voice control method of the present application. The voice control method includes:
[0081] Step S10, respond to the user's start instruction, receive the user's voice based on the start instruction, and determine corresponding control parameters and thread identifiers based on the user voice.
[0082] It should be noted that before the smart TV responds to the user's startup instruction, it is necessary to create a corresponding function control thread in the smart TV. A thread is a scheduling unit that executes corresponding operations. The corresponding function control is started through the thread, and the corresponding thread is bound to its corresponding thread identifier and stored in the smart TV. Threads include but are not limited to volume control threads, channel control threads, and application control threads. The smart TV can be started by continuously calling a preset number of times, where the preset number is set according to requirements and is not limited in this embodiment.
[0083] After the smart TV detects the user's startup instruction, it responds to the user's startup instruction and receives the user's voice through the microphone device in the smart TV. After the smart TV receives the user's voice, it converts the user's voice into corresponding descriptive text, and then analyzes the descriptive text to obtain the keywords and control parameters in the descriptive text. The control parameters include but are not limited to adjusting the volume, switching the interface, and the application name of the application to be operated. Then, the smart TV compares and matches the keywords with the preset keywords in the smart TV to determine the preset keywords in the smart TV that match the keywords. The preset keywords are the keywords bound by the developer according to the thread type. Finally, the smart TV determines the thread identifier corresponding to the preset keyword and determines the thread identifier corresponding to the user's voice.
[0084] In this embodiment, for example, the thread identifier corresponding to the volume control thread is 00x1, and the corresponding keywords are "volume, sound, tone, and speaker, etc.", the thread identifier corresponding to the channel control thread is 00x2, and the corresponding keywords are "channel, program, TV drama, and variety show, etc.". If the user's voice is "Adjust the volume to 60%", the smart TV determines that the thread identifier corresponding to the user's voice is 00x1.
[0085] Step S20: Determine the corresponding function control instruction based on the thread identifier, and control the smart TV to execute the corresponding operation based on the function control instruction and the control parameter.
[0086] After the smart TV determines the thread identifier corresponding to the user's voice, it matches the function control thread corresponding to the thread identifier in the smart TV to determine the function control instruction corresponding to the user's voice. Then, the smart TV determines the control parameters in the user's voice and controls the smart TV to execute the execution operation corresponding to the function control instruction according to the control parameters.
[0087] In this embodiment, for example, the current volume value of the smart TV is "75%", the keywords corresponding to the volume control thread are "volume, sound, tone, speaker, etc.", and the keywords corresponding to the channel control thread are "channel, program, TV drama, variety show, etc.". The user's voice is "Adjust the volume to 60%". The smart TV then determines that the keyword corresponding to the user's voice is "volume", determines the corresponding function control instruction as the volume control instruction according to the keyword "volume", the control parameter is "60%", and adjusts the current volume value "75%" to "60%".
[0088] Step S30: Generate corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice.
[0089] After the smart TV determines that the corresponding execution operation is completed, it determines the corresponding execution result according to the corresponding execution operation, converts the execution result into the corresponding prompt voice, and then controls the voice broadcast module of the smart TV to broadcast the prompt voice. It should be noted that the prompt voice is the natural semantics set by the developer.
[0090] In this embodiment, for example, after the smart TV adjusts the current volume value "75%" to "60%", the smart TV will broadcast the prompt voice "Hello, master, the volume has been adjusted to 60%".
[0091] Further, the step S10 includes:
[0092] Step S101: Convert the user voice into the corresponding description text, and parse the description text according to the text features to obtain the control parameter and the first keyword in the user voice;
[0093] Step S102: Match the first keyword with the preset keywords in the database, determine the second keyword that matches the first keyword, and determine the target thread identifier corresponding to the second keyword;
[0094] Step S103: Determine the target thread identifier as the thread identifier corresponding to the user voice.
[0095] Specifically, after receiving the user voice, the smart TV converts the user voice into the corresponding description text, and then splits the description text according to the text features of the subject, predicate, object, attribute, adverbial, and complement in the text to obtain the keyword and the control parameter in the description text. Then, the smart TV compares and matches the keyword with the preset keywords in the smart TV to determine the target preset keyword that matches the keyword in the preset keywords of the smart TV. Finally, the smart TV determines the thread identifier corresponding to the target preset keyword and determines the thread identifier as the thread identifier corresponding to the user voice.
[0096] Further, the step S20 includes:
[0097] Step S201, if the function control instruction corresponding to the thread identifier is a volume control instruction, determine the target volume value in the control parameter, and control the smart TV to adjust the current volume value to the target volume value.
[0098] Specifically, if the smart TV determines that the function control instruction corresponding to the thread identifier of the user voice is a volume control instruction, the smart TV determines the current volume value of the volume system in the smart TV, then determines the target volume value in the control parameter, and detects whether the current volume value is equal to the target volume value. If the smart TV detects that the current volume value is equal to the target volume value, the smart TV plays the corresponding voice. If the smart TV detects that the current volume value is not equal to the target volume value, the smart TV adjusts the current volume value to the target volume value and plays the corresponding prompt voice.
[0099] Further, the step S20 further includes:
[0100] Step S202, if the function control instruction corresponding to the thread identifier is an analog remote control instruction, determine the remote control command in the control parameter;
[0101] Step S203, based on the remote control command, determine the corresponding target switching interface, and control the smart TV to switch the current interface to the target switching interface.
[0102] Specifically, if the smart TV determines that the function control instruction corresponding to the thread identifier of the user voice is an analog remote control instruction, the smart TV obtains the channel list and the current playing channel of the current interface, and determines the position of the current playing channel in the channel list. Then, the smart TV analyzes the remote control command in the control parameter, and then determines the target playing channel corresponding to the remote control command according to the position of the current playing channel in the channel list, and obtains the target switching interface corresponding to the target playing channel, and finally switches the current interface to the target switching interface.
[0103] In this embodiment, there are the first channel, the second channel, the third channel, and the fourth channel, etc. in the playlist. The current playing channel of the smart TV is the "second channel", and the user voice is "I want to switch to the next channel". Then the smart TV obtains the "third channel" in the channel list and switches the "second channel" to the "third channel".
[0104] Further, as Figure 4 shown Figure 4It is a schematic diagram of the implementation framework of the voice control method of this application. In this embodiment, the background service of the smart TV connects and communicates with the NPAPI plugin, sends an analog remote control instruction to the NPAPI plugin through IPC. After receiving the analog remote control instruction, the NPAPI plugin calls back CROSSUI and realizes switching from the "second channel" to the "third channel" through CROSSUI.
[0105] In this embodiment, by responding to the user's start instruction, receiving the user's voice based on the start instruction, and determining the corresponding control parameters and thread identifier based on the user's voice; determining the corresponding function control instruction based on the thread identifier, and controlling the smart TV to execute the corresponding operation based on the function control instruction and the control parameters; generating the corresponding prompt voice based on the execution result corresponding to the operation, and controlling the smart TV to broadcast the prompt voice. It can be seen that during the voice control process of this application, the corresponding control parameters and thread identifier are determined according to the received user's voice, then the corresponding function control instruction is determined according to the thread identifier, and then the smart TV is controlled to execute the corresponding operation according to the function control instruction and the control parameters, so that the corresponding operation of the smart TV can be controlled without manual touch or remote control. After the corresponding operation is completed, the corresponding prompt information is broadcast, improving the intelligence of controlling the smart TV.
[0106] Refer to Figure 5 , Figure 5 It is a schematic flowchart of another embodiment of the voice control method of this application. In this embodiment, in the above step S20, it further includes:
[0107] Step S204, if the function control instruction corresponding to the thread identifier is an application control instruction, determine the application to be operated and the operation instruction corresponding to the control parameters;
[0108] Step S205, control the application to be operated to execute the corresponding operation based on the operation instruction, and control the smart TV to switch the current interface to the interface after the execution of the operation instruction.
[0109] Specifically, if the smart TV determines that the function control instruction corresponding to the thread identifier of the user voice is an application control instruction, the smart TV determines the application name of the to-be-operated application corresponding to the control parameter and the operation instruction in the control parameter, and then obtains the to-be-operated application in the smart TV according to the application name, and detects the current state of the to-be-operated application. If the smart TV detects that the current state of the to-be-operated application is the unstarted state and the operation instruction is "start application", the smart TV starts the to-be-operated application. If the smart TV detects that the current state of the to-be-operated application is the started state and the operation instruction is "close application", the smart TV closes the to-be-operated application. After the smart TV executes the corresponding operation, it switches the current interface to the interface after the operation instruction is executed.
[0110] In this embodiment, for example, the current interface of the smart TV is the system home page interface, and the user voice is "open the TCL TV software", then the smart TV will display the home page interface of the "TCL TV software" on the system home page interface.
[0111] Further, as Figure 4 shown, Figure 4 is a schematic diagram of the implementation framework of the voice control method of the present application. In this embodiment, the application is an H5 (HTML5) web application. The background service of the smart TV connects and communicates with the NPAPI plugin, sends an application control instruction to the NPAPI plugin through IPC. After receiving the application control instruction, the NPAPI plugin calls back the global JavaScript in the browser, and then starts the H5 web application or the function corresponding to the H5 web application through the global JavaScript.
[0112] Further, the step S205 includes:
[0113] Step S2051, if the operation instruction is an application start instruction, detect whether there is a function name corresponding to the to-be-operated application in the control parameter;
[0114] Step S2052, if it is detected that there is a function name corresponding to the to-be-operated application in the control parameter, start the function corresponding to the function name in the to-be-operated application; or,
[0115] Step S2053, if it is detected that there is no function name corresponding to the to-be-operated application in the control parameter, start the to-be-operated application.
[0116] Specifically, if the smart TV detects that the current state of the application to be operated is the unstarted state and the operation instruction is "start the application", the smart TV then detects whether there is a function name corresponding to the application to be operated in the control parameters. If the smart TV detects that there is a function name corresponding to the application to be operated in the control parameters, the smart TV first starts the application to be operated and then starts the function corresponding to the function name. If the smart TV detects that the current state of the application to be operated is the started state, the smart TV directly starts the function corresponding to the function name. If the smart TV detects that there is no function name corresponding to the application to be operated in the control parameters, the smart TV directly starts the application to be operated. Similarly, the method for closing the application to be operated is the same.
[0117] In this embodiment, if the function control instruction corresponding to the thread identifier is an application control instruction, the application to be operated and the operation instruction corresponding thereto in the control parameters are determined; based on the operation instruction, the application to be operated is controlled to perform the corresponding operation, and the smart TV is controlled to switch the current interface to the interface after the operation instruction is executed. In this embodiment, the user's voice directly performs the corresponding operation on the application to be operated, without the need for manual touch or remote control, improving the intelligence of controlling the smart TV.
[0118] Refer to Figure 6 , Figure 6 is a schematic flowchart of another embodiment of the voice control method of the present application. In this embodiment, in the above step S20, it further includes:
[0119] Step S206, if the function control instruction corresponding to the thread identifier is a channel control instruction, determine the system time in the control parameters and detect whether the system time is within a preset time;
[0120] Step S207, if it is detected that the system time is within the preset time, obtain the preset channel information corresponding to the preset time and control the smart TV to display the preset channel information.
[0121] Specifically, if the smart TV determines that the function control instruction corresponding to the thread identifier of the user voice is a channel control instruction, the smart TV determines the system time in the control parameters and detects whether the system time is within a preset time. The preset time is set according to the user's needs. In this embodiment, the preset time is defaulted to "8:00 to 18:00", that is, defined as daytime, and relatively, "18:01 to 23:59" is defined as nighttime. If the smart TV detects that the system time is within the preset time, that is, within the defined daytime, it obtains the preset channel information corresponding to the preset time, then determines the corresponding weight values according to the playing duration and playing times of each channel in the preset channel information, sorts according to the size of the weight values, and displays the sorted preset channel information on the display screen of the smart TV. Similarly, if the smart TV detects that the system time is outside the preset time, that is, within the defined nighttime, the smart TV performs the same execution operation.
[0122] In this embodiment, for example, the preset channel information corresponding to the preset time is "news, movies, and TV dramas". The playing times of news are 3 times, the playing times of movies are 7 times, and the playing times of TV dramas are 5 times. The preset time is "8:00 to 18:00". The smart TV detects that the system time in the control parameters is "14:08", then the smart TV arranges movies, TV dramas, and news in sequence on the display screen of the smart TV.
[0123] In this embodiment, if the function control instruction corresponding to the thread identifier is a channel control instruction, it determines the system time in the control parameters and detects whether the system time is within the preset time; if it detects that the system time is within the preset time, it obtains the preset channel information corresponding to the preset time and controls the smart TV to display the preset channel information. In this embodiment, the user can directly perform corresponding operations on the channel through voice without manual touch or remote control, which improves the intelligence of controlling the smart TV.
[0124] This application also provides a voice control device. Refer to Figure 7 , Figure 7 which is a schematic diagram of the voice control device of this application. The voice control device includes:
[0125] A receiving module 10, configured to respond to a user's start instruction and receive the user's voice based on the start instruction;
[0126] A determining module 20, configured to determine corresponding control parameters and thread identifiers based on the user voice;
[0127] The determining module 20 is further configured to determine a corresponding function control instruction based on the thread identifier;
[0128] A control module 30, configured to control the smart TV to perform corresponding operations based on the function control instruction and the control parameter;
[0129] The control module 30 is further configured to generate corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice.
[0130] Wherein, the function implementation of each module in the above voice control device corresponds to each step in the above voice control method embodiment, and its function and implementation process will not be described in detail here.
[0131] The present invention further provides a computer-readable storage medium, on which a voice control program is stored. When the voice control program is executed by a processor, the steps of the voice control method described in any one of the above embodiments are implemented.
[0132] The specific embodiments of the computer-readable storage medium of the present invention are basically the same as those of the above voice control method embodiments, and will not be described in detail here.
[0133] It should be noted that, in this article, the terms "include", "comprise" or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device including a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element.
[0134] The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.
[0135] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal device to complete the methods described in various embodiments of the present application.
Claims
1. A method for controlling voice, characterized in that, The control method for the voice includes: Responding to a start instruction of a user, receiving the user's voice based on the start instruction, and determining corresponding control parameters and a thread identifier based on the user's voice; Determining a corresponding function control instruction based on the thread identifier, and controlling the smart TV to perform corresponding operations based on the function control instruction and the control parameters; The step of determining a corresponding function control instruction based on the thread identifier, and controlling the smart TV to perform corresponding operations based on the function control instruction and the control parameters includes: If the function control instruction corresponding to the thread identifier is a channel control instruction, determining the system time in the control parameters, and detecting whether the system time is within a preset time; If it is detected that the system time is within the preset time, obtaining preset channel information corresponding to the preset time, determining corresponding weight values according to the playing duration and playing times of each channel in the preset channel information, sorting according to the magnitudes of the weight values, and displaying the sorted preset channel information on the display screen of the smart TV; Generating corresponding prompt voice based on the execution result of the operation, and controlling the smart TV to broadcast the prompt voice; Among them, the step of determining corresponding control parameters and a thread identifier based on the user's voice includes: Converting the user's voice into corresponding descriptive text, and splitting the descriptive text according to the text features of subject, predicate, object, attribute, adverbial, and complement to obtain the control parameters and a first keyword in the user's voice; Matching the first keyword with preset keywords in a database, determining a second keyword that matches the first keyword, and determining a target thread identifier corresponding to the second keyword; Determining the target thread identifier as the thread identifier corresponding to the user's voice; If the function control instruction corresponding to the thread identifier is an application control instruction, determining the application to be operated and an operation instruction corresponding in the control parameters; If the operation instruction is an application start instruction, detecting whether there is a function name corresponding to the application to be operated in the control parameters; Performing corresponding operations according to the detection result of whether there is a function name corresponding to the application to be operated in the control parameters; If the function control instruction corresponding to the thread identifier is a simulated remote control instruction, determining a remote control command in the control parameters; Determining a corresponding target switching interface based on the remote control command, and controlling the smart TV to switch the current interface to the target switching interface.
2. The voice control method according to claim 1, wherein The step of performing corresponding operations according to the detection result of whether there is a function name corresponding to the application to be operated in the control parameters includes: If it is detected that there is a function name corresponding to the application to be operated in the control parameters, starting the function corresponding to the function name in the application to be operated; or If it is detected that there is no function name corresponding to the application to be operated in the control parameters, starting the application to be operated.
3. The voice control method according to claim 1, characterized in that The control method for the voice further includes: If the function control instruction corresponding to the thread identifier is a volume control instruction, determine the target volume value in the control parameter, and control the smart TV to adjust the current volume value to the target volume value.
4. A voice control device, characterized in that, The control device for the voice includes: A receiving module, configured to respond to a start instruction of a user, and receive the user voice of the user based on the start instruction; A determining module, configured to determine a corresponding control parameter and a thread identifier based on the user voice; Wherein, the determining module includes a splitting sub-module, a matching sub-module, and an identifier determining sub-module; The splitting sub-module is configured to convert the user voice into corresponding descriptive text, and split the descriptive text according to the text features of the subject, predicate, object, attribute, adverbial, and complement to obtain the control parameter and the first keyword in the user voice; The matching sub-module is configured to match the first keyword with a preset keyword in a database, determine a second keyword that matches the first keyword, and determine a target thread identifier corresponding to the second keyword; The identifier determining sub-module is configured to determine the target thread identifier as the thread identifier corresponding to the user voice; The determining module is further configured to determine a corresponding function control instruction based on the thread identifier; A control module, configured to control the smart TV to perform a corresponding operation based on the function control instruction and the control parameter; Wherein, the control module includes a determining sub-module and a sorting sub-module; The determining sub-module is configured to, if the function control instruction corresponding to the thread identifier is a channel control instruction, determine the system time in the control parameter, and detect whether the system time is within a preset time; The sorting sub-module is configured to, if it is detected that the system time is within the preset time, obtain the preset channel information corresponding to the preset time, determine corresponding weight values according to the playing duration and playing times of each channel in the preset channel information, sort according to the magnitude of the weight values, and display the sorted preset channel information on the display screen of the smart TV; The control module is further configured to generate a corresponding prompt voice based on the execution result corresponding to the operation, and control the smart TV to broadcast the prompt voice; The control module is further configured to, if the function control instruction corresponding to the thread identifier is an application control instruction, determine the to-be-operated application and the operation instruction corresponding in the control parameter; The control module is further configured to, if the operation instruction is an application start instruction, detect whether there is a function name corresponding to the to-be-operated application in the control parameter; The control module is further configured to perform a corresponding operation according to the detection result of whether there is a function name corresponding to the to-be-operated application in the control parameter; The control module is further configured to, if the function control instruction corresponding to the thread identifier is a simulated remote control instruction, determine the remote control command in the control parameter; The control module is further configured to determine a corresponding target switching interface based on the remote control command, and control the smart TV to switch the current interface to the target switching interface.
5. A terminal device, characterized in that, The terminal device includes a memory, a processor, and a voice control program stored on the memory and running on the processor. When the voice control program is executed by the processor, it implements the steps of the voice control method according to any one of claims 1 to 3.
6. A computer-readable storage medium, characterized in that, A voice control program is stored on the computer-readable storage medium. When the voice control program is executed by a processor, it implements the steps of the voice control method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Method and device for controlling electrical device, equipment, and storage medium
CN108376543A
Resource pushing method and device for intelligent device and storage medium
CN109698858A
Method for speech recognition and related device
CN110176227A
Control method and device based on voice simulation remote controller and electronic equipment
CN111754996A