Voice interaction method and device for display interface and electronic equipment

Abstract

The invention provides a voice interaction method and device for a display interface and electronic equipment, and relates to the technical field of voice recognition processing, and the method comprises the steps: receiving a voice wake-up instruction of a user; determining all to-be-interacted objects which can be subjected to response operation from a current display picture of the display equipment, amplifying all the to-be-interacted objects under the condition that all the to-be-interacted objects are text information and the word number of each piece of text information is smaller than a preset word number, and displaying all the amplified interaction objects; receiving and identifying a first input voice of a user; and determining a target interaction object according to the first input voice, and executing a response operation corresponding to the target interaction object. According to the method and the device, the character information is amplified, so that a user can conveniently select through voice, the user can more intuitively and conveniently interact with a display interface through voice, the operation step of digital identification rendering is reduced, and the operation burden of a processor is reduced.

Description

Technical Field

[0001] The present invention relates to the field of speech recognition processing technology, and in particular to a speech interaction method, device and electronic equipment for a display interface. Background Art

[0002] With the popularity of smart TVs, voice control of TVs through remote controls has become very common. However, usually, the voice control of the remote control needs to respond on a specific smart TV platform, or the voice content needs to be targeted at certain specific film and television titles, and the common operations defined by the current platform under the established scenario to be effective. However, it is impossible to make flexible voice control for the business logic in the specific page that the user is currently seeing. Because each page on the TV displays different content and the content provider is different, after connecting to the Internet, it is difficult to summarize the specific operations on various different pages and respond to the operations through certain agreed voices.

[0003] The Chinese invention patent with the application publication number CN 114627870 A and the invention name is a method, device and intelligent terminal for realizing digital superscript based on voice recognition, which discloses a method, device and intelligent terminal for realizing digital superscript based on voice recognition. The method includes: searching for all multiple operable focus areas of the current interface according to a voice wake-up instruction; marking all multiple operable focus areas of the current interface with different digital superscripts in turn, and establishing a corresponding relationship between the marked digital superscript and the operation instruction to start the corresponding focus area; parsing the corresponding digital superscript according to the digital voice instruction, and controlling the focus area where the parsed digital superscript is located to perform the corresponding operation. However, its specific application scenario is limited by the website content and the interactive platform, and does not take into account the complexity of the text information of the object to be interacted with that can be executed with the response operation in different pages. If the number of words is small, the above operation will still be performed, which will increase the overall operation process due to the increase of the page rendering step of the digital superscript, and increase the processor operation burden. At the same time, it does not take into account the situation where there is a secondary display interface in the display interface, which makes the overall process operation complicated.

[0004] In summary, there is currently no technical solution that can solve the above technical problems, and there is no voice interaction method, device, and electronic device for a display interface. Summary of the invention

[0005] The present invention provides a voice interaction method, device and electronic device for a display interface, which can select different voice recognition processing modes according to the display images of different pages, which not only improves the page display fluency, but also realizes voice interaction of non-text information.

[0006] In a first aspect, the present invention provides a voice interaction method for a display interface, comprising: Receiving a voice wake-up instruction from a user, wherein the voice wake-up instruction is determined by pressing a voice button of an interactive device, wherein the interactive device is communicatively connected to a display device; In response to the voice wake-up instruction, all objects to be interacted with that can be subjected to a response operation are determined from a current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, all objects to be interacted with are enlarged, and all enlarged interactive objects are displayed; receiving and recognizing a first input voice of a user, where the first input voice is determined after the user selects all the magnified interactive objects; A target interaction object is determined according to the first input voice, and a response operation corresponding to the target interaction object is performed.

[0007] According to the voice interaction method of the display interface provided by the present invention, after all objects to be interacted with that can be subjected to response operations are determined from the current display screen of the display device, the method further includes: When all objects to be interacted with include text information and non-text information, or when all objects to be interacted with are non-text information, or when the number of characters in any text information is greater than or equal to the preset number of characters, a digital identifier is displayed within a preset range of each object to be interacted with; receiving and recognizing a second input voice of a user to determine the target interaction object according to the second input voice, wherein the second input voice is determined after the user selects all digital identifiers; The non-text information includes icon information and character information, and each object to be interacted with corresponds to a different digital identifier.

[0008] According to the voice interaction method for a display interface provided by the present invention, the second input voice is obtained by continuously pressing a voice button of the interactive device after a voice wake-up instruction is generated; After displaying the digital identification within the preset range of each object to be interacted with, the method further includes: Displaying all digital identifiers in a display interface of the interactive device; Receiving a first input instruction from a user, wherein the first input instruction is determined after pressing a voice button of an interactive device and sliding to a display area corresponding to a target digital identifier and then stopping the pressing; In response to the first input instruction, generating a first instruction, wherein the first instruction is used to instruct the display device to perform a response operation on the object to be interacted with corresponding to the target digital identifier; Send the first instruction to the display device.

[0009] According to the voice interaction method of the display interface provided by the present invention, before or after displaying a digital identification within a preset range of each object to be interacted with, the method further includes: Receiving a second input instruction from the user, the second input instruction being determined by sliding a finger along a preset path after pressing a voice button of the interactive device, and continuously pressing the button for a preset time; For each object to be interacted with, if there is a secondary display interface for the object to be interacted with, determine all secondary interactive objects in the secondary display interface that can be subjected to a response operation, wherein the secondary display interface is a drop-down interface that is expanded when the object to be interacted with is about to be selected; Digitally labeling all secondary interactive objects, and displaying all secondary labels in the secondary display interface of the interactive device; Among them, each secondary identification is different, each secondary identification is different from each digital identification, and the preset path includes clockwise sliding, counterclockwise sliding or straight sliding.

[0010] According to the voice interaction method of the display interface provided by the present invention, the displaying of a digital identifier within a preset range of each object to be interacted with comprises: Display a digital logo in the upper left corner of the preset range of any object to be interacted with; Alternatively, a digital identifier is displayed in the upper right corner of a preset range of any object to be interacted with; Alternatively, a digital identifier is displayed at the lower left corner within a preset range of any object to be interacted with; Alternatively, a digital identification is displayed at the lower right corner within a preset range of any object to be interacted with.

[0011] According to the voice interaction method for a display interface provided by the present invention, determining a target interaction object according to the first input voice and executing a response operation corresponding to the target interaction object include: Acquire all voices from the time when a voice button of the interactive device is pressed to the time when the voice button of the interactive device is released, and determine all the voices as the first input voice; The first input voice is recognized to obtain recognized text, the target interaction object is determined from all objects to be interacted with according to the recognized text, and a response operation corresponding to the target interaction object is executed.

[0012] According to the voice interaction method for a display interface provided by the present invention, the current display screen of the display device also includes a cursor, and the step of determining a target interaction object according to the first input voice and executing a response operation corresponding to the target interaction object includes: Determine a target interactive object according to the first input voice, and generate a second instruction, wherein the second instruction is used to instruct the cursor to move from the current position of the cursor to the position of the target interactive object and display a confirmation box; receiving a third input instruction from a user, wherein the third input instruction is confirmed after a response operation is performed in the to-be-confirmed box using an interactive key of the interactive device; In response to the third input instruction, a response operation corresponding to the target interactive object is executed.

[0013] According to the voice interaction method of the display interface provided by the present invention, when the currently displayed screen is a video playback screen, the response operation includes a jump operation and a non-jump operation. The jump operation is used to jump to the next playback interface, and the target interaction object corresponding to the non-jump operation includes at least a playback operation displayed by an icon or text, a pause operation, a volume adjustment operation, a barrage adjustment operation, a multiple adjustment operation, a full-screen adjustment operation, a login operation, a logout operation, a window closing operation, a like operation, and a favorite operation.

[0014] In a second aspect, a voice interaction device for a display interface is provided, comprising: a first receiving unit, the first receiving unit being used to receive a voice wake-up instruction of a user, the voice wake-up instruction being determined after pressing a voice button of an interactive device, wherein the interactive device is communicatively connected with a display device; A response unit, the response unit being used to respond to the voice wake-up instruction, determine all objects to be interacted with that can be subjected to a response operation from a current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, enlarge all objects to be interacted with, and display all enlarged interactive objects; a second receiving unit, the second receiving unit being configured to receive and recognize a first input voice of a user, where the first input voice is determined after the user selects all the amplified interactive objects; An execution unit, wherein the execution unit is used to determine a target interaction object according to the first input voice, and execute a response operation corresponding to the target interaction object.

[0015] In a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements a voice interaction method of the display interface when executing the program.

[0016] The present invention realizes activating the voice interaction function through a voice wake-up command, and automatically identifies all text information in the display interface that can be responded to. When the number of words in the text information is less than a preset number of words, the text information is amplified to facilitate the user to select through voice. This not only enables the user to interact with the display interface more intuitively and conveniently through voice, but also reduces the operation steps required for digital logo rendering, thereby reducing the operating burden of the processor. The digital identifier is only displayed when the object to be interacted with contains content such as icons or characters that cannot be voice-recognized, or the number of words in the text information is greater than or equal to the preset number of words, so that the user can quickly locate and select the target object through digital identifiers and voice input even when faced with a complex display interface; the user is allowed to display all digital identifiers in the display interface of the interactive device by sliding his finger while continuously pressing the voice button, and select the target digital identifier, which improves the flexibility of user operation and allows the user to further digitally identify and select the object to be interacted with that has a secondary display interface, thereby reducing the complexity of the overall interaction process. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a flow chart of the voice interaction method of the display interface provided by the present invention; Figure 2 It is a structural schematic diagram of the voice interaction device of the display interface provided by the present invention; Figure 3 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] Figure 1 : is a flow chart of a voice interaction method for a display interface provided by the present invention, wherein the voice interaction method for a display interface comprises: Step 101: receiving a voice wake-up command from a user, wherein the voice wake-up command is determined by pressing a voice button of an interactive device, wherein the interactive device is communicatively connected to a display device; Step 102: In response to the voice wake-up instruction, all objects to be interacted with that can be subjected to a response operation are determined from the current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, all objects to be interacted with are enlarged, and all enlarged interactive objects are displayed; Step 103: receiving and recognizing a first input voice of a user, where the first input voice is determined after the user selects all the amplified interactive objects; Step 104: determine a target interaction object according to the first input voice, and execute a response operation corresponding to the target interaction object.

[0021] In step 101, in the present invention, the interactive device can be an intelligent terminal with a touch screen, and the display device can be a computer display screen, a TV display screen, etc. The interactive device can realize data interaction with the display device through preset application software. The user presses the voice button of the interactive device. The voice button is a virtual button. The specific position may vary according to the design of the device and can be designed to be located at the lower part of the screen. The built-in microphone of the interactive device starts to receive the user's voice input and converts it into a digital signal for processing. After pressing the voice button of the interactive device, the voice wake-up instruction is determined. The interactive device can pre-process the received voice signal, including denoising, filtering, etc., to improve the accuracy of voice recognition, and then use voice recognition technology to recognize the pre-processed voice signal and parse the user's voice wake-up instruction. The present invention activates the voice interaction function by pressing the voice button, which is simple to operate and easy for users to master.

[0022] In step 102, the interactive device establishes a wake-up response with the display device according to the voice wake-up instruction, obtains the content of the current display screen, and parses the content in the current display screen to identify all objects to be interacted with that can be subjected to response operations. These objects to be interacted with may include text information, icons, buttons, etc. If all objects to be interacted with are text information, and the number of words in each text information is less than a preset number of words, for example, the preset number of words is within 5 words, then the interactive device amplifies all objects to be interacted with to facilitate user selection and operation. The present invention amplifies all qualified objects to be interacted with, thereby improving the visibility and operability of these objects for the user, and limits the subsequent processing of text information within a certain number of words, which not only takes into account the recognition failure that may be caused when the user inputs a long sentence by voice, but also ensures that the user does not need to speak a large amount of voice in this mode, thereby improving the efficiency of voice interaction.

[0023] In another case considered by the present invention, if all objects to be interacted with include not only text information but also other information, or the number of characters in the text information is greater than or equal to the preset number of characters, all objects to be interacted with that meet the conditions will not be enlarged, and specifically, the following steps will be performed: After all objects to be interacted with that can be subjected to response operations are determined from the current display screen of the display device, the method further includes: When all objects to be interacted with include text information and non-text information, or when all objects to be interacted with are non-text information, or when the number of characters in any text information is greater than or equal to the preset number of characters, a digital identifier is displayed within a preset range of each object to be interacted with; receiving and recognizing a second input voice of a user to determine the target interaction object according to the second input voice, wherein the second input voice is determined after the user selects all digital identifiers; The non-text information includes icon information and character information, and each object to be interacted with corresponds to a different digital identifier.

[0024] Optionally, the method first determines all objects to be interacted with that can be subjected to response operations in the current display screen. These objects to be interacted with may include text information and non-text information, or may all be non-text information. For objects to be interacted with that contain text information, if the number of words in any text information is greater than or equal to a preset number of words, the display logic in this method will also be triggered. Specifically, when one of the above conditions is met, that is, there is a mixture of text and non-text information, all are non-text information, or the number of words in at least one text information reaches a preset threshold, a digital identifier is displayed for each object to be interacted with within its preset range. The digital identifier is used to uniquely identify each object to be interacted with, so that the user can select it through voice commands.

[0025] At this time, the system receives and recognizes the user's second input voice, and determines the target object the user wants to interact with based on the recognition result. The target object here is determined by the digital identifier mentioned in the user's voice. The present invention is different from the prior art and aims to deal with the complex and changeable elements in the display scene. The interactive object of the processed display screen is a mixture of unspecific text and non-text information, or the number of words in the text information is uncertain. How to solve the technical problem of how to improve the efficiency of voice interaction as much as possible for each different situation. Non-text information includes icon information and character information, which means that in addition to plain text, users can also interact with graphic elements such as icons and buttons, and digitally identify each object to be interacted with to ensure the accuracy of the voice command. Finally, the user determines the second input voice after selecting all digital identifiers, receives and recognizes the user's second input voice, and determines the target interactive object based on the second input voice.

[0026] The voice interaction method of the present invention is more friendly and convenient for users with limited vision or who do not like to use traditional input methods. In particular, in interfaces with dense text information or containing multiple types of information, the introduction of digital identifiers greatly improves the user's selection accuracy and speed. The method can handle complex interfaces containing different types of information, whether it is pure non-text information, a mixture of text and non-text information, or long text information, all can be uniformly managed through digital identifiers.

[0027] Optionally, the second input voice is obtained by continuously pressing a voice button of the interactive device after the voice wake-up instruction is generated; After displaying the digital identification within the preset range of each object to be interacted with, the method further includes: Displaying all digital identifiers in a display interface of the interactive device; Receiving a first input instruction from a user, wherein the first input instruction is determined after pressing a voice button of an interactive device and sliding to a display area corresponding to a target digital identifier and then stopping the pressing; In response to the first input instruction, generating a first instruction, wherein the first instruction is used to instruct the display device to perform a response operation on the object to be interacted with corresponding to the target digital identifier; Send the first instruction to the display device.

[0028] Optionally, after the user generates a voice wake-up command and continuously presses the voice button of the interactive device, the system starts to receive and recognize the user's second input voice. After determining all objects to be interacted with and assigning digital identifiers to them, the system will display these digital identifiers in the display interface of the interactive device, so that the user can intuitively see the numbers corresponding to each object to be interacted with, which is convenient for subsequent selection and operation. The user can slide his finger on the touch screen of the interactive device from the position where the voice button is pressed to the display area corresponding to the target digital identifier, and then stop pressing to determine the target digital identifier. In such an embodiment, the present invention will synchronously display all objects to be interacted with on the interactive device after displaying them and assigning them digital identifiers. In the display interface of the device, each digital identifier corresponding to all objects to be interacted with is synchronously displayed in an arrangement order from left to right and from top to bottom. For example, when a voice button is pressed, the finger is slid from the position where the voice button is pressed to the display area corresponding to the target digital identifier in the display interface of the interactive device, and then the finger is released to complete the selection of the target digital identifier in the interactive device without adopting the form of voice input. The system responds to the user's first input instruction (determined by sliding and stopping pressing) and generates a first indication instruction for instructing the display device to perform a response operation of the object to be interacted with corresponding to the target digital identifier, and then sends the first indication instruction to the display device to perform the corresponding operation.

[0029] Optionally, all digital identifiers are displayed in the display interface so that the user can intuitively see the numbers corresponding to each object to be interacted with. The present invention combines the two interaction modes of touch and voice to provide a more natural and intuitive interaction experience. Since the wake-up voice command can be completed by pressing, and the user can select the target digital identifier by sliding the finger, that is, in fact, the present invention can also solve some interaction problems that exist during use due to the temporary inability to use voice interaction, such as the user cannot speak, the voice recognition is inaccurate, the voice input is not smooth, and the "second voice input" cannot be normally implemented. Using this embodiment, the target digital identifier can be determined without "second voice input".

[0030] Optionally, before or after displaying a digital identifier within a preset range of each object to be interacted with, the method further includes: Receiving a second input instruction from the user, the second input instruction being determined by sliding a finger along a preset path after pressing a voice button of the interactive device, and continuously pressing the button for a preset time; For each object to be interacted with, if there is a secondary display interface for the object to be interacted with, determine all secondary interactive objects in the secondary display interface that can be subjected to a response operation, wherein the secondary display interface is a drop-down interface that is expanded when the object to be interacted with is about to be clicked; Digitally labeling all secondary interactive objects, and displaying all secondary labels in the secondary display interface of the interactive device; Among them, each secondary identification is different, each secondary identification is different from each digital identification, and the preset path includes clockwise sliding, counterclockwise sliding or straight sliding.

[0031] Optionally, the user presses the voice button of the interactive device and slides the finger along a preset path, which includes clockwise sliding, counterclockwise sliding or straight sliding, and continues to press for a preset time, thereby triggering a second input instruction. This input method combines the three dimensions of virtual buttons, finger sliding and continuous pressing time, providing users with a more flexible and intuitive interaction method. After receiving the second input instruction, the system will parse and process it according to the preset logic to trigger subsequent operation procedures.

[0032] Furthermore, for each object to be interacted with, the system first determines whether it has a secondary display interface. The secondary display interface is usually a drop-down interface that expands when the object to be interacted with is clicked or the cursor is moved to the object to be interacted with, which contains more detailed information or additional operation options. If the object to be interacted with has a secondary display interface, the system will further determine all secondary interactive objects in the interface that can be responded to. These secondary interactive objects may be text information, icons, buttons, links or other interactive elements. The system digitally identifies all secondary interactive objects to ensure that each secondary interactive object has a unique digital identifier. These digital identifiers will be displayed in the secondary display interface so that the user can intuitively see and select the required secondary interactive object, wherein each secondary identifier is different, and each secondary identifier is also different from each digital identifier to ensure the uniqueness of all identifiers.

[0033] By introducing the diversity of second input instructions and preset paths, the present invention enables users to trigger operations on secondary interactive objects in a more flexible and intuitive manner. Users can clearly see each object to be interacted with and its corresponding secondary interactive object, thereby more accurately selecting the desired operation options. Since each secondary interactive object has a unique digital identifier, and is different from the digital identifier of the primary object to be interacted with, users can more accurately select the desired operation object. In the operation mode that does not adopt this embodiment, the user needs to determine any object to be interacted with that has a secondary display interface, select the object to be interacted with, and then display the secondary display interface of the object to be interacted with on the display device, and further regenerate the digital identifier of each secondary interactive object in the secondary display interface, and select the secondary interactive object again. However, by utilizing this embodiment, the present invention can directly complete the task that originally required two steps in only one step, thereby reducing the complexity of interactive operations and improving interactive efficiency.

[0034] Optionally, displaying a digital identifier within a preset range of each object to be interacted with includes: Display a digital logo in the upper left corner of the preset range of any object to be interacted with; Alternatively, a digital identifier is displayed in the upper right corner of a preset range of any object to be interacted with; Alternatively, a digital identifier is displayed at the lower left corner within a preset range of any object to be interacted with; Alternatively, a digital identification is displayed at the lower right corner within a preset range of any object to be interacted with.

[0035] Optionally, the present invention can display digital logos in any of the above-mentioned ways, but it is necessary to ensure that the digital logos are clearly visible and do not obstruct the key information of the object. If there is any obstruction, it can be adjusted to display in other orientations. By reasonably displaying digital logos in different positions, it is possible to avoid obstruction of key information, thereby speeding up the user's identification and selection of objects to be interacted with.

[0036] In step 103, after all objects to be interacted with are magnified and displayed, the user selects the desired object through voice, for example, the user can input "next episode", "settings", "bullet screen", etc. by voice, and the interactive device continues to receive the user's voice input, that is, the first input voice. The interactive device preprocesses and performs voice recognition on the first input voice to parse out the target interactive object selected by the user.

[0037] In step 104, the interactive device determines the target interactive object selected by the user according to the parsed first input voice, and performs a corresponding response operation according to the type of the target interactive object. For example, if the target interactive object is an icon, a click operation is performed; if the target interactive object is a link, a jump operation is performed, etc. The interactive device feeds back the execution result to the display device to update the content of the current display screen.

[0038] Optionally, determining a target interaction object according to the first input voice and performing a response operation corresponding to the target interaction object includes: Acquire all voices from the time when a voice button of the interactive device is pressed to the time when the voice button of the interactive device is released, and determine all the voices as the first input voice; The first input voice is recognized to obtain recognized text, the target interaction object is determined from all objects to be interacted with according to the recognized text, and a response operation corresponding to the target interaction object is executed.

[0039] Optionally, by monitoring the pressing and releasing states of the voice button, the complete voice information of the user input can be accurately captured. This method avoids recognition errors or operation failures caused by accidental truncation of the voice input. The voice is converted into text content using voice recognition technology. Based on the recognized text content, the target object that matches the user's instruction or request is screened out from all objects to be interacted with. Once the target object is determined, the corresponding response operation is executed.

[0040] Optionally, the current display screen of the display device further includes a cursor, and the determining a target interaction object according to the first input voice and performing a response operation corresponding to the target interaction object includes: Determine a target interactive object according to the first input voice, and generate a second instruction, wherein the second instruction is used to instruct the cursor to move from the current position of the cursor to the position of the target interactive object and display a confirmation box; receiving a third input instruction from a user, wherein the third input instruction is confirmed after a response operation is performed in the to-be-confirmed box using an interactive key of the interactive device; In response to the third input instruction, a response operation corresponding to the target interactive object is executed.

[0041] Optionally, the system first determines the target interactive object based on the user's first input voice. The present invention utilizes the voice recognition and parsing process to convert the voice into understandable text or commands. Once the target interactive object is determined, the system generates a second indication instruction to guide the cursor to move from the current position to the position of the target interactive object. The cursor is usually a visual indicator used to indicate the user's current focus or selection on the screen. After the cursor is moved, the system will display a confirmation box at the position of the target interactive object. This confirmation box may be a highlighted area, border or other visual mark to remind the user that the object has been selected and is ready to perform an operation. Next, the system waits for the user's third input instruction. The third input instruction is input through the interactive key of the interactive device to confirm the operation on the target interactive object. It can be a physical key or a virtual key. Once the user's third input instruction is received, the system will execute a response operation corresponding to the target interactive object. Through the confirmation mechanism of the confirmation box and the third input instruction, the present invention can reduce erroneous operations caused by voice recognition errors or unclear user intentions.

[0042] Optionally, when the currently displayed screen is a video playback screen, the response operation includes a jump operation and a non-jump operation. The jump operation is used to jump to the next playback interface, and the target interactive object corresponding to the non-jump operation includes at least a playback operation displayed by an icon or text, a pause operation, a volume adjustment operation, a barrage adjustment operation, a multiple adjustment operation, a full-screen adjustment operation, a login operation, a logout operation, a window closing operation, a like operation, and a favorite operation.

[0043] Optionally, in addition to the case where the current display screen is the video playback screen, there may be other display screens. For example, in the current display screen of the "main interface / home page", the target interaction objects may include application icons (such as shortcuts to applications such as news, music, and games), search boxes, user avatars (used to access personal centers), setting icons, etc., and response operations include opening applications, searching for content, entering personal centers to view information or settings, adjusting interface layouts or themes, etc.; in the current display screen of the "message notification interface", the target interaction objects include unread message notifications, friend requests, system prompts, etc., and response operations include viewing message details, replying to messages, accepting or rejecting friend requests, clearing notifications, etc.; in the current display screen of the "music playback interface", the target interaction objects include playlists, song covers, progress bars, volume icons, play / pause buttons, next / previous buttons, etc., and response operations include switching songs, Adjust playback progress, adjust volume, play / pause music, fast forward / rewind, etc.; in the current display screen of the "game interface", the target interactive objects include game characters, prop icons, task prompts, setting buttons, exit buttons, etc., and response operations include controlling character movement or attack, using props, viewing or accepting tasks, adjusting game settings, exiting the game, etc.; in the current display screen of the "e-book reading interface", the target interactive objects include page turning buttons, directory buttons, bookmark icons, font size adjustment buttons, brightness adjustment sliders, etc., and response operations include turning pages, viewing directories, adding or deleting bookmarks, adjusting font size, adjusting screen brightness, etc. In the current display screen of the "shopping application interface", the target interactive objects include product pictures or lists, shopping cart icons, search boxes, coupon buttons, settlement buttons, etc., and response operations include viewing product details, adding to shopping carts, searching for products, receiving coupons, and settling purchases.

[0044] The present invention realizes activating the voice interaction function through a voice wake-up command, and automatically identifies all text information in the display interface that can be responded to. When the number of words in the text information is less than a preset number of words, the text information is amplified to facilitate the user to select through voice. This not only enables the user to interact with the display interface more intuitively and conveniently through voice, but also reduces the operation steps required for digital logo rendering, thereby reducing the operating burden of the processor. The digital identifier is only displayed when the object to be interacted with contains content such as icons or characters that cannot be voice-recognized, or the number of words in the text information is greater than or equal to the preset number of words, so that the user can quickly locate and select the target object through digital identifiers and voice input even when faced with a complex display interface; the user is allowed to display all digital identifiers in the display interface of the interactive device by sliding his finger while continuously pressing the voice button, and select the target digital identifier, which improves the flexibility of user operation and allows the user to further digitally identify and select the object to be interacted with that has a secondary display interface, thereby reducing the complexity of the overall interaction process.

[0045] Figure 2 It is a structural schematic diagram of the voice interaction device of the display interface provided by the present invention, the voice interaction device of the display interface includes a first receiving unit 1, the first receiving unit is used to receive the user's voice wake-up command, the voice wake-up command is determined after pressing the voice button of the interactive device, wherein the interactive device is communicatively connected with the display device, the working principle of the first receiving unit 1 can refer to the aforementioned step 101, and will not be repeated here.

[0046] The voice interaction device of the display interface also includes a response unit 2, which is used to respond to the voice wake-up instruction, determine all objects to be interacted with that can be subjected to a response operation from the current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, all objects to be interacted with are enlarged, and all enlarged interactive objects are displayed. The working principle of the response unit 2 can refer to the aforementioned step 102 and will not be repeated here.

[0047] The voice interaction device of the display interface also includes a second receiving unit 3, which is used to receive and recognize the user's first input voice. The first input voice is determined after the user selects all enlarged interactive objects. The working principle of the second receiving unit 3 can refer to the aforementioned step 103 and will not be repeated here.

[0048] The voice interaction device of the display interface also includes an execution unit 4, which is used to determine the target interaction object according to the first input voice and execute a response operation corresponding to the target interaction object. The working principle of the execution unit 4 can refer to the aforementioned step 104 and will not be repeated here.

[0049] The present invention realizes activating the voice interaction function through a voice wake-up command, and automatically identifies all text information in the display interface that can be responded to. When the number of words in the text information is less than a preset number of words, the text information is amplified to facilitate the user to select through voice. This not only enables the user to interact with the display interface more intuitively and conveniently through voice, but also reduces the operation steps required for digital logo rendering, thereby reducing the operating burden of the processor. The digital identifier is only displayed when the object to be interacted with contains content such as icons or characters that cannot be voice-recognized, or the number of words in the text information is greater than or equal to the preset number of words, so that the user can quickly locate and select the target object through digital identifiers and voice input even when faced with a complex display interface; the user is allowed to display all digital identifiers in the display interface of the interactive device by sliding his finger while continuously pressing the voice button, and select the target digital identifier, which improves the flexibility of user operation and allows the user to further digitally identify and select the object to be interacted with that has a secondary display interface, thereby reducing the complexity of the overall interaction process.

[0050] Figure 3 Schematic diagram of the structure of the electronic device provided by the present invention. Figure 3 As shown, the electronic device may include: a processor 110, a communication interface 120, a memory 130 and a communication bus 140, wherein the processor 110, the communication interface 120 and the memory 130 communicate with each other through the communication bus 140. The processor 110 may call the logic instructions in the memory 130 to execute the voice interaction method of the display interface, the method comprising: receiving a voice wake-up instruction of the user, the voice wake-up instruction is determined after pressing the voice button of the interactive device, wherein the interactive device is connected to the display device in communication; in response to the voice wake-up instruction, determining all objects to be interacted with that can be executed with a response operation from the current display screen of the display device, and when all objects to be interacted with are text information and the number of words of each text information is less than the preset number of words, enlarging all objects to be interacted with, and displaying all enlarged interactive objects; receiving and recognizing the first input voice of the user, the first input voice is determined after the user selects all enlarged interactive objects; determining the target interactive object according to the first input voice, and executing the response operation corresponding to the target interactive object.

[0051] In addition, the logic instructions in the above-mentioned memory 130 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0052] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute a voice interaction method for a display interface provided by the above methods, the method including: receiving a user's voice wake-up command, the voice wake-up command is determined after pressing a voice button of an interactive device, wherein the interactive device is communicatively connected to a display device; in response to the voice wake-up command, determining all objects to be interacted with that can be subjected to a response operation from a current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, enlarging all objects to be interacted with and displaying all enlarged interactive objects; receiving and recognizing a first input voice of the user, the first input voice is determined after the user selects all enlarged interactive objects; determining a target interactive object according to the first input voice, and executing a response operation corresponding to the target interactive object.

[0053] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a voice interaction method for a display interface provided by the above-mentioned methods, the method comprising: receiving a voice wake-up command from a user, the voice wake-up command being determined after pressing a voice button of an interactive device, wherein the interactive device is communicatively connected to a display device; in response to the voice wake-up command, determining from a current display screen of the display device all objects to be interacted with that can be subjected to a response operation, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, enlarging all objects to be interacted with and displaying all enlarged interactive objects; receiving and recognizing a first input voice from a user, the first input voice being determined after the user selects all enlarged interactive objects; determining a target interactive object according to the first input voice, and executing a response operation corresponding to the target interactive object.

[0054] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0055] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0056] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A voice interaction method for a display interface, characterized in that: include: Receiving a voice wake-up instruction from a user, wherein the voice wake-up instruction is determined by pressing a voice button of an interactive device, wherein the interactive device is communicatively connected to a display device; In response to the voice wake-up instruction, all objects to be interacted with that can be subjected to a response operation are determined from a current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, all objects to be interacted with are enlarged, and all enlarged interactive objects are displayed; receiving and recognizing a first input voice of a user, where the first input voice is determined after the user selects all the magnified interactive objects; A target interaction object is determined according to the first input voice, and a response operation corresponding to the target interaction object is performed.

2. The voice interaction method of the display interface according to claim 1, characterized in that: After all objects to be interacted with that can be subjected to response operations are determined from the current display screen of the display device, the method further includes: When all objects to be interacted with include text information and non-text information, or when all objects to be interacted with are non-text information, or when the number of characters in any text information is greater than or equal to the preset number of characters, a digital identifier is displayed within a preset range of each object to be interacted with; receiving and recognizing a second input voice of a user to determine the target interaction object according to the second input voice, wherein the second input voice is determined after the user selects all digital identifiers; The non-text information includes icon information and character information, and each object to be interacted with corresponds to a different digital identifier.

3. The voice interaction method of the display interface according to claim 2, characterized in that: The second input voice is obtained by continuously pressing a voice button of the interactive device after the voice wake-up instruction is generated; After displaying the digital identification within the preset range of each object to be interacted with, the method further includes: Displaying all digital identifiers in a display interface of the interactive device; Receiving a first input instruction from a user, wherein the first input instruction is determined after pressing a voice button of an interactive device and sliding to a display area corresponding to a target digital identifier and then stopping the pressing; In response to the first input instruction, generating a first instruction, wherein the first instruction is used to instruct the display device to perform a response operation on the object to be interacted with corresponding to the target digital identifier; Send the first instruction to the display device.

4. The voice interaction method of the display interface according to claim 2, characterized in that: Before or after displaying the digital identification within the preset range of each object to be interacted with, the method further includes: Receiving a second input instruction from the user, the second input instruction being determined by sliding a finger along a preset path after pressing a voice button of the interactive device, and continuously pressing the button for a preset time; For each object to be interacted with, if there is a secondary display interface for the object to be interacted with, determine all secondary interactive objects in the secondary display interface that can be subjected to a response operation, wherein the secondary display interface is a drop-down interface that is expanded when the object to be interacted with is about to be clicked; Digitally labeling all secondary interactive objects, and displaying all secondary labels in the secondary display interface of the interactive device; Among them, each secondary identification is different, each secondary identification is different from each digital identification, and the preset path includes clockwise sliding, counterclockwise sliding or straight sliding.

5. The voice interaction method of the display interface according to claim 2, characterized in that: The displaying of a digital identifier within a preset range of each object to be interacted with includes: Display a digital logo in the upper left corner of the preset range of any object to be interacted with; Alternatively, a digital identifier is displayed in the upper right corner of a preset range of any object to be interacted with; Alternatively, a digital identifier is displayed at the lower left corner within a preset range of any object to be interacted with; Alternatively, a digital identification is displayed at the lower right corner within a preset range of any object to be interacted with.

6. The voice interaction method of the display interface according to claim 1, characterized in that: The determining a target interaction object according to the first input voice and executing a response operation corresponding to the target interaction object includes: Acquire all voices from the time when a voice button of the interactive device is pressed to the time when the voice button of the interactive device is released, and determine all the voices as the first input voice; The first input voice is recognized to obtain recognized text, the target interaction object is determined from all objects to be interacted with according to the recognized text, and a response operation corresponding to the target interaction object is executed.

7. The voice interaction method of the display interface according to claim 1, characterized in that: The current display screen of the display device also includes a cursor, and the step of determining a target interactive object according to the first input voice and performing a response operation corresponding to the target interactive object includes: Determine a target interactive object according to the first input voice, and generate a second instruction, wherein the second instruction is used to instruct the cursor to move from the current position of the cursor to the position of the target interactive object and display a confirmation box; receiving a third input instruction from a user, wherein the third input instruction is confirmed after a response operation is performed in the to-be-confirmed box using an interactive key of the interactive device; In response to the third input instruction, a response operation corresponding to the target interactive object is executed.

8. The voice interaction method of the display interface according to claim 1, characterized in that: When the currently displayed screen is a video playback screen, the response operation includes a jump operation and a non-jump operation. The jump operation is used to jump to the next playback interface, and the target interactive object corresponding to the non-jump operation includes at least a playback operation displayed by an icon or text, a pause operation, a volume adjustment operation, a barrage adjustment operation, a multiple adjustment operation, a full-screen adjustment operation, a login operation, a logout operation, a window closing operation, a like operation, and a favorite operation.

9. A voice interaction device for a display interface, characterized in that: include: a first receiving unit, the first receiving unit being used to receive a voice wake-up instruction of a user, the voice wake-up instruction being determined after pressing a voice button of an interactive device, wherein the interactive device is communicatively connected with a display device; A response unit, the response unit being used to respond to the voice wake-up instruction, determine all objects to be interacted with that can be subjected to a response operation from a current display screen of the display device, and when all objects to be interacted with are text information and the number of words in each text information is less than a preset number of words, enlarge all objects to be interacted with, and display all enlarged interactive objects; a second receiving unit, the second receiving unit being configured to receive and recognize a first input voice of a user, where the first input voice is determined after the user selects all the amplified interactive objects; An execution unit, wherein the execution unit is used to determine a target interaction object according to the first input voice, and execute a response operation corresponding to the target interaction object.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the voice interaction method of the display interface as described in any one of claims 1 to 8 is implemented.

Images