Method, device and intelligent terminal for processing digital corner marks based on voice recognition

Abstract

The present invention discloses a method, device, and intelligent terminal for realizing digital corner mark processing based on voice recognition, and the method includes: searching for all multiple operable focus areas of the current interface according to a voice wake-up instruction; marking all multiple operable focus areas of the current interface with different digital corner marks in turn, and establishing a corresponding relationship between the marked digital corner marks and the operation instruction to start the corresponding focus area; parsing the corresponding digital corner mark according to the digital voice instruction, and controlling the focus area where the parsed digital corner mark is located to perform the corresponding operation. The present invention adds a new function to the intelligent terminal: it has the function of marking multiple operable focus areas with different digital corner marks in turn, and controlling the corresponding focus area to perform the corresponding operation through digital voice instructions, thereby improving the operation efficiency and greatly providing convenience for the user. The present invention is based on the user using the voice function, which facilitates the user to select each area of ​​the target browsing page through voice to operate.

Description

Technical Field

[0001] The present invention relates to the field of speech recognition processing technology, and in particular to a method, device, intelligent terminal and storage medium for realizing digital superscript processing based on speech recognition. Background Art

[0002] With the development of science and technology and the continuous improvement of people's living standards, the use of various smart terminals such as smart TVs is becoming more and more popular, and smart TVs have become an indispensable communication tool in people's lives.

[0003] The existing intelligent terminals have more and more functions, such as voice recognition, etc. However, when the voice recognition operation of the existing intelligent terminals is used to operate various areas of the browsing page, the user is not clear about what voice to use, which is inconvenient for the user to use.

[0004] Therefore, the prior art still needs to be improved and enhanced. Summary of the invention

[0005] The technical problem to be solved by the present invention is that, in view of the above-mentioned defects of the prior art, a method, device, intelligent terminal and storage medium for realizing digital superscript processing based on voice recognition are provided. The present invention is based on the convenience of users using voice function to select target browsing page areas for operation through voice; a set of methods for identifying browsing page cards for users and facilitating users to select viewing content is implemented, which provides convenience for users.

[0006] In order to solve the above technical problems, the first aspect of the present invention provides a method for realizing digital superscript processing based on speech recognition, and the method comprises:

[0007] Obtain a voice wake-up command, and search for all operable focus areas of the current interface according to the voice wake-up command;

[0008] All multiple operable focus areas of the current interface are marked with different digital corner marks in sequence, and a corresponding relationship is established between the marked digital corner marks and the operation instructions for starting the corresponding focus areas;

[0009] A digital voice command is obtained, a corresponding digital superscript is parsed according to the digital voice command, and a focus area where the parsed digital superscript is located is controlled to perform a corresponding operation.

[0010] The method for processing digital superscripts based on voice recognition, wherein the steps of obtaining a digital voice instruction, parsing the digital superscript according to the digital voice instruction, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation also include:

[0011] When the voice command listening process ends for a predetermined time and there is no new voice command, the digital corner marks marked on the multiple focus areas are controlled to disappear;

[0012] Wherein, the focus area includes an operation menu area and a closed graphic area.

[0013] The method for realizing digital corner mark processing based on voice recognition, wherein the step of obtaining a voice wake-up instruction and searching for all operable multiple focus areas of the current interface according to the voice wake-up instruction comprises:

[0014] Determine whether a specified voice wake-up command is detected;

[0015] When a voice wake-up command is detected, the voice wake-up command is obtained;

[0016] According to the voice wake-up command, all multiple operable focus areas of the current interface are searched, and the coordinate range of each focus area is determined.

[0017] The method for realizing digital corner marks based on voice recognition, wherein the step of marking all multiple operable focus areas of the current interface with different digital corner marks in sequence and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes:

[0018] Obtain the coordinate range of each focus area of ​​the determined current interface;

[0019] According to the coordinate range of each focus area, all operable focus areas of the current interface are marked with different digital corner marks in turn;

[0020] A correspondence is established between the marked digital corner mark and the operation instruction for starting the corresponding focus area.

[0021] The method for realizing digital corner marks based on voice recognition, wherein the step of marking all multiple operable focus areas of the current interface with different digital corner marks in sequence and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes:

[0022] Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics;

[0023] According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn;

[0024] For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction for starting the corresponding focus area.

[0025] The method for realizing digital corner marks based on voice recognition, wherein the step of marking all multiple operable focus areas of the current interface with different digital corner marks in sequence and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas, further comprises:

[0026] Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics;

[0027] For the closed area graphics to be marked, the background identification mark is 1;

[0028] Get the layout area of ​​the current interface, traverse all closed area graphics marked as 1, and record the closed area graphics marked as 1;

[0029] Determine whether the recorded closed area graphics are visible on the screen;

[0030] Get the coordinates of the recorded closed area graphics on the screen;

[0031] Generate serial numbers for cards based on the recorded closed area graphic coordinates;

[0032] Draw a numbered icon for the recorded enclosed area graphics.

[0033] The method for realizing digital superscript processing based on voice recognition, wherein the steps of obtaining a digital voice instruction, parsing the digital superscript according to the digital voice instruction, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation include:

[0034] Obtaining a digital voice command, parsing the digital voice command, and parsing out a corresponding digital value;

[0035] Searching for the digital subscript corresponding to the focus area according to the digital value;

[0036] The focus area corresponding to the digital sub-mark is confirmed according to the digital value, and the focus area where the corresponding digital sub-mark is located is controlled to perform a corresponding operation.

[0037] A digital corner mark processing device based on voice recognition, wherein the device comprises:

[0038] A wake-up search module, used to obtain a voice wake-up instruction, and search all operable focus areas of the current interface according to the voice wake-up instruction;

[0039] The marking module is used to mark all the multiple operable focus areas of the current interface with different digital corner marks in sequence, and establish a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas;

[0040] The digital superscript control execution module is used to obtain digital voice instructions, parse the digital superscript according to the digital voice instructions, and control the focus area where the parsed digital superscript is located to perform corresponding operations.

[0041] An intelligent terminal includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, including the method for executing any one of the methods described above.

[0042] A non-transitory computer-readable storage medium, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the methods described above.

[0043] Beneficial effects: Compared with the prior art, the present invention provides a method for realizing digital corner mark processing based on voice recognition, obtaining a voice wake-up instruction, searching all multiple operable focus areas of the current interface according to the voice wake-up instruction; marking all multiple operable focus areas of the current interface with different digital corner marks in turn, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas; obtaining digital voice instructions, parsing the corresponding digital corner marks according to the digital voice instructions, and controlling the focus area where the parsed digital corner marks are located to perform corresponding operations. The present invention adds new functions to the smart terminal: it has the function of marking multiple operable focus areas with different digital corner marks in turn, and controlling the corresponding focus areas to perform corresponding operations through digital voice instructions, thereby improving the operation efficiency and greatly providing convenience for users. The present invention is based on the user using the voice function, which facilitates the user to select each area of ​​the target browsing page through voice for operation; a set of methods for identifying browsing page cards for users and facilitating users to select viewing content is implemented, providing convenience for users. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A flowchart of a specific implementation method of a digital superscript processing method based on speech recognition provided in an embodiment of the present invention.

[0045] Figure 2 A schematic diagram of the structure of marking digital superscripts on a closed graphic area of ​​an operation interface of a method for implementing digital superscripts based on speech recognition provided in an embodiment of the present invention.

[0046] Figure 3 The present invention is a flowchart of a specific implementation method of a method for processing digital superscripts based on speech recognition according to a specific application embodiment of the present invention.

[0047] Figure 4It is a principle block diagram of a digital superscript processing device based on speech recognition provided by an embodiment of the present invention.

[0048] Figure 5 It is a block diagram of the internal structure principle of the intelligent terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0050] With the development of science and technology and the continuous improvement of people's living standards, the use of various smart terminals such as smart TVs is becoming more and more popular, and smart TVs have become an indispensable communication tool in people's lives.

[0051] The existing intelligent terminals have more and more functions, such as voice recognition, etc. However, when the voice recognition operation of the existing intelligent terminals is used to operate various areas of the browsing page, the user is not clear about what voice to use, which is inconvenient for the user to use.

[0052] In order to solve the problems of the prior art, the present embodiment provides a method for realizing a digital superscript processing based on voice recognition. In specific implementation, a voice wake-up instruction is obtained, and all multiple operable focus areas of the current interface are searched according to the voice wake-up instruction; all multiple operable focus areas of the current interface are marked with different digital superscripts in turn, and a correspondence is established between the marked digital superscripts and the operation instructions to start the corresponding focus areas; a digital voice instruction is obtained, and the digital superscript is parsed according to the digital voice instruction to obtain the corresponding digital superscript, and the focus area where the parsed digital superscript is located is controlled to perform the corresponding operation. The present invention adds a new function to the smart terminal: it has the function of marking multiple operable focus areas with different digital superscripts in turn, and controlling the corresponding focus area to perform the corresponding operation through digital voice instructions, thereby improving the operation efficiency and greatly providing convenience for users.

[0053] The present invention is based on the fact that when a user uses the voice function, the user can select each area of ​​the target browsing page through voice to operate; a method for identifying browsing page cards for users is implemented to facilitate users to select viewing content. For example: after saying "Xiao Ming Xiao Ming" to wake up the voice, all the cards that can be focused on the current screen of the TV are displayed with digital numbers; the ASR listening process ends, and if there is no instruction, the number disappears; the present invention speeds up the operation efficiency and provides convenience for users.

[0054] Exemplary Methods

[0055] The method of this embodiment can be applied to a smart terminal. When it is implemented, Figure 1 As shown in the figure, a method for realizing digital superscript processing based on speech recognition provided by an embodiment of the present invention specifically includes the following steps:

[0056] Step S100: obtaining a voice wake-up instruction, and searching for all operable focus areas of the current interface according to the voice wake-up instruction;

[0057] In the embodiment of the present invention, the voice control of each focus area of ​​the operation interface is converted into operation through digital voice in the operation interface of the voice recognition operation. In the intelligent terminal of the present invention, such as a smart TV, each operation interface has multiple focus areas that can be controlled to realize corresponding operations. These focus areas can be manually touched or operated through voice recognition: in order to simplify the voice recognition operation and provide convenience for users. Specifically in the present invention:

[0058] The smart TV determines whether a specified voice wake-up command is detected; when a voice wake-up command is detected, the voice wake-up command is obtained; and all operable focus areas of the current interface are searched according to the voice wake-up command, and a coordinate range of each focus area is determined.

[0059] For example, when the smart TV detects the wake-up voice of "Xiao Ming Xiao Ming", it will search for all the multiple focus areas that can be operated in the current interface according to the voice wake-up command; wherein the focus area includes an operation menu area and a closed graphic area; for example, the focus area in the embodiment of the present invention may include a menu area that can be operated by the user (such as Figure 2 ), and also includes closed graphic areas of the browse page (such as Figure 2 shown below).

[0060] In the embodiment of the present invention, after searching for all multiple operable focus areas of the current interface according to the voice wake-up command, the coordinate range of each focus area can be recorded to facilitate the subsequent establishment of a corresponding relationship between the operation commands for each focus area.

[0061] Step S200: marking all multiple operable focus areas of the current interface with different digital corner marks in sequence, and establishing a correspondence between the marked digital corner marks and the operation instructions for starting the corresponding focus areas;

[0062] In this step, all the multiple operable focus areas of the current interface are marked with different digital corner marks in sequence, and a corresponding relationship is established between the marked digital corner marks and the operation instructions for starting the corresponding focus areas. Figure 2 As shown, in the embodiment of the present invention, the coordinate range of each focus area of ​​the current interface is determined; then, according to the coordinate range of each focus area, all the operable focus areas of the current interface are marked with different digital corner marks in sequence; for example, Figure 2As shown in the figure, all the operable focus areas of the current interface can be marked with different digital corner marks in order from left to right and from top to bottom. Figure 2 The focus area shown is a closed graphic area of ​​the browsing page to which the digital markings 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 belong.

[0063] Furthermore, the embodiment of the present invention establishes a corresponding relationship between the marked digital corner mark and the operation instruction for activating the corresponding focus area. Figure 2 The number mark 1 of the first closed graphic area is connected to the link URL of the detailed news of the graphic corresponding to the first closed graphic area, so that the user can open the link of the detailed news of the graphic corresponding to the first closed graphic area by saying the voice command "please open 1" after starting the voice recognition.

[0064] Specific as Figure 2 As shown, in the embodiment of the present invention, preferably, the coordinate ranges of the multiple focus areas are obtained and determined, wherein: Figure 2 The multiple focus areas of the illustrated embodiment include: closed area graphics.

[0065] According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn; Figure 2 The focus area shown is a closed graphic area of ​​the browsing page to which the digital markings 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 belong.

[0066] For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction to start the corresponding focus area. Figure 2 The closed graphic area of ​​the browsing page to which the focus area shown is belongs is marked with numbers 1, 2, 3, 4, 5, 6, 7, 8, 9, 10; the background is marked with 1 to facilitate the system to perform voice recognition search; and a correspondence is established between the marked digital superscript and the operation instruction (such as a link URL) to start the corresponding focus area.

[0067] Step S300: obtaining a digital voice command, parsing the digital voice command into a corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation.

[0068] In the present invention, after the digital corner marking of the focus area is completed, if a digital voice command is obtained at this time, the corresponding digital corner mark will be parsed according to the digital voice command, and the focus area where the parsed digital corner mark is located will be controlled to perform the corresponding operation.

[0069] Specifically, this step obtains a digital voice command, parses the digital voice command, and parses the corresponding digital value; searches for the digital subscript corresponding to the focus area according to the digital value; confirms the focus area corresponding to the digital subscript according to the digital value, and controls the focus area where the corresponding digital subscript is located to perform the corresponding operation. Figure 2 As shown, when the user says the wake-up voice "Xiao Ming Xiao Ming" and then says "Please open the number 2 corner mark" or "Open the number 2 content", the present invention recognizes the focus area where the number 2 digital corner mark is located, and controls the opening of the focus area corresponding to the number 2 digital corner mark.

[0070] In the embodiment of the present invention, after entering another operation interface by operating the focus area corresponding to the digital corner mark of the current interface, if the present invention continues to receive a voice wake-up command, all focus areas can be marked with digital corner marks according to the above method after entering another operation interface. Similarly, the focus area marked with digital corner marks can be operated by digital voice commands.

[0071] The present invention further includes, after step S300: when the voice command listening process ends for a predetermined time and there is no new voice command, the digital corner marks marked on the multiple focus areas are controlled to disappear. That is, in the embodiment of the present invention, when the voice command listening process ends for a predetermined time, for example, when the user does not issue a voice command for 30 seconds, the digital corner marks marked on the multiple focus areas are controlled to disappear in the embodiment of the present invention. The voice system is directly woken up next time and the focus areas are re-marked.

[0072] As can be seen from the above, the present invention adds new functions to the smart terminal: it has the function of marking multiple operable focus areas with different digital corner marks in sequence, and controlling the corresponding focus areas to perform corresponding operations through digital voice commands, thereby improving operating efficiency and greatly providing convenience for users. The present invention is based on the user using the voice function, which facilitates the user to select each area of ​​the target browsing page through voice for operation.

[0073] The present invention is further described in detail below through another specific application embodiment:

[0074] like Figure 3 As shown, the method for realizing digital superscript processing based on speech recognition described in this specific application embodiment includes the following steps:

[0075] Step S10: voice wake-up, and proceed to step S11;

[0076] For example, you can say "Xiao Ming Xiao Ming" to wake up the phone with voice.

[0077] Step S11, obtain the root layout, and proceed to step S12;

[0078] In this specific embodiment, Figure 2As shown below, obtaining the root layout may be obtaining the closed area graphic layout, wherein the closed area graphic is also referred to as a card.

[0079] Step S12, traverse the root layout to find the card marked 1, and go to step S13;

[0080] For example, for the closed area graphic (card) to be marked, the background identification mark is 1; and the process goes to step S13;

[0081] Step S13: Check whether the card is visible, and proceed to step S14;

[0082] That is, is the closed area graphic (card) visible? If yes, proceed to step S14;

[0083] Step S14, obtaining the coordinates of the card on the screen, and proceeding to step S15;

[0084] That is, the coordinate range of the closed area graphic (card) on the screen is obtained, and the process goes to step S15;

[0085] Step S15, record the card information into the collection, and proceed to step S16;

[0086] Record the closed area graphic (card) information into a collection and proceed to step S16;

[0087] Step S16, traversal of cards is completed, and the process goes to step S17;

[0088] Each closed area graphic (card) is traversed and the process goes to step S17;

[0089] Step S17, sort the cards according to the card coordinates, and proceed to step S18;

[0090] Sort the cards from left to right and from top to bottom according to the coordinates of the closed area graphics (cards), and proceed to step S18;

[0091] Step S18, draw a serial number corner mark for each card, and proceed to step S19;

[0092] like Figure 2 Draw serial number corner marks for each closed area figure (card) as shown; Figure 2 The closed graphic area (card) of the browsing page to which the focus area shown is belongs is marked with numbers 1, 2, 3, 4, 5, 6, 7, 8, 9, 10;

[0093] Step S19, obtaining a digital voice command, parsing the digital voice command into a corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation.

[0094] For example Figure 2The number mark 1 of the first closed graphic area is connected to the link URL of the detailed news of the graphic corresponding to the first closed graphic area, so that the user can open the link of the detailed news of the graphic corresponding to the first closed graphic area by saying the voice command "please open 1" after starting the voice recognition.

[0095] In a further embodiment, the present invention is described by taking the focus area as a closed area graphic as an example, and the process of drawing the voice digital corner mark is specifically as follows:

[0096] S30, obtaining and determining the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics;

[0097] S31. For the closed area graphics to be marked, the background identification mark is 1;

[0098] S32, obtaining the layout area of ​​the current interface, traversing all closed area graphics marked as 1, and recording the closed area graphics marked as 1;

[0099] S33, determining whether the recorded closed area graphic is visible on the screen;

[0100] S34, obtaining the coordinates of the recorded closed area graphic on the screen;

[0101] S35, generating a serial number for the card according to the recorded closed area graphic coordinates;

[0102] S36. Draw a serial number icon for the recorded closed area graphics.

[0103] Through the above-mentioned specific process of drawing voice digital corner marks, the present invention can easily realize digital marking of focus areas that need to be marked, such as closed area graphics, in each operation interface, which is very convenient for users to operate and use, provides convenience for users' operations, and improves voice operation efficiency.

[0104] The present invention can determine whether the closed area graphic (card) is visible on the screen by the following method:

[0105] Method 1: Get the coordinates of the four visible endpoints of the enclosed area graphic (card) on the screen through the system method getGlobalVisibleRect(). If the difference between the lower endpoint and the upper endpoint is equal to the height of the enclosed area graphic (card), and the difference between the right endpoint and the left endpoint is equal to the width of the enclosed area graphic (card), the enclosed area graphic (card) is completely displayed on the screen;

[0106] Method 2: When the card is fully displayed in the window, determine whether the card is covered by other views and becomes invisible.

[0107] The above method can be used to quickly determine whether a card is visible on the screen, thereby improving the determination efficiency.

[0108] The present invention further comprises the following steps: when receiving a digital voice command, the process of determining and obtaining the serial number of the closed area graphic (card) can be:

[0109] Step 1. Take the coordinates (x, y) of the upper left endpoint of the closed area graphic (card); compare the y coordinates of all closed area graphics (cards), the one with a smaller y coordinate has a smaller serial number; if the y coordinates are equal, compare the x coordinates of the closed area graphics (cards), the one with a smaller x coordinate has a smaller serial number;

[0110] Step 2: Set the offset value for the y coordinate, and allow the error to be less than the offset value. Compare the cards on the x coordinate. It is very convenient to obtain the digital corner number of the upper left end point of the closed area graphic (card).

[0111] As can be seen from the above, the present invention is based on the user using the voice function, which facilitates the user to select the target browsing page areas for operation through voice; it implements a set of methods for identifying browsing page cards for users, facilitating users to select viewing content, and provides convenience for users.

[0112] Exemplary Devices

[0113] like Figure 4 As shown in the embodiment of the present invention, a digital superscript processing device based on speech recognition is provided, and the device includes:

[0114] A wake-up search module 410 is used to obtain a voice wake-up instruction and search all operable focus areas of the current interface according to the voice wake-up instruction;

[0115] The marking module 420 is used to mark all the multiple operable focus areas of the current interface with different digital corner marks in sequence, and establish a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas;

[0116] The digital superscript control execution module 430 is used to obtain digital voice instructions, parse the digital superscript according to the digital voice instructions, and control the focus area where the parsed digital superscript is located to perform corresponding operations, as described above.

[0117] Based on the above embodiments, the present invention further provides an intelligent terminal, whose principle block diagram can be shown as follows: Figure 5As shown. The smart terminal of an embodiment of the present invention may be a smart TV, and the smart terminal includes a processor, a memory, a network interface, and a display screen connected via a system bus. Among them, the processor of the smart terminal is used to provide computing and control capabilities. The memory of the smart terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface of the smart terminal is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a digital corner mark processing method based on voice recognition is implemented. The display screen of the smart terminal may be a liquid crystal display screen or an electronic ink display screen.

[0118] Those skilled in the art will understand that Figure 5 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the smart terminal to which the scheme of the present invention is applied. The specific smart terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0119] In one embodiment, a smart terminal is provided, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs include instructions for performing the following operations:

[0120] Obtain a voice wake-up command, and search for all operable focus areas of the current interface according to the voice wake-up command;

[0121] All multiple operable focus areas of the current interface are marked with different digital corner marks in sequence, and a corresponding relationship is established between the marked digital corner marks and the operation instructions for starting the corresponding focus areas;

[0122] A digital voice command is obtained, a corresponding digital superscript is parsed according to the digital voice command, and a focus area where the parsed digital superscript is located is controlled to perform a corresponding operation.

[0123] The step of obtaining a digital voice command, parsing the digital voice command into a corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation further includes:

[0124] When the voice command listening process ends for a predetermined time and there is no new voice command, the digital corner marks marked on the multiple focus areas are controlled to disappear;

[0125] Wherein, the focus area includes an operation menu area and a closed graphic area.

[0126] The step of obtaining a voice wake-up instruction and searching for all operable focus areas of the current interface according to the voice wake-up instruction includes:

[0127] Determine whether a specified voice wake-up command is detected;

[0128] When a voice wake-up command is detected, the voice wake-up command is obtained;

[0129] According to the voice wake-up command, all multiple operable focus areas of the current interface are searched, and the coordinate range of each focus area is determined.

[0130] The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a correspondence between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes:

[0131] Obtain the coordinate range of each focus area of ​​the determined current interface;

[0132] According to the coordinate range of each focus area, all operable focus areas of the current interface are marked with different digital corner marks in turn;

[0133] A correspondence is established between the marked digital corner mark and the operation instruction for starting the corresponding focus area.

[0134] The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a correspondence between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes:

[0135] Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics;

[0136] According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn;

[0137] For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction for starting the corresponding focus area.

[0138] The step of marking all operable focus areas of the current interface with different digital corner marks in sequence and establishing a correspondence between the marked digital corner marks and the operation instructions for starting the corresponding focus areas also includes:

[0139] Wherein, the plurality of focus areas include: closed area graphics;

[0140] For the closed area graphics to be marked, the background identification mark is 1;

[0141] Get the layout area of ​​the current interface, traverse all closed area graphics marked as 1, and record the closed area graphics marked as 1;

[0142] Determine whether the recorded closed area graphics are visible on the screen;

[0143] Get the coordinates of the recorded closed area graphics on the screen;

[0144] Generate serial numbers for cards based on the recorded closed area graphic coordinates;

[0145] Draw a numbered icon for the recorded enclosed area graphics.

[0146] The steps of obtaining a digital voice command, parsing the digital voice command into a corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation include:

[0147] Obtaining a digital voice command, parsing the digital voice command, and parsing out a corresponding digital value;

[0148] Searching for the digital subscript corresponding to the focus area according to the digital value;

[0149] The focus area corresponding to the digital sub-mark is confirmed according to the digital value, and the focus area where the corresponding digital sub-mark is located is controlled to perform a corresponding operation.

[0150] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0151] In summary, the present invention discloses a method, device, intelligent terminal and storage medium for realizing digital corner mark based on voice recognition, the method comprising: obtaining a voice wake-up instruction, searching all multiple operable focus areas of the current interface according to the voice wake-up instruction; marking all multiple operable focus areas of the current interface with different digital corner marks in turn, and establishing a corresponding relationship between the marked digital corner marks and the operation instruction to start the corresponding focus area; obtaining a digital voice instruction, parsing the digital corner mark according to the digital voice instruction, and controlling the focus area where the parsed digital corner mark is located to perform a corresponding operation. The present invention adds a new function to the intelligent terminal: it has the function of marking multiple operable focus areas with different digital corner marks in turn, and controlling the corresponding focus area to perform a corresponding operation through a digital voice instruction, thereby improving the operation efficiency and greatly providing convenience for the user. The present invention is based on the user using the voice function, facilitating the user to select each area of ​​the target browsing page through voice for operation; realizing a set of methods for identifying browsing page cards for users and facilitating users to select viewing content, providing convenience for users.

[0152] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for realizing digital superscript processing based on speech recognition, characterized in that: The method comprises: Obtain a voice wake-up command, and search for all operable focus areas of the current interface according to the voice wake-up command; All multiple operable focus areas of the current interface are marked with different digital corner marks in sequence, and a corresponding relationship is established between the marked digital corner marks and the operation instructions for starting the corresponding focus areas; Acquire a digital voice command, parse the digital voice command into a corresponding digital superscript, and control the focus area where the parsed digital superscript is located to perform a corresponding operation; The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes: Obtain the coordinate range of each focus area of ​​the determined current interface; According to the coordinate range of each focus area, all operable focus areas of the current interface are marked with different digital corner marks in turn; Establishing a correspondence between the marked digital corner mark and the operation instruction for starting the corresponding focus area; The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes: Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics; According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn; For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction to start the corresponding focus area; Get the coordinates (x, y) of the upper left endpoint of the closed area figure; compare the y coordinates of all closed area figures, the smaller the y coordinate, the smaller the serial number; if the y coordinates are equal, compare the x coordinates of the closed area figures, the smaller the x coordinate, the smaller the serial number; set the offset offset for the y coordinate, and allow the error to be less than the offset offset card to compare the x coordinate; The step of sequentially marking all the multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas also includes: Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics; For the closed area graphics to be marked, the background identification mark is 1; Get the layout area of ​​the current interface, traverse all closed area graphics marked as 1, and record the closed area graphics marked as 1; Determine whether the recorded closed area graphics are visible on the screen; Get the coordinates of the recorded closed area graphics on the screen; Generate serial numbers for cards based on the recorded closed area graphic coordinates; Draw serial number icons for the recorded closed area graphics; The process of judging whether the closed area graphics is visible on the screen is as follows: Through the system method getGlobalVisib leRect(), the coordinates of the four visible endpoints of the closed area graphics on the screen are obtained. If the difference between the lower endpoint and the upper endpoint is equal to the height of the closed area graphics, and the difference between the right endpoint and the left endpoint is equal to the width of the closed area graphics, then the closed area graphics is completely displayed on the screen.

2. According to the method for realizing digital superscript processing based on speech recognition according to claim 1, it is characterized in that: After the step of obtaining the digital voice command, parsing the digital voice command to obtain the corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform the corresponding operation, the following steps are further included: When the voice command listening process ends for a predetermined time and there is no new voice command, the digital corner marks marked on the multiple focus areas are controlled to disappear; Wherein, the focus area includes an operation menu area and a closed graphic area.

3. The method for realizing digital superscript processing based on speech recognition according to claim 1, characterized in that: The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes: Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics; According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn; For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction for starting the corresponding focus area.

4. The method for realizing digital superscript processing based on speech recognition according to claim 1, characterized in that: The steps of obtaining a digital voice command, parsing the digital voice command to obtain a corresponding digital superscript, and controlling the focus area where the parsed digital superscript is located to perform a corresponding operation include: Obtaining a digital voice command, parsing the digital voice command, and parsing out a corresponding digital value; Searching for the digital subscript corresponding to the focus area according to the digital value; The focus area corresponding to the digital sub-mark is confirmed according to the digital value, and the focus area where the corresponding digital sub-mark is located is controlled to perform a corresponding operation.

5. A digital corner mark processing device based on voice recognition, characterized in that: The device comprises: A wake-up search module, used to obtain a voice wake-up instruction, and search all operable focus areas of the current interface according to the voice wake-up instruction; The marking module is used to mark all the multiple operable focus areas of the current interface with different digital corner marks in sequence, and establish a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas; A digital superscript control execution module is used to obtain a digital voice command, parse the digital superscript according to the digital voice command, and control the focus area where the parsed digital superscript is located to perform a corresponding operation; The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes: Obtain the coordinate range of each focus area of ​​the determined current interface; According to the coordinate range of each focus area, all operable focus areas of the current interface are marked with different digital corner marks in turn; Establishing a correspondence between the marked digital corner mark and the operation instruction for starting the corresponding focus area; The step of sequentially marking all multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas includes: Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics; According to the coordinate range of each focal area, each focal area is marked with different digital corner marks in turn; For each marked focus area, the background identification mark is 1, and a corresponding relationship is established between the marked digital corner mark and the operation instruction to start the corresponding focus area; Get the coordinates (x, y) of the upper left endpoint of the closed area figure; compare the y coordinates of all closed area figures, the smaller the y coordinate, the smaller the serial number; if the y coordinates are equal, compare the x coordinates of the closed area figures, the smaller the x coordinate, the smaller the serial number; set the offset offset for the y coordinate, and allow the error to be less than the offset offset card to compare the x coordinate; The step of sequentially marking all the multiple operable focus areas of the current interface with different digital corner marks, and establishing a corresponding relationship between the marked digital corner marks and the operation instructions for starting the corresponding focus areas also includes: Acquire and determine the coordinate ranges of the multiple focus areas, wherein the multiple focus areas include: closed area graphics; For the closed area graphics to be marked, the background identification mark is 1; Get the layout area of ​​the current interface, traverse all closed area graphics marked as 1, and record the closed area graphics marked as 1; Determine whether the recorded closed area graphics are visible on the screen; Get the coordinates of the recorded closed area graphics on the screen; Generate serial numbers for cards based on the recorded closed area graphic coordinates; Draw serial number icons for the recorded closed area graphics; The process of judging whether the closed area graphics is visible on the screen is as follows: Get the coordinates of the four visible endpoints of the closed area graphics on the screen through the system method getGlobalVisibleRect(). If the difference between the lower endpoint and the upper endpoint is equal to the height of the closed area graphics, and the difference between the right endpoint and the left endpoint is equal to the width of the closed area graphics, then the closed area graphics is completely displayed on the screen.

6. An intelligent terminal, characterized in that: The device comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs include being used to execute the method according to any one of claims 1 to 4.

7. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as claimed in any one of claims 1 to 4.

Images