Interaction method and device based on intelligent glasses, intelligent glasses and storage medium

Abstract

The invention provides an interaction method and device based on intelligent glasses, the intelligent glasses and a storage medium. The method is applied to the intelligent glasses and comprises the steps of determining a target object in response to an information prompt request; obtaining a target voice of the target object; based on the target voice of the target object, corresponding target information is output, and the target information is information associated with the target voice; and displaying the target information to prompt a wearer wearing the intelligent glasses. According to the interaction method based on the intelligent glasses, the target information is dynamically output based on the voice information of the target object, and then the target information is displayed, so that a wearer is prompted in time based on the dynamically generated target information.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an interaction method, an interaction device, smart glasses and a computer-readable storage medium based on smart glasses. Background Art

[0002] At present, smart glasses such as AR (Augmented Reality) glasses and VR (Virtual Reality) glasses can already realize the function of teleprompters, which are widely used in speeches, meetings and other scenes. The current implementation scheme of the teleprompter function of smart glasses is: prepare the teleprompter content text in advance, and then turn on the teleprompter function when using it. Since the teleprompter content text is generated by manually inputting text or by recognizing file content, when encountering real-time questions on the spot, it is impossible to dynamically generate prompt information and then prompt the wearer, so it is impossible to meet the real-time needs of the wearer, and thus it is impossible to fully play a role in real-time communication scenes such as interviews, reports, and interviews. Summary of the invention

[0003] The present application provides an interactive method, interactive device, equipment and computer-readable storage medium based on smart glasses, aiming to provide timely prompts to the wearer based on dynamically generated target information.

[0004] To achieve the above object, the present application provides an interaction method based on smart glasses, which is applied to smart glasses. The method includes:

[0005] In response to the information prompt request, determining a target object;

[0006] Acquire the target voice of the target object;

[0007] Based on the target speech of the target object, outputting corresponding target information, wherein the target information is information associated with the target speech;

[0008] The target information is displayed to prompt a wearer of the smart glasses.

[0009] To achieve the above object, the present application further provides an interactive device, the interactive device comprising:

[0010] A determination module, the determination module is used to determine a target object in response to an information prompt request;

[0011] An acquisition module, the acquisition module is used to acquire the target speech of the target object;

[0012] An output module, the output module is used to output corresponding target information based on the target speech of the target object, wherein the target information is information associated with the target speech;

[0013] A display module is used to display the target information to prompt a wearer of the smart glasses.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a pair of smart glasses, which include a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the steps of any one of the smart glasses-based interaction methods provided in the embodiments of the present application when executing the computer program.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor enables the processor to implement the steps of any one of the smart glasses-based interaction methods provided in the embodiments of the present application.

[0016] The embodiments of the present application disclose an interactive method, interactive device, smart glasses and computer-readable storage medium based on smart glasses, which can be applied to smart glasses. Specifically, the target object can be determined in response to an information prompt request. Then, the target voice of the target object is obtained, and the target information corresponding to the target voice is output, wherein the target information is information associated with the target voice. In this way, the smart glasses can display the target information to prompt the wearer wearing the smart glasses. The present application aims to provide dynamic output of target information based on the real-time voice information of the target object, thereby realizing timely prompting of the wearer based on the dynamically generated target information. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 is a schematic diagram of the steps of an interactive method based on smart glasses provided in an embodiment of the present application;

[0019] Figure 2 This is a schematic diagram of a step of determining a target object provided by an embodiment of the present application;

[0020] Figure 3 It is a schematic diagram of the steps for implementing a page turning operation provided in an embodiment of the present application;

[0021] Figure 4 is a scene schematic diagram of an interactive method based on smart glasses provided in an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of another scenario of an interactive method based on smart glasses provided in an embodiment of the present application;

[0023] Figure 6 is a schematic block diagram of an interactive device provided in an embodiment of the present application;

[0024] Figure 7 It is a schematic block diagram of a pair of smart glasses provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0027] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0028] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0029] See also Figure 1 , Figure 1 1 is a schematic diagram of the steps of an interactive method based on smart glasses provided in an embodiment of the present application. The interactive method based on smart glasses can be applied to smart glasses, and the smart glasses include an AIGC module.

[0030] like Figure 1 As shown, the interaction method based on smart glasses includes steps S11 to S14.

[0031] Step S11: In response to the information prompt request, determine the target object.

[0032] Among them, the information prompt request can be initiated by the wearer of the smart glasses. The specific initiation method is not limited in this application. For example, it can be initiated by touching a remote control device connected to the smart glasses, where the remote control device can be a ring or a finger clip.

[0033] It is understandable that when the wearer of smart glasses is in a scene such as an interview or report, the wearer needs to ask relevant questions based on the answers of the interviewee, or give relevant answers based on the questions of the interviewer. Therefore, in order to prevent the wearer from forgetting words in the above scenes and improve the work quality of the wearer, the wearer can initiate an information prompt request to the smart glasses by touching the remote control device connected to the smart glasses, so as to realize the prompting through the smart glasses.

[0034] Specifically, after the wearer initiates an information prompt request, the smart glasses can receive the information prompt request and determine the target object based on the information prompt request.

[0035] The target object is the person who is currently asking or answering the wearer. That is, the wearer needs to give relevant answers or ask relevant questions based on the answer or question of the target object.

[0036] In an embodiment of the present application, the smart glasses can determine the target object in response to the information prompt request initiated by the wearer, and then provide information prompts to the wearer to meet the wearer's needs to give relevant answers or raise relevant questions based on the target object's answers or questions, thereby improving the wearer's work quality.

[0037] Step S12: Acquire the target voice of the target object.

[0038] Step S13: Based on the target speech of the target object, output corresponding target information.

[0039] The target information is information associated with the target speech, for example, the target information is the answer to the target speech or the question corresponding to the target speech.

[0040] Furthermore, the present application does not limit the method of acquiring the target speech and outputting the target information. For example, the target speech and outputting the target information may be acquired through an AIGC module.

[0041] It should be noted that AIGC (Artificial Intelligence Generated Content) refers to the use of artificial intelligence technology to find patterns through existing data, and automatically generate various types of content such as articles, videos, pictures, music, codes, etc. through pre-trained large models, generative adversarial networks (GANs) and other methods.

[0042] AIGC is a new content creation method after PGC (Professionally Generated Content) and UGC (User Generated Content). It has the following characteristics: Automation: AIGC can automatically generate content based on keywords or requirements entered by users without manual intervention or editing; Efficiency: AIGC can use technologies such as big data and cloud computing to quickly process massive amounts of information and generate high-quality content; Creativity: AIGC can use technologies such as deep learning and reinforcement learning to continuously learn and optimize content generation strategies and generate creative and personalized content; Interaction: AIGC can use technologies such as natural language processing and computer vision to achieve natural communication and feedback with users, and dynamically adjust the way content is generated according to user preferences and behaviors.

[0043] Optionally, the AIGC module includes at least one of ChatGPT, Promptpal, and Motion Al, which is not limited in this application, and is described by taking the AIGC module including ChatGPT as an example.

[0044] ChatGPT is a large language model trained by OpenAI. It is based on the Transformer architecture, which learns how to generate human-readable text by pre-training a large amount of text data, and then implements dialogue by accepting input and generating output. ChatGPT has a wide range of uses and can be used for natural language processing (NLP) tasks such as dialogue generation, question-answering systems, text generation, etc.

[0045] It can be understood that after determining the target object, the voice of the target object can be obtained through the AIGC module, and then the corresponding answers or questions and other related information can be generated based on the voice of the target object through language training models such as ChatGPT, so as to be used to prompt the wearer.

[0046] In the embodiment of the present application, the AIGC module can obtain the voice of the target object in real time, and dynamically generate corresponding answers or questions based on the real-time voice of the target object, so as to prompt the wearer of the smart glasses. This realizes more flexible satisfaction of the wearer's needs in different scenarios, thereby improving the wearer's work quality.

[0047] Step S14: Display the target information to prompt the wearer of the smart glasses.

[0048] After obtaining the target information, the smart glasses can display the target information to prompt the wearer of the smart glasses.

[0049] Optionally, the target information is displayed to prompt a wearer of the smart glasses, including: obtaining the prompt display capacity of the smart glasses; and using the target text unit as the display content of the current display page, and displaying it through the smart glasses.

[0050] Among them, the target text unit is the first displayed text unit, and the prompt display capacity of the smart glasses is the number of words that can be displayed in the entire display page, which can be determined based on the text format set by the user.

[0051] Specifically, based on the prompt display capacity of the smart glasses, the target information can be divided into several text units, and the first display text unit among the several text units is determined as the target text unit, and the target text unit is displayed as the display content of the current display page to provide prompts to the wearer of the smart glasses.

[0052] It is understandable that the second, third, and Nth displayed text units among several text units can also be determined, and the text units in a certain order can be displayed in sequence based on the display page to prompt the wearer of the smart glasses.

[0053] Furthermore, the smart glasses can also receive a confirmation instruction from the wearer of the smart glasses, wherein the confirmation instruction is used to indicate that the wearer of the smart glasses asks a question or answers a question based on the target information.

[0054] In the embodiment of the present application, the target information can be displayed to prompt the wearer of the smart glasses. In addition, a confirmation instruction of the wearer of the smart glasses can also be received, which indicates that the wearer of the smart glasses asks or answers questions based on the target information.

[0055] An interactive method based on smart glasses disclosed in an embodiment of the present application can be applied to smart glasses. Specifically, a target object can be determined in response to an information prompt request. Then, a target voice of the target object is obtained, and target information corresponding to the target voice is output, wherein the target information is information associated with the target voice. In this way, the smart glasses can display the target information to prompt the wearer wearing the smart glasses. The present application aims to provide dynamic output of target information based on the real-time voice information of the target object, thereby realizing timely prompting of the wearer based on the dynamically generated target information.

[0056] Please continue reading Figure 2 , Figure 2 Schematic diagram of a step of determining a target object provided by an embodiment of the present application. Figure 2 As shown, the target object can be determined through steps S111 to S113.

[0057] Step S111: In response to the information prompt request, determine the target gaze point of the wearer of the smart glasses.

[0058] The target gaze point is the point where the wearer's line of sight is aimed.

[0059] Since there are many people when the wearer is in a scene such as an interview or report, the wearer's target gaze point can be determined based on the point where the wearer's line of sight is aimed.

[0060] It should be noted that the present application does not limit the method of determining the wearer's target gaze point based on the point where the wearer's line of sight is aligned. For example, the wearer's target gaze point can be determined by eye tracking technology.

[0061] Eye tracking technology refers to tracking eye movements by measuring the position of the eye's gaze point or the movement of the eye relative to the head. By accurately tracking the user's eye movements. In addition, eye tracking technology can also be used to achieve more intelligent wearer interaction, such as operating through eye control.

[0062] In an embodiment of the present application, after receiving an information prompt request, the smart glasses can determine the target gaze point of the wearer of the smart glasses based on eye tracking technology.

[0063] Step S112: Determine whether the stay time of the wearer of the smart glasses at the target gaze point is greater than or equal to a preset stay time.

[0064] Step S113: When the dwell time is greater than or equal to the preset dwell time, the object corresponding to the target gaze point is determined as the target object.

[0065] Specifically, it can be determined whether the time the wearer of the smart glasses stays at the target gaze point is greater than or equal to a preset time, wherein the preset time can be 5s, 10s, etc., which is not limited in this application.

[0066] It can be understood that if the wearer of the smart glasses stays at the target gaze point for a time greater than or equal to the preset time, it means that the wearer is communicating with the object at the target gaze point, so the object corresponding to the target gaze point can be determined as the target object. If the wearer of the smart glasses stays at the target gaze point for less than the preset time, the user can manually determine the target object based on the remote control device.

[0067] In an embodiment of the present application, the target object can be determined based on the dwell time of the wearer of the smart glasses at the target gaze point, so as to obtain the corresponding target voice based on the target object.

[0068] Optionally, after displaying the target information to prompt the wearer of the smart glasses and receiving a confirmation instruction from the wearer of the smart glasses, the method further includes: saving the target information in response to a save instruction, wherein the save instruction is sent by a remote control device connected to the smart glasses or triggered by the smart glasses. The remote control device may be a finger clip or a finger ring, which is not limited in this application.

[0069] Specifically, the wearer can also initiate a save instruction to the smart glasses based on the ring connected to the smart glasses, so that the smart glasses can receive the save instruction and save the target information in response to the save instruction.

[0070] Optionally, the prompt information pre-stored in the teleprompter module in the smart glasses can also be obtained, and then the prompt information is merged with the saved target information, so that the wearer can realize subsequent work records based on the merged information.

[0071] In an embodiment of the present application, the ring worn by the wearer of the smart glasses can initiate a save command to the smart glasses, so that the smart glasses save the target text to facilitate the wearer's subsequent work records, etc.

[0072] Optionally, see Figure 3 , Figure 3 Schematic diagram of the steps for implementing the page turning operation provided by the embodiment of the present application. Figure 3 As shown, the page turning operation can be implemented through steps S15 to S17.

[0073] Step S15: receiving a plurality of current voice information, and determining the current voice information of the wearer of the smart glasses from the plurality of current voice information.

[0074] Step S16: Determine whether the text information corresponding to the current voice information of the wearer of the smart glasses is located in the last line of the currently displayed page.

[0075] Step S17: When the text information corresponding to the current voice information of the wearer of the smart glasses is on the last line of the currently displayed page, a page turning operation is performed based on the currently displayed page.

[0076] It is understandable that since the smart glasses display the target information through multiple display pages, when the wearer of the smart glasses asks questions or answers based on the target information, the display pages can be turned to enhance the user experience.

[0077] Specifically, multiple voice information can be received in the scene where the wearer is located, wherein the multiple voice information is voice information generated by multiple people in the scene at the same time, and then the current voice information of the wearer of the smart glasses is determined from the multiple current voice information, and it is determined whether the position of the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page.

[0078] It can be understood that when the text information corresponding to the current voice information of the wearer of the smart glasses is on the last line of the currently displayed page, it means that the wearer needs the text information of the next displayed page, and at this time, the page turning operation can be performed based on the currently displayed page.

[0079] It should be noted that the present application does not limit the method of determining the current voice information of the wearer of the smart glasses. For example, the current voice information of the wearer of the smart glasses can be determined by voiceprint analysis.

[0080] Voiceprint analysis is to identify unknown voices by analyzing the characteristics of one or more voice signals. Simply put, it is a technology to identify whether a certain sentence is spoken by a certain person. The theoretical basis of voiceprint recognition is that each voice has unique characteristics, and the voices of different people can be effectively distinguished through these characteristics.

[0081] Optionally, after displaying the target information through the display module and receiving a confirmation instruction from the wearer of the smart glasses, the method further includes: responding to a page turning instruction, turning a page on the currently displayed page, wherein the page turning instruction is sent by a remote control device connected to the smart glasses or triggered by the smart glasses. The remote control device may be a finger clip or a finger ring, which is not limited in this application.

[0082] Specifically, the wearer can also initiate a page-turning instruction to the smart glasses based on a remote control device connected to the smart glasses or triggered by the smart glasses, so that the smart glasses can receive the page-turning instruction and turn the page of the target information in response to the page-turning instruction.

[0083] In the embodiment of the present application, the target information can be turned by judging whether the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the current display page. A remote control device connected to the smart glasses or triggered by the smart glasses can also be used to send a page turning command to the smart glasses, thereby improving the wearer's experience.

[0084] Optionally, see Figure 4 as well as Figure 5 , Figure 4 is a scene schematic diagram of an interactive method based on smart glasses provided in an embodiment of the present application; Figure 5 This is a scene diagram of another interactive method based on smart glasses provided in an embodiment of the present application.

[0085] like Figure 4 As shown, when the wearer of the smart glasses is in an interview scene, he can initiate an information prompt request to the smart glasses by touching the remote control device connected to the smart glasses, so that the smart glasses receive the information prompt request and turn on the teleprompter module to provide text prompts to the wearer. Furthermore, the smart glasses can ask questions to the interviewee based on the text information preset in the teleprompter module, and turn on the AIGC module after the interview. The AIGC module can obtain the interviewee's answer in real time, dynamically generate related questions based on the answer, and display the related questions to provide information prompts to the wearer.

[0086] Furthermore, after confirming that the above-generated related questions are the required questions, the wearer can continue to realize information prompts through the AIGC module. In addition, during the information prompt process, the wearer can initiate a page turning command or a save command to the smart glasses through the remote control device worn, so that the smart glasses turn the page or save the target information. In this way, the quality of the wearer's interview process is improved.

[0087] like Figure 5 As shown, when the wearer of the smart glasses is in a reporting scenario, he can initiate an information prompt request to the smart glasses by touching the ring connected to the smart glasses, so that the smart glasses receive the information prompt request and turn on the teleprompter module to display the pre-saved text to the wearer to achieve information prompts. Furthermore, when the wearer is interrupted by the interviewer's questions, the smart glasses can turn on the AIGC module, and then the AIGC module can obtain the interviewer's questions in real time, dynamically generate relevant answers based on the questions, and display the relevant answers to achieve information prompts for the wearer.

[0088] Furthermore, after confirming that the above generated relevant answers are the required answers, the wearer can continue to realize information prompts through the AIGC module. In addition, during the information prompt process, the wearer can initiate a page turning command or a save command to the smart glasses through the remote control device worn, so that the smart glasses turn the page or save the target text. In this way, the quality of the wearer's reporting process is improved.

[0089] See also Figure 6 , Figure 6 It is a schematic block diagram of an interaction device provided in an embodiment of the present application. The interaction device can be configured in a server to execute the steps of the aforementioned interaction method based on smart glasses.

[0090] like Figure 6 As shown, the interaction device 200 includes: a determination module 201 , an acquisition module 202 , an output module 203 and a display module 204 .

[0091] A determination module 201 is used to determine a target object in response to an information prompt request;

[0092] An acquisition module 202 is used to acquire the target speech of the target object;

[0093] An output module 203, configured to output corresponding target information based on the target speech of the target object, wherein the target information is information associated with the target speech;

[0094] The display module 204 is used to display the target information to prompt the wearer of the smart glasses.

[0095] The determination module 201 is also used to determine the target gaze point of the wearer of the smart glasses in response to an information prompt request; determine whether the stay time of the wearer of the smart glasses at the target gaze point is greater than or equal to the preset stay time; when the stay time is greater than or equal to the preset stay time, determine the object corresponding to the target gaze point as the target object.

[0096] The display module 204 is further configured to save the target information in response to a save instruction, wherein the save instruction is sent by a remote control device connected to the smart glasses or triggered by the smart glasses.

[0097] The display module 204 is also used to obtain the prompt display capacity of the smart glasses; according to the prompt display capacity of the smart glasses, the target information is divided into at least one text unit, and the target text unit is used as the display content of the current display page and displayed through the smart glasses, wherein the target text unit is the first text unit displayed.

[0098] The display module 204 is also used to respond to a page turning instruction to turn the current display page to display the target information, wherein the current display page is used to display the target information, and the page turning instruction is sent by a remote control device connected to the smart glasses or triggered by the smart glasses.

[0099] The display module 204 is also used to receive multiple current voice information, and determine the current voice information of the wearer of the smart glasses from the multiple current voice information; determine whether the position of the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page; when the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page, perform a page turning operation based on the currently displayed page.

[0100] The acquisition module 202 is further used to acquire pre-stored prompt information; and merge the prompt information with the saved target information.

[0101] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0102] The method and apparatus of the present application can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices.

[0103] Exemplarily, the above method and apparatus may be implemented in the form of a computer program. The computer program may be implemented in the form of a computer program. Figure 7 The smart glasses shown are running on

[0104] See also Figure 7 , Figure 7 1 is a schematic block diagram of a smart glasses provided in an embodiment of the present application. The smart glasses may be a server.

[0105] like Figure 7 As shown, the smart glasses 400 include a processor 401 and a memory 402 connected via a system bus, wherein the memory 402 may include a volatile storage medium, a non-volatile storage medium and an internal memory.

[0106] The processor 401 is used to provide computing and control capabilities to support the operation of the entire smart glasses 400.

[0107] The memory 402 provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor 401 can execute any interactive method based on smart glasses.

[0108] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that the structure of the smart glasses 400 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the smart glasses 400 to which the solution of the present application is applied. The specific smart glasses 400 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0109] It should be understood that the processor 401 may be a central processing unit (CPU), and the processor 401 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0110] In some embodiments, the processor 401 is used to run a computer program stored in the memory 402 to implement the following steps: determine the target object in response to an information prompt request; obtain the target voice of the target object through the AIGC module; based on the target voice of the target object, output corresponding target information through the AIGC module, wherein the target information is an answer to the target voice or a question corresponding to the target voice; display the target information to prompt the wearer of the smart glasses, and receive a confirmation instruction from the wearer of the smart glasses, wherein the confirmation instruction is used to indicate that the wearer of the smart glasses asks a question or answers based on the target information.

[0111] In some embodiments, the processor 401 is also used to determine the target gaze point of the wearer of the smart glasses in response to an information prompt request; determine whether the wearer of the smart glasses stays at the target gaze point for a time greater than or equal to a preset stay time; when the stay time is greater than or equal to the preset stay time, determine the object corresponding to the target gaze point as the target object.

[0112] In some implementations, the processor 401 is further configured to save the target information in response to a save instruction, wherein the save instruction is obtained by a ring worn by a wearer of the smart glasses.

[0113] In some embodiments, the processor 401 is also used to obtain the prompt display capacity of the smart glasses; according to the prompt display capacity of the smart glasses, the target information is divided into at least one text unit, and the target text unit is used as the display content of the current display page, and displayed through the smart glasses, wherein the target text unit is the first text unit displayed.

[0114] In some embodiments, the processor 401 is further used to respond to a page turning instruction to turn the currently displayed page to display the target information, wherein the page turning instruction is sent by a remote control device connected to the smart glasses or triggered by the smart glasses.

[0115] In some embodiments, the processor 401 is also used to receive multiple current voice information, and determine the current voice information of the wearer of the smart glasses from the multiple current voice information; determine whether the position of the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page; when the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page, perform a page turning operation based on the currently displayed page.

[0116] In some implementations, the processor 401 is further configured to obtain pre-stored prompt information; and merge the prompt information with the saved target information.

[0117] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any one of the smart glasses-based interaction methods provided in the embodiments of the present application is implemented.

[0118] The computer-readable storage medium may be an internal storage unit of the smart glasses described in the foregoing embodiments, such as a hard disk or memory of the smart glasses. The computer-readable storage medium may also be an external storage device of the smart glasses, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the smart glasses.

[0119] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like.

[0120] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. An interactive method based on smart glasses, It is characterized in that The method is applied to smart glasses, and the method comprises: In response to the information prompt request, determining a target object; Acquire the target voice of the target object; Based on the target speech of the target object, outputting corresponding target information, wherein the target information is information associated with the target speech; The target information is displayed to prompt a wearer of the smart glasses.

2. The method according to claim 1, It is characterized in that The step of determining the target object in response to the information prompt request includes: In response to the information prompt request, determining a target gaze point of a wearer of the smart glasses; Determine whether the stay time of the wearer of the smart glasses at the target gaze point is greater than or equal to a preset stay time; When the stay time is greater than or equal to the preset stay time, the object corresponding to the target gaze point is determined as the target object.

3. The method according to claim 1, It is characterized in that After displaying the target information to prompt the wearer of the smart glasses, the method further includes: In response to a save instruction, a save operation is performed on the target information to obtain the saved target information, wherein the save instruction is sent by a remote control device connected to the smart glasses or is triggered by the smart glasses.

4. The method according to claim 1, It is characterized in that The displaying of the target information to prompt a wearer of the smart glasses includes: Obtaining the prompt display capacity of the smart glasses; According to the prompting display capacity of the smart glasses, the target information is divided into at least one text unit, and the target text unit is used as the display content of the current display page and displayed through the smart glasses, wherein the target text unit is the first text unit displayed.

5. The method according to claim 4, It is characterized in that The displaying of the target information to prompt a wearer of the smart glasses further includes: In response to a page turning instruction, the currently displayed page is turned to display the target information, wherein the page turning instruction is sent by a remote control device connected to the smart glasses or is triggered by the smart glasses.

6. The method according to claim 4, It is characterized in that The target information includes text information, and the displaying of the target information to prompt a wearer of the smart glasses further includes: Receiving a plurality of current voice information, and determining the current voice information of the wearer of the smart glasses from the plurality of current voice information; Determine whether the position of the text information corresponding to the current voice information of the wearer of the smart glasses is in the last line of the currently displayed page; When the text information corresponding to the current voice information of the wearer of the smart glasses is on the last line of the currently displayed page, a page turning operation is performed based on the currently displayed page to display the target information.

7. The method according to claim 3, It is characterized in that The method further comprises: Get pre-stored prompt information; The prompt information is merged with the saved target information.

8. An interactive device, It is characterized in that The interactive device comprises: A determination module, the determination module is used to determine a target object in response to an information prompt request; An acquisition module, the acquisition module is used to acquire the target speech of the target object; An output module, the output module is used to output corresponding target information based on the target speech of the target object, wherein the target information is information associated with the target speech; A display module is used to display the target information to prompt a wearer of the smart glasses.

9. A kind of smart glasses, It is characterized in that include: A memory and a processor; wherein the memory is connected to the processor and is used to store a program; the processor is used to implement the steps of the interactive method based on smart glasses as described in any one of claims 1 to 7 by running the program stored in the memory.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the steps of the smart glasses-based interaction method according to any one of claims 1 to 7.

Images