Data interaction method, device and equipment of intelligent glasses and storage medium

Abstract

The invention provides a data interaction method and device of intelligent glasses, equipment and a storage medium, and the method comprises the steps: capturing a user operation action of a current user when the current intelligent glasses and target intelligent glasses are in a connection state, feeding the user operation action back to an operation page of the intelligent glasses, and generating an operation instruction; and the function of the intelligent glasses is controlled. And sending an account association signal to the target intelligent glasses according to the operation instruction, thereby establishing an association relationship between the current user account and the target user account according to an agreement signal sent by the target intelligent glasses, thereby completing data interaction with the target user account according to the association relationship between the user accounts. By capturing the user operation action of the current user, the intelligent glasses are controlled, the operation process and the data interaction process of the intelligent glasses are simplified, the operation convenience of the data interaction function of the intelligent glasses is improved, and the use experience of the user is enhanced.

Description

Technical Field

[0001] The present application relates to the field of smart wearable technology, and in particular to a data interaction method, device, equipment and storage medium for smart glasses. Background Art

[0002] Smart glasses are wearable smart electronic devices with independent operating systems. They can be controlled by voice or motion to take pictures, watch videos, play games, and make calls, for example, AR (Augmented Reality) glasses and VR (Virtual Reality) glasses.

[0003] With the development and popularization of smart glasses technology, smart glasses need to exchange data with other devices, such as mobile phones, glasses and other devices. However, due to the size limitation of smart glasses themselves and the fact that various application technologies of smart glasses are not very mature, the data interaction function of smart glasses is not convenient to operate, which reduces the user experience. Summary of the invention

[0004] The present application provides a data interaction method, device, equipment and storage medium for smart glasses, aiming to improve the operational convenience of the data interaction function of the smart glasses and enhance the user experience.

[0005] In a first aspect, the present application provides a data interaction method for smart glasses, comprising:

[0006] When detecting that the current smart glasses are in a connected state with the target smart glasses, capturing the user operation action of the current user and generating an operation instruction;

[0007] Based on the operation instruction, sending an account association signal to the target smart glasses;

[0008] Upon receiving a consent signal sent by the target smart glasses based on the account association signal, establishing an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses;

[0009] Based on the association relationship, data interaction is performed with the target smart glasses.

[0010] In a second aspect, the present application also provides a data interaction device for smart glasses, comprising:

[0011] An operation instruction generation module is used to capture the user operation action of the current user and generate an operation instruction when detecting that the current smart glasses are in a connected state with the target smart glasses;

[0012] An association signal sending module, configured to send an account association signal to the target smart glasses based on the operation instruction;

[0013] an association relationship establishing module, configured to establish an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses upon receiving a consent signal sent by the target smart glasses based on the account association signal;

[0014] A data interaction module is used to interact with the target smart glasses based on the association relationship.

[0015] In a third aspect, the present application also provides a computer device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the data interaction method of the smart glasses as described above are implemented.

[0016] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the data interaction method for smart glasses as described above are implemented.

[0017] The present invention provides a data interaction method, device, equipment and storage medium for smart glasses. The method includes: when detecting that the current smart glasses are in a connected state with the target smart glasses, capturing the user operation action of the current user and generating an operation instruction; based on the operation instruction, sending an account association signal to the target smart glasses; when receiving the consent signal sent by the target smart glasses based on the account association signal, establishing an association relationship between the current user account corresponding to the current smart glasses and the target user account corresponding to the target smart glasses; based on the association relationship, performing data interaction with the target smart glasses. Through the above-mentioned method, when the current smart glasses are in a connected state with the target smart glasses, by capturing the user operation action of the current user, the action is fed back to the operation page of the smart glasses, and then the operation instruction is generated to realize the control of the smart glasses function. According to the operation instruction, an account association signal is sent to the target smart glasses, so that according to the consent signal sent by the target smart glasses, the association relationship between the current user account and the target user account is established, thereby completing the data interaction with the target user account according to the association relationship between the user accounts. By capturing the current user's operation actions, the smart glasses can be controlled, avoiding dependence on other electronic devices, simplifying the operation process and data interaction process of the smart glasses, reducing the difficulty of operating the smart glasses, improving the operational convenience of the data interaction function of the smart glasses, and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 A schematic diagram of a flow chart of a first embodiment of a data interaction method for smart glasses provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of a flow chart of a second embodiment of a data interaction method for smart glasses provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a flow chart of a third embodiment of a data interaction method for smart glasses provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of a flow chart of a fourth embodiment of a data interaction method for smart glasses provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of a flow chart of a fifth embodiment of a data interaction method for smart glasses provided in an embodiment of the present application;

[0024] Figure 6 It is a structural schematic diagram of a first embodiment of a data interaction device for smart glasses provided by the present application;

[0025] Figure 7 It is a schematic block diagram of the structure of a computer device provided in an embodiment of the present application.

[0026] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0029] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0030] Please refer to Figure 1 , Figure 1 A flowchart of a first embodiment of a data interaction method for smart glasses provided in an embodiment of the present application.

[0031] like Figure 1 As shown, the recharging method includes steps S101 to S104.

[0032] Step S101: when it is detected that the current smart glasses are in a connected state with the target smart glasses, the user operation action of the current user is captured and an operation instruction is generated;

[0033] In one embodiment, smart glasses may include smart electronic products such as AR glasses and VR glasses.

[0034] Among them, AR glasses are a kind of wearable smart electronic product designed and produced based on augmented reality technology. By wearing AR glasses, users can not only see actual objects in reality, but also see virtual objects or images that appear in real scenes. VR glasses use head-mounted display devices to block people's vision and hearing to the outside world, guiding users to have a feeling of being in a virtual environment. The display principle is that the left and right eye screens display the left and right eye images respectively, and the human eye obtains this different information and produces a three-dimensional sense in the mind.

[0035] In one embodiment, the current smart glasses and the target smart glasses can achieve communication connection via Bluetooth or WiFi.

[0036] In one embodiment, the smart glasses can realize the device scanning and being scanned functions through Bluetooth, WiFi or camera modules. Before the smart glasses are connected for communication, one party needs to turn on the device scanning function and the other party needs to turn on the being scanned function.

[0037] In one embodiment, when the scanning smart glasses search for the scanned smart glasses through Bluetooth, WiFi or camera module, a list of all searched smart glasses devices is displayed on the current smart glasses. The device list displays the user ID, smart glasses model and connection authorization information of each smart glasses.

[0038] In one embodiment, the camera module can capture the image of the target smart glasses and then extract key information, such as the appearance of the device or the mark of a specific part of the device. Then the key information is compared and analyzed with the smart glasses database to determine the model and function of the target smart glasses. Each smart glasses is provided with a camera module, which can be set inside the smart glasses, such as installed in the frame of the smart glasses, or connected to the smart glasses by wired connection.

[0039] In one embodiment, the user ID may be unique, and the smart glasses may be screened and the target smart glasses may be determined based on the user ID of the smart glasses. The smart glasses model may assist the user in searching for functions supported by the target smart glasses. The connection authorization information may help the user screen out smart glasses that may or may not be directly connected.

[0040] In one embodiment, the connection authorization information can be set according to user needs. For smart glasses that cannot be directly connected, when receiving a connection request, the user can choose to reject the connection or authorize the connection.

[0041] In one embodiment, the user operation action of the current user may be a gesture operation action, and the gesture operation action of the user operation may be captured by operating a remote control device connected to the smart glasses, and the remote control device may be a finger ring, a finger ring, a wristband, etc. The following description takes the remote control device as an example of a finger ring.

[0042] In one embodiment, when the current smart glasses are turned on, the operating ring can be turned on at the same time. The current smart glasses and the operating ring can be connected to each other via Bluetooth or WiFi.

[0043] In one embodiment, just like when a mouse is connected to a computer, when the operating ring is connected to the current smart glasses, the operating ring can act as a virtual mouse to display operating icons, such as arrow icons, on the display screen of the current smart glasses to display the operating position of the operating ring on the display screen of the current smart glasses, so as to facilitate the current user to accurately select and operate the functions of the current smart glasses.

[0044] In one embodiment, the operating ring can capture the user's gestures. For example, when the operating ring is placed on the index finger, the operating ring can capture the gestures of the index finger and the fingers on both sides of the index finger (thumb and middle finger). The operation button of the mouse is mapped to the operating ring. At this time, clicking the thumb is a left click, clicking the middle finger is a right click, and sliding the index finger is a scroll wheel (sliding up and down). When the hand moves, the operation icon is controlled to move on the display screen of the smart glasses.

[0045] In one embodiment, the operation instruction refers to the instruction generated by the user through various operations performed by the operating ring, such as the operation instruction generated by clicking on a certain function, such as device search instruction, personal information viewing instruction, account association application instruction, etc.

[0046] In one embodiment, the user operation action of the current user may also be an eye operation action, and the eye operation action of the user operation may be captured by eye tracking technology.

[0047] In one embodiment, the eye tracking technology uses one or more camera modules to capture a series of eye images. Then, an image processing algorithm is used to identify two key locations on each image sent by the eye tracking camera - the pupil center and the corneal reflection center. The corneal reflection point is the point where the light emitted by a fixed light source (infrared illuminator) is reflected back on the cornea.

[0048] In one embodiment, when the eye rotates, the position of the pupil center on the image sensor of the camera module will change. However, when the head is stable, the position of the corneal reflection (CR) is relatively fixed on the image sensor (because the reflection source does not move relative to the camera). The image processing technology is performed by the instrument to locate the pupil position, obtain the coordinates, and calculate the point where the eye is looking or gazing through a certain algorithm, and the coordinates of the point are fed back to the current operation page of the smart glasses, so as to determine the operation that the user needs to perform according to the eye movement.

[0049] In one embodiment, when it is detected that the current smart glasses are connected to the target smart glasses, the device information of the target smart glasses and the target user information corresponding to the target smart glasses can be displayed on the screen of the current smart glasses. The current user can manipulate the functions displayed on the screen by operating the finger ring, such as selecting the personal basic information viewing button / function of the target user by tapping, and then displaying the personal basic information of the target user on the screen of the current smart glasses.

[0050] In one embodiment, the basic personal information includes but is not limited to the user's nickname, hobbies, hometown, gender, city, age, occupation, etc. The current user and the target user can choose to disclose the basic personal information or hide the basic personal information.

[0051] Among them, if the target user chooses to disclose personal basic information, when the current user establishes a communication connection with the target user's smart glasses through smart glasses, he can directly click to view it, or directly search for and view it by searching for the target user's user nickname or account number and other information.

[0052] If the target user chooses to hide his basic personal information, the current user has no right to view it directly. If the current user wants to view the target user's basic personal information, he needs to submit a viewing request to the target user and can view it only after obtaining authorization from the target user.

[0053] Step S102: sending an account association signal to the target smart glasses based on the operation instruction;

[0054] In one embodiment, after the current user views the target user's basic personal information and becomes interested in the target user, the current user's operating actions are captured and mapped to the display page of the current smart glasses. The user chooses to click the association application button to generate an account association operation instruction to actively initiate an association application to the target smart glasses.

[0055] In one embodiment, according to the account association operation instruction, the current smart glasses generate a corresponding account association signal, and then send it to the target smart glasses via wireless communication methods such as Bluetooth or WiFi.

[0056] Step S103: upon receiving a consent signal sent by the target smart glasses based on the account association signal, establishing an association relationship between the current user account corresponding to the current smart glasses and the target user account corresponding to the target smart glasses;

[0057] In one embodiment, after receiving the account association signal sent by the current smart glasses, the target smart glasses can generate a reminder message to remind the target user to view the application details, and the target user can choose to refuse or agree.

[0058] In one embodiment, regardless of whether the target user chooses to reject or agree, the target smart glasses will generate corresponding feedback information to inform the current user of the account association result. If the target user chooses to reject, the target smart glasses will generate a rejection notification signal and send it to the current smart glasses to remind the current user that the account association failed. If the target user chooses to agree, the target smart glasses will generate an approval signal and send it to the current smart glasses.

[0059] In one embodiment, when the target user agrees to the current user's account association application, the current user account corresponding to the current smart glasses establishes an association relationship with the target user account corresponding to the target smart glasses, and the established association relationship is uploaded to the cloud server for storage, so that the current user or the target user can obtain the other party's account data through the smart glasses, such as account information, personal basic information, status information and dynamic information.

[0060] In one embodiment, establishing an association relationship means adding the target user's account ID to the associated account list of the current user's smart glasses, and paying attention to the target user's network social dynamics. The association relationship can be a one-way association relationship or a two-way association relationship. Among them, a one-way association relationship means that only one party is associated with the other party, and the other party does not return the association, that is, only one party adds the other party's account ID to the associated account list of the smart glasses; a two-way association relationship means that both parties are associated with each other, that is, both parties add the other party's account ID to the associated account list of their own smart glasses.

[0061] Step S104: Based on the association relationship, data is exchanged with the target smart glasses.

[0062] In one embodiment, after the current user account and the target user account establish an association relationship through smart glasses, dynamic information uploaded to the cloud server by the other party, such as text, pictures and videos, can be obtained through the smart glasses.

[0063] Furthermore, when the account information of the target user account is updated, based on the association relationship, update notification information sent by the target smart glasses is received; based on the update notification information, a data viewing request is sent to the cloud server to obtain the account information updated by the target user through the target smart glasses.

[0064] In one embodiment, account information may include dynamic information, status information, and user personal information.

[0065] In one embodiment, when the account information of the current user account or the target user account is updated, an update notification message may be generated and sent to the associated account via the cloud server to remind the other party to check the updated account information.

[0066] In one embodiment, based on the association relationship, the current user and the target user can use smart glasses to search for each other's dynamic information, status information, and public personal information uploaded to the cloud server.

[0067] In one embodiment, the status information may include online, offline or invisible status, etc. Dynamic information may include text, pictures and videos uploaded by users.

[0068] The present embodiment provides a data interaction method for smart glasses. When the current smart glasses are in a connected state with the target smart glasses, the method captures the user operation actions of the current user, thereby feeding back to the operation page of the smart glasses, and then generating operation instructions to realize the control of the functions of the smart glasses. According to the operation instructions, an account association signal is sent to the target smart glasses, and then an association relationship between the current user account and the target user account is established according to the consent signal sent by the target smart glasses. Thus, data interaction with the target user account can be completed according to the association relationship between the user accounts. By capturing the user operation actions of the current user, the smart glasses can be controlled, which avoids dependence on other electronic devices, simplifies the operation process and data interaction process of the smart glasses, reduces the difficulty of controlling the smart glasses, improves the convenience of operation of the data interaction function of the smart glasses, and enhances the user's experience.

[0069] Please refer to Figure 2 , Figure 2 A flowchart of a second embodiment of a data interaction method for smart glasses provided in an embodiment of the present application.

[0070] like Figure 2 As shown, the method further includes steps S201 to S203.

[0071] Step S201, starting the device scanning function of the current smart glasses to search for the device information of the target smart glasses;

[0072] In one embodiment, the smart glasses may have a device scanning function and a scanned function. The device scanning function allows the smart glasses to search for other smart glasses nearby, and the scanned function allows other smart glasses to search for the current smart glasses. The smart glasses need to turn on the device scanning function to actively search for other smart glasses nearby. Similarly, the smart glasses need to turn on the scanned function to be searched by other devices.

[0073] In one embodiment, the smart glasses can realize the device scanning and being scanned functions through Bluetooth, Wi-Fi or camera module. Before the smart glasses are connected for communication, one party needs to turn on the device scanning function and the other party needs to turn on the being scanned function.

[0074] In one embodiment, the camera can capture the image of the target smart glasses and then extract key information, such as the appearance of the device or the markings of specific parts of the device, etc. The key information is then compared and analyzed with the smart glasses database to determine the model and function of the target smart glasses.

[0075] In one embodiment, when the scanning smart glasses search for the scanned smart glasses through Bluetooth, Wi-Fi or camera, a list of all searched smart glasses devices is displayed on the current smart glasses. The device list displays the user ID, smart glasses model and connection authorization information of each smart glasses.

[0076] Step S202: judging whether the target smart glasses are connectable devices based on the device information of the target smart glasses;

[0077] In one embodiment, the device information of the target smart glasses may include the brand, model, operating system, system version, etc. of the target smart glasses.

[0078] In one embodiment, the device information of the target smart glasses is compared and queried based on the device information of the current smart glasses device or the list of devices that can support connection to determine whether the target smart glasses are smart glasses devices that can establish a communication connection with the current smart glasses.

[0079] For example, if the target smart glasses and the current smart glasses belong to the same brand, the two are allowed to establish a communication connection, and the target smart glasses are connectable devices; if the target smart glasses and the current smart glasses do not belong to the same brand, but have the same operating system, the two are allowed to establish a communication connection, and the target smart glasses are connectable devices; if the target smart glasses and the current smart glasses do not belong to the same brand, have different operating systems, and the communication connection methods supported by the two are different, the two are not allowed to establish a communication connection, and the target smart glasses are non-connectable devices.

[0080] Step S203: When it is determined that the target smart glasses are a connectable device, a communication connection is established with the target smart glasses.

[0081] In one embodiment, the connection authorization information can be set according to user needs. For smart glasses that cannot be directly connected, when receiving a connection request, the user can choose to reject the connection or authorize the connection.

[0082] In one embodiment, the connectable device may be a device that is authorized to be connected. Or it may be a smart glasses whose operating system version is within the range of allowed connection, for example, smart glasses with a lower version operating system are not allowed to connect to smart glasses with a higher version operating system, but smart glasses with a higher version operating system can connect to smart glasses with a lower version operating system. Or smart glasses with different operating systems are not allowed to connect. Or smart glasses with operating system versions that differ too much do not support communication connection.

[0083] In this embodiment, through the device scanning and being scanned functions, nearby devices are searched, so that it is convenient for users to find the target smart glasses device. According to the device information of the target smart glasses, it is determined whether the target smart glasses are connectable devices, which can avoid user connection failures, thereby timely abandoning the connection or reminding the target user to set up to allow the connection, thereby improving communication efficiency.

[0084] Please refer to Figure 3 , Figure 3 A flowchart of a third embodiment of a data interaction method for smart glasses provided in an embodiment of the present application.

[0085] like Figure 3 As shown, the method further includes step S301 to step S302.

[0086] Step S301: Based on the user ID and / or face image of the target user account, the current smart glasses send a data query request of the target user to a cloud server;

[0087] In one embodiment, when the current smart glasses are in a communication connection state with the target smart glasses, the current user can read the user ID corresponding to the target smart glasses through the current smart glasses. The current user can send the user ID of the target user and the target user's account information query request to the cloud server through the current smart glasses to query the target user's account information uploaded to the cloud server and made public.

[0088] In one embodiment, the current user can also capture the facial image of the target user through the camera module of the current smart glasses, and then send the facial image to the cloud server, perform a comparison query on the cloud server, and determine the target user's public account information.

[0089] In one embodiment, the current smart glasses can also send the user ID and the face image to the cloud server at the same time to query the target user account information to improve the accuracy of the query results.

[0090] Step S302: Receive the query result fed back by the cloud server based on the data query request, and obtain the account information of the target user account.

[0091] In one embodiment, after the cloud server queries the target user's account information based on the user ID or face image sent by the current smart glasses, it sends the target user's account information that is allowed to be disclosed to the current smart glasses for the current user to view. Correspondingly, if the target user does not authorize disclosure, the cloud server can feedback a query result signal or no viewing permission.

[0092] In this embodiment, the target user's public account basic information can be viewed based on the target user's user ID or face image, so that the current user can have a preliminary understanding of the target user and thus determine whether to establish an association with the user.

[0093] Please refer to Figure 4 , Figure 4 A flowchart of a fourth embodiment of a data interaction method for smart glasses provided in an embodiment of the present application.

[0094] like Figure 4 As shown, the method further includes steps S401 to S403.

[0095] Step S401: When it is detected that the current smart glasses and the target smart glasses are in a dialogue scene, detecting a camera deflection range of the current smart glasses;

[0096] In one embodiment, the voice detection module of the current smart glasses can detect whether the user has output voice to determine whether the user is in a conversation scene. When the voice detection module detects that the user has output voice, it can be preliminarily determined that the user is in a conversation scene.

[0097] In one embodiment, the voice detection module may be a sound sensor or a voice chip component. The voice detection module may be installed on the current smart glasses to collect sound waves around the current smart glasses and identify voice data in the sound waves.

[0098] In one embodiment, in order to improve the recognition accuracy of the dialogue scene, when the voice detection module detects that the user has output voice, it can cooperate to detect the deflection range of the camera of the current smart glasses. For example, when the user outputs voice, the current deflection angle of the camera module is recorded, and then the deflection angle of the camera module is detected in real time, and the deflection angle is compared with the current deflection angle when the user outputs voice, and the deflection range of the deflection angle relative to the current deflection angle is calculated.

[0099] In one embodiment, the camera module can be installed on the current smart glasses. When the current user turns his head, the current smart glasses deflect synchronously with the current user's head deflection, so the deflection angle of the camera module can be calculated based on the change in the coordinates of the center point of the picture captured by the camera module.

[0100] Step S402: When the camera deflection range is smaller than the preset angle range and the duration is greater than the first preset duration, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether the current user account has established an associated relationship with the target user account;

[0101] In one embodiment, when it is detected that the deflection range of the camera is less than a preset angle range, such as a 30° angle range, that is, within a 15° range on both sides of the current deflection angle when the user outputs the voice. For example, when it is detected that the current deflection angle when the user outputs the voice is 90° (i.e., facing forward), if the deflection angle of the camera is within a range of 75° to 105°, and the duration of maintaining the deflection angle within the range reaches a first preset duration, it is determined that the current user is having a conversation with the target user.

[0102] In one embodiment, when it is detected that the current user is talking to the target user, the user ID corresponding to the target smart glasses is obtained through the current smart glasses, and then the user ID is searched in the associated account list of the current smart glasses. If the user ID exists in the associated account list of the current smart glasses, it means that the current user account and the target user account have established an associated relationship; if the user ID does not exist in the associated account list of the current smart glasses, it means that the current user account and the target user account are not yet associated.

[0103] Step S403: When no association relationship is established between the current user account and the target user account, association reminder information is generated to capture the user operation action performed by the current user according to the association reminder information.

[0104] In one embodiment, when it is detected that the current user is conversing with the target user and no association is established between the current user account and the target user account, the current smart glasses of the current user may generate an account association reminder to remind the current user to establish an association with the target user.

[0105] In one embodiment, when generating the associated reminder information, when the user views the associated reminder information, the operation intention of the current user can be determined by capturing the user operation action of the current user, thereby generating a corresponding operation instruction.

[0106] In one embodiment, the current user can choose to ignore the reminder or choose to agree to the application. If the user chooses to agree to the application, the current smart glasses apply for a friend application signal, send it to the target smart glasses, and wait for feedback from the target smart glasses. When the target user receives the friend application signal, he can choose to ignore, reject or agree through the target smart glasses, and feedback the result to the current smart glasses.

[0107] In this embodiment, by detecting the current user's voice and the camera deflection angle, it is determined whether the current user is interested in the target user, that is, it is inferred whether the current user needs to establish an association with the target user, thereby avoiding manual search, addition and information switching operations by the user, and improving the convenience of the basic social functions of smart glasses.

[0108] Please refer to Figure 5 , Figure 5 A flowchart of a fifth embodiment of a data interaction method for smart glasses provided in an embodiment of the present application.

[0109] As shown in 5, the method further includes steps S501 to S504.

[0110] Step S501: when it is detected that the current user and the target user are in a conversation scene, based on a camera module, a facial image of the target user is collected, and a collection method of the facial image of the target user is detected;

[0111] In one embodiment, when it is detected that the target smart glasses are in a connected state, if it is detected that the current user is talking to the target user, a facial image of the target user is collected through a camera module.

[0112] In one embodiment, the voice detection mode can be used to detect whether the current user outputs voice. If it is detected that the current user outputs voice, it can be determined that the current user is talking to the target user.

[0113] In one embodiment, the camera module may include a CMOS sensor or an infrared sensor.

[0114] In one embodiment, the acquisition method of the camera module may include continuous acquisition or interval acquisition.

[0115] Among them, continuous acquisition means that the camera module maintains the image acquisition state at a preset frame rate to obtain a continuous set of pictures or videos. Interval acquisition means that the camera module acquires a frame of picture at a preset time interval, thereby obtaining a set of pictures acquired in chronological order. The time interval for interval acquisition of pictures is generally greater than the time interval for continuous acquisition of pictures. For example, if the frame rate of continuous acquisition is set to 10FPS, it means that 10 pictures are collected within 1s; while interval acquisition can be set to collect a frame of picture every 3s.

[0116] Step S502: when it is detected that the acquisition mode of the face image of the target user is continuous acquisition, the accumulated acquisition time of the face image of the target user is obtained;

[0117] In one embodiment, when the target user's facial image is collected in a continuous manner, a recording mode or a video collection mode can be displayed on the current smart glasses, and the cumulative collection time of the continuous collection is recorded, that is, the cumulative time of the complete facial image of the target user collected by the camera module of the current smart glasses.

[0118] In one embodiment, if the facial image of the target user is not collected or the facial image is incomplete during the continuous collection process, it will not be counted in the cumulative collection time.

[0119] Step S503: When the accumulated collection time is greater than a second preset time, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether an associated relationship has been established between the current user account and the target user account;

[0120] In one embodiment, in the continuous acquisition mode, when the cumulative acquisition time for completely acquiring the complete facial image of the target user is greater than the second preset time, it indicates that the current user is interested in the target user.

[0121] For example, when the cumulative acquisition time of the current smart glasses in the continuous acquisition mode to completely capture the complete facial image of the target user is greater than 3 minutes, it means that the current user may have a long conversation with the target user, or frequently have a conversation with the target user, and it can be judged that the current user is interested in the target user.

[0122] Furthermore, when it is detected that the facial image of the target user is collected in an interval collection mode, the number of collection times of the facial image of the target user within a third preset time length is obtained; when the number of collection times is greater than the preset number, based on the user ID of the target smart glasses, the associated account list of the current smart glasses is searched to determine whether an association relationship has been established between the current user account and the target user account; when an association relationship has not been established between the current user account and the target user account, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

[0123] In one embodiment, when the target user's facial image is collected in interval collection, timing starts from the first complete facial image of the target user collected, and the number of times the target user's complete facial image is collected within the third preset time length is recorded.

[0124] In one embodiment, if the number of complete facial images of the target user collected within the third preset time period is greater than the preset number, it indicates that the current user is interested in the target user. For example, if the number of complete facial images of the target user collected by the current user within one minute is greater than five times, that is, the current user may be facing the target user all the time or looking at the target user frequently, in which case it can be determined that the current user is interested in the target user.

[0125] In one embodiment, when the current smart glasses determine that the current user is interested in the target user based on the acquisition results of the camera module, the user ID of the target smart glasses is obtained through the current smart glasses, and then the user ID is searched in the associated account list of the current smart glasses.

[0126] In one embodiment, if the user ID is found in the associated account list of the current smart glasses, it means that the current user account is associated with the target user account.

[0127] In one embodiment, if the user ID is not found in the associated account list of the current smart glasses, it means that the current user account is not associated with the target user account.

[0128] Step S504: when no association relationship is established between the current user account and the target user account, generate association reminder information to capture the user operation action performed by the current user according to the association reminder information.

[0129] In one embodiment, when it is determined that the current user is interested in the target user and the current user account has not established an association relationship with the target user account, association reminder information is generated to remind the current user to apply for account association with the target user.

[0130] In one embodiment, the current user can choose to ignore the application reminder information, or can choose to agree to the application. If the current user chooses to agree to the application, the current smart glasses generate a corresponding account association application signal and send it to the target smart glasses.

[0131] In one embodiment, when the target smart glasses receive the account association application sent by the current smart glasses, they display the application to the target user. The target user can choose to ignore, reject or agree by operating the ring. The target smart glasses generate a corresponding feedback signal according to the target user's selection result, such as a rejection notification signal or an association agreement signal, and send the feedback signal to the current smart glasses to remind the current user of the account association application result.

[0132] In this embodiment, when it is detected that the current user and the target user are in a dialogue scene, the face image of the target user is collected through the image collection module, and the current user's interest in the target user is judged according to the collection method and the corresponding collection result, so as to judge whether the current user account needs to be associated with the target user account. Then, when it is judged that the current user is interested in the target user, a reminder message is generated to prevent the user from forgetting and to avoid the user from performing complex operations such as manual search, addition and information switching, thereby simplifying the operation of establishing relationships with friends and improving the convenience of the basic social functions of smart glasses.

[0133] See also Figure 6 , Figure 6 It is a structural schematic diagram of a first embodiment of a data interaction device for smart glasses provided in the present application, and the data interaction device for smart glasses is used to execute the aforementioned data interaction method for smart glasses.

[0134] like Figure 6As shown, the data interaction device 600 of the smart glasses includes: an operation instruction generating module 601, an association signal sending module 602, an association relationship establishing module 603 and a data interaction module 604.

[0135] in:

[0136] The operation instruction generating module 601 is used to capture the user operation action of the current user and generate an operation instruction when detecting that the current smart glasses are in a connected state with the target smart glasses;

[0137] An association signal sending module 602, configured to send an account association signal to the target smart glasses based on the operation instruction;

[0138] An association relationship establishing module 603 is used to establish an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses when receiving a consent signal sent by the target smart glasses based on the account association signal;

[0139] The data interaction module 604 is used to interact with the target smart glasses based on the association relationship.

[0140] In one embodiment, the data interaction module 604 is also used to receive update notification information sent by the target smart glasses based on the association relationship when the account information of the target user account is updated; based on the update notification information, send a data viewing request to the cloud server to obtain the account information updated by the target user through the target smart glasses.

[0141] In one embodiment, the data interaction device 600 of the smart glasses also includes an account information query module, which is used for the current smart glasses to send a data query request of the target user to a cloud server based on the user ID and / or face image of the target user account; receive the query result fed back by the cloud server based on the data query request, and obtain the account information of the target user account.

[0142] In one embodiment, the data interaction device 600 of the smart glasses also includes an association application module, which is used to detect the camera deflection range of the current smart glasses when it is detected that the current smart glasses and the target smart glasses are in a dialogue scene; when the camera deflection range is less than the preset angle range and the duration is greater than the first preset duration, based on the user ID of the target smart glasses, search the associated account list of the current smart glasses to determine whether the current user account and the target user account have established an association relationship; when the current user account and the target user account have not established an association relationship, generate association reminder information to capture the user operation action performed by the current user according to the association reminder information.

[0143] In one embodiment, the association application module is also used to, when it is detected that the current user and the target user are in a dialogue scene, based on a camera module, collect the facial image of the target user and detect the collection method of the facial image of the target user; when it is detected that the collection method of the facial image of the target user is continuous collection, obtain the cumulative collection time of the facial image of the target user; when the cumulative collection time is greater than a second preset time, based on the user ID of the target smart glasses, search the associated account list of the current smart glasses to determine whether the current user account and the target user account have established an association relationship; when the current user account and the target user account have not established an association relationship, generate association reminder information to capture the user operation action performed by the current user according to the association reminder information.

[0144] In one embodiment, the association application module is also used to obtain the number of collection times of the target user's facial image within a third preset time period when it is detected that the collection method of the target user's facial image is interval collection; when the number of collection times is greater than the preset number, based on the user ID of the target smart glasses, search the associated account list of the current smart glasses to determine whether the current user account and the target user account have established an association relationship; when the current user account and the target user account have not established an association relationship, generate association reminder information to capture the user operation action performed by the current user according to the association reminder information.

[0145] In one embodiment, the data interaction device 600 of the smart glasses also includes a communication connection establishment module, which is used to start the device scanning function of the current smart glasses and search for the device information of the target smart glasses; based on the device information of the target smart glasses, determine whether the target smart glasses are connectable devices; when it is determined that the target smart glasses are connectable devices, establish a communication connection with the target smart glasses.

[0146] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the above-described device and each module can refer to the corresponding process in the aforementioned shooting method embodiment based on the split camera module, and will not be repeated here.

[0147] The apparatus provided in the above embodiment may be implemented in the form of a computer program. The computer program may be Figure 7 Runs on the computer device shown.

[0148] See also Figure 7 , Figure 7 1 is a schematic block diagram of a computer device provided in an embodiment of the present application. The computer device may be a server.

[0149] See also Figure 7 The computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0150] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any shooting method based on the split camera module.

[0151] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0152] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any shooting method based on the split camera module.

[0153] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 7 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0154] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0155] In one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:

[0156] When detecting that the current smart glasses are in a connected state with the target smart glasses, capturing the user operation action of the current user and generating an operation instruction;

[0157] Based on the operation instruction, sending an account association signal to the target smart glasses;

[0158] Upon receiving a consent signal sent by the target smart glasses based on the account association signal, establishing an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses;

[0159] Based on the association relationship, data interaction is performed with the target smart glasses.

[0160] In one embodiment, the processor implements the data interaction between the current smart glasses and the target smart glasses based on the association relationship, and is further configured to implement:

[0161] When the account information of the target user account is updated, based on the association relationship, receiving update notification information sent by the target smart glasses;

[0162] Based on the update notification information, a data viewing request is sent to a cloud server to obtain the account information updated by the target user through the target smart glasses.

[0163] In one embodiment, when the processor runs the computer program stored in the memory, it is also used to implement:

[0164] Based on the user ID and / or face image of the target user account, the current smart glasses send a data query request of the target user to the cloud server;

[0165] Receive the query result fed back by the cloud server based on the data query request, and obtain the account information of the target user account.

[0166] In one embodiment, when the processor runs the computer program stored in the memory, it is also used to implement:

[0167] When it is detected that the current smart glasses and the target smart glasses are in a dialogue scene, detecting a camera deflection range of the current smart glasses;

[0168] When the camera deflection range is smaller than the preset angle range and the duration is greater than the first preset duration, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether the current user account has established an associated relationship with the target user account;

[0169] When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

[0170] In one embodiment, when the processor runs the computer program stored in the memory, it is also used to implement:

[0171] When it is detected that the current user and the target user are in a conversation scene, based on the camera module, a facial image of the target user is collected, and a collection method of the facial image of the target user is detected;

[0172] When it is detected that the acquisition mode of the face image of the target user is continuous acquisition, obtaining the cumulative acquisition time of the face image of the target user;

[0173] When the accumulated collection time is greater than a second preset time, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether an associated relationship has been established between the current user account and the target user account;

[0174] When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

[0175] In one embodiment, after implementing the camera module, collecting the face image of the target user, and detecting the collection method of the face image of the target user, the processor is further used to implement:

[0176] When it is detected that the facial image of the target user is collected in an interval collection mode, obtaining the number of collection times of the facial image of the target user within a third preset time length;

[0177] When the number of collections is greater than a preset number of times, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses, and determining whether the current user account has established an associated relationship with the target user account;

[0178] When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

[0179] In one embodiment, when the processor runs the computer program stored in the memory, it is also used to implement:

[0180] Start the device scanning function of the current smart glasses to search for the device information of the target smart glasses;

[0181] Based on the device information of the target smart glasses, determining whether the target smart glasses are connectable devices;

[0182] When it is determined that the target smart glasses are a connectable device, a communication connection is established with the target smart glasses.

[0183] A computer-readable storage medium is also provided in an embodiment of the present application, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and the processor executes the program instructions to implement any one of the shooting methods based on the split camera module provided in the embodiments of the present application.

[0184] The computer-readable storage medium may be an internal storage unit of the computer device described in the above embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SmartMediaCard, SMC), a secure digital (SecureDigital, SD) card, a flash card (FlashCard), etc. equipped on the computer device.

[0185] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A data interaction method for smart glasses, It is characterized in that The method is applied to current smart glasses, and the method further includes: When detecting that the current smart glasses are in a connected state with the target smart glasses, capturing the user operation action of the current user and generating an operation instruction; Based on the operation instruction, sending an account association signal to the target smart glasses; Upon receiving a consent signal sent by the target smart glasses based on the account association signal, establishing an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses; Based on the association relationship, data interaction is performed with the target smart glasses.

2. The data interaction method of smart glasses according to claim 1, It is characterized in that Based on the association relationship, the current smart glasses and the target smart glasses perform data interaction, including: When the account information of the target user account is updated, based on the association relationship, receiving update notification information sent by the target smart glasses; Based on the update notification information, a data viewing request is sent to a cloud server to obtain the account information updated by the target user through the target smart glasses.

3. The data interaction method of smart glasses according to claim 1, It is characterized in that The method further comprises: Based on the user ID and / or face image of the target user account, the current smart glasses send a data query request of the target user to the cloud server; Receive the query result fed back by the cloud server based on the data query request, and obtain the account information of the target user account.

4. The data interaction method of smart glasses according to claim 1, It is characterized in that After detecting that the current smart glasses are in a connected state with the target smart glasses, the method further includes: When it is detected that the current smart glasses and the target smart glasses are in a dialogue scene, detecting a camera deflection range of the current smart glasses; When the camera deflection range is smaller than the preset angle range and the duration is greater than the first preset duration, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether the current user account has established an associated relationship with the target user account; When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

5. The data interaction method of smart glasses according to claim 1, It is characterized in that After detecting that the current smart glasses are in a connected state with the target smart glasses, the method further includes: When it is detected that the current user and the target user are in a conversation scene, based on the camera module, a facial image of the target user is collected, and a collection method of the facial image of the target user is detected; When it is detected that the acquisition mode of the face image of the target user is continuous acquisition, obtaining the cumulative acquisition time of the face image of the target user; When the accumulated collection time is greater than a second preset time, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses to determine whether an associated relationship has been established between the current user account and the target user account; When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

6. The data interaction method of smart glasses according to claim 5, It is characterized in that After collecting the face image of the target user based on the camera module and detecting the collection method of the face image of the target user, the method further includes: When it is detected that the facial image of the target user is collected in an interval collection mode, obtaining the number of collection times of the facial image of the target user within a third preset time length; When the number of collections is greater than a preset number of times, searching the associated account list of the current smart glasses based on the user ID of the target smart glasses, and determining whether the current user account has established an associated relationship with the target user account; When the current user account and the target user account have not established an association relationship, association reminder information is generated to facilitate capturing the user operation action performed by the current user according to the association reminder information.

7. The data interaction method of smart glasses according to any one of claims 1 to 6, It is characterized in that The method further comprises: Start the device scanning function of the current smart glasses to search for the device information of the target smart glasses; Based on the device information of the target smart glasses, determining whether the target smart glasses are connectable devices; When it is determined that the target smart glasses are a connectable device, a communication connection is established with the target smart glasses.

8. A data interaction device for smart glasses, It is characterized in that The data interaction device of the smart glasses comprises: An operation instruction generation module is used to capture the user operation action of the current user and generate an operation instruction when detecting that the current smart glasses are in a connected state with the target smart glasses; An association signal sending module, configured to send an account association signal to the target smart glasses based on the operation instruction; an association relationship establishing module, configured to establish an association relationship between a current user account corresponding to the current smart glasses and a target user account corresponding to the target smart glasses upon receiving a consent signal sent by the target smart glasses based on the account association signal; A data interaction module is used to interact with the target smart glasses based on the association relationship.

9. A computer device, It is characterized in that The computer device includes a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the data interaction method for smart glasses as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the data interaction method for smart glasses according to any one of claims 1 to 7 are implemented.

Images