Wearable device, control method thereof, storage medium, computer program product

Abstract

The application discloses a wearable device and a control method thereof, a storage medium and a computer program product, relates to the technical field of communication, and comprises the following steps: in response to a wearing operation of a target user, acquiring image data within the visual range of the target user; in the case that it is identified that the image data comprises preset identity information, establishing a binding relationship with the preset identity information; in response to a check-in instruction of the target user, identifying whether the image data comprises check-in information; and in the case that the image data comprises the check-in information, performing a check-in operation on the target user based on the binding relationship. The application achieves the technical effect of improving the efficiency of a meeting.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a wearable device and its control method, storage medium, and computer program product. Background Technology

[0002] A gathering is an activity involving multiple people, serving important purposes such as communication, information dissemination, and exchange. Meetings, classes, training sessions, and lectures all fall under the category of gatherings. However, with the expansion of businesses, the increasing complexity of collaborative scenarios, and rising information security requirements, traditional gathering management methods face numerous challenges.

[0003] Registration is a crucial part of any gathering, but currently, the mainstream methods for managing registration are still manual verification of identity documents or paper registration sheets, and maintaining order on-site also requires human intervention. In scenarios with a large number of attendees, manual verification and paper registration methods can easily lead to congestion in the registration process, resulting in low efficiency for the gathering. Summary of the Invention

[0004] The main purpose of this application is to provide a wearable device and its control method, storage medium, and computer program product, which aims to solve the technical problem of low efficiency in organizing assemblies, assist in assembly management, and ensure the smooth conduct of assemblies.

[0005] To achieve the above objectives, this application proposes a control method for a wearable device, comprising:

[0006] In response to the wearer's operation, image data within the target user's field of vision is acquired;

[0007] If the image data is found to include preset identity information, a binding relationship with the preset identity information is established;

[0008] In response to the check-in instruction from the target user, identify whether the image data contains check-in information;

[0009] If the check-in information is included in the image data, a check-in operation is performed on the target user based on the binding relationship.

[0010] In one embodiment, the step of performing a check-in operation for the target user based on the binding relationship includes:

[0011] Obtain the pairing information contained in the check-in information;

[0012] The device is paired with the host device based on the pairing information, and a communication connection is established with the host device.

[0013] In one embodiment, after the step of performing a check-in operation for the target user based on the binding relationship when the check-in information is included in the image data, the method further includes:

[0014] In response to the questioning instruction from the target user, a request to ask a question message is sent to the host device;

[0015] If it is determined that there is no user currently asking a question, the audio data of the target user will be collected and output to the host device;

[0016] If a user is detected asking a question, a mute message will be displayed.

[0017] In one embodiment, before the step of sending a request for question message to the host device in response to the question instruction from the target user, the method further includes:

[0018] Receive the question-and-answer session start message sent by the host device;

[0019] Based on the message indicating the start of the question-asking process, a reminder to start the question-asking process is output.

[0020] In one embodiment, after the step of collecting the target user's audio data and outputting it to the host device when it is determined that there is currently no user asking a question, the method further includes:

[0021] In response to the target user's question-ending instruction, a question-ending message is sent to the host device.

[0022] In one embodiment, before the step of establishing a binding relationship with the preset identity information when the image data is identified to include preset identity information, the method further includes:

[0023] Detect whether the image data contains personnel identity information;

[0024] If the image data contains the person's identity information, the person's identity information is matched with the preset identity information to determine whether the image data includes the preset identity information.

[0025] If the image data does not contain the person's identity information, a user registration reminder will be output.

[0026] In one embodiment, after the step of performing a check-in operation for the target user based on the binding relationship when the check-in information is included in the image data, the method further includes:

[0027] In response to the translation command from the target user, audio data is collected, translated, and the translation result is output.

[0028] Alternatively, in response to the recording command from the target user, audio data is collected and saved to a preset storage space;

[0029] Alternatively, in response to the recording command from the target user, audio and image data can be collected and saved to a preset storage space.

[0030] In addition, to achieve the above objectives, this application also proposes a wearable device, the wearable device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the control method for the wearable device as described above.

[0031] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the control method for the wearable device as described above.

[0032] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the control method for wearable devices as described above.

[0033] One or more technical solutions proposed in this application have at least the following technical effects: In response to a target user's wearing operation, image data within the target user's field of vision is acquired. The target user's wearing operation can wake up the wearable device and trigger the wearable device to acquire image data, which serves as the basis for the target user's registration. If the image data includes preset identity information, a binding relationship is established with the preset identity information. The preset identity information can serve as the target user's identity credential, and the establishment of the binding relationship can be considered as registering the target user to the wearable device they are wearing. In response to the target user's check-in instruction, it is identified whether the image data contains check-in information. The check-in information is the basis for check-in, and by identifying the check-in information, it can be determined whether the current conditions for check-in are met. If the image data contains the check-in information, a check-in operation is performed on the target user based on the binding relationship. Identifying the check-in information indicates that the conditions for check-in have been met, and the preset identity information in the binding relationship can be used to check in the target user's identity. This application embodiment determines the identity of the target user performing the wearable operation by acquiring image data, and then establishes a binding relationship to achieve the purpose of user registration. The wearable device can serve as a carrier of the target user's identity information and sign in for the target user under the instruction of the sign-in command, thereby eliminating the process of manual sign-in for participants, avoiding congestion caused by excessive concentration of people, improving the efficiency of the meeting, and verifying the identity of the participants can also prevent unqualified personnel from joining the meeting, thus assisting the meeting to proceed smoothly. Attached Figure Description

[0034] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0035] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 A processor architecture diagram of a wearable device provided in this application embodiment;

[0037] Figure 2 A flowchart illustrating the first embodiment of the control method for the wearable device of this application;

[0038] Figure 3 This application provides a schematic diagram of a meeting check-in system scenario.

[0039] Figure 4This is a simplified flowchart illustrating a control method for a wearable device according to an embodiment of this application.

[0040] Figure 5 This is a schematic diagram of the module structure of the control device for a wearable device according to an embodiment of this application;

[0041] Figure 6 This is a schematic diagram of the hardware operating environment involved in the control method of the wearable device in the embodiments of this application.

[0042] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0043] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application. To better understand the technical solutions of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0044] It should be noted that the executing entity in this embodiment can be a wearable device with data processing, network communication, and program execution functions, such as AR (Augmented Reality) glasses, AR helmets, smart bracelets, etc. The following description uses AR glasses as an example to illustrate this embodiment and the subsequent embodiments.

[0045] Figure 1 A processor architecture diagram of a wearable device provided in this application embodiment is shown below. Figure 1 As shown, the wearable device in this embodiment adopts a multi-core MCU (Microcontroller Unit) architecture, where each core corresponds to a processor. Different cores are responsible for single or related functional modules, which are turned on when in use and can enter a sleep or off state when not in use to save power. Figure 1 In this wearable device, processor 1 (labeled P1), processor 2 (labeled P2), processor 3 (labeled P3), and processor 4 (labeled P4) are included. P1 is primarily used for Bluetooth (BT) or Wi-Fi scheduling, P2 is mainly used for audio data processing, P3 is mainly used for camera data acquisition and processing, and P4 handles other miscellaneous functions. P4 communicates with P1, P2, and P3 respectively, and P1 communicates with P2 and P3 respectively. P2 communicates with audio components such as microphones and speakers, controlling the microphone to acquire audio data and the speaker to output audio data. The four processors work collaboratively and can be woken up or put into sleep mode as needed.

[0046] It is understandable that the communication connection between P1 and P2 can be regarded as the transmission path of audio data, and the communication connection between P1 and P3 can be regarded as the transmission path of image data. Under this architecture design, the audio data interaction between wearable devices and the outside world, as well as the acquisition of image data, can be transmitted directly through P1 without going through P4 as a relay, resulting in higher data transmission and reception efficiency.

[0047] In one embodiment, P1 is a low-power BT / WIFI module, P2 is a high-performance audio processing chip, and P3 is an integrated smart camera module. Additionally, one or more simple MCUs can be used to control other required functions depending on the functional positioning of the wearable product; that is, the number of P4s can be multiple. Thus, on top of the basic functions, the implementation of specific functions can be achieved through fine-tuning the architecture design, resulting in strong scalability.

[0048] Based on this, embodiments of this application provide a control method for a wearable device, referring to... Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the control method for the wearable device of this application.

[0049] In this embodiment, the control method for the wearable device includes steps S10 to S40:

[0050] Step S10: In response to the wearer's operation, acquire image data within the target user's field of vision;

[0051] This application can be applied to various multi-person gathering scenarios, such as meetings, classes, training sessions, and lectures. This embodiment uses a meeting scenario as an example. In a meeting scenario, there may be participants with different roles, including a host and attendees. Attendees need to sign in to indicate their attendance. Attendees can pick up and wear AR glasses before entering the meeting.

[0052] The target users refer to the attendees who receive and wear the AR glasses. Once the target user wears the AR glasses, their position is relatively fixed, and the field of view from which the AR glasses can capture images largely overlaps with the target user's naked eye field of vision. Wearing sensors can be installed at specific locations on the AR glasses. When the target user wears the AR glasses in the correct posture, the sensors can recognize them, thus activating the relevant functions of the AR glasses. The AR glasses then begin collecting image data within their field of vision, preparing for subsequent meeting sessions.

[0053] Step S20: If the image data is found to include preset identity information, establish a binding relationship with the preset identity information;

[0054] Pre-set identity information refers to the identity information of someone qualified to attend the meeting. The binding relationship refers to the association between the pre-set identity information and the wearable device. It can be understood that meeting organizers can pre-store attendee information as pre-set identity information, or use identity information containing specific content as pre-set identity information. For example, the specific content could be at least one of a facial photo, name, or meeting identification code. The more types of specific content, the stronger the identity verification. AR glasses can collect image data in real time, analyze and compare the image data to determine whether it includes pre-set identity information. If the image data is found to include pre-set identity information, it means the target user's identity matches the pre-set identity information, and the target user is qualified to attend the meeting. This pre-set identity information can be stored in the AR glasses' memory, binding it to the AR glasses and forming a binding relationship.

[0055] In one embodiment, steps S21 to S23 are included before step S20:

[0056] Step S21: Detect whether the image data contains personnel identity information;

[0057] Personnel identification information refers to information that can verify the identity of attendees, and may include at least one of the following: name, facial photo, or attendee identification code. AR glasses can be equipped with object detection algorithms. P2 analyzes the image data to detect whether the image data contains targets of the types such as images, text, barcodes, and QR codes, and determines whether it contains personnel identification information.

[0058] Step S22: If the image data contains personnel identity information, match the personnel identity information with preset identity information to determine whether the image data contains preset identity information.

[0059] Attendees can enter with their registration credentials, which can be physical documents such as name tags or invitations printed with pre-defined identification information. AR glasses collect image data from these credentials to identify the target user. As the attendee's head position changes, the image data captured by the AR glasses also changes. When an attendee wearing the AR glasses looks at their registration credentials or other targets containing the aforementioned information, it can be determined that the image data contains the person's identification information. The detected person's identification information is then matched item by item with pre-defined identification information. If all matches are successful, the image data confirms that the pre-defined identification information is included. If no matches are found, it may indicate that an ineligible attendee has been identified, meaning the image data does not contain the pre-defined identification information.

[0060] Step S23: If the image data does not contain personal identification information, output a user registration reminder.

[0061] User registration reminders are notifications sent to target users to register and are linked to wearable devices. It's understandable that target users may not be familiar with operating AR glasses and may not register immediately after wearing them. In this case, a user registration reminder can prompt the user to register promptly. User registration reminders can take various forms, such as voice or vibration alerts, or a combination of these methods, guiding the target user to point the AR glasses' camera at their membership credential to collect preset identity information. For example, in the case of a voice reminder, P3 can wake up P4, informing P4 that it cannot recognize the preset identity information. P4 then notifies P2 via inter-core communication, controlling the audio component to output the user registration reminder.

[0062] By verifying the identity information of the personnel involved in the meeting, the participation qualifications of the target users can be checked, which can prevent unqualified personnel from using AR glasses to enter the meeting and disrupt the meeting order. At this stage, the user registration reminders can also guide the target users to register, thereby improving the user-friendliness.

[0063] Step S30: In response to the check-in instruction from the target user, identify whether the image data contains check-in information;

[0064] A check-in instruction refers to a command issued by the target user instructing the wearable device to check in. Check-in information refers to the information provided to attendees for meeting check-in. After device binding is complete, the AR glasses can use the target user's identity to check in and perform subsequent operations. During the check-in process, the AR glasses can still collect image data in real time and analyze whether the image data contains check-in information. Check-in information can be presented in various forms, such as QR codes, barcodes, and digital verification codes. Referring to the user registration process described above, check-in information can be announced in advance in various forms at the venue, and target users can check in by wearing AR glasses and collecting image data of the check-in information.

[0065] Step S40: If the image data contains check-in information, perform a check-in operation for the target user based on the binding relationship.

[0066] The general purpose of check-in is to indicate that attendees have arrived at the meeting. If the image data contains check-in information, it means the check-in criteria have been met, and check-in can be performed based on a previously established binding relationship. This binding relationship defines the connection between the target user and the wearable device. Check-in based on this binding relationship allows the wearable device to convey the target user's attendance information to the meeting organizer, and the AR glasses can send preset identity information to the organizer.

[0067] In one embodiment, performing a check-in operation for a target user based on the binding relationship may include steps S41 to S42:

[0068] Step S41: Obtain the pairing information contained in the check-in information;

[0069] Pairing information refers to the information used to pair with the host's device. The host's device is a device with meeting hosting functions; it can be a wearable device or other types of electronic devices with data processing, network communication, and program execution functions, such as computers and mobile phones. After recognizing the check-in information in the image data, the AR glasses analyze the check-in information to obtain pairing information.

[0070] Step S42: Pair with the host device according to the pairing information and establish a communication connection with the host device.

[0071] The pairing of attendees' wearable devices with the host's device can take various forms, such as Bluetooth or hotspot connections, with the goal of establishing communication links and enabling mutual communication. Understandably, with numerous attendees at the conference, each attendee's AR glasses can be paired with the host's device, forming a cluster network.

[0072] Figure 3 This application provides a schematic diagram of a meeting check-in system scenario, as shown in the embodiments of this application. Figure 3 As shown, taking Bluetooth pairing as an example, the host device can be considered the cluster center, and the AR glasses worn by each participant (AR glasses 1, AR glasses 2, AR glasses 3, AR glasses 4, AR glasses 5, etc.) can all be considered nodes. The host device can communicate with each participant individually. After a participant checks in, they join this Bluetooth cluster network and notify the host device to complete the check-in. P1 can enter a low-power working state and is idle when there is no data transmission; P2 enters a low-power voice wake-up mode, which can be considered as a sleep state, working once every 20ms to record and recognize keywords; P3 and P4 enter sleep mode.

[0073] By establishing a communication connection with the host's device through pairing, check-in can be completed, and a communication bridge can be provided between the host's device and subsequent question-and-answer sessions, thus improving check-in efficiency.

[0074] This embodiment provides a control method for a wearable device. In response to a target user's wearing operation, image data within the target user's field of vision is acquired. The target user's wearing operation can wake up the wearable device, triggering the acquisition of image data, which serves as the basis for the target user's registration. If the image data includes preset identity information, a binding relationship is established with the preset identity information. The preset identity information serves as the target user's identity credential, and establishing the binding relationship can be considered as registering the target user to the wearable device they are wearing. In response to the target user's check-in instruction, it is identified whether the image data contains check-in information. The check-in information is the basis for check-in, and identifying the check-in information determines whether the current conditions for check-in are met. If the image data contains the check-in information, a check-in operation is performed on the target user based on the binding relationship. Identifying the check-in information indicates that the conditions for check-in have been met, and the target user's identity can be checked in using the preset identity information in the binding relationship. This application embodiment determines the identity of the target user performing the wearable operation by acquiring image data, and then establishes a binding relationship to achieve the purpose of user registration. The wearable device can serve as a carrier of the target user's identity information and sign in for the target user under the instruction of the sign-in command, thereby eliminating the process of manual sign-in for participants, avoiding congestion caused by excessive concentration of people, improving the efficiency of the meeting, and verifying the identity of the participants can also prevent unqualified personnel from joining the meeting, thus assisting the meeting to proceed smoothly.

[0075] In the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description and will not be repeated hereafter. Based on this, after step S40, steps S50 to S70 are also included:

[0076] Step S50: In response to the questioning instruction from the target user, a request to ask a question message is sent to the host device;

[0077] A question instruction refers to the command given by the target user indicating that they want to ask a question. A request to ask a question message refers to a message from the wearable device requesting permission to ask a question from the host device. The target user can generate question instructions in various ways. For example, the target user can speak a keyword, the AR glasses can capture the user's voice, the P2 can recognize the correct keyword, and generate a question instruction corresponding to the keyword; or, the target user can press a specific button on the AR glasses to generate a question instruction. By determining the target user's current intention to speak through the question instructions, they can then request speaking permission from the host device.

[0078] In one embodiment, before step S50, steps S51 to S52 are further included:

[0079] Step S51: Receive the question-and-answer session start message sent by the host device;

[0080] The "Question Session Begins" message is a notification from the host's device indicating that the meeting has entered the question-and-answer session. This means the question-and-answer session is a space for participants to communicate and interact with the host. In meetings with many participants, the question-and-answer session can be centrally located. When participants' AR glasses receive the "Question Session Begins" message, they can be notified to start asking questions.

[0081] Step S52: Based on the message indicating the start of the question-asking phase, output a reminder that the question-asking phase has begun.

[0082] The "Question Start Reminder" is used to notify the target user that they have entered the question-and-answer session. The AR glasses worn by the target user communicate with the host's device. When P1 of the AR glasses receives the "Question Start Reminder" message, it wakes up P2, which then controls the audio component to output the "Question Start Reminder."

[0083] Step S60: If it is found that there is no user currently asking a question, collect the audio data of the target user and output it to the host device;

[0084] A user currently asking a question is a user who has obtained question-asking privileges and is currently asking a question. It's understandable that if no user is currently asking a question, it means that none of the participants have submitted a question to the host device. Given that a request to ask a question has already been sent to the host device, the target user's question request can be fulfilled. Therefore, the AR glasses can instruct P2 to collect audio data, which is then sent to the host device via P1 to initiate the question. P1 can also broadcast a message. Upon receiving this broadcast message, the AR glasses worn by other participants will wake up their respective P1 devices and notify P2, reminding the bound target user that a participant is currently asking a question.

[0085] In one embodiment, after step S60, step S61 is further included:

[0086] Step S61: In response to the target user's question-ending instruction, send a question-ending message to the host device.

[0087] The "End Question" command indicates that the target user has finished asking questions. To ensure uninterrupted questioning during the process, participants can use the "End Question" command to conclude their questioning session and release questioning privileges to other participants. After the target user confirms they are finished asking questions, they can verbally output a keyword. The AR glasses P2 recognize the keyword, notify P1, and send an "End Question" message through the communication connection between P1 and the host's device. This message is then broadcast to the AR glasses of all participants, indicating that they can continue asking questions.

[0088] Step S70: If a user is detected asking a question, output a mute reminder.

[0089] A mute alert is used to notify the target user that they are currently unable to ask a question. If a user is detected asking a question, it means that someone other than the target user is asking a question, and therefore the target user cannot ask a question at that moment. Based on the target user's question instruction, P1 checks the current broadcast messages and, if it detects that another participant is asking a question, it can output a mute alert via P2.

[0090] In this embodiment, the start of the Q&A session is promptly communicated to the participants, and each participant's questioning process is conducted individually without interference from others. The questioning privileges are promptly released after the Q&A session ends, all of which help maintain order at the meeting and ensure its smooth progress.

[0091] In the third embodiment of this application, the same or similar content as in the above embodiments can be referred to the above description and will not be repeated hereafter. Based on this, after step S40, steps A10, A20, or A30 may also be included:

[0092] Step A10: In response to the target user's translation instruction, collect audio data for translation and output the translation result.

[0093] It should be noted that, once the meeting is confirmed to be ready to begin, the host device can send a broadcast message to the AR glasses of each participant. Upon receiving the message, each participant's AR glasses P1 wakes up and notifies their respective P2. P2 then plays an audio notification to announce the start of the meeting. During the meeting, the AR glasses can provide various functions to the target user. After the meeting, participants return the wearable devices. After the wearable devices are powered off, the preset user information in the memory is cleared, and they need to be re-bound upon powering on.

[0094] Translation commands are used to instruct users to activate the translation function. The target user can generate translation commands via voice input or other methods. Upon receiving the command, the AR glasses activate P2, which translates the collected audio data, specifically conference audio data. The AR glasses can have a built-in default translation language and output the translation result to the target user via simultaneous voice interpretation or text display.

[0095] Step A20: In response to the recording command from the target user, audio data is collected and saved to a preset storage space.

[0096] The recording command is used to instruct the user to start the recording function. Preset storage space refers to the available storage space on the wearable device, which can be the built-in storage space of the wearable device or cloud storage. The target user can generate recording commands via voice data, etc. After the AR glasses receive the recording command, they wake up P2 and save the collected audio data.

[0097] Step A30: In response to the recording command from the target user, audio and image data are collected and saved to the preset storage space.

[0098] The recording command is used to instruct the user to start the recording function. The target user can generate recording commands through voice input or other means. After the AR glasses receive the recording command, they will wake up P2 and P3, which will jointly collect audio and image data and synthesize them into audio and video data. The data will be saved directly to the built-in storage space, or uploaded to the cloud storage space at a breakpoint. The data can then be viewed or retrieved later using preset identity information.

[0099] In this embodiment, multiple functions such as translation, audio recording, and video recording are provided to participants during the meeting process to help them quickly understand the meeting content and facilitate their review of the content after the meeting, making it highly practical.

[0100] For example, to help understand the implementation flow of the wearable device control method obtained by combining this embodiment with the above embodiments, please refer to... Figure 4 , Figure 4 A simplified flowchart of a control method for a wearable device is provided, specifically including the following steps.

[0101] 1. User registration: Bind the target user with the information of the attendees.

[0102] (1) Upon entering the venue, each participant will receive an AR glasses, at which point all processors will be in a dormant state.

[0103] (2) When the user wears AR glasses, the wear sensor connected to P4 recognizes the wearing action, sends an interrupt message to P4, and wakes up P4.

[0104] (3) P4 wakes up and notifies P3 to take pictures and collect image data through inter-core communication, and then P4 goes into sleep mode;

[0105] (4) P3 takes a picture and processes the image data to identify the person's ID in the image data;

[0106] (5) If the name and photo of the person can be extracted from the image data, P3 wakes up and notifies P4 to save the user information into memory through inter-core communication. After completion, P3 and P4 go into hibernation.

[0107] (6) If the ID cannot be identified in the image data, P3 wakes up and notifies P4 that it cannot identify user information through inter-core communication;

[0108] (7) P4 wakes up and notifies P2 to send a voice reminder to the user to look at the ID card through inter-core communication. Steps (4) and (5) are repeated. After completion, P2, P3 and P4 go into sleep.

[0109] 2. Meeting Check-in: The host and all participants will be notified of the identity information of the users actually attending the meeting. Multiple AR glasses communicate via broadcast or scanning through the BLE protocol to achieve broadcast information sharing.

[0110] (1) Prepare the host's device Bluetooth pairing information QR code in advance as a check-in code and display it on the big screen;

[0111] (2) When the user wears AR glasses and looks at the big screen, he says the command "check in". P2 records the audio every 20ms for recognition. After the keyword is recognized, the interrupt is output to P4.

[0112] (3) P4 is woken up and notifies P3 to take pictures and collect image data, and transmits the image data to P4, while P3 goes into sleep mode;

[0113] (4) P4 analyzes the QR code in the image data, obtains Bluetooth pairing information, and wakes up P1 to pair;

[0114] (5) After P1 pairing is completed, request the user information saved in P4 and send it to the host device via BLE;

[0115] (6) When the host device receives new user information, it broadcasts the user information and the corresponding Bluetooth MAC to all participants.

[0116] (7) The attendees scan information and save the attendee information broadcast by the host's device;

[0117] (8) P1 enters a low-power working state and is in an idle state when there is no data transmission.

[0118] (9) P2 enters low-power voice wake-up mode, sleeps, and works once every 20ms to record and recognize keywords.

[0119] (10) P3 and P4 enter hibernation.

[0120] 3. Meeting Process: Functions such as translation, voice prompts, video recording, and audio recording can be provided according to user needs.

[0121] In translation and recording scenarios, P2 is activated.

[0122] In a recording scenario, P2 and P3 are activated.

[0123] 4. Meeting Encore: The meeting resumes after a pause.

[0124] (1) When the host says the command "Meeting start", the host device P2 recognizes the keyword and outputs an interrupt to P1;

[0125] (2) P1 broadcasts a message to each participant. After receiving the message, each user P1 wakes up and notifies its respective P2.

[0126] (3) The user's AR glasses P2 play an audio reminder "Meeting begins".

[0127] 5. Q&A Session: Participants ask questions to the host.

[0128] (1) When the host says “Questioning begins”, the host’s device P2 recognizes the keyword and outputs an interrupt to P1;

[0129] (2) P1 broadcasts a message to each participant. After receiving the message, each user P1 wakes up and notifies its respective P2.

[0130] (3) The user's AR glasses P2 play an audio prompt "Question begins";

[0131] (4) When no one asks a question, the host sends a broadcast message to notify all participants that no one is asking a question. After receiving the message, each user P1 wakes up and notifies its respective P2.

[0132] (5) The user's AR glasses P2 play an audio reminder: "No one is asking questions now, you can say you want to grab the microphone and ask a question."

[0133] (6) When a user wants to ask a question, the user says the command "grab the microphone". The AR glasses P2 worn by the user recognize the user's command and notify P1, which then broadcasts a message.

[0134] (7) The host and all participants P1 receive the message, wake up and notify their respective P2, and P2 plays an audio reminder "User A is asking a question";

[0135] (8) If another user says "grab the microphone" at this time, the AR glasses P2 worn by that user recognize the user's command and notify P1. P1 checks the current broadcast message, recognizes that someone is asking a question, feeds back to P2, and plays an audio reminder "User A is asking a question, please wait".

[0136] (9) When the question is completed, the user says the command "Question ends". The AR glasses P2 worn by the user recognizes the user's command and notifies P1. P1 then sends a broadcast message. After each user P1 receives the message, it wakes up and notifies its own P2 to repeat step (5).

[0137] 6. Meeting ends: Participants return the AR glasses and turn them off.

[0138] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the control method of the wearable device of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0139] This application also provides a control device for a wearable device; please refer to [reference needed]. Figure 5 The control device for the wearable device includes:

[0140] The acquisition module 10, in response to the wearing operation of the target user, acquires image data within the field of view of the target user;

[0141] Module 20 establishes a binding relationship with the preset identity information when it is recognized that the image data includes preset identity information;

[0142] The identification module 30, in response to the check-in instruction of the target user, identifies whether the image data contains check-in information;

[0143] The check-in module 40, when the check-in information is included in the image data, performs a check-in operation for the target user based on the binding relationship.

[0144] The check-in module 10 is also used for:

[0145] Obtain the pairing information contained in the check-in information;

[0146] The device is paired with the host device based on the pairing information, and a communication connection is established with the host device.

[0147] The control device of the wearable device also includes a query module, used for:

[0148] In response to the questioning instruction from the target user, a request to ask a question message is sent to the host device;

[0149] If it is determined that there is no user currently asking a question, the audio data of the target user will be collected and output to the host device;

[0150] If a user is detected asking a question, a mute message will be displayed.

[0151] The questioning module is also used for:

[0152] Receive the question-and-answer session start message sent by the host device;

[0153] Based on the message indicating the start of the questioning process, a reminder to start the questioning process is output.

[0154] The questioning module is also used for:

[0155] In response to the target user's question-ending instruction, a question-ending message is sent to the host device.

[0156] The control device for the wearable device further includes a detection module, used for:

[0157] Detect whether the image data contains personnel identity information;

[0158] If the image data contains the person's identity information, the person's identity information is matched with the preset identity information to determine whether the image data includes the preset identity information.

[0159] If the image data does not contain the person's identity information, a user registration reminder will be output.

[0160] The control device for the wearable device further includes an execution module, used for:

[0161] In response to the translation command from the target user, audio data is collected, translated, and the translation result is output.

[0162] Alternatively, in response to the recording command from the target user, audio data is collected and saved to a preset storage space;

[0163] Alternatively, in response to the recording command from the target user, audio and image data can be collected and saved to a preset storage space.

[0164] The wearable device control device provided in this application, employing the wearable device control method in the above embodiments, can solve the technical problem of low efficiency in organizing gatherings. Compared with the prior art, the beneficial effects of the wearable device control device provided in this application are the same as those of the wearable device control method provided in the above embodiments, and other technical features in the wearable device control device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0165] This application provides a wearable device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the control method of the wearable device in the above embodiments.

[0166] The following is for reference. Figure 6 It shows a structural schematic diagram suitable for implementing the wearable device of the embodiments of this application. Figure 6The wearable device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0167] like Figure 6 As shown, the wearable device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in the read-only memory 1002 or a program loaded from the storage device 1003 into the random access memory 1004. The random access memory 1004 also stores various programs and data required for the operation of the wearable device. The processing unit 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output interface 1006 is also connected to the bus. Typically, the following systems can be connected to the input / output interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the wearable device to communicate wirelessly or wiredly with other devices to exchange data. While wearable devices with various systems are shown in the figures, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0168] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from read-only memory 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0169] The wearable device provided in this application, employing the control method of the wearable device in the above embodiments, can solve the technical problem of low efficiency in organizing gatherings. Compared with the prior art, the beneficial effects of the control device of the wearable device provided in this application are the same as the beneficial effects of the control method of the wearable device provided in the above embodiments, and other technical features in the wearable device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0170] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0171] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0172] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the control method of the wearable device in the above embodiments.

[0173] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0174] The aforementioned computer-readable storage medium may be included in the wearable device; or it may exist independently and not assembled into the wearable device.

[0175] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a wearable device, cause the wearable device to: acquire image data within the field of view of the target user in response to a wearing operation by the target user; establish a binding relationship with the preset identity information if the image data is found to include preset identity information; identify whether the image data contains check-in information in response to a check-in instruction from the target user; and perform a check-in operation for the target user based on the binding relationship if the image data contains the check-in information.

[0176] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0177] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0178] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0179] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the control method of the wearable device described above, which can solve the technical problem of low efficiency in organizing gatherings. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the control method of the wearable device provided in the above embodiments, and will not be repeated here.

[0180] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the control method for wearable devices as described above.

[0181] The computer program product provided in this application can solve the technical problem of low efficiency in organizing gatherings. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the wearable device control method provided in the above embodiments, and will not be repeated here.

[0182] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A control method for a wearable device, characterized in that, The control method for the wearable device includes: In response to the wearer's operation, image data within the target user's field of vision is acquired; If the image data is found to include preset identity information, a binding relationship with the preset identity information is established; In response to the check-in instruction from the target user, identify whether the image data contains check-in information; If the check-in information is included in the image data, a check-in operation is performed on the target user based on the binding relationship.

2. The control method for a wearable device as described in claim 1, characterized in that, The step of performing the check-in operation for the target user based on the binding relationship includes: Obtain the pairing information contained in the check-in information; The device is paired with the host device based on the pairing information, and a communication connection is established with the host device.

3. The control method for a wearable device as described in claim 2, characterized in that, When the image data contains the check-in information, after the step of performing the check-in operation for the target user based on the binding relationship, the method further includes: In response to the questioning instruction from the target user, a request to ask a question message is sent to the host device; If it is determined that there is no user currently asking a question, the audio data of the target user will be collected and output to the host device; If a user is detected asking a question, a mute message will be displayed.

4. The control method for a wearable device as described in claim 3, characterized in that, Before the step of sending a request to ask a question message to the host device in response to the question instruction from the target user, the method further includes: Receive the question-and-answer session start message sent by the host device; Based on the message indicating the start of the questioning process, a reminder to start the questioning process is output.

5. The control method for a wearable device as described in claim 3, characterized in that, After the step of collecting the target user's audio data and outputting it to the host device when no user is currently asking a question, the method further includes: In response to the target user's question-ending instruction, a question-ending message is sent to the host device.

6. The control method for a wearable device as described in claim 1, characterized in that, Before the step of establishing a binding relationship with the preset identity information when the image data is identified to include preset identity information, the method further includes: Detect whether the image data contains personnel identity information; If the image data contains the person's identity information, the person's identity information is matched with the preset identity information to determine whether the image data includes the preset identity information. If the image data does not contain the person's identity information, a user registration reminder will be output.

7. The control method for a wearable device as described in any one of claims 1 to 6, characterized in that, When the image data contains the check-in information, after the step of performing the check-in operation for the target user based on the binding relationship, the method further includes: In response to the translation command from the target user, audio data is collected, translated, and the translation result is output. Alternatively, in response to the recording command from the target user, audio data is collected and saved to a preset storage space; Alternatively, in response to the recording command from the target user, audio and image data can be collected and saved to a preset storage space.

8. A wearable device, characterized in that, The wearable device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the control method for the wearable device as described in any one of claims 1 to 7.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the control method for the wearable device as described in any one of claims 1 to 7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the control method for a wearable device as described in any one of claims 1 to 7.

Images