Intelligent control method and device, wearable device, and storage medium

Abstract

The present disclosure provides an intelligent control method and device, a wearable device, and a storage medium, which belongs to the field of artificial intelligence technology. The method is applied to a first device, and the first device includes an image acquisition device and a display device, including: in response to a first wake-up instruction of a first user matching a first preset wake-up instruction, controlling the image acquisition device and / or the display device to execute a control instruction corresponding to the first wake-up instruction based on a first power consumption, and the first user is a user wearing the first device; in response to a first control instruction of the first user matching a first preset control instruction, determining a first working mode of the first device, and the working mode of the first device is any working mode of the first device; when the first device is in the first working mode, controlling the image acquisition device and / or the display device based on a second control instruction. The intelligent control method and device, wearable device, and storage medium provided by the present disclosure can improve user experience.

Description

Technical Field

[0001] The present disclosure belongs to the field of artificial intelligence technology, and more specifically, relates to an intelligent control method and apparatus, a wearable device, and a storage medium. Background Art

[0002] With the advancement of technology, smart wearable devices, such as smart glasses, are becoming increasingly popular. These devices are typically equipped with image acquisition devices (such as cameras) and display devices. However, traditional control methods have many shortcomings. For example, all functions are often activated simultaneously during device operation, making it impossible to precisely activate modules based on actual needs, resulting in unnecessary energy waste and cumbersome operation. The selection of specific operating modes and subsequent control of related devices are not flexible enough, making it difficult to quickly and accurately meet the user's current requirements. This leads to low efficiency and a poor user experience. Summary of the Invention

[0003] The purpose of the present disclosure is to provide an intelligent control method and apparatus, a wearable device, and a storage medium to improve user experience.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an intelligent control method, which is applied to a first device, wherein the first device includes an image acquisition device and a display device, including: In response to a first wake-up instruction of a first user matching a first preset wake-up instruction, waking up the image acquisition device and / or the display device, where the first user is a user wearing the first device; In response to a first control instruction of a first user matching a first preset control instruction, determining a first operating mode of a first device, the operating mode of the first device being any operating mode of the first device; When the first device is in the first working mode, the image acquisition device and / or the display device is controlled based on a second control instruction.

[0005] According to a second aspect of the embodiments of the present disclosure, an intelligent control device is provided, which is applied to a first device. The first device includes an image acquisition device and a display device, including: a wake-up module, configured to control an image acquisition device and / or a display device to execute a control instruction corresponding to the first wake-up instruction based on a first power consumption in response to a first wake-up instruction of a first user matching a first preset wake-up instruction, wherein the first user is a user wearing the first device; a mode selection module, configured to determine a first operating mode of the first device in response to a first control instruction of the first user matching a first preset control instruction, wherein the operating mode of the first device is any operating mode of the first device; A control module is configured to control the image acquisition device and / or display device based on a second control instruction when the first device is in the first operating mode.

[0006] According to a third aspect of an embodiment of the present disclosure, a wearable device is provided, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the above-mentioned intelligent control method when executing the computer program.

[0007] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned intelligent control method are implemented.

[0008] The beneficial effects of the intelligent control method and device, wearable device, and storage medium provided by the embodiments of the present disclosure are as follows: the embodiments of the present disclosure wake up the image acquisition device and / or display device by matching the first wake-up instruction issued by the first user with the preset wake-up instruction. This flexible wake-up mechanism can accurately activate the corresponding modules according to the actual needs of the user, avoid unnecessary function activation, and save device energy consumption. For example, only the acquisition device can be woken up when only shooting. Secondly, the working mode is determined by matching the first control instruction with the first preset control instruction, so that the user can quickly select specific work scenes such as taking pictures and recording videos as needed. The operation is convenient and accurate, and the use efficiency is improved. Finally, in the determined working mode, the relevant devices are controlled according to the second control instruction. Whether it is adjusting the parameters of the image acquisition device to obtain a clear picture, or changing the parameters of the display device to assist in framing and viewing, the device can better meet the user's current usage requirements, and the overall convenience, functionality and user experience of the first device are enhanced. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0010] Figure 1 A flow chart of an intelligent control method provided in one embodiment of the present disclosure; Figure 2 A structural block diagram of an intelligent control device provided in one embodiment of the present disclosure; Figure 3 A schematic block diagram of a wearable device provided in one embodiment of the present disclosure. DETAILED DESCRIPTION

[0011] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present disclosure. However, it will be apparent to those skilled in the art that the present disclosure may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present disclosure with unnecessary detail.

[0012] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, specific embodiments will be described below with reference to the accompanying drawings.

[0013] Please refer to Figure 1 , Figure 1 This is a flow chart of an intelligent control method provided in one embodiment of the present disclosure. The method is applied to a first device, which includes an image acquisition device and a display device.

[0014] In this embodiment, the first device is various wearable devices that have image acquisition devices and display devices and need to operate according to a specific intelligent control method, such as smart wearable devices with cameras and screens, smart monitoring terminals, etc. Its characteristics are that it relies on image acquisition and display functions and is controlled by specific instructions to achieve different working states.

[0015] In this embodiment, the first device may be smart glasses. The image acquisition device is a hardware component that can obtain external visual information, such as a camera. For smart glasses, the image acquisition device may be a miniature camera integrated into the frame, whose function is to capture image information such as pictures, objects, and people in the surrounding environment for subsequent storage, processing, display, or execution of corresponding tasks based on these image data, such as taking pictures, recording videos, identifying scenes, and other operations. The display device is a hardware part used to present various types of visual information to the user for viewing, such as the micro display screen in smart glasses. It can display the real-time images captured by the image acquisition device, and can also display images, videos, text information stored in the device, and some processed visualization results, to help users obtain information more intuitively and experience related application scenarios.

[0016] The method includes: S101: In response to a first wake-up instruction of a first user matching a first preset wake-up instruction, controlling an image acquisition device and / or a display device to execute a control instruction corresponding to the first wake-up instruction based on a first power consumption, where the first user is a user wearing a first device.

[0017] In this embodiment, after the first user issues a first wake-up command, this embodiment can match the first wake-up command with a pre-set first preset wake-up command. The first preset wake-up command can be a specific voice command (such as "turn on the glasses") or an instruction in the form of an electrical signal generated by performing a specific operation on a physical button on the first device. Once the match is successful, the image acquisition device and / or display device can be awakened. This means that the smart glasses are ready to enter a state where they can capture images or perform display-related operations.

[0018] In this embodiment, "and / or" indicates that the first device may be awakened in different situations. It may be possible to awaken only the image capture device, for example, when a user wishes to use the smart glasses solely to capture images of their surroundings and temporarily does not need the display function, in which case only the hardware and software modules related to image capture are activated. Alternatively, it may be possible to awaken only the display device, for example, when a user wishes to view previously stored images, such as images or videos, in which case only the display module is activated. It may also be possible to awaken both devices simultaneously, for example, when real-time image capture is required and a processed image is immediately displayed on the glasses' display interface, in which case both devices need to be awakened and work together.

[0019] In this embodiment, the state corresponding to the first power consumption may be a standby state. The standby state is a low-power state, meaning that after being awakened, the image acquisition device and / or display device does not immediately operate at full power, but instead prepares to perform subsequent tasks in a more energy-efficient manner. This helps extend the battery life of the first device, particularly in scenarios where the device needs to frequently awaken and switch operating states.

[0020] When the first wake-up instruction matches the first preset wake-up instruction, this embodiment can identify the devices that need to be awakened (which can be the image acquisition device, the display device, or both), and then send control signals to these devices, instructing them to begin operating in a standby state. In the standby state, these devices can perform initialization operations and prepare to receive and process subsequent control instructions (such as the first control instruction or the second control instruction), while not consuming excessive power.

[0021] For example, when the first wake-up instruction matches the first preset wake-up instruction, for the image acquisition device (such as the camera on smart glasses), only a small number of necessary functions such as the most basic sensor calibration may be started, rather than immediately starting full-function image capture, and relatively power-consuming functional modules such as high frame rate shooting and complex image optimization algorithms will not be immediately turned on; for the display device, the screen backlight can be lit to a lower brightness and some simple prompt information (such as the awakened logo, etc.) can be displayed, rather than directly entering the full brightness, full color working state to display various complex pictures.

[0022] This embodiment effectively extends the battery life of the first device by associating the response to the wake-up instruction with the operation of the image acquisition device and / or display device based on the first power consumption. This embodiment is particularly suitable for scenarios involving frequent wake-up and switching of operating states, thereby avoiding rapid battery depletion due to unnecessary high-power operation. Furthermore, in the standby mode, the awakened device can perform initialization operations to prepare for receiving and processing subsequent control instructions. This ensures that the device can respond to subsequent operations in a timely manner while operating in an energy-efficient manner. For example, the image acquisition device may only initiate basic sensor calibration, and the display device may display a simple prompt message at a low brightness, thus meeting basic functional requirements while reducing power consumption.

[0023] S102: In response to a first control instruction of a first user matching a first preset control instruction, determining a first operating mode of the first device, where the operating mode of the first device is any operating mode of the first device.

[0024] In this embodiment, the first control instruction is a command issued by the first user after the device is awakened, and is used to determine the specific operating mode of the first device. After the awakening operation is completed, the specific work task scenario to be performed by the device can be accurately selected through command matching, that is, the operating mode is determined.

[0025] After completing the wake-up operation, when the first user then issues a first control instruction, this instruction will also be compared and matched with the first preset control instruction. The first preset control instruction is associated with determining the working mode of the first device, and different preset control instructions correspond to different working modes. For example, for smart glasses, clients include multiple working modes such as photo mode, video mode, and navigation mode. If the first control instruction issued by the user matches the preset control instruction corresponding to the photo mode (for example, a voice saying "enter photo mode" or pressing a specific photo function button, etc.), then it can be determined that the first device (smart glasses) has entered the photo working mode.

[0026] S103: When the first device is in the first working mode, control the image acquisition device and / or the display device based on the second control instruction.

[0027] In this embodiment, when the first device is already in a determined first working mode (such as a photographing mode), if a second control instruction is subsequently received, this embodiment can control the image acquisition device and / or display device according to this instruction.

[0028] For example, if the second control instruction is a "focus" instruction, then the image acquisition device (camera-related components) can perform automatic focusing operations according to this instruction and adjust hardware parameters such as the lens to obtain a clear shooting picture; if there is a relevant second control instruction in terms of display, such as "switch display screen parameters (such as brightness, contrast, etc.)", then the display device can change the corresponding display effect parameters according to the instruction, so as to better assist in framing during image acquisition or meet the user's needs for viewing the picture.

[0029] For example, suppose user A is preparing to use smart glasses to capture a beautiful sunset. After putting on the smart glasses, they utter a specific voice command, "Turn on glasses" (the first wake-up command). The smart glasses' internal system quickly matches this command with a pre-set first wake-up command. Since the match is successful, the image capture device of the smart glasses is awakened. Since user A only wants to capture the sunset and does not need the display function at this time, only the camera-related hardware and software modules are activated.

[0030] Next, user A presses a specific photo-taking function button on the leg of the smart glasses to begin photographing the sunset. This action generates a command known as a first control command. The smart glasses compare this command with a first preset control command. Because the button press matches the preset control command for photo mode, the smart glasses determine that they have entered photo mode.

[0031] While in photo mode, user A notices that the image is blurry. They issue a second control command, "Focus," via voice. Upon receiving this command, the image acquisition device (camera) automatically adjusts hardware parameters, such as the lens' focal length, to gradually sharpen the image, preparing to capture a beautiful sunset. Simultaneously, user A can also issue a second control command, such as "Adjust Brightness," to the display device by pressing another button (although the primary focus is currently on shooting, the display device can be used to assist in reviewing the results). The display device then adjusts the brightness accordingly, allowing user A to better confirm that the image meets their expectations, allowing them to successfully capture the sunset.

[0032] From the above, it can be concluded that the present embodiment wakes up the image acquisition device and / or display device by matching the first wake-up instruction issued by the first user with the preset wake-up instruction. This flexible wake-up mechanism can accurately activate the corresponding modules according to the actual needs of the user, avoid unnecessary function activation, and save device energy consumption. For example, only the acquisition device can be woken up when only shooting. Secondly, the working mode is determined by matching the first control instruction with the first preset control instruction, allowing the user to quickly select specific work scenes such as taking pictures, recording videos, etc. as needed. The operation is convenient and accurate, and the use efficiency is improved. Finally, in the determined working mode, the relevant devices are controlled according to the second control instruction. Whether it is adjusting the parameters of the image acquisition device to obtain a clear picture, or changing the parameters of the display device to assist in framing and viewing, the device can better meet the user's current usage requirements, and the overall convenience, functionality and user experience of the first device are enhanced.

[0033] In an embodiment of the present disclosure, if the first control instruction of the first user is not received within the first time, the process returns to the step of responding to the first user's first wake-up instruction matching the first preset wake-up instruction.

[0034] In this embodiment, the first time is a time threshold preset in this embodiment, and its purpose is to determine whether the first control instruction from the first user can be received in time after the image acquisition device and / or the display device is awakened.

[0035] If this embodiment does not receive the first control instruction from the first user within the set first time, it means that the user may not have further clarified which specific operating mode the first device should enter, or may not immediately intend to operate the device to perform subsequent functions. In this case, this embodiment can return to the step of "responding to the first user's first wake-up instruction matching the first preset wake-up instruction." This is equivalent to resetting the state of the first device to the wake-up instruction matching stage, and the first device can continue to wait for the next user-issued wake-up instruction and subsequent corresponding control instructions.

[0036] For example, after the user wakes up the relevant devices of the smart glasses, due to a temporary delay, he is unable to issue a control command to select the working mode in time. Then after 5 minutes, the smart glasses will return to the state of waiting for the wake-up command to match, and wait for the user to operate the corresponding process again when he is free later.

[0037] From the above, it can be concluded that this embodiment introduces a double check of time threshold and instruction matching, which can ensure that the first device will not remain in an uncertain standby state when it does not receive a valid subsequent instruction, and rationally utilize resources. At the same time, it is also ready to respond to new user operation requirements again at any time, avoiding potential problems such as power consumption and freezes that may arise due to the first device being in unnecessary low-power waiting for a long time, making the control process of the first device more flexible and reasonable.

[0038] In one embodiment of the present disclosure, when the first device is in the first working mode, before controlling the image acquisition device and / or the display device based on the second control instruction, the method further includes: When the first device is in the first working mode, controlling the image acquisition device and / or the display device to execute a control instruction corresponding to the first control instruction based on the second power consumption; The second power consumption is greater than the first power consumption.

[0039] In this embodiment, during the wake-up phase, the image acquisition device and / or display device operates at a first power consumption level. The first power consumption level is a low-power, simple initialization state that activates only the most basic functions to conserve energy while awaiting further instructions. After entering the first operating mode, the first device needs to be more fully prepared for the specific task to be performed, so increasing power consumption to the second power consumption level means that more hardware modules are activated and more software algorithms are run to ensure that subsequent operations can proceed smoothly and efficiently.

[0040] The state corresponding to the second power consumption can be understood as the initial parameter settings corresponding to the image acquisition device and / or display device after entering the first working mode. For the image acquisition device, if the first working mode is the photo mode, then at this stage, according to the first device preset and the relevant requirements of the first control instruction, the camera resolution can be set to the standard value in this mode, the sensitivity range can be adjusted, and a certain degree of autofocus function can be turned on. These are all initial parameter settings in the specific working mode of photo taking, which pave the way for subsequent actual shooting; for the display device, if it is in navigation mode, the screen brightness, contrast and other parameters can be adjusted to appropriate values ​​to ensure that the picture content that meets the requirements of the working mode can be accurately and clearly presented later.

[0041] From the above, it can be concluded that, by performing such initial parameter settings based on the second power consumption, the present embodiment allows the image acquisition device and / or display device to transition from a simple standby state to a state that is consistent with the current first operating mode and can better respond to subsequent second control instructions. When a second control instruction is subsequently received, they can more accurately and efficiently complete specific operations such as focus adjustment and image parameter switching based on these already set initial parameters, making the entire device run more smoothly and achieve more complete functions in the corresponding operating mode, meeting the user's needs for using the device in this mode.

[0042] In one embodiment of the present disclosure, it further includes: When the first device is in the first working mode, parameter information corresponding to the power consumption of the image acquisition device and / or the display device is adjusted based on the environmental information.

[0043] In this embodiment, after entering the first operating mode, the first device needs to obtain environmental information. This environmental information covers a wide range of factors, including light intensity (high light, low light, or moderate light), temperature (high temperature, low temperature, or normal temperature), and many other factors. There are various ways to obtain this environmental information, such as detecting light intensity using a light sensor built into the image acquisition device, sensing temperature using a built-in temperature sensor, or obtaining it through a mobile device connected to the first device (such as a mobile phone).

[0044] In this embodiment, the sensitivity, shutter speed and other parameters corresponding to the power consumption of the image acquisition device are affected by the adjustment based on the ambient light intensity; the brightness, clarity and other parameters corresponding to the power consumption of the display device are affected by the adjustment based on the ambient light intensity.

[0045] For image acquisition devices in bright light environments, to obtain high-quality images and avoid overexposure, camera parameters such as sensitivity and shutter speed can be adjusted. For example, lowering the sensitivity and increasing the shutter speed ensures clear imaging while preventing the image acquisition device from operating under high load (high power consumption) due to excessive light. Inappropriate parameters can lead to poor image quality, requiring repeated adjustments and multiple image captures, which in turn increases power consumption. Conversely, in low-light environments, the sensitivity can be increased and the shutter speed can be slowed to capture sufficient light for imaging.

[0046] When adjusting the sensitivity and shutter speed, we must also consider the problems of increased noise and increased power consumption that may be caused by such parameter adjustments. This embodiment can control power consumption as much as possible while ensuring the imaging effect through reasonable settings, such as moderately increasing the sensitivity instead of increasing it unlimitedly, to find a balance between imaging and power consumption.

[0047] In this embodiment, the image acquisition device may be adjusted based on a mapping relationship between ambient light intensity and sensitivity.

[0048] When the light is strong, lowering the sensitivity appropriately can reduce noise and power consumption, while ensuring normal exposure with a suitable shutter speed. When the light is weak, increase the sensitivity appropriately, but not infinitely. In this way, while improving the sensitivity to obtain enough light for imaging, the noise and power consumption increase caused by the increased sensitivity can be controlled within a reasonable range, ensuring a balance between imaging effect and power consumption.

[0049] In this embodiment, the mapping relationship between the ambient light intensity and the sensitivity can be determined based on optical imaging principles and a large amount of experimental data.

[0050] From the above, it can be concluded that this embodiment dynamically adjusts these parameters that affect power consumption based on environmental information in real time, so that the image acquisition device and / or display device can optimize power consumption as much as possible under different external conditions while ensuring the normal functioning of its own functions and providing users with a good user experience, thereby extending the overall battery life of the device and improving the applicability and stability of the device in various complex environments.

[0051] In one embodiment of the present disclosure, when the first device is in the first operating mode, controlling the image acquisition device and / or the display device based on the second control instruction includes: Calculating a first similarity between the second control instruction and the second preset control instruction; In response to a first similarity between the second control instruction and the second preset control instruction being greater than a preset similarity, the image acquisition device and / or the display device is controlled based on the second control instruction.

[0052] In this embodiment, when the first device is in the first operating mode, the user can issue a second control instruction to further control the image acquisition device and / or the display device to meet specific usage requirements. After the user issues the second control instruction, it is necessary to calculate a first similarity between the second control instruction and the second preset control instruction. The first similarity is a threshold value pre-set based on factors such as the accuracy requirements of the first device and the prevention of misoperation. In this embodiment, the similarity between the second control instruction issued by the first user and the second preset control instruction can be calculated based on technical means such as text semantic analysis and instruction feature matching.

[0053] If the first similarity between the second control instruction and the second preset control instruction is greater than the preset similarity, it means that the instruction issued by the user is close enough to the standard instruction expected by the device and can accurately perform the corresponding operation. It can be basically determined that the user's intention is clear and complies with the device operating specifications. At this time, the first device can control the image acquisition device and / or display device based on the second control instruction to perform corresponding functional operations, such as adjusting the focal length of the image acquisition device, changing the brightness of the display device and other parameters according to the instruction, so as to meet the user's expected operating effect.

[0054] For example, in the video recording working mode, if the user issues a second control instruction such as "improve the video clarity", the smart glasses calculate and find that its similarity with the preset second preset control instructions such as improving resolution, optimizing encoding quality, etc. is very high and greater than the preset similarity, then the parameters of the image acquisition device can be adjusted accordingly to improve the video clarity.

[0055] From the above, it can be concluded that this embodiment improves the accuracy of the device's response to user instructions by introducing the calculation of the first similarity between the second control instruction and the second preset control instruction, avoiding erroneous operations caused by slightly vague or inaccurate user instructions or the appearance of similar but not executable instruction content of the device preset, and ensuring that the device can accurately complete the corresponding work according to the user's true intention after receiving the instruction, thereby improving user experience and the reliability of device operation.

[0056] In one embodiment of the present disclosure, it further includes: In response to the similarity between the second control instruction and the second preset control instruction being less than or equal to the preset similarity, calculating a second similarity between the third control instruction and the third preset control instruction; The image acquisition device and / or the display device is controlled based on the overall similarity of the first similarity and the second similarity.

[0057] In this embodiment, the interaction instructions between the user and the first device can be multimodal. When the second control instruction is received, it is compared with the second preset control instruction for similarity, which is equivalent to determining the matching of instructions in one of the modalities. If this similarity is less than or equal to the preset similarity, relying solely on this single modality (i.e., the instruction communication form represented by the second control instruction) cannot accurately and reliably determine the user's intention and perform the corresponding operation. This is because it does not match the standard executable instructions preset by the first device and there is uncertainty, just as a single gesture instruction may not match well due to factors such as occlusion and non-standardization.

[0058] To more fully understand user intent, a third control instruction is introduced, and a second similarity between the third control instruction and the third preset control instruction is calculated. The third control instruction can be considered as another modal information supplement. Together with the second control instruction, the third control instruction reflects the user's desired operation on the first device from different perspectives, just like comprehensively judging user needs by referring to both voice and gesture modal instructions.

[0059] After obtaining the second similarity, the overall similarity can be calculated by referring to the corresponding weights for each modality. These weights can be derived from big data analysis of users' daily operating habits or set based on the design priorities of the first device. For example, if the second control instruction is considered relatively more important, a higher weight may be assigned, while the third control instruction may be given a slightly lower weight. The overall similarity is calculated by combining the respective similarities and the set weights. If this overall similarity reaches a certain level (e.g., exceeding a preset total match threshold), it means that the user's true intent can be reliably inferred based on the comprehensive information from various modalities. Based on this overall similarity, the image acquisition device and / or display device can be controlled to implement specific operations such as adjusting image acquisition parameters or changing the display effects of the display device, in order to respond to and meet the user's desired device function adjustment needs. This allows for more intelligent and flexible grasping and effective execution of user intent, even in the face of ambiguous and uncertain instructions, thereby improving the smoothness of user-device interaction and the accuracy of device operation.

[0060] For example, user B, wearing smart glasses, is about to take a photo. They first say, "Make the picture clearer!" (this is the second control command). The smart glasses system compares this with various preset second control commands related to image clarity and finds a similarity of only 60%, which is below the preset similarity level. It's difficult to determine user B's exact intention based solely on this command. User B then points twice at a distant scene (this is the third control command). The smart glasses then calculate the second similarity between this gesture command and the corresponding third control command, finding it to be 70%. The smart glasses system previously weighted voice commands at 0.55 and gesture commands at 0.45 based on big data analysis of user B's past operating habits. Combining the first similarity of 60% and the second similarity of 70%, along with their corresponding weights, the system calculates an overall similarity of 63.5%. The smart glasses' preset total match threshold is 60%, and the overall similarity exceeds this threshold, meaning it can be inferred that user B intended to focus on the distant scene for a clearer image. The smart glasses then control the image acquisition device (camera) to adjust parameters such as automatic focusing, achieving the functional adjustment requirement of user B to make the picture clearer, making the interaction smoother and the operation more precise.

[0061] In this embodiment, the overall similarity can be calculated using the first formula.

[0062] The first formula is:

[0063] in, Expressed as overall similarity; It is expressed as the first similarity; Expressed as the weight corresponding to the first similarity; Expressed as the second similarity; Expressed as the weight corresponding to the second similarity; and The introduction of adjustment coefficients makes the consideration of similarity no longer a simple linear relationship, but can make nonlinear adjustments to the similarities of different modes according to actual conditions, such as by adjusting and The value of can highlight or weaken the influence of a certain modality in the overall similarity calculation, so as to better adapt to different application scenarios, device characteristics, and user behavior patterns, etc., and make the calculation results more in line with actual needs; C is a bias term, which can to a certain extent make up for the shortcomings that may exist in relying solely on similarity and weight calculation, ensuring that in various complex situations, the calculation results of the overall similarity can reasonably reflect the comprehensive judgment situation and avoid extreme values ​​that do not meet actual expectations.

[0064] From the above, it can be concluded that this embodiment can more comprehensively understand the user's intention by introducing different modal instructions, and avoid misjudging user needs due to relying solely on a single modal instruction.

[0065] In one embodiment of the present disclosure, it further includes: The weights corresponding to the second control instruction and the third control instruction are adjusted based on the environmental information.

[0066] In this embodiment, the first device must be able to accurately perceive environmental information. This environmental information may include, but is not limited to, light intensity, ambient noise level, the user's location (indoor, outdoor, confined space, open space, etc.), and the motion state of surrounding objects. These environmental factors can affect the interaction between the user and the device, and thus the effectiveness and importance of different modal control instructions (i.e., the second and third control instructions).

[0067] In this embodiment, the weights corresponding to the second control instruction and the third control instruction may be adjusted based on the light intensity, noise level, and space type of the environment.

[0068] For example, if the ambient light is low, the user may prefer to use voice commands to operate the first device, because gesture commands may not be easily accurately recognized by the device in this situation (for example, the gesture may not be clearly captured by the image capture device due to insufficient light). In this case, the weight corresponding to the voice command (assuming it is the second control command) can be appropriately increased, and the weight corresponding to the gesture command (assuming it is the third control command) can be reduced. Conversely, in an environment with sufficient light, the weight corresponding to the gesture command can be relatively increased.

[0069] For example, in a noisy environment, voice commands may be interfered with, reducing recognition accuracy. Therefore, the weight of voice commands can be reduced. If the device has other modal commands (such as touch commands as third-party control commands), their weight can be increased accordingly. In a quiet environment, the weight of voice commands can be appropriately increased.

[0070] For example, in confined spaces, where the range of user gestures is limited, the accuracy and convenience of gesture commands are reduced, so the weight of gesture commands can be reduced. In open spaces, the weight of gesture commands can be increased. For some special spaces that require quiet, such as museums and libraries, the weight of voice commands may need to be reduced to avoid disturbing others.

[0071] In this embodiment, the weight adjustment method corresponding to the second control instruction and the third control instruction can be flexibly adjusted and optimized according to the specific performance of the device, the user's personalized settings, and feedback data from actual use.

[0072] From the above, it can be concluded that in this embodiment, by dynamically adjusting the command weight based on environmental information, the first device can adapt to different usage scenarios more intelligently, understand user intentions more accurately, improve the accuracy and effectiveness of responding to user commands, and further optimize the user experience.

[0073] Corresponding to the intelligent control method of the above embodiment, Figure 2 This is a block diagram of the structure of an intelligent control device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 2 , the intelligent control device 20 is applied to a first device, the first device includes an image acquisition device and a display device, including: a wake-up module 21, a mode selection module 22 and a control module 23; The wake-up module 21 is configured to control the image acquisition device and / or the display device to execute a control instruction corresponding to the first wake-up instruction based on the first power consumption in response to a first wake-up instruction of a first user matching a first preset wake-up instruction, wherein the first user is a user wearing the first device; a mode selection module 22 for determining a first operating mode of the first device in response to a first control instruction of the first user matching a first preset control instruction, where the operating mode of the first device is any operating mode of the first device; The control module 23 is configured to control the image acquisition device and / or the display device based on the second control instruction when the first device is in the first working mode.

[0074] In one embodiment of the present disclosure, the wake-up module 21 is further configured to: When the first device is in the first working mode, controlling the image acquisition device and / or the display device to execute a control instruction corresponding to the first control instruction based on the second power consumption; The second power consumption is greater than the first power consumption.

[0075] In one embodiment of the present disclosure, the wake-up module 21 is further configured to: When the first device is in the first working mode, parameter information corresponding to the power consumption of the image acquisition device and / or the display device is adjusted based on the environmental information.

[0076] In one embodiment of the present disclosure, the control module 23 is specifically configured to: Calculating a first similarity between the second control instruction and the second preset control instruction; In response to a first similarity between the second control instruction and the second preset control instruction being greater than a preset similarity, the image acquisition device and / or the display device is controlled based on the second control instruction.

[0077] In one embodiment of the present disclosure, the control module 23 is further configured to: In response to the similarity between the second control instruction and the second preset control instruction being less than or equal to the preset similarity, calculating a second similarity between the third control instruction and the third preset control instruction; The image acquisition device and / or the display device is controlled based on the overall similarity of the first similarity and the second similarity.

[0078] In one embodiment of the present disclosure, the control module 23 is further configured to: Calculating an overall similarity between the first similarity and the second similarity based on the first formula; The first formula is:

[0079] in, Expressed as overall similarity; It is expressed as the first similarity; Expressed as the weight corresponding to the first similarity; Expressed as the second similarity; Expressed as the weight corresponding to the second similarity; and are adjustment coefficients, and C is the bias term.

[0080] In one embodiment of the present disclosure, the control module 23 is further configured to: The weights corresponding to the second control instruction and the third control instruction are adjusted based on the environmental information.

[0081] See also Figure 3 , Figure 3 This is a schematic block diagram of a wearable device provided by an embodiment of the present disclosure. Figure 3 The wearable device 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to execute the functions of the modules in the above-mentioned device embodiments, such as Figure 2 The functions of modules 21 to 23 are shown.

[0082] It should be understood that in the embodiments of the present disclosure, the processor 301 may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0083] The input device 302 may include a touchpad, a fingerprint collection sensor (for collecting user fingerprint information and fingerprint direction information), a microphone, etc. The output device 303 may include a display (LCD, etc.), a speaker, etc.

[0084] The memory 304 may include a read-only memory and a random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store device type information.

[0085] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present disclosure can execute the implementation methods described in the first and second embodiments of the intelligent control method provided in the embodiments of the present disclosure, and can also execute the implementation methods of the wearable device described in the embodiments of the present disclosure, which will not be repeated here.

[0086] In another embodiment of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, all or part of the process of the method in the above embodiment is implemented. The computer program can also be used to instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of each of the above method embodiments are implemented. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium.

[0087] The computer-readable storage medium can be the internal storage unit of the wearable device of any of the aforementioned embodiments, such as the wearable device's hard drive or memory. The computer-readable storage medium can also be an external storage device of the wearable device, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Furthermore, the computer-readable storage medium can include both the wearable device's internal storage unit and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the wearable device. The computer-readable storage medium can also be used to temporarily store data that has been output or is about to be output.

[0088] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the composition and steps of each example according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0089] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the wearable device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0090] In the several embodiments provided in this application, it should be understood that the disclosed wearable devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or it can be an electrical, mechanical or other form of connection.

[0091] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, i.e., they may be located in one place or distributed across multiple network units. Some or all of these units may be selected based on actual needs to achieve the objectives of the embodiments of the present disclosure.

[0092] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0093] The above are only specific embodiments of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or replacements within the technical scope disclosed in this disclosure, and such modifications or replacements should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. An intelligent control method, applied to a first device, wherein the first device includes an image acquisition device and a display device, characterized in that: include: In response to a first wake-up instruction of a first user matching a first preset wake-up instruction, controlling an image acquisition device and / or a display device to execute a control instruction corresponding to the first wake-up instruction based on a first power consumption, wherein the first user is a user wearing the first device; In response to a first control instruction of a first user matching a first preset control instruction, determining a first operating mode of a first device, the operating mode of the first device being any operating mode of the first device; When the first device is in the first working mode, the image acquisition device and / or the display device is controlled based on a second control instruction.

2. The intelligent control method according to claim 1, characterized in that: Before controlling the image acquisition device and / or the display device based on the second control instruction when the first device is in the first working mode, the method further includes: When the first device is in the first working mode, controlling the image acquisition device and / or the display device to execute a control instruction corresponding to the first control instruction based on the second power consumption; The second power consumption is greater than the first power consumption.

3. The intelligent control method according to claim 2, characterized in that: Also includes: When the first device is in the first working mode, parameter information corresponding to the power consumption of the image acquisition device and / or the display device is adjusted based on the environmental information.

4. The intelligent control method according to claim 1, characterized in that: When the first device is in the first working mode, controlling the image acquisition device and / or the display device based on the second control instruction includes: Calculating a first similarity between the second control instruction and the second preset control instruction; In response to a first similarity between the second control instruction and the second preset control instruction being greater than a preset similarity, the image acquisition device and / or the display device is controlled based on the second control instruction.

5. The intelligent control method according to claim 4, characterized in that: Also includes: In response to the similarity between the second control instruction and the second preset control instruction being less than or equal to the preset similarity, calculating a second similarity between the third control instruction and the third preset control instruction; The image acquisition device and / or the display device is controlled based on the overall similarity of the first similarity and the second similarity.

6. The intelligent control method according to claim 5, characterized in that: Also includes: Calculate the overall similarity between the first similarity and the second similarity based on a first formula; The first formula is: in, Expressed as overall similarity; It is expressed as the first similarity; It is represented as the weight corresponding to the first similarity; It is expressed as the second similarity; Expressed as the weight corresponding to the second similarity; and are adjustment coefficients respectively, and C is the bias term.

7. The intelligent control method according to claim 5, characterized in that: Also includes: The weights corresponding to the second control instruction and the third control instruction are adjusted based on environmental information.

8. An intelligent control device, applied to a first device, the first device comprising an image acquisition device and a display device, characterized in that: include: a wake-up module, configured to control an image acquisition device and / or a display device to execute a control instruction corresponding to the first wake-up instruction based on a first power consumption in response to a first wake-up instruction of a first user matching a first preset wake-up instruction, wherein the first user is a user wearing the first device; a mode selection module, configured to determine a first operating mode of a first device in response to a first control instruction of a first user matching a first preset control instruction, wherein the operating mode of the first device is any operating mode of the first device; A control module is used to control the image acquisition device and / or the display device based on a second control instruction when the first device is in the first working mode.

9. A wearable device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images