Intelligent glasses image acquisition control system and method based on wearing state perception

Abstract

The application relates to the technical field of intelligent wearing devices, and provides an intelligent glasses image collection control system and method based on wearing state sensing. The method continuously collects wearing state data of intelligent glasses through a wearing detection sensor; the collected wearing state data is analyzed and judged to determine whether the intelligent glasses are in a wearing state or a non-wearing state; a single-key or double-click operation signal input by a user through an image collection key is received; according to the type of the received operation signal, photographing, video recording or audio recording operation is started; in the image collection process, a software anti-shake algorithm suitable for a head-mounted shooting scene is called to perform real-time anti-shake processing on the collected image data; after the image collection operation is completed, the wireless transmission function of the intelligent glasses is automatically triggered to transmit the processed image file to a preset terminal device. The method realizes automatic linkage between the wearing state and the image collection permission, and solves the problem of false triggering.

Description

Technical Field

[0001] This application relates to the field of smart wearable device technology, and in particular to a smart glasses image acquisition and control system and method based on wearing status perception. Background Technology

[0002] With the development of wearable technology, smart glasses are gradually becoming important portable image acquisition devices. However, existing smart glasses image acquisition systems have the following drawbacks: 1. No linkage control mechanism has been established between the wearing status and the image acquisition function. When not wearing the device, the buttons are easily pressed accidentally, resulting in a large number of invalid image files. 2. The image acquisition operation logic is complex, and different acquisition modes require multiple buttons or multiple steps to switch and start; 3. It uses a general software image stabilization algorithm, which is not optimized for head movement characteristics in head-mounted shooting scenarios, resulting in significant image shake. 4. Image files require users to manually initiate the transfer, which is cumbersome and carries the risk of file loss.

[0003] Therefore, a method is urgently needed to solve at least one of the above problems. Summary of the Invention

[0004] This application provides an image acquisition and control system and method for smart glasses based on wearing status perception, aiming to solve the problem that the defects of existing smart glasses image acquisition systems result in poor user experience of the image acquisition function of existing smart glasses, and cannot meet the user's needs for convenient and stable shooting in mobile scenarios.

[0005] In a first aspect, embodiments of this application provide a smart glasses image acquisition and control method based on wearing status perception, the method comprising: The system continuously collects wearing status data of the smart glasses through wear detection sensors; it then analyzes and judges the collected wearing status data to determine whether the smart glasses are being worn or not. When the smart glasses are determined to be in an unworn state, all input signals for the image capture buttons are blocked, and any image capture operation is prohibited; when the smart glasses are determined to be worn, the input blocking of the image capture buttons is lifted, and the image capture function is enabled. It receives single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0006] In some embodiments, the continuous collection of wearing status data of smart glasses by wearing detection sensors includes: continuously collecting pressure data on the inside of the temples; continuously collecting contact data of the nose bridge; and merging the collected pressure data and contact data into wearing status data.

[0007] In some embodiments, analyzing and judging the collected wearing status data to determine whether the smart glasses are in a wearing state or not includes: comparing the collected pressure data with a preset pressure threshold; comparing the collected contact data with a preset contact threshold; determining that the smart glasses are in a wearing state when the pressure data is greater than or equal to the preset pressure threshold and the contact data is greater than or equal to the preset contact threshold; and determining that the smart glasses are in a non-wearing state when the pressure data is less than the preset pressure threshold or the contact data is less than the preset contact threshold.

[0008] In some embodiments, when it is determined that the smart glasses are not being worn, blocking the input signals of all image acquisition buttons and prohibiting any image acquisition operation includes: generating a button blocking instruction; disabling the interrupt response of all image acquisition buttons according to the button blocking instruction; clearing the input buffer data of all image acquisition buttons; and stopping all ongoing image acquisition operations.

[0009] In some embodiments, when it is determined that the smart glasses are being worn, the step of deactivating the input shield of the image acquisition buttons and enabling the image acquisition function includes: generating a button deactivation command; enabling the interrupt response of all image acquisition buttons according to the button deactivation command; initializing the hardware resources of the image acquisition module; and loading preset image acquisition parameters.

[0010] In some embodiments, the step of initiating a photo, video, or audio recording operation according to the type of the received operation signal includes: identifying the received operation signal as a single-key short press signal, a single-key long press signal, or a double-click signal; initiating a single photo taking operation when the signal is identified as a single-key short press signal; initiating a continuous video recording operation when the signal is identified as a single-key long press signal; and initiating a continuous audio recording operation when the signal is identified as a double-click signal.

[0011] In some embodiments, during the image acquisition process, calling a software stabilization algorithm adapted to the head-mounted shooting scenario to perform real-time stabilization processing on the acquired image data includes: extracting feature points of the acquired image data frame by frame; calculating motion vectors of feature points between adjacent frames; filtering abnormal motion vectors based on the motion characteristics of the head-mounted shooting scenario; performing geometric transformation compensation on the current frame based on the filtered motion vectors; and outputting the compensated stable image data.

[0012] In some embodiments, automatically triggering the wireless transmission function of the smart glasses after the image acquisition operation is completed to transmit the processed image file to a preset terminal device includes: detecting the wireless connection status between the smart glasses and the preset terminal device; generating a file transfer instruction when a normal wireless connection is detected; sending the processed image file to the preset terminal device according to the file transfer instruction; receiving a transmission completion confirmation signal returned by the preset terminal device; and deleting the corresponding image file stored locally on the smart glasses.

[0013] In some embodiments, the method further includes: continuously collecting head posture data when the smart glasses are worn and the image acquisition function is enabled; continuously collecting ambient light intensity data; generating an automatic photo-taking prompt signal when it is detected that the head posture remains stable for more than a preset stabilization time and the ambient light intensity is within a preset suitable range; and automatically initiating a single photo-taking operation if no cancellation signal from the user is received within the preset prompt time.

[0014] Secondly, this application provides an intelligent glasses image acquisition and control system based on wearing status perception, the system comprising: The data acquisition unit is used to continuously collect the wearing status data of the smart glasses through the wear detection sensor; analyze and judge the collected wearing status data to determine whether the smart glasses are in a wearing state or not. The status judgment unit is used to block the input signals of all image acquisition buttons and prohibit any image acquisition operation when it determines that the smart glasses are not being worn; when it determines that the smart glasses are being worn, it unlocks the input signal of the image acquisition buttons and enables the image acquisition function. The file transfer unit is used to receive single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0015] This application achieves automatic linkage between wearing status and image acquisition permissions, and completely disables image acquisition button input when not wearing the device, fundamentally solving the problem of accidental triggering. It adopts a simplified operation logic of single-button / double-click, corresponding to the three core acquisition functions of taking photos, recording videos, and recording audio, greatly simplifying the operation process. It calls on a software anti-shake algorithm adapted to head-mounted shooting scenarios to specifically handle image shaking caused by head movements, significantly improving image stability. After image acquisition is completed, wireless transmission is automatically triggered, eliminating the need for manual operation by the user and improving file management efficiency. It forms a complete closed-loop control process, realizing full automation and intelligence of smart glasses image acquisition, freeing the user's hands.

[0016] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic flowchart illustrating the steps of an image acquisition and control method for smart glasses based on wearing status perception, provided in an embodiment of this application. Figure 2 This is a schematic diagram illustrating the principle of an image acquisition and control method for smart glasses based on wearing status perception, provided in one embodiment of this application. Figure 3 This is a schematic block diagram of the structure of an intelligent glasses image acquisition and control system based on wearing status perception provided in one embodiment of this application; Figure 4 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application.

[0019] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Detailed Implementation

[0020] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0021] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0022] It should be understood that, in order to clearly describe the technical solutions of the embodiments of the present invention, the terms "first" and "second" are used in the embodiments of the present invention to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0023] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0024] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0025] With the development of wearable technology, smart glasses are gradually becoming important portable image acquisition devices. However, existing smart glasses image acquisition systems have the following drawbacks: There is no linkage control mechanism between the wearing status and the image acquisition function. When not wearing the device, the buttons are easily pressed accidentally, resulting in a large number of invalid image files. The image acquisition operation logic is complex, and different acquisition modes require multiple buttons or multiple steps to switch and start. It uses a general software image stabilization algorithm, but it is not optimized for head movement characteristics in head-mounted shooting scenarios, resulting in prominent image shakiness. Image files require users to manually initiate the transfer, which is cumbersome and carries the risk of missing files.

[0026] The aforementioned defects result in a poor user experience for the image acquisition function of existing smart glasses, failing to meet users' needs for convenient and stable shooting in mobile scenarios.

[0027] Please refer to Figure 1 and Figure 2This invention provides a smart glasses image acquisition and control method based on wearing status perception, aiming to solve the technical problems of existing smart glasses image acquisition systems, such as high false trigger rate, cumbersome operation, obvious image jitter, and inconvenient file transfer. This method establishes a linkage control mechanism between wearing status and image acquisition function, combined with simplified operation logic, scenario-based anti-shake algorithms, and automatic file transfer function, to achieve intelligent and convenient full-process image acquisition for smart glasses.

[0028] The method described in this embodiment of the invention can be applied to the main control processor of smart glasses, or to a terminal device that communicates with the smart glasses. The smart glasses include a wear detection sensor, at least one image acquisition button, an image acquisition module, a wireless communication module, and a storage module. The wear detection sensor is used to detect whether the smart glasses are being worn by a user; the image acquisition button is used to receive user operation commands; the image acquisition module is used to acquire image data; the wireless communication module is used to transmit data with a preset terminal device; and the storage module is used to temporarily store the acquired image files.

[0029] It should be noted that all user data involved in the embodiments of the present invention are collected and processed under the premise of explicit authorization by the user and in compliance with relevant laws and regulations, and will not infringe on the user's personal privacy.

[0030] The provided smart glasses image acquisition and control method based on wearing status perception includes steps S101 to S103. Details are as follows: Step S101. Continuously collect the wearing status data of the smart glasses through the wear detection sensor; analyze and judge the collected wearing status data to determine whether the smart glasses are in a wearing state or not.

[0031] Specifically, the system continuously collects wearing status data of the smart glasses through wear detection sensors; the collected wearing status data is analyzed and judged to determine whether the smart glasses are in a wearing state or not.

[0032] This step is the premise and foundation of the entire method. Its core function is to perceive the physical wearing status of the smart glasses in real time, providing a basis for subsequent function access control. The wear detection sensor continuously collects data at a fixed sampling frequency. The sampling frequency can be set according to actual needs, typically 10 to 50 times per second, to ensure the real-time performance and accuracy of status detection. The collected wearing status data is transmitted in real time to the main control processor of the smart glasses for analysis and processing.

[0033] The main control processor preprocesses the received wearing status data to remove noise and interference signals. Then, it analyzes the data according to preset judgment logic and finally outputs the wearing status result of the smart glasses. There are only two wearing status results: wearing status and not wearing status. There are no intermediate states to ensure the determinism and stability of subsequent control logic.

[0034] Step S102. When it is determined that the smart glasses are not being worn, the input signals of all image acquisition buttons are blocked, and any image acquisition operation is prohibited; when it is determined that the smart glasses are being worn, the input blocking of the image acquisition buttons is released, and the image acquisition function is enabled.

[0035] Specifically, when the smart glasses are determined to be in an unworn state, the input signals of all image capture buttons are blocked, and any image capture operation is prohibited; when the smart glasses are determined to be worn, the input blocking of the image capture buttons is lifted, and the image capture function is enabled.

[0036] This step is one of the core innovations of this invention. By binding the permissions of the image acquisition function to the wearing status, it fundamentally solves the problem of accidental triggering when not wearing the glasses. When the smart glasses are not worn, the system will not perform any image acquisition operation regardless of whether the user accidentally touches the image acquisition button, thereby avoiding the generation of a large number of invalid image files and saving storage space and power.

[0037] When the main control processor determines that the smart glasses are not being worn, it immediately generates a button-disabling command and sends it to the button control module. Upon receiving the command, the button control module immediately disables the input response of all image acquisition buttons and clears all unprocessed input signals from the button input buffer. If the system is currently performing an image acquisition operation, it will also immediately stop the operation and save the acquired data.

[0038] When the main control processor determines that the smart glasses are being worn, it immediately generates a button unlock command and sends it to the button control module. Upon receiving the command, the button control module immediately restores the input response of all image acquisition buttons, initializes the hardware resources of the image acquisition module, loads preset image acquisition parameters, and puts the system in a ready-to-acquire state, ready to respond to user operation commands at any time.

[0039] Step S103. Receive single-key or double-key operation signals input by the user through the image acquisition button; start the corresponding photo, video, or audio recording operation according to the type of the received operation signal; during the image acquisition process, call the software anti-shake algorithm adapted to the head-mounted shooting scene to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, automatically trigger the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0040] Specifically, it receives single-key or double-key operation signals input by the user through the image capture button; based on the type of operation signal received, it initiates photo, video, or audio recording operations accordingly; during the image capture process, it calls a software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the captured image data; after the image capture operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0041] This step enables full-process control of image acquisition, including receiving operation commands, activating acquisition modes, processing image data, and automatically transferring files. Users can switch between and activate the three core acquisition functions using different operation methods of a single image acquisition button, eliminating the need for complex menu operations or combinations of multiple buttons, thus greatly simplifying the operation process.

[0042] When a user presses the image capture button, the button control module detects the button press time and interval to identify the type of operation signal. Different types of operation signals correspond to different capture modes, and the system initiates the corresponding capture operation based on the identification result. During the capture process, the system performs real-time image stabilization on the captured image data to eliminate image shake caused by head movements. After the capture operation is completed, the system automatically checks the wireless connection status with the preset terminal device. If the connection is normal, it automatically transmits the processed image file to that terminal device.

[0043] In some embodiments, the continuous collection of wearing status data of smart glasses by wearing detection sensors includes: continuously collecting pressure data on the inside of the temples; continuously collecting contact data of the nose bridge; and merging the collected pressure data and contact data into wearing status data.

[0044] In this embodiment, a pressure sensor is installed on the inner side of each of the two temples of the smart glasses, and a contact sensor is installed at the nose bridge position. The pressure sensors are used to detect the pressure exerted by the temples on both sides of the head when the user wears the glasses, and the contact sensors are used to detect the contact state between the nose bridge and the user's nose.

[0045] The pressure sensor can be a piezoelectric or capacitive pressure sensor, which converts pressure signals into electrical signals. The contact sensor can be a capacitive contact sensor or an infrared proximity sensor, which detects whether an object is in contact with it. Two pressure sensors and one contact sensor work simultaneously, collecting status data from different locations, thereby improving the accuracy of wear status detection.

[0046] The main control processor simultaneously reads data from three sensors at a preset sampling frequency, and packages the read pressure and contact data to form complete wearing status data. The packaged wearing status data includes timestamp information for subsequent time-series analysis.

[0047] In some embodiments, analyzing and judging the collected wearing status data to determine whether the smart glasses are in a wearing state or not includes: comparing the collected pressure data with a preset pressure threshold; comparing the collected contact data with a preset contact threshold; determining that the smart glasses are in a wearing state when the pressure data is greater than or equal to the preset pressure threshold and the contact data is greater than or equal to the preset contact threshold; and determining that the smart glasses are in a non-wearing state when the pressure data is less than the preset pressure threshold or the contact data is less than the preset contact threshold.

[0048] In this embodiment, the preset pressure threshold and preset contact threshold are standard values ​​determined through extensive experimental testing, which can accurately distinguish whether the smart glasses are being worn normally. The preset pressure threshold corresponds to the minimum pressure value that the pressure sensor on the inside of the temple can detect when the user is wearing the glasses normally; the preset contact threshold corresponds to the minimum contact value that the nose bridge contact sensor can detect when the user is wearing the glasses normally.

[0049] The main control processor compares the pressure data collected by the pressure sensors on the inner sides of the two temples with preset pressure thresholds, and simultaneously compares the contact data collected by the nose bridge contact sensor with a preset contact threshold. The smart glasses are determined to be worn only when both pressure sensor readings are greater than or equal to the preset pressure thresholds, and both contact sensor readings are greater than or equal to the preset contact thresholds. If any one of these conditions is not met, the smart glasses are determined to be unworn.

[0050] This dual-condition judgment logic effectively avoids state recognition errors caused by single sensor failure or misjudgment, significantly improving the reliability of wearing status detection. For example, when smart glasses are placed on a table and an object is pressing on the temples, the pressure sensor may detect pressure, but the contact sensor will not detect contact. Therefore, the system will determine that the glasses are not being worn and will not mistakenly activate the image acquisition function.

[0051] In some embodiments, when it is determined that the smart glasses are not being worn, blocking the input signals of all image acquisition buttons and prohibiting any image acquisition operation includes: generating a button blocking instruction; disabling the interrupt response of all image acquisition buttons according to the button blocking instruction; clearing the input buffer data of all image acquisition buttons; and stopping all ongoing image acquisition operations.

[0052] In this embodiment, when the main control processor determines that the smart glasses are not being worn, it immediately generates a high-priority button blocking instruction. This instruction is sent to the hardware interrupt controller of the smart glasses. Upon receiving the instruction, the hardware interrupt controller immediately disables all external interrupt lines corresponding to the image capture buttons. Thus, even if the image capture button is pressed, no interrupt signal will be generated, and the main control processor will not receive any button input.

[0053] Simultaneously, the main control processor clears the data in the input buffers corresponding to all image acquisition buttons to prevent previously unprocessed button input signals from being mistakenly executed after the shielding is lifted. If the system is currently performing photo, video, or audio recording operations, the main control processor will immediately send a stop command to the image acquisition module. Upon receiving the command, the image acquisition module will immediately stop data acquisition and save the acquired data to the storage module.

[0054] This hardware-level interrupt-disabling method is more thorough and reliable than software-level input signal filtering, and can completely eliminate the problem of accidental triggering when not in use.

[0055] In some embodiments, when it is determined that the smart glasses are being worn, the step of deactivating the input shield of the image acquisition buttons and enabling the image acquisition function includes: generating a button deactivation command; enabling the interrupt response of all image acquisition buttons according to the button deactivation command; initializing the hardware resources of the image acquisition module; and loading preset image acquisition parameters.

[0056] In this embodiment, when the main control processor determines that the smart glasses are being worn, it immediately generates a button unlock command. This command is sent to the hardware interrupt controller. Upon receiving the command, the hardware interrupt controller immediately restores the external interrupt lines corresponding to all image acquisition buttons, enabling the buttons to generate interrupt signals normally.

[0057] Simultaneously, the main control processor sends an initialization command to the image acquisition module. Upon receiving the command, the image acquisition module initializes its hardware resources, including powering on the sensor, configuring the clock, and initializing the data interface. After initialization, the main control processor reads the preset image acquisition parameters from the storage module and loads these parameters into the image acquisition module. The preset image acquisition parameters include resolution, frame rate, white balance, and exposure time, which users can set in advance according to their needs.

[0058] Through the above steps, the system can quickly complete the image acquisition preparation work the moment the user puts on the smart glasses, allowing the user to start shooting immediately without waiting.

[0059] In some embodiments, the step of initiating a photo, video, or audio recording operation according to the type of the received operation signal includes: identifying the received operation signal as a single-key short press signal, a single-key long press signal, or a double-click signal; initiating a single photo taking operation when the signal is identified as a single-key short press signal; initiating a continuous video recording operation when the signal is identified as a single-key long press signal; and initiating a continuous audio recording operation when the signal is identified as a double-click signal.

[0060] In this embodiment, the button control module monitors the status of the image acquisition buttons in real time and records the button press time, release time, and interval between two button presses. Based on these time parameters, the button control module can accurately identify three different types of operation signals: Single button short press signal: The button is pressed for less than the preset short press time threshold and is not pressed again within the preset interval; Single-key long press signal: The key press time is greater than or equal to the preset long press time threshold; Double-click signal: The interval between two button presses is less than the preset double-click interval threshold.

[0061] The preset short press time threshold, preset long press time threshold, and preset double-tap interval time threshold can be adjusted according to the user's operating habits. For example, the preset short press time threshold can be set to 500 milliseconds, the preset long press time threshold can be set to 1 second, and the preset double-tap interval time threshold can be set to 300 milliseconds.

[0062] Once the button control module identifies the type of operation signal, it sends the information to the main control processor, which then initiates the corresponding acquisition operation based on the signal type. Short press of a single button: initiates a single photo capture operation. The image acquisition module captures one frame of image data, which is then processed by image stabilization and saved as an image file. Long press on a single button: Starts continuous recording. The image acquisition module continuously collects video data, which is then saved as a video file after real-time image stabilization. The recording stops when the user presses the button again. Double-click: Starts continuous recording. The audio acquisition module continuously collects audio data and saves it as an audio file until the user presses the button again.

[0063] This single-button, multi-mode operation logic allows users to quickly switch and activate different data collection functions using only touch, without needing to look at the screen or perform complex operations, making it ideal for use in mobile scenarios.

[0064] In some embodiments, during the image acquisition process, calling a software stabilization algorithm adapted to the head-mounted shooting scenario to perform real-time stabilization processing on the acquired image data includes: extracting feature points of the acquired image data frame by frame; calculating motion vectors of feature points between adjacent frames; filtering abnormal motion vectors based on the motion characteristics of the head-mounted shooting scenario; performing geometric transformation compensation on the current frame based on the filtered motion vectors; and outputting the compensated stable image data.

[0065] In this embodiment, the software image stabilization algorithm adapted for head-mounted shooting scenarios is specifically optimized for the characteristics of head movements. Head movements are typically low-frequency and large-amplitude, which is significantly different from the high-frequency, small-amplitude shaking during handheld shooting. General software image stabilization algorithms often cannot effectively handle the image shake caused by head movements, and may even lead to image distortion or rolling shutter effects.

[0066] The specific processing steps of this algorithm are as follows: Feature point extraction: Feature points are extracted for each frame of image data. The extracted feature points are usually points with significant gray-level changes in the image, such as corner points and edge points. A fast feature point extraction algorithm is used to ensure real-time processing.

[0067] Motion vector calculation: The feature points of the current frame are matched with the feature points of the previous frame, and the motion vector of each matched feature point is calculated. The motion vector represents the displacement of the feature point between the two frames.

[0068] Anomaly vector filtering: Based on the motion characteristics of the head-mounted camera scene, a statistical model of motion vectors is established. The calculated motion vectors are compared with the statistical model, and abnormal motion vectors that do not conform to the head motion characteristics are filtered out. Abnormal motion vectors are usually caused by image noise, motion blur, or moving objects in the scene.

[0069] Geometric transformation compensation: Based on the filtered effective motion vectors, the global motion parameters of the current frame relative to the reference frame are calculated, including translation, rotation, and scaling. Then, a geometric transformation is performed on the current frame according to these global motion parameters to compensate for the image displacement caused by head movement.

[0070] Stable image output: Outputs image data after geometric transformation compensation to obtain a stable image.

[0071] Through the above steps, this algorithm can effectively eliminate image shake caused by head movement and significantly improve image quality in head-mounted shooting scenarios.

[0072] In some embodiments, automatically triggering the wireless transmission function of the smart glasses after the image acquisition operation is completed to transmit the processed image file to a preset terminal device includes: detecting the wireless connection status between the smart glasses and the preset terminal device; generating a file transfer instruction when a normal wireless connection is detected; sending the processed image file to the preset terminal device according to the file transfer instruction; receiving a transmission completion confirmation signal returned by the preset terminal device; and deleting the corresponding image file stored locally on the smart glasses.

[0073] In this embodiment, the wireless transmission function is implemented using wireless local area network (WLAN) technology, and the preset terminal device can be a smartphone, tablet, or laptop, etc. The smart glasses and the preset terminal device have been pre-paired and a trust relationship has been established.

[0074] After the image acquisition operation is completed, the main control processor immediately sends a connection status detection command to the wireless communication module. Upon receiving the command, the wireless communication module checks the wireless connection status with the preset terminal device. If the wireless connection is detected to be normal, it returns a connection normal signal to the main control processor; if the wireless connection is detected to be broken, it returns a connection broken signal to the main control processor and checks again after a preset time interval until the connection is restored or the maximum number of retries is reached.

[0075] Once the main control processor receives a connection confirmation signal, it immediately generates a file transfer command and sends the path and name of the processed image file to the wireless communication module. Upon receiving the command, the wireless communication module establishes a data transmission channel with the preset terminal device and sends the image file to that device.

[0076] During file transfer, the wireless communication module monitors the transfer progress in real time and feeds the progress information back to the main control processor. Once the file transfer is complete, the preset terminal device sends a transfer completion confirmation signal to the smart glasses. Upon receiving the confirmation signal, the wireless communication module forwards it to the main control processor. Upon receiving the confirmation signal, the main control processor sends a deletion command to the storage module, deleting the corresponding image file stored locally on the smart glasses to free up storage space.

[0077] If a connection is interrupted during transmission, the wireless communication module will record the transmission breakpoint and resume transmission from the breakpoint once the connection is restored, thus avoiding the need to repeatedly transmit the entire file.

[0078] In some embodiments, the method further includes: continuously collecting head posture data when the smart glasses are worn and the image acquisition function is enabled; continuously collecting ambient light intensity data; generating an automatic photo-taking prompt signal when it is detected that the head posture remains stable for more than a preset stabilization time and the ambient light intensity is within a preset suitable range; and automatically initiating a single photo-taking operation if no cancellation signal from the user is received within the preset prompt time.

[0079] In this embodiment, the smart glasses also include an attitude sensor and a light sensor. The attitude sensor is used to collect the user's head attitude data, including pitch angle, roll angle, and yaw angle; the light sensor is used to collect ambient light intensity data.

[0080] When the smart glasses are worn and the image capture function is enabled, the main control processor continuously reads data from the posture sensor and the light sensor at a fixed sampling frequency. The main control processor analyzes the head posture data and calculates the amount of change in head posture. When the amount of change in head posture is less than a preset posture change threshold, and this state lasts for more than a preset stabilization time, it is determined that the user's head remains stable.

[0081] Meanwhile, the main control processor compares the collected ambient light intensity data with the preset suitable light range. The preset suitable light range is a range of light intensity suitable for taking pictures, determined experimentally, which can ensure that the pictures have good exposure effects.

[0082] When both head posture stability and ambient lighting conditions are met simultaneously, the main control processor generates an automatic photo-taking prompt signal. This prompt signal can be played as an audio prompt through the smart glasses' speaker or displayed as a prompt icon through the optical display module, informing the user that the system is about to take a photo automatically.

[0083] Users can cancel the automatic photo capture operation by pressing the image capture button within a preset prompt time. If the main control processor does not receive a cancellation signal from the user within the preset prompt time, it will automatically initiate a single photo capture operation and complete the photo taking.

[0084] This intelligent photo-taking assistance feature helps users capture photos at the optimal moment, avoiding missing wonderful moments due to untimely manual operation, while also improving the success rate of shooting and the quality of photos.

[0085] In some embodiments, this embodiment further optimizes and expands the "image acquisition permission control based on wearing status" in step S102, specifically addressing the problem of unexpected interruption of image acquisition caused by users briefly removing and putting on smart glasses. When the smart glasses are in the wearing state and image acquisition is being performed, the changing trend of the wearing status data is continuously monitored. When a rapid change in the wearing status data from meeting the wearing status threshold to not meeting the wearing status threshold is detected, a transitional state caching mode is activated. In the transitional state caching mode, the enabled state of the image acquisition function is temporarily retained, and the acquired image data is written to the cache area instead of the permanent storage area. A transitional state timer is started to record the duration of the transitional state. When the duration of the transitional state is less than a preset transition time threshold and the wearing status data recovers to meeting the wearing status threshold, the transitional state caching mode is exited, the image data in the cache area is merged with the image data before the acquisition interruption, and the image acquisition operation continues. When the duration of the transitional state is greater than or equal to the preset transition time threshold, the transitional state caching mode is exited, and button blocking and acquisition stop operations are performed in the non-wearing state, while all temporary data in the cache area is deleted.

[0086] In this embodiment, the preset transition time threshold is set to 3 seconds. This time length can cover most scenarios where users briefly remove and put on their glasses, such as wiping lenses or adjusting the wearing position. The high-speed cache uses an independent high-speed random access memory, whose read and write speed is much higher than that of the permanent storage area, which can ensure that the continuous writing of image data in the transition state does not result in frame loss.

[0087] When the system detects a change in wearing status, it does not immediately stop data acquisition but enters a brief transition buffer period. If the user puts the glasses back on within 3 seconds, the system automatically and seamlessly stitches the cached image data with the previously acquired data, so the user will not notice any interruption in the acquisition process. If the user's wearing and removing of the glasses takes more than 3 seconds, the system will then officially stop data acquisition and disable button presses, thus achieving the best balance between preventing accidental triggering and ensuring continuous data acquisition.

[0088] In some embodiments, a creative improvement has been made to step S103, which involves "calling a software stabilization algorithm adapted to the head-mounted shooting scenario to perform real-time stabilization processing on the acquired image data," thereby achieving an adaptive stabilization function that dynamically adjusts stabilization parameters based on the user's actual motion intensity. This is achieved by continuously collecting acceleration data of the user's head using an accelerometer built into the smart glasses; calculating the current motion intensity value based on the collected acceleration data; comparing the calculated motion intensity value with multiple preset motion intensity level thresholds to determine the current motion intensity level; calling the corresponding stabilization parameter group from a preset stabilization parameter library based on the determined motion intensity level; and using the called stabilization parameter group to perform real-time stabilization processing on the acquired image data.

[0089] In this embodiment, motion intensity is divided into four levels, each corresponding to a different set of image stabilization parameters: Stillness level: The motion intensity value is less than the first threshold, corresponding to the low-intensity image stabilization parameter group, the number of feature points extracted is 500 per frame, the motion vector filtering threshold is 2 pixels, and the geometric transformation compensation amplitude is 100%; Walking level: The motion intensity value is greater than or equal to the first threshold and less than the second threshold. The corresponding image stabilization parameter group is medium intensity image stabilization, the number of feature points extracted is 800 per frame, the motion vector filtering threshold is 5 pixels, and the geometric transformation compensation amplitude is 120%. Running level: The exercise intensity value is greater than or equal to the second threshold and less than the third threshold. The corresponding anti-shake parameter group is high-intensity anti-shake, the number of feature points extracted is 1200 per frame, the motion vector filtering threshold is 10 pixels, and the geometric transformation compensation amplitude is 150%. Cycling level: The exercise intensity value is greater than or equal to the third threshold, the corresponding anti-shake parameter group is the extreme intensity anti-shake, the number of feature points extracted is 1500 per frame, the motion vector filtering threshold is 15 pixels, and the geometric transformation compensation amplitude is 200%.

[0090] This embodiment addresses the issue of inconsistent performance of traditional fixed-parameter image stabilization algorithms across different motion scenarios by correlating motion intensity with stabilization parameters. Low-intensity stabilization is used in stationary or slow-walking scenarios to reduce excessive image processing and preserve more image details; high-intensity stabilization is used in vigorous motion scenarios such as running or cycling to effectively eliminate large-scale image shake and ensure image stability.

[0091] In some embodiments, the step S103, "receiving a single-key or double-click operation signal input by the user via the image acquisition button," has been extended to enable quick switching of acquisition modes or execution of auxiliary functions via single-key compound operations during image acquisition, without having to stop and restart the current acquisition. During continuous recording, the system receives operation signals input by the user via the image acquisition button; when a short single-key press signal is detected, a single photo capture operation is initiated without interrupting continuous recording, and the image data of the current frame is saved as an independent image file; when a long single-key press signal is detected, continuous recording is paused, and resumed upon re-detection of the long single-key press signal; when a double-click signal is detected, continuous recording is stopped, and continuous audio recording is initiated. During continuous recording, the system receives operation signals input by the user via the image capture button. When a short press signal is detected, a single photo capture operation is initiated without interrupting the continuous recording operation. When a long press signal is detected, the continuous recording operation is paused, and when a long press signal is detected again, the continuous recording operation is resumed. When a double-click signal is detected, the continuous recording operation is stopped, and continuous video recording is started.

[0092] In this embodiment, the system allocates independent processes and storage resources to each acquisition operation, ensuring that multiple acquisition operations can be executed simultaneously without interfering with each other. For example, when taking a picture during video recording, the video recording process continues to run, while the picture taking process independently completes the acquisition, processing, and saving of the image.

[0093] This embodiment greatly enriches the functionality of single-button operation, enabling users to flexibly switch modes and perform auxiliary operations during the acquisition process. For example, if a user sees a wonderful moment while recording a video, they can directly press the button briefly to take a photo without stopping video recording, thus ensuring that no important content is missed.

[0094] In some embodiments, the step S103, "automatically triggering the wireless transmission function of the smart glasses to transmit the processed image file to a preset terminal device," has been deeply optimized, solving the problems of large file transmission and transmission failure in weak network environments. After the image acquisition operation is completed, the wireless LAN bandwidth between the smart glasses and the preset terminal device is detected. Based on the detected bandwidth value, the size of each transmission segment is dynamically calculated. The image file to be transmitted is divided into multiple consecutive transmission segments according to the calculated segment size. A unique segment number and checksum are assigned to each transmission segment. The transmission segments are sent to the preset terminal device in the order of the segment numbers. After sending each transmission segment, a segment reception confirmation signal and checksum result are received from the preset terminal device. When a segment reception confirmation signal is received and the checksum result is correct, the next transmission segment is sent. When a segment reception failure confirmation signal is received or the checksum result is incorrect, the current transmission segment is retransmitted. When a network interruption occurs during transmission, the number of the last successfully transmitted segment is recorded. When the network connection is restored, transmission continues from the next segment with the recorded segment number, without retransmitting the entire file.

[0095] In this embodiment, the fragment size is calculated according to the following rules: when the bandwidth is greater than or equal to 10 Mbps, the fragment size is set to 10 MB; when the bandwidth is greater than or equal to 2 Mbps but less than 10 Mbps, the fragment size is set to 2 MB; and when the bandwidth is less than 2 Mbps, the fragment size is set to 512 KB. This dynamic fragmentation mechanism can make full use of network bandwidth and improve transmission efficiency.

[0096] This embodiment also supports transmission priority settings. The system automatically prioritizes image files over video and audio files, ensuring users can view photos as quickly as possible. For files whose transmission is incomplete, the system saves transmission progress information locally, allowing transmission to resume the next connection even if the smart glasses are powered off and restarted.

[0097] In some embodiments, by combining the wearing status perception in step S101 and the image acquisition control in step S103, an eye status perception function is added, further enhancing the system's intelligence and privacy protection capabilities. When the smart glasses are worn and the image acquisition function is enabled, the eye status detection sensor built into the smart glasses continuously acquires the user's eye image data; the acquired eye image data is analyzed and processed to identify whether the user's eye status is open or closed; when it is detected that the user's eye status remains closed for more than a preset closed-eye time threshold, a capture pause command is generated; according to the capture pause command, all currently executing image acquisition operations are paused, while maintaining the input response state of the image acquisition button; when it is detected that the user's eye status returns to open, a capture resume command is generated; according to the capture resume command, the previously paused image acquisition operations are automatically resumed.

[0098] In this embodiment, the eye state detection sensor uses a low-power infrared camera, which can accurately detect the user's eye state under various lighting conditions. The preset eye-closing time threshold is set to 2 seconds, which can effectively distinguish between normal blinking and conscious eye-closing.

[0099] This embodiment enables intelligent control by stopping recording when the user closes their eyes. When the user does not want to be photographed or needs a short break, they only need to close their eyes for 2 seconds, and the system will automatically pause all data acquisition operations; when the user opens their eyes, the system will automatically resume data acquisition. This function not only effectively prevents accidental recording but also protects the user's privacy, preventing recording from taking place without the user's knowledge.

[0100] In some embodiments, by expanding the application scope of steps S101 and S102, collaborative control of image acquisition between smart glasses and a preset terminal device is realized, giving full play to the advantages of different devices. A wireless communication connection is established between the smart glasses and the preset terminal device; when the smart glasses are detected to be in a wearing state, a wearing state synchronization signal is automatically sent to the preset terminal device; after receiving the wearing state synchronization signal, the preset terminal device automatically enters the collaborative acquisition mode; in the collaborative acquisition mode, the smart glasses synchronously transmit the real-time acquired image data to the preset terminal device for display and preview; the user can send image acquisition control commands to the smart glasses through the touch screen of the preset terminal device, and the smart glasses execute the corresponding acquisition operation after receiving the control commands; when the smart glasses are detected to be in a non-wearing state, a non-wearing state synchronization signal is automatically sent to the preset terminal device; after receiving the non-wearing state synchronization signal, the preset terminal device automatically exits the collaborative acquisition mode and stops receiving and displaying the image data from the smart glasses.

[0101] In this embodiment, the collaborative acquisition mode supports multiple collaborative methods: Remote control method: Users wear smart glasses on their heads and remotely control the smart glasses to take photos, record videos or record audio through a terminal device in their hands. The terminal device also displays the real-time image captured by the smart glasses. Dual-view acquisition method: The smart glasses and the terminal device simultaneously acquire images, recording the scene from both the first-person and third-person perspectives. After the acquisition is completed, the system will automatically associate and save the image files from the two perspectives. Relay data collection method: When the smart glasses are low on power, the system will automatically transfer the data collection task to the terminal device to continue execution, ensuring the continuity of the data collection process.

[0102] This embodiment breaks the limitations of a single device, achieving complementary advantages between smart glasses and terminal devices. Smart glasses offer the advantages of a first-person perspective and hands-free operation, while terminal devices offer the advantages of large-screen previews and a variety of operation methods. The combination of the two can provide users with a more flexible and powerful image acquisition experience.

[0103] Please see Figure 3 As shown, Figure 3 This is a schematic diagram of the structure of a smart glasses image acquisition and control system 200 based on wearing status perception provided in this application embodiment. The smart glasses image acquisition and control system 200 based on wearing status perception is used to execute the steps of the smart glasses image acquisition and control method based on wearing status perception shown in the above embodiments. The smart glasses image acquisition and control system 200 based on wearing status perception can be a single server or a server cluster, or it can be a terminal, such as a handheld terminal, a laptop computer, a wearable device, or a robot.

[0104] like Figure 3 As shown, the smart glasses image acquisition and control system 200 based on wearing status perception includes: The data acquisition unit 201 is used to continuously collect the wearing status data of the smart glasses through the wear detection sensor; analyze and judge the collected wearing status data to determine whether the smart glasses are in a wearing state or not. The status judgment unit 202 is used to block the input signals of all image acquisition buttons and prohibit any image acquisition operation when it is determined that the smart glasses are not being worn; and to unlock the input of the image acquisition buttons and enable the image acquisition function when it is determined that the smart glasses are being worn. The file transfer unit 203 is used to receive single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0105] In some embodiments, the continuous collection of wearing status data of smart glasses by wearing detection sensors includes: continuously collecting pressure data on the inside of the temples; continuously collecting contact data of the nose bridge; and merging the collected pressure data and contact data into wearing status data.

[0106] In some embodiments, analyzing and judging the collected wearing status data to determine whether the smart glasses are in a wearing state or not includes: comparing the collected pressure data with a preset pressure threshold; comparing the collected contact data with a preset contact threshold; determining that the smart glasses are in a wearing state when the pressure data is greater than or equal to the preset pressure threshold and the contact data is greater than or equal to the preset contact threshold; and determining that the smart glasses are in a non-wearing state when the pressure data is less than the preset pressure threshold or the contact data is less than the preset contact threshold.

[0107] In some embodiments, when it is determined that the smart glasses are not being worn, blocking the input signals of all image acquisition buttons and prohibiting any image acquisition operation includes: generating a button blocking instruction; disabling the interrupt response of all image acquisition buttons according to the button blocking instruction; clearing the input buffer data of all image acquisition buttons; and stopping all ongoing image acquisition operations.

[0108] In some embodiments, when it is determined that the smart glasses are being worn, the step of deactivating the input shield of the image acquisition buttons and enabling the image acquisition function includes: generating a button deactivation command; enabling the interrupt response of all image acquisition buttons according to the button deactivation command; initializing the hardware resources of the image acquisition module; and loading preset image acquisition parameters.

[0109] In some embodiments, the step of initiating a photo, video, or audio recording operation according to the type of the received operation signal includes: identifying the received operation signal as a single-key short press signal, a single-key long press signal, or a double-click signal; initiating a single photo taking operation when the signal is identified as a single-key short press signal; initiating a continuous video recording operation when the signal is identified as a single-key long press signal; and initiating a continuous audio recording operation when the signal is identified as a double-click signal.

[0110] In some embodiments, during the image acquisition process, calling a software stabilization algorithm adapted to the head-mounted shooting scenario to perform real-time stabilization processing on the acquired image data includes: extracting feature points of the acquired image data frame by frame; calculating motion vectors of feature points between adjacent frames; filtering abnormal motion vectors based on the motion characteristics of the head-mounted shooting scenario; performing geometric transformation compensation on the current frame based on the filtered motion vectors; and outputting the compensated stable image data.

[0111] In some embodiments, automatically triggering the wireless transmission function of the smart glasses after the image acquisition operation is completed to transmit the processed image file to a preset terminal device includes: detecting the wireless connection status between the smart glasses and the preset terminal device; generating a file transfer instruction when a normal wireless connection is detected; sending the processed image file to the preset terminal device according to the file transfer instruction; receiving a transmission completion confirmation signal returned by the preset terminal device; and deleting the corresponding image file stored locally on the smart glasses.

[0112] In some embodiments, the method further includes: continuously collecting head posture data when the smart glasses are worn and the image acquisition function is enabled; continuously collecting ambient light intensity data; generating an automatic photo-taking prompt signal when it is detected that the head posture remains stable for more than a preset stabilization time and the ambient light intensity is within a preset suitable range; and automatically initiating a single photo-taking operation if no cancellation signal from the user is received within the preset prompt time.

[0113] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the intelligent glasses image acquisition and control system and its modules described above based on wearing status perception can be found in the corresponding contents of the various embodiments of the intelligent glasses image acquisition and control method based on wearing status perception, and will not be repeated here.

[0114] The aforementioned image acquisition and control method for smart glasses based on wearing status perception can be implemented as a computer program, which can be used in, for example... Figure 3 It runs on the system shown.

[0115] Please see Figure 4 , Figure 4 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application. The computer device includes a processor, a memory, and a network interface connected via a device bus, wherein the memory may include a storage medium and internal memory.

[0116] The storage medium can store operating devices and computer programs. The computer program includes program instructions that, when executed, cause the processor to perform any smart glasses image acquisition and control method based on wear status awareness.

[0117] The processor provides computing and control capabilities, supporting the operation of the entire computer device.

[0118] The internal memory provides an environment for the execution of computer programs in non-volatile storage media. When the computer program is executed by the processor, it enables the processor to execute any smart glasses image acquisition and control method based on wearing status perception.

[0119] This network interface is used for network communication, such as sending assigned tasks. Those skilled in the art will understand that... Figure 4 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the terminal to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0120] It should be understood that the processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0121] In one embodiment, the processor is configured to run a computer program stored in memory to perform the following steps: The system continuously collects wearing status data of the smart glasses through wear detection sensors; it then analyzes and judges the collected wearing status data to determine whether the smart glasses are being worn or not. When the smart glasses are determined to be in an unworn state, all input signals for the image capture buttons are blocked, and any image capture operation is prohibited; when the smart glasses are determined to be worn, the input blocking of the image capture buttons is lifted, and the image capture function is enabled. It receives single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

[0122] In some embodiments, the continuous collection of wearing status data of smart glasses by wearing detection sensors includes: continuously collecting pressure data on the inside of the temples; continuously collecting contact data of the nose bridge; and merging the collected pressure data and contact data into wearing status data.

[0123] In some embodiments, analyzing and judging the collected wearing status data to determine whether the smart glasses are in a wearing state or not includes: comparing the collected pressure data with a preset pressure threshold; comparing the collected contact data with a preset contact threshold; determining that the smart glasses are in a wearing state when the pressure data is greater than or equal to the preset pressure threshold and the contact data is greater than or equal to the preset contact threshold; and determining that the smart glasses are in a non-wearing state when the pressure data is less than the preset pressure threshold or the contact data is less than the preset contact threshold.

[0124] In some embodiments, when it is determined that the smart glasses are not being worn, blocking the input signals of all image acquisition buttons and prohibiting any image acquisition operation includes: generating a button blocking instruction; disabling the interrupt response of all image acquisition buttons according to the button blocking instruction; clearing the input buffer data of all image acquisition buttons; and stopping all ongoing image acquisition operations.

[0125] In some embodiments, when it is determined that the smart glasses are being worn, the step of deactivating the input shield of the image acquisition buttons and enabling the image acquisition function includes: generating a button deactivation command; enabling the interrupt response of all image acquisition buttons according to the button deactivation command; initializing the hardware resources of the image acquisition module; and loading preset image acquisition parameters.

[0126] In some embodiments, the step of initiating a photo, video, or audio recording operation according to the type of the received operation signal includes: identifying the received operation signal as a single-key short press signal, a single-key long press signal, or a double-click signal; initiating a single photo taking operation when the signal is identified as a single-key short press signal; initiating a continuous video recording operation when the signal is identified as a single-key long press signal; and initiating a continuous audio recording operation when the signal is identified as a double-click signal.

[0127] In some embodiments, during the image acquisition process, calling a software stabilization algorithm adapted to the head-mounted shooting scenario to perform real-time stabilization processing on the acquired image data includes: extracting feature points of the acquired image data frame by frame; calculating motion vectors of feature points between adjacent frames; filtering abnormal motion vectors based on the motion characteristics of the head-mounted shooting scenario; performing geometric transformation compensation on the current frame based on the filtered motion vectors; and outputting the compensated stable image data.

[0128] In some embodiments, automatically triggering the wireless transmission function of the smart glasses after the image acquisition operation is completed to transmit the processed image file to a preset terminal device includes: detecting the wireless connection status between the smart glasses and the preset terminal device; generating a file transfer instruction when a normal wireless connection is detected; sending the processed image file to the preset terminal device according to the file transfer instruction; receiving a transmission completion confirmation signal returned by the preset terminal device; and deleting the corresponding image file stored locally on the smart glasses.

[0129] In some embodiments, the method further includes: continuously collecting head posture data when the smart glasses are worn and the image acquisition function is enabled; continuously collecting ambient light intensity data; generating an automatic photo-taking prompt signal when it is detected that the head posture remains stable for more than a preset stabilization time and the ambient light intensity is within a preset suitable range; and automatically initiating a single photo-taking operation if no cancellation signal from the user is received within the preset prompt time.

[0130] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the steps of the smart glasses image acquisition and control method based on wearing status perception provided in any embodiment of this application.

[0131] The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiments, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, SmartMedia Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the computer device.

[0132] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for image acquisition and control of smart glasses based on wearing status perception, characterized in that, include: The system continuously collects wearing status data of the smart glasses through wear detection sensors; it then analyzes and judges the collected wearing status data to determine whether the smart glasses are being worn or not. When the smart glasses are determined to be in an unworn state, all input signals for the image capture buttons are blocked, and any image capture operation is prohibited; when the smart glasses are determined to be worn, the input blocking of the image capture buttons is lifted, and the image capture function is enabled. It receives single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

2. The method according to claim 1, characterized in that, The method of continuously collecting wearing status data of smart glasses through wear detection sensors includes: Continuously collect pressure data on the inside of the temples; Continuously collect contact data of the nose bridge support; The collected pressure data and contact data are combined into wearing status data.

3. The method according to claim 1, characterized in that, The step of analyzing and judging the collected wearing status data to determine whether the smart glasses are in a wearing state or not includes: The collected pressure data is compared with a preset pressure threshold. The collected contact data is compared with a preset contact threshold. When the pressure data is greater than or equal to the preset pressure threshold and the contact data is greater than or equal to the preset contact threshold, it is determined that the smart glasses are being worn. When the pressure data is less than the preset pressure threshold or the contact data is less than the preset contact threshold, the smart glasses are determined to be in a non-wearing state.

4. The method according to claim 1, characterized in that, When it is determined that the smart glasses are not being worn, the input signals of all image acquisition buttons are blocked, and any image acquisition operation is prohibited, including: Generate key blocking commands; Disable interrupt response for all image acquisition buttons according to the button blocking command; Clear the input buffer data for all image acquisition buttons; Stop all ongoing image acquisition operations.

5. The method according to claim 1, characterized in that, When it is determined that the smart glasses are being worn, the input blocking of the image capture button is deactivated, and the image capture function is enabled, including: Generate a command to unblock the key presses; The interrupt response for all image acquisition buttons is enabled based on the button unlock command; Initialize the hardware resources of the image acquisition module; Load the preset image acquisition parameters.

6. The method according to claim 1, characterized in that, The step of initiating photo taking, video recording, or audio recording operations according to the type of received operation signal includes: The system identifies whether the received operation signal is a short press, a long press, or a double-click. When a single short press signal is detected, a single photo-taking operation is initiated. When a single button long press signal is detected, continuous recording is initiated. When a double-click signal is detected, continuous recording is initiated.

7. The method according to claim 1, characterized in that, During image acquisition, a software-based image stabilization algorithm adapted to head-mounted shooting scenarios is invoked to perform real-time image stabilization processing on the acquired image data, including: Extract feature points from the acquired image data frame by frame; Calculate the motion vectors of feature points between adjacent frames; Filter out abnormal motion vectors based on the motion characteristics of the head-mounted shooting scene; Perform geometric transformation compensation on the current frame based on the filtered motion vector; Output the compensated and stabilized image data.

8. The method according to claim 1, characterized in that, The step of automatically triggering the wireless transmission function of the smart glasses after the image acquisition operation is completed, and transmitting the processed image file to a preset terminal device, includes: Detect the wireless connection status between the smart glasses and the preset terminal device; When a normal wireless connection is detected, a file transfer command is generated; The processed image file is sent to the preset terminal device according to the file transfer instruction; Receive a transmission completion confirmation signal returned by the preset terminal device; Delete the corresponding image file stored locally on the smart glasses.

9. The method according to claim 1, characterized in that, The method further includes: When the smart glasses are worn and the image acquisition function is enabled, they continuously collect head posture data and ambient light intensity data. When the head posture is detected to remain stable for more than a preset stabilization time and the ambient light intensity is within a preset suitable range, an automatic photo prompt signal is generated; If no cancellation signal is received from the user within the preset prompt time, a single photo-taking operation will be automatically initiated.

10. A smart glasses image acquisition and control system based on wearing status perception, used to implement the method as described in any one of claims 1-9, characterized in that, include: The data acquisition unit is used to continuously collect the wearing status data of the smart glasses through the wear detection sensor; analyze and judge the collected wearing status data to determine whether the smart glasses are in a wearing state or not. The status judgment unit is used to block the input signals of all image acquisition buttons and prohibit any image acquisition operation when it determines that the smart glasses are not being worn; when it determines that the smart glasses are being worn, it unlocks the input signal of the image acquisition buttons and enables the image acquisition function. The file transfer unit is used to receive single-key or double-key operation signals input by the user through the image acquisition button; according to the type of operation signal received, it initiates the corresponding photo, video, or audio operation; during the image acquisition process, it calls the software anti-shake algorithm adapted to the head-mounted shooting scenario to perform real-time anti-shake processing on the acquired image data; after the image acquisition operation is completed, it automatically triggers the wireless transmission function of the smart glasses to transmit the processed image file to the preset terminal device.

Images