Smart glasses control method and system with camera function
By integrating the skin sensing module and the vibration sensing module, combined with multi-environment teeth strike simulation and interference signal analysis, the automatic control of the smart glasses camera is realized, solving the problems of high control difficulty and response delay in the existing technology, and improving user experience and convenience.
Patent Information
- Application Number
- CN202510114638.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-24
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2045-01-24
AI Technical Summary
The existing smart glasses control methods mainly rely on manual control or voice control, which leads to difficult control and delayed response when users are inconvenient with both hands or need to operate freely with both hands, which reduces the user experience.
By integrating the skin sensing module and the vibration sensing module, the automatic wear detection of the smart glasses camera and the acquisition of tooth vibration signal. Using multi-environment dental strike simulation and interference signal analysis, accurately identify tooth strike vibration and count the number of effective strikes, and automatically control the start of the shooting module or recording module.
It improves the convenience and user experience of smart glasses, especially when users are inconvenient with both hands or need to operate freely with both hands, greatly enhancing the convenience and practicality of the equipment.
Smart Images

Figure CN119556479B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of smart glasses control, and in particular to a smart glasses control method and system with a camera function. Background Art
[0002] With the rapid development of modern science and technology, wearable devices have become an important part of smart life. Among them, smart glasses, as an emerging wearable technology, are widely favored by users because they can provide real-time image capture functions. In practical applications, the control method of such smart glasses is crucial to the user experience.
[0003] Currently, the control of smart glasses is mainly achieved through manual control or voice control by the user. This method will bring great control difficulty when the user's hands are inconvenient. At the same time, voice control has a large response delay, which makes it impossible for users to capture images quickly, thereby reducing the user experience. Summary of the invention
[0004] The present invention provides a control method and system for smart glasses with a camera function, the main purpose of which is to improve the convenience of using the smart glasses and enhance the user experience of the smart glasses.
[0005] To achieve the above object, the present invention provides a method for controlling smart glasses with a camera function, comprising:
[0006] Receiving a smart glasses control instruction, and starting a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and at this time the smart glasses camera is in a standby state;
[0007] Using the skin sensing module to perform smart glasses camera wearing detection, and obtain wearing sensing instructions, wherein the wearing sensing instructions include: wearing instructions and not wearing instructions;
[0008] When the wearing sensing instruction is a non-wearing instruction, the smart glasses camera is kept in a standby state;
[0009] When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained;
[0010] An interference test environment group is set, and based on the interference test environment group, a multi-environment tooth knocking simulation is performed to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a movement test environment, and a static test environment;
[0011] According to the effective test voltage group, the interference signal analysis is performed on the tooth vibration voltage set to obtain the effective vibration voltage set;
[0012] Perform tooth knocking vibration recognition in the effective vibration voltage concentration to obtain the effective knocking number, and start control of the shooting module and the recording module according to the effective knocking number and the preset knocking control specification;
[0013] When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program to complete the control of the smart glasses with camera function.
[0014] Optionally, the step of performing smart glasses camera wearing detection by using a skin sensing module to obtain a wearing sensing instruction includes:
[0015] Set the contact detection cycle and contact detection frequency of the skin sensing module;
[0016] Based on the contact detection cycle and the contact detection frequency, a skin contact detection is performed using a skin sensing module to obtain an original contact voltage. When the original contact voltage is not less than a preset minimum contact voltage, the current contact start time is recorded, and the original contact voltage is recorded as the contact start voltage.
[0017] From the moment of contact start, skin contact detection is performed using a skin sensing module to obtain a contact original voltage group, and the contact start voltage is added to the contact original voltage group to obtain a contact effective voltage group;
[0018] Based on the contact effective voltage group, an effective contact analysis is performed to obtain an effective contact coefficient, and it is determined whether the effective contact coefficient is greater than a preset standard contact coefficient;
[0019] If the effective contact coefficient is not greater than the standard contact coefficient, returning to the step of performing skin contact detection using a skin sensing module based on the contact detection cycle and the contact detection frequency;
[0020] If the effective contact coefficient is greater than the standard contact coefficient, the contact effective voltage group is recorded as a contacted voltage group;
[0021] Obtaining the end detection time of the contacted voltage group, updating the contact start time using the end detection time, and returning to the step of performing skin contact detection using the skin sensing module from the contact start time until the number of contacted voltage groups is not less than a preset minimum number of contact groups;
[0022] Summarizing the contacted voltage groups to obtain a contacted voltage group set, identifying a total contact duration of the contacted voltage group set, and determining whether the total contact duration is greater than a preset minimum contact duration;
[0023] If the total contact time is not greater than the shortest contact time, a wearing instruction is generated;
[0024] If the total contact time is greater than the shortest contact time, a not-wearing instruction is generated.
[0025] Optionally, performing effective contact analysis based on the contact effective voltage group to obtain an effective contact coefficient includes:
[0026] Based on the contact effective voltage group, a voltage fluctuation analysis is performed to obtain a voltage fluctuation value group, wherein the number of voltage fluctuation values in the voltage fluctuation value group is the number of contact effective voltages in the contact effective voltage group minus one, and the voltage fluctuation value group is expressed as:
[0027]
[0028] in, Indicates the voltage fluctuation value group, represents the i-th voltage fluctuation value in the voltage fluctuation value group, represents the i+1th contact effective voltage in the contact effective voltage group, represents the effective voltage of the ith contact, Indicates the number of effective contact voltages in the effective contact voltage group;
[0029] Counting the number of contact targets in the contact effective voltage group, wherein the number of contact targets is the number of contact effective voltages in the contact effective voltage group that are not less than the minimum contact voltage;
[0030] According to the voltage fluctuation value group and the number of contact targets, the effective contact coefficient is calculated, where the effective contact coefficient is expressed as:
[0031]
[0032] in, represents the effective contact coefficient, Indicates the number of contact targets, Represents the jth voltage fluctuation value.
[0033] Optionally, the tooth vibration signal collection by using a vibration sensing module to obtain a tooth vibration signal set includes:
[0034] Set the vibration detection period and vibration detection frequency;
[0035] Based on the vibration detection period and the vibration detection frequency, a vibration sensing module is used to detect the vibration signal to obtain an original vibration signal, and the original vibration signal is added to a pre-constructed original vibration signal group to obtain a target vibration signal group;
[0036] Record the vibration detection duration of the current vibration signal detection;
[0037] Obtain the current operating state of the smart glasses camera, where the operating state includes: an idle state and a working state, where the idle state means that the current smart glasses camera is not shooting, recording or recording, and the working state means that the current smart glasses camera is shooting, recording or recording;
[0038] When the running state is the working state, the target vibration signal group is updated using a preset empty set, and the step of detecting the vibration signal using the vibration sensing module based on the vibration detection period and the vibration detection frequency is stopped;
[0039] When the running state is an idle state, the original vibration signal group is updated using the target vibration signal group, and the step of performing vibration signal detection using the vibration sensing module based on the vibration detection period and the vibration detection frequency is returned until the vibration detection duration is not less than the preset minimum vibration detection duration;
[0040] The target vibration signal groups are combined to obtain a tooth vibration signal set.
[0041] Optionally, the multi-environment tooth knocking simulation is performed based on the interference test environment group to obtain an effective test voltage group, including:
[0042] Setting a plurality of user test groups, wherein each user test group includes an experience user and a smart glasses camera;
[0043] The following test is performed on each of the multiple user test groups:
[0044] Under each interference test environment, a tooth knocking test is performed using a user test group, and a test vibration voltage group and a corresponding test acquisition time group in the tooth knocking test are recorded;
[0045] In the step of performing the tooth knocking test, the operating state of the smart glasses camera is monitored to obtain a working state time group, wherein the working state time is the time when the smart glasses camera changes from an idle state to a working state;
[0046] Based on the working state time group, time matching is performed in the test acquisition time group to obtain the vibration effective time group, and the test effective voltage group corresponding to the vibration effective time group is identified in the test vibration voltage group;
[0047] The test effective voltage groups of multiple interference environments of each user test group are summarized to obtain a test effective voltage set, and based on a preset effective voltage number, a valid test voltage group is identified in the test effective voltage set, wherein the number of times the valid test voltage appears in the test effective voltage set is not less than the effective voltage number.
[0048] Optionally, the tooth percussion test using the user test group includes:
[0049] Setting a start-up knocking times array, wherein the start-up knocking times array includes: a shooting start-up knocking times, a video start-up knocking times, and a sound recording start-up knocking times;
[0050] Extract the start knock times in the start knock times array in sequence;
[0051] Obtain the current knocking start time, and based on the knocking start time, the number of start knocking times and the preset single test duration, use the user test group to perform continuous tooth knocking, and based on the vibration detection frequency, perform vibration sensing detection in the continuous tooth knocking step to obtain a knocking test voltage group and a knocking collection time group, wherein the knocking test voltage corresponds to the knocking collection time one by one;
[0052] After the user test group completes the step of continuous tooth tapping, the current tapping test duration is obtained, and the process returns to the step of obtaining the current tapping start time until the tapping test duration is not less than the preset standard test duration;
[0053] The knock test voltage group and the knock collection time group are respectively summarized to obtain a test vibration voltage group and a test collection time group.
[0054] Optionally, the step of performing time matching in the test collection time group based on the working state time group to obtain the vibration effective time group includes:
[0055] The reaction fluctuation duration is set, the working state moments are sequentially extracted from the working state moment group, and a working time range is generated based on the reaction fluctuation duration and the working state moment, wherein the working time range is expressed as:
[0056]
[0057] in, Indicates the working time range, Indicates the working status time. Indicates the duration of reaction fluctuation;
[0058] Based on the working time range, the effective working time group is identified in the test collection time group, and the effective working time group corresponding to each working state moment is summarized to obtain the vibration effective time group, wherein the effective working time is the test collection time within the working time range.
[0059] Optionally, performing interference signal analysis on the tooth vibration voltage set to obtain an effective vibration voltage set includes:
[0060] Extracting tooth vibration voltages in sequence from the tooth vibration voltage set, and determining whether the tooth vibration voltage is in the valid test voltage group;
[0061] If the tooth vibration voltage is in the valid test voltage group, the tooth vibration voltage is recorded as a candidate vibration voltage, and the candidate vibration voltages are summarized to obtain a candidate vibration voltage group, wherein the candidate vibration voltages in the candidate vibration voltage group are sorted according to the time of collection;
[0062] Extracting a first vibration voltage from the candidate vibration voltage group, and extracting a subsequent vibration voltage of the first vibration voltage, and identifying a first acquisition time of the first vibration voltage and a subsequent acquisition time of the subsequent vibration voltage respectively;
[0063] Calculate the collection time difference between the first collection time and the second collection time, and determine whether the collection time difference is less than a preset maximum interval time difference;
[0064] If the acquisition time difference is less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are added to the pre-constructed original vibration voltage set to obtain a target vibration voltage set, and the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group;
[0065] If the acquisition time difference is not less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group;
[0066] The defective vibration voltage group and the target vibration voltage set are used to update the candidate vibration voltage group and the original vibration voltage set respectively, and the step of extracting the first vibration voltage in the candidate vibration voltage group is returned until the defective vibration voltage group is an empty set, and the target vibration voltage set at this time is recorded as a valid vibration voltage set.
[0067] Optionally, performing tooth knocking vibration identification in the effective vibration voltage set to obtain the effective knocking number includes:
[0068] Extracting a first effective voltage and a second effective voltage from the effective vibration voltage set, and obtaining a first effective time of the first effective voltage and a second effective time of the second effective voltage respectively;
[0069] Calculate the effective time difference between the first effective time and the second effective time, and determine whether the effective time difference is greater than the preset minimum effective interval;
[0070] If the effective time difference is not greater than the minimum effective interval, the first effective voltage is added to the pre-constructed original effective voltage group to obtain a target effective voltage group;
[0071] Eliminate the first effective voltage from the effective vibration voltage set to obtain an eliminated effective voltage set, use the eliminated effective voltage set and the target effective voltage group to update the effective vibration voltage set and the original effective voltage group respectively, and return to the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set until the eliminated effective voltage set is an empty set;
[0072] If the effective time difference is greater than the minimum effective interval, the first effective voltage is removed from the effective vibration voltage set to obtain a removed effective voltage set, and the effective vibration voltage set and the original effective voltage group are updated using the removed effective voltage set and the empty set, respectively, and the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set is returned until the removed effective voltage set is an empty set;
[0073] The number of effective voltages of each target effective voltage group is counted to obtain an effective voltage array, the maximum number of voltages in the effective voltage array is identified, and the maximum number of voltages is recorded as the effective number of tappings.
[0074] To achieve the above object, the present invention further provides a smart glasses control system with a camera function, comprising:
[0075] A power module startup module, used to receive a smart glasses control instruction, and start a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and the smart glasses camera is in a standby state at this time;
[0076] A tooth vibration detection module is used to use a skin sensing module to perform wearing detection on a smart glasses camera and obtain a wearing sensing instruction, wherein the wearing sensing instruction includes: a wearing instruction and a not wearing instruction. When the wearing sensing instruction is a not wearing instruction, the smart glasses camera is kept in a standby state. When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained.
[0077] An effective vibration identification module is used to set an interference test environment group, and based on the interference test environment group, perform multi-environment tooth knocking simulation to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a motion test environment, and a static test environment. According to the effective test voltage group, an interference signal analysis is performed on the tooth vibration voltage set to obtain an effective vibration voltage set;
[0078] The smart glasses control module is used to identify the tooth knocking vibration in the effective vibration voltage concentration, obtain the effective knocking number, and start the shooting module and the recording module according to the effective knocking number and the preset knocking control specification. When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program.
[0079] In order to solve the above problem, the present invention further provides an electronic device, the electronic device comprising:
[0080] A memory storing at least one instruction; and a processor executing the instruction stored in the memory to implement the above-mentioned smart glasses control method with camera function.
[0081] In order to solve the above problems, the present invention also provides a computer-readable storage medium, in which at least one instruction is stored. The at least one instruction is executed by a processor in an electronic device to implement the above-mentioned smart glasses control method with camera function.
[0082] The present invention solves the problems described in the background technology. First, by integrating a skin sensing module, it can automatically detect whether the user is wearing a smart glasses camera, and generate corresponding wearing sensing instructions according to the detection results. These instructions are used to determine whether the user has worn the device correctly, and automatically adjust the working mode of the smart glasses camera according to the user's wearing status, thereby optimizing the user experience. Further, by constructing an interference test environment group, the tooth knocking conditions in multiple environments can be simulated to obtain an effective test voltage group. This step provides important reference data for accurately detecting the vibration voltage generated when the user knocks his teeth, and significantly improves the accuracy of detecting the tooth knocking vibration voltage in various practical application scenarios. Using these effective vibration voltage data, the tooth knocking vibration can be accurately identified, and the effective number of knocks during the tooth knocking process can be counted. Based on the effective number of knocks, the smart glasses camera can automatically control the start-up of the shooting module or the recording module, so that the user can control the shooting, video recording and recording functions of the smart glasses camera through a simple physical action-tooth knocking. This control method is particularly suitable for occasions where the user's hands are inconvenient or need to operate both hands freely, greatly enhancing the convenience and practicality of the smart glasses camera. Therefore, the present invention can improve the convenience of using smart glasses and enhance the user experience of smart glasses. BRIEF DESCRIPTION OF THE DRAWINGS
[0083] Figure 1 A schematic diagram of a flow chart of a method for controlling smart glasses with a camera function provided by an embodiment of the present invention;
[0084] Figure 2 A functional module diagram of a smart glasses control system with a camera function provided by an embodiment of the present invention;
[0085] Figure 3 A schematic diagram of the structure of an electronic device for implementing the method for controlling smart glasses with a camera function provided by an embodiment of the present invention.
[0086] Description of reference numerals:
[0087] 1. Electronic device; 10. Processor; 11. Memory; 12. Bus.
[0088] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0089] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0090] The embodiment of the present application provides a method for controlling smart glasses with a camera function. The execution subject of the method for controlling smart glasses with a camera function includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the method for controlling smart glasses with a camera function can be executed by software or hardware installed on a terminal device or a server device, and the software can be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.
[0091] Reference Figure 1 FIG. 1 is a flow chart of a method for controlling smart glasses with a camera function provided by an embodiment of the present invention. In this embodiment, the method for controlling smart glasses with a camera function includes:
[0092] S1. Receive a smart glasses control instruction, and start a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera also includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and the smart glasses camera is in standby mode at this time.
[0093] It can be understood that the smart glasses control instruction refers to an instruction initiated manually to turn on the power of the smart glasses. The smart glasses control instruction can be for manually turning on the power switch of the smart glasses camera. The power module refers to the energy supply center of the smart glasses camera, which contains a lithium battery and a power management circuit, and is responsible for providing power to other modules of the smart glasses camera. The smart glasses camera refers to a pair of glasses that can be used for shooting, video recording and audio recording. The smart glasses camera is similar in appearance to ordinary myopia glasses on the market. The frame part of the smart glasses camera has a display light module and a shooting module, the left temple has a vibration sensing module, a recording module, a touch button module, a power module and a signal receiving module, the right temple has a power switch and a circuit chip for controlling the operation of the entire smart glasses camera, the connection part between the left temple and the frame is the installation part of the display light module, the connection part between the right temple and the frame is the installation part of the shooting module, and a skin sensing module is installed on the nose pad part of the smart glasses camera, and the skin sensing module will contact the user's nose bridge.
[0094] It can be understood that the display light module is an LED display light, which is used to display the current working status of the smart glasses camera. When the smart glasses camera is in the off state, the LED display light is off. When the smart glasses camera is in the standby state, shooting state, recording state and recording state, the LED display light will display different colors. The shooting module refers to a camera that can capture and record images. The image module includes functions such as autofocus and image processing.
[0095] Furthermore, the recording module refers to a module capable of voice input, voice recognition and recording functions, which includes a microphone module, allowing the smart glasses camera to capture sound for recording or recognition of voice control commands. The touch button module refers to the physical operation interface of the smart glasses camera. Users can control the glasses camera's photo taking, video recording and audio playback functions through the touch button module. The skin sensing module refers to a sensor for detecting whether the user is wearing glasses. A nose bridge skin sensing sensor can be selected as the skin sensing module, which is a capacitive sensor.
[0096] It needs to be explained that the vibration sensing module refers to a vibration sensor that can detect the vibration of the user's teeth. The vibration sensing module can detect the number of times the user's teeth knock, and control the activation of related functions of the smart glasses camera through the number of times the teeth knock. For example: when the number of times the user's teeth knock is 3, the shooting module is started to shoot. The signal receiving module refers to a device that can realize wireless signal transmission, which includes Bluetooth and WiFi modules. It enables the smart glasses camera to connect to mobile devices such as smartphones to transmit and control audio and video files.
[0097] For example, Xiao Zhang is a user of a smart glasses camera. When Xiao Zhang starts the smart glasses camera, the LED display light of the smart glasses camera is off. After Xiao Zhang turns on the power switch of the smart glasses camera, it is deemed that the user has sent a smart glasses control instruction to the smart glasses camera, and the power module completes the startup. At this time, the LED display light flashes 3 times and remains in the blue light state, indicating that the power module has been started and the smart glasses camera is in standby mode.
[0098] S2. Use the skin sensing module to perform smart glasses camera wearing detection to obtain a wearing sensing instruction, wherein the wearing sensing instruction includes: a wearing instruction and a not wearing instruction.
[0099] It can be understood that the wearing sensing instruction refers to the detection result obtained by the skin sensing module after detecting the user's smart glasses camera wearing behavior. The detection result is in two situations: the user is already wearing the smart glasses camera, and the skin sensing module will generate a wearing instruction; the user is not wearing the smart glasses camera, and the skin sensing module will generate a not wearing instruction.
[0100] In detail, the use of the skin sensing module to perform smart glasses camera wearing detection and obtain a wearing sensing instruction includes:
[0101] Set the contact detection cycle and contact detection frequency of the skin sensing module;
[0102] Based on the contact detection cycle and the contact detection frequency, a skin contact detection is performed using a skin sensing module to obtain an original contact voltage. When the original contact voltage is not less than a preset minimum contact voltage, the current contact start time is recorded, and the original contact voltage is recorded as the contact start voltage.
[0103] From the moment of contact start, skin contact detection is performed using a skin sensing module to obtain a contact original voltage group, and the contact start voltage is added to the contact original voltage group to obtain a contact effective voltage group;
[0104] Based on the contact effective voltage group, an effective contact analysis is performed to obtain an effective contact coefficient, and it is determined whether the effective contact coefficient is greater than a preset standard contact coefficient;
[0105] If the effective contact coefficient is not greater than the standard contact coefficient, returning to the step of performing skin contact detection using a skin sensing module based on the contact detection cycle and the contact detection frequency;
[0106] If the effective contact coefficient is greater than the standard contact coefficient, the contact effective voltage group is recorded as a contacted voltage group;
[0107] Obtaining the end detection time of the contacted voltage group, updating the contact start time using the end detection time, and returning to the step of performing skin contact detection using the skin sensing module from the contact start time until the number of contacted voltage groups is not less than a preset minimum number of contact groups;
[0108] Summarizing the contacted voltage groups to obtain a contacted voltage group set, identifying a total contact duration of the contacted voltage group set, and determining whether the total contact duration is greater than a preset minimum contact duration;
[0109] If the total contact time is not greater than the shortest contact time, a wearing instruction is generated;
[0110] If the total contact time is greater than the shortest contact time, a not-wearing instruction is generated.
[0111] It can be understood that the contact detection cycle refers to the total duration of skin sensing detection, the contact detection frequency refers to the number of times the skin sensing module performs detection per unit time, and they are all artificially set constants. The original contact voltage refers to the voltage value detected by the skin sensing module, the contact start voltage refers to the original contact voltage that is not less than the minimum contact voltage, the contact original voltage group refers to the voltage combination detected by the skin sensing module within a contact detection cycle from the start of contact, wherein the detection frequency is the contact detection frequency, the contact effective voltage group refers to the contact original voltage group after the contact start voltage is supplemented, the effective contact coefficient refers to a value used to represent the degree of contact between the user and the smart glasses camera, and the standard contact coefficient refers to an artificially set constant.
[0112] It is clear that the terminal detection time refers to the collection time of the last collected contacted voltage in the contacted voltage group. For example, the collection time of voltage a is 20min20s, which is the latest voltage collected in the contacted voltage group. Therefore, the terminal detection time is the collection time corresponding to the voltage: 20min20s. The minimum number of contact groups refers to an artificially set constant, which indicates the number of contacted voltage groups that need to be obtained at least. When the number of contacted voltage groups is less than the minimum number of contact groups, the subsequent data processing will have a large deviation due to the small amount of data obtained. The total contact time refers to the total time consumed to detect the contacted voltage group set. The shortest contact time refers to an artificially set constant. When the total contact time is not greater than the shortest contact time, it means that the user has correctly worn the smart glasses camera at this time, so the complete contacted voltage set can be obtained in a shorter time.
[0113] In detail, the effective contact analysis is performed based on the contact effective voltage group to obtain the effective contact coefficient, including:
[0114] Based on the contact effective voltage group, a voltage fluctuation analysis is performed to obtain a voltage fluctuation value group, wherein the number of voltage fluctuation values in the voltage fluctuation value group is the number of contact effective voltages in the contact effective voltage group minus one, and the voltage fluctuation value group is expressed as:
[0115]
[0116] in, Indicates the voltage fluctuation value group, represents the i-th voltage fluctuation value in the voltage fluctuation value group, represents the i+1th contact effective voltage in the contact effective voltage group, represents the effective voltage of the ith contact, Indicates the number of effective contact voltages in the effective contact voltage group;
[0117] Counting the number of contact targets in the contact effective voltage group, wherein the number of contact targets is the number of contact effective voltages in the contact effective voltage group that are not less than the minimum contact voltage;
[0118] According to the voltage fluctuation value group and the number of contact targets, the effective contact coefficient is calculated, where the effective contact coefficient is expressed as:
[0119]
[0120] in, represents the effective contact coefficient, Indicates the number of contact targets, Represents the jth voltage fluctuation value.
[0121] Further, the voltage fluctuation value refers to the difference between two adjacent contact effective voltages in the contact effective voltage group, and the contact target number refers to the number of contact target voltages that are not less than the minimum contact voltage in the contact effective voltage group.
[0122] S3. When the wearing sensing instruction is a non-wearing instruction, the camera of the smart glasses is kept in a standby state.
[0123] It should be explained that when the wearing sensing instruction is a non-wearing instruction, it means that the current user is not wearing the smart glasses camera. In order to ensure a long battery life of the smart glasses camera and to avoid accidental touches, the vibration sensing module will not be started. At this time, the status of the display light module is still blue light.
[0124] S4. When the wearing sensing instruction is a wearing instruction, start the vibration sensing module, and use the vibration sensing module to collect tooth vibration signals to obtain a tooth vibration signal set, and obtain a tooth vibration voltage set of the tooth vibration signal set.
[0125] It can be understood that when the wearing sensing instruction is a wearing instruction, it means that the current user has worn the smart glasses camera correctly, and the vibration sensing module can be started to detect user behavior at all times. The original tooth vibration signal set refers to the vibration signal set collected by the vibration sensing module within a preset vibration detection period. The vibration sensing module is installed at the front end of the left temple of the smart glasses camera, that is, the connecting part of the left temple and the frame, and the vibration sensing module is a capacitive sensor.
[0126] In detail, the tooth vibration signal collection by using the vibration sensing module to obtain the tooth vibration signal set includes:
[0127] Set the vibration detection period and vibration detection frequency;
[0128] Based on the vibration detection period and the vibration detection frequency, a vibration sensing module is used to detect the vibration signal to obtain an original vibration signal, and the original vibration signal is added to a pre-constructed original vibration signal group to obtain a target vibration signal group;
[0129] Record the vibration detection duration of the current vibration signal detection;
[0130] Obtain the current operating state of the smart glasses camera, where the operating state includes: an idle state and a working state, where the idle state means that the current smart glasses camera is not shooting, recording or recording, and the working state means that the current smart glasses camera is shooting, recording or recording;
[0131] When the running state is the working state, the target vibration signal group is updated using a preset empty set, and the step of detecting the vibration signal using the vibration sensing module based on the vibration detection period and the vibration detection frequency is stopped;
[0132] When the running state is an idle state, the original vibration signal group is updated using the target vibration signal group, and the step of performing vibration signal detection using the vibration sensing module based on the vibration detection period and the vibration detection frequency is returned until the vibration detection duration is not less than the preset minimum vibration detection duration;
[0133] The target vibration signal groups are combined to obtain a tooth vibration signal set.
[0134] It can be understood that the vibration detection period and vibration detection frequency are both artificially set constants, the original vibration signal refers to the vibration signal detected by the vibration sensing module once, the original vibration signal group refers to the set of original vibration signals detected in the meantime, and the target vibration signal group refers to the original vibration signal group after the original vibration signal is supplemented.
[0135] It should be explained that when the camera of the smart glasses is in the state of shooting, recording or recording, the user does not need to control the start of the shooting module and the recording module by knocking the teeth. The user can start the shooting module or the recording module by knocking the teeth, voice input or button input. When the user starts the shooting module or the recording module by voice input or button input, the vibration signal collected by the vibration sensing module at this time needs to be reset to zero, because the vibration signal collected by the vibration sensing module at this time will not provide any valid information.
[0136] For example, Xiao Zhang is a user of a smart glasses camera. After Xiao Zhang wears the smart glasses camera correctly, the vibration sensing module is started up and monitors Xiao Zhang's tooth vibration signal at all times. At this time, the operating state of the smart glasses camera is idle. After a period of time, the vibration sensing module collects a target vibration signal group. At this time, Xiao Zhang completes the startup of the shooting module through the touch button module on the smart glasses camera, so the operating state of the smart glasses camera changes from idle to working. It is necessary to clear the target vibration signal group obtained at this time to an empty set and stop vibration sensing. If Xiao Zhang does not change the idle state of the smart glasses camera by other means at this time, the vibration signal detection continues until the vibration signal detection duration is not less than the minimum vibration detection duration.
[0137] S5. Setting an interference test environment group, and based on the interference test environment group, performing a multi-environment tooth knocking simulation to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a motion test environment, and a static test environment.
[0138] It should be explained that the interference test environment group refers to the activity state used to simulate the user's actual application in which a large number of vibration signals will be generated. Among them, the chewing test environment refers to the activity state of the user when eating, the motion test environment refers to the user's running, walking and other motion states, and the static test environment refers to the user's static state.
[0139] Furthermore, since the vibration sensing module detects the user's vibration signal, not all signals in the original vibration signal set are about the user's teeth knocking. For example, the vibration signal generated by the user touching the frame of the glasses with his hands, the vibration signal generated when the user chews, etc. These signals need to be eliminated from the original vibration signal set.
[0140] In detail, the multi-environment tooth knocking simulation is performed based on the interference test environment group to obtain an effective test voltage group, including:
[0141] Setting a plurality of user test groups, wherein each user test group includes an experience user and a smart glasses camera;
[0142] The following test is performed on each of the multiple user test groups:
[0143] Under each interference test environment, a tooth knocking test is performed using a user test group, and a test vibration voltage group and a corresponding test acquisition time group in the tooth knocking test are recorded;
[0144] In the step of performing the tooth knocking test, the operating state of the smart glasses camera is monitored to obtain a working state time group, wherein the working state time is the time when the smart glasses camera changes from an idle state to a working state;
[0145] Based on the working state time group, time matching is performed in the test acquisition time group to obtain the vibration effective time group, and the test effective voltage group corresponding to the vibration effective time group is identified in the test vibration voltage group;
[0146] The test effective voltage groups of multiple interference environments of each user test group are summarized to obtain a test effective voltage set, and based on a preset effective voltage number, a valid test voltage group is identified in the test effective voltage set, wherein the number of times the valid test voltage appears in the test effective voltage set is not less than the effective voltage number.
[0147] It can be understood that the user test group is an experience user wearing a smart glasses camera, and in the teeth knocking test, the experience user will not start the shooting module or the recording module by any means other than teeth knocking. The test vibration voltage group refers to the set of signal voltages detected by the vibration sensing module in the smart glasses camera during the teeth knocking test. The test acquisition time group refers to the set of times when the test vibration voltage is obtained. The working status time refers to the time when the smart glasses camera changes from an idle state to a working state.
[0148] For example, the current state of a smart glasses camera is an idle state, and the shooting module of the smart glasses camera completes startup at 20 minutes and 30 seconds, so the current 20 minutes and 30 seconds is recorded as the working state time.
[0149] Furthermore, after the user completes the teeth knocking, the smart glasses camera will not immediately start the corresponding function, but needs to wait for a response time. Therefore, the working state moment is not the moment when the user completes the teeth knocking. The vibration effective moment can be expressed as the moment when the user completes the teeth knocking. The test effective voltage group refers to the test vibration voltage corresponding to the vibration effective moment, and the effective voltage number refers to a manually set quantitative constant.
[0150] For example, the number of effective voltages is 2, and the effective voltage set of a certain test is: {10V, 20V, 10V, 30V, 20V}, wherein the number of times 10V, 20V and 30V appear in the effective voltage set of the test are: 2, 2 and 1 respectively, and the top two numbers of their appearances are 10V and 20V, so 10V and 20V are effective test voltages.
[0151] In detail, the tooth percussion test using the user test group includes:
[0152] Setting a start-up knocking times array, wherein the start-up knocking times array includes: a shooting start-up knocking times, a video start-up knocking times, and a sound recording start-up knocking times;
[0153] Extract the start knock times in the start knock times array in sequence;
[0154] Obtain the current knocking start time, and based on the knocking start time, the number of start knocking times and the preset single test duration, use the user test group to perform continuous tooth knocking, and based on the vibration detection frequency, perform vibration sensing detection in the continuous tooth knocking step to obtain a knocking test voltage group and a knocking collection time group, wherein the knocking test voltage corresponds to the knocking collection time one by one;
[0155] After the user test group completes the step of continuous tooth tapping, the current tapping test duration is obtained, and the process returns to the step of obtaining the current tapping start time until the tapping test duration is not less than the preset standard test duration;
[0156] The knock test voltage group and the knock collection time group are respectively summarized to obtain a test vibration voltage group and a test collection time group.
[0157] It should be explained that the number of start-up knocking times refers to the number of teeth knockings manually set for starting different functions of the smart glasses camera, among which the number of knockings to start shooting, the number of knockings to start video recording and the number of knockings to start recording respectively refer to the number of teeth knockings required to start the shooting module for shooting, the number of teeth knockings required to start the shooting module for video recording, and the number of teeth knockings required to start the recording module for recording. The single test duration refers to the duration manually set for the experiencing user to perform a continuous teeth knocking step. The knocking test duration refers to the total time for the user test group to complete the continuous teeth knocking, which is expressed as the total number of continuous teeth knocking steps performed by the user test group multiplied by the single test duration.
[0158] For example, Xiao Wang is an experience user in a user test group. Once, Xiao Wang needs to perform continuous tooth tapping while eating. The start number of tapping steps is set to 3 times, and the single test duration is set to 10s. When the tapping start time is 20min10s, Xiao Wang starts eating, and the single eating duration is 10s. During the eating process, Xiao Wang randomly performs continuous tooth tapping, where the number of continuous tapping is 3 times. After 10s, the smart glasses camera records the tapping test voltage group and the tapping collection time group within these 10s.
[0159] In detail, the time matching is performed in the test collection time group based on the working state time group to obtain the vibration effective time group, including:
[0160] The reaction fluctuation duration is set, the working state moments are sequentially extracted from the working state moment group, and a working time range is generated based on the reaction fluctuation duration and the working state moment, wherein the working time range is expressed as:
[0161]
[0162] in, Indicates the working time range, Indicates the working status time. Indicates the duration of reaction fluctuation;
[0163] Based on the working time range, the effective working time group is identified in the test collection time group, and the effective working time group corresponding to each working state moment is summarized to obtain the vibration effective time group, wherein the effective working time is the test collection time within the working time range.
[0164] It can be understood that the reaction fluctuation duration refers to the time interval between the smart glasses camera receiving the teeth knocking instruction and the completion of the startup of the corresponding functional module, and the reaction fluctuation duration is set manually.
[0165] S6. According to the effective test voltage group, interference signal analysis is performed on the tooth vibration voltage set to obtain an effective vibration voltage set.
[0166] It should be explained that the effective vibration voltage refers to the vibration signal voltage generated by tooth knocking.
[0167] In detail, the interference signal analysis of the tooth vibration voltage set to obtain the effective vibration voltage set includes:
[0168] Extracting tooth vibration voltages in sequence from the tooth vibration voltage set, and determining whether the tooth vibration voltage is in the valid test voltage group;
[0169] If the tooth vibration voltage is in the valid test voltage group, the tooth vibration voltage is recorded as a candidate vibration voltage, and the candidate vibration voltages are summarized to obtain a candidate vibration voltage group, wherein the candidate vibration voltages in the candidate vibration voltage group are sorted according to the time of collection;
[0170] Extracting a first vibration voltage from the candidate vibration voltage group, and extracting a subsequent vibration voltage of the first vibration voltage, and identifying a first acquisition time of the first vibration voltage and a subsequent acquisition time of the subsequent vibration voltage respectively;
[0171] Calculate the collection time difference between the first collection time and the second collection time, and determine whether the collection time difference is less than a preset maximum interval time difference;
[0172] If the acquisition time difference is less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are added to the pre-constructed original vibration voltage set to obtain a target vibration voltage set, and the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group;
[0173] If the acquisition time difference is not less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group;
[0174] The defective vibration voltage group and the target vibration voltage set are used to update the candidate vibration voltage group and the original vibration voltage set respectively, and the step of extracting the first vibration voltage in the candidate vibration voltage group is returned until the defective vibration voltage group is an empty set, and the target vibration voltage set at this time is recorded as a valid vibration voltage set.
[0175] It can be understood that the first vibration voltage refers to the candidate vibration voltage ranked first in the candidate vibration voltage group, the second vibration voltage refers to the candidate vibration voltage ranked after the first candidate vibration voltage in the candidate vibration voltage group, the acquisition time difference refers to the difference between the first acquisition time and the second acquisition time, the original vibration voltage set refers to the set of the first vibration voltage and the second vibration voltage collected before, and the target vibration voltage set refers to the original vibration voltage set after being supplemented by the currently extracted first vibration voltage and the second vibration voltage.
[0176] S7. Perform tooth knocking vibration recognition in the effective vibration voltage concentration to obtain the effective knocking number, and start control of the shooting module and the recording module according to the effective knocking number and the preset knocking control specification.
[0177] It can be understood that the effective number of knocks refers to the number of times the user actually knocks his teeth, and the effective number of knocks can start the shooting module and the recording module. The knock control specification refers to the startup rules corresponding to the manually set effective number of knocks. For example: when the effective number of knocks is 2, the shooting module is started to take pictures; when the effective number of knocks is 3, the shooting module is started to record; when the effective number of knocks is 4, the recording module is started to record; when the effective number of knocks is 0 or less than 2, the smart glasses camera is kept in an idle state.
[0178] It should be noted that when the shooting module and the recording module are started, the display light module will emit an indicator light corresponding to the working status. For example, when the number of effective taps is 2, the shooting module is started to take pictures. At this time, the display light module will flash green twice and keep the green light on during the photo-taking process.
[0179] In detail, the tooth knocking vibration recognition is performed in the effective vibration voltage concentration to obtain the effective knocking number, including:
[0180] Extracting a first effective voltage and a second effective voltage from the effective vibration voltage set, and obtaining a first effective time of the first effective voltage and a second effective time of the second effective voltage respectively;
[0181] Calculate the effective time difference between the first effective time and the second effective time, and determine whether the effective time difference is greater than the preset minimum effective interval;
[0182] If the effective time difference is not greater than the minimum effective interval, the first effective voltage is added to the pre-constructed original effective voltage group to obtain a target effective voltage group;
[0183] Eliminate the first effective voltage from the effective vibration voltage set to obtain an eliminated effective voltage set, use the eliminated effective voltage set and the target effective voltage group to update the effective vibration voltage set and the original effective voltage group respectively, and return to the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set until the eliminated effective voltage set is an empty set;
[0184] If the effective time difference is greater than the minimum effective interval, the first effective voltage is removed from the effective vibration voltage set to obtain a removed effective voltage set, and the effective vibration voltage set and the original effective voltage group are updated using the removed effective voltage set and the empty set, respectively, and the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set is returned until the removed effective voltage set is an empty set;
[0185] The number of effective voltages of each target effective voltage group is counted to obtain an effective voltage array, the maximum number of voltages in the effective voltage array is identified, and the maximum number of voltages is recorded as the effective number of tappings.
[0186] It should be explained that the first effective voltage and the second effective voltage refer to the effective vibration voltages concentrated and ranked in the first and second places respectively, the effective time difference refers to the difference between the first effective time and the second effective time, the minimum effective interval refers to an artificially set time interval constant, the original effective voltage group refers to the set of the first effective voltage and the second effective voltage obtained previously, the target effective voltage group refers to the original effective voltage group after being supplemented by the currently obtained first effective voltage and the second effective voltage, and the number of effective voltages refers to the number of target effective voltages in the target effective voltage group.
[0187] S8. After the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program to complete the control of the smart glasses with camera function.
[0188] It is understandable that when the shooting module or the recording module is started, it means that the current smart glasses camera is in the shooting state, the recording state or the recording state. At this time, the user can control the smart glasses camera through the mobile phone application, for example: adjust the shooting focal length during shooting, the volume during recording, etc. through the application.
[0189] The present invention solves the problems described in the background technology. First, by integrating a skin sensing module, it can automatically detect whether the user is wearing a smart glasses camera, and generate corresponding wearing sensing instructions according to the detection results. These instructions are used to determine whether the user has worn the device correctly, and automatically adjust the working mode of the smart glasses camera according to the user's wearing status, thereby optimizing the user experience. Further, by constructing an interference test environment group, the tooth knocking conditions in multiple environments can be simulated to obtain an effective test voltage group. This step provides important reference data for accurately detecting the vibration voltage generated when the user knocks his teeth, and significantly improves the accuracy of detecting the tooth knocking vibration voltage in various practical application scenarios. Using these effective vibration voltage data, the tooth knocking vibration can be accurately identified, and the effective number of knocks during the tooth knocking process can be counted. Based on the effective number of knocks, the smart glasses camera can automatically control the start-up of the shooting module or the recording module, so that the user can control the shooting, video recording and recording functions of the smart glasses camera through a simple physical action-tooth knocking. This control method is particularly suitable for occasions where the user's hands are inconvenient or need to operate both hands freely, greatly enhancing the convenience and practicality of the smart glasses camera. Therefore, the present invention can improve the convenience of using smart glasses and enhance the user experience of smart glasses.
[0190] like Figure 2 , which is a functional module diagram of a smart glasses control system with a camera function provided by an embodiment of the present invention.
[0191] The smart glasses control system 100 with camera function of the present invention can be installed in an electronic device. According to the functions to be implemented, the smart glasses control system 100 with camera function can include a power module startup module 101, a tooth vibration detection module 102, an effective vibration identification module 103 and a smart glasses control module 104. The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.
[0192] The power module startup module 101 is used to receive a smart glasses control instruction and start a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and the smart glasses camera is in a standby state at this time;
[0193] The tooth vibration detection module 102 is used to use the skin sensing module to perform wearing detection of the smart glasses camera to obtain a wearing sensing instruction, wherein the wearing sensing instruction includes: a wearing instruction and a not wearing instruction. When the wearing sensing instruction is a not wearing instruction, the smart glasses camera is kept in a standby state. When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained;
[0194] The effective vibration identification module 103 is used to set an interference test environment group, and based on the interference test environment group, perform multi-environment tooth knocking simulation to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a motion test environment and a static test environment, and according to the effective test voltage group, perform interference signal analysis on the tooth vibration voltage set to obtain an effective vibration voltage set;
[0195] The smart glasses control module 104 is used to identify the tooth knocking vibration in the effective vibration voltage concentration, obtain the effective knocking number, and start the shooting module and the recording module according to the effective knocking number and the preset knocking control specification. When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program.
[0196] In detail, each module in the smart glasses control system 100 with camera function in the embodiment of the present invention is used in the same manner as above. Figure 1 The same technical means as the method for controlling the smart glasses with a camera function described in the invention can produce the same technical effects, which will not be repeated here.
[0197] like Figure 3 , is a schematic diagram of the structure of an electronic device for implementing a method for controlling smart glasses with a camera function provided by an embodiment of the present invention.
[0198] The electronic device 1 may include a processor 10, a memory 11 and a bus 12, and may also include a computer program stored in the memory 11 and executable on the processor 10, such as a program for controlling a smart glasses with a camera function.
[0199] The memory 11 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a magnetic memory, a disk, an optical disk, etc. In some embodiments, the memory 11 may be an internal storage unit of the electronic device 1, such as a mobile hard disk of the electronic device 1. In other embodiments, the memory 11 may also be an external storage device of the electronic device 1, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 1. Further, the memory 11 also includes an internal storage unit of the electronic device 1 and an external storage device. The memory 11 can not only be used to store application software and various types of data installed in the electronic device 1, such as the code of the smart glasses control method program with a camera function, but also can be used to temporarily store data that has been output or is to be output.
[0200] The processor 10 may be composed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips, etc. The processor 10 is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes or executes programs or modules (such as a smart glasses control method program with a camera function, etc.) stored in the memory 11, and calls data stored in the memory 11 to execute various functions of the electronic device 1 and process data.
[0201] The bus 12 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus 12 may be divided into an address bus, a data bus, a control bus, etc. The bus 12 is configured to realize connection and communication between the memory 11 and at least one processor 10, etc.
[0202] Figure 3 Only an electronic device with components is shown, and those skilled in the art will understand that Figure 3 The structure shown does not constitute a limitation on the electronic device 1, and may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.
[0203] For example, although not shown, the electronic device 1 may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the at least one processor 10 through a power management system, so that the power management system can realize functions such as charging management, discharging management, and power consumption management. The power source may also include any components such as one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators. The electronic device 1 may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.
[0204] Furthermore, the electronic device 1 may also include a network interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device 1 and other electronic devices.
[0205] Optionally, the electronic device 1 may further include a user interface, which may be a display, an input unit (such as a keyboard), or a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode) touch device. The display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device 1 and to display a visual user interface.
[0206] The program of the method for controlling the smart glasses with a camera function stored in the memory 11 of the electronic device 1 is a combination of multiple instructions. When running in the processor 10, the following can be achieved:
[0207] Receiving a smart glasses control instruction, and starting a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and at this time the smart glasses camera is in a standby state;
[0208] Using the skin sensing module to perform smart glasses camera wearing detection, and obtain wearing sensing instructions, wherein the wearing sensing instructions include: wearing instructions and not wearing instructions;
[0209] When the wearing sensing instruction is a non-wearing instruction, the smart glasses camera is kept in a standby state;
[0210] When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained;
[0211] An interference test environment group is set, and based on the interference test environment group, a multi-environment tooth knocking simulation is performed to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a movement test environment, and a static test environment;
[0212] According to the effective test voltage group, the interference signal analysis is performed on the tooth vibration voltage set to obtain the effective vibration voltage set;
[0213] Perform tooth knocking vibration recognition in the effective vibration voltage concentration to obtain the effective knocking number, and start control of the shooting module and the recording module according to the effective knocking number and the preset knocking control specification;
[0214] When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program to complete the control of the smart glasses with camera function.
[0215] Specifically, the specific implementation method of the processor 10 for the above instructions can refer to Figures 1 to 3 The description of the relevant steps in the corresponding embodiments will not be repeated here.
[0216] Furthermore, if the module / unit integrated in the electronic device 1 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium can include: any entity or system that can carry the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).
[0217] The present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can implement:
[0218] Receiving a smart glasses control instruction, and starting a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and at this time the smart glasses camera is in a standby state;
[0219] Using the skin sensing module to perform smart glasses camera wearing detection, and obtain wearing sensing instructions, wherein the wearing sensing instructions include: wearing instructions and not wearing instructions;
[0220] When the wearing sensing instruction is a non-wearing instruction, the smart glasses camera is kept in a standby state;
[0221] When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained;
[0222] An interference test environment group is set, and based on the interference test environment group, a multi-environment tooth knocking simulation is performed to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a movement test environment, and a static test environment;
[0223] According to the effective test voltage group, the interference signal analysis is performed on the tooth vibration voltage set to obtain the effective vibration voltage set;
[0224] Perform tooth knocking vibration recognition in the effective vibration voltage concentration to obtain the effective knocking number, and start control of the shooting module and the recording module according to the effective knocking number and the preset knocking control specification;
[0225] When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program to complete the control of the smart glasses with camera function.
[0226] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. For example, the system embodiments described above are only illustrative, and actual implementation may have other division methods.
[0227] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0228] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.
[0229] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.
[0230] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.
Claims
1. A method for controlling smart glasses with a camera function, characterized in that: The method comprises: Receiving a smart glasses control instruction, and starting a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and at this time the smart glasses camera is in a standby state; Using the skin sensing module to perform smart glasses camera wearing detection, and obtain wearing sensing instructions, wherein the wearing sensing instructions include: wearing instructions and not wearing instructions; When the wearing sensing instruction is a non-wearing instruction, the smart glasses camera is kept in a standby state; When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained; The method of collecting tooth vibration signals by using a vibration sensing module to obtain a tooth vibration signal set includes: Set the vibration detection period and vibration detection frequency; Based on the vibration detection period and the vibration detection frequency, a vibration sensing module is used to detect the vibration signal to obtain an original vibration signal, and the original vibration signal is added to a pre-constructed original vibration signal group to obtain a target vibration signal group; Record the vibration detection duration of the current vibration signal detection; Obtain the current operating state of the smart glasses camera, where the operating state includes: an idle state and a working state, where the idle state means that the current smart glasses camera is not shooting, recording or recording, and the working state means that the current smart glasses camera is shooting, recording or recording; When the running state is the working state, the target vibration signal group is updated using a preset empty set, and the step of detecting the vibration signal using the vibration sensing module based on the vibration detection period and the vibration detection frequency is stopped; When the running state is an idle state, the original vibration signal group is updated using the target vibration signal group, and the step of performing vibration signal detection using the vibration sensing module based on the vibration detection period and the vibration detection frequency is returned until the vibration detection duration is not less than the preset minimum vibration detection duration; Combining the target vibration signal groups to obtain a tooth vibration signal set; An interference test environment group is set, and based on the interference test environment group, a multi-environment tooth knocking simulation is performed to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a movement test environment, and a static test environment; According to the effective test voltage group, the interference signal analysis is performed on the tooth vibration voltage set to obtain the effective vibration voltage set; Perform tooth knocking vibration recognition in the effective vibration voltage concentration to obtain the effective knocking number, and start control of the shooting module and the recording module according to the effective knocking number and the preset knocking control specification; When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program to complete the control of the smart glasses with camera function.
2. The method for controlling smart glasses with camera function as claimed in claim 1, characterized in that: The method of using the skin sensing module to perform smart glasses camera wearing detection and obtain a wearing sensing instruction includes: Set the contact detection cycle and contact detection frequency of the skin sensing module; Based on the contact detection cycle and the contact detection frequency, a skin contact detection is performed using a skin sensing module to obtain an original contact voltage. When the original contact voltage is not less than a preset minimum contact voltage, the current contact start time is recorded, and the original contact voltage is recorded as the contact start voltage. From the moment of contact start, skin contact detection is performed using a skin sensing module to obtain a contact original voltage group, and the contact start voltage is added to the contact original voltage group to obtain a contact effective voltage group; Based on the contact effective voltage group, an effective contact analysis is performed to obtain an effective contact coefficient, and it is determined whether the effective contact coefficient is greater than a preset standard contact coefficient; If the effective contact coefficient is not greater than the standard contact coefficient, returning to the step of performing skin contact detection using a skin sensing module based on the contact detection cycle and the contact detection frequency; If the effective contact coefficient is greater than the standard contact coefficient, the contact effective voltage group is recorded as a contacted voltage group; Obtaining the end detection time of the contacted voltage group, updating the contact start time using the end detection time, and returning to the step of performing skin contact detection using the skin sensing module from the contact start time until the number of contacted voltage groups is not less than a preset minimum number of contact groups; Summarizing the contacted voltage groups to obtain a contacted voltage group set, identifying a total contact duration of the contacted voltage group set, and determining whether the total contact duration is greater than a preset minimum contact duration; If the total contact time is not greater than the shortest contact time, a wearing instruction is generated; If the total contact time is greater than the shortest contact time, a not-wearing instruction is generated.
3. The method for controlling smart glasses with camera function as claimed in claim 2, characterized in that: The effective contact analysis is performed based on the contact effective voltage group to obtain the effective contact coefficient, including: Based on the contact effective voltage group, a voltage fluctuation analysis is performed to obtain a voltage fluctuation value group, wherein the number of voltage fluctuation values in the voltage fluctuation value group is the number of contact effective voltages in the contact effective voltage group minus one, and the voltage fluctuation value group is expressed as: in, Indicates the voltage fluctuation value group, represents the i-th voltage fluctuation value in the voltage fluctuation value group, represents the i+1th contact effective voltage in the contact effective voltage group, represents the effective voltage of the ith contact, Indicates the number of effective contact voltages in the effective contact voltage group; Counting the number of contact targets in the contact effective voltage group, wherein the number of contact targets is the number of contact effective voltages in the contact effective voltage group that are not less than the minimum contact voltage; According to the voltage fluctuation value group and the number of contact targets, the effective contact coefficient is calculated, where the effective contact coefficient is expressed as: in, represents the effective contact coefficient, Indicates the number of contact targets, Represents the jth voltage fluctuation value.
4. The method for controlling smart glasses with camera function as claimed in claim 3, characterized in that: The multi-environment tooth knocking simulation is performed based on the interference test environment group to obtain an effective test voltage group, including: Setting a plurality of user test groups, wherein each user test group includes an experience user and a smart glasses camera; The following test is performed on each of the multiple user test groups: Under each interference test environment, a tooth knocking test is performed using a user test group, and a test vibration voltage group and a corresponding test acquisition time group in the tooth knocking test are recorded; In the step of performing the tooth knocking test, the operating state of the smart glasses camera is monitored to obtain a working state time group, wherein the working state time is the time when the smart glasses camera changes from an idle state to a working state; Based on the working state time group, time matching is performed in the test acquisition time group to obtain the vibration effective time group, and the test effective voltage group corresponding to the vibration effective time group is identified in the test vibration voltage group; The test effective voltage groups of multiple interference environments of each user test group are summarized to obtain a test effective voltage set, and based on a preset effective voltage number, a valid test voltage group is identified in the test effective voltage set, wherein the number of times the valid test voltage appears in the test effective voltage set is not less than the effective voltage number.
5. The method for controlling the smart glasses with camera function as claimed in claim 4, characterized in that: The tooth percussion test using the user test group comprises: Setting a start-up knocking times array, wherein the start-up knocking times array includes: a shooting start-up knocking times, a video start-up knocking times, and a sound recording start-up knocking times; Extract the start knock times in the start knock times array in sequence; Obtain the current knocking start time, and based on the knocking start time, the number of start knocking times and the preset single test duration, use the user test group to perform continuous tooth knocking, and based on the vibration detection frequency, perform vibration sensing detection in the continuous tooth knocking step to obtain a knocking test voltage group and a knocking collection time group, wherein the knocking test voltage corresponds to the knocking collection time one by one; After the user test group completes the step of continuous tooth tapping, the current tapping test duration is obtained, and the process returns to the step of obtaining the current tapping start time until the tapping test duration is not less than the preset standard test duration; The knock test voltage group and the knock collection time group are respectively summarized to obtain a test vibration voltage group and a test collection time group.
6. The method for controlling the smart glasses with camera function as claimed in claim 5, characterized in that: The method of performing time matching in the test acquisition time group based on the working state time group to obtain the vibration effective time group includes: The reaction fluctuation duration is set, the working state moments are sequentially extracted from the working state moment group, and a working time range is generated based on the reaction fluctuation duration and the working state moment, wherein the working time range is expressed as: in, Indicates the working time range, Indicates the working status time. Indicates the duration of reaction fluctuation; Based on the working time range, the effective working time group is identified in the test collection time group, and the effective working time group corresponding to each working state moment is summarized to obtain the vibration effective time group, wherein the effective working time is the test collection time within the working time range.
7. The method for controlling smart glasses with camera function as claimed in claim 6, characterized in that: The interference signal analysis of the tooth vibration voltage set to obtain the effective vibration voltage set includes: Extracting tooth vibration voltages in sequence from the tooth vibration voltage set, and determining whether the tooth vibration voltage is in the valid test voltage group; If the tooth vibration voltage is in the valid test voltage group, the tooth vibration voltage is recorded as a candidate vibration voltage, and the candidate vibration voltages are summarized to obtain a candidate vibration voltage group, wherein the candidate vibration voltages in the candidate vibration voltage group are sorted according to the time of collection; Extracting a first vibration voltage from the candidate vibration voltage group, and extracting a subsequent vibration voltage of the first vibration voltage, and identifying a first acquisition time of the first vibration voltage and a subsequent acquisition time of the subsequent vibration voltage respectively; Calculate the collection time difference between the first collection time and the second collection time, and determine whether the collection time difference is less than a preset maximum interval time difference; If the acquisition time difference is less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are added to the pre-constructed original vibration voltage set to obtain a target vibration voltage set, and the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group; If the acquisition time difference is not less than the maximum interval time difference, the first vibration voltage and the second vibration voltage are removed from the candidate vibration voltage group to obtain a defective vibration voltage group; The defective vibration voltage group and the target vibration voltage set are used to update the candidate vibration voltage group and the original vibration voltage set respectively, and the step of extracting the first vibration voltage in the candidate vibration voltage group is returned until the defective vibration voltage group is an empty set, and the target vibration voltage set at this time is recorded as a valid vibration voltage set.
8. The method for controlling the smart glasses with camera function as claimed in claim 7, characterized in that: The tooth knocking vibration identification is performed in the effective vibration voltage concentration to obtain the effective knocking number, including: Extracting a first effective voltage and a second effective voltage from the effective vibration voltage set, and obtaining a first effective time of the first effective voltage and a second effective time of the second effective voltage respectively; Calculate the effective time difference between the first effective time and the second effective time, and determine whether the effective time difference is greater than the preset minimum effective interval; If the effective time difference is not greater than the minimum effective interval, the first effective voltage is added to the pre-constructed original effective voltage group to obtain a target effective voltage group; Eliminate the first effective voltage from the effective vibration voltage set to obtain an eliminated effective voltage set, use the eliminated effective voltage set and the target effective voltage group to update the effective vibration voltage set and the original effective voltage group respectively, and return to the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set until the eliminated effective voltage set is an empty set; If the effective time difference is greater than the minimum effective interval, the first effective voltage is removed from the effective vibration voltage set to obtain a removed effective voltage set, and the effective vibration voltage set and the original effective voltage group are updated using the removed effective voltage set and the empty set, respectively, and the step of extracting the first effective voltage and the second effective voltage from the effective vibration voltage set is returned until the removed effective voltage set is an empty set; The number of effective voltages of each target effective voltage group is counted to obtain an effective voltage array, the maximum number of voltages in the effective voltage array is identified, and the maximum number of voltages is recorded as the effective number of tappings.
9. A smart glasses control system with a camera function using any one of claims 1 to 8, characterized in that: The system comprises: A power module startup module, used to receive a smart glasses control instruction, and start a pre-built power module based on the smart glasses control instruction, wherein the power module is built into a smart glasses camera, and the smart glasses camera further includes: a shooting module, a recording module, a touch button module, a skin sensing module, a display light module, a vibration sensing module and a signal receiving module, and the smart glasses camera is in a standby state at this time; The tooth vibration detection module is used to use the skin sensing module to perform wearing detection of the smart glasses camera to obtain a wearing sensing instruction, wherein the wearing sensing instruction includes: a wearing instruction and a non-wearing instruction. When the wearing sensing instruction is a non-wearing instruction, the smart glasses camera is kept in a standby state. When the wearing sensing instruction is a wearing instruction, the vibration sensing module is started, and the vibration sensing module is used to collect tooth vibration signals to obtain a tooth vibration signal set, and a tooth vibration voltage set of the tooth vibration signal set is obtained. The tooth vibration signal set is obtained by using the vibration sensing module to collect tooth vibration signals, including: Set the vibration detection period and vibration detection frequency; Based on the vibration detection period and the vibration detection frequency, a vibration sensing module is used to detect the vibration signal to obtain an original vibration signal, and the original vibration signal is added to a pre-constructed original vibration signal group to obtain a target vibration signal group; Record the vibration detection duration of the current vibration signal detection; Obtain the current operating state of the smart glasses camera, where the operating state includes: an idle state and a working state, where the idle state means that the current smart glasses camera is not shooting, recording or recording, and the working state means that the current smart glasses camera is shooting, recording or recording; When the running state is the working state, the target vibration signal group is updated using a preset empty set, and the step of detecting the vibration signal using the vibration sensing module based on the vibration detection period and the vibration detection frequency is stopped; When the running state is an idle state, the original vibration signal group is updated using the target vibration signal group, and the step of performing vibration signal detection using the vibration sensing module based on the vibration detection period and the vibration detection frequency is returned until the vibration detection duration is not less than the preset minimum vibration detection duration; Combining the target vibration signal groups to obtain a tooth vibration signal set; An effective vibration identification module is used to set an interference test environment group, and based on the interference test environment group, perform multi-environment tooth knocking simulation to obtain an effective test voltage group, wherein the interference test environment group includes: a chewing test environment, a motion test environment, and a static test environment. According to the effective test voltage group, an interference signal analysis is performed on the tooth vibration voltage set to obtain an effective vibration voltage set; The smart glasses control module is used to identify the tooth knocking vibration in the effective vibration voltage concentration, obtain the effective knocking number, and start the shooting module and the recording module according to the effective knocking number and the preset knocking control specification. When the shooting module or the recording module is started, the signal receiving module is used to connect to the preset mobile phone control program.
Citation Information
Patent Citations
Myopia prevention glasses and mobile terminal
CN113359323A
Control method of intelligent glasses, intelligent glasses, storage medium and computer program product
CN118430534A