Information acquisition method, intelligent glasses and readable storage medium

Abstract

The invention discloses an information acquisition method, intelligent glasses and a readable storage medium, and relates to the technical field of intelligent wearable equipment. The method is applied to a processing module of the intelligent glasses, the intelligent glasses are further provided with a proximity sensor and an image acquisition module, and the processing module is connected with the proximity sensor and the image acquisition module. Controlling the image acquisition module to acquire data content including the target object; and under the condition of determining that a calorie analysis triggering condition is met based on the intelligent glasses, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information. Whether the calorie analysis triggering condition is met or not can be automatically judged, then the target calorie information is automatically analyzed according to the collected data content, and the convenience of recording the intake calorie by the user is improved.

Description

Technical Field

[0001] This application relates to the technical field of smart wearable devices, and more specifically, to an information acquisition method, smart glasses, and a readable storage medium. Background Art

[0002] Currently, with the development of electronic information technology, users can record the calorie information of the food consumed daily through electronic devices. However, the current recording methods generally require users to actively operate to obtain the calorie information, resulting in poor convenience and affecting the user experience. Summary of the Invention

[0003] This application proposes an information acquisition method, smart glasses, and a readable storage medium.

[0004] In a first aspect, an embodiment of this application provides an information acquisition method, which is applied to a processing module of smart glasses. The smart glasses are further provided with a proximity sensor and an image acquisition module. The processing module is respectively connected to the proximity sensor and the image acquisition module. The method includes: when a target object is detected by the proximity sensor, controlling the image acquisition module to acquire data content including the target object; when it is determined based on the smart glasses that a calorie analysis trigger condition is met, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information.

[0005] In a second aspect, an embodiment of this application further provides a pair of smart glasses, which includes a processing module, a proximity sensor, and an image acquisition module. The processing module is respectively connected to the proximity sensor and the image acquisition module; the processing module is used to obtain target calorie information based on the method described in the first aspect.

[0006] In a third aspect, an embodiment of this application further provides a computer-readable storage medium, in which program code is stored, and the program code can be called by a processor to execute the method described in the first aspect above.

[0007] The information acquisition method, smart glasses and readable storage medium provided by the embodiments of the present application, when detecting a target object through the proximity sensor, control the image acquisition module to acquire data content including the target object; when determining that the heat analysis trigger condition is satisfied based on the smart glasses, perform heat analysis on the target object in the data content based on the food analysis model to obtain target heat information. If the heat information ingested is manually input or set by the user, the convenience is poor. In the present application, it is possible to automatically determine whether the heat analysis trigger condition is satisfied, and then automatically analyze the target heat information according to the collected data content, improving the convenience of the user to record the ingested heat and the intelligence level of the smart glasses, and also improving the user experience.

[0008] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and part of them will become obvious from the description, or will be understood by implementing the embodiments of the present application. The objectives and other advantages of the embodiments of the present application can be achieved and obtained through the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative efforts.

[0010] Figure 1 Shows a schematic diagram of the smart glasses provided by the embodiments of the present application;

[0011] Figure 2 Shows Figure 1 The connection block diagram between the various modules in the smart glasses;

[0012] Figure 3 Shows the method flow chart of the information acquisition method provided by the embodiments of the present application;

[0013] Figure 4 Shows the method flow chart of the information acquisition method provided by another embodiment of the present application;

[0014] Figure 5 Shows the structural block diagram of the computer-readable storage medium provided by the embodiments of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0015] To enable those skilled in the art to better understand the solution of this application, the following will clearly and completely describe the technical solutions in the embodiments of this application in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Usually, the components of the embodiments of this application described and illustrated herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents the selected embodiments of this application. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of this application.

[0016] It should be noted that: Similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, terms such as "first" and "second" are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0017] Currently, with the development of electronic information technology, users can record the calorie information of the food they consume daily through electronic devices. However, the current recording methods generally require users to actively operate to obtain the calorie information, resulting in poor convenience and affecting the user experience. How to improve the convenience of recording calorie information is an urgent problem to be solved.

[0018] Currently, to record the calorie information of the food consumed by users, users can directly input the calorie information through electronic devices. For example, users can input the daily calorie information or the calorie information of each meal. In addition, users can also take pictures of the food-containing images through electronic devices at each meal, so as to automatically analyze the corresponding calorie information of the meal through the electronic devices.

[0019] However, the inventors found in the research that if users actively input calorie information or users control the electronic devices to take pictures of the food-containing images, it will increase the operation burden of users and cause inconvenience to users.

[0020] Therefore, to solve or partially solve the above problems, the embodiments of this application provide an information acquisition method, smart glasses and a readable storage medium.

[0021] Please refer to Figure 1 and Figure 2 , Figure 1 which shows a schematic diagram of the smart glasses provided by the embodiments of this application. Figure 2 shows Figure 1 the connection block diagram between the various modules in the smart glasses in Figure 1In the smart glasses 100 shown, a processing module 110, a proximity sensor 120, and an image acquisition module 130 are provided. By Figure 2 It can be known that among them, the processing module 110 is respectively connected to the proximity sensor 120 and the image acquisition module 130.

[0022] In some embodiments, the smart glasses can be augmented reality glasses devices. The processing module 110 can control the operation of the proximity sensor 120, and can also control the operation of the image acquisition module 130. Specifically, the proximity sensor 120 can be used to detect whether a target object is approaching, and the image acquisition module 130 can be used to collect data content including the target object. The processing module 110 can also analyze the data content collected by the image acquisition module 130 to obtain heat information. For a detailed introduction, reference can be made to the subsequent embodiments.

[0023] Among them, the proximity sensor 120 can include a photoelectric proximity sensor that detects the approach of an object based on the reflection or occlusion of light. The photoelectric proximity sensor is composed of a light-emitting diode and a photosensitive element (such as a photodiode). The light-emitting diode emits an infrared beam. If an external object approaches, it will reflect the infrared light, and the photosensitive element measures the intensity of the reflected light to determine the approach state of the object. In some embodiments, the distance parameter of the approach state of the target object obtained by the proximity sensor 120 can be directly sent to the processing module 110.

[0024] Among them, the image acquisition module 130 can include at least one camera, so that the data content collected by the image acquisition module 130 can also be sent to the processing module 110.

[0025] Please refer to Figure 3 , Figure 3 shows a flowchart of the information acquisition method provided by the embodiment of the present application. This information acquisition method can be applied to Figure 1 the processing module in the smart glasses shown. Specifically, this method can include step S110 and step S120.

[0026] Through the foregoing introduction, it can be known that the smart glasses are also provided with a proximity sensor and an image acquisition module, and the processing module is respectively connected to the proximity sensor and the image acquisition module.

[0027] Step S110: When the proximity sensor detects a target object, control the image acquisition module to collect data content including the target object.

[0028] As can be seen from the foregoing introduction, the proximity sensor can detect the distance of the target object. For example, the proximity sensor can obtain the distance parameter of the target object, so as to characterize the spatial distance between the target object and the proximity sensor through this distance parameter. It should be noted that since the proximity sensor is provided on the smart glasses, the distance between the target object and the proximity sensor can be approximately regarded as the distance between the target object and the smart glasses.

[0029] In some embodiments, a distance threshold can be set, so as to compare the size of the distance parameter of the target object collected by the proximity sensor with this distance threshold. When the distance parameter is less than or equal to the distance threshold, it can be understood that the distance between the target object and the smart glasses is already relatively close, so in this case, it can be determined that the target object is detected by the proximity sensor.

[0030] Furthermore, when the target object is detected by the proximity sensor, the image acquisition module can be controlled to acquire the data content including the target object.

[0031] That is to say, when it is determined that the distance between the target object and the smart glasses is already relatively close, the image acquisition module is controlled to acquire the data content including the target object. Specifically, for example, when it is determined that the distance between the target object and the smart glasses is already relatively close, the image acquisition module can be awakened or started to acquire the data content including the target object. Thus, it is avoided that the image acquisition module is continuously in the working state of acquiring data content, the waste of power consumption is avoided, and the energy consumption of the smart glasses is reduced.

[0032] Among them, the data content can include image content or video content. For a detailed introduction, please refer to the subsequent embodiments.

[0033] Step S120: When it is determined based on the smart glasses that the heat analysis trigger condition is satisfied, perform heat analysis on the target object in the data content based on the food analysis model to obtain the target heat information.

[0034] Further, even when the target object is detected by the proximity sensor, it can only be determined that the target object is relatively close to the smart glasses at this time. However, the target object may be food or other non-food objects, such as a display screen, a book, etc. Therefore, in the embodiment provided in the present application, it is also possible to further determine whether the calorie analysis trigger condition is satisfied. Among them, the calorie analysis trigger condition can be determined according to whether the user wearing the smart glasses is in a diet state. Specifically, if it is determined that the user wearing the smart glasses is in a diet state, it can be determined that the calorie analysis trigger condition is satisfied; if it is determined that the user wearing the smart glasses is not in a diet state, it can be determined that the calorie analysis trigger condition is not satisfied. Thus, if it is determined that the calorie analysis trigger condition is satisfied, there is a high probability that the target object is food at this time.

[0035] Among them, the smart glasses can be used to automatically determine whether the calorie analysis trigger condition is satisfied. Exemplarily, the smart glasses can collect the vibration data to be detected, and then compare the similarity between the vibration data to be detected and the standard vibration data corresponding to the chewing action of the user's mouth wearing the smart glasses, so as to determine whether the calorie analysis trigger condition is satisfied. For a detailed introduction, please refer to the subsequent embodiments.

[0036] Therefore, when it is determined based on the smart glasses that the calorie analysis trigger condition is satisfied, the target object in the data content can be calorically analyzed based on the food analysis model to obtain the target calorie information. Among them, the food analysis model can be a neural network model, and the neural network model can be pre-trained. The food analysis module can be used to identify the calories corresponding to the food in the target object. Among them, after the food analysis model is trained, it can be stored in the smart glasses after lightweight processing such as quantization and pruning.

[0037] Exemplarily, the calorie information can be the total calories corresponding to the food in the target object included in the data content. The target calorie information obtained through the food analysis model can be regarded as the calorie information matching the user, and the user is the user wearing the smart glasses. It should be noted that the calorie information matching the user can be understood as the calorie information input by the user analyzed by the smart glasses. It should be clear that this is a calculated value analyzed by the smart glasses, rather than the determined value of the user's actual intake.

[0038] Optionally, since smart glasses aim to save power consumption, the processing module configured in the smart glasses generally has relatively low performance. Therefore, when it is determined based on the smart glasses that the heat analysis trigger condition is met, the data content collected by the image acquisition module can also be sent to an electronic device with which a communication link has been previously established, so as to perform heat analysis on the target object in the data content through the food analysis model stored in the electronic device, and then further obtain the target heat information output by the food analysis model sent by the electronic device. Exemplarily, the electronic device may include a smart phone, a smart tablet, a vehicle-mounted system, a cloud server, etc.

[0039] In the information acquisition method provided by the embodiments of the present application, when the target object is detected by the proximity sensor, the image acquisition module is controlled to acquire the data content including the target object; when it is determined based on the smart glasses that the heat analysis trigger condition is met, the target object in the data content is subjected to heat analysis based on the food analysis model to obtain the target heat information. If the calorie information ingested is manually input or set by the user, the convenience is relatively poor. However, in the present application, it can be automatically determined whether the heat analysis trigger condition is met, and then the target heat information can be automatically analyzed based on the collected data content, which improves the convenience of the user to record the ingested calories and the intelligence level of the smart glasses, and also improves the user experience.

[0040] Please refer to Figure 4 , Figure 4 which shows the flowchart of the information acquisition method provided by the embodiments of the present application. This information acquisition method can be applied to Figure 1 the processing module in the smart glasses shown in

[0041] Step S210: Obtain the distance parameter of the target object detected by the proximity sensor.

[0042] Step S211: Whether the distance parameter is less than or equal to the distance threshold.

[0043] As introduced above, detecting the target object through the proximity sensor is essentially to obtain the distance parameter between the target object and the proximity sensor, and this distance parameter can be the spatial distance between the target object and the proximity sensor.

[0044] Furthermore, the size relationship between the distance parameter and the distance threshold can be compared to determine whether the ear canal target object is detected. Specifically, when the distance parameter is less than or equal to the distance threshold, step S220 can be jumped to for execution; while when the distance parameter is greater than the distance threshold, step S290 can be jumped to for execution.

[0045] Among them, the distance threshold can be preset, and the specific value is not limited in this application.

[0046] Step S220: When the distance parameter is less than or equal to the distance threshold, it is determined that the target object is detected.

[0047] Step S230: When the target object is detected by the proximity sensor, control the image acquisition module to acquire data content including the target object.

[0048] When the distance parameter is less than or equal to the distance threshold, it can be determined that the target object is detected. Thus, when the target object is detected by the proximity sensor, the image acquisition module can be controlled to acquire data content including the target object. For the introduction of the specific data content acquisition, reference can be made to the above embodiments, which will not be elaborated here.

[0049] Step S240: Acquire vibration data to be detected based on the inertial measurement unit provided in the smart glasses.

[0050] Step S250: Determine the similarity between the vibration data to be detected and the standard vibration data, where the standard vibration data includes vibration data corresponding to the chewing action of the user's mouth when wearing the smart glasses.

[0051] In some embodiments, the smart glasses can also be provided with an inertial measurement unit (IMU), where the inertial measurement unit is connected to the processing module. The inertial measurement unit usually consists of an accelerometer and a gyroscope. The accelerometer can detect the acceleration of an object, and the gyroscope can detect the angular velocity of an object. By combining the acceleration and the gyroscope, information such as the movement and posture of the object can be obtained. It should be noted that when the inertial measurement unit is provided in the smart glasses in the embodiments of this application, the information such as the movement and posture of the above object actually refers to the movement and posture of the smart glasses.

[0052] It can be understood that if the user is in a diet state, actions such as chewing or swallowing of the mouth will drive the vibration of the smart glasses. Therefore, vibration data to be detected can be acquired based on the inertial measurement unit provided in the smart glasses, and the vibration data to be detected includes the data of the vibration of the smart glasses.

[0053] Then, determine the similarity between the vibration data to be detected and the standard vibration data, where the standard vibration data includes vibration data corresponding to the chewing action of the user's mouth when wearing the smart glasses. Among them, the standard vibration data can be vibration data acquired in advance to determine the vibration of the smart glasses when the user is eating.

[0054] Step S251: Whether the similarity is greater than or equal to the threshold similarity.

[0055] Therefore, the higher the similarity, the higher the likelihood that the current user is in a dietary state. Thus, it can be determined whether the similarity is greater than or equal to the threshold similarity. Further, when the similarity is greater than or equal to the threshold similarity, jump to execute Step S260; when the similarity is less than the threshold similarity, jump to execute Step S280.

[0056] Among them, the threshold similarity can be preset. It can be understood that the larger the set threshold similarity, the higher the accuracy of determining that the user is in a dietary state. However, there may be a situation of missed determination; while the smaller the set threshold similarity, although the situation of missed determination can be avoided as much as possible, the accuracy of determining that the user is in a dietary state may be relatively low. The specific value of the set threshold similarity can be flexibly selected according to actual needs, and the embodiments of the present application do not make specific limitations.

[0057] Step S260: When the similarity is greater than or equal to the threshold similarity, it is determined that the calorie analysis trigger condition is satisfied.

[0058] Step S270: When it is determined that the calorie analysis trigger condition is satisfied, perform calorie analysis on the target object in the data content based on the food analysis model to obtain target calorie information.

[0059] Thus, when the similarity is greater than or equal to the threshold similarity, it can be determined that the user wearing the smart glasses is in a dietary state, and further it can be determined that the calorie analysis trigger condition is satisfied. That is, there is a high probability that there are actions such as chewing or swallowing in the user's mouth. Therefore, the target object in the data content collected in the foregoing steps is very likely to be food. At this time, the target object in the data content can be subjected to calorie analysis based on the food analysis model to obtain target calorie information.

[0060] For some embodiments, the data content may include multiple image contents. Thus, Step S270 may further include Step S271 to Step S273.

[0061] Step S271: When it is determined based on the smart glasses that the calorie analysis trigger condition is satisfied, obtain the first image content corresponding to the start time when the calorie analysis trigger condition is satisfied, and the second image content corresponding to the end time when the calorie analysis trigger condition is satisfied, where the first image content includes a first target object, and the second image content includes a second target object.

[0062] Step S272: Based on the food analysis model, perform calorie analysis on the first target object and the second target object respectively, to obtain the first calorie information corresponding to the first target object and the second calorie information corresponding to the second target object.

[0063] Step S273: Take the difference between the first calorie information and the second calorie information as the target calorie information.

[0064] It can be understood that the multiple image contents included in the data content can respectively correspond to the image contents collected by the image acquisition module at different moments from the start moment when the calorie analysis trigger condition is met to the end moment when the calorie analysis trigger condition is met. It should be noted that the start moment when the calorie analysis trigger condition is met can be regarded as the start moment when the user is in the eating state, and the end moment when the calorie analysis trigger condition is met can be regarded as the end moment when the user is in the eating state. Thus, when it is determined based on the smart glasses that the calorie analysis trigger condition is met, the first image content corresponding to the start moment when the calorie analysis trigger condition is met and the second image content corresponding to the end moment when the calorie analysis trigger condition is met can be obtained. That is, the first image content corresponding to the start moment when the user is in the eating state and the second image content corresponding to the end moment when the user is in the eating state can be obtained.

[0065] Exemplarily, one of the image contents collected first among the multiple image contents in the data content can be taken as the first image content corresponding to the start moment when the calorie analysis trigger condition is met; and one of the image contents collected last among the multiple image contents in the data content can be taken as the second image content corresponding to the end moment when the calorie analysis trigger condition is met.

[0066] From the foregoing introduction, it can be seen that meeting the calorie analysis trigger condition can include the user being in the eating state. Therefore, the target object in the first image content and the target object in the second image content generally change. In some embodiments, the target object in the first image content can be taken as the first target object; and the target object in the second image content can be taken as the second target object.

[0067] Furthermore, the food analysis model can be used to perform calorie analysis on the first target object and the second target object respectively, to obtain the first calorie information corresponding to the first target object and the second calorie information corresponding to the second target object. The method for obtaining the first calorie information and the second calorie information is similar to the method for obtaining the calorie information of the target object in the foregoing embodiments, and will not be elaborated here.

[0068] It can be understood that the first target object can be regarded as the target object corresponding to the starting moment when the calorie analysis trigger condition is met; while the second target object can be regarded as the target object corresponding to the ending moment when the calorie analysis trigger condition is met. And meeting the calorie analysis trigger condition can include that the user is in a diet state. Thus, the first target object has not been eaten by the user or only a small amount has been eaten; while a part of the second target object has been eaten by the user, or all of it has been eaten by the user. Therefore, the first calorie information will be greater than or equal to the second calorie information, and thus the difference between the first calorie information and the second calorie information can be used as the target calorie information. It can be seen that in the embodiments of the present application, the data content includes multiple image contents, and thus the calorie information can be determined through multiple images to improve the accuracy of the obtained calorie information.

[0069] For some other embodiments, the data content may include video content, and thus step S270 may further include step S274 and step S275.

[0070] Step S274: When it is determined based on the smart glasses that the calorie analysis trigger condition is met, obtain the target video content corresponding to the time period between the starting moment and the ending moment when the calorie analysis trigger condition is met, where the target video content includes the target object that changes during the time period.

[0071] Step S275: Perform calorie analysis on the target object that changes in the target video content based on the food analysis model to obtain the target calorie information.

[0072] When it is determined based on the smart glasses that the calorie analysis trigger condition is met, the target video content corresponding to the time period between the starting moment and the ending moment when the calorie analysis trigger condition is met can be obtained.

[0073] Exemplarily, the video content collected by the image acquisition module in the foregoing steps may include a first time period from the starting moment when the calorie analysis trigger condition is met to the cut-off moment, where the cut-off moment may be a second time period after the ending moment when the user is in a diet state. For example, the second time period is 1 minute, 2 minutes, etc. By setting the cut-off moment, the robustness of the calorie information obtained subsequently can be improved to a certain extent. Thus, the video content can be intercepted to obtain the target video content corresponding to the time period between the starting moment and the ending moment when the calorie analysis trigger condition is met.

[0074] It can be understood that meeting the calorie analysis trigger condition includes that the user is in a diet state. Thus, when the user is in a diet state, the target object in the target video content will change. Therefore, the target video content actually includes the target object that changes during the time period.

[0075] Further, after obtaining the target video content, perform calorie analysis on the target object that changes in the target video content based on the food analysis model to obtain target calorie information. Thus, the object for which calorie analysis is performed is the target video content corresponding to the relatively complete process of the user being in a diet state, which can improve the accuracy of the obtained calorie information.

[0076] Step S280: When it is determined based on the smart glasses that the calorie analysis trigger condition is not met, clear the data content.

[0077] Further, when the similarity is less than the threshold similarity, it can be determined that the user wearing the smart glasses is not in a diet state, and thus it is determined that the calorie analysis trigger condition is not met. Therefore, the data content can be further cleared. It can be understood that when it is determined that the calorie analysis trigger condition is not met, the data content can be not subjected to calorie analysis.

[0078] In addition, the data content collected through the foregoing steps can be cached in the cache, so clearing the data content can be clearing the data content in the cache. The collected data content can also be directly stored in a storage module, such as a flash memory or a hard disk, etc., so clearing the data content can be clearing the data content in the storage module.

[0079] It can be seen that in the embodiment provided in the present application, even if a target object is detected to be close to the smart glasses and data content including the target object is collected, however, subsequently, since the calorie analysis trigger condition is not met, it is very likely that the target object at this time is non-food. Therefore, the data content can be not subjected to calorie analysis subsequently and the data content can be cleared. On the one hand, it can avoid power consumption waste caused by subsequent calorie analysis, and on the other hand, it also releases the storage space occupied by the data content.

[0080] Step S290: When the target object is not detected by the proximity sensor, control the image acquisition module to be in a low-power working mode.

[0081] Further, when the distance parameter is greater than the distance threshold, it can be determined that the target object is not detected by the proximity sensor. Thus, when the target object is not detected by the proximity sensor, control the image acquisition module to be in a low-power working mode. That is to say, in the information acquisition method provided in the embodiment of the present application, the image acquisition module is in a low-power working mode when the proximity sensor does not detect the target object; and only when the proximity sensor detects the target object, the image acquisition module is controlled to switch to the working mode, and then data content including the target object is collected. It can reduce the power consumption of the image acquisition module, and further achieve reducing the power consumption of the entire smart glasses and improving the battery life.

[0082] Among them, the low-power operating mode can be a sleep mode, a standby mode, etc. The image acquisition module operating in the low-power operating mode has a low power and can be woken up to the operating mode at any time, so as not to cause a delay effect on the data content to be acquired.

[0083] In the information acquisition method provided by the embodiment of the present application, the data content may include multiple image contents, so that the heat information can be determined through multiple images to improve the accuracy of the acquired heat information. In addition, the data content may also include video content, so that the target video content corresponding to the relatively complete process of the user in the eating state is the object for heat analysis, which can improve the accuracy of the acquired heat information. Furthermore, when the proximity sensor does not detect the target object, the image acquisition module is in the low-power operating mode; and only when the proximity sensor detects the target object, the image acquisition module is controlled to switch to the operating mode, and then the data content including the target object is acquired. It can reduce the power consumption of the image acquisition module, and thus reduce the power consumption of the entire smart glasses and improve the battery life.

[0084] Please continue to refer to Figure 1 and Figure 2 , Figure 1 The processing module 110 shown in

[0085] Optionally, the smart glasses 100 further include an inertial measurement unit 140. As can be known from Figure 2 , the inertial measurement unit is connected to the processing module 110.

[0086] As can be known from the foregoing introduction, the inertial measurement unit 140 can be used to collect vibration data to be detected.

[0087] Optionally, a memory (not shown in Figure 1 ) may also be provided in the smart glasses 100, and the memory is connected to the processing module 110.

[0088] Among them, the processing module 110 may include one or more processing cores. The processing module 110 connects various parts within the entire smart glasses 100 through various interfaces and circuits, and executes various functions of the smart glasses 100 and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory, and by calling the data stored in the memory. Optionally, the processing module 110 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLA). The processing module 110 may integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, computer programs, etc.; the GPU is responsible for rendering and drawing the display content; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processing module 110 and may be implemented separately through a communication chip. Specifically, the method described in the foregoing embodiments may be executed by one or more processing modules 110.

[0089] For some embodiments, the memory may include random access memory (RAM) and may also include read-only memory. The memory can be used to store instructions, programs, code, code sets, or instruction sets. The memory may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for implementing at least one function, instructions for implementing the following various method embodiments, etc. The data storage area may also store data created during the use of the smart glasses 100.

[0090] Exemplarily, the smart glasses 100 may include a front frame and temple arms connected to the frame. In some embodiments, a proximity sensor 120 may be disposed near the middle position of the front frame, an image acquisition module 130 and an inertial measurement unit 140 may be disposed near the corner position of the front frame, and the processing module 110 may be disposed in the temple arms.

[0091] It can be understood that in order to implement the above-mentioned various method functions of the smart glasses 100, electronic devices such as a circuit board and a battery are also provided in the smart glasses 100, which are not shown here one by one.

[0092] Please refer toFigure 5 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. Program code is stored in the computer-readable medium 500, and the program code can be called by a processor to execute the method described in the above method embodiment.

[0093] The computer-readable storage medium 500 can be an electronic memory such as a flash memory, EEPROM (electrically erasable programmable read-only memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 500 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 500 has a storage space for the program code 510 that executes any method step in the above method. These program codes can be read from or written into one or more computer program products. The program code 510 can be compressed in an appropriate form, for example.

[0094] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims

1. An information acquisition method, characterized in that, A processing module applied to smart glasses, the smart glasses are further provided with a proximity sensor and an image acquisition module, the processing module is respectively connected to the proximity sensor and the image acquisition module, and the method includes: When a target object is detected by the proximity sensor, controlling the image acquisition module to acquire data content including the target object; When it is determined based on the smart glasses that a calorie analysis trigger condition is satisfied, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information.

2. The method according to claim 1, characterized in that, The step of, when a target object is detected by the proximity sensor, controlling the image acquisition module to acquire data content including the target object, includes: Obtaining a distance parameter of the target object detected by the proximity sensor; When the distance parameter is less than or equal to a distance threshold, determining that the target object is detected; When a target object is detected by the proximity sensor, controlling the image acquisition module to acquire data content including the target object.

3. The method according to claim 1, wherein The step of, when it is determined based on the smart glasses that a calorie analysis trigger condition is satisfied, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information, includes: Collecting vibration data to be detected based on an inertial measurement unit provided in the smart glasses; Determining the similarity between the vibration data to be detected and standard vibration data, wherein the standard vibration data includes vibration data corresponding to a chewing action of the mouth of a user wearing the smart glasses; When the similarity is greater than or equal to a threshold similarity, determining that the calorie analysis trigger condition is satisfied; When it is determined that the calorie analysis trigger condition is satisfied, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information.

4. The method according to claim 1, characterized in that, The data content includes multiple image contents, and the step of, when it is determined based on the smart glasses that a calorie analysis trigger condition is satisfied, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information, includes: When it is determined based on the smart glasses that a calorie analysis trigger condition is satisfied, obtaining a first image content corresponding to a start time when the calorie analysis trigger condition is satisfied, and a second image content corresponding to an end time when the calorie analysis trigger condition is satisfied, wherein the first image content includes a first target object, and the second image content includes a second target object; Performing calorie analysis on the first target object and the second target object respectively based on a food analysis model to obtain first calorie information corresponding to the first target object and second calorie information corresponding to the second target object; Taking the difference between the first calorie information and the second calorie information as the target calorie information.

5. The method according to claim 1, wherein The data content includes video content, and the step of, when it is determined based on the smart glasses that a calorie analysis trigger condition is satisfied, performing calorie analysis on the target object in the data content based on a food analysis model to obtain target calorie information, includes: When it is determined based on the smart glasses that the calorie analysis trigger condition is met, obtain the target video content corresponding to the time period from the start time to the end time that meets the calorie analysis trigger condition, where the target video content includes a target object that changes during the time period; Perform calorie analysis on the target object that changes in the target video content based on the food analysis model to obtain target calorie information.

6. The method according to claim 1, characterized in that, The method further includes: When it is determined based on the smart glasses that the calorie analysis trigger condition is not met, clear the data content.

7. The method according to claim 1, characterized in that The method further includes: When no target object is detected by the proximity sensor, control the image acquisition module to be in the low-power working mode.

8. An intelligent glasses, characterized in that, The smart glasses include a processing module, a proximity sensor, and an image acquisition module, and the processing module is respectively connected to the proximity sensor and the image acquisition module; The processing module is used to obtain target calorie information based on the method according to any one of claims 1 to 7.

9. The smart glasses according to claim 8, characterized in that, The smart glasses further include an inertial measurement unit, and the inertial measurement unit is connected to the processing module; The inertial measurement unit is used to collect vibration data to be detected.

10. A computer-readable storage medium, characterized in that, Program code is stored in the computer-readable storage medium, and the program code can be called by a processor to execute the method according to any one of claims 1-7.

Images