Shooting method and device, electronic equipment, storage medium and program product

Abstract

The invention provides a shooting method and device, electronic equipment, a storage medium and a program product, and the method comprises the steps: controlling a camera to shoot a surrounding environment in a navigation mode, and storing a plurality of shot images in a temporary storage area; the images comprise images and / or videos; for any image in the temporary storage area, screening target associated data corresponding to the image from the associated data, and judging whether the image is a target image or not according to the target associated data; wherein the target image is used for indicating an image needing to be stored in the permanent storage area, and the associated data is used for indicating physiological data and motion data of the user; when the image is the target image, the image is moved to the permanent storage area, so that the surrounding environment is automatically shot and stored in the temporary storage area, a user can capture a potential important image without active operation, the importance of the image is judged by using the associated data, and the accuracy of target influence judgment can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of smart glasses, and in particular to a photographing method, device, electronic device, storage medium and program product. Background Art

[0002] The camera function of smart glasses is one of its core features, providing users with a convenient and fast way to capture moments in life. Users usually use touch or voice to control smart glasses to take pictures. However, when the smart glasses are in cycling navigation mode, users ride with both hands and basically do not use touch to control the glasses to take pictures. When the road environment is noisy, issuing camera commands through voice is also easily affected by noise. In addition, because users focus on road traffic information and navigation prompts, they may forget or be too late to issue camera commands, thereby missing the capture of images or videos of some important moments. Summary of the invention

[0003] The present application provides a shooting method, device, electronic device, storage medium and program product to reduce the probability of users missing images of important moments.

[0004] In a first aspect, an embodiment of the present application provides a shooting method, which is applied to smart glasses, wherein the smart glasses include a camera, including:

[0005] When in navigation mode, the camera is controlled to shoot the surrounding environment, and multiple images obtained by shooting are stored in a temporary storage area; the images include images and / or videos;

[0006] For any image in the temporary storage area, target associated data corresponding to the image is screened out from a plurality of associated data, and whether the image is a target image is determined based on the target associated data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the associated data is used to indicate the physiological data and motion data of the user;

[0007] When the image is a target image, the image is moved to a permanent storage area.

[0008] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data includes:

[0009] When the space utilization rate of the temporary storage area exceeds a first preset threshold, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data;

[0010] The method further comprises:

[0011] When the image is not the target image, the image is deleted from the temporary storage area.

[0012] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, includes:

[0013] For any image in the temporary storage area that is taken before the target time, determine the associated data within a second preset time length before and after the image is taken as the target associated data; wherein the difference between the target time and the current time is the first preset time length; wherein the second preset time length is less than or equal to the first preset time length;

[0014] When the physiological data in the target-related data is abnormal, and / or the motion data undergoes a preset change, the image is determined to be a target image.

[0015] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, includes:

[0016] For any image in the temporary storage area that is taken before the target moment, when no photo-taking instruction issued by the user is received within a third preset time length before or after the image is taken, determining the associated data within a second preset time length before or after the image is taken as the target associated data; wherein the difference between the target moment and the current moment is the first preset time length;

[0017] Inputting the physiological data and acceleration data in the target-related data into a judgment model to determine whether the image is a target image;

[0018] The method further comprises:

[0019] When a photo-taking instruction issued by a user is received within a third preset time period before or after the image is taken, the image is determined to be a target image.

[0020] Optionally, the method further includes:

[0021] When a user deletes any target image in the permanent storage area, acquiring target association data corresponding to the target image;

[0022] The judgment model is retrained according to the target association data respectively corresponding to the plurality of target images.

[0023] Optionally, controlling the camera to shoot the surrounding environment includes:

[0024] When the current location meets a high-risk condition or a vehicle approaches the user, the camera is controlled to shoot the surrounding environment with a first shooting quality, otherwise the surrounding environment is shot with a second shooting quality, the first shooting quality is higher than the second shooting quality, and the shooting quality is used to indicate the resolution, color depth, contrast, saturation, shooting frequency and / or video frame rate used in shooting;

[0025] The method further comprises:

[0026] When the power level is lower than a second preset threshold, the function modules except the necessary function modules are turned off; wherein the necessary function modules are used to indicate the function modules used for navigation, taking pictures and determining the target image.

[0027] In a second aspect, an embodiment of the present application provides a photographing device, which is applied to smart glasses, wherein the smart glasses include a camera, and the device includes:

[0028] A control module, used for controlling the camera to shoot the surrounding environment and storing a plurality of images obtained by shooting in a temporary storage area when in a navigation mode; the images include images and / or videos;

[0029] a screening module, for screening target-related data corresponding to any image in the temporary storage area from a plurality of related data, and judging whether the image is a target image according to the target-related data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the related data is used to indicate physiological data and motion data of the user;

[0030] The moving module is used to move the image to a permanent storage area when the image is a target image.

[0031] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0032] The memory stores computer-executable instructions;

[0033] The processor executes the computer-executable instructions stored in the memory to implement the method described in the first aspect above.

[0034] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method described in the first aspect above.

[0035] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which implements the method described in the first aspect when executed by a processor.

[0036] The present application provides a shooting method, device, electronic device, storage medium and program product, the method comprising: when in navigation mode, controlling the camera to shoot the surrounding environment, and storing multiple images obtained by shooting in a temporary storage area; the image includes an image and / or a video; for any image in the temporary storage area, filtering out target-related data corresponding to the image from multiple related data, and judging whether the image is a target image according to the target related data; wherein the target image is used to indicate an image that needs to be stored in a permanent storage area, and the related data is used to indicate the physiological data and motion data of the user; when the image is a target image, moving the image to the permanent storage area, so that by automatically shooting the surrounding environment and storing it in the temporary storage area, the user can capture potentially important images without active operation, and using the related data (such as the physiological data and motion data of the user) to judge the importance of the image, the accuracy of the target impact judgment can be improved, and all the shot images are initially stored in the temporary storage area, and only the target image is moved to the permanent storage area, which can reduce the probability of the user missing the image of the important moment and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0038] Figure 1 An application scenario diagram provided for an embodiment of the present application;

[0039] Figure 2 A schematic diagram of a process of a photographing method provided in an embodiment of the present application;

[0040] Figure 3 A schematic diagram of a flow chart of another photographing method provided in an embodiment of the present application;

[0041] Figure 4 A schematic diagram of the structure of a photographing device provided in an embodiment of the present application;

[0042] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0043] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0044] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0045] The camera function of smart glasses is one of its core features, providing users with a convenient and quick way to capture moments in life. Traditional control methods usually include touch and voice commands, which can meet users' needs in most cases. However, these control methods may face some challenges when smart glasses are in cycling navigation mode.

[0046] During riding, the user's hands are usually used to control the direction and speed of the bicycle, so there is rarely an opportunity to use touch to control the camera function of smart glasses. In addition, the road environment during riding is often accompanied by loud noises, such as wind and vehicle noises, which makes it unreliable to issue camera commands through voice, because noise may interfere with the accuracy of voice recognition. This is a significant shortcoming for users who want to record the beautiful moments during riding.

[0047] More importantly, when riding, users' attention is mainly focused on road traffic information and navigation prompts, and ensuring safe driving is the top priority. In this case, users may forget or be too late to issue a photo command, thus missing out on capturing images or videos of some important moments.

[0048] In view of this, the present application provides a shooting method, which controls the camera to shoot the surrounding environment when in navigation mode, and stores multiple images obtained by shooting in a temporary storage area; the image includes an image and / or a video; for each image in the temporary storage area, the target associated data corresponding to the image is screened out from multiple associated data, and according to the target associated data, it is determined whether the image is a target image; wherein the target image is used to indicate the image that needs to be stored in the permanent storage area, and the associated data is used to indicate the user's physiological data and motion data; when the image is a target image, the image is moved to the permanent storage area, so that by automatically shooting the surrounding environment and storing it in the temporary storage area, the user can capture potentially important images without active operation, and use the associated data (such as the user's physiological data and motion data) to judge the importance of the image, which can improve the accuracy of the target impact judgment, and all the shot images are initially stored in the temporary storage area, and only the target image is moved to the permanent storage area, which can reduce the probability of the user missing the important moment image and improve the user experience.

[0049] Figure 1 An application scenario diagram provided for an embodiment of the present application, such as Figure 1 As shown, when the smart glasses are in navigation mode, they control the camera to shoot the surrounding environment and store multiple images obtained by shooting in a temporary storage area; for each image in the temporary storage area, the target associated data corresponding to the image is screened out from multiple associated data, and according to the target associated data, it is determined whether the image is a target image; wherein the target image is used to indicate the image that needs to be stored in the permanent storage area, and the associated data is used to indicate the user's physiological data and motion data; when the image is a target image, the image is moved to the permanent storage area, and when the image is not a target image, the image is deleted from the temporary storage area.

[0050] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0051] Figure 2 This is a flow chart of a shooting method provided in an embodiment of the present application. The execution subject of this embodiment can be any device with data processing function. This application uses smart glasses as the execution subject for specific description. Figure 2 As shown, a shooting method provided in an embodiment of the present application may include:

[0052] Step 201: When in navigation mode, control the camera to shoot the surrounding environment, and store multiple images obtained by shooting in a temporary storage area; the images include images and / or videos.

[0053] The images may include only images, only videos, or both images and videos.

[0054] Specifically, the smart glasses first determine whether the current functional mode is in navigation mode, such as cycling navigation, walking navigation, etc. If the current functional mode is navigation mode, a power-on command is sent to the camera located on the smart glasses. After receiving the power-on command, the camera is turned on. After the power-on is completed, the surrounding environment is photographed and the multiple images taken are stored in a temporary storage device.

[0055] Optionally, controlling the camera to shoot the surrounding environment includes:

[0056] When the current location meets the high-risk condition or a vehicle approaches the user, the camera is controlled to shoot the surrounding environment with a first shooting quality, otherwise the surrounding environment is shot with a second shooting quality, the first shooting quality is higher than the second shooting quality, and the shooting quality is used to indicate the resolution, color depth, contrast, saturation, shooting frequency, and video frame rate used in shooting;

[0057] The shooting method provided in the embodiment of the present application further includes:

[0058] When the power level is lower than a second preset threshold, the function modules except the necessary function modules are turned off; wherein the necessary function modules are used to indicate the function modules used for navigation, taking pictures and determining the target image.

[0059] Among them, high-risk conditions may include high-risk traffic conditions and high-risk geological conditions.

[0060] Among them, high-risk traffic conditions may include:

[0061] High accident rate road sections: road sections where many traffic accidents have occurred in history.

[0062] Sharp turns or steep slopes: Road features that can easily cause a vehicle to lose control.

[0063] Intersections: especially those where vision is obstructed or traffic signals are not obvious.

[0064] Pedestrian-dense areas: such as areas near schools and markets, and areas with frequent pedestrian activities.

[0065] Impact of adverse weather conditions: such as heavy fog, heavy rain, and roads covered with ice and snow.

[0066] Geologically hazardous conditions can include:

[0067] Landslide or mud-rock flow prone areas: areas with unstable geological structure and prone to landslide or mud-rock flow.

[0068] Earthquake fault zone: An area near an active earthquake fault.

[0069] Flood-prone areas: Low-lying, poorly drained areas.

[0070] For example, when judging whether the current location is located in a section of road with a high accident rate, an area prone to landslides or mudslides, an earthquake fault zone, or an area prone to floods, it can be judged by whether the section of road is marked as a section of road with a high accident rate, an area prone to landslides or mudslides, an earthquake fault zone, or an area prone to floods on the map.

[0071] When judging whether the current position is on a steep slope, the slope of the road section where the current position is located can be calculated. When the calculated slope is greater than the preset slope, the current position is considered to be on a steep slope. When judging whether the current position is in a sharp turn area, the curvature radius corresponding to the road section where the current position is located can be calculated. When the calculated curvature radius is greater than the preset radius, the current position is considered to be in a sharp turn area.

[0072] The remaining steps of determining whether the current location is an intersection, a pedestrian-dense area, or severe weather conditions can all be determined using existing technologies, which will not be described in detail here.

[0073] The present application does not limit the method for determining whether there is a vehicle approaching the user at the current location.

[0074] In one feasible manner, it can be determined by changes in volume. As a vehicle approaches, the intensity of the sound received by the microphone will increase. By monitoring the changes in volume, it can be determined whether the vehicle is approaching.

[0075] In another possible implementation, the Doppler effect can be used to determine the direction of the vehicle's movement. The Doppler effect indicates that when a vehicle moves, the frequency of sound changes. When approaching, the frequency increases; when moving away, the frequency decreases. By analyzing the change in sound frequency, the direction of the vehicle's movement can be determined.

[0076] In yet another achievable manner, it can be determined based on spectrum analysis that the sound produced by the vehicle has specific spectrum characteristics, and by analyzing the spectrum of the sound, the sound of the vehicle can be identified and its distance change can be determined.

[0077] In another possible implementation, a machine learning model can be trained to recognize the sound pattern of an approaching vehicle. By training the model with a large amount of data, the accuracy of the judgment can be improved.

[0078] When the current position of the smart glasses meets the high-risk condition or there is a vehicle approaching the user, the smart glasses control the camera to use the first shooting quality to shoot the surrounding environment. When the current position does not meet the high-risk condition and there is no vehicle approaching the user, the smart glasses use the second shooting quality to shoot the surrounding environment, wherein the first shooting quality is higher than the second shooting quality. The shooting quality can be used to indicate the resolution, color depth, contrast, saturation, shooting frequency, video frame rate, etc. used during shooting.

[0079] And when the power level is lower than a second preset threshold, the smart glasses will shut down functional modules except necessary functional modules; wherein, the necessary functional modules are used to indicate functional modules used for navigation, taking pictures and determining target images to ensure the normal operation of the necessary functional modules.

[0080] In this way, by improving the shooting quality (first shooting quality) in high-risk conditions or when vehicles are approaching, it is ensured that high-resolution and high-detail images are captured at critical moments. Using a lower shooting quality (second shooting quality) under normal circumstances can reduce data storage requirements and processing burdens, thereby saving device resources and reducing device power consumption. When the power is lower than the second preset threshold, turning off non-essential functional modules helps to extend the working time of the device and ensure that the device can still perform key functions such as navigation and taking pictures in low-power conditions. Dynamically adjusting the shooting quality and the use of functional modules can achieve a balance between performance and battery life.

[0081] Step 202: for any image in the temporary storage area, filter out target associated data corresponding to the image from multiple associated data, and determine whether the image is a target image based on the target associated data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the associated data is used to indicate the user's physiological data and motion data.

[0082] The associated data is used to indicate the physiological data and motion data of the user. For example, the physiological data of the user may be heart rate, blood pressure, body temperature, respiratory rate, blood oxygen saturation, etc. The motion data of the user may be speed data or acceleration data.

[0083] The associated data may be obtained through a wearable device such as a smart watch, or may be obtained through a sensor built into the smart watch.

[0084] Since all the images taken have shooting time information, and the user's physiological data and motion data also have time information, for any image in the temporary storage area, the smart glasses can filter out the target associated data corresponding to the image from multiple associated data, and determine whether the image is a target image based on the target associated data. The target image is used to indicate the image that needs to be stored in the permanent storage area.

[0085] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data includes:

[0086] When the space utilization rate of the temporary storage area exceeds a first preset threshold, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data;

[0087] The shooting method provided in the embodiment of the present application further includes:

[0088] When the image is not the target image, the image is deleted from the temporary storage area.

[0089] Specifically, when the space utilization rate of the temporary storage area exceeds a first preset threshold, the smart glasses filter out target-related data corresponding to any image in the temporary storage area from multiple related data; and determine whether the image is a target image based on the target-related data, and delete the image from the temporary storage area if the image is not a target image.

[0090] When the space utilization rate of the temporary storage area is less than a first preset threshold, the smart glasses stop filtering out target associated data corresponding to any image in the temporary storage area from the plurality of associated data.

[0091] In this way, when the space utilization of the temporary storage area exceeds the first preset threshold, the target-related data corresponding to the image will be screened out, and it will be determined whether the image is the target image based on the target-related data. If the image is not the target image, it will be automatically deleted from the temporary storage area. This automated cleaning mechanism reduces the need for manual intervention, ensures that the storage area is always kept in the best condition, and helps to prioritize important data when storage space is tight, prevent the storage area from being overfilled, and ensure the normal operation of the system.

[0092] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, includes:

[0093] For any image in the temporary storage area that is taken before the target time, determine the associated data within a second preset time length before and after the image is taken as the target associated data; wherein the difference between the target time and the current time is the first preset time length; wherein the second preset time length is less than or equal to the first preset time length;

[0094] When the physiological data in the target-related data is abnormal, and / or the motion data undergoes a preset change, the image is determined to be a target image.

[0095] Usually, the measurement frequency of the user's physiological data and motion data is lower than the shooting frequency. Therefore, when matching associated data of an image, the associated data within a second preset time period before and after the image is shot can be set as target associated data.

[0096] Specifically, for any image in the temporary storage area taken before the target moment, the smart glasses determine that the associated data within a second preset time length before and after the image is taken is the target associated data; wherein the difference between the target moment and the current moment is the first preset time length; and the second preset time length is less than or equal to the first preset time length.

[0097] Preferably, the first preset duration may be 30s.

[0098] When the physiological data in the target-related data is abnormal, and / or the motion data undergoes a preset change, the smart glasses determine that the image is a target image.

[0099] For example, the abnormal physiological data may be a sudden change in heart rate data accompanied by a change in blood pressure, indicating that the user may encounter a special situation (such as a traffic accident). At this time, the smart glasses will determine that the image is a target image.

[0100] The preset change in motion data may be a change in the acceleration sensor that the user may determine as a fall or impact, and may be determined using existing technology methods. At this time, the smart glasses will determine that the image is the target image.

[0101] In this way, by screening the associated data within a period of time (the second preset time length) before and after the image is taken, it is ensured that the selected data has a temporal correlation with the image. This method improves the accuracy of data screening, so that the judgment of the image is based on more relevant information, and by detecting abnormalities in physiological data and / or preset changes in motion data, it can automatically identify possible important images, thereby improving the accuracy and efficiency of target image judgment.

[0102] Optionally, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, includes:

[0103] For any image in the temporary storage area that is taken before the target moment, when no photo-taking instruction issued by the user is received within a third preset time length before or after the image is taken, determining the associated data within a second preset time length before or after the image is taken as the target associated data; wherein the difference between the target moment and the current moment is the first preset time length;

[0104] Inputting the physiological data and acceleration data in the target-related data into a judgment model to determine whether the image is a target image;

[0105] The method further comprises:

[0106] When a photo-taking instruction issued by a user is received within a third preset time period before or after the image is taken, the image is determined to be a target image.

[0107] Among them, the third preset time length can be set according to user needs or habits, and can be 1s or 2s for example. The user issues a photo command before shooting an important moment, or may not have time to issue a photo command when shooting an important moment. There will also be a delay between the smart glasses receiving the photo command and the actual shooting action. Therefore, when the user's photo command is received within the third preset time length before or after the image is shot, the image can be determined as the target image.

[0108] Specifically, for any image in the temporary storage area taken before the target moment, if no photo-taking command issued by the user is received within the third preset time before and after the image is taken, the smart glasses determine that the associated data within the second preset time before and after the image is taken is the target associated data; wherein the difference between the target moment and the current moment is the first preset time; the smart glasses input the physiological data and acceleration data in the target associated data into the judgment model to determine whether the image is the target image.

[0109] If a photo taking instruction from the user is received within a third preset time period before or after the image is taken, the smart glasses determine that the image is a target image.

[0110] In this way, when a user's photo-taking instruction is received within a period of time before or after the image is taken (the third preset duration), the image is directly determined as the target image. This mechanism can identify the user's clear intention, ensure that the images actively taken by the user are processed and stored first, and improve the judgment efficiency of the target image. In the case where the user's photo-taking instruction is not received, the importance of the image is judged by analyzing the associated data before and after the image (the second preset duration), and the sensor data is used to supplement the lack of user intention, thereby improving the intelligent level of image screening. In addition, the physiological data and acceleration data are input into the judgment model for analysis, and the system can more comprehensively evaluate the importance of the image. This multi-dimensional data analysis improves the accuracy of judgment.

[0111] Step 203: When the image is a target image, move the image to a permanent storage area.

[0112] The image in the permanent storage area can be synchronized to the cloud for storage, and when the image is the target image, the image is moved to the permanent storage area.

[0113] Optionally, the method further includes:

[0114] When a user deletes any target image in the permanent storage area, acquiring target association data corresponding to the target image;

[0115] The judgment model is retrained according to the target association data respectively corresponding to the plurality of target images.

[0116] Specifically, whenever new image data is added to the permanent storage area, the user can be reminded to check. When the user deletes any target image in the permanent storage area, it means that the target image may not be needed, and the target association data corresponding to the target image is obtained; and the judgment model is re-trained based on the target association data corresponding to multiple target images.

[0117] For example, a user likes to brake suddenly, so sudden braking is a routine operation, but the judgment model may determine that the image of sudden braking is the target image. When the target views the target image in the permanent storage area, it may find the image containing sudden braking and delete it. We can use the motion data corresponding to the deleted image as a training set to train the judgment model again, thereby reducing the probability of misjudgment of the judgment model.

[0118] In this way, when a user deletes a target image in the permanent storage area, the associated data of the image is obtained and used to train the judgment model again. This feedback mechanism enables the model to self-optimize and gradually improve its judgment accuracy and adaptability. The user's behavior of deleting images provides important feedback information, indicating that some images may not meet the user's expectations or needs. By leveraging this feedback, the system can better adjust and optimize the model to be closer to the user's actual needs.

[0119] The present application provides a shooting method, which can control the camera to shoot the surrounding environment when in navigation mode, and store multiple images obtained by shooting in a temporary storage area; the image includes an image and / or a video; for any image in the temporary storage area, the target associated data corresponding to the image is screened out from multiple associated data, and according to the target associated data, it is determined whether the image is a target image; wherein the target image is used to indicate an image that needs to be stored in a permanent storage area, and the associated data is used to indicate the physiological data and motion data of the user; when the image is a target image, the image is moved to the permanent storage area, so that by automatically shooting the surrounding environment and storing it in the temporary storage area, the user can capture potentially important images without active operation, and use the associated data (such as the physiological data and motion data of the user) to judge the importance of the image, which can improve the accuracy of the target impact judgment, and all the shot images are initially stored in the temporary storage area, and only the target image is moved to the permanent storage area, which can reduce the probability of the user missing the image of the important moment and improve the user experience.

[0120] Figure 3 A flowchart of another shooting method provided in an embodiment of the present application is shown as follows: Figure 3As shown, when in navigation mode, it is determined whether the current position meets the high-risk condition or there is a vehicle approaching the user. When the current position meets the high-risk condition or there is a vehicle approaching the user, the camera is controlled to shoot the surrounding environment with a first shooting quality, and the multiple images obtained by shooting are stored in a temporary storage area; the image includes an image and / or a video; otherwise, the surrounding environment is shot with a second shooting quality, the first shooting quality is higher than the second shooting quality, and the shooting quality is used to indicate the resolution, color depth, contrast, saturation, shooting frequency, and video frame rate used when shooting; it is determined whether the current power is lower than the second preset threshold, and when the power is lower than the second preset threshold, the function modules except the necessary function modules are turned off; wherein the necessary function modules are used to indicate the function modules used for navigation, shooting, and determining the target image. For any image shot before the target time in the temporary storage area, when a shooting instruction issued by the user is received within the third preset time before and after the shooting of the image, the image is determined to be the target image. When no photo-taking instruction issued by the user is received within a third preset time period before or after the image is taken, the associated data within a second preset time period before or after the image is taken is determined to be target associated data; wherein the difference between the target moment and the current moment is the first preset time period; the physiological data and acceleration data in the target associated data are input into a judgment model to determine whether the image is a target image; when the user deletes any target image located in a permanent storage area, the target associated data corresponding to the target image is obtained; and the judgment model is retrained according to the target associated data corresponding to a plurality of target images.

[0121] Corresponding to the above-mentioned shooting method, the embodiment of the present application further provides a shooting device, Figure 4 This is a schematic diagram of the structure of a photographing device provided in an embodiment of the present application. Figure 4 As shown, the device comprises:

[0122] The control module 401 is used to control the camera to shoot the surrounding environment and store multiple images obtained by shooting in a temporary storage area when in the navigation mode; the images include images and / or videos;

[0123] The screening module 402 is used to screen out target-related data corresponding to any image in the temporary storage area from a plurality of related data, and determine whether the image is a target image according to the target-related data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the related data is used to indicate the physiological data and motion data of the user;

[0124] The moving module 403 is used to move the image to a permanent storage area when the image is a target image.

[0125] Optionally, when the screening module 402 screens out the target associated data corresponding to any image in the temporary storage area from the plurality of associated data, the screening module 402 is specifically configured to:

[0126] When the space utilization rate of the temporary storage area exceeds a first preset threshold, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data;

[0127] The method further comprises:

[0128] When the image is not the target image, the image is deleted from the temporary storage area.

[0129] Optionally, when the screening module 402 screens out target associated data corresponding to any image in the temporary storage area from a plurality of associated data and determines whether the image is a target image according to the target associated data, it is specifically used to:

[0130] For any image in the temporary storage area that is taken before the target time, determine the associated data within a second preset time length before and after the image is taken as the target associated data; wherein the difference between the target time and the current time is the first preset time length; wherein the second preset time length is less than or equal to the first preset time length;

[0131] When the physiological data in the target-related data is abnormal, and / or the motion data undergoes a preset change, the image is determined to be a target image.

[0132] Optionally, when the screening module 402 screens out target associated data corresponding to any image in the temporary storage area from a plurality of associated data and determines whether the image is a target image according to the target associated data, it is specifically used to:

[0133] For any image in the temporary storage area that is taken before the target moment, when no photo-taking instruction issued by the user is received within a third preset time length before or after the image is taken, determining the associated data within a second preset time length before or after the image is taken as the target associated data; wherein the difference between the target moment and the current moment is the first preset time length;

[0134] Inputting the physiological data and acceleration data in the target-related data into a judgment model to determine whether the image is a target image;

[0135] The method further comprises:

[0136] When a photo-taking instruction issued by a user is received within a third preset time period before or after the image is taken, the image is determined to be a target image.

[0137] Optionally, the screening module 402 is further configured to:

[0138] When a user deletes any target image in the permanent storage area, acquiring target association data corresponding to the target image;

[0139] The judgment model is retrained according to the target association data respectively corresponding to the plurality of target images.

[0140] Optionally, when controlling the camera to shoot the surrounding environment, the control module 401 is specifically used to:

[0141] When the current location meets the high-risk condition or a vehicle approaches the user, the camera is controlled to shoot the surrounding environment with a first shooting quality, otherwise the surrounding environment is shot with a second shooting quality, the first shooting quality is higher than the second shooting quality, and the shooting quality is used to indicate the resolution, color depth, contrast, saturation, shooting frequency, and video frame rate used in shooting;

[0142] The control module 401 is also used for:

[0143] When the power level is lower than a second preset threshold, the function modules except the necessary function modules are turned off; wherein the necessary function modules are used to indicate the function modules used for navigation, taking pictures and determining the target image.

[0144] The specific implementation principles and effects of the shooting device provided in the embodiments of the present application can be found in the aforementioned embodiments and will not be repeated here.

[0145] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown, the electronic device of this embodiment may include:

[0146] at least one processor 501; and

[0147] A memory 502 communicatively connected to the at least one processor;

[0148] The memory 502 stores instructions that can be executed by the at least one processor 501, and the instructions are executed by the at least one processor 501 to enable the electronic device to execute the method described in any of the above embodiments.

[0149] Optionally, the memory 502 may be independent or integrated with the processor 501 .

[0150] The implementation principle and technical effects of the electronic device provided in this embodiment can be found in the aforementioned embodiments and will not be described in detail here.

[0151] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the method described in any of the above embodiments is implemented.

[0152] An embodiment of the present application further provides a computer program product, including a computer program, which implements the method described in any of the above embodiments when executed by a processor.

[0153] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0154] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method described in each embodiment of the present application.

[0155] It should be understood that the above-mentioned processor can be a processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the application can be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor. The memory may include a high-speed random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage, and can also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk, etc.

[0156] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0157] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic device or a main control device.

[0158] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0159] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0160] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0161] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A shooting method, characterized in that: Applied to smart glasses, the smart glasses comprising a camera, including: When in navigation mode, the camera is controlled to shoot the surrounding environment, and multiple images obtained by shooting are stored in a temporary storage area; the images include images and / or videos; For any image in the temporary storage area, target associated data corresponding to the image is screened out from a plurality of associated data, and whether the image is a target image is determined based on the target associated data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the associated data is used to indicate the physiological data and motion data of the user; When the image is a target image, the image is moved to a permanent storage area.

2. The method according to claim 1, characterized in that For any image in the temporary storage area, the target associated data corresponding to the image is screened out from a plurality of associated data, including: When the space utilization rate of the temporary storage area exceeds a first preset threshold, for any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data; The method further comprises: When the image is not the target image, the image is deleted from the temporary storage area.

3. The method according to claim 1, characterized in that For any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, including: For any image in the temporary storage area that is taken before the target time, determine the associated data within a second preset time length before and after the image is taken as the target associated data; wherein the difference between the target time and the current time is the first preset time length; wherein the second preset time length is less than or equal to the first preset time length; When the physiological data in the target-related data is abnormal, and / or the motion data undergoes a preset change, the image is determined to be a target image.

4. The method according to claim 1, characterized in that For any image in the temporary storage area, selecting target associated data corresponding to the image from a plurality of associated data, and judging whether the image is a target image according to the target associated data, including: For any image in the temporary storage area that is taken before the target moment, when no photo-taking instruction issued by the user is received within a third preset time length before or after the image is taken, determining the associated data within a second preset time length before or after the image is taken as the target associated data; wherein the difference between the target moment and the current moment is the first preset time length; Inputting the physiological data and acceleration data in the target-related data into a judgment model to determine whether the image is a target image; The method further comprises: When a photo-taking instruction issued by a user is received within a third preset time period before or after the image is taken, the image is determined to be a target image.

5. The method according to claim 4, characterized in that The method further comprises: When a user deletes any target image in the permanent storage area, acquiring target association data corresponding to the target image; The judgment model is retrained according to the target association data respectively corresponding to the plurality of target images.

6. The method according to any one of claims 1 to 5, characterized in that: Controlling the camera to shoot the surrounding environment includes: When the current location meets a high-risk condition or a vehicle approaches the user, the camera is controlled to shoot the surrounding environment with a first shooting quality, otherwise the surrounding environment is shot with a second shooting quality, the first shooting quality is higher than the second shooting quality, and the shooting quality is used to indicate the resolution, color depth, contrast, saturation, shooting frequency and / or video frame rate used in shooting; The method further comprises: When the power level is lower than a second preset threshold, the function modules except the necessary function modules are turned off; wherein the necessary function modules are used to indicate the function modules used for navigation, taking pictures and determining the target image.

7. A photographing device, characterized in that: Applied to smart glasses, the smart glasses include a camera, and the device includes: A control module, used for controlling the camera to shoot the surrounding environment and storing a plurality of images obtained by shooting in a temporary storage area when in a navigation mode; the images include images and / or videos; a screening module, for screening target-related data corresponding to any image in the temporary storage area from a plurality of related data, and judging whether the image is a target image according to the target-related data; wherein the target image is used to indicate an image that needs to be stored in the permanent storage area, and the related data is used to indicate physiological data and motion data of the user; The moving module is used to move the image to a permanent storage area when the image is a target image.

8. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images