Intelligent camera shooting method and system, electronic equipment and readable storage medium

Abstract

The invention provides an intelligent camera shooting method and system, electronic equipment and a readable storage medium, and belongs to the technical field of intelligent camera shooting, and the method comprises the steps: responding to a condition that first equipment is in a camera shooting mode, and determining a target camera shooting angle based on a target scene; the target scene is a scene where a user wearing the first equipment is located; determining a shooting area based on the target shooting angle; and shooting the shooting area based on the user head information and the user eye information to obtain a shot image. According to the intelligent camera shooting method and system, the electronic equipment and the readable storage medium provided by the invention, the actual camera shooting requirement of the user can be met.

Description

Technical Field

[0001] The present disclosure belongs to the field of intelligent camera technology, and more specifically, relates to an intelligent camera method and system, an electronic device, and a readable storage medium. Background Art

[0002] At present, smart glasses camera technology has been used in the market to a certain extent, but there are still many limitations. Existing glasses camera systems usually use fixed camera positions and viewing angles, which makes the shooting content relatively broad and fixed. In actual use, users often find it difficult to accurately capture the fine content of certain locations through this fixed camera mode. The shooting content often does not meet user expectations and cannot meet actual needs. Summary of the invention

[0003] The purpose of the present disclosure is to provide an intelligent camera method and system, an electronic device, and a readable storage medium to meet the actual camera needs of users.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an intelligent camera method, which is applied to a first device and includes: In response to the first device being in a camera mode, a target camera angle is determined based on a target scene, where the target scene is a scene where a user wearing the first device is located.

[0005] The imaging area is determined based on the target imaging angle.

[0006] The camera area is photographed based on the user's head information and the user's eye information to obtain a photographed image.

[0007] According to a second aspect of the embodiments of the present disclosure, there is provided an intelligent camera system, which is applied to a first device and includes: The angle calibration module is used to determine a target camera angle based on a target scene in response to the first device being in a camera mode. The target scene is a scene where a user wearing the first device is located.

[0008] The first camera module is used to determine a camera area based on a target camera angle.

[0009] The second camera module is used to shoot the camera area based on the user's head information and the user's eye information to obtain a shot image.

[0010] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the above-mentioned intelligent camera method when executing the computer program.

[0011] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned intelligent camera method are implemented.

[0012] The beneficial effects of the intelligent camera method and system, electronic device, and readable storage medium provided by the embodiments of the present disclosure are: On the one hand, determining the target camera angle through the target scene can make shooting more intelligent and targeted. Different scenes, such as outdoor scenery and indoor meetings, have different requirements for camera angles. This method can ensure that the most suitable angle can be automatically adjusted in various scenes, avoiding the problem of single and wide traditional camera angles, improving the quality and accuracy of shooting, and meeting users' shooting needs for specific content in different scenes.

[0013] On the other hand, the use of user head and eye information to shoot the camera area further enhances the personalization and humanity of shooting. It can better capture the area that the user is concerned about, closely combine with the user's line of sight, ensure that the shot image meets the user's actual expectations, solve the problem in the existing technology that the shot content often does not meet the user's expectations, and greatly improve the user experience and the practicality of shooting.

[0014] In summary, the disclosed embodiments can bring a convenient and efficient shooting experience to users. Ideal images can be obtained without complicated operations, which can adapt to the habits and needs of different users, open up a new direction for the development of the field of intelligent photography, and have broad application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0016] Figure 1 A schematic diagram of a flow chart of an intelligent camera method provided by an embodiment of the present disclosure; Figure 2 A structural block diagram of an intelligent camera system provided by an embodiment of the present disclosure; Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0017] In the following description, specific details such as specific system structures and technologies are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present disclosure. However, it should be clear to those skilled in the art that the present disclosure may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obstructing the description of the present disclosure with unnecessary details.

[0018] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, specific embodiments will be described below in conjunction with the accompanying drawings.

[0019] Please refer to Figure 1 , Figure 1 This is a schematic flow chart of an intelligent camera method provided by an embodiment of the present disclosure. The method may include S101 to S103.

[0020] S101: In response to a first device being in a camera mode, determining a target camera angle based on a target scene, wherein the target scene is a scene where a user wearing the first device is located.

[0021] In this embodiment, the first device is a wearable device, which may include smart glasses or a smart helmet. The camera mode is a working state of the first device. When the first device enters the camera mode, the camera and related image processing and analysis functions are started. In the camera mode, the first device will focus on capturing images and videos, and automatically adjust and optimize according to different scenarios and user needs. For example, in the camera mode, the device may adjust the parameters of the camera, such as exposure time, focus distance, resolution, etc., to obtain the best shooting effect. At the same time, the first device can also start the image stabilization function to reduce the blurring of the picture caused by the user's hand shaking or body movement.

[0022] The target camera angle refers to the angle to which the camera of the first device is adjusted in order to obtain the best shooting effect in a specific target scene. The determination of this angle is based on the analysis of the target scene and the needs and habits of the user. For example, when shooting a person, the target camera angle can be adjusted according to the position and movement of the person to ensure that the position of the person in the picture is appropriate and the proportion is coordinated. When shooting scenery, the target camera angle can be adjusted according to the distribution of the scenery, the position of the key elements, and the user's visual habits, etc., to show the most beautiful picture composition. The target camera angle can be a horizontal angle, a vertical angle, or a combination of the two, and can be dynamically adjusted as the user moves and the scene changes.

[0023] In this embodiment, before determining the target camera angle based on the target scene, the method further includes: In response to receiving the target trigger instruction, the first device is controlled to enter a camera mode.

[0024] Exemplarily, when the first device receives the target trigger instruction, the corresponding program will be started to make the first device enter the camera mode. A specific physical key or touch button can be set on the first device as the input source of the target trigger instruction. When the user presses the button, the processor of the first device will receive the signal and switch to the camera mode. Alternatively, the microphone can receive the user's voice command to control the first device to enter the camera mode.

[0025] In this embodiment, the target scene refers to the actual environment and situation in which the user wearing the first device is currently located. The target scene may include various situations, such as indoor scenes (such as conference rooms, family living rooms, etc.), outdoor scenes (such as parks, streets, mountains, etc.), and specific activity scenes (such as sports games, concerts, parties, etc.). The basis for determining the target scene may include environmental information (such as light, sound, geographical landmarks, etc.) and built-in sensor data of the device (such as accelerometers, gyroscopes, etc. to determine the wearer's posture).

[0026] For example, the light sensor of the device detects a specific light intensity and color temperature to determine whether it is daytime or nighttime, and whether it is an indoor or outdoor scene; the sound sensor identifies the surrounding sound patterns, such as crowd noise, music, etc., to further determine the scene type. Through comprehensive analysis of this information, the first device can intelligently adjust the camera angle to better meet the shooting needs in different scenes.

[0027] S102: Determine a shooting area based on a target shooting angle.

[0028] In this embodiment, after the target camera angle is determined, the first device will define the camera area according to the field of view corresponding to this angle. If the field of view of the camera is regarded as a cone-shaped space, the target camera angle determines the direction of this cone. The first device can calculate the actual spatial range that can be covered at this specific angle, thereby determining the camera area. For example, if the target camera angle is 30 degrees horizontally to the upper right, the device will determine the specific area range that can be photographed from this angle based on factors such as the focal length of the camera and the size of the sensor, which may include specific objects, scenes or spaces.

[0029] For example, the first device is a pair of smart glasses, and the user activates the camera function while visiting a museum. The target camera angle is determined to be 15 degrees above the front according to the current target scene (museum exhibition hall). At this time, the first device will determine the camera area based on this angle, including the cultural relics on display and the sign next to them. In this way, the user can focus on viewing the exhibits, while the device automatically captures the area of ​​interest to facilitate subsequent review or sharing. If the user moves or adjusts the head angle, the device will re-determine the target camera angle and camera area to ensure that the most appropriate picture is always captured.

[0030] S103: photographing the camera area based on the user's head information and the user's eye information to obtain a photographed image.

[0031] In this embodiment, the user head information may include the position, direction, rotation angle, etc. of the user's head. For example, the horizontal rotation angle, vertical tilt angle, etc. of the head may reflect the direction the user is looking at. The user eye information may include the position of the eyeball, gaze direction, blinking frequency, pupil size, etc. The user eye information can more accurately determine the specific object that the user is really paying attention to. For example, if the eyeball is focused on a specific object, it means that the user is paying close attention to the object.

[0032] Exemplarily, the first device detects the movement and posture changes of the user's head through built-in sensors (such as gyroscopes, accelerometers, etc.) to obtain head information. For eye information, eye tracking technology can be used to capture the movement and state of the eyeballs using infrared light or a camera. After determining the camera area, the first device further adjusts the shooting parameters and focus based on the head and eye information to ensure that the content that the user is really concerned about is captured. For example, if the user's head is slightly tilted and the eyes are fixed on a specific corner, the first device will adjust the camera angle and focal length accordingly to shoot at that area.

[0033] Exemplarily, the first device is a pair of smart glasses. When traveling, the user wears smart glasses. When the glasses are in camera mode, the target camera angle is determined according to the current target scene, such as a beautiful seaside, so that the camera can better capture the sea view. The camera area is determined based on the target camera angle, which may include waves, beaches, and islands in the distance. At the same time, by detecting the user's head information and eye information, if the user turns his head to look at a puppy running on the beach, the glasses will automatically adjust the shooting area to focus on the puppy, and finally capture the picture that the user is concerned about, making it convenient for the user to record beautiful moments.

[0034] It can be concluded from the above that, on the one hand, this embodiment can make shooting more intelligent and targeted by determining the target camera angle through the target scene. Different scenes, such as outdoor scenery and indoor meetings, have different requirements for camera angles. This method can ensure that the most suitable angle can be automatically adjusted in various scenes, avoiding the problem of single and wide traditional camera angles, improving the quality and accuracy of shooting, and meeting the user's shooting needs for specific content in different scenes.

[0035] On the other hand, the use of user head and eye information to shoot the camera area further enhances the personalization and humanity of shooting. It can better capture the area that the user is concerned about, closely combine with the user's line of sight, ensure that the shot image meets the user's actual expectations, solve the problem in the existing technology that the shot content often does not meet the user's expectations, and greatly improve the user experience and the practicality of shooting.

[0036] In summary, this embodiment can bring a convenient and efficient shooting experience to users. Ideal pictures can be obtained without complicated operations, which adapts to the habits and needs of different users, opens up a new direction for the development of the field of intelligent photography, and has broad application prospects.

[0037] In one embodiment of the present disclosure, determining a target camera angle based on a target scene includes: The target camera angle is determined based on the light information, the target scene and the user's first commonly used angle set. The target scene is the scene where the user is located determined based on the user's environment information.

[0038] In this embodiment, the user's first frequently used angle set can be understood as a collection of a series of camera angles that the user used to take photos with the first device in various scenes. This collection reflects the user's shooting habits and preferences, and covers the angle ranges that the user tends to choose in different scenes. For example, in outdoor landscape shooting scenes, users often use a slightly tilted angle (e.g., 15 degrees above the horizontal) to shoot the sky and distant mountains; in indoor character shooting scenes, a specific horizontal angle is used to highlight the main character.

[0039] Exemplarily, when determining the target camera angle, first obtain the current light information and target scene. Light information can affect the shooting effect and the shooting angle that the user is accustomed to. Under different light angles, users are accustomed to using different camera angles to obtain the best picture. The target scene provides environmental background information. If the current scene is similar to a scene in the past, you can refer to the user's commonly used angles in similar scenes, comprehensively consider factors such as light, and select the angle that best suits the current situation as the target camera angle.

[0040] The first device can record the angle information and corresponding scene information of each shooting by the user through the built-in storage module. As the number of times the user uses it increases, the angle set is continuously enriched and updated. When determining the target camera angle, the current scene and light information are analyzed, matched with the scenes in the stored angle set, and the final angle is determined according to certain weights and preset rules.

[0041] Exemplarily, the first device is a smart helmet, which is often used by users when cycling. On a sunny morning, the user rides to the suburbs, and the device determines that the target scene is a suburban road based on environmental information. Combined with the current light information (sunlight shining from the left) and the "user's first commonly used angle set". If in similar suburban cycling scenes and such light conditions in the past, the user often uses an angle slightly to the left to shoot the scenery in front of and around the road, then determine this angle as the current target camera angle, so that the captured picture can make full use of the light and conform to the user's habits, providing the user with a better shooting experience.

[0042] This embodiment can automatically determine the best camera angle by intelligently analyzing the user's habits and the current environment, thereby improving the shooting effect. The first device continuously optimizes the angle selection by learning the user's behavior pattern to ensure that each shot can achieve the best effect, thereby improving the user's shooting experience and satisfaction.

[0043] In one embodiment of the present disclosure, the environmental information includes landmark information, geographic information and sound information.

[0044] The intelligent camera method also includes: The target scene is determined based on landmark information, geographic information and sound information.

[0045] In this embodiment, determining the target scene based on the landmark information, geographic information and sound information includes: A first scene is determined based on the landmark information and the geographic information.

[0046] A target scene is determined based on the sound information and the first scene.

[0047] In this embodiment, the landmark information may be an object or sign with obvious features that can be recognized by the device, such as a famous building, a specific sculpture, a road sign, etc. Geographic information may include location coordinates (such as longitude and latitude), altitude, topography, etc.

[0048] For example, when the user wears the first device and walks in the city, the first device identifies nearby landmark buildings and current geographic coordinates, thereby determining that the first scene is a specific area in the city. For example, in City A, Tower B is identified and the geographic information is displayed in District C, thereby preliminarily determining the first scene.

[0049] In this embodiment, the first scene is a relatively broad scene that the user is in, which is preliminarily determined based on the landmark information and the geographic information. The first scene is the basis for further determining the target scene.

[0050] Determining the first scene based on the marker information and the geographic information includes: determining the first scene based on the marker information, the geographic information and a scene database. The scene database includes a plurality of standard marker information, a plurality of standard geographic information and a plurality of corresponding scene information.

[0051] Determining the first scene based on geographic information and a scene database includes: matching the geographic information with a plurality of standard geographic information in the scene database, and if the match is successful, adding the corresponding scene information and standard landmark information to the first scene data set.

[0052] Based on the marker information, a match is performed with multiple standard marker information in the first scene data set. If the match is successful, the corresponding scene information is used as the first scene.

[0053] For example, a scene database containing multiple combinations of markers and geographic information can be established. When new markers and geographic information are obtained, the first scene is determined by querying the scene database. Sound information refers to the sounds in the surrounding environment collected by the first device, including natural sounds (such as wind, rain, birdsong, etc.) and artificial sounds (such as human voices, vehicle sounds, music, etc.). The first device can collect sound information through a microphone, and combined with the first scene, specific sounds can further refine the scene.

[0054] For example, the first scene is a city street, and the sound collected at this time contains construction noise, so it can be determined that the target scene is near the construction area of ​​the city street.

[0055] This embodiment achieves a step-by-step recognition of scenes from broad to precise by integrating landmarks, geography and sound information. It improves the accuracy and detail of scene recognition, making the user experience more personalized and intelligent. Through multi-dimensional information fusion, it can more accurately capture the user's environment, providing strong support for subsequent adjustment of camera angles, etc.

[0056] In one embodiment of the present disclosure, determining a target camera angle based on light information, a target scene, and a user's first commonly used angle set includes: Based on the light information and the user's first frequently used angle set, a second frequently used angle set of the user is determined. The amount of data in the second frequently used angle set of the user is less than the amount of data in the first frequently used angle set of the user.

[0057] A target camera angle is determined based on the target scene and a second common angle set of the user.

[0058] In this embodiment, based on the light information and the first commonly used angle set of the user, determining the second commonly used angle set of the user includes: An angle that matches the light information is selected from the user's first frequently used angle set as the user's second frequently used angle set.

[0059] In this embodiment, the second user's commonly used angle set is an angle set selected from the first user's commonly used angle set under specific conditions. It focuses more on the current light information and target scene, has a smaller amount of data than the first user's commonly used angle set, and is more in line with the user's habitual angle range under the current specific shooting situation.

[0060] Light information includes light intensity, light direction, etc. Based on the impact of light on shooting, the angles preferred by users under similar light conditions are selected from the user's first commonly used angle set to form the user's second commonly used angle set. Combined with the target scene, the target camera angle that best suits the current scene and light conditions is further determined from the user's second commonly used angle set.

[0061] Exemplarily, the first device can establish an angle screening algorithm and use light information as one of the input parameters. When new light information is obtained, the algorithm traverses the user's first commonly used angle set and screens according to the preset association rules between light and angle. For example, if the light is strong and shines from above, then the angle range that the user usually uses to slightly lower his head under such light conditions is screened and put into the user's second commonly used angle set.

[0062] In this embodiment, determining the target camera angle based on the target scene and the user's second commonly used angle set includes: A scene identification is determined based on the target scene.

[0063] Based on the scene identification and the user's second most frequently used angle set, a target camera angle is determined.

[0064] For example, the smart glasses determine that the target scene is a seaside scene based on the surrounding environment information, and then generate a corresponding scene identifier, such as "seaside", and match it with the user's second most commonly used angle set. If the user usually likes to shoot the sea and sky at a slightly elevated angle in a seaside scene, then this slightly elevated angle will be determined as the target camera angle, and the camera will be automatically adjusted.

[0065] In this embodiment, the second user frequently used angle set includes multiple user frequently used angles. Determining the target camera angle based on the scene identifier and the second user frequently used angle set includes: determining the target camera angle by matching the scene identifier with multiple user frequently used angles.

[0066] Exemplarily, the first device is smart glasses, which are used by the user during outdoor travel. The current scene is the seaside, and the sun shines obliquely from the right. First, the user's first commonly used angle set is determined according to the seaside scene where the user is located. However, due to the large amount of data and the fact that it does not necessarily fully meet the current light conditions, the angles commonly used by the user at the seaside and under similar light conditions are filtered out from the user's first commonly used angle set in combination with the current light information, such as turning slightly to the left to better utilize the light to shoot the seascape angle range, to form the user's second commonly used angle set. Then, the target camera angle is determined based on the seaside scene and the user's second commonly used angle set, so that the photos taken can not only highlight the beautiful scenery of the seaside, but also make full use of the light to obtain better shooting effects.

[0067] This embodiment dynamically optimizes the camera angle selection by combining light information, target scene and user's commonly used angle set, thereby improving the shooting effect and user experience. This embodiment can not only automatically adapt to complex light conditions, but also accurately select the best shooting angle according to user habits and specific scenes, effectively reducing the time and difficulty of manual adjustment by users, making the shooting process more intelligent and efficient, and ultimately presenting higher quality image effects.

[0068] In one embodiment of the present disclosure, photographing a camera area based on user eye information includes: The photographing subject is determined from the imaging area based on the user's eye information.

[0069] A target imaging area is selected from the imaging areas based on the imaging subject, and the target imaging area is photographed.

[0070] In this embodiment, the photographed subject refers to the object that the user is mainly concerned about in the camera area, determined based on the user's eye information. This object may include a person, an object, a specific element in a scene, etc. It is the part that is focused on and highlighted during shooting to ensure that the captured image can meet the user's actual needs and concerns.

[0071] Exemplarily, the first device obtains the user's eye information through eye tracking technology, including the position of the eyeball, the direction of gaze, the duration of gaze, etc. When the user's eyes are focused on a specific object in the camera area, the first device determines the user's focus based on this eye information. If the user's gaze is relatively stable and lasts for a period of time, the first device will determine the object being gazed as the subject of the shooting. For example, if the user's eyes are fixed on a flower in the camera area for a long time, then the flower is determined to be the subject of the shooting.

[0072] In this embodiment, determining the photographing subject from the photographing area based on the user's eye information includes: The first pupil information and the second pupil information are determined based on the user's eye information.

[0073] A subject is determined from the imaging area based on the first pupil information and the second pupil information.

[0074] In this embodiment, the first pupil information and the second pupil information may include the position, size, gaze direction, etc. of the pupil. If the user has special conditions such as strabismus, the gaze directions of the two eyes will be different. In this case, it is necessary to comprehensively analyze the two pupil information to more accurately determine the actual focus of the user. For example, if one eye of the user is strabismus, but the other eye is looking at an object normally, the pupil information of the two eyes can be comprehensively analyzed according to the specific situation of the user to further determine the object that the user is actually paying attention to, thereby determining the shooting subject from the camera area.

[0075] Exemplarily, for users with special eye conditions, corrections can be made based on the differences between the two eyes. For example, if the squint angle of one eye of the user is a certain value, the gaze direction of the two eyes can be adjusted according to this angle to determine a more accurate subject for the photo. Allow users to perform personalized eye information calibration. When using the first device for the first time, the user can perform some eye tests to allow the device to record the user's special eye features so that the subject can be better determined later.

[0076] This embodiment can improve the personalization and accuracy of user photography. By comprehensively analyzing the pupil information of the user's eyes, including correction of special situations such as strabismus, the user's real focus can be captured more accurately, thereby intelligently determining the subject of the photo. This shooting method based on the user's eye information not only meets the user's personalized needs, but also improves the accuracy and pertinence of the shooting, making the final image closer to the user's expectations and focus.

[0077] In one embodiment of the present disclosure, photographing a camera area based on user head information and user eye information includes: Determine the gaze duration based on the user's head information.

[0078] The frequency of video recording is determined based on the duration of gaze.

[0079] The camera area is photographed based on the camera frequency and the user's eye information.

[0080] In this embodiment, the shooting frequency refers to the number of times the first device shoots the shooting area within a certain period of time. The shooting frequency determines the frequency of the first device capturing images, which can be high-frequency continuous shooting or low-frequency intermittent shooting. The shooting frequency affects the number of images captured, the resource consumption of the device (such as power, storage space, etc.) and the final shooting effect.

[0081] In this embodiment, first, the gaze duration is determined by analyzing the user's head information. When the user's head maintains a relatively stable posture, it can be inferred that the user is concentrating on observing a certain area, and the user's gaze duration on the specific area can be calculated. If the gaze duration is greater than the preset gaze duration threshold, it means that the user pays more attention to the area and needs to shoot frequently, so the camera frequency can be increased to capture possible important pictures more comprehensively. On the contrary, if the gaze duration is less than or equal to the preset gaze duration threshold, it means that the user is not paying attention to the area, and the camera frequency can be reduced to save equipment resources.

[0082] Exemplarily, sensors (such as gyroscopes, accelerometers, etc.) can be used to detect the movement and posture change information of the user's head. When the head movement amplitude is small, it can be considered that the user is concentrating on observation, and the timing is started to determine the gaze duration. Different camera frequencies can be set according to the gaze duration. For example, multiple different gaze duration intervals can be set, and each interval corresponds to a different camera frequency. When the detected gaze duration falls within a certain interval, the camera frequency of the device is automatically adjusted to the corresponding value. As the user's head moves and the gaze duration changes, the camera frequency is dynamically adjusted in real time to adapt to different shooting needs.

[0083] In this embodiment, determining the camera frequency based on the gaze duration includes: If the gaze duration is greater than or equal to the first duration, the video shooting frequency is determined to be the first shooting frequency.

[0084] If the gazing duration is greater than or equal to the second duration, the first shooting frequency is adjusted to determine the second shooting frequency. The first duration is less than the second duration.

[0085] In this embodiment, the user's attention to a certain area is a gradual process. At first, the user may only pay attention to it briefly. As time goes by, if the user feels that the area is more attractive or important, the user will continue to pay attention to it for a longer time. The setting of the first duration being shorter than the second duration is in line with this user behavior habit, and can more accurately capture the user's attention changes, providing the user with a better shooting experience.

[0086] In this embodiment, the values ​​of the first shooting frequency and the second shooting frequency, as well as the first duration and the second duration corresponding thereto, can be preset. They can be reasonably set according to actual needs and device performance. For example, the first shooting frequency can be to take a photo every 30 seconds, and the first duration is 5 seconds, and the second shooting frequency can be to take a photo every 10 seconds, and the second duration is 10 seconds. When different duration conditions are met, the first device automatically switches to the corresponding shooting frequency to achieve dynamic adjustment.

[0087] Exemplarily, a user wears smart glasses to visit a tourist attraction. When seeing a beautiful sculpture, he starts to stare at it. If the staring duration is between 5 seconds and 10 seconds (greater than or equal to the first duration of 5 seconds), the smart glasses record the sculpture at a first shooting frequency of taking a photo every 30 seconds. As the user continues to appreciate the sculpture, the staring duration exceeds 10 seconds (greater than or equal to the second duration), and the smart glasses adjust to a second shooting frequency of taking a photo every 10 seconds to more comprehensively record the details of the sculpture that the user is interested in. If the user quickly shifts his gaze and the staring duration is less than 5 seconds, the lower default shooting frequency is restored or shooting is paused to save power and storage space.

[0088] This embodiment can improve the intelligence and efficiency of shooting. By dynamically adjusting the camera frequency, this embodiment can accurately capture the moments that the user really cares about, while effectively managing device resources. While maintaining high-quality shooting, it reduces unnecessary shooting, extends device battery life, optimizes storage space utilization, and brings users a more personalized and efficient shooting experience.

[0089] In one embodiment of the present disclosure, determining the gaze duration based on the user head information includes: The head angle change rate is determined based on the user's head information.

[0090] If the head angle change rate is less than or equal to the first change rate threshold, the gaze duration is calculated.

[0091] In this embodiment, the head angle change rate refers to the degree of change in the head movement state of the wearer of the first device, which can be measured by parameters such as the rotation angle of the head, the moving speed, etc. For example, the angle of rotation of the head or the distance of movement per unit time.

[0092] The first change rate threshold is a pre-set value used to determine whether the head movement is relatively stable, so as to determine whether to start calculating the gaze duration. When the head angle change rate is less than or equal to this threshold, the head movement is considered to be relatively stable, indicating that the user is concentrating on observing a certain area.

[0093] Exemplarily, the sensor in the first device is used to continuously collect head motion data, including information such as the angle and acceleration of the head. The collected head motion data is analyzed to calculate the rate of change of the head angle. The rate of change can be calculated by using the amount of change of the head motion parameters within a certain time window. A first rate of change threshold is set according to actual application scenarios and user needs. This threshold can be adjusted through experiments and user feedback to achieve the best effect.

[0094] For example, a user wears smart glasses to visit a museum. When the user sees an exhibit of interest, the head information is relatively stable. The smart glasses detect through sensors that the rate of change of the user's head angle is gradually decreasing. When the rate of change is less than or equal to the first rate of change threshold, the gaze duration begins to be calculated. If the user continues to observe the exhibit, the gaze duration will trigger the smart glasses to adjust the shooting frequency in order to better record the content that the user is paying attention to. If the user's head turns quickly and the rate of change of the head angle exceeds the first rate of change threshold, the gaze duration calculation is stopped, and it is determined whether to start the calculation again after the head is stable again.

[0095] This embodiment can improve the intelligence and accuracy of the shooting system. This embodiment can automatically record the gaze duration when the user is truly focused, and adjust the shooting frequency accordingly to ensure that important moments are not missed. At the same time, it ignores unstable head movements, avoids invalid shooting, optimizes resource utilization, and brings users a smoother and more efficient shooting experience.

[0096] Corresponding to the intelligent camera method of the above embodiment, Figure 2 This is a block diagram of the structure of an intelligent camera system provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 2 The intelligent camera system 20 includes: an angle calibration module 21, a first camera module 22 and a second camera module 23.

[0097] The angle calibration module 21 is used to determine a target camera angle based on a target scene in response to the first device being in a camera mode. The target scene is a scene where a user wearing the first device is located.

[0098] The first camera module 22 is used to determine a camera area based on a target camera angle.

[0099] The second camera module 23 is used to shoot the camera area based on the user's head information and the user's eye information to obtain a shot image.

[0100] In one embodiment of the present disclosure, the angle calibration module 21 is specifically used to determine the target camera angle based on light information, the target scene and the user's first commonly used angle set. The target scene is the scene where the user is located determined based on the user's environment information.

[0101] In one embodiment of the present disclosure, the environmental information includes landmark information, geographic information and sound information.

[0102] The intelligent camera system 20 further includes a scene recognition module for determining a target scene based on landmark information, geographic information and sound information.

[0103] In one embodiment of the present disclosure, the angle calibration module 21 is further configured to determine a second frequently used angle set based on light information and the first frequently used angle set of the user. The amount of data in the second frequently used angle set of the user is less than the amount of data in the first frequently used angle set of the user.

[0104] A target camera angle is determined based on the target scene and a second common angle set of the user.

[0105] In an embodiment of the present disclosure, the second camera module 23 is specifically used to determine the photographing subject from the camera area based on the user's eye information.

[0106] A target imaging area is selected from the imaging areas based on the imaging subject, and the target imaging area is photographed.

[0107] In an embodiment of the present disclosure, the second camera module 23 is further configured to determine the gaze duration based on the user's head information.

[0108] The frequency of video recording is determined based on the duration of gaze.

[0109] The camera area is photographed based on the camera frequency and the user's eye information.

[0110] In an embodiment of the present disclosure, the second camera module 23 is further configured to determine a head angle change rate based on user head information.

[0111] If the head angle change rate is less than or equal to the first change rate threshold, the gaze duration is calculated.

[0112] See also Figure 3 , Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. Figure 3 The electronic device 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303 and one or more memories 304. The processors 301, input devices 302, output devices 303 and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to execute the functions of the modules in the above-mentioned system embodiments, such as Figure 2 The functions of modules 21 to 23 are shown.

[0113] It should be understood that in the embodiment of the present disclosure, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0114] The input device 302 may include a touch panel, a fingerprint collection sensor (for collecting the user's fingerprint information and fingerprint direction information), a microphone, etc., and the output device 303 may include a display (LCD, etc.), a speaker, etc.

[0115] The memory 304 may include a read-only memory and a random access memory, and provide instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store information about the device type.

[0116] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present disclosure can execute the implementation methods described in the first and second embodiments of the intelligent camera method provided in the embodiments of the present disclosure, and can also execute the implementation methods of the electronic device 300 described in the embodiments of the present disclosure, which will not be repeated here.

[0117] In another embodiment of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by the processor, all or part of the processes in the above-mentioned embodiment method are implemented, and the computer program can also be completed by instructing the relevant hardware through the computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0118] The computer-readable storage medium may be an internal storage unit of the electronic device of any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0119] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0120] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the electronic devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0121] In the several embodiments provided in the present application, it should be understood that the disclosed electronic device and method can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or it can be an electrical, mechanical or other form of connection.

[0122] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present disclosure.

[0123] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0124] The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present disclosure, and these modifications or replacements should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. An intelligent camera method, characterized in that: Applied to a first device, comprising: In response to the first device being in a camera mode, determining a target camera angle based on a target scene; the target scene is a scene where a user wearing the first device is located; Determine a camera area based on the target camera angle; The camera area is photographed based on the user's head information and the user's eye information to obtain a photographed image.

2. The intelligent camera method according to claim 1, characterized in that: The step of determining a target camera angle based on a target scene comprises: The target camera angle is determined based on light information, the target scene and a first common angle set of the user; the target scene is a scene where the user is located, which is determined based on information about the environment where the user is located.

3. The intelligent camera method according to claim 2, characterized in that: The environmental information includes landmark information, geographic information and sound information; The intelligent camera method also includes: The target scene is determined based on the landmark information, the geographic information, and the sound information.

4. The intelligent camera method according to claim 2, characterized in that: The determining the target camera angle based on the light information, the target scene and the user's first commonly used angle set includes: Based on the light information and the first commonly used angle set of the user, determining a second commonly used angle set of the user; the amount of data in the second commonly used angle set of the user is less than the amount of data in the first commonly used angle set of the user; The target camera angle is determined based on the target scene and the second common angle set of the user.

5. The intelligent camera method according to claim 1, characterized in that: The method includes photographing the camera area based on the user's eye information, including: Determine a photographing subject from the photographing area based on the user's eye information; A target imaging area is selected from the imaging areas based on the imaging subject, and the target imaging area is photographed.

6. The intelligent camera method according to claim 1, characterized in that: The photographing the camera area based on the user head information and the user eye information includes: Determine the gaze duration based on the user's head information; Determining a camera frequency based on the gaze duration; The imaging area is photographed based on the imaging frequency and the user's eye information.

7. The intelligent camera method according to claim 6, characterized in that: The determining of the gaze duration based on the user head information includes: Determine a head angle change rate based on the user head information; If the head angle change rate is less than or equal to the first change rate threshold, the gaze duration is calculated.

8. An intelligent camera system, characterized in that: Applied to a first device, comprising: an angle calibration module, configured to determine a target camera angle based on a target scene in response to the first device being in a camera mode; the target scene being a scene in which a user wearing the first device is located; A first camera module, used to determine a camera area based on the target camera angle; The second camera module is used to shoot the camera area based on the user's head information and eye information to obtain a shot image.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images