Shooting method and device and electronic equipment

Abstract

The invention discloses a shooting method and device and electronic equipment, and belongs to the technical field of camera shooting. The method comprises the following steps: acquiring a first biological signal acquired by a first wearable device and first eye movement information acquired by a second wearable device; determining a first feedback index of the user according to the first biological signal and the first eye movement information; and when the first feedback index exceeds a preset threshold value, at least one image is shot.

Description

Technical Field

[0001] The present application belongs to the field of camera technology, and specifically relates to a shooting method, device and electronic equipment. Background Art

[0002] With the development of electronic devices, photography has gradually become an important way for people to record their lives and express their creativity. Especially with the widespread use of electronic devices, users are increasingly photographing human scenes. Through the lens, people hope to freeze those "decisive moments" that tell stories and move people, preserving the unique charm of human scenes.

[0003] However, existing photography solutions present numerous practical challenges. For one thing, when capturing the "decisive moment," users often rely on their personal experience for composition and timing, or employ methods like continuous shooting with their cameras or extracting keyframes from pre-recorded videos on smart devices. This can easily lead to users missing the "decisive moment" when photographing human scenes, resulting in images that deviate from expectations, impacting both the quality of the shot and the user experience. Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide a shooting method, device and electronic device that can solve the problem that users currently have difficulty in grasping the shooting timing during the shooting process, resulting in difficulty in capturing satisfactory images.

[0005] In a first aspect, an embodiment of the present application provides a shooting method, which is applied to an electronic device, wherein the electronic device is connected to a first wearable device and a second wearable device, respectively, and the method includes:

[0006] Acquire a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device;

[0007] determining a first feedback index of the user based on the first bio-signal and the first eye movement information;

[0008] When the first feedback index exceeds a preset threshold, at least one image is captured.

[0009] In a second aspect, an embodiment of the present application provides a photographing device, which is applied to an electronic device, wherein the electronic device is connected to a first wearable device and a second wearable device, respectively, and the device includes:

[0010] an acquisition module, configured to acquire a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device;

[0011] a determination module, configured to determine a first feedback index of the user based on the first bio-signal and the first eye movement information;

[0012] The shooting module is used to shoot and obtain at least one image when the first feedback index exceeds a preset threshold.

[0013] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0017] In an embodiment of the present application, a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device are obtained. Since the collection frequency of the biosignal and eye movement information is high, a high-sensitivity response to instantaneous changes can be ensured. Through multimodal perception of physiology and vision, the user's subconscious physiological reaction is captured, which facilitates the advance prediction of the shooting intention. According to the first biosignal and the first eye movement information, the user's first feedback index is determined, and the vague shooting intention can be converted into a calculable numerical indicator, so as to achieve accurate quantification of the user's shooting intention, which is convenient for the subsequent determination of the shooting timing. When the first feedback index exceeds the preset threshold, it indicates that the user expects the shooting time, and at least one image is captured. Therefore, by perceiving the user's physiological state and visual state in real time, the shooting timing can be accurately grasped, and the image the user wants can be captured efficiently and accurately. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flowchart of a shooting method provided by an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a shooting scene provided in an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of another shooting scene provided by an embodiment of the present application;

[0021] Figure 4is a structural diagram of a photographing device provided in an embodiment of the present application;

[0022] Figure 5 This is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;

[0023] Figure 6 This is the second hardware structure diagram of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the accompanying drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0025] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0026] The shooting method provided in the embodiment of the present application can be applied to at least the following application scenarios, which are described below.

[0027] Currently, filming birds catching fish often takes place in natural water environments such as wetlands and lakes. The birds' rapid movements, including swooping and catching, present a significant challenge for photographers due to their speed and the difficulty of timing. Users hope to capture the visually striking "decisive moment," such as the splashing bird entering the water and the intense clash between fish and bird.

[0028] However, the traditional method of relying on the photographer's experience in composition and timing judgment, or using continuous shooting or pre-recorded video to extract key frames, is often unable to accurately predict the movement of birds due to the single perception dimension; the time and space coordination is inaccurate, and the delay between the mobile phone shutter and the eye's perspective causes image deviation; and later images need to be selected from a large number of continuous shots or video frames, which is not only time-consuming and labor-intensive, but also difficult to guarantee image quality.

[0029] In response to the problems arising from the related art, the embodiments of the present application provide a shooting method, device and electronic device, which can solve the problem in the related art that users currently have difficulty in grasping the shooting timing during the shooting process, resulting in difficulty in capturing satisfactory images.

[0030] The following describes the shooting method provided in the embodiment of the present application in detail through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0031] Figure 1 A flowchart of a shooting method provided in an embodiment of the present application.

[0032] like Figure 1 As shown, the shooting method may include steps 110 to 130, which are applied to the electronic device, wherein the electronic device is connected to the first wearable device and the second wearable device respectively, as shown below:

[0033] Step 110: Acquire a first biosignal collected by the first wearable device and first eye movement information collected by the second wearable device;

[0034] The first wearable device can be a smartwatch or smart bracelet. The second wearable device can be smart glasses or a smart helmet. The first biosignal, collected by the first wearable device, reflects the user's physiological state and includes skin conductance change rate and heart rate. The first eye movement information, collected by the second wearable device, reflects the user's eye movement characteristics and includes pupil diameter change, gaze point coordinates, and eye saccade frequency.

[0035] The first wearable device collects the user's skin conductance change rate and heart rate value to reflect the user's physiological arousal level; at the same time, the second wearable device collects the pupil diameter change, gaze point coordinates and eye movement frequency to quantify the user's visual attention distribution, forming a multi-dimensional perception basis and breaking through the limitation of traditional shooting that relies solely on visual feedback.

[0036] The system has been upgraded from single-view perception to multimodal perception combining physiology and vision, capturing the user's subconscious physiological reactions and predicting shooting intentions in advance. The high frequency of biosignals and eye movement information acquisition ensures a highly sensitive response to instantaneous changes.

[0037] For example, in a flying bird fishing scenario, when the bird dives close to the water surface, the user's skin conductance (Galvanic Skin Response, GSR) increases sharply from the baseline value of 2 microSiemens (μS) to 5μS, the heart rate increases from 70 beats / minute (bpm) to 95bpm, the pupil diameter expands by 0.8 millimeters (mm), and the gaze point is continuously locked on the contact point between the bird's beak and the water surface. The first biological signal and the first eye movement information are collected in real time and transmitted to the electronic device.

[0038] Step 120: determining a first feedback index of the user based on the first bio-signal and the first eye movement information;

[0039] The first feedback index is a value calculated by combining the first bio-signal and the first eye movement information, and is used to quantify the user's attention level and emotional response to the shooting scene.

[0040] By analyzing the user's biosignals and eye movement information, the system identifies the "decisive moment" the user may want to capture. When the first feedback index exceeds a preset threshold, indicating that the user is highly focused and excited, the area the user is looking at is determined as the focus area for the capture based on the first eye movement information.

[0041] By converting the vague "shooting intention" into a calculable numerical indicator and filtering out environmental noise through multi-signal fusion, for example, when the user blinks due to wind, the eye saccade frequency increases but the GSR does not change significantly, thus ensuring the accuracy of the first feedback index.

[0042] For example, at the moment the bird enters the water, the weight value corresponding to the user's GSR change rate is 0.35, the heart rate fluctuation contribution is 0.25, the weight value corresponding to pupil focus is 0.3, and the weight value corresponding to gaze point stability is 0.1. Combining the above first biological signal and the first eye movement information, the feedback index F = 0.82 is determined.

[0043] In a possible embodiment, the first biosignal includes: skin conductance change rate and heart rate value;

[0044] The first eye movement information includes: pupil diameter change and eye saccade frequency;

[0045] The skin conductance change rate is used to characterize the environmental pressure, and the pupil diameter change is used to characterize the visual focus locking strength;

[0046] Step 120 may specifically include the following steps:

[0047] Normalizing at least one of the skin conductance change rate and the heart rate value to obtain at least one biological parameter value;

[0048] Normalizing at least one of the pupil diameter change and the eye movement frequency to obtain at least one eye movement parameter value;

[0049] The at least one biological parameter value and the at least one eye movement parameter value are weighted to determine the first feedback index.

[0050] Skin conductance change rate refers to the rate of change of surface conductivity of the human skin over time and is used to indicate environmental stress or emotional arousal. Pupil diameter change refers to the magnitude of pupil diameter change over a short period of time and is used to indicate the strength of visual focus. Normalization maps the skin conductance change rate to the [0, 1] range to eliminate dimensionality and facilitate weight calculation.

[0051] Different biosignals and eye movement information provide different indicators of a user's attention level. For example, skin conductance change and heart rate reflect a user's emotional arousal level, while pupil diameter change and eye movement frequency reflect the user's visual focus. Weighted processing can comprehensively consider these factors to more accurately assess a user's First Feedback Index. Weighted processing involves assigning different weights to different biosignals and eye movement information, then performing a weighted summation to produce the First Feedback Index.

[0052] For example, when filming a concert, as the band reaches its climax, the user's skin conductance change rate increases significantly, indicating excitement; their pupil diameter increases, indicating visual focus on the stage; their heart rate increases; and their eye movement frequency decreases. These indicators are weighted, with pupil diameter change and skin conductance change rate given higher weights. This results in a higher first feedback index, triggering the capture of the band's exciting performance.

[0053] Therefore, by weighting different biological signals and eye movement information, the user's interest and attention to the shooting scene can be more accurately reflected, the calculation accuracy of the first feedback index can be improved, and the shooting timing can be judged more reliably.

[0054] The step of performing weighted processing on the at least one biological parameter value and the at least one eye movement parameter value to determine the first feedback index may specifically include the following steps:

[0055] respectively determining a first sub-weight, a second sub-weight, a third sub-weight, and a fourth sub-weight corresponding to the skin conductance change rate, the pupil diameter change, and the heart rate value and the saccade frequency;

[0056] The skin conductance change rate, the pupil diameter change, the heart rate value and the eye saccade frequency are weighted according to the first sub-weight, the second sub-weight, the third sub-weight and the fourth sub-weight to obtain the feedback index.

[0057] In addition, the first sub-weight, the second sub-weight, the third sub-weight and the fourth sub-weight can also be dynamically adjusted through a long short-term memory network; a long short-term memory network is a recurrent neural network that can learn long-term dependencies in time series data and is used to dynamically adjust the proportion of each sub-weight.

[0058] Specifically, the first sub-weight can be obtained by analyzing the rate of change of skin conductance data, eliminating the influence of individual differences and environmental interference. The second sub-weight can be obtained by performing a differential calculation on the change in pupil diameter to capture the instantaneous rate of pupil change. The third sub-weight can be obtained by performing a fluctuation analysis on the heart rate value to assess its stability.

[0059] An LSTM network is used to learn the temporal characteristics of biosignals and eye movement information, dynamically adjusting the proportions of the four sub-weights. When the skin conductance change rate suddenly increases beyond the first change rate threshold and the pupil diameter expands beyond the pupil change threshold, the third sub-weight is increased. This often indicates a state of high arousal, and heart rate changes better reflect the user's emotions. When the saccade frequency consistently exceeds the saccade frequency threshold, the first sub-weight is decreased. This suggests that the user may be nervous or anxious, reducing the reliability of skin conductance changes. Based on the adjusted sub-weights, the skin conductance change rate, pupil diameter change, heart rate, and saccade frequency are weighted and summed to produce the final feedback index.

[0060] In addition, when the skin conductance change rate suddenly increases and exceeds the first change rate threshold and the pupil diameter expands and exceeds the pupil change threshold, the allocation ratio of the third sub-weight is increased; when the saccade frequency continues to be higher than the saccade frequency threshold, the allocation ratio of the first sub-weight is reduced.

[0061] For example, when filming a scene of a flying bird catching fish, the moment the bird dives close to the water, the user's skin conductance change rate suddenly increases, and the pupil diameter expands rapidly. After detecting this situation, the third sub-weight corresponding to the heart rate value is increased. At this time, if the user's heart rate also increases significantly and fluctuates greatly, it indicates that the user is highly excited and focused. The feedback index will increase significantly, triggering the shooting operation. If the user waits for a long time for the bird to appear and the eye saccade frequency continues to exceed the eye saccade frequency threshold, the system will reduce the first sub-weight corresponding to the skin conductance change rate to avoid misjudgment of skin conductance changes due to the user's nervousness and improve the accuracy of the feedback index.

[0062] Therefore, by targeted processing and dynamic weight adjustment of different biological signals, it is possible to more accurately capture the changes in the user's physiological and psychological state at the moment of shooting, improve the calculation accuracy of the feedback index, and thus more reliably judge the shooting timing and adapt to different shooting scenes and changes in user status.

[0063] Step 130: When the first feedback index exceeds a preset threshold, at least one image is captured.

[0064] When the first feedback index exceeds the preset threshold, it means that the current time is the user's desired shooting time, and at least one image is captured. By perceiving the user's physiological state and visual state in real time, the shooting time can be accurately grasped, and the image the user wants can be captured efficiently and accurately.

[0065] Exemplarily, the comprehensive feedback index F=0.82, which exceeds the preset threshold value of 0.7. When it is determined that the first feedback index exceeds the preset threshold value, at least one image is captured.

[0066] In a possible embodiment, step 130 may specifically include the following steps:

[0067] Step 140: determining a first focus area based on the first eye movement information when the first feedback index exceeds a preset threshold;

[0068] Step 150: photograph based on the first focus area to obtain at least one image.

[0069] Since the first eye movement information can characterize the user's eye movement characteristics, that is, it can reflect the focus of the user, based on the first eye movement information, the first focus area that the user wants to shoot can be accurately determined. The calculated focus area coordinates are mapped to the camera coordinate system, the lens motor is driven to complete the focus and trigger the shutter. At the same time, the multi-frame continuous shooting strategy is initiated, which specifically includes the following shooting results:

[0070] Main Frame: A capture based on focus parameters at the moment of the feedback index peak. Forward Frame: A frame captured 20ms in advance to compensate for system processing delays. Backward Frame: A frame captured three consecutive frames after the peak to cover the duration of the action. This single-frame capture mode improves capture rates for shorter "decisive moments," avoiding the quality degradation associated with traditional continuous shooting.

[0071] For example, when the feedback index reaches 0.82, the capture is triggered. The forward frame records the initial state of the bird's beak contacting the water surface, the main frame captures the highest point of the splash, and the backward frame preserves the dynamic process of the fish leaping out of the water. The user ultimately selects the main frame from the sequence as the decisive moment in the artwork.

[0072] In this way, it can perceive the user's physiological and visual state in real time, automatically determine the shooting time and focus area, increase the probability of capturing the "decisive moment", and reduce the problem of missing key images due to manual operation delays.

[0073] like Figure 2 As shown, the electronic device 100 can be used as a shooting execution end, the first wearable device 200 can be used as a biological signal collection end, and the second wearable device 300 can be used as an eye movement information collection end. The specific process is as follows:

[0074] Electronic device 100 works in conjunction with first wearable device 200 and second wearable device 300. First wearable device 200 continuously collects the user's first biosignal, while second wearable device 300 simultaneously collects first eye movement information. Leveraging multimodal physiological and visual perception, and leveraging their high acquisition rates, this system can keenly capture the user's subconscious physiological reactions, ensuring highly sensitive responses to instantaneous changes in scenes like birds flying and fishing.

[0075] The electronic device 100 receives the first biosignal from the first wearable device 200 and the first eye movement information from the second wearable device 300, and uses a specific algorithm to convert the vague "shooting intention" into a computable numerical indicator, a first feedback index, to accurately quantify the user's shooting intention and provide a clear and judgable basis for subsequently determining the timing of the shooting.

[0076] When the electronic device 100 determines that the first feedback index exceeds the preset threshold, it means that the user's desired shooting time is now. Because the first eye movement information collected by the second wearable device 300 can accurately characterize the user's eye movement characteristics and reflect the user's focus, the electronic device 100 can accurately determine the first focus area that the user wants to shoot based on this first eye movement information.

[0077] Based on the determined first focus area, the electronic device 100 controls its own camera module to perform a capture operation to obtain at least one image. In this way, through the first wearable device 200 and the second wearable device 300 sensing the user's physiological and visual state in real time, the electronic device 100 accurately grasps the capture timing and the first focus area, and can efficiently and accurately capture the user's desired image.

[0078] In a possible embodiment, step 140 may specifically include the following steps:

[0079] determining, based on the first eye movement information, coordinate information of a gaze point, a dwell time of the gaze point, and a movement rate of the gaze point;

[0080] When the dwell time of the gaze point exceeds a preset time, generating an initial focus area according to the coordinate information of the gaze point;

[0081] The size of the initial focus area is adjusted according to the moving rate of the gaze point to obtain the first focus area.

[0082] The coordinate information of the gaze point refers to the coordinate information of the user's eye gaze position on the image plane; the dwell time of the gaze point refers to the length of time the gaze point stays at a certain position; the movement rate of the gaze point refers to the speed at which the gaze point moves on the image plane; the initial focus area can be a rectangular area generated with the gaze point coordinates as the center; the first focus area is the final focus area obtained after adjusting the initial focus area according to the movement rate of the gaze point.

[0083] When a user gazes at an area for a long time, it indicates that the area may be of interest to the user. Therefore, an initial focus area is generated with the gaze point as the center. The movement rate of the gaze point also reflects the motion state of the user's object of attention. A fast movement rate indicates that the object of attention may be moving rapidly, and the focus area needs to be expanded to ensure that the object remains in focus. A slow movement rate indicates that the object of attention is relatively stable, and the focus area can be narrowed to improve focusing accuracy.

[0084] For example, when photographing a running pet, the user's gaze moves with the pet's movements. First, an initial focus area is generated based on the gaze point coordinates. Then, the gaze point's movement rate is calculated. Because the pet is running quickly, the movement rate exceeds a preset rate threshold, so the size of the initial focus area is expanded to create a second focus area. This ensures that even if the pet moves quickly within the frame, it remains in the focus area, ensuring a clear photo.

[0085] In this way, the size of the focus area can be dynamically adjusted according to the movement characteristics of the user's gaze point, adapting to the shooting objects in different motion states, and improving the success rate of shooting and the quality of photos.

[0086] The step of adjusting the size of the initial focus area according to the movement rate of the gaze point to obtain the first focus area may specifically include the following steps:

[0087] When the moving speed is greater than a speed threshold, adjusting the initial size of the initial focus area to a first size to obtain the first focus area, wherein the first size is greater than the initial size; or

[0088] When the moving speed is less than the speed threshold, the initial size of the initial focus area is adjusted to a second size to obtain the first focus area, and the second size is smaller than the initial size.

[0089] The preset rate threshold is a pre-set speed value used to determine whether the movement rate of the gaze point is fast or slow; when the movement rate of the gaze point is greater than the preset rate threshold, it means that the subject is moving faster. In order to ensure that the subject is always in the focus area during the shooting process, the focus area needs to be expanded; when the movement rate is less than the preset rate threshold, it means that the subject is relatively still or moves slowly. At this time, the focus area can be narrowed to improve the focus accuracy and image clarity.

[0090] When the moving rate is greater than the rate threshold, the initial size of the initial focus area is adjusted to a first size, and the first size is greater than the initial size, that is, the size of the initial focus area is expanded. Specifically, the width and height of the initial focus area can be increased on the basis of the initial focus area to obtain the first focus area.

[0091] When the moving rate is less than the rate threshold, the initial size of the initial focus area is adjusted to a second size, and the second size is smaller than the initial size, that is, the size of the initial focus area is reduced. Specifically, the width and height of the initial focus area can be reduced on the basis of the initial focus area to obtain the first focus area.

[0092] For example, when taking a landscape photo, the user's gaze is primarily focused on a distant mountain, and the gaze moves at a low rate. Detecting that the movement rate is less than a preset rate threshold, the initial focus area is reduced in size, precisely locking the focus area on the mountain. The resulting landscape photo shows the mountain in sharp, clear detail. When filming a basketball game, the user's gaze changes rapidly with the player's rapid movements, and the movement rate exceeds the preset rate threshold. The initial focus area is expanded to ensure the player remains in focus during rapid motion, resulting in a photo with clear, unblurred movements.

[0093] Therefore, by dynamically adjusting the focus area size according to the movement rate of the gaze point, it is possible to adapt to shooting scenes with different motion states while ensuring that the subject is in clear focus, thereby improving shooting flexibility and photo quality.

[0094] In a possible embodiment, the above-mentioned step of determining the first focus area based on the first eye movement information may specifically include the following steps:

[0095] The first eye movement information is input into an attention transfer model, and the first focus area is output.

[0096] Among them, the attention transfer model is trained based on multiple groups of sample shooting data, each group of sample shooting data includes: multiple sample images, sample selected images, sample biological signals and sample eye movement information collected when shooting the sample images; the sample images are shot based on the focus area predicted by the initial model, and the sample selected images are selected by the user from the multiple sample images.

[0097] The attention transfer model is a machine learning-based model used to predict the user's focus area based on the user's eye movement information; the sample shooting data is the dataset used to train the attention transfer model; the initial model is the basic model used before training the attention transfer model to generate the initial focus area prediction.

[0098] The attention transfer model is trained by collecting a large amount of sample shooting data, including user eye movement information, biosignals, and captured images in different scenarios. The attention transfer model learns the correlation between the user's eye movement information and the area of ​​attention, and can predict the user's first focus area based on the first eye movement information collected in real time.

[0099] The real-time first eye movement information is fed into a trained attention transfer model. Based on information such as pupil diameter change, gaze point coordinates, and saccade frequency, the attention transfer model predicts the user's focal area. The camera then captures the predicted focal area, producing a clear and focused photo. Furthermore, by continuously collecting user feedback on the photos they take, the attention transfer model can be continuously optimized, improving the accuracy of the focal area prediction.

[0100] Therefore, the use of the attention transfer model can more accurately capture the user's visual focus, realize intelligent focus area prediction, and improve shooting accuracy and user satisfaction.

[0101] In a possible embodiment, after step 130, the following steps may be further included:

[0102] generating feedback information according to the first bio-signal and the first eye movement information collected during the shooting process;

[0103] A target image is determined from the at least one image according to the feedback information.

[0104] The feedback information is generated based on the first biological signal and the first eye movement information collected during the shooting process, and is used to assist the user in selecting a satisfactory photo from the captured images; the target image is selected by the user from at least one image, or the target image is automatically selected by the electronic device from at least one image.

[0105] After the capture is complete, feedback is generated based on the first bio-signal and first eye movement information recorded during the capture process, such as the user's emotional state at the moment of capture and the stability of their gaze. This feedback helps users understand the context and quality of each photo, allowing them to more accurately select the target image that meets their expectations. For example, a photo showing a child laughing happily, coupled with feedback indicating a large change in pupil diameter and a high rate of change in skin conductance during the capture, indicates that the user was highly focused on the scene at the time, making this photo likely the target image they were looking for.

[0106] For example, after taking a group of photos of children playing, the captured images are displayed along with feedback information. The feedback information includes the child's movements during each photo capture, the user's pupil diameter change, and the skin conductance change rate. Based on this feedback information, the user can select the photo with the most natural child movements and the one that attracted the most attention at the time as the target image. Alternatively, the electronic device can automatically determine the target image from the at least one image based on the feedback information.

[0107] Therefore, by providing feedback information based on the first bio-signal and the first eye movement information, users can more efficiently screen out satisfactory target images from multiple photos, reduce the trouble of later image selection, and improve user experience.

[0108] In a possible embodiment, spatial anchor point data of historical shooting scenes is obtained;

[0109] generating an augmented reality guide line according to the spatial anchor point data of the historical shooting scene, wherein the augmented reality guide line is used to mark the shooting parameters of the historical shooting scene;

[0110] Control the second wearable device to display the augmented reality guide line.

[0111] The spatial anchor point data of the historical shooting scene refers to the three-dimensional spatial position information of the shooting scene recorded during the historical shooting process; the augmented reality guide line is a virtual line generated based on the spatial anchor point data, which is used to mark the shooting parameters of the historical shooting scene in the real scene, such as composition method, focus position, etc.; the second wearable device refers to a wearable device with display function, such as smart glasses, which is used to display augmented reality guide lines.

[0112] When a user takes a photo, the spatial anchor point data of the historical shooting scene is obtained and matched with the current shooting scene. Then, augmented reality guide lines are generated based on the historical shooting parameters and superimposed on the real scene through a second wearable device to provide shooting guidance to the user.

[0113] For example, a user visits a scenic spot where they've previously taken excellent photos and wishes to retake a similar style. By matching the spatial anchor point data of the current scene with the historical photo, augmented reality guide lines are displayed on the user's smart glasses. These guide lines indicate information such as the composition, focus area, and exposure parameters used in the historical photo. The user can adjust their shooting position and parameters based on the guides, resulting in a high-quality photo that resembles the style of the historical photo.

[0114] Therefore, through augmented reality guide lines, historical shooting experience can be intuitively presented to users, helping users quickly master excellent shooting techniques and parameter settings, improve shooting quality, and also facilitate the inheritance and sharing of shooting experience.

[0115] In a possible embodiment, the electronic device is connected to the third wearable device and the fourth wearable device respectively, and the method further includes:

[0116] Acquire a second biosignal collected by the third wearable device and second eye movement information collected by the fourth wearable device;

[0117] generating second feedback information according to the second bio-signal and the second eye movement information;

[0118] Shooting prompt information is output according to first feedback information and the second feedback information, where the first feedback information is generated based on the first bio-signal and the first eye movement information.

[0119] The third wearable device and the fourth wearable device are two other wearable devices connected to the electronic device, respectively, for collecting the second biological signal and the second eye movement information; the third wearable device can be a smart bracelet or a smart watch; the fourth wearable device can be smart glasses or a smart helmet.

[0120] The second bio-signal refers to the user's physiological state data collected by the third wearable device; the second eye movement information refers to the user's eye movement data collected by the fourth wearable device; the first feedback information is generated based on the first bio-signal and the first eye movement information, and is used to reflect the attention level and emotional state of the user wearing the first wearable device and the second wearable device; the second feedback information is generated based on the second bio-signal and the second eye movement information, and is used to reflect the attention level and emotional state of the user wearing the third wearable device and the fourth wearable device; the shooting prompt information is generated based on the first feedback information and the second feedback information, and is used as advice information to guide the user to take pictures.

[0121] The third and fourth wearable devices collect the student's physiological and visual data, respectively, to generate second feedback information. The student's feedback information is compared and analyzed with the teacher's first feedback information to determine the consistency of the student's and the teacher's attention to the shooting scene. Then, shooting prompt information is output to help the student adjust his or her shooting strategy.

[0122] For example, in a market photography tutorial, the teacher wears a first and second wearable device, while the student wears a third and fourth wearable device. The teacher focuses on the fishmonger's facial expression when composing the shot, and the first feedback indicates a high degree of attention to the subject. The student initially focuses more on the lanterns in the background, and the second feedback indicates a high degree of attention to the background. Comparing the first and second feedback indicates a discrepancy between the teacher's and the student's focus. The system then generates a prompt, "Please shift your primary focus to the fishmonger," and displays it on the student's smart glasses, helping them adjust their shooting strategy in a timely manner.

[0123] Therefore, by comparing the attention status of teachers and students on the shooting scene in real time, accurate shooting prompt information is output to guide students to quickly grasp the shooting focus, improve learning efficiency, and avoid poor shooting results due to students focusing on the wrong areas.

[0124] Take photography teaching scene as an example, Figure 3 As shown, the following equipment is involved:

[0125] Electronic device 100: Student-side shooting device, responsible for performing shooting operations, receiving teaching instructions and feedback.

[0126] The first wearable device 200: a student-side biological signal collection device, which collects the student's skin conductance, heart rate and other physiological data to reflect the student's emotions during the shooting.

[0127] The second wearable device 300: an eye movement information collection device on the student side, which captures the student's gaze point, eye saccade frequency, pupil changes and other visual data, and presents the student's attention distribution when shooting.

[0128] The third wearable device 400: a teacher-side biological signal collection device, which collects the teacher's physiological data when demonstrating shooting.

[0129] The fourth wearable device 500 is an eye movement information collection device on the teacher's side, which records the teacher's eye movement trajectory, focus prediction and other visual strategies when shooting.

[0130] When shooting the actual bird fishing scene:

[0131] The third wearable device 400 collects biological signals when the teacher is shooting: for example, when the teacher predicts the moment when a bird dives to catch fish, the GSR rises sharply from the baseline 2μS to 5μS, and the heart rate rises from 70bpm to 95bpm. These data are uploaded to the teaching system and marked as physiological characteristics of "high-value shooting opportunity".

[0132] The fourth wearable device 500 records the teacher's eye movement information: the teacher's gaze remains fixed on the bird's trajectory, the frequency of saccades decreases, and the pupil dilates 0.8mm due to focusing. This eye movement trajectory is extracted as a template for the "precise focus path." Based on the teacher's data, an "optimal shooting timing-biosignal model" and a "precise focus-eye movement trajectory model" are constructed to serve as the basis for teaching judgment.

[0133] The first wearable device 200 collects the student's bio-signals in real time. The second wearable device 300 captures the student's eye movement information. If the student's gaze frequently deviates from the target, resulting in a chaotic eye movement trajectory, the teacher's "precise focus path" is used for comparison, and the electronic device 100 displays the message "Your gaze point is 30% off target."

[0134] Through the dual-dimensional perception of biosignals and eye movement information, abstract "photography experience" is transformed into a quantifiable and comparable data model, resolving the ambiguity of traditional teaching methods that rely solely on intuition and experience. This allows photography skills training to move from result feedback to process intervention, significantly improving teaching efficiency. It can also automatically generate customized training plans based on the differences in each student's biosignals and eye movement data.

[0135] In a possible embodiment, the electronic device is connected to the fourth wearable device, and the following steps may also be included:

[0136] Obtaining second eye movement information collected by the fourth wearable device;

[0137] generating visual deviation information according to the first eye movement information and the second eye movement information;

[0138] Output visual focus point prompt information according to the visual deviation information.

[0139] Visual deviation information: This is the difference in visual focus between the first and second eye movement data. Visual focus prompt information: This is generated based on visual deviation information. In teaching scenes, it is used to remind students to pay attention to the area the teacher is focusing on.

[0140] The first eye movement information and the second eye movement information are analyzed and calculated to obtain visual deviation information, and then visual focus point prompt information is generated according to the visual deviation information to prompt the students to adjust their sight and focus on the key shooting area that the teacher is concerned about.

[0141] For example, when filming a moving cart at a market, the teacher's first eye movement data shows that their gaze steadily follows the cart's direction of movement, while the student's second eye movement data shows that their gaze frequently deviates from the cart and wanders to surrounding stalls. After calculating the obvious visual deviation information, a visual focus prompt message is generated, "The teacher is steadily following the cart. Please pay attention to the subject's movement trajectory." This prompt appears in the student's smart glasses viewfinder in the form of a pop-up window. After receiving the prompt, the student focuses their gaze on the cart, imitating the teacher's focus tracking method.

[0142] Therefore, by timely discovering the differences in visual focus between teachers and students, and using prompts to help students quickly correct visual deviations, students can learn the teacher's techniques for capturing the subject and improve their ability to shoot dynamic scenes.

[0143] In a possible embodiment, a first eye movement trajectory is generated according to the first eye movement information, and a second eye movement trajectory is generated according to the second eye movement information;

[0144] determining a degree of overlap between the first eye movement trajectory and the second eye movement trajectory;

[0145] When the trajectory overlap is greater than or equal to a preset overlap, controlling the third wearable device to output a first prompt message;

[0146] When the trajectory overlap is less than the preset overlap, the third wearable device is controlled to output a second prompt message.

[0147] Track overlap: A numerical value that measures the similarity between the first and second eye movement tracks. Preset overlap: A pre-set threshold for determining track similarity. First prompt: A positive prompt output by a third wearable device when the track overlap is greater than or equal to the preset overlap. Second prompt: A reminder prompt output by a third wearable device when the track overlap is less than the preset overlap.

[0148] Determine the degree of overlap between the first eye movement trajectory and the second eye movement trajectory, generate eye movement trajectories for the teacher and the student respectively, calculate the degree of overlap between the two trajectories, compare the degree of overlap with the preset degree of overlap, and output different prompt information through the student's bracelet according to the comparison result to assist the student in adjusting the shooting behavior.

[0149] For example, when filming the fishmonger throwing a fish, the teacher's first eye movement trajectory is stably locked on the parabolic trajectory of the fish, while the second eye movement trajectory generated by the student deviates after the fish is thrown. The first eye movement trajectory is the eye movement trajectory generated by the teacher's smart glasses collecting eye movement information. The second eye movement trajectory is the eye movement trajectory generated by the student's smart glasses collecting eye movement information. If the calculated trajectory overlap is lower than the preset overlap, the student's wristband is controlled to output a second prompt message, prompting the student to adjust his or her line of sight. When the student's eye movement trajectory overlaps with the teacher's for more than the preset overlap for 5 seconds after adjustment, the wristband releases a positive incentive signal, giving the student positive feedback and reinforcing the correct shooting behavior.

[0150] If the student's eye movement trajectory is close to the teacher's template, combined with the bio-signals collected by the first wearable device 200, it is determined to be "close to the optimal shooting state." The electronic device 100 vibrates and a pop-up window appears: "Detected the optimal shooting time! Recommended to focus and shoot immediately," while automatically recommending a focus area.

[0151] If the student fails to take the photo in time due to delayed reaction, the teacher's data will be called up and the "teacher's best shooting moment" will be replayed through the electronic device 100 to show the teacher's GSR and heart rate change curves at that time, and superimpose the eye movement trajectory animation to help the student understand the timing and logic of shooting.

[0152] After the recording is complete, the teaching system generates a "Teacher-Student Data Comparison Report," which is displayed on electronic device 100. The report compares the GSR and heart rate curves of the student and teacher at the "optimal time," with the annotation "Your excitement phase is delayed by 0.3 seconds, requiring enhanced anticipation training." A heat map of the teacher and student eye movement trajectories is superimposed, with red areas marking student distractions and green areas highlighting the teacher's focus path, visually demonstrating differences in attention allocation.

[0153] Therefore, by quantifying the overlap between teachers' and students' eye movement trajectories and providing corresponding feedback, students can intuitively understand the differences between their own shooting behaviors and those of teachers, correct mistakes in a timely manner, strengthen correct shooting habits, and improve students' shooting skills in complex scenes.

[0154] In an embodiment of the present application, a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device are obtained. Since the collection frequency of the biosignal and eye movement information is high, a high-sensitivity response to instantaneous changes can be ensured. Through multimodal perception of physiology and vision, the user's subconscious physiological reaction is captured, which facilitates the advance prediction of the shooting intention. According to the first biosignal and the first eye movement information, the user's first feedback index is determined, and the vague shooting intention can be converted into a calculable numerical indicator, so as to achieve accurate quantification of the user's shooting intention, which is convenient for the subsequent determination of the shooting timing. When the first feedback index exceeds the preset threshold, it indicates that the user expects the shooting time, and at least one image is captured. Therefore, by perceiving the user's physiological state and visual state in real time, the shooting timing can be accurately grasped, and the image the user wants can be captured efficiently and accurately.

[0155] The shooting method provided in the embodiment of the present application can be executed by a shooting device. In the embodiment of the present application, the shooting method is executed by a shooting device as an example to illustrate the shooting device provided in the embodiment of the present application.

[0156] Figure 4 4 is a block diagram of a photographing device provided in an embodiment of the present application. The device 400 includes:

[0157] An acquisition module 410 is configured to acquire a first biosignal collected by the first wearable device and first eye movement information collected by the second wearable device;

[0158] a determination module 420, configured to determine a first feedback index of the user based on the first bio-signal and the first eye movement information;

[0159] The shooting module 430 is configured to capture at least one image when the first feedback index exceeds a preset threshold.

[0160] In one possible embodiment, the first biosignal includes: a skin conductance change rate and a heart rate value; the first eye movement information includes: a pupil diameter change amount and an eye saccade frequency; wherein the skin conductance change rate is used to represent environmental pressure, and the pupil diameter change amount is used to represent visual focus lock intensity; the determination module 420 is specifically used to:

[0161] Normalizing at least one of the skin conductance change rate and the heart rate value to obtain at least one biological parameter value;

[0162] Normalizing at least one of the pupil diameter change and the eye movement frequency to obtain at least one eye movement parameter value;

[0163] The at least one biological parameter value and the at least one eye movement parameter value are weighted to determine the first feedback index.

[0164] In a possible embodiment, the shooting module 430 is specifically configured to:

[0165] determining a first focus area based on the first eye movement information when the first feedback index exceeds a preset threshold;

[0166] Shooting is performed based on the first focus area to obtain at least one image.

[0167] In a possible embodiment, the shooting module 430 is specifically configured to:

[0168] determining, based on the first eye movement information, coordinate information of a gaze point, a dwell time of the gaze point, and a movement rate of the gaze point;

[0169] When the dwell time of the gaze point exceeds a preset time, generating an initial focus area according to the coordinate information of the gaze point;

[0170] The size of the initial focus area is adjusted according to the moving rate of the gaze point to obtain the first focus area.

[0171] In a possible embodiment, the shooting module 430 is specifically configured to:

[0172] When the moving speed is greater than a speed threshold, adjusting the initial size of the initial focus area to a first size to obtain the first focus area, wherein the first size is greater than the initial size; or

[0173] When the moving speed is less than the speed threshold, the initial size of the initial focus area is adjusted to a second size to obtain the first focus area, and the second size is smaller than the initial size.

[0174] In a possible embodiment, the shooting module 430 is specifically configured to:

[0175] The first eye movement information is input into an attention transfer model, and the first focus area is output.

[0176] In a possible embodiment, the apparatus 400 may further include:

[0177] a generating module, configured to generate feedback information based on the first bio-signal and the first eye movement information collected during the shooting process;

[0178] The determination module 420 further determines a target image from the at least one image according to the feedback information.

[0179] In a possible embodiment, the apparatus 400 may further include:

[0180] The acquisition module is used to obtain the spatial anchor point data of historical shooting scenes;

[0181] The generating module is further configured to generate an augmented reality guide line based on the spatial anchor point data of the historical shooting scene, wherein the augmented reality guide line is used to mark the shooting parameters of the historical shooting scene;

[0182] A display module is used to control the second wearable device to display the augmented reality guide line.

[0183] In a possible embodiment, the electronic device is connected to a third wearable device and a fourth wearable device respectively, and the acquisition module 410 is further configured to acquire a second biosignal acquired by the third wearable device and second eye movement information acquired by the fourth wearable device;

[0184] a generating module, further configured to generate second feedback information based on the second bio-signal and the second eye movement information;

[0185] The apparatus 400 may further include:

[0186] The output module is configured to output shooting prompt information according to the first feedback information and the second feedback information, wherein the first feedback information is generated based on the first biological signal and the first eye movement information.

[0187] In a possible embodiment, the electronic device is connected to a fourth wearable device, and the acquisition module 410 is further configured to acquire second eye movement information collected by the fourth wearable device;

[0188] a generating module, further configured to generate visual deviation information based on the first eye movement information and the second eye movement information;

[0189] The output module is further used to output visual focus point prompt information based on the visual deviation information.

[0190] In a possible embodiment, the generating module is further configured to generate a first eye movement trajectory according to the first eye movement information, and generate a second eye movement trajectory according to the second eye movement information;

[0191] The determination module 420 is further configured to determine a degree of overlap between the first eye movement trajectory and the second eye movement trajectory;

[0192] The apparatus 400 may further include:

[0193] a control module, configured to control the third wearable device to output a first prompt message when the trajectory overlap is greater than or equal to a preset overlap;

[0194] The control module is further configured to control the third wearable device to output a second prompt message when the trajectory overlap is less than the preset overlap.

[0195] In an embodiment of the present application, a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device are obtained. Since the collection frequency of the biosignal and eye movement information is high, a high-sensitivity response to instantaneous changes can be ensured. Through multimodal perception of physiology and vision, the user's subconscious physiological reaction is captured, which facilitates the advance prediction of the shooting intention. According to the first biosignal and the first eye movement information, the user's first feedback index is determined, and the vague shooting intention can be converted into a calculable numerical indicator, so as to achieve accurate quantification of the user's shooting intention, which is convenient for the subsequent determination of the shooting timing. When the first feedback index exceeds the preset threshold, it indicates that the user expects the shooting time, and at least one image is captured. Therefore, by perceiving the user's physiological state and visual state in real time, the shooting timing can be accurately grasped, and the image the user wants can be captured efficiently and accurately.

[0196] The shooting device in the embodiments of the present application can be an electronic device or a component of an electronic device, such as an integrated circuit or chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiments of the present application do not specifically limit this.

[0197] The shooting device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0198] The shooting device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be described here.

[0199] Alternatively, as Figure 5 As shown, an embodiment of the present application also provides an electronic device 510, including a processor 511, a memory 512, and a program or instruction stored in the memory 512 and executable on the processor 511. When the program or instruction is executed by the processor 511, each step of any of the above-mentioned shooting method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0200] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0201] Figure 6 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0202] The electronic device 600 includes but is not limited to components such as a radio frequency unit 601 , a network module 602 , an audio output unit 603 , an input unit 604 , a sensor 605 , a display unit 606 , a user input unit 607 , an interface unit 608 , a memory 609 , and a processor 610 .

[0203] Those skilled in the art will understand that the electronic device 600 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0204] The processor 610 is configured to obtain a first biosignal collected by the first wearable device and first eye movement information collected by the second wearable device;

[0205] The processor 610 is configured to determine a first feedback index of the user based on the first bio-signal and the first eye movement information;

[0206] The input unit 604 is configured to capture at least one image when the first feedback index exceeds a preset threshold.

[0207] Optionally, the first bio-signal includes: skin conductance change rate and heart rate value; the first eye movement information includes: pupil diameter change amount and eye saccade frequency; wherein the skin conductance change rate is used to represent environmental pressure, and the pupil diameter change amount is used to represent visual focus locking intensity;

[0208] The processor 610 is further configured to perform normalization processing on at least one of the skin conductance change rate and the heart rate value to obtain at least one biological parameter value;

[0209] The processor 610 is further configured to perform normalization processing on at least one of the pupil diameter change and the eye movement frequency to obtain at least one eye movement parameter value;

[0210] The processor 610 is further configured to perform weighted processing on the at least one biological parameter value and the at least one eye movement parameter value to determine the first feedback index.

[0211] Optionally, the processor 610 is further configured to determine a first focus area based on the first eye movement information when the first feedback index exceeds a preset threshold;

[0212] The input unit 604 is further configured to shoot based on the first focus area to obtain at least one image.

[0213] Optionally, the processor 610 is further configured to determine, based on the first eye movement information, coordinate information of a gaze point, a dwell time of the gaze point, and a movement rate of the gaze point;

[0214] The processor 610 is further configured to generate an initial focus area according to the coordinate information of the gaze point when the dwell time of the gaze point exceeds a preset time;

[0215] The processor 610 is further configured to adjust the size of the initial focus area according to the movement rate of the gaze point to obtain the first focus area.

[0216] Optionally, the processor 610 is further configured to, when the moving speed is greater than a speed threshold, adjust an initial size of the initial focus area to a first size to obtain the first focus area, where the first size is greater than the initial size;

[0217] The processor 610 is further configured to, when the moving rate is less than the rate threshold, adjust the initial size of the initial focus area to a second size to obtain the first focus area, where the second size is smaller than the initial size.

[0218] Optionally, the processor 610 is further configured to input the first eye movement information into an attention transfer model and output the first focus area.

[0219] Optionally, the processor 610 is further configured to generate feedback information according to the first bio-signal and the first eye movement information collected during the shooting process;

[0220] The processor 610 is further configured to determine a target image from the at least one image according to the feedback information.

[0221] Optionally, the processor 610 is further configured to obtain spatial anchor point data of historical shooting scenes;

[0222] The processor 610 is further configured to generate an augmented reality guide line based on the spatial anchor point data of the historical shooting scene, wherein the augmented reality guide line is used to mark the shooting parameters of the historical shooting scene;

[0223] The processor 610 is further configured to control the second wearable device to display the augmented reality guide line.

[0224] Optionally, the electronic device is connected to a third wearable device and a fourth wearable device respectively, and the processor 610 is further configured to obtain a second biosignal collected by the third wearable device and second eye movement information collected by the fourth wearable device;

[0225] The processor 610 is further configured to generate second feedback information according to the second bio-signal and the second eye movement information;

[0226] an audio output unit 603, configured to output shooting prompt information according to first feedback information and the second feedback information, wherein the first feedback information is generated based on the first bio-signal and the first eye movement information;

[0227] The display unit 606 is configured to output shooting prompt information according to the first feedback information and the second feedback information, where the first feedback information is generated based on the first bio-signal and the first eye movement information.

[0228] Optionally, the electronic device is connected to a fourth wearable device, and the processor 610 is further configured to obtain second eye movement information collected by the fourth wearable device;

[0229] The processor 610 is further configured to generate visual deviation information based on the first eye movement information and the second eye movement information;

[0230] The display unit 606 is configured to output shooting prompt information according to the first feedback information and the second feedback information, where the first feedback information is generated based on the first bio-signal and the first eye movement information.

[0231] Optionally, the processor 610 is further configured to generate a first eye movement trajectory according to the first eye movement information, and generate a second eye movement trajectory according to the second eye movement information;

[0232] The processor 610 is further configured to determine a degree of overlap between the first eye movement trajectory and the second eye movement trajectory;

[0233] The processor 610 is further configured to control the third wearable device to output a first prompt message when the trajectory overlap is greater than or equal to a preset overlap;

[0234] The processor 610 is further configured to control the third wearable device to output a second prompt message when the trajectory overlap is less than the preset overlap.

[0235] In an embodiment of the present application, a first biosignal collected by a first wearable device and first eye movement information collected by a second wearable device are obtained. Since the collection frequency of the biosignal and eye movement information is high, a high-sensitivity response to instantaneous changes can be ensured. Through multimodal perception of physiology and vision, the user's subconscious physiological reaction is captured, which facilitates the advance prediction of the shooting intention. According to the first biosignal and the first eye movement information, the user's first feedback index is determined, and the vague shooting intention can be converted into a calculable numerical indicator, so as to achieve accurate quantification of the user's shooting intention, which is convenient for the subsequent determination of the shooting timing. When the first feedback index exceeds the preset threshold, it indicates that the user expects the shooting time, and at least one image is captured. Therefore, by perceiving the user's physiological state and visual state in real time, the shooting timing can be accurately grasped, and the image the user wants can be captured efficiently and accurately.

[0236] It should be understood that in an embodiment of the present application, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes image data of a static picture or video image obtained by an image capture device (such as a camera) in a video image capture mode or an image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and at least one of other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an action stick, which will not be repeated here. The memory 609 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 610.

[0237] The memory 609 can be used to store software programs and various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 609 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0238] Processor 610 may include one or more processing units. Optionally, processor 610 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 610.

[0239] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0240] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0241] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0242] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0243] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0244] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0245] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0246] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A shooting method, characterized in that: Applied to an electronic device, the electronic device is connected to a first wearable device and a second wearable device respectively, and the method includes: Acquire a first biosignal collected by the first wearable device and first eye movement information collected by the second wearable device; determining a first feedback index of the user based on the first bio-signal and the first eye movement information; When the first feedback index exceeds a preset threshold, at least one image is captured.

2. The method according to claim 1, characterized in that The first biological signal includes: skin conductance change rate and heart rate value; The first eye movement information includes: pupil diameter change and eye saccade frequency; The skin conductance change rate is used to characterize the environmental pressure, and the pupil diameter change is used to characterize the visual focus locking strength; The determining a first feedback index of the user according to the first bio-signal and the first eye movement information includes: Normalizing at least one of the skin conductance change rate and the heart rate value to obtain at least one biological parameter value; Normalizing at least one of the pupil diameter change and the eye movement frequency to obtain at least one eye movement parameter value; The at least one biological parameter value and the at least one eye movement parameter value are weighted to determine the first feedback index.

3. The method according to claim 1, characterized in that The capturing of at least one image when the first feedback index exceeds a preset threshold value includes: determining a first focus area based on the first eye movement information when the first feedback index exceeds a preset threshold; Shooting is performed based on the first focus area to obtain at least one image.

4. The method according to claim 3, characterized in that The determining a first focus area based on the first eye movement information when the first feedback index exceeds a preset threshold includes: determining, based on the first eye movement information, coordinate information of a gaze point, a dwell time of the gaze point, and a movement rate of the gaze point; When the dwell time of the gaze point exceeds a preset time, generating an initial focus area according to the coordinate information of the gaze point; The size of the initial focus area is adjusted according to the moving rate of the gaze point to obtain the first focus area.

5. The method according to claim 4, characterized in that The adjusting the size of the initial focus area according to the movement rate of the gaze point to obtain the first focus area includes: When the moving speed is greater than a speed threshold, adjusting the initial size of the initial focus area to a first size to obtain the first focus area, wherein the first size is greater than the initial size; or When the moving speed is less than the speed threshold, the initial size of the initial focus area is adjusted to a second size to obtain the first focus area, and the second size is smaller than the initial size.

6. The method according to claim 3, characterized in that The determining a first focus area based on the first eye movement information includes: The first eye movement information is input into an attention transfer model, and the first focus area is output.

7. The method according to claim 1, characterized in that When the first feedback index exceeds a preset threshold, after capturing at least one image, the method further includes: generating feedback information according to the first bio-signal and the first eye movement information collected during the shooting process; A target image is determined from the at least one image according to the feedback information.

8. The method according to claim 1, characterized in that The method further comprises: Obtain spatial anchor point data of historical shooting scenes; generating an augmented reality guide line according to the spatial anchor point data of the historical shooting scene, wherein the augmented reality guide line is used to mark the shooting parameters of the historical shooting scene; Control the second wearable device to display the augmented reality guide line.

9. The method according to claim 1, characterized in that The electronic device is connected to a third wearable device and a fourth wearable device respectively, and the method further includes: Acquire a second biosignal collected by the third wearable device and second eye movement information collected by the fourth wearable device; generating second feedback information according to the second bio-signal and the second eye movement information; Shooting prompt information is output according to first feedback information and the second feedback information, where the first feedback information is generated based on the first bio-signal and the first eye movement information.

10. The method according to claim 1, characterized in that The electronic device is connected to a fourth wearable device, and the method further includes: Obtaining second eye movement information collected by the fourth wearable device; generating visual deviation information according to the first eye movement information and the second eye movement information; Output visual focus point prompt information according to the visual deviation information.

11. The method according to claim 9, characterized in that The method further comprises: generating a first eye movement trajectory according to the first eye movement information, and generating a second eye movement trajectory according to the second eye movement information; determining a degree of overlap between the first eye movement trajectory and the second eye movement trajectory; When the trajectory overlap is greater than or equal to a preset overlap, controlling the third wearable device to output a first prompt message; When the trajectory overlap is less than the preset overlap, the third wearable device is controlled to output a second prompt message.

12. A photographing device, characterized in that: Applied to the electronic device, the electronic device is connected to a first wearable device and a second wearable device respectively, and the device includes: an acquisition module, configured to acquire a first biosignal collected by the first wearable device and first eye movement information collected by the second wearable device; a determination module, configured to determine a first feedback index of the user based on the first bio-signal and the first eye movement information; The shooting module is used to shoot and obtain at least one image when the first feedback index exceeds a preset threshold.

13. The device according to claim 12, characterized in that The first biological signal includes: skin conductance change rate and heart rate value; The first eye movement information includes: pupil diameter change and eye saccade frequency; The skin conductance change rate is used to characterize the environmental pressure, and the pupil diameter change is used to characterize the visual focus locking strength; The determining module is specifically configured to: Normalizing at least one of the skin conductance change rate and the heart rate value to obtain at least one biological parameter value; Normalizing at least one of the pupil diameter change and the eye movement frequency to obtain at least one eye movement parameter value; The at least one biological parameter value and the at least one eye movement parameter value are weighted to determine the first feedback index.

14. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 11 are implemented.

Images