Photographing method and apparatus, and computer-readable medium and electronic device

Abstract

A photographing method and apparatus, and a computer-readable medium and an electronic device. The method comprises: determining the type of a target photographing control subject having an association relationship with a target object to be photographed, wherein the target photographing control subject is used for controlling a photographing operation of a camera; acquiring imaging information of the target photographing control subject, and generating a photographing control signal on the basis of the imaging information and the type of the target photographing control subject; and executing a corresponding photographing operation on the target object on the basis of the photographing control signal. In the technical solution provided in the embodiments of the present application, a camera can implement automatic photographing on the basis of a target object that needs to be photographed and a target photographing control body, without requiring a user to perform a manual operation for photographing, such that the user can use the camera for photographing in more scenarios, thereby expanding the usage scenarios of the camera and improving the user experience.

Description

Photographing method, apparatus, computer readable medium and electronic device

[0001] Cross-reference to related applications

[0002] The present disclosure claims priority to Chinese Patent Application No. 202410828745.0, filed on June 25, 2024, entitled “Photographing method, apparatus, computer readable medium and electronic device,” the entire contents of which are incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] The present disclosure belongs to the technical field of cameras, and specifically relates to a photographing method, apparatus, computer readable medium and electronic device. BACKGROUND

[0004] Photographing can form a long-term record of instantaneous events, which has become a necessary operation in people's daily life and work. In general, compared with the camera module integrated in the terminal device (such as a mobile phone), the camera specially used for photographing can obtain better photographing effect, and thus the camera is more loved by professionals.

[0005] Taking a smart camera similar to a Polaroid as an example, the smart camera integrates the functions of photographing and printing in a single camera device, and can complete the printing of a photo immediately. However, the photographing operation of the smart camera currently limits the use scenarios of the camera, such as the user needs to hold the camera to aim at the object to be photographed, and then press the photographing button on the camera to perform photographing.

[0006] SUMMARY

[0007] The present disclosure aims to provide a photographing method, apparatus, computer readable medium and electronic device.

[0008] Other characteristics and advantages of the present disclosure will become apparent from the following detailed description, or will be learned by practice of the present disclosure.

[0009] According to an aspect of an embodiment of the present disclosure, a photographing method is provided, comprising:

[0010] determining a type of a target photographing control subject associated with a target object to be photographed, wherein the target photographing control subject is used to control a photographing operation of a camera;

[0011] obtaining imaging information of the target photographing control subject, and generating a photographing control signal according to the imaging information and the type of the target photographing control subject;

[0012] performing a corresponding photographing operation on the target object according to the photographing control signal.

[0013] According to an aspect of some embodiments of the present disclosure, a photographing apparatus is provided, comprising:

[0014] a type determining module configured to determine a type of a target photographing control subject associated with a target object to be photographed, the target photographing control subject being configured to control a photographing operation of a camera;

[0015] a signal generating module configured to obtain imaging information of the target photographing control subject, and generate a photographing control signal according to the imaging information and the type of the target photographing control subject;

[0016] a photographing module configured to control the camera to perform a photographing operation according to the target photographing control subject and the target object.

[0017] In an embodiment of the present disclosure, the type determining module is specifically configured to:

[0018] obtain video stream data collected by the camera for the target object;

[0019] determine a type of the target object to be photographed according to the video stream data;

[0020] determine the type of the target photographing control subject according to the type of the target object and a preset object-subject mapping relationship, the preset object-subject mapping relationship indicating a mapping relationship between a photographing object type and a photographing control subject type.

[0021] In an embodiment of the present disclosure, the type determining module is specifically configured to:

[0022] determine the type of the target photographing control subject associated with the target object to be photographed according to a photographing mode selected by a user, the photographing mode at least including a single-gesture photographing mode, a multi-gesture photographing mode, a dynamic-gesture photographing mode, a predefined-gesture photographing mode, a marker tracking photographing mode, and a face recognition tracking photographing mode.

[0023] In an embodiment of the present disclosure, the type determining module is specifically configured to:

[0024] obtain face image data within a viewfinder range of the camera;

[0025] perform face feature extraction on the face image data to obtain to-be-identified face feature information;

[0026] if the to-be-identified face feature information is consistent with pre-stored face feature information, take an object corresponding to the to-be-identified face feature information as a target object, and determine a type of a target photographing control subject associated with the target object.

[0027] In one embodiment of the present disclosure, the signal generation module is specifically configured to:

[0028] determine a corresponding subject recognition algorithm according to the type of the target shooting control subject; the subject recognition algorithm at least includes one of a gesture recognition algorithm, a face recognition algorithm, and a marker recognition algorithm, or any combination thereof;

[0029] generate the shooting control signal when the target shooting control subject in the imaging information is identified as a specified shooting control subject through the subject recognition algorithm.

[0030] In one embodiment of the present disclosure, the signal generation module is specifically configured to:

[0031] identify a specified region in the imaging information through the subject recognition algorithm to determine the target shooting control subject contained in the imaging information; wherein the distance between the boundary of the specified region and the image contour of the target object is less than a first preset distance, or the distance between the boundary of the specified region and the specified part contour of the target object is less than a second preset distance.

[0032] In one embodiment of the present disclosure, the type of the target shooting control subject is a gesture; the type determination module is specifically configured to:

[0033] perform face recognition on the target object to record the region where the face of the target object is located;

[0034] detect the distance between the position where the target control subject is located and the region where the face is located when the target shooting control subject is identified according to the imaging information;

[0035] generate the shooting control signal when the distance is within a preset range.

[0036] In one embodiment of the present disclosure, the type of the target shooting control subject is a marker; the type determination module is specifically configured to:

[0037] establish a wireless connection with the wireless signal transmission module of the target shooting control subject when the target shooting control subject is detected according to the imaging information;

[0038] obtain the shooting control signal sent by the target shooting control subject through the wireless connection.

[0039] In one embodiment of the present disclosure, the type of the target shooting control subject is a gesture; the signal generation module is specifically configured to:

[0040] detect a first gesture action performed by the target object according to the imaging information;

[0041] When the second gesture action performed by the target object is detected within a preset time period after the first gesture action is detected, the shooting control signal is generated.

[0042] In one embodiment of the present disclosure, the target object is a plurality of target objects; and the signal generation module is specifically configured to:

[0043] identify a plurality of target shooting control subjects according to the imaging information and types of the target shooting control subjects;

[0044] calculate a ratio between the number of the control subjects and the number of the target objects;

[0045] generate the shooting control signal when the ratio is greater than a preset threshold.

[0046] In one embodiment of the present disclosure, the shooting control signal includes a focusing instruction and a shooting instruction; and the shooting module is specifically configured to:

[0047] perform a corresponding shooting operation on the target object according to the shooting instruction after performing a focusing operation on the target object according to the focusing instruction.

[0048] In one embodiment of the present disclosure, the target object is a plurality of target objects; and the shooting module is specifically configured to:

[0049] perform a focusing operation on each target object in sequence according to a shooting control signal generation time corresponding to each target object, and then perform a shooting operation on each target object; or

[0050] perform a focusing operation on each target object respectively, and then perform a shooting operation on the plurality of target objects as a whole.

[0051] In one embodiment of the present disclosure, the shooting module is further configured to:

[0052] control the camera to stop shooting when a stop shooting gesture is detected.

[0053] In one embodiment of the present disclosure, the shooting module is further configured to:

[0054] generate a lens movement instruction according to a movement path of the target object when the movement of the target object is detected;

[0055] control the lens of the camera to move according to the lens movement instruction, so that the target object is within the framing range of the camera during the shooting process.

[0056] According to an aspect of an embodiment of the present disclosure, a computer readable medium having a computer program stored thereon is provided, the computer program being executed by a processor to implement the shooting method in the above technical solutions.

[0057] According to an aspect of an embodiment of the present disclosure, an electronic device is provided, which includes a processor, and a memory storing executable instructions of the processor, wherein the processor executes the executable instructions to enable the electronic device to perform the photographing method in the above technical solutions.

[0058] According to an aspect of an embodiment of the present disclosure, a computer program product or computer program is provided, which includes computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to enable the computer device to perform the photographing method in the above technical solutions.

[0059] In the technical solution provided in the present disclosure, first, the type of a target photographing control subject having an association relationship with a target object that needs to be photographed is determined, wherein the target photographing control subject is used to control the photographing operation of a camera; then, the imaging information of the target photographing control subject is acquired, and a photographing control signal is generated according to the imaging information and the type of the target photographing control subject; finally, a corresponding photographing operation is performed on the target object according to the photographing control signal. In this way, the camera can realize automatic photographing based on the target object that needs to be photographed and the target photographing control subject, without the need for manual operation of the user, so that the user can use the camera to take pictures in more scenarios, expand the use scenarios of the camera, and improve the user experience.

[0060] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0061] The accompanying drawings, which are incorporated into and form part of the specification, illustrate one embodiment consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0062] FIG. 1 schematically shows a flowchart of a photographing method according to an embodiment of the present disclosure.

[0063] FIG. 2 schematically shows a flowchart of a photographing method according to an embodiment of the present disclosure.

[0064] FIG. 3 schematically shows a structural block diagram of a photographing device according to an embodiment of the present disclosure.

[0065] FIG. 4 schematically shows a structural block diagram of a computer system of an electronic device suitable for implementing an embodiment of the present disclosure. DETAILED DESCRIPTION

[0066] Example implementations will now be described more fully with reference to the accompanying drawings. Example implementations may, however, be implemented in many different forms and should not be construed as limited to the examples set forth herein; rather, these implementations are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example implementations to those skilled in the art.

[0067] Moreover, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the

[0068] The block diagrams in the drawings show only the functionality of the features and can not imply a physical or architectural arrangement of the features. That is, the functionality can be implemented in software, hardware, or a combination thereof. The functionality can be implemented in one or more modules or components, which can collect data and / or perform one or more operations.

[0069] The flow diagrams depicted herein are examples of sequences of operations that can be performed, for example, by a processor. The depicted examples are not meant to limit the scope of the disclosure in any way. One or more of the operations shown can be repeated, omitted, or performed in a different order. Further, examples of the flow diagrams can include additional operations, not shown, that are similar to the operations shown. For example, additional operations can include operations performed by different processors, or other operations performed by the same processor. In some examples, the operations can be performed by different processors or different processor cores at different times.

[0070] In the embodiments of the present disclosure, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works with other related parts to achieve a predetermined target, and can be implemented entirely or partially by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an integral module or unit that includes the functions of the module or unit.

[0071] When taking a picture using a camera, a user needs to hold the camera to aim at the object to be photographed, and then press a shutter button on the camera to take a picture. This makes the user who performs the picture taking operation unable to be photographed by the camera, and also makes the camera have to be carried by the user, and the user cannot perform the picture taking operation without the camera, thereby limiting the use scenarios of the camera. Based on the foregoing problem, the present disclosure provides a photographing method, which will be described in detail below in combination with specific embodiments.

[0072] Fig. 1 schematically shows a flow chart of a photographing method provided by one embodiment of the present disclosure, which can be implemented by a camera, such as a Polaroid camera. As shown in Fig. 1, the photographing method provided by the present embodiment includes steps 110 to 130, which are specifically as follows:

[0073] Step 110, determining a type of a target photographing control subject having an association relationship with a target object that needs to be photographed, wherein the target photographing control subject is used to control a photographing operation of the camera.

[0074] Specifically, the target object is a photographing object of the camera, which can be a person, an animal, an instrument, or any object that can be recorded by the camera. The target photographing control subject is an object used to control the photographing operation of the camera, which has multiple types, for example, the types of the target photographing control subject include a body posture, a facial expression, a hand gesture, a worn marker, and the like, and can also be a marker on other animals or articles, such as an animal name tag, a license plate, and the like.

[0075] In one embodiment of the present disclosure, a user can pre-store multiple facial feature information in the camera, for example, the user uses the camera to take a photograph of a specified person, the camera performs facial recognition on the photographed image, obtains facial feature information and stores it; or the user imports a facial image of a specified person into the camera, the camera performs facial recognition on the image, obtains facial feature information and stores it. The facial feature information can be used to distinguish different people. When photographing, the camera collects facial image data in the range of view and performs recognition on the facial image data to extract the to-be-identified facial feature information; then the to-be-identified facial feature information is compared with the pre-stored facial feature information, if they are consistent, the person corresponding to the to-be-identified facial feature information is taken as the target object; if they are not consistent, the corresponding person is not taken as the target object. In this way, the target object that needs to be photographed can be accurately confirmed, and the interference of other non-photographing related persons in the environment is excluded.

[0076] In one embodiment of the present disclosure, the type of the target photographing control subject can be determined according to the photographing mode set by the user on the camera, i.e., the type of the target photographing control subject associated with the target object to be photographed is determined according to the photographing mode selected by the user. Among them, the photographing mode defines the type of the subject triggering the photographing operation, i.e., the type of the target photographing control subject, for example, the photographing mode can include a single-gesture photographing mode, a multi-gesture photographing mode, a dynamic-gesture photographing mode, a pre-defined gesture photographing mode, a marker tracking photographing mode, and a face recognition tracking photographing mode, and other types of photographing modes can also be included based on user needs or design needs. The single-gesture photographing mode refers to a mode in which a single gesture action triggers the photographing operation, such as a single hand making a "V" shape. The multi-gesture photographing mode refers to a mode in which multiple gesture actions trigger the photographing operation, such as both hands making a "V" shape. The dynamic-gesture photographing mode refers to a mode in which a changing gesture action triggers the photographing operation, such as changing from a gesture making a number 1 to a gesture making a number 2. The pre-defined gesture photographing mode refers to a mode in which the user pre-sets or the camera pre-stores a related gesture action, and the photographing operation is triggered after the user performs the gesture action subsequently. The marker tracking photographing mode refers to a mode in which a certain specific marker triggers the photographing operation, which can also be referred to as a logo tracking photographing mode, such as an animal nameplate, a license plate, a specific marker worn by a person, etc. As an example, the specific marker can be a corporate logo or related graphics on a corporate t-shirt, or a nameplate or marker on a clothing item. The face recognition tracking photographing mode refers to a mode in which a face is recognized to trigger the photographing operation. The above-mentioned modes of triggering the photographing operation through various gestures can be collectively referred to as gesture photographing modes. Then according to the above-mentioned several photographing modes, the type of the target photographing control subject can be a gesture, a face, a marker, etc.

[0077] As a further specific example, in the logo tracking photographing mode, the nameplate or marker can also be integrated with a wireless signal transmission module, which has a photographing control signal transmission function and can be networked or paired with the camera. When the camera recognizes the corresponding logo within the viewfinder range, it can start network connection or pairing and automatically network or pair with the wireless transmission module of the marker. After that, the camera enters a wireless control photographing mode, and the user can output a photographing control signal by operating on the marker. The photographing control signal is transmitted to the camera end through wireless transmission, and then the camera performs the video recording or photographing function.

[0078] In one embodiment of the present disclosure, the type of the target shooting control subject can be actively identified by the camera, and the specific process includes: obtaining video stream data collected by the camera for the target object; determining the type of the target object that needs to be shot according to the video stream data; determining the type of the target shooting control subject according to the type of the target object and a preset object-subject mapping relationship. The camera can start to collect imaging information through the lens viewfinder. The multiple images collected in continuous time are the video stream data collected by the camera. When the target object needs to be shot, the images in the video stream collected by the camera usually include the target object. Therefore, the type of the target object can be determined by identifying the images in the video stream. For example, the type of the target object can be determined to be a person, an animal, a vehicle or other objects. According to the different types of the target object, the corresponding type of the target shooting control subject is naturally different. The camera can pre-store an object-subject mapping relationship, that is, a mapping relationship between the type of the shooting object and the type of the shooting control subject. Then, according to the type of the target object detected at present, the mapping relationship is queried to determine the type of the target shooting control subject. For example, when the type of the target object is detected to be a person, the type of the target shooting control subject can be determined to be a gesture, a posture or a facial expression. When the type of the target object is detected to be an animal, the type of the target shooting control subject can be determined to be an animal nameplate, an identification object worn by the animal or a specific action made by the animal. When the type of the target object is detected to be a vehicle, the type of the target shooting control subject can be determined to be a license plate, a vehicle logo, etc.

[0079] Step 120, obtaining imaging information of the target shooting control subject, and generating a shooting control signal according to the imaging information and the type of the target shooting control subject.

[0080] Specifically, the imaging information of the target shooting control subject is obtained by the camera lens collecting image data of the target object, such as the video stream data described above. The imaging information is mainly used to identify what the target shooting control subject is, such as what gesture, what facial expression, specific characters of the license plate number, etc. Generating a shooting control signal according to the imaging information and the type of the target shooting control subject means that whether the specific content of the target shooting control subject identified according to the imaging information is the subject content corresponding to the type of the target shooting control subject that triggers the shooting operation. If yes, a shooting control signal is generated, which can control the camera to perform the shooting operation. For example, if the type of the target shooting control subject is a gesture, the gesture that triggers the shooting operation can be a “V”-shaped gesture. According to the imaging information, whether the target shooting control subject is a “V”-shaped gesture is identified. If yes, a shooting control signal is generated.

[0081] Step 130, performing a corresponding shooting operation on the target object according to the shooting control signal.

[0082] Specifically, after the shooting control signal is generated, the camera executes the shooting control signal, that is, the shooting operation is performed on the target object. In this way, the user does not need to hold the camera and press the shutter button to be able to take a picture, and the user can place the camera in a certain position, and then realize automatic shooting through gestures, postures, facial expressions and the like, or realize conditional automatic shooting on other animals, vehicles or objects, etc., greatly expanding the application scenarios of the camera and improving the user experience.

[0083] In the technical solution provided by the embodiment of the present disclosure, first, the type of the target shooting control subject having an association relationship with the target object that needs to be shot is determined, wherein the target shooting control subject is used to control the shooting operation of the camera; then the imaging information of the target shooting control subject is acquired, and the shooting control signal is generated according to the imaging information and the type of the target shooting control subject; finally, the corresponding shooting operation is performed on the target object according to the shooting control signal. Therefore, the camera can realize automatic shooting based on the target object that needs to be shot and the target shooting control subject, without the need for manual operation of the user, so that the user can use the camera to shoot in more scenarios, thereby expanding the use scenarios of the camera and improving the user experience.

[0084] FIG. 2 schematically shows a flowchart of a shooting method provided by an embodiment of the present disclosure, which is a further refinement of the above-mentioned embodiment. As shown in FIG. 2, the shooting method provided by the embodiment includes the following steps:

[0085] Step 210, determining the type of the target shooting control subject having an association relationship with the target object that needs to be shot, wherein the target shooting control subject is used to control the shooting operation of the camera.

[0086] Step 220, acquiring the imaging information of the target shooting control subject.

[0087] Steps 210-220 are the same as the corresponding contents in steps 110-120 in the above-mentioned embodiment, and will not be described here again.

[0088] Step 230, determining the corresponding subject recognition algorithm according to the type of the target shooting control subject; the subject recognition algorithm at least includes a gesture recognition algorithm, a face recognition algorithm and a marker recognition algorithm.

[0089] Specifically, the subject recognition algorithm is used to identify the specific content of the target shooting control subject. The type of the target shooting control subject is different, and the corresponding subject recognition algorithm is also different. Therefore, the corresponding subject recognition algorithm needs to be determined according to the type of the target shooting control subject. In this embodiment, the subject recognition algorithm at least includes one of a gesture recognition algorithm, a face recognition algorithm and a marker recognition algorithm or any combination thereof. The gesture recognition algorithm is used to identify what gesture the target object performs as the target shooting control subject. For example, the gesture recognition algorithm is used to identify whether the target object performs a "V" shape gesture or a "√" shape gesture (a gesture formed by spreading the thumb and the index finger). Or, the gesture recognition algorithm is used to identify whether the target shooting control subject is a shooting control subject triggering a shooting operation. For example, the shooting control subject triggering the shooting operation is a "V" shape gesture. Then, the gesture recognition algorithm is used to identify whether the target object performs a "V" shape gesture. The face recognition algorithm is used to identify the facial expression of the target object. For example, the face recognition algorithm is used to identify whether the target object makes a smiling expression. The marker recognition algorithm is used to identify the marker content, such as the animal nameplate content, the license plate, the vehicle logo, etc. By associating the subject recognition algorithm with the type of the target shooting control subject, the target shooting control subject can be identified by using a more accurate algorithm. For example, it is determined that the type of the target shooting control subject is a gesture. Then, the gesture recognition algorithm is used instead of the face recognition algorithm or the marker recognition algorithm. Thus, more accurate identification information of the target shooting control subject can be obtained.

[0090] Step 240, when the target shooting control subject in the imaging information is identified as the specified shooting control subject by the subject recognition algorithm, a shooting control signal is generated.

[0091] Specifically, the specified shooting control subject is a shooting control subject triggering a shooting operation. When the target shooting control subject in the imaging information is identified as the specified shooting control subject, it means that the shooting operation can be performed. Thus, the shooting control signal is generated.

[0092] In one embodiment of the present disclosure, the specific process of identifying the target shooting control subject by the subject recognition algorithm is: identifying the specified region in the imaging information by the subject recognition algorithm to determine the target shooting control subject contained in the imaging information; wherein the distance between the boundary of the specified region and the image contour of the target object is less than a first preset distance, or the distance between the boundary of the specified region and the contour of the specified part of the target object is less than a second preset distance. For example, the specified region is a region within or near the image contour of the target object, or the specified region is a region within or near the contour of a specific part of the target object, such as a gesture within or near the contour of a human body, a license plate within or near the front and rear of a vehicle, an "eight" shape gesture near a face, etc.

[0093] Further, in another embodiment of the present disclosure, the target object can be first recognized by face recognition, and the face feature information can be recorded or temporarily stored, which can be used to distinguish different people. The face recognition can be combined with the recognition of the target photographing control subject to generate the photographing control signal. Specifically, the face feature information of each face in the camera viewfinder range can be extracted and recorded, and then when the photographing control gesture is recognized, the control gesture is determined to be close to the area where the previously recorded face feature information is located according to the recognized control gesture. If it is close, it is determined that the control gesture is valid, otherwise it is determined that the control gesture is invalid, and the photographing of the camera is not controlled until the valid photographing control gesture is recognized. In the case of photographing multiple people in a public place, in addition to the target photographing object, there are also other “strangers” in the place. The combination of gestures and face recognition can exclude the interference control of the camera by the strangers.

[0094] In one embodiment of the present disclosure, the type of the target photographing control subject is a gesture, and at this time, the photographing control signal can be generated according to single gesture recognition, multiple gesture recognition, static gesture recognition, dynamic gesture recognition, and self-defined gesture recognition based on the imaging information. Single gesture recognition refers to recognizing only one gesture action. Multiple gesture recognition refers to recognizing two or more gesture actions. Static gesture recognition refers to recognizing a gesture action that does not need to change in a short time, such as “OK” gesture, heart gesture, “eight”-shaped gesture, etc. In this case, the face position of the target object can be combined for recognition, such as the “eight”-shaped gesture close to the face. Dynamic gesture recognition refers to recognizing multiple gesture actions in a short time. Self-defined gesture recognition is to define the gesture action by the user in advance, and then perform recognition, for example, a person with a physical disability can define an irregular gesture action in advance, and then generate a photographing control signal through self-defined gesture recognition when photographing.

[0095] The generation process of the shooting control signal includes: detecting a first gesture action performed by the target object according to the imaging information; and generating the shooting control signal when a second gesture action performed by the target object is detected within a preset time period after the first gesture action is detected. Specifically, first, whether the target object performs the first gesture action is detected according to the imaging information. If the target object performs the first gesture action, it is continued to detect whether the target object performs the second gesture action within the preset time period. If yes, the shooting control signal is generated. If any of the foregoing conditions is not met, the shooting control signal is not generated. For example, if the user first performs a "V" gesture and then performs a "√" gesture within 2 seconds, the shooting control signal is generated. Otherwise, the shooting control signal is not generated. For another example, if the user changes from thumbs-up to thumbs-down within 1 second, the shooting control signal is generated.

[0096] In an embodiment of the present disclosure, when there are multiple target objects, each target object can have a corresponding target shooting control subject. In this case, the generation process of the shooting control signal includes: identifying multiple target shooting control subjects according to the imaging information and the type of the target shooting control subject; calculating the ratio between the number of control subjects and the number of target objects; and generating the shooting control signal when the ratio is greater than a preset threshold. For example, the type of the target shooting control subject is a gesture, and the gesture-to-head ratio is calculated. When the ratio exceeds a preset threshold (for example, 50%), the shooting control signal is generated.

[0097] Step 250: After performing the focusing operation on the target object according to the focusing instruction, performing the corresponding shooting operation on the target object according to the shooting instruction.

[0098] Specifically, the shooting control signal includes a focusing instruction and a shooting instruction. The focusing instruction is used to control the camera to focus on the target object, and the shooting instruction is used to control the camera to perform the shooting operation. Then, when the camera performs the shooting, it first focuses on the target object according to the focusing instruction, and then performs the shooting operation according to the shooting instruction, that is, performs the shooting operation, to achieve clear shooting of the target object. The focusing can be performed on part of the target object or the whole target object. For example, the focusing can be performed on the face of the target object, or the whole body of the target object, or in combination with a marker, the whole body of a person with a certain marker, the face of the person, or the marker itself.

[0099] In one embodiment of the present disclosure, when there are multiple target objects, the execution process of the focusing and shooting actions can be: focusing on each target object in turn and then performing the shooting operation. Specifically, the shooting control signal generation time corresponding to each target object actually reflects the execution time of the target shooting control subject corresponding to the target object, such as the gesture execution time of the target object. At this time, each target object can be focused and shot in turn according to the backward order of the gesture execution time of each target object, that is, each target object is focused and shot according to the order of the gestures.

[0100] In one embodiment of the present disclosure, when there are multiple target objects, the execution process of the focusing and shooting actions can be: focusing on each target object in turn and then performing the shooting operation. Specifically, the shooting control signal generation time corresponding to each target object actually reflects the execution time of the target shooting control subject corresponding to the target object, such as the gesture execution time of the target object. At this time, each target object can be focused and shot in turn according to the backward order of the gesture execution time of each target object, that is, each target object is focused and shot according to the order of the gestures.

[0101] In one embodiment of the present disclosure, during the shooting process, if a stop shooting gesture is detected, the camera is controlled to stop shooting. Optionally, during the shooting process, if other objects in the background environment perform the corresponding target shooting control subject, the camera is controlled to stop shooting to exclude the interference of the environment crowd. For example, when the target object is shooting in a park, other people in the background environment perform the relevant gesture to interfere with the shooting, and the camera is controlled to stop shooting. Alternatively, during the shooting process, the target object makes a gesture different from the shooting gesture, which is predefined as a stop shooting gesture, and the camera is controlled to stop shooting. For example, when shooting a group video, some people participating in the shooting are late and need to join the ongoing shooting. Then, any person in the framing frame makes a stop shooting gesture, and the current video recording is ended. After the latecomers are in place, a new video recording or photo shooting is started through the gesture control.

[0102] In one embodiment of the present disclosure, the camera can realize automatic tracking shooting, that is: when the movement of the target object is detected, a lens movement instruction is generated according to the movement path of the target object; and the lens of the camera is controlled to move according to the lens movement instruction, so that the target object is in the framing range of the camera during the shooting process. Specifically, during the movement of the target object, the camera lens can move synchronously with the target object, so that the target object is always in the framing range of the camera, and thus the target object can be shot at all times. For example, when the target object moves from the left side to the right side, the camera lens can follow the target object to move from the left side to the right side, realizing target dynamic locking. This process can realize face tracking shooting, animal / plant / object tracking shooting, specific person tracking shooting, vehicle license plate number tracking shooting, etc.

[0103] In the present disclosure, the photographing control signal specifically refers to a control signal for starting photographing, starting video recording, and the like, and controls the camera to perform a photographing action.

[0104] The technical solution provided by the embodiments of the present disclosure can realize object recognition / tracking, automatic focusing, automatic photographing, and the like, greatly enriches the use mode and use scenario of the camera, and makes the camera better meet the use demand of the user, thereby improving the user experience.

[0105] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired result. In addition or alternatively, some steps can be omitted, a plurality of steps can be combined into one step, and / or one step can be divided into a plurality of steps, and the like.

[0106] The device embodiments of the present disclosure are introduced below, which can be used to execute the photographing method in the above-mentioned embodiments of the present disclosure. FIG. 3 schematically shows a structural block diagram of a photographing device provided by the embodiments of the present disclosure. As shown in FIG. 3, the photographing device provided by the embodiments of the present disclosure comprises:

[0107] A type determiner 310 is configured to determine the type of a target photographing control subject associated with a target object that needs to be photographed, the target photographing control subject being used to control the photographing operation of the camera;

[0108] A signal generator 320 is configured to acquire imaging information of the target photographing control subject, and generate a photographing control signal according to the imaging information and the type of the target photographing control subject;

[0109] A photographer 330 is configured to control the camera to perform a photographing operation according to the target photographing control subject and the target object.

[0110] In an embodiment of the present disclosure, the type determiner 310 is specifically configured to:

[0111] acquire video stream data collected by the camera for the target object;

[0112] determine the type of the target object that needs to be photographed according to the video stream data;

[0113] determine the type of the target photographing control subject according to the type of the target object and a preset object-subject mapping relationship, the preset object-subject mapping relationship indicating a mapping relationship between a photographing object type and a photographing control subject type.

[0114] In an embodiment of the present disclosure, the type determiner 310 is specifically configured to:

[0115] determine a type of a target photographing control subject having a correlation with a target object to be photographed according to a photographing mode selected by a user; the photographing mode at least includes a single-gesture photographing mode, a multi-gesture photographing mode, a dynamic-gesture photographing mode, a predefined-gesture photographing mode, a marker tracking photographing mode, and a face recognition tracking photographing mode.

[0116] In an embodiment of the present disclosure, the type determiner 310 is specifically configured to:

[0117] obtain face image data within the camera viewfinder range;

[0118] perform face feature extraction on the face image data to obtain to-be-identified face feature information;

[0119] if the to-be-identified face feature information is consistent with pre-stored face feature information, an object corresponding to the to-be-identified face feature information is taken as a target object, and a type of a target photographing control subject having a correlation with the target object is determined.

[0120] In an embodiment of the present disclosure, the signal generator 320 is specifically configured to:

[0121] determine a corresponding subject identification algorithm according to the type of the target photographing control subject; the subject identification algorithm at least includes one of a gesture identification algorithm, a face recognition algorithm, and a marker identification algorithm, or any combination thereof;

[0122] generate the photographing control signal when the target photographing control subject in the imaging information is identified as a specified photographing control subject by the subject identification algorithm.

[0123] In an embodiment of the present disclosure, the signal generator 320 is specifically configured to:

[0124] identify a specified region in the imaging information by the subject identification algorithm to determine a target photographing control subject contained in the imaging information; wherein a distance between a boundary of the specified region and an image contour of the target object is less than a first preset distance, or a distance between a boundary of the specified region and a contour of a specified part of the target object is less than a second preset distance.

[0125] In an embodiment of the present disclosure, the type of the target photographing control subject is a gesture; the type determiner 310 is specifically configured to:

[0126] perform face recognition on the target object to record a region where a face of the target object is located;

[0127] When the target photographing control subject is identified according to the imaging information, a distance between a position where the target control subject is located and an area where the face is located is detected;

[0128] When the distance is within a preset range, the photographing control signal is generated.

[0129] In an embodiment of the present disclosure, the type of the target photographing control subject is a marker; the type determiner 310 is specifically configured as:

[0130] When the target photographing control subject is detected according to the imaging information, a wireless connection is established with a wireless signal transmitter of the target photographing control subject;

[0131] The photographing control signal transmitted by the target photographing control subject is acquired through the wireless connection.

[0132] In an embodiment of the present disclosure, the type of the target photographing control subject is a gesture; the signal generator 320 is specifically configured as:

[0133] A first gesture action performed by the target object is detected according to the imaging information;

[0134] When a second gesture action performed by the target object is detected within a preset time period after the first gesture action is detected, the photographing control signal is generated.

[0135] In an embodiment of the present disclosure, the target object is multiple; the signal generator 320 is specifically configured as:

[0136] A plurality of target photographing control subjects are identified according to the imaging information and the type of the target photographing control subject;

[0137] A ratio between a number of control subjects and a number of target objects is calculated;

[0138] When the ratio is greater than a preset threshold, the photographing control signal is generated.

[0139] In an embodiment of the present disclosure, the photographing control signal includes a focusing instruction and a photographing instruction; the photographer 330 is specifically configured as:

[0140] After a focusing operation on the target object is performed according to the focusing instruction, a corresponding photographing operation on the target object is performed according to the photographing instruction.

[0141] In an embodiment of the present disclosure, the target object is multiple; the photographer 330 is specifically configured as:

[0142] focus on each target object in sequence and then perform the photographing operation on the multiple target objects as a whole.

[0143] focus on each target object in sequence and then perform the photographing operation on the multiple target objects as a whole.

[0144] In an embodiment of the present disclosure, the photographing device 330 is further configured to:

[0145] When the stop photographing gesture is detected, the camera is controlled to stop photographing.

[0146] In an embodiment of the present disclosure, the photographing device 330 is further configured to:

[0147] When the target object is detected to move, a lens movement instruction is generated according to the movement path of the target object;

[0148] The lens of the camera is controlled to move according to the lens movement instruction, so that the target object is within the framing range of the camera during photographing.

[0149] The specific details of the photographing device provided in the embodiments of the present disclosure have been described in detail in the corresponding method embodiments, and will not be described here.

[0150] FIG. 4 schematically shows a computer system structure block diagram of an electronic device for implementing an embodiment of the present disclosure.

[0151] It should be noted that the computer system 400 of the electronic device shown in FIG. 4 is only an example, and should not bring any limitation to the functions and use range of the embodiments of the present disclosure.

[0152] As shown in FIG. 4, the computer system 400 includes a central processing unit 401 (CPU), which can perform various appropriate actions and processes according to programs stored in a read-only memory 402 (ROM) or loaded into a random access memory 403 (RAM) from a storage portion 408. In the random access memory 403, various programs and data required for system operation are also stored. The central processing unit 401, the read-only memory 402, and the random access memory 403 are connected to each other through a bus 404. An input / output interface 405 (I / O interface) is also connected to the bus 404.

[0153] The following components are connected to the input / output interface 405: an input portion 406 including input devices such as a keyboard and a mouse; an output portion 407 including output devices such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage portion 408 including a hard disk; and a communication portion 409 including a network interface card such as a Local Area Network card, a modem, and the like. The communication portion 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the input / output interface 405 as necessary. A removable media 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like is attached to the drive 410 as necessary, so that a computer program read therefrom is installed in the storage portion 408 as necessary.

[0154] In particular, according to embodiments of the present disclosure, the processes described in the various method flow diagrams can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for executing the methods illustrated by the flow diagrams. In such embodiments, the computer program can be downloaded and installed from a network via the communication portion 409, and / or installed from the removable media 411. When the computer program is executed by the central processing unit 401, various functions defined in the system of the present disclosure are executed.

[0155] It should be noted that the computer-readable medium in the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination thereof. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or apparatus. In the present disclosure, the computer-readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or apparatus. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, or the like, or any suitable combination thereof.

[0156] The flowcharts and block diagrams in the drawings illustrate the possible implementation architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment, or a portion of code that contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different orders than that shown in the drawings. For example, two blocks that are shown in succession can actually be executed substantially concurrently, or they can sometimes be executed in reverse order, depending on the involved functions. It should also be noted that each block in the block diagrams or flowcharts, and the combination of blocks in the block diagrams or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0157] It should be noted that, although several modules or units for a device for action execution are mentioned in the above detailed description, such a division is not mandatory. Indeed, according to an embodiment of the disclosure, the features and functionalities of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functionalities of one module or unit described above can be further divided into several modules or units embodied.

[0158] Those skilled in the art can easily understand, through the above description of the embodiments, that the example embodiments described herein can be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solutions according to the embodiments of the disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a U disk, a mobile hard disk, etc.) or a network, and includes several instructions to make a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) execute the methods according to the embodiments of the disclosure.

[0159] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. The disclosure is intended to cover any variations, uses, or adaptations of the disclosure following the general principles thereof and including such departures from the present disclosure that come within known

[0160] It should be understood that the present disclosure is not limited to the precise construction that has been described and shown in the accompanying drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present disclosure. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A photographing method, comprising: determining a type of a target photographing control subject associated with a target object to be photographed, wherein the target photographing control subject is used to control a photographing operation of a camera; obtaining imaging information of the target photographing control subject, and generating a photographing control signal according to the imaging information and the type of the target photographing control subject; performing a corresponding photographing operation on the target object according to the photographing control signal.

2. The photographing method according to claim 1, wherein The determination of the type of the target photographing control subject associated with the target object to be photographed comprises: obtaining video stream data collected by the camera for the target object; determining a type of the target object to be photographed according to the video stream data; determining the type of the target photographing control subject according to the type of the target object and a preset object-subject mapping relationship, wherein the preset object-subject mapping relationship indicates a mapping relationship between a photographing object type and a photographing control subject type.

3. The photographing method of claim 1, wherein, The determination of the type of the target photographing control subject associated with the target object to be photographed comprises: determining the type of the target photographing control subject associated with the target object to be photographed according to a photographing mode selected by a user, wherein the photographing mode at least comprises a single-gesture photographing mode, a multi-gesture photographing mode, a dynamic-gesture photographing mode, a predefined-gesture photographing mode, a marker tracking photographing mode, and a face recognition tracking photographing mode.

4. The photographing method of claim 1, wherein, The determination of the type of the target photographing control subject associated with the target object to be photographed comprises: obtaining face image data within a viewfinder range of the camera; performing face feature extraction on the face image data to obtain to-be-identified face feature information; if the to-be-identified face feature information is consistent with pre-stored face feature information, taking an object corresponding to the to-be-identified face feature information as a target object, and determining a type of a target photographing control subject associated with the target object.

5. The photographing method according to claim 1, wherein The generation of the photographing control signal according to the imaging information and the type of the target photographing control subject comprises: determining a corresponding subject recognition algorithm according to the type of the target photographing control subject, wherein the subject recognition algorithm at least comprises one of a gesture recognition algorithm, a face recognition algorithm, and a marker recognition algorithm, or any combination thereof; generating the photographing control signal when a target photographing control subject in the imaging information is identified as a specified photographing control subject by the subject recognition algorithm.

6. The photographing method according to claim 5, wherein After the determination of the corresponding subject recognition algorithm according to the type of the target photographing control subject, the method further comprises: identifying a specified region in the imaging information by the subject recognition algorithm to determine a target photographing control subject contained in the imaging information, wherein a boundary of the specified region is less than a first preset distance from an image contour of the target object, or a boundary of the specified region is less than a second preset distance from a specified part contour of the target object.

7. The photographing method according to claim 1, wherein The type of the target photographing control subject is a gesture, and the generation of the photographing control signal according to the imaging information and the type of the target photographing control subject comprises: perform face recognition on the target object to record a region where a face of the target object is located; detect a distance between a position where the target control subject is located and the region where the face is located when the target photographing control subject is recognized according to the imaging information; generate the photographing control signal when the distance is within a preset range.

8. The photographing method of claim 1, wherein, The type of the target photographing control subject is a marker. generating a photographing control signal according to the imaging information and the type of the target photographing control subject, including: establishing a wireless connection with a wireless signal transmission module of the target photographing control subject when the target photographing control subject is detected according to the imaging information; obtaining the photographing control signal sent by the target photographing control subject through the wireless connection.

9. The photographing method of claim 1, wherein, The type of the target photographing control subject is a gesture. generating a photographing control signal according to the imaging information and the type of the target photographing control subject, including: detecting a first gesture action performed by the target object according to the imaging information; generating the photographing control signal when a second gesture action performed by the target object is detected within a preset time period after the first gesture action is detected.

10. The photographing method of claim 1, wherein, The target object is multiple; generating a photographing control signal according to the imaging information and the type of the target photographing control subject, including: identifying multiple target photographing control subjects according to the imaging information and the type of the target photographing control subject; calculating a ratio between the number of control subjects and the number of target objects; generating the photographing control signal when the ratio is greater than a preset threshold.

11. The photographing method of claim 1, wherein, The photographing control signal includes a focusing instruction and a photographing instruction; performing a corresponding photographing operation on the target object according to the photographing control signal, including: performing a corresponding photographing operation on the target object according to the photographing instruction after performing a focusing operation on the target object according to the focusing instruction.

12. The photographing method of claim 1, wherein, The target object is multiple; performing a corresponding photographing operation on the target object according to the photographing control signal, including: generating a time according to the photographing control signal of each target object, and performing a photographing operation on each target object in turn after focusing; or performing a photographing operation on multiple target objects as a whole after focusing on each target object respectively.

13. The photographing method of claim 1, wherein, In the process of performing a corresponding photographing operation on the target object according to the photographing control signal, the method further includes: stopping photographing when a stop photographing gesture is detected.

14. The photographing method of claim 1, wherein, In the process of performing a corresponding photographing operation on the target object according to the photographing control signal, the method further includes: generating a lens movement instruction according to a movement path of the target object when the movement of the target object is detected; controlling the lens of the camera to move according to the lens movement instruction, so that the target object is within the framing range of the camera during photographing.

15. A photographing device, comprising: a type determiner configured to determine a type of a target photographing control subject having an association relationship with a target object that needs to be photographed, the target photographing control subject being used to control a photographing operation of a camera; A signal generator configured to acquire imaging information of the target photographing control subject, and generate a photographing control signal according to the imaging information and a type of the target photographing control subject; A photographing device configured to control the camera to perform a photographing operation according to the target photographing control subject and the target object. 16.A computer readable medium having stored thereon a computer program, which, when executed by a processor, implements the photographing method of any one of claims 1-14. 17.An electronic device, comprising: a processor; and a memory configured to store executable instructions of the processor; wherein the processor is configured to execute the executable instructions to enable the electronic device to implement the photographing method of any one of claims 1-14. 18.[Amended according to Rule 26 01.07.2025] A computer program product, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium; A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to enable the computer device to implement the photographing method of any one of claims 1-14. ​

Images