A camera shooting control method, device, equipment and storage medium

Abstract

This application discloses a camera shooting control method, device, equipment, and storage medium. The technical solution provided in this application acquires a first image captured by a camera module in a first field-of-view mode, performs target recognition on the first image to obtain a target recognition result, and determines the target in the first image based on the target recognition result. When the target position in the first image is outside a preset area of ​​the first image, the camera module is controlled to switch from the first field-of-view mode to a second field-of-view mode, and the camera module is controlled to turn towards the direction corresponding to the target position via a camera pan-tilt unit. This acquires a first target image captured by the camera module in the second field-of-view mode. Image recognition processing can be performed on the first target image, improving the pixel density and clarity of the captured image, enhancing image recognition accuracy, improving image recognition results, and optimizing the user experience.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a camera shooting control method, apparatus, device, and storage medium. Background Technology

[0002] With the development of computer technology, electronic devices are becoming more and more diverse in form and use. In order to improve students' learning efficiency and quality, learning machines are offering more and more functions, and more and more users are using learning machines for learning.

[0003] Currently, in order to cover a larger desktop work environment for users and allow books, test papers, and other items to be placed more freely on the desktop, thereby improving the user experience, learning machines generally increase the field of view (FOV) of the camera module. However, a larger FOV means a decrease in pixel density, which is more severe in the far field of view. The image clarity outside the center area of ​​the screen decreases significantly, resulting in a decrease in image recognition accuracy, poor image recognition results, and a poor user experience. Summary of the Invention

[0004] This application provides a camera shooting control method, device, equipment, and storage medium to solve the technical problem in related technologies that the use of camera modules with a large field of view leads to a significant decrease in image clarity outside the center area of ​​the image, a decrease in image recognition accuracy, poor image recognition results, and a poor user experience. It can improve the image clarity of the captured image, improve the accuracy of image recognition, enhance image recognition results, and optimize the user experience.

[0005] In a first aspect, embodiments of this application provide a camera shooting control method, applied to a camera shooting control device, the camera shooting control device including a camera module and a camera pan / tilt unit, the camera module being mounted on the camera pan / tilt unit, including:

[0006] Acquire the first image captured by the camera module in the first field of view mode;

[0007] The first image is subjected to target recognition to obtain target recognition results, and the target in the first image is determined based on the target recognition results;

[0008] When the target position of the identified target on the first image is outside the preset area of ​​the first image, the camera module is controlled to switch from a first field of view mode to a second field of view mode, and the camera module is controlled to turn towards the direction corresponding to the target position through the camera pan-tilt unit. In the first field of view mode, the pixel density of the camera module in the preset area is higher than the pixel density in the non-preset area. The focal length of the camera module in the first field of view mode is smaller than the focal length in the second field of view mode. The field of view of the first field of view mode is larger than the field of view of the second field of view mode.

[0009] The first target image captured by the camera module in the second field of view mode is acquired, and the first target image is used for image recognition processing.

[0010] In a second aspect, embodiments of this application provide a camera shooting control device, applied to a camera shooting control equipment. The camera shooting control equipment includes a camera module and a camera pan-tilt unit. The camera module is mounted on the camera pan-tilt unit and includes a first shooting module, a target recognition module, a mode conversion module, and a second shooting module, wherein:

[0011] The first shooting module is configured to acquire a first image captured by the camera module in a first field of view mode;

[0012] The target recognition module is configured to perform target recognition on the first image to obtain a target recognition result, and determine the target in the first image based on the target recognition result;

[0013] The mode switching module is configured to control the camera module to switch from a first field of view mode to a second field of view mode when the target position of the identified target on the first image is outside a preset area of ​​the first image, and to control the camera module to turn towards the direction corresponding to the target position through the camera pan-tilt unit. In the first field of view mode, the pixel density of the camera module in the preset area is higher than the pixel density in the non-preset area, the focal length of the camera module in the first field of view mode is less than the focal length in the second field of view mode, and the field of view of the first field of view mode is greater than the field of view of the second field of view mode.

[0014] The second shooting module is configured to acquire a first target image captured by the camera module in a second field of view mode, and the first target image is used for image recognition processing.

[0015] In a third aspect, embodiments of this application provide a camera shooting control device, including: a memory and one or more processors;

[0016] The memory is used to store one or more programs;

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the camera shooting control method as described in the first aspect.

[0018] In a fourth aspect, embodiments of this application provide a storage medium for storing computer-executable instructions, which, when executed by a computer processor, are used to perform the camera shooting control method as described in the first aspect.

[0019] This application embodiment acquires a first image captured by a camera module in a first field-of-view mode, performs target recognition on the first image to obtain a target recognition result, and determines the target in the first image based on the target recognition result. When the target position of the target in the first image is outside a preset area of ​​the first image, the camera module is controlled to switch from the first field-of-view mode to a second field-of-view mode, and the camera module is controlled to turn towards the direction corresponding to the target position via a camera pan-tilt unit, acquiring the first target image captured by the camera module in the second field-of-view mode. Image recognition processing can be performed on the first target image. Since the camera module... In the first field of view mode, the pixel density in the preset area is higher than that in the non-preset area. The focal length of the camera module in the first field of view mode is shorter than that in the second field of view mode. The field of view of the first field of view mode is greater than that of the second field of view mode. By obtaining a larger field of view in the first field of view mode, a larger recognition range can be achieved. When the target to be recognized is in a low pixel density position, the camera module can switch to the second field of view mode and turn towards the target to improve the pixel density and clarity of the captured image, improve the image recognition accuracy, improve the image recognition results, and optimize the user experience. Attached Figure Description

[0020] Figure 1 This is a flowchart of a camera shooting control method provided in an embodiment of this application;

[0021] Figure 2 This is a schematic diagram illustrating the positional relationship between a camera shooting control device and a camera module, provided in an embodiment of this application.

[0022] Figure 3 This is a schematic diagram of the camera module rotation of a camera shooting control device provided in an embodiment of this application;

[0023] Figure 4 This is a schematic diagram of a shooting in a second field of view mode provided in an embodiment of this application;

[0024] Figure 5This is a schematic diagram of a shooting in a first field of view mode provided in an embodiment of this application;

[0025] Figure 6 This is a flowchart of another camera shooting control method provided in the embodiments of this application;

[0026] Figure 7 This is a schematic diagram of the internal structure of a camera module provided in an embodiment of this application;

[0027] Figure 8 This is a schematic diagram of the structure of a camera shooting control device provided in an embodiment of this application;

[0028] Figure 9 This is a schematic diagram of the structure of a camera shooting control device provided in an embodiment of this application. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely for explaining this application and not for limiting it. It should also be noted that, for ease of description, only the parts relevant to this application are shown in the drawings, not all of them. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but additional steps not included in the drawings may also be present. The above processes can correspond to methods, functions, procedures, subroutines, subroutines, etc.

[0030] Figure 1 A flowchart of a camera shooting control method provided in an embodiment of this application is given. The camera shooting control method provided in this embodiment of the application can be executed by a camera shooting control device, which can be implemented by hardware and / or software and integrated into a camera shooting control device.

[0031] The camera shooting control method provided in this application can be applied to camera shooting control devices, which can be devices equipped with cameras, such as learning machines, tutoring machines, and tablets. These devices can be portable devices, or they can be devices that are inconvenient to move and are mainly placed on a desktop or fixed to a non-horizontal surface, such as large-screen tablets. Figure 2 A schematic diagram showing the positional relationship between a camera shooting control device and a camera module is provided, and as follows: Figure 3The provided diagram illustrates the camera module rotation of a camera shooting control device. The device includes a memory (not shown), one or more processors (not shown), a camera module (Figure 2), and a camera pan-tilt unit (not shown). The camera pan-tilt unit can be implemented using a piezoelectric motor, stepper motor, semi-circular VCM (Voice Coil Motor), SMA (Shape Memory Alloy) motor, etc. The camera pan-tilt unit is mounted on the body of the camera shooting control device (Figure 1), and the camera module is mounted on the camera pan-tilt unit. The camera module and camera pan-tilt unit are electrically connected to one or more processors. The camera shooting control device provided in this solution may also include a display screen, which is electrically connected to one or more processors. The display screen can be used to display answer explanations, interactive interfaces, etc. The camera shooting control device provided in this solution may also include a posture detection camera module, which is electrically connected to one or more processors. The posture detection camera module can be used to detect the user's posture and perform preset operations based on the detected user posture.

[0032] In one embodiment, the camera module can be rotated by a camera pan-tilt unit to shoot in different directions. For example, one or more processors can send control commands to the camera pan-tilt unit to control the up-down and left-right rotation of the camera module, switch the camera module between a first field-of-view mode and a second field-of-view mode, and adjust shooting parameters (such as frame rate, resolution, etc.) and control the camera module to shoot based on the shooting parameters. Different shooting parameters can be configured for different field-of-view modes.

[0033] In this design, the focal length of the camera module in the first field-of-view mode is shorter than that in the second field-of-view mode, while the field of view in the first mode is larger than that in the second mode. Furthermore, the pixel density in the preset area of ​​the camera module is higher in the first field-of-view mode than in the non-preset area. This results in images captured in the first field-of-view mode having a wider field of view compared to images captured in the second mode. Additionally, the higher pixel density and sharpness of images captured in the preset area allow for better image recognition within that area. The preset area can be the central region of the captured image.

[0034] The following description uses the camera shooting control device to execute the camera shooting control method as an example. (Refer to...) Figure 1 The camera's shooting control method includes:

[0035] S110: Acquire the first image captured by the camera module in the first field of view mode.

[0036] For example, the camera module is controlled to operate in a first field-of-view mode, and one or more first images are captured in the first field-of-view mode. Since the first image is captured in the first field-of-view mode, the pixel density of the camera module in the first field-of-view mode is higher in a preset area than in a non-preset area, the focal length of the camera module in the first field-of-view mode is shorter than the focal length in the second field-of-view mode, the range displayed by the first image is larger, and the clarity of the first image is higher within the preset area.

[0037] In one embodiment, multiple images can be captured in a first field-of-view mode, and the sharpness of each image can be determined. The image with the highest sharpness can be used as the first image to improve the accuracy of image recognition.

[0038] S120: Perform target recognition on the first image to obtain the target recognition result, and determine the target in the first image based on the target recognition result.

[0039] For example, target recognition is performed on the first image to determine the target recognition result in the first image. The recognition icon can be one or more combinations of objects such as a finger, pen, book, exam paper, question, or notes in the first image. Optionally, the target recognition result can be obtained by performing target recognition on the first image using a trained image recognition model.

[0040] In one embodiment, after recognizing the target recognition result in the first image, one or more recognition targets in the first image can be determined based on the target recognition result. For example, the type corresponding to the recognition target, the target position of the recognition target in the first image (e.g., the coordinate point of the recognition target (e.g., the coordinate point of the fingertip, pen tip), the coordinate of the positioning box, etc.) can be determined.

[0041] S130: When the target position of the identified target in the first image is outside the preset area of ​​the first image, control the camera module to switch from the first field of view mode to the second field of view mode, and control the camera module to turn towards the direction corresponding to the target position through the camera pan-tilt unit.

[0042] For example, it can be determined whether the target position of the target on the first image is located within a preset area of ​​the first image, such as determining whether the coordinates of the fingertip or pen tip are within the preset area of ​​the first image.

[0043] In one embodiment, such as Figure 4As shown in the provided schematic diagram of shooting in a second field of view mode, when the target position in the first image is outside a preset area of ​​the first image, since the target to be identified is located in an area with low pixel density, it is necessary to switch to the second field of view mode to image the target in a high pixel density area, thereby improving the clarity of the target in the captured image. Based on this, the camera module can be controlled to switch from the first field of view mode to the second field of view mode, and the camera pan-tilt unit can be used to control the camera module to turn towards the direction corresponding to the target position, so that the camera module can capture images of the target in the second field of view mode.

[0044] S140: Acquire the first target image captured by the camera module in the second field of view mode. The first target image is used for image recognition processing.

[0045] For example, after switching the camera module from a first field-of-view mode to a second field-of-view mode and controlling the camera module to turn towards the direction corresponding to the target position, the camera module is controlled to capture a first target image in the second field-of-view mode. At this time, a preset image recognition process can be performed on the first target image. For example, the question in the first target image can be identified, and the answer analysis corresponding to the identified question can be determined. The answer analysis can be displayed on the display screen of the camera shooting control device.

[0046] Optionally, after acquiring the first target image captured by the camera module in the second field of view mode, the camera module can be controlled to switch back from the second field of view mode to the first field of view mode, and the camera module can be turned back to its original direction by the camera gimbal to continue waiting for the next image capture and target recognition with a larger field of view.

[0047] In one possible embodiment, after determining the target in the first image based on the target recognition result, the camera shooting control method provided by this solution further includes: maintaining the camera module in the first field of view mode when the target position of the target in the first image is within a preset area of ​​the first image; acquiring a second target image captured by the camera module in the first field of view mode, the second target image being used for image recognition processing.

[0048] For example, such as Figure 5As shown in the provided schematic diagram of shooting in the first field of view mode, when the target position of the identified target in the first image is within a preset area of ​​the first image, the identified target is located in a region with high clarity in the first image, which can achieve high-quality image recognition. The camera module can be kept in the first field of view mode and a second target image captured by the camera module in the first field of view mode can be acquired. The second target image is used for image recognition processing, such as identifying questions in the second target image and determining the answer analysis corresponding to the identified questions. The answer analysis can be displayed on the display screen of the camera shooting control device.

[0049] This solution maintains the camera module in the first field of view mode when the target position on the first image is within a preset area of ​​the first image, and captures a second target image in the first field of view mode for image recognition processing. This achieves a larger recognition range while ensuring high image recognition quality.

[0050] For example, the learning machine can first use the first field of view mode to recognize the desktop scene. When the target, such as a book or test paper, is placed in the preset area (e.g., pointing a finger to the question to be recognized via finger pointing), the pixel density ensures clarity and recognition accuracy, maintaining the first field of view mode. When the content to be recognized is located in an area with low pixel density or clarity (i.e., outside the preset area), the camera pan-tilt unit and camera module are activated to switch to a smaller second field of view mode. This rotates the camera module's recognition area to the corresponding area of ​​the target, improving pixel density and clarity, and enhancing recognition accuracy. The learning machine combines the two modes of large and small field of view, balancing a wide recognition range and high recognition rate in various scenarios, effectively improving the user experience.

[0051] As described above, by acquiring a first image captured by the camera module in a first field-of-view mode, target recognition is performed on the first image to obtain a target recognition result, and the target in the first image is determined based on the target recognition result. When the target position of the target in the first image is outside a preset area of ​​the first image, the camera module is controlled to switch from the first field-of-view mode to the second field-of-view mode, and the camera module is controlled to turn towards the direction corresponding to the target position via the camera pan-tilt unit, acquiring a first target image captured by the camera module in the second field-of-view mode. Image recognition processing can be performed on the first target image. Since the camera module in the first field-of-view mode... In the field-of-view mode, the pixel density in the preset area is higher than that in the non-preset area. The focal length of the camera module in the first field-of-view mode is shorter than that in the second field-of-view mode. The field of view of the first field-of-view mode is larger than that of the second field-of-view mode. By using the camera module in the first field-of-view mode, a larger field of view can be obtained, thus achieving a larger recognition range. When the target to be recognized is in a low pixel density position, the camera module can switch to the second field-of-view mode and turn towards the target to improve the pixel density and clarity of the captured image, thereby improving the accuracy of image recognition, enhancing the image recognition results, and optimizing the user experience.

[0052] Based on the above embodiments, Figure 6 A flowchart of another camera shooting control method provided in an embodiment of this application is given, which is a concretization of the above-described camera shooting control method. (Reference) Figure 6 The camera's shooting control method includes:

[0053] S210: Receives a query command from the user and, in response to the query command, acquires the first image captured by the camera module in the first field of view mode.

[0054] For example, when a user needs to obtain information related to specific content (such as the answer explanation for a specific question), they can issue a query command. Optionally, the query command can be issued via voice, preset function keys, etc. Optionally, the camera shooting control device receives sound in real time through a microphone and detects whether there is a preset voice in the received sound, such as "How to do this question?".

[0055] In one embodiment, upon receiving a query command from a user, the camera module can acquire a first image captured in a first field-of-view mode in response to the query command. For example, a user can point to a question on a test paper with their finger or pen tip and say the query command "How do I do this question?" The camera module will then be controlled to capture a first image in the first field-of-view mode in response to this query command. This solution allows the camera module to quickly capture a first image in the first field-of-view mode via a query command when a user needs to query information related to a specific target, providing richer camera capture control methods and further enhancing the user experience.

[0056] S220: Perform target recognition on the first image to obtain target recognition results, and determine the target in the first image based on the target recognition results.

[0057] S230: When the target position of the identified target in the first image is outside the preset area of ​​the first image, the axial distance between the first lens group and the second lens group in the camera module is increased by the lens driving component, and the camera module is turned to the direction corresponding to the target position by the camera gimbal.

[0058] like Figure 7 A schematic diagram of the internal structure of a camera module is provided. The camera module provided in this solution includes a lens driving component (not shown in the figure) and an image sensor (CMOS sensor), a second lens group (lens group 2 in the figure), and a first lens group (lens group 1 in the figure), arranged sequentially. The second and first lens groups can be composed of one or more lenses. The first and second lens groups can move axially relative to each other to change the axial distance (distance D in the figure) between them. The lens driving component can be used to control the axial distance between the first and second lens groups. The lens driving component can be based on a piezoelectric motor, a stepper motor, a semi-circular VCM motor, an SMA motor, etc.

[0059] Specifically, when the axial distance between the first and second lens groups changes, the field of view (FOV) of the camera module also changes synchronously. When the axial distance between the first and second lens groups increases, the focal length of the camera module becomes longer, the field of view becomes smaller, and the field of view of the camera module changes towards the second field of view mode. Conversely, when the axial distance between the first and second lens groups decreases, the focal length of the camera module becomes shorter, the field of view becomes larger, and the field of view of the camera module changes towards the first field of view mode. The first and second field of view modes can correspond to different axial distances of the lens groups, with the axial distance of the first field of view mode being smaller than that of the second field of view mode.

[0060] Optionally, when a query command is received from a user, if the camera module is not in the first field of view mode, the axial distance between the first lens group and the second lens group in the camera module can be reduced by the lens driving component to enable the camera module to enter the first field of view mode, and then the first image captured by the camera module in the first field of view mode can be acquired.

[0061] For example, when the target location in the first image is outside a preset area of ​​the first image, the axial distance between the first lens group and the second lens group in the camera module is increased by the lens driving component, so that the camera module enters a second field of view mode, and the camera module is turned to face the direction corresponding to the target location by the camera pan-tilt unit. After the camera module enters the second field of view mode and turns to face the direction corresponding to the target location, the first image is captured by the camera module in the first field of view mode.

[0062] This solution employs a two-segment field-of-view design for the lens of a single camera module. By utilizing a lens driving component to change the axial distance between the first and second lens groups in the camera module, the camera module can flexibly switch between the first and second field-of-view modes. Combined with the camera pan-tilt unit to control the up-down and left-right rotation of the camera module, it can meet the requirements of a large recognition range and high recognition rate in the working scenario.

[0063] In one possible embodiment, the camera module provided by this solution is movably mounted in a camera shooting control device via a lifting mechanism. This lifting mechanism can be electrically connected to one or more processors. The lifting mechanism can be used to control the camera module to be housed within the camera shooting control device or to extend beyond the camera shooting control device. When the camera module is not needed, it can be housed within the camera shooting control device via the lifting mechanism; when it is needed, it can extend beyond the camera shooting control device via the lifting mechanism. In one embodiment, a lens driving component is connected to a second lens group to drive the second lens group to move closer to or further away from the first lens group. For example, when the camera module is in a first field-of-view mode, the outer surface of the second lens group is flush with the outer panel of the camera module; when the camera module is in a first field-of-view mode, the outer surface of the second lens group protrudes beyond the outer panel of the camera module, allowing the camera module to be placed inside the camera shooting control device via a lifting scheme, and extended during use to switch between the first and second field-of-view modes via external focusing.

[0064] Accordingly, the camera shooting control method provided in this solution increases the axial distance between the first lens group and the second lens group in the camera module by using the lens driving component. This can be achieved by moving the position of the second lens group through the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

[0065] For example, when the target location on the first image is outside a preset area of ​​the first image, the second lens group is moved away from the first lens group by the lens driving component. This increases the axial distance between the first and second lens groups in the camera module, allowing the camera module to switch from a first field-of-view mode to a second field-of-view mode. This solution uses a lifting mechanism to control the camera module to extend out of or be hidden within the camera shooting control device, reducing the camera module's size. Switching between the first and second field-of-view modes can be achieved simply by moving the position of the second lens group using the lens driving component, balancing the requirements of a large recognition range and high recognition rate in the operational scenario.

[0066] In one possible embodiment, the camera module can be positioned externally to the camera capture control device, and the camera module can be connected to one or more processors via wired and / or wireless means. The camera module can be connected to the body of the camera capture control device by means of fixed connection, snap-fit, magnetic connection, etc. Positioning the camera module externally allows for a larger camera module size, and the first lens group can move inside the camera module to adjust the axial distance between the first lens group and the second lens group, thereby enabling switching between a first field of view mode and a second field of view mode.

[0067] Accordingly, the camera shooting control method provided in this solution increases the axial distance between the first lens group and the second lens group in the camera module by using the lens driving component. This can be achieved by moving the position of the first lens group through the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

[0068] For example, when the target location on the first image is outside a preset area of ​​the first image, the lens driving component moves the first lens group away from the second lens group to increase the axial distance between the first and second lens groups in the camera module, allowing the camera module to switch from a first field-of-view mode to a second field-of-view mode. This solution places the camera module outside the camera shooting control device, reducing restrictions on the camera module. Switching between the first and second field-of-view modes can be achieved simply by moving the position of the first lens group using the lens driving component, thus balancing the requirements of a large recognition range and high recognition rate in the operational scenario.

[0069] S240: Acquire the first target image captured by the camera module in the second field of view mode. The first target image is used for image recognition processing.

[0070] In one possible embodiment, the camera shooting control method provided by this solution to acquire the first target image captured by the camera module in the second field of view mode may be: acquiring multiple second images captured by the camera module in the second field of view mode, determining the clarity of each second image; and determining the second image corresponding to the highest clarity as the first target image.

[0071] For example, after switching the camera module from a first field-of-view mode to a second field-of-view mode and controlling the camera module to turn towards the direction corresponding to the target position, the camera module is controlled to capture multiple second images in the second field-of-view mode, and the sharpness of these second images is determined. Optionally, the sharpness can be represented by the image gradient (e.g., Tenengrad gradient, Laplacian gradient, Brenner gradient, energy gradient, etc.), variance (grayscale variance of the image), frequency components, root mean square error, structural similarity index, gradient magnitude similarity index, etc. Further, the second image with the highest sharpness among the multiple second images is determined, and this second image with the highest sharpness is identified as the first target image, improving the accuracy of image recognition processing on the first target image and enhancing the user experience.

[0072] In one possible embodiment, before acquiring multiple second images captured by the camera module in the second field-of-view mode, the camera shooting control method provided by this solution can further increase the shooting frame rate of the camera module to a preset shooting frame rate. Accordingly, acquiring multiple second images captured by the camera module in the second field-of-view mode includes: acquiring multiple second images captured by the camera module in the second field-of-view mode based on the preset shooting frame rate.

[0073] For example, after switching the camera module from the first field of view mode to the second field of view mode and controlling the camera module to turn towards the direction corresponding to the target position, the shooting frame rate of the camera module is increased to a preset shooting frame rate. Then, through the camera module in the second field of view mode, multiple second images are captured based on the preset shooting frame rate. This achieves image capture with a higher frame rate and pixel density in the second field of view mode, which can acquire multiple clear second images faster. The second image with the highest clarity is determined as the first target image, which can perform image recognition processing on the first target image faster and more accurately, reducing the user's waiting time and improving the user experience.

[0074] In one possible embodiment, after acquiring the first target image captured by the camera module in the second field of view mode, the camera shooting control method provided by this solution may further include: performing image recognition processing on the first target image to obtain first recognition content; determining first response content according to the query instruction and the first recognition content; and displaying the first response content.

[0075] For example, image recognition processing is performed on the first target image to obtain the first recognized content, which can be text or graphic content, such as questions in a test paper. The first response content is then determined based on the query instruction and the first recognized content. Optionally, the first response content can be determined based on a trained neural network model (e.g., a GPT model) according to the query instruction and the first recognized content. For example, when the query instruction is "How to do this question?", the neural network model searches for the answer analysis corresponding to the first recognized content in a preset question bank based on the instruction "How to do this question?", and uses the answer analysis as the first response content, displaying it on the screen. Alternatively, the text content corresponding to the first response content can be played through a speaker. This solution obtains the first recognized content by performing image recognition processing on the first target image, determines and displays the first response content based on the query instruction and the first recognized content, and uses the first target image captured in a second field-of-view mode. The first target image has higher clarity, resulting in better image recognition performance and more accurate determination of the first response content.

[0076] As described above, by acquiring a first image captured by the camera module in a first field-of-view mode, target recognition is performed on the first image to obtain a target recognition result, and the target in the first image is determined based on the target recognition result. When the target position of the target in the first image is outside a preset area of ​​the first image, the camera module is controlled to switch from the first field-of-view mode to the second field-of-view mode, and the camera module is controlled to turn towards the direction corresponding to the target position via the camera pan-tilt unit, acquiring a first target image captured by the camera module in the second field-of-view mode. Image recognition processing can be performed on the first target image. Since the camera module in the first field-of-view mode... In the field-of-view mode, the pixel density in the preset area is higher than that in the non-preset area. The focal length of the camera module in the first field-of-view mode is shorter than that in the second field-of-view mode. The field of view in the first field-of-view mode is larger than that in the second field-of-view mode. By obtaining a larger field of view in the first field-of-view mode, a wider recognition range can be achieved. When the target is in a low-pixel-density location, the camera module can switch to the second field-of-view mode and turn towards the target, which can improve the pixel density and clarity of the captured image, enhance image recognition accuracy, improve image recognition results, and optimize user experience. At the same time, in the second field-of-view mode, the shooting frame rate of the camera module is increased to the preset shooting frame rate, achieving higher frame rate and pixel density image capture. This allows for the faster acquisition of multiple clear second images, and the highest-resolution second image is identified as the first target image. This enables faster and more accurate image recognition processing of the first target image, reducing user waiting time and further improving user experience.

[0077] Figure 8 A schematic diagram of a camera shooting control device according to an embodiment of this application is provided. This camera shooting control device can be applied to a camera shooting control equipment, which includes a camera module and a camera pan-tilt unit, with the camera module mounted on the camera pan-tilt unit. (Reference) Figure 8 The camera shooting control device includes a first shooting module 31, a target recognition module 32, a mode conversion module 33, and a second shooting module 34.

[0078] The system includes a first shooting module 31 configured to acquire a first image captured by the camera module in a first field-of-view mode; a target recognition module 32 configured to perform target recognition on the first image to obtain a target recognition result, and determine the target in the first image based on the target recognition result; a mode switching module 33 configured to control the camera module to switch from a first field-of-view mode to a second field-of-view mode when the target position of the target in the first image is outside a preset area of ​​the first image, and to control the camera module to turn towards the direction corresponding to the target position via a camera gimbal, wherein the pixel density of the camera module in the preset area is higher than the pixel density in the non-preset area in the first field-of-view mode, the focal length of the camera module in the first field-of-view mode is less than the focal length in the second field-of-view mode, and the field of view of the first field-of-view mode is greater than the field of view of the second field-of-view mode; and a second shooting module 34 configured to acquire a first target image captured by the camera module in the second field-of-view mode, the first target image being used for image recognition processing.

[0079] As described above, by acquiring a first image captured by the camera module in a first field-of-view mode, target recognition is performed on the first image to obtain a target recognition result, and the target in the first image is determined based on the target recognition result. When the target position of the target in the first image is outside a preset area of ​​the first image, the camera module is controlled to switch from the first field-of-view mode to the second field-of-view mode, and the camera module is controlled to turn towards the direction corresponding to the target position via the camera pan-tilt unit, acquiring a first target image captured by the camera module in the second field-of-view mode. Image recognition processing can be performed on the first target image. Since the camera module in the first field-of-view mode... In the field-of-view mode, the pixel density in the preset area is higher than that in the non-preset area. The focal length of the camera module in the first field-of-view mode is shorter than that in the second field-of-view mode. The field of view of the first field-of-view mode is larger than that of the second field-of-view mode. By using the camera module in the first field-of-view mode, a larger field of view can be obtained, thus achieving a larger recognition range. When the target to be recognized is in a low pixel density position, the camera module can switch to the second field-of-view mode and turn towards the target to improve the pixel density and clarity of the captured image, thereby improving the accuracy of image recognition, enhancing the image recognition results, and optimizing the user experience.

[0080] In one possible embodiment, the second shooting module 34 acquires a first target image captured by the camera module in the second field of view mode, including: acquiring multiple second images captured by the camera module in the second field of view mode, determining the sharpness of each second image; and determining the second image corresponding to the highest sharpness as the first target image.

[0081] In one possible embodiment, the camera shooting control device further includes a frame rate adjustment module, which is used to increase the shooting frame rate of the camera module to a preset shooting frame rate before the second shooting module 34 acquires multiple second images captured by the camera module in the second field of view mode.

[0082] Correspondingly, the second shooting module 34 acquires multiple second images captured by the camera module in the second field of view mode, including: acquiring multiple second images captured by the camera module in the second field of view mode based on a preset shooting frame rate.

[0083] In one possible embodiment, the camera module includes a lens driving component and an image sensor, a second lens group, and a first lens group arranged sequentially, wherein the lens driving component is used to control the axial distance between the first lens group and the second lens group.

[0084] The mode switching module 33 controls the camera module to switch from the first field of view mode to the second field of view mode, including: increasing the axial distance between the first lens group and the second lens group in the camera module through the lens driving component.

[0085] In one possible embodiment, the camera module is movably mounted in the camera shooting control device via a lifting mechanism. The lifting mechanism is used to control the camera module to be housed inside the camera shooting control device or to control the camera module to extend out of the camera shooting control device.

[0086] The mode conversion module 33 increases the axial distance between the first lens group and the second lens group in the camera module by means of the lens driving component, including: moving the position of the second lens group by means of the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

[0087] In one possible embodiment, the camera module is disposed outside the camera shooting control device, and the mode conversion module 33 increases the axial distance between the first lens group and the second lens group in the camera module by means of the lens driving component, including: moving the position of the first lens group by means of the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

[0088] In one possible embodiment, the second shooting module 34 is further configured to maintain the camera module in the first field of view mode when the target position of the identified target on the first image is within a preset area of ​​the first image; acquire the second target image captured by the camera module in the first field of view mode, and use the second target image for image recognition processing.

[0089] In one possible embodiment, the camera shooting control device further includes an instruction acquisition module, which is used to receive query instructions issued by the user;

[0090] Accordingly, the first shooting module 31 acquires the first image captured by the camera module in the first field of view mode, including: in response to the query command, acquiring the first image captured by the camera module in the first field of view mode.

[0091] In one possible embodiment, the camera shooting control device further includes a response processing module, which is used to perform image recognition processing on the first target image to obtain first recognition content; determine the first response content according to the query instruction and the first recognition content, and display the first response content.

[0092] It is worth noting that in the above-described embodiments of the camera shooting control device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this application.

[0093] This application also provides a camera shooting control device, which can integrate the camera shooting control device provided in this application. Figure 9 This is a schematic diagram of the structure of a camera shooting control device provided in an embodiment of this application. (Reference) Figure 9 The camera shooting control device includes: an input device 43, an output device 44, a memory 42, and one or more processors 41; the memory 42 is used to store one or more programs; when one or more programs are executed by one or more processors 41, the one or more processors 41 implement the camera shooting control method provided in the above embodiments. The input device 43, output device 44, memory 42, and processors 41 can be connected via a bus or other means. Figure 9 Taking the example of a connection between China and Israel via a bus.

[0094] The memory 42, as a computing device readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the camera shooting control method provided in any embodiment of this application (e.g., the first shooting module 31, target recognition module 32, mode conversion module 33, and second shooting module 34 in the camera shooting control device). The memory 42 may mainly include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory 42 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 42 may further include memory remotely located relative to the processor 41, and these remote memories can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0095] Input device 43 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the device. Output device 44 may include display devices such as a display screen.

[0096] The processor 41 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 42, thereby realizing the above-mentioned camera shooting control method.

[0097] The camera shooting control device, equipment, and computer provided above can be used to execute the camera shooting control method provided in any of the above embodiments, and have corresponding functions and beneficial effects.

[0098] This application embodiment also provides a storage medium for storing computer-executable instructions. When executed by a computer processor, the computer-executable instructions are used to execute the camera shooting control method provided in the above embodiment. The camera shooting control method includes: acquiring a first image captured by a camera module in a first field of view mode; performing target recognition on the first image to obtain a target recognition result, and determining a target in the first image based on the target recognition result; when the target position of the target in the first image is outside a preset area of ​​the first image, controlling the camera module to switch from the first field of view mode to a second field of view mode, and controlling the camera module to turn towards the direction corresponding to the target position via a camera pan-tilt unit, wherein the pixel density of the camera module in the preset area in the first field of view mode is higher than the pixel density in the non-preset area, the focal length of the camera module in the first field of view mode is less than the focal length in the second field of view mode, and the field of view of the first field of view mode is greater than the field of view of the second field of view mode; acquiring a first target image captured by the camera module in the second field of view mode, the first target image being used for image recognition processing.

[0099] Storage medium – any type of memory device or storage device. The term “storage medium” is intended to include: mounting media, such as CD-ROMs, floppy disks, or magnetic tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (e.g., hard disks or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. Furthermore, storage media may reside in a first computer system in which a program is executed, or may reside in a different second computer system connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term “storage medium” can include two or more storage media that may reside in different locations (e.g., in different computer systems connected via a network). Storage media may store program instructions (e.g., specifically implemented as a computer program) executable by one or more processors.

[0100] Of course, the computer-executable instructions stored in the storage medium provided in the embodiments of this application are not limited to the camera shooting control method provided above, but can also execute related operations in the camera shooting control method provided in any embodiment of this application.

[0101] The camera shooting control device, equipment, and storage medium provided in the above embodiments can execute the camera shooting control method provided in any embodiment of this application. For technical details not described in detail in the above embodiments, please refer to the camera shooting control method provided in any embodiment of this application.

[0102] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments provided herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A camera shooting control method, applied to a camera shooting control device, the camera shooting control device comprising a camera module and a camera pan / tilt unit, the camera module being mounted on the camera pan / tilt unit, characterized in that, include: Acquire the first image captured by the camera module in the first field of view mode; The first image is subjected to target recognition to obtain target recognition results, and the target in the first image is determined based on the target recognition results; When the target position of the identified target on the first image is outside the preset area of ​​the first image, the camera module is controlled to switch from a first field of view mode to a second field of view mode, and the camera module is controlled to turn towards the direction corresponding to the target position through the camera pan-tilt unit. In the first field of view mode, the pixel density of the camera module in the preset area is higher than the pixel density in the non-preset area. The focal length of the camera module in the first field of view mode is smaller than the focal length in the second field of view mode. The field of view of the first field of view mode is larger than the field of view of the second field of view mode. The first target image captured by the camera module in the second field of view mode is acquired, and the first target image is used for image recognition processing.

2. The camera shooting control method according to claim 1, characterized in that, The acquisition of the first target image captured by the camera module in the second field-of-view mode includes: Acquire multiple second images captured by the camera module in the second field of view mode, and determine the sharpness of each second image; The second image corresponding to the highest resolution is determined as the first target image.

3. The camera shooting control method according to claim 2, characterized in that, Before acquiring the multiple second images captured by the camera module in the second field-of-view mode, the method further includes: Increase the shooting frame rate of the camera module to a preset shooting frame rate; Accordingly, acquiring multiple second images captured by the camera module in the second field-of-view mode includes: The camera module captures multiple second images based on the preset shooting frame rate in the second field of view mode.

4. The camera shooting control method according to claim 1, characterized in that, The camera module includes a lens driving component and an image sensor, a second lens group, and a first lens group arranged in sequence. The lens driving component is used to control the axial distance between the first lens group and the second lens group. The control of the camera module to switch from the first field of view mode to the second field of view mode includes: The axial distance between the first lens group and the second lens group in the camera module is increased by the lens driving component.

5. The camera shooting control method according to claim 4, characterized in that, The camera module is movably mounted in the camera shooting control device via a lifting mechanism. The lifting mechanism is used to control the camera module to be housed in the camera shooting control device or to control the camera module to extend out of the camera shooting control device. Increasing the axial distance between the first lens group and the second lens group in the camera module by means of the lens driving component includes: The position of the second lens group is moved by the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

6. The camera shooting control method according to claim 4, characterized in that, The camera module is disposed outside the camera shooting control device. Increasing the axial distance between the first lens group and the second lens group in the camera module via the lens driving component includes: The position of the first lens group is moved by the lens driving component to increase the axial distance between the first lens group and the second lens group in the camera module.

7. The camera shooting control method according to claim 1, characterized in that, After determining the target in the first image based on the target recognition result, the method further includes: When the target position of the identified target on the first image is within a preset area of ​​the first image, the camera module is kept in the first field of view mode; The second target image captured by the camera module in the first field of view mode is acquired, and the second target image is used for image recognition processing.

8. The camera shooting control method according to claim 1, characterized in that, Before acquiring the first image captured by the camera module in the first field-of-view mode, the method further includes: Receive query commands from users; Accordingly, acquiring the first image captured by the camera module in the first field-of-view mode includes: In response to the query command, the first image captured by the camera module in the first field of view mode is obtained.

9. The camera shooting control method according to claim 8, characterized in that, After acquiring the first target image captured by the camera module in the second field-of-view mode, the method further includes: The first target image is subjected to image recognition processing to obtain the first recognition content; The first response content is determined based on the query instruction and the first identified content, and then displayed.

10. A camera shooting control device, applied to a camera shooting control equipment, the camera shooting control equipment comprising a camera module and a camera pan-tilt unit, the camera module being mounted on the camera pan-tilt unit, characterized in that, It includes a first shooting module, a target recognition module, a mode conversion module, and a second shooting module, wherein: The first shooting module is configured to acquire a first image captured by the camera module in a first field of view mode; The target recognition module is configured to perform target recognition on the first image to obtain a target recognition result, and determine the target in the first image based on the target recognition result; The mode switching module is configured to control the camera module to switch from a first field of view mode to a second field of view mode when the target position of the identified target on the first image is outside a preset area of ​​the first image, and to control the camera module to turn towards the direction corresponding to the target position through the camera pan-tilt unit. In the first field of view mode, the pixel density of the camera module in the preset area is higher than the pixel density in the non-preset area, the focal length of the camera module in the first field of view mode is less than the focal length in the second field of view mode, and the field of view of the first field of view mode is greater than the field of view of the second field of view mode. The second shooting module is configured to acquire a first target image captured by the camera module in a second field of view mode, and the first target image is used for image recognition processing.

11. A camera shooting control device, characterized in that, include: Memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the camera shooting control method as described in any one of claims 1-9.

12. A storage medium for storing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the camera shooting control method as described in any one of claims 1-9.

Images