Camera device control method and apparatus, and computer program product and camera device
By acquiring the depth information of the target subject and the coordinate relationship with the device, and calculating and sending attitude adjustment information, the problem of the camera device being unable to capture the target subject in a timely manner was solved, resulting in better shooting effects.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SHENZHEN IMAGINEVISION TECHNOLOGY LTD
- Filing Date
- 2024-10-29
- Publication Date
- 2026-05-07
AI Technical Summary
In live broadcasts of sporting events and entertainment performances, the subject may move during filming, making it difficult for the camera to capture the subject in a timely manner, resulting in poor filming quality.
By acquiring the depth information of the target subject, its first projected coordinates in the device coordinate system of the first camera device are determined, and the attitude adjustment information of the second camera device is calculated based on the device coordinate relationship. This information is then sent to the second camera device to adjust its attitude, ensuring that it can capture the target subject in a timely manner.
The improved shooting effect allows the second camera to capture images of the target subject in a timely manner, enhancing the accuracy and quality of the shooting.
Smart Images

Figure CN2024128201_07052026_PF_FP_ABST
Abstract
Description
Camera equipment control methods, devices, computer program products and camera equipment Technical Field
[0001] This application belongs to the field of equipment control technology, and in particular relates to a camera equipment control method, device, computer program product, and camera equipment. Background Technology
[0002] In live streaming applications for sporting events and entertainment performances, multiple cameras are often used to film the subject from different angles to better present the reality of the scene. However, because the subject may move during filming, causing its position to change, there are situations where the cameras cannot capture the subject in a timely manner. Technical issues
[0003] One of the objectives of this application is to provide a camera equipment control method, apparatus, computer program product, and camera equipment. Technical solutions
[0004] The technical solution adopted in the embodiments of this application is:
[0005] In a first aspect, a camera control method applied to a first camera device is provided, which may include:
[0006] Obtain in-depth information about the target entity;
[0007] Based on the depth information of the target subject, the first projected coordinates of the target subject are determined; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device;
[0008] Based on the device coordinate relationship and the first projection coordinates, the posture adjustment information of the second camera device is determined; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0009] The posture adjustment information is sent to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information.
[0010] Secondly, a camera control method for a second camera device is provided, which may include:
[0011] Receive posture adjustment information; wherein the posture adjustment information is determined by the first camera device based on the device coordinate relationship and the first projected coordinates of the target body, and the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0012] Based on the posture adjustment information, the second camera device is controlled to adjust its posture.
[0013] Thirdly, a camera control device for use with a first camera device is provided, which may include:
[0014] The information acquisition module is used to acquire depth information of the target subject;
[0015] The coordinate determination module is used to determine the first projected coordinates of the target subject based on the depth information of the target subject; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device;
[0016] The adjustment determination module is used to determine the posture adjustment information of the second camera device based on the device coordinate relationship and the first projection coordinates; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0017] The information sending module is used to send the posture adjustment information to the second camera device, so that the second camera device can adjust its posture based on the posture adjustment information.
[0018] Fourthly, a camera control device for use with a second camera is provided, which may include:
[0019] An information receiving module is used to receive posture adjustment information; wherein the posture adjustment information is determined by the first camera device based on the device coordinate relationship and the first projected coordinates of the target body, and the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0020] The posture adjustment module is used to control the second camera device to adjust its posture based on the posture adjustment information.
[0021] Fifthly, a computer-readable storage medium is provided, the computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of any of the above-described camera device control methods.
[0022] In a sixth aspect, a camera device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the camera device performs the steps of any of the above-described camera device control methods.
[0023] In a seventh aspect, a computer program product is provided, comprising a computer program that, when executed, causes any of the above-described camera device control methods to be performed. Beneficial effects
[0024] The beneficial effects of the camera device control method provided in this application embodiment are as follows: This application embodiment acquires the depth information of the target subject; based on the depth information of the target subject, determines the first projected coordinates of the target subject; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device; based on the device coordinate relationship and the first projected coordinates, determines the posture adjustment information of the second camera device; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; and sends the posture adjustment information to the second camera device so that the second camera device performs posture adjustment based on the posture adjustment information. In this application embodiment, when the first camera device captures the target subject, it can guide the second camera device to perform posture adjustment based on the device coordinate relationship, thereby enabling the second camera device to capture the target subject in a timely manner, which helps to improve the shooting effect.
[0025] The beneficial effects of the camera control device provided in this application embodiment are as follows: The device of this application embodiment acquires the depth information of the target subject; determines the first projected coordinates of the target subject based on the depth information of the target subject; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device; determines the posture adjustment information of the second camera device based on the device coordinate relationship and the first projected coordinates; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; and sends the posture adjustment information to the second camera device so that the second camera device can perform posture adjustment based on the posture adjustment information. Through the device of this application embodiment, when the first camera device captures the target subject, it can guide the second camera device to perform posture adjustment based on the device coordinate relationship, thereby enabling the second camera device to capture the target subject in a timely manner, which helps to improve the shooting effect.
[0026] The beneficial effect of the readable storage medium provided in this application embodiment is that: the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the steps of the above-mentioned camera device control method.
[0027] The beneficial effects of the camera device provided in this application embodiment are as follows: The camera device provided in this application embodiment includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the steps of any of the above-mentioned camera device control methods applied to the camera device.
[0028] The beneficial effect of the computer program product provided in this application embodiment is that: the computer program product provided in this application embodiment includes a computer program, and when the computer program is run, any of the above-mentioned camera device control methods are executed. Attached Figure Description
[0029] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or exemplary technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0030] Figure 1 is a schematic diagram of the hotspot area in an embodiment of this application;
[0031] Figure 2 is a flowchart of an embodiment of a camera control method applied to a first camera device in this application;
[0032] Figure 3 is a schematic diagram of the coordinate system of the first camera device and the second camera device;
[0033] Figure 4 is a flowchart of an embodiment of a camera control method applied to a second camera device in this application;
[0034] Figure 5 is a structural diagram of an embodiment of a camera control device applied to a first camera device in this application;
[0035] Figure 6 is a structural diagram of an embodiment of a camera control device applied to a second camera device in this application;
[0036] Figure 7 is a schematic block diagram of a camera device according to an embodiment of this application. Embodiments of the present invention
[0037] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the scope of this application.
[0038] It should be noted that when a component is referred to as "fixed to" or "set on" another component, it can be directly or indirectly attached to that other component. When a component is referred to as "connected to" another component, it can be directly or indirectly connected to that other component. The terms "upper," "lower," "left," "right," etc., indicate orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, and are for ease of description only, not to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application. Those skilled in the art can understand the specific meaning of the above terms according to the specific circumstances. The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features. "A plurality" means two or more, unless otherwise explicitly defined.
[0039] To illustrate the technical solutions provided in this application, the following detailed description is provided in conjunction with specific drawings and embodiments.
[0040] In live streaming applications for sporting events and entertainment performances, multiple cameras are often used to film the subject from different angles to better present the reality of the scene. However, because the subject may move during filming, causing its position to change, there are situations where the cameras cannot capture the subject in a timely manner.
[0041] In view of this, embodiments of this application provide a camera equipment control method, apparatus, computer program product, and camera equipment to solve the problem that the existing camera equipment control methods cannot capture the target subject in a timely manner, resulting in poor shooting effects.
[0042] It should be noted that the subject of the method in this application is a camera device, which may include, but is not limited to, any common camera device in the prior art such as a wide-angle camera or a gimbal camera.
[0043] In this embodiment of the application, in order to better capture the subject to be captured, an area including the subject can be set in the shooting screen, and the camera device can be controlled to shoot based on the area. This allows the camera device to capture the subject to be captured more easily and in a more targeted manner, thereby improving the shooting effect.
[0044] For example, as shown in Figure 1, when filming a sports event, the athlete can be the subject of the filming, the area where the athlete is located (1) can be the area to be filmed, and the camera equipment can be controlled to film the area where the athlete is located more specifically to better reflect the situation of the event.
[0045] For ease of description, the subject to be photographed in this application embodiment can be referred to as the target subject, and the area including the target subject can be referred to as the hotspot area.
[0046] In one specific implementation of this application, hotspot areas can be determined based on user settings. For example, a server can establish a communication connection with the camera device to better control and manage its shooting; the user can set the hotspot area of the camera device interactively on the server's management interface. Alternatively, the user can directly set the hotspot area of the camera device interactively on its display interface.
[0047] In another specific implementation of this application, hotspot areas can be determined based on the recognition results of an artificial intelligence model. Specifically, an artificial intelligence model for target recognition can be used to identify the target subject, and the area including the target subject can be determined as a hotspot area. Here, the artificial intelligence model can be any common artificial intelligence model for target recognition in the prior art, and this application does not limit it.
[0048] In another specific implementation of this application, hotspot areas can be determined by combining user settings with the recognition results of an artificial intelligence model. For example, hotspot areas of the camera device can be recommended based on the recognition results of the artificial intelligence model, and the user can confirm or adjust the recommended hotspot areas to determine the final hotspot areas.
[0049] Once the hotspot area is identified, the camera can focus and shoot based on that area; this can improve the shooting effect and the user's viewing experience.
[0050] In one specific implementation of this application, the user sets a hotspot area on the server's management interface to determine the hotspot area in the shooting frame. The server can then generate a region focus command based on the determined hotspot area and send the region focus command to the camera device so that the camera device can focus on and shoot the hotspot area. After receiving the region focus command, the camera device can parse the region focus command to obtain the set hotspot area. Then, the camera device can focus on and shoot based on the hotspot area.
[0051] In another specific implementation of this application, if the user identifies a hotspot area on the display interface of the camera device, the camera device can directly focus and shoot based on the identified hotspot area.
[0052] In this embodiment, various camera devices can be assembled into a camera system. Different camera devices can be positioned at different locations. During filming, each camera device in the system can capture images of the hotspot area. Therefore, the camera system can capture the target subject from different shooting angles, enriching the viewer's viewing experience. The number and specific locations of the camera devices in the system can be customized and contextualized according to actual needs; this embodiment does not limit this.
[0053] Specifically, if one camera device in the camera system can capture the target subject, but another camera device in the camera system is currently unable to accurately capture the target subject, the camera device capable of capturing the target subject (referred to as the first camera device) can be used to guide the other camera devices that are unable to accurately capture the target subject (referred to as the second camera device) to adjust their posture so that the second camera device can successfully capture the target subject. The camera device control method of this application embodiment will be described below from the perspectives of the first camera device and the second camera device respectively.
[0054] Please refer to Figure 2. One embodiment of a camera control method applied to a first camera device in this application can be divided into steps S201 to S204:
[0055] Step S201: Obtain depth information of the target subject.
[0056] In this embodiment of the application, since the first camera device is able to capture the target subject, the first camera device can determine the position of the target subject in the device coordinate system of the first camera device (referred to as the first projected coordinates) based on the depth information of the target subject.
[0057] Specifically, the depth information of the target subject can be the distance of the target subject relative to the first camera device. When the first camera device takes a picture of the target subject, it will focus on the target subject in order to capture the target subject more clearly; at this time, the first camera device can obtain the distance of the target subject relative to the first camera device (i.e., the depth information of the target subject).
[0058] Step S202: Determine the first projected coordinates of the target subject based on the depth information of the target subject.
[0059] When the first camera captures an image of the target subject, it can be assumed that the target subject is projected into the device coordinate system of the first camera. After obtaining the depth information of the target subject, the coordinates of the target subject in the device coordinate system of the first camera (called the first projected coordinates of the target subject) can be determined based on the intrinsic parameters of the first camera and the depth information of the target subject.
[0060] Step S203: Based on the device coordinate relationship and the first projection coordinate, determine the attitude adjustment information of the second camera device.
[0061] After determining the first projected coordinates of the target subject, the position of the target subject in the device coordinate system of the first camera device can be transformed to the device coordinate system of the second camera device according to the relationship between the first projected coordinates and the device coordinates, so as to obtain the coordinates of the target subject in the device coordinate system of the second camera device (called the second projected coordinates of the target subject), as shown in Figure 3; where the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device.
[0062] After determining the second projected coordinates, the posture of the second camera device can be adjusted so that it can successfully capture the target subject. Specifically, the posture adjustment information of the second camera device can be determined based on the device coordinate relationship and the first projected coordinates.
[0063] In this embodiment, before determining the posture adjustment information of the second camera device, the coordinate transformation relationship between the various camera devices in the camera system can be determined. Then, based on the first projected coordinates of the target subject, the posture adjustment information required by the other camera devices to capture the target subject can be determined.
[0064] In one specific implementation of this application, a camera device can be used to photograph a marked object at a known location in the world coordinate system. Then, the marks in the image can be identified, and the position of the marks can be associated with the corresponding position in the world coordinate system to determine the world coordinate information of the camera device. Here, a first camera device and a second camera device can be used to photograph the marked object at a known location in the world coordinate system. Then, the first camera device can identify the marks in its own captured image and associate the position of the marks with the corresponding position in the world coordinate system to determine the world coordinate information of the first camera device (referred to as first coordinate information). Similarly, the second camera device can also identify the marks in its own captured image and associate the position of the marks with the corresponding position in the world coordinate system to determine the world coordinate information of the second camera device (referred to as second coordinate information). When determining the device coordinate relationship, the first coordinate information and the second coordinate information can be obtained, and based on the first coordinate information and the second coordinate information, the relative positional relationship between the first camera device and the second camera device can be determined. Accordingly, the coordinate transformation relationship between the first camera device and the second camera device can be determined. Specifically, the world coordinate information of the camera device can be represented as (x, y, z, pitch, yaw, roll), where x, y, and z are the components of the camera device on the x-axis, y-axis, and z-axis of the world coordinate system, respectively; pitch is the pitch angle of the camera device (i.e., the angle of rotation of the camera device around the x-axis); yaw is the yaw angle of the camera device (i.e., the angle of rotation of the camera device around the y-axis); and roll is the roll angle of the camera device (i.e., the angle of rotation of the camera device around the z-axis).
[0065] In another specific implementation of this application embodiment, each camera device in the camera system can be equipped with a wireless ranging transceiver (e.g., Ultra Wide Band (UWB)) to send or receive wireless signals. Here, any three or more camera devices can be used as reference camera devices (anchor points). Each camera device can send wireless signals to the reference camera devices and receive wireless signals in response from the reference camera devices. The camera device can calculate the distance between itself and the reference camera devices based on the time difference between the wireless signals it sends and the wireless signals it receives. Then, a multilateration algorithm can be used to calculate the relative position information of the camera device in the camera system based on the distance between the camera device and at least three reference camera devices. Based on the relative position information of the first camera device and the second camera device in the camera system, the coordinate transformation relationship between the first camera device and the second camera device can be determined.
[0066] In another specific implementation of this application embodiment, each camera device in the camera system can be equipped with a laser sensor. The camera device can use the laser sensor to send laser pulses to other camera devices. After being reflected by other camera devices, the laser pulses return to the camera device that emitted the laser pulses. Based on the time difference between the emitted laser pulse and the received laser pulse, the distance between the camera device that emitted the laser pulse and the other camera devices can be calculated. Accordingly, the distance between each camera device in the camera system can be determined. Based on the distance between each camera device, the relative position information of each camera device in the camera system can be determined. Based on the relative position information of the first camera device and the second camera device, the coordinate transformation relationship between the first camera device and the second camera device can be determined.
[0067] In another specific implementation of this application embodiment, a camera device set at a higher position can be used to capture images of other camera devices in the camera system to determine the relative positions between the other camera devices and obtain the relative position information of each camera device; based on the relative position information of the first camera device and the second camera device, the coordinate transformation relationship between the first camera device and the second camera device can be determined.
[0068] After determining the device coordinate relationships, the first projected coordinates can be converted into second projected coordinates. Then, the attitude adjustment information of the second camera device can be determined based on the second projected coordinates.
[0069] In one specific implementation of this application embodiment, the difference between the content currently captured by the second camera device and the second projection coordinates can be calculated, thereby determining the posture adjustment information of the second camera device; wherein, the posture adjustment information of the second camera device may include, but is not limited to, the rotation and translation parameters of the second camera device.
[0070] Step S204: Send the attitude adjustment information to the second camera device so that the second camera device can adjust the attitude based on the attitude adjustment information.
[0071] In one specific implementation of this application embodiment, the first camera device and the second camera device can establish a communication connection through a preset communication link. After determining the posture adjustment information of the second camera device, the first camera device can send the posture adjustment information to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information.
[0072] In another specific implementation of this application embodiment, the first camera device and the second camera device can establish a communication connection with the server through a preset communication link. After determining the posture adjustment information of the second camera device, the first camera device can send the posture adjustment information to the server. After receiving the posture adjustment information sent by the first camera device, the server can send the posture adjustment information to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information.
[0073] The aforementioned communication link can be a communication link established based on at least one wireless communication solution, such as Wireless Local Area Networks (WLAN) (e.g., Wireless Fidelity (WiFi)), Bluetooth, Bluetooth Low Energy, Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), and Long Term Evolution (LTE).
[0074] In addition, after the posture adjustment information of the second camera device is sent to the second camera device, the first camera device can update the device coordinate relationship and obtain the updated device coordinate relationship.
[0075] The camera device control method of this application embodiment will now be described from the perspective of the second camera device.
[0076] Please refer to Figure 4. One embodiment of a camera control method applied to a second camera device in this application may include steps S401 to S402:
[0077] Step S401: Receive attitude adjustment information.
[0078] In this embodiment of the application, the second camera device can receive the posture adjustment information of the second camera device determined by the first camera device.
[0079] In one specific implementation of this application embodiment, the second camera device can establish a communication connection with the first camera device. The first camera device can send the posture adjustment information of the second camera device to the second camera device through the communication connection, and the second camera device can receive the posture adjustment information sent by the first camera device through the communication connection.
[0080] In another specific implementation of this application embodiment, the first camera device and the second camera device can establish communication connections with the server respectively. The first camera device can send attitude adjustment information to the server. After receiving the attitude adjustment information sent by the first camera device, the server can send the attitude adjustment information to the second camera device.
[0081] Step S402: Based on the posture adjustment information, control the second camera device to perform posture adjustment.
[0082] In this embodiment of the application, after receiving the posture adjustment information, the second camera device can adjust its own posture accordingly in order to capture the target subject more accurately.
[0083] Specifically, the second camera device can analyze the posture adjustment information to determine the rotation and translation parameters of the second camera device, and can make physical adjustments to the second camera device based on the analyzed rotation and translation parameters so that the target subject is located in the field of view of the second camera device.
[0084] In addition, after the second camera device adjusts its posture based on the posture adjustment information, the coordinate transformation relationship between the first camera device and the second camera device changes. Therefore, the device coordinate relationship can be updated based on the posture adjustment information to obtain the updated device coordinate relationship.
[0085] Furthermore, to avoid monotonous playback and a single shooting perspective, during actual shooting, the playback can be switched between different camera devices based on preset switching rules. Specifically, the switching rules can be customized and contextualized according to actual needs, and this application embodiment does not limit this.
[0086] In one specific implementation of this application, the switching rule can be to switch the playback screen to the camera device whose hotspot area is located in the center of the shooting screen. For example, if the hotspot area of camera device A is located in the center of camera device A, then the screen of camera device A can be used as the playback screen; subsequently, the target subject moves beyond the shooting screen of camera device A and enters the shooting screen of camera device B and is located in the center of camera device B (i.e., the hotspot area of camera device B is located in the center of camera device B); therefore, the playback screen can be switched to the screen of camera device B.
[0087] In another specific implementation of this application, the switching rule can be to switch the playback screen from the output of the current camera device to the output of another camera device at specific time intervals. Here, the specific value of the specific time interval can be customized and contextualized according to actual needs, and this application does not limit it. For example, the specific time interval can be 15 seconds, that is, the playback screen is switched from the output of one camera device to the output of another camera device every 15 seconds.
[0088] Switching between different playback screens can enrich the playback content and help improve the viewer's viewing experience.
[0089] In summary, this application embodiment obtains the depth information of the target subject; based on the depth information of the target subject, determines the first projected coordinates of the target subject; wherein the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device; based on the device coordinate relationship and the first projected coordinates, determines the posture adjustment information of the second camera device; wherein the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; and sends the posture adjustment information to the second camera device so that the second camera device can perform posture adjustment based on the posture adjustment information. In this application embodiment, when the first camera device captures the target subject, it can guide the second camera device to perform posture adjustment based on the device coordinate relationship, thereby enabling the second camera device to capture the target subject in a timely manner, which helps to improve the shooting effect.
[0090] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0091] Corresponding to the camera equipment control method described in the above embodiments, Figure 5 shows a structural diagram of an embodiment of a camera equipment control device applied to a first camera equipment provided in this application.
[0092] In this embodiment of the application, a camera control device applied to a first camera device may include:
[0093] Information acquisition module 501 is used to acquire depth information of the target subject;
[0094] The coordinate determination module 502 is used to determine the first projected coordinates of the target subject based on the depth information of the target subject; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device;
[0095] The adjustment determination module 503 is used to determine the posture adjustment information of the second camera device based on the device coordinate relationship and the first projection coordinate; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0096] The information sending module 504 is used to send the posture adjustment information to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information.
[0097] In one specific implementation of this application embodiment, the apparatus further includes:
[0098] The coordinate acquisition module is used to acquire first coordinate information and second coordinate information; wherein, the first coordinate information is the world coordinate information of the first camera device, and the second coordinate information is the world coordinate information of the second camera device;
[0099] The relationship determination module is used to determine the device coordinate relationship based on the first coordinate information and the second coordinate information.
[0100] In one specific implementation of this application embodiment, the adjustment determination module includes:
[0101] The coordinate determination submodule is used to determine the second projection coordinates based on the device coordinate relationship and the first projection coordinates; wherein, the second projection coordinates are the coordinates of the target subject in the device coordinate system of the second camera device;
[0102] The adjustment determination submodule is used to determine the attitude adjustment information based on the second projection coordinates.
[0103] In one specific implementation of this application embodiment, the apparatus further includes:
[0104] The relationship update module is used to update the device coordinate relationship based on the attitude adjustment information to obtain the updated device coordinate relationship.
[0105] In one specific implementation of this application embodiment, the apparatus further includes:
[0106] The instruction receiving module is used to receive area focus instructions;
[0107] The instruction parsing module is used to parse the region focusing instruction to obtain the hot spot region;
[0108] The shooting control module is used to control the first camera device to shoot based on the hotspot area.
[0109] Corresponding to the camera device control method described in the above embodiments, Figure 6 shows a structural diagram of an embodiment of a camera device control device applied to a second camera device provided in this application.
[0110] In this embodiment of the application, a camera control device applied to a second camera device may include:
[0111] The information receiving module 601 is used to receive posture adjustment information; wherein, the posture adjustment information is determined by the first camera device based on the device coordinate relationship and the first projected coordinates of the target body, and the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device;
[0112] The posture adjustment module 602 is used to control the second camera device to perform posture adjustment based on the posture adjustment information.
[0113] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0114] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0115] Figure 7 shows a schematic block diagram of a camera device provided in an embodiment of this application. For ease of explanation, only the parts related to the embodiment of this application are shown.
[0116] As shown in FIG7, the camera device 7 of this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70. When the processor 70 executes the computer program 72, it implements the steps in the various camera device control method embodiments described above, such as steps S201 to S204 shown in FIG1, and steps S401 to S402 shown in FIG4. Alternatively, when the processor 70 executes the computer program 72, it implements the functions of each module / unit in the various device embodiments described above, such as the functions of modules 501 to 504 shown in FIG5, and modules 601 to 602 shown in FIG6.
[0117] For example, the computer program 72 may be divided into one or more modules / units, which are stored in the memory 71 and executed by the processor 70 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 72 in the camera device 7.
[0118] Those skilled in the art will understand that Figure 7 is merely an example of the camera device 7 and does not constitute a limitation on the camera device 7. It may include more or fewer components than shown, or combine certain components, or different components. For example, the camera device 7 may also include input / output devices, network access devices, buses, etc.
[0119] The processor 70 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0120] The memory 71 can be an internal storage unit of the camera device 7, such as a hard disk or memory of the camera device 7. The memory 71 can also be an external storage device of the camera device 7, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the camera device 7. Furthermore, the memory 71 can include both internal and external storage units of the camera device 7. The memory 71 is used to store the computer program and other programs and data required by the camera device 7. The memory 71 can also be used to temporarily store data that has been output or will be output.
[0121] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0122] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0123] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0124] In the embodiments provided in this application, it should be understood that the disclosed apparatus / camera device and method can be implemented in other ways. For example, the apparatus / camera device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0125] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0126] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0127] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals.
[0128] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. A method for controlling a camera device, characterized in that, Applied to a first camera device, the method includes: Obtain in-depth information about the target entity; Based on the depth information of the target subject, the first projected coordinates of the target subject are determined; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device; Based on the device coordinate relationship and the first projection coordinates, the posture adjustment information of the second camera device is determined; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; The posture adjustment information is sent to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information.
2. The camera equipment control method according to claim 1, characterized in that, Before determining the posture adjustment information of the second camera device based on the device coordinate relationship and the first projection coordinates, the method further includes: Obtain first coordinate information and second coordinate information; wherein, the first coordinate information is the world coordinate information of the first camera device, and the second coordinate information is the world coordinate information of the second camera device; Based on the first coordinate information and the second coordinate information, the coordinate relationship of the device is determined.
3. The camera equipment control method according to claim 1, characterized in that, The determination of the posture adjustment information of the second camera device based on the device coordinate relationship and the first projection coordinate includes: Based on the device coordinate relationship and the first projection coordinates, the second projection coordinates are determined; wherein, the second projection coordinates are the coordinates of the target subject in the device coordinate system of the second camera device; The attitude adjustment information is determined based on the second projection coordinates.
4. The camera equipment control method according to claim 1, characterized in that, After sending the posture adjustment information to the second camera device so that the second camera device can adjust its posture based on the posture adjustment information, the method further includes: Based on the attitude adjustment information, the device coordinate relationship is updated to obtain the updated device coordinate relationship.
5. The camera equipment control method according to claim 1, characterized in that, Also includes: Receive area focus command; The focus command for the area is parsed to obtain the hot spot area; Based on the hotspot area, the first camera device is controlled to take pictures.
6. A method for controlling a camera device, characterized in that, Applied to a second camera device, the method includes: Receive posture adjustment information; wherein the posture adjustment information is determined by the first camera device based on the device coordinate relationship and the first projected coordinates of the target body, and the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; Based on the posture adjustment information, the second camera device is controlled to adjust its posture.
7. A camera equipment control device, characterized in that, Applied to a first camera device, the device includes: The information acquisition module is used to acquire depth information of the target subject; The coordinate determination module is used to determine the first projected coordinates of the target subject based on the depth information of the target subject; wherein, the first projected coordinates are the coordinates of the target subject in the device coordinate system of the first camera device; The adjustment determination module is used to determine the posture adjustment information of the second camera device based on the device coordinate relationship and the first projection coordinates; wherein, the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; The information sending module is used to send the posture adjustment information to the second camera device, so that the second camera device can adjust its posture based on the posture adjustment information.
8. A camera equipment control device, characterized in that, Applied to a second camera device, the device includes: An information receiving module is used to receive posture adjustment information; wherein the posture adjustment information is determined by the first camera device based on the device coordinate relationship and the first projected coordinates of the target body, and the device coordinate relationship is the coordinate transformation relationship between the first camera device and the second camera device; The posture adjustment module is used to control the second camera device to adjust its posture based on the posture adjustment information.
9. A computer program product, characterized in that, It includes a computer program, which, when run, causes the camera device control method as described in any one of claims 1 to 6 to be executed.
10. A camera device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it causes the camera device to implement the steps of the camera device control method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Video monitoring system for multi-target tracking close-up shooting
CN102148965A
Tracking shooting method and device, computer equipment and storage medium thereof
CN117177053A
Camera in a Headframe for Object Tracking
US20140267775A1