Focus tracking photographing method and device, storage medium and electronic device
By calculating the actual distance between the shooting device and the subject in virtual space and automatically adjusting the focal length, the problem of low shooting efficiency in follow-focus shooting is solved, and efficient automatic follow-focus shooting is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-10
- Publication Date
- 2026-03-17
AI Technical Summary
Focusing is inefficient, and the current technology relies on manual adjustment of the focus, which leads to low efficiency.
By acquiring the target position coordinates of the target shooting device and the target focus object in the virtual space, calculating its actual distance in the real scene space, and sending the actual distance to the shooting device to instruct it to adjust the focus, automatic following shooting is achieved.
It improves the efficiency of focus tracking shooting, enables the shooting device to automatically adjust the focal length, and reduces the need for manual operation.
Smart Images

Figure CN116506731B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computers, and more specifically, to a focusing shooting method, apparatus, storage medium, and electronic device. Background Technology
[0002] In focus-following shooting scenarios, the focus is usually adjusted manually, but this manual method leads to low efficiency. Therefore, focus-following shooting suffers from low efficiency.
[0003] There is currently no effective solution to the above problems. Summary of the Invention
[0004] This application provides a focus-following shooting method, apparatus, storage medium, and electronic device to at least solve the technical problem of low focus-following shooting efficiency.
[0005] According to one aspect of the embodiments of this application, a focus-following shooting method is provided, comprising: acquiring target position coordinates of a target shooting device and a target focus-following object in a virtual space, wherein the virtual space is a space established based on a real scene space, the target shooting device and the target focus-following object are both located in the real scene space, and the target shooting device is used to follow and shoot the target focus-following object; calculating the actual distance between the target shooting device and the target focus-following object in the real scene space based on a first position coordinate corresponding to the target shooting device and a second position coordinate corresponding to the target focus-following object, wherein the target position coordinates include the first position coordinates and the second position coordinates; and sending the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow and shoot the target focus-following object.
[0006] According to another aspect of the embodiments of this application, a focus-following shooting device is also provided, comprising: a first acquisition unit, configured to acquire target position coordinates of a target shooting device and a target focus-following object in a virtual space, wherein the virtual space is a space established based on a real scene space, and the target shooting device and the target focus-following object are both located in the real scene space, and the target shooting device is configured to follow and shoot the target focus-following object; a calculation unit, configured to calculate the actual distance between the target shooting device and the target focus-following object in the real scene space based on a first position coordinate corresponding to the target shooting device and a second position coordinate corresponding to the target focus-following object, wherein the target position coordinates include the first position coordinates and the second position coordinates; and a first shooting unit, configured to send the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow and shoot the target focus-following object.
[0007] As an optional solution, the above-mentioned calculation unit includes: a first calculation module, used to calculate the difference between the lateral coordinate in the first position coordinate and the lateral coordinate in the second position coordinate to obtain the lateral distance between the target shooting device and the target focusing object in the virtual space; and to calculate the difference between the longitudinal coordinate in the first position coordinate and the longitudinal coordinate in the second position coordinate to obtain the longitudinal distance between the target shooting device and the target focusing object in the virtual space; and a second calculation module, used to calculate the actual distance based on the lateral distance and the longitudinal distance.
[0008] As an optional solution, the second calculation module includes: a first calculation submodule, used to calculate the sum of the squares of the horizontal distance and the vertical distance to obtain the square of the relative distance between the target shooting device and the target focusing object in the virtual space; and a second calculation submodule, used to perform proportional conversion on the relative distance to obtain the actual distance.
[0009] As an optional solution, the above-mentioned device further includes: a second acquisition unit, configured to acquire identity information of at least one shooting device and at least one focus object located in the real-world space before acquiring the target position coordinates of the target shooting device and the target focus object in the virtual space, wherein the at least one shooting device includes the target shooting device and the at least one focus object includes the target focus object; and a determination unit, configured to determine, before acquiring the target position coordinates of the target shooting device and the target focus object in the virtual space, a shooting device matching the first identity information from the at least one shooting device, and determine the shooting device matching the first identity information as the target shooting device, wherein the first identity information is the identity information of the target shooting device; and a focus object matching the second identity information from the at least one focus object, and determine the focus object matching the second identity information as the target focus object, wherein the second identity information is the identity information of the focus object.
[0010] As an optional solution, the second acquisition unit includes: a first receiving module for receiving optical signals uploaded by a motion capture lens, wherein the optical signals are infrared light signals reflected back by reflective markers configured on the surface of the target objects after the motion capture lens emits infrared light of a specific wavelength and illuminates at least two target objects, the reflective markers being used to mark the identity information, and the target objects including at least one shooting device and at least one focus target; or, a second receiving module for receiving recognition signals uploaded by an image recognition lens, wherein the recognition information is identity recognition information obtained by the image recognition lens after performing image recognition on each image acquired from the images of the at least two target objects, and the identity recognition information includes the identity information.
[0011] As an optional solution, the above-mentioned device further includes: an acquisition unit, configured to acquire a panoramic image set corresponding to the real scene space before acquiring the target position coordinates of the target shooting device and the target focusing object in the virtual space, wherein the panoramic image set includes multiple local images of the real scene space; and a construction unit, configured to construct a virtual three-dimensional space using the panoramic image set before acquiring the target position coordinates of the target shooting device and the target focusing object in the virtual space, and to determine the virtual three-dimensional space as the virtual space.
[0012] As an optional solution, the first acquisition unit includes: an acquisition module, used to acquire the target position coordinates in response to a follow-up shooting request, wherein the follow-up shooting request is used to request control of the target shooting device to follow and shoot the target focus object.
[0013] As an optional solution, the above-mentioned device further includes: a second shooting unit, used to calculate the actual distance between the target shooting device and the target focusing object in the real scene space based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, and then send the actual distance to the target shooting device to instruct the target shooting device to adjust the light intensity according to the actual distance and follow and shoot the target focusing object.
[0014] According to another aspect of the embodiments of this application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the focus-following shooting method described above.
[0015] According to another aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-described focus-following shooting method through the computer program.
[0016] In this embodiment, the target shooting device and the target focus object are obtained in a virtual space. The virtual space is a space established based on the real scene space. Both the target shooting device and the target focus object are located in the real scene space. The target shooting device is used to follow and shoot the target focus object. Based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focus object, the actual distance between the target shooting device and the target focus object in the real scene space is calculated. The target position coordinates include the first position coordinates and the second position coordinates. The actual distance is sent to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow and shoot the target focus object. By obtaining the coordinates in the virtual space, the actual distance between the shooting device and the focus object is determined, thereby achieving the purpose of instructing the shooting device to automatically adjust the focal length according to the actual distance. This achieves the technical effect of improving the focus shooting efficiency and solves the technical problem of low focus shooting efficiency. Attached Figure Description
[0017] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:
[0018] Figure 1 This is a schematic diagram of the application environment of an optional focus-following shooting method according to an embodiment of this application;
[0019] Figure 2 This is a schematic diagram of the flow of an optional focus-following shooting method according to an embodiment of this application;
[0020] Figure 3 This is a schematic diagram of an optional focus-following shooting method according to an embodiment of this application;
[0021] Figure 4 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0022] Figure 5 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0023] Figure 6 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0024] Figure 7 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0025] Figure 8 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0026] Figure 9 This is a schematic diagram of another optional focus-following shooting method according to an embodiment of this application;
[0027] Figure 10 This is a schematic diagram of an optional focus-following shooting device according to an embodiment of this application;
[0028] Figure 11 This is a schematic diagram of the structure of an optional electronic device according to an embodiment of this application. Detailed Implementation
[0029] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0031] For ease of understanding, the following terms are explained:
[0032] Artificial intelligence (AI) is the theory, methods, technology, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess the functions of perception, reasoning, and decision-making.
[0033] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily include computer vision, speech processing, natural language processing, and machine learning / deep learning.
[0034] Computer vision (CV) is a science that studies how to enable machines to "see." More specifically, it refers to machine vision, which uses cameras and computers to replace human eyes in tasks such as target recognition, tracking, and measurement, and further performs image processing to create images more suitable for human observation or transmission to instruments. As a scientific discipline, computer vision studies related theories and technologies, attempting to build artificial intelligence systems capable of extracting information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, 3D object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping (SLAM), and common biometric recognition technologies such as facial recognition and fingerprint recognition.
[0035] Machine learning (ML) is a multidisciplinary field involving probability theory, statistics, approximation theory, convex analysis, and algorithm complexity theory. It specifically studies how computers can simulate or implement human learning behavior to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is the core of artificial intelligence and the fundamental way to endow computers with intelligence; its applications span all areas of artificial intelligence. Machine learning and deep learning typically include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and instructional learning.
[0036] With the research and advancement of artificial intelligence (AI) technology, AI is being studied and applied in various fields, such as smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, autonomous driving, drones, robots, smart healthcare, and smart customer service. It is believed that with the development of technology, AI will be applied in more fields and play an increasingly important role.
[0037] The solutions provided in this application involve artificial intelligence technologies such as computer vision and machine learning, which are specifically illustrated through the following embodiments:
[0038] According to one aspect of the embodiments of this application, a focus-following shooting method is provided. Optionally, as an optional implementation, the above-described focus-following shooting method may be applied to, but is not limited to, [examples of other methods]. Figure 1 The environment shown may include, but is not limited to, user equipment 102 and server 112. User equipment 102 may include, but is not limited to, a display 104, a processor 106 and a memory 108. Server 112 includes a database 114 and a processing engine 116.
[0039] The specific process can be summarized in the following steps:
[0040] In step S102, the user equipment 102 acquires the target position coordinates of the target shooting device 1002 and the target focusing object 1004 in the virtual space;
[0041] Steps S104-S106: Send the target location coordinates to the server 112 via network 110;
[0042] In step S108, server 112 calculates the actual distance between the target shooting device and the target focusing object in the real-world space through processing engine 116;
[0043] In steps S110-S112, the actual distance is sent to the user equipment 102 via the network 110. The user equipment 102 uses the actual distance through the processor 106 to adjust the focus, follow the shooting target 1004, display the captured image on the display 108, and store the actual distance in the memory 104.
[0044] remove Figure 1 Beyond the examples shown, the above steps can be completed independently by the client or server, or collaboratively by both, such as by user equipment 102 performing the actual distance calculation steps, thereby reducing the processing load on server 112. User equipment 102 includes, but is not limited to, handheld devices (such as mobile phones), laptops, desktop computers, and in-vehicle devices; this application does not limit the specific implementation of user equipment 102.
[0045] Alternatively, as an alternative implementation method, such as Figure 2 As shown, the focus-following shooting method includes:
[0046] S202, obtain the target position coordinates of the target shooting device and the target focus object in the virtual space, wherein the virtual space is a space established based on the real scene space, and the target shooting device and the target focus object are both located in the real scene space, and the target shooting device is used to follow and shoot the target focus object.
[0047] S204, based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, calculate the actual distance between the target shooting device and the target focusing object in the real scene space, wherein the target position coordinates include the first position coordinates and the second position coordinates;
[0048] S206 sends the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow the shooting target.
[0049] Optionally, in this embodiment, the above-mentioned focus-following shooting method can be applied, but is not limited to, in environments where multiple objects need to be followed or where objects are in violent motion. By combining motion capture technology with virtual shooting technology, a correspondence between the object being photographed (focus object) and the camera (shooting device) is established in virtual shooting based on light-emitting diodes (LEDs) (the actual distance between the camera and the object being photographed is known), multiple objects being photographed are automatically identified, and the camera is controlled in real time to quickly focus on any one of the objects, and the focus point can be easily switched to achieve automatic and efficient focus-following shooting.
[0050] Optionally, in this embodiment, the target shooting device is used to follow and shoot the target focus object. To improve the shooting efficiency of the device, the target shooting device can, but is not limited to, automatically or semi-automatically follow and shoot the target focus object. The automatic following and shooting can, but is not limited to, controlling the target shooting device to automatically follow the designated focus object (target focus object) and automatically adjusting the focus during the following process. The semi-automatic following and shooting can, but is not limited to, being manually controlled by the user to automatically follow the designated focus object, but automatically adjusting the focus during the following process.
[0051] Optionally, in this embodiment, the virtual space is a space established based on the real scene space. The difference between the virtual space and the real scene space may be, but is not limited to, that the real scene space is the physical space that the shooting device can actually capture, while the virtual space is a simulated space constructed based on the images captured by the shooting device, used to simulate the real scene space. The virtual space is also configured with the system's coordinate system, which can determine the coordinate positions of each target body located in the real scene space on the coordinate system.
[0052] Optionally, in this embodiment, after obtaining the target position coordinates of the target shooting device and the target focus object in the virtual space, the relative positional relationship between the target shooting device and the target focus object can be calculated based on the target position coordinates, but is not limited to this calculation. Then, the direction information of the target focus object relative to the target shooting device is determined based on this relative positional relationship to instruct the target shooting device to adjust its shooting orientation. That is, the relative positional relationship between the target shooting device and the target focus object is calculated based on the target position coordinates, and this relationship is sent to the target shooting device to instruct it to adjust its orientation according to the relative positional relationship and follow the target focus object. Thus, the target shooting device can automatically adjust its shooting orientation based on the target position coordinates and adjust its orientation in real time according to the position of the target focus object, maintaining continuous shooting and improving the efficiency of the shooting process.
[0053] To further illustrate, the target imaging device may optionally be equipped with a mechanical device (such as motion control) that can respond to control commands. After receiving the orientation control command issued by the processor, the mechanical device will deform its posture or move its position. The purpose of this is to adjust the orientation of the target imaging device. The processor can be understood, but is not limited to, as being deployed in the target imaging device and responsible for processing various types of information received (such as actual distance, relative position relationship, etc.) into corresponding control commands to directly or indirectly control the target imaging device to adjust relevant data.
[0054] It should be noted that by obtaining the coordinates in the virtual space, the actual distance between the shooting device and the object being focused is determined, and the shooting device is further instructed to automatically adjust the focus according to the actual distance, thereby improving the efficiency of focus tracking shooting.
[0055] To further illustrate, optional examples include... Figure 3As shown, the target shooting device 302 and the target focus object 304 are obtained in the virtual space. The virtual space is a space established based on the real scene space 306. Both the target shooting device 302 and the target focus object 304 are located in the real scene space 306. The target shooting device 302 is used to follow and shoot the target focus object 304. Based on the first position coordinates corresponding to the target shooting device 302 and the second position coordinates corresponding to the target focus object 304, the actual distance 308 between the target shooting device 302 and the target focus object 304 in the real scene space 306 is calculated. The target position coordinates include the first position coordinates and the second position coordinates. The actual distance 308 is sent to the target shooting device 302 to instruct the target shooting device 302 to adjust the focal length according to the actual distance 308 and follow and shoot the target focus object 304.
[0056] The embodiments provided in this application obtain the target position coordinates of the target shooting device and the target focus object in a virtual space. The virtual space is a space established based on the real scene space, and both the target shooting device and the target focus object are located in the real scene space. The target shooting device is used to follow and shoot the target focus object. Based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focus object, the actual distance between the target shooting device and the target focus object in the real scene space is calculated. The target position coordinates include the first position coordinates and the second position coordinates. The actual distance is sent to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow and shoot the target focus object. By obtaining the coordinates in the virtual space, the actual distance between the shooting device and the focus object is determined, thereby achieving the purpose of instructing the shooting device to automatically adjust the focal length according to the actual distance, thus realizing the technical effect of improving the focus shooting efficiency.
[0057] As an optional approach, based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, the actual distance between the target shooting device and the target focusing object in the real-world space is calculated, including:
[0058] S1, calculate the difference between the horizontal coordinate in the first position coordinate and the horizontal coordinate in the second position coordinate to obtain the horizontal distance between the target shooting device and the target focusing object in the virtual space; and calculate the difference between the vertical coordinate in the first position coordinate and the vertical coordinate in the second position coordinate to obtain the vertical distance between the target shooting device and the target focusing object in the virtual space.
[0059] S2 calculates the actual distance based on the horizontal and vertical distances.
[0060] Optionally, in this embodiment, to improve focusing efficiency, the actual distance is calculated using horizontal and vertical coordinates;
[0061] To further illustrate, optional examples include... Figure 4 As shown, the difference between the lateral coordinates of the target shooting device 402 in the virtual space 406 and the lateral coordinates of the target focusing object 404 in the virtual space 406 is calculated to obtain the lateral distance between the target shooting device 402 and the target focusing object 404 in the virtual space 406; and the difference between the longitudinal coordinates of the target shooting device 402 in the virtual space 406 and the longitudinal coordinates of the target focusing object 404 in the virtual space 406 is calculated to obtain the longitudinal distance between the target shooting device 402 and the target focusing object 404 in the virtual space 406; based on the lateral distance and the longitudinal distance, the actual distance is calculated.
[0062] Optionally, in this embodiment, to improve focusing accuracy, a multi-dimensional coordinate method is used to calculate the actual distance, such as using x-axis coordinates, y-axis coordinates, and z-axis coordinates in a three-dimensional coordinate system to calculate the actual distance;
[0063] To further illustrate, optional examples include... Figure 5 As shown, the difference between the horizontal coordinate of the target shooting device 502 in the virtual space 506 and the X coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the X distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; and the difference between the vertical coordinate of the target shooting device 502 in the virtual space 506 and the Y coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the Y distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; and the difference between the vertical coordinate of the target shooting device 502 in the virtual space 506 and the Z coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the Z distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; based on the X distance, Y distance, and Z distance, the actual distance is calculated.
[0064] It should be noted that the method for calculating the actual distance can be chosen based on actual needs. For example, if there is a high demand for shooting accuracy, the actual distance can be calculated based on the X distance, Y distance, and Z distance. Conversely, if there is a low demand for shooting accuracy but a high demand for shooting efficiency, the actual distance can be calculated based on the horizontal distance and the vertical distance, thereby improving the flexibility of the actual distance calculation.
[0065] As an optional approach, the actual distance is calculated based on the horizontal and vertical distances, including:
[0066] S1, calculate the sum of the squares of the horizontal distance and the vertical distance to obtain the square of the relative distance between the target shooting device and the target focusing object in the virtual space;
[0067] S2, perform a proportional conversion on the relative distance to obtain the actual distance.
[0068] To further illustrate, optional examples include... Figure 4 As shown, the sum of the squares of the horizontal distance and the vertical distance is calculated to obtain the square of the relative distance 408 between the target shooting device 402 and the target focusing object 404 in the virtual space; the relative distance 408 is then proportionally converted to obtain the actual distance.
[0069] Optionally, in this embodiment, for example Figure 5 As shown, the sum of the squares of the X-axis distance, the Y-axis distance, and the Z-axis distance is calculated to obtain the square of the relative distance 508 between the target shooting device 502 and the target focusing object 504 in virtual space; the relative distance 508 is then proportionally converted to obtain the actual distance.
[0070] The embodiments provided in this application calculate the sum of the squares of the horizontal distance and the vertical distance to obtain the square of the relative distance between the target shooting device and the target focusing object in the virtual space; the relative distance is proportionally converted to obtain the actual distance. By using the proportional conversion between the virtual space and the real scene space, the actual distance can be determined efficiently, thereby achieving the technical effect of improving the calculation efficiency of the actual distance.
[0071] As an optional approach, before obtaining the target position coordinates of the target imaging device and the target focusing object in virtual space, the method further includes:
[0072] S1, obtain the identity information of at least one shooting device and at least one focus-following object located in the real scene space, wherein at least one shooting device includes a target shooting device and at least one focus-following object includes a target focus-following object;
[0073] S2, determine from at least one shooting device that matches the first identity information, and determine the shooting device that matches the first identity information as the target shooting device, wherein the first identity information is the identity information of the target shooting device; determine from at least one focusing object that matches the second identity information, and determine the focusing object that matches the second identity information as the target focusing object, wherein the second identity information is the identity information of the focusing object.
[0074] Optionally, in this embodiment, each target object (at least one shooting device and at least one focus-following object) located in the real-world space may be configured with its own unique identification information, and the unique identification information may be used to determine the target shooting device and the target focus-following object used by the target shooting device for following the shooting.
[0075] As an optional approach, the identification information of at least one shooting device and at least one focus-tracking object located in the real-world space is obtained, including:
[0076] The system receives optical signals uploaded by a motion capture lens. The optical signals are infrared light signals reflected back by reflective markers on the surface of the target objects after the motion capture lens illuminates at least two target objects with infrared light of a specific wavelength emitted by the lens. The reflective markers are used to mark identity information. The target objects include at least one shooting device and at least one focus target.
[0077] Optionally, in this embodiment, to improve the efficiency of identity information collection, the motion capture camera can be deployed in a wide-angle position so that the emitted infrared light of a specific wavelength can illuminate each target body, thereby achieving comprehensive information collection.
[0078] To further illustrate, optional examples include... Figure 6 As shown, the motion capture lens 602 emits infrared light of a specific wavelength, which is then irradiated onto at least two targets (at least one shooting device and at least one focus target). The infrared light signal is reflected back by reflective markers configured on the surface of the targets. The reflective markers are used to mark identity information.
[0079] Optionally, in this embodiment, the reflective markers configured on the surface of the target object can, but are not limited to, be created as custom steel props (e.g., 5 markers defining 6 degrees of freedom in the steel prop, with different relative positions of the markers). Different objects are assigned different marker positions. When the motion capture camera recognizes different arrangements of markers, it can distinguish objects based on different feature points. For example... Figure 7 The different plates A, B, C, D, E, and F shown are used as different reflective markers on the surface of the target object;
[0080] To further illustrate, optionally based on Figure 7 As shown, continue for example Figure 8 As shown, different reflective markers are deployed on different target objects. For example, the reflective markers of plate A are deployed on the target shooting device 802, and the reflective markers of plate B are deployed on the target focusing object 804.
[0081] As an optional approach, the identification information of at least one shooting device and at least one focus-tracking object located in the real-world space is obtained, including:
[0082] The system receives recognition signals uploaded by an image recognition lens, wherein the recognition information is the identity recognition information obtained by the image recognition lens after performing image recognition on each image acquired from at least two target images, and the identity recognition information includes identity information.
[0083] Optionally, in this embodiment, different targets may be equipped with QR codes with different patterns, or different objects in the scene may be directly identified through image analysis.
[0084] Optionally, in this embodiment, image recognition technology may be, but is not limited to, based on the main features of an image. Each image has its own features. Studies of eye movements during image recognition show that the gaze is always focused on the main features of the image, that is, on the places where the curvature of the image contour is greatest or where the contour direction changes abruptly. These places contain the most information. Moreover, the scanning path of the eye always moves sequentially from one feature to another. Therefore, in the process of image recognition, the perceptual mechanism must filter out redundant input information and extract key information. Simultaneously, there must be a mechanism in the brain responsible for integrating information, which can organize the information obtained in stages into a complete perceptual image.
[0085] The embodiments provided in this application receive optical signals uploaded by a motion capture lens, wherein the optical signals are infrared light signals reflected back by reflective markers configured on the surface of the target objects after the motion capture lens illuminates at least two target objects with infrared light of a specific wavelength emitted by the motion capture lens. The reflective markers are used to mark identity information, and the target objects include at least one shooting device and at least one focus target; or, an identification signal uploaded by an image recognition lens is received, wherein the identification information is identity recognition information obtained by the image recognition lens after performing image recognition on each image acquired from at least two target object images. The identity recognition information includes identity information, thereby achieving the purpose of obtaining identity information with high flexibility using different methods, and thus realizing the technical effect of improving the flexibility of obtaining identity information.
[0086] As an optional approach, before obtaining the target position coordinates of the target imaging device and the target focusing object in virtual space, the method further includes:
[0087] S1, Collect a panoramic image set corresponding to the real scene space, wherein the panoramic image set includes multiple local images within the real scene space;
[0088] S2 uses a panoramic image set to construct a virtual three-dimensional space and defines the virtual three-dimensional space as a virtual space.
[0089] Optionally, in this embodiment, to improve the accuracy of the position coordinates, a virtual three-dimensional space can be pre-constructed, and the three-dimensional position coordinates of the shooting device and the target focusing object in the virtual space can be obtained using the virtual three-dimensional space.
[0090] To further illustrate, optional examples include... Figure 5As shown, the difference between the horizontal coordinate of the target shooting device 502 in the virtual space 506 and the X coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the X distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; and the difference between the vertical coordinate of the target shooting device 502 in the virtual space 506 and the Y coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the Y distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; and the difference between the vertical coordinate of the target shooting device 502 in the virtual space 506 and the Z coordinate of the target focusing object 504 in the virtual space 506 is calculated to obtain the Z distance between the target shooting device 502 and the target focusing object 504 in the virtual space 506; based on the X distance, Y distance, and Z distance, the actual distance is calculated.
[0091] The embodiments provided in this application collect a panoramic image set corresponding to the real scene space, wherein the panoramic image set includes multiple local images within the real scene space; a virtual three-dimensional space is constructed using the panoramic image set, and the virtual three-dimensional space is determined as a virtual space, thereby achieving the purpose of accurately obtaining the position coordinates, thus realizing the technical effect of improving the accuracy of obtaining the position coordinates.
[0092] As an optional approach, the target position coordinates of the target imaging device and the target focusing object in virtual space are obtained, including:
[0093] In response to a follow-up shooting request, the target position coordinates are obtained. The follow-up shooting request is used to request control of the target shooting device to follow and shoot the target focusing object.
[0094] Optionally, in this embodiment, the user can trigger a specific follow-shooting request to specify any one or more shooting devices to perform follow-shooting and automatic focus on any one or more focus objects.
[0095] As an optional approach, after calculating the actual distance between the target shooting device and the target focusing object in the real-world space based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, the method further includes:
[0096] The actual distance is sent to the target shooting device to instruct the target shooting device to adjust the light intensity according to the actual distance and follow the shooting target and focus on the object.
[0097] Optionally, in this embodiment, to improve the diversity of shooting, adaptive adjustment of light intensity can be configured in addition to focus tracking, so that high-quality follow shooting can be achieved in some environments with high light requirements.
[0098] The embodiments provided in this application send the actual distance to the target shooting device to instruct the target shooting device to adjust the light intensity according to the actual distance and follow the shooting target and focus object, thereby achieving the purpose of adaptively adjusting the light intensity of the shooting, thereby realizing the technical effect of improving the diversity of shooting.
[0099] As an alternative solution, for ease of understanding, the above-mentioned focus-following shooting method is applied to LED-based virtual shooting scenarios. This is used in environments where multiple objects need to be followed or where objects are in violent motion. By combining motion capture technology with virtual shooting technology, a correspondence between the object being shot and the camera is established in LED-based virtual shooting (understanding the actual distance between the camera and the object being shot). Multiple objects are automatically identified, and the camera is controlled in real time to quickly focus on any one of them, making it easy to switch focus points.
[0100] Optionally, in this embodiment, the focal point, sometimes also called the image point in geometric optics, is the point where light rays from the source converge after passing through the objective lens. However, the focal point is only a conceptual point; in reality, it exists in a spatial range called the circle of haze. Points within the "minimum circle of haze" can be considered "focus points" or "in focus," while those outside the circle are considered "out of focus." Out-of-focus objects can be considered a shooting problem in some situations. A dedicated adjustment ring on the camera lens, called the "focus ring," controls the position of the focus point. This adjustment of the "focus ring" is called "focus tracking." LED virtual production refers to using a high-performance, small-pitch LED display as a background wall. Through a real-time rendering engine, a multi-screen synchronized real-time rendering method is used. A camera's internal and external parameters are synchronized to render a high-quality 3D scene onto the LED background wall. The real-time rendering engine adjusts and synchronizes the lighting, scene machinery, and other shooting equipment on site, which are then directly filmed by the camera. The real actor performances and props are then composited with the LED background wall in real time, thereby achieving... A new "what you see is what you get" filmmaking method; motion capture technology is used to accurately measure the motion of objects in three-dimensional space. Based on computer graphics, it records the motion of capture devices (mainly sensors) through images or other forms. It records the spatial coordinates of objects at different times to obtain their motion. Then, combined with 3D assets and skeletal rigging, objects in virtual space can simulate realistic movement. This technology has wide applications in film virtualization, digital humans, and 3D animation. It requires a certain number of motion capture cameras (forming a three-dimensional environment) to identify reflective markers within the three-dimensional environment.
[0101] To further illustrate, the optional based on Figure 6 The scenario shown continues, for example... Figure 9As shown, screen 902 represents LED-based virtual shooting. Virtual images are rendered on screen 902 in real time to coordinate with foreground figures and scenery for filming. In this shooting environment, the camera (such as the target object 302) captures the foreground object and the virtual background content displayed on screen 902. The foreground object needs to be in focus; the camera is equipped with a focus tracking device to respond to focus data calculated from external devices and apply it to the focus ring, enabling accurate focus on the subject (such as the target focus object 304).
[0102] In addition, a motion capture lens 602 is mounted above the screen 902, which constructs a virtual 3D environment and captures the motion trajectory of objects in the current environment, as well as identifying the objects. The objects being followed and the camera used for shooting are attached with identification tags. These tags allow the system to know the number of the currently followed object, and through these numbers, the corresponding focus object can be identified. Each tag has distinct reflective markings at different positions; these different positions serve as identification attributes, allowing the system to distinguish the different tag numbers. Furthermore, the system can record the trajectory of these tags in the virtual 3D space in real time and calculate the distance between these trajectories and the camera in real time, feeding this information back to the focusing device deployed on the target focus object 304, enabling it to focus on that object in real time.
[0103] Optionally, in this embodiment, after the system is set up, it is necessary to obtain the position information of various objects in the current state, including the position information of the camera and the position information of the object to be followed. Through the motion capture system, the position of the markers attached to the object and the camera in three-dimensional space can be obtained. Each marker will have a number set by the system. The user needs to set a custom name for each number so that the number corresponds to the specific object to be followed. Considering that the marker is usually located on the surface of the object (rather than the center), it usually has some offset. In the software, the user can also customize the offset data to achieve more accurate focusing (the focus is usually not a specific point, but a certain range of "depth of field". If the "depth of field" is shallow, but the object is large, it is possible that the front half of the object is in the depth of field, but the back half is out of focus. If this is the case, the focus point cannot be completely focused on the marker, and a certain offset is required to make it focus on the center of the object).
[0104] Optionally, in this embodiment, after obtaining the relative position information and motion information, it is necessary to calculate the distance between all followed objects and the camera. By mapping the positional relationships in the virtual 3D space to the real space, a scale is constructed (this step is actually completed when building the motion capture system). By calculating the straight-line distance between the highlights in the virtual space and converting it into actual distance using the scale, the distance between any followed object and the camera can be obtained.
[0105] Optionally, in this embodiment, after completing the above preparations, the user only needs to select an object to be followed on the software interface. The software will automatically calculate the distance between the object and the camera based on the above logic and continuously feed the data back to the camera's focus tracker in real time. The focus tracker will continuously adjust the focus based on the received data to achieve dynamic and real-time focusing of the object. If the user needs to switch the focus point, they only need to reselect the object to be followed.
[0106] Optionally, in this embodiment, an optical motion capture camera principle is adopted. This principle is also based on computer vision, using multiple lenses to observe and locate specific marker points to obtain their spatial positions. Infrared lights on the optical motion capture lens panel emit infrared light of a specific wavelength, illuminating the target (reflective marker point). The reflective material on the surface of the marker point reflects the infrared light back to the lens. The reflected infrared light undergoes signal processing, and the FPGA performs image capture and algorithm processing to obtain the two-dimensional coordinates of the reflective marker point within the lens. A typical motion capture system has multiple motion capture lenses. These lenses sample the same set of infrared motion point data to calculate the position of each lens, thus obtaining the three-dimensional coordinates of each motion capture camera. Finally, the origin coordinates of the virtual space are matched with the real LED scene. This yields the relative positional relationship between the motion capture camera and the LED ring screen.
[0107] Optionally, in this embodiment, after obtaining the positional relationship between the virtual space and the real space, the next step is to apply the principle of optical motion capture. The captured object can be created as a custom rigid prop (e.g., 5 mark points determine the 6 degrees of freedom of the rigid body, with different relative positional relationships between the points). Different objects are assigned different point positions. When the motion capture camera recognizes different arrangements of mark points, it can distinguish objects based on different feature points. For example, the different plates A, B, C, D, E, and F below can be used as the standard for defining objects.
[0108] Furthermore, since both the camera and the subject have markings, their positional relationship can be obtained in the motion capture system. Once a virtual positional correspondence is established in the virtual 3D space, the coordinates of the objects in 3D space are obtained. The relative distance between the two can be calculated using the Pythagorean theorem, and then converted to the real position using a ratio (this step is automatically completed when the motion capture system is built), thus obtaining the real distance.
[0109] The embodiments provided in this application enable rapid and precise focus switching, and the switching speed can be defined in the software to achieve smoother adjustments than manual adjustments, without requiring the object to be followed to appear in the camera's view. Furthermore, this embodiment does not limit the number of "following markers," allowing for an unlimited number of following points and cameras to simultaneously capture images (as long as the following markers in the scene can be identified). Moreover, (as long as the following markers are visible to the motion capture camera), the object can be followed in real-time regardless of its speed within the area. This achieves the goal of combining motion capture technology with virtual shooting technology to establish a correspondence between the object being filmed and the camera (understanding the actual distance between the camera and the object) in LED-based virtual shooting. It automatically identifies multiple objects and controls the camera to quickly focus on any one of them in real-time, facilitating focus switching and thus improving shooting efficiency.
[0110] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0111] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0112] According to another aspect of the embodiments of this application, a focusing shooting apparatus for implementing the above-described focusing shooting method is also provided. For example... Figure 10 As shown, the device includes:
[0113] The first acquisition unit 1002 is used to acquire the target position coordinates of the target shooting device and the target focusing object in the virtual space. The virtual space is a space established based on the real scene space. The target shooting device and the target focusing object are both located in the real scene space. The target shooting device is used to follow and shoot the target focusing object.
[0114] The calculation unit 1004 is used to calculate the actual distance between the target shooting device and the target focusing object in the real scene space based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object. The target position coordinates include the first position coordinates and the second position coordinates.
[0115] The first shooting unit 1006 is used to send the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow the shooting target.
[0116] For specific implementation examples, please refer to the example shown in the above-described focus-following shooting device; further details will not be repeated here.
[0117] As an optional solution, computing unit 1004 includes:
[0118] The first calculation module is used to calculate the difference between the horizontal coordinate in the first position coordinate and the horizontal coordinate in the second position coordinate to obtain the horizontal distance between the target shooting device and the target focusing object in the virtual space; and to calculate the difference between the vertical coordinate in the first position coordinate and the vertical coordinate in the second position coordinate to obtain the vertical distance between the target shooting device and the target focusing object in the virtual space.
[0119] The second calculation module is used to calculate the actual distance based on the horizontal and vertical distances.
[0120] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0121] As an optional solution, the second computing module includes:
[0122] The first calculation submodule is used to calculate the sum of the squares of the horizontal distance and the vertical distance to obtain the square of the relative distance between the target shooting device and the target focusing object in the virtual space.
[0123] The second calculation submodule is used to perform proportional conversion on the relative distance to obtain the actual distance.
[0124] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0125] As an optional solution, the device also includes:
[0126] The second acquisition unit is used to acquire the identity information of at least one shooting device and at least one focus object located in the real scene space before acquiring the target position coordinates of the target shooting device and the target focus object in the virtual space, wherein at least one shooting device includes the target shooting device and at least one focus object includes the target focus object.
[0127] The determining unit is configured to, before acquiring the target position coordinates of the target shooting device and the target focusing object in the virtual space, determine from at least one shooting device a shooting device that matches first identity information, and determine the shooting device that matches the first identity information as the target shooting device, wherein the first identity information is the identity information of the target shooting device; and determine from at least one focusing object a focusing object that matches second identity information, and determine the focusing object that matches the second identity information as the target focusing object, wherein the second identity information is the identity information of the focusing object.
[0128] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0129] As an optional solution, the second acquisition unit includes:
[0130] The first receiving module is used to receive optical signals uploaded by the motion capture lens. The optical signals are infrared light signals reflected back from reflective markers on the surface of at least two target objects after the motion capture lens emits infrared light of a specific wavelength. These reflective markers are used to mark identification information. The target objects include at least one shooting device and at least one object being tracked.
[0131] The second receiving module is used to receive the recognition signal uploaded by the image recognition lens. The recognition information is the identity recognition information obtained by the image recognition lens after performing image recognition on each image acquired from at least two target images. The identity recognition information includes identity information.
[0132] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0133] As an optional solution, the device also includes:
[0134] The acquisition unit is used to acquire a panoramic image set corresponding to the real scene space before acquiring the target position coordinates of the target shooting device and the target focusing object in the virtual space. The panoramic image set includes multiple local images in the real scene space.
[0135] The construction unit is used to construct a virtual three-dimensional space using a panoramic image set before acquiring the target position coordinates of the target shooting device and the target focusing object in the virtual space, and to define the virtual three-dimensional space as the virtual space.
[0136] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0137] As an optional solution, the first acquisition unit 1002 includes:
[0138] The acquisition module is used to obtain the target position coordinates in response to the follow-shoot request. The follow-shoot request is used to request control of the target shooting device to follow and shoot the target focusing object.
[0139] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0140] As an optional solution, the device also includes:
[0141] The second shooting unit is used to calculate the actual distance between the target shooting device and the target focusing object in the real scene space based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, and then send the actual distance to the target shooting device to instruct the target shooting device to adjust the light intensity according to the actual distance and follow the target focusing object.
[0142] For specific implementation examples, please refer to the examples shown in the above focus-following shooting method. These examples will not be repeated here.
[0143] According to another aspect of the embodiments of this application, an electronic device for implementing the above-described focusing and shooting method is also provided, such as... Figure 11 As shown, the electronic device includes a memory 1102 and a processor 1104. The memory 1102 stores a computer program, and the processor 1104 is configured to execute the steps of any of the above method embodiments via the computer program.
[0144] Optionally, in this embodiment, the aforementioned electronic device may be located in at least one of a plurality of network devices in a computer network.
[0145] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:
[0146] S1, obtain the target position coordinates of the target shooting device and the target focus object in the virtual space. The virtual space is a space established based on the real scene space. The target shooting device and the target focus object are both located in the real scene space. The target shooting device is used to follow and shoot the target focus object.
[0147] S2, based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, calculate the actual distance between the target shooting device and the target focusing object in the real scene space, wherein the target position coordinates include the first position coordinates and the second position coordinates;
[0148] S3 sends the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow the shooting target.
[0149] Alternatively, as those skilled in the art will understand, Figure 11 The structure shown is for illustrative purposes only. Electronic devices can also be smartphones (such as Android phones, iOS phones, etc.), tablets, PDAs, and other user devices such as mobile internet devices (MIDs) and tablets. Figure 11 This does not limit the structure of the aforementioned electronic devices. For example, the electronic device may also include components that are more... Figure 11 The more or fewer components shown (such as network interfaces, etc.), or having the same Figure 11 The different configurations shown.
[0150] The memory 1102 can be used to store software programs and modules, such as the program instructions / modules corresponding to the focus-following shooting method and apparatus in this embodiment. The processor 1104 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102, thereby realizing the aforementioned focus-following shooting method. The memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1102 may further include memory remotely located relative to the processor 1104, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Specifically, the memory 1102 may be used, but is not limited to, to store information such as target location coordinates, virtual space, and actual distance. As an example, such as... Figure 11 As shown, the memory 1102 may include, but is not limited to, the first acquisition unit 1002, the calculation unit 1004, and the first shooting unit 1006 in the aforementioned focus-following shooting device. Furthermore, it may include, but is not limited to, other module units in the aforementioned focus-following shooting device, which will not be elaborated upon in this example.
[0151] Optionally, the transmission device 1106 described above is used to receive or send data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 1106 includes a Network Interface Controller (NIC), which can be connected to other network devices and a router via a network cable to communicate with the Internet or a local area network. In another example, the transmission device 1106 is a radio frequency (RF) module, used for wireless communication with the Internet.
[0152] In addition, the aforementioned electronic device also includes: a display 1108 for displaying information such as the target location coordinates, virtual space, and actual distance; and a connection bus 1110 for connecting various module components in the aforementioned electronic device.
[0153] In other embodiments, the aforementioned user equipment or server can be a node in a distributed system, wherein the distributed system can be a blockchain system, which is a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer (P2P) network, and any form of computing device, such as a server, terminal, or other electronic device, can become a node in the blockchain system by joining this peer-to-peer network.
[0154] According to one aspect of this application, a computer program product is provided, comprising a computer program / instructions containing program code for performing the methods shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions provided in embodiments of this application.
[0155] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0156] It should be noted that the computer system of the electronic device is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0157] A computer system includes a Central Processing Unit (CPU), which performs various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) or loaded from RAM. ROM also stores various programs and data required for system operation. The CPU, ROM, and RAM are interconnected via a bus. Input / output interfaces (I / O interfaces) are also connected to the bus.
[0158] The following components are connected to the input / output interface: input sections including keyboards, mice, etc.; output sections including cathode ray tubes (CRTs), liquid crystal displays (LCDs), and speakers; storage sections including hard drives; and communication sections including network interface cards such as LAN cards and modems. The communication section performs communication processing via a network such as the Internet. Drives are also connected to the input / output interface as needed. Removable media, such as disks, optical discs, magneto-optical discs, semiconductor memories, etc., are installed on the drive as needed so that computer programs read from them can be installed into the storage section as required.
[0159] Specifically, according to embodiments of this application, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions defined in the system of this application.
[0160] According to one aspect of this application, a computer-readable storage medium is provided, wherein a processor of a computer device reads computer instructions from the computer-readable storage medium, and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative implementations described above.
[0161] Optionally, in this embodiment, the computer-readable storage medium described above may be configured to store a computer program for performing the following steps:
[0162] S1, obtain the target position coordinates of the target shooting device and the target focus object in the virtual space. The virtual space is a space established based on the real scene space. The target shooting device and the target focus object are both located in the real scene space. The target shooting device is used to follow and shoot the target focus object.
[0163] S2, based on the first position coordinates corresponding to the target shooting device and the second position coordinates corresponding to the target focusing object, calculate the actual distance between the target shooting device and the target focusing object in the real scene space, wherein the target position coordinates include the first position coordinates and the second position coordinates;
[0164] S3 sends the actual distance to the target shooting device to instruct the target shooting device to adjust the focal length according to the actual distance and follow the shooting target.
[0165] Optionally, in this embodiment, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0166] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0167] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.
[0168] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0169] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.
[0170] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0171] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0172] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A method of focus tracking photography, characterized by, The method comprises the following steps: acquiring target position coordinates of a target shooting device and a target follow-focus object in a virtual space, wherein the virtual space is a space established according to a real scene space, the target shooting device and the target follow-focus object are both located in the real scene space, the target shooting device is used for following shooting of the target follow-focus object and virtual content displayed on a screen, and a virtual picture is rendered on the screen in real time; calculating an actual distance between the target shooting device and the target follow-focus object in the real scene space based on first position coordinates of a mark number follow card on the target shooting device in the virtual space, second position coordinates of a mark number follow card on the target follow-focus object in the virtual space, and offset data, wherein the target position coordinates comprise the first position coordinates and the second position coordinates, a number corresponding to the mark number follow card on the target shooting device is different from a number corresponding to the mark number follow card on the target follow-focus object, and the offset data is used for compensating for an offset between the mark number follow cards and centers of corresponding objects; sending the actual distance to the target shooting device, so as to instruct the target shooting device to adjust a focal length according to the actual distance and follow shooting of the target follow-focus object.
2. The method of claim 1, wherein, The step of calculating the actual distance between the target shooting device and the target follow-focus object in the real scene space based on the first position coordinates of the mark number follow card on the target shooting device in the virtual space, the second position coordinates of the mark number follow card on the target follow-focus object in the virtual space, and the offset data comprises the following steps: calculating a difference between a horizontal coordinate in the first position coordinates and a horizontal coordinate in the second position coordinates to obtain a horizontal distance between the target shooting device and the target follow-focus object in the virtual space; and calculating a difference between a vertical coordinate in the first position coordinates and a vertical coordinate in the second position coordinates to obtain a vertical distance between the target shooting device and the target follow-focus object in the virtual space; calculating the actual distance based on the horizontal distance and the vertical distance.
3. The method of claim 2, wherein, The step of calculating the actual distance based on the horizontal distance and the vertical distance comprises the following steps: calculating a sum of a square of the horizontal distance and a square of the vertical distance to obtain a square of a relative distance between the target shooting device and the target follow-focus object in the virtual space; performing proportional conversion on the relative distance to obtain the actual distance.
4. The method of claim 1, wherein, Before the step of acquiring the target position coordinates of the target shooting device and the target follow-focus object in the virtual space, the method further comprises the following steps: acquiring identity information of at least one shooting device and at least one follow-focus object located in the real scene space, wherein the at least one shooting device comprises the target shooting device, and the at least one follow-focus object comprises the target follow-focus object. determining a shooting device matched with the first identity information from the at least one shooting device, and determining the shooting device matched with the first identity information as the target shooting device, wherein the first identity information is identity information of the target shooting device; and determining a follow-up object matched with the second identity information from the at least one follow-up object, and determining the follow-up object matched with the second identity information as the target follow-up object, wherein the second identity information is identity information of the follow-up object.
5. The method of claim 4, wherein, The obtaining of the identity information of the at least one shooting device and the at least one follow-up object located in the real scene space comprises: receiving an optical signal uploaded by a motion capture lens, wherein the optical signal is an infrared light signal reflected back by reflective marker points configured on surfaces of target bodies after the motion capture lens irradiates infrared light of a specific wavelength to the target bodies, the reflective marker points are used for marking the identity information, and the target bodies comprise the at least one shooting device and the at least one follow-up object; or receiving identification information uploaded by an image recognition lens, wherein the identification information is identity identification information obtained after the image recognition lens performs image recognition on each image obtained by image acquisition on the at least two target bodies, and the identity identification information comprises the identity information.
6. The method according to any one of claims 1 to 5, characterized in that, Before the obtaining of the target position coordinates of the target shooting device and the target follow-up object in the virtual space, the method further comprises: acquiring a panoramic image set corresponding to the real scene space, wherein the panoramic image set comprises a plurality of local images in the real scene space; constructing a virtual three-dimensional space by using the panoramic image set, and determining the virtual three-dimensional space as the virtual space.
7. The method according to any one of claims 1 to 5, characterized in that, The obtaining of the target position coordinates of the target shooting device and the target follow-up object in the virtual space comprises: in response to a follow-up shooting request, obtaining the target position coordinates, wherein the follow-up shooting request is used for requesting the target shooting device to follow up and shoot the target follow-up object.
8. The method according to any one of claims 1 to 5, characterized in that, After the calculating of the actual distance between the target shooting device and the target follow-up object in the real scene space based on the first position coordinates of the marker number follow-up card on the target shooting device in the virtual space, the second position coordinates of the marker number follow-up card on the target follow-up object in the virtual space, and the offset data, the method further comprises: sending the actual distance to the target shooting device, so as to instruct the target shooting device to adjust the light intensity according to the actual distance and follow up and shoot the target follow-up object.
9. A focus tracking camera device, characterized by comprise: a first obtaining unit configured to obtain target position coordinates of a target shooting device and a target follow-up object in a virtual space, wherein the virtual space is a space established according to a real scene space, the target shooting device and the target follow-up object are both located in the real scene space, the target shooting device is used for follow-up shooting of the target follow-up object and virtual content displayed on a screen, and the screen will render a virtual picture in real time; The computing unit is configured to calculate an actual distance between the target shooting device and the target focus object in the real space based on a first position coordinate of a marker number following card on the target shooting device in the virtual space, a second position coordinate of a marker number following card on the target focus object in the virtual space, and offset data, wherein the target position coordinate comprises the first position coordinate and the second position coordinate, the marker number following card on the target shooting device corresponds to a number different from a number corresponding to the marker number following card on the target focus object, and the offset data is used to compensate for an offset between the marker number following card and a center of a corresponding object. The first shooting unit is configured to send the actual distance to the target shooting device to instruct the target shooting device to adjust a focal length according to the actual distance and follow to shoot the target focus object.
10. A computer readable storage medium, characterized in that, The computer readable storage medium comprises a stored program, wherein the program can be run by a terminal device or a computer to execute the method in any one of claims 1 to 8.
11. A computer program product comprising computer programs / instructions, characterized in that, The computer program / instruction is executed by a processor to implement the steps of the method in any one of claims 1 to 8.
12. An electronic device comprising a memory and a processor, characterized in that The memory stores a computer program, and the processor is configured to execute the method in any one of claims 1 to 8 by using the computer program.
Citation Information
Patent Citations
Positioning recognition method and device, computer equipment and readable storage medium
CN113808209A
Shooting control method and device, holder and follow focus motor
CN113841383A
Imaging control device, imaging control method, and storage medium
WO2015141185A1