A virtual shooting content and space adaptation method and a virtual shooting system

Abstract

The application discloses a kind of virtual shooting content and space adaptation method, comprising the following steps: establishing virtual canvas, and based on space layout information, display area of display channel of fuser and it is drawn on virtual canvas, form space mapping model;Virtual shooting content is arranged to the target position of virtual canvas, and generates content mapping matrix;Based on space mapping model and content mapping matrix, the number of display channel corresponding to the target position of virtual shooting content in virtual canvas, channel resolution and pixel proportion are calculated;Based on channel resolution and pixel proportion, picture segmentation is carried out to virtual shooting content;And the virtual shooting content corresponding to each display channel belonging to the same fuser is synthesized, and the synthesized projection content corresponding to the fuser is obtained;Fuser receives corresponding synthesized projection content, and distributes corresponding display channel to carry out projection output;Using the above technical scheme improves the efficiency of editing operation, realizes the intelligent adaptation of multiple channels of virtual content.

Description

Technical Field

[0001] This application relates to the field of multimedia information technology, specifically to a method for adapting virtual shooting content to space and a virtual shooting system. Background Technology

[0002] Existing virtual shooting systems rely on pre-made static images, video sequences, or real-time rendered 3D scenes as background materials. These materials are manually located using a file browser, imported, and then individually assigned to different display channels. This process is cumbersome and makes precise matching of display areas difficult. Due to differences in resolution, size, and physical layout among various fusion units and display devices, the system lacks a unified virtual canvas for overall mapping and visual layout, resulting in low efficiency and susceptibility to errors in content adjustment. Furthermore, existing systems primarily rely on manual cropping and aspect ratio estimation for content allocation and video generation, failing to automatically optimize image resolution and aspect ratio based on display channel characteristics, which can easily lead to distortion or insufficient clarity. Summary of the Invention

[0003] In view of the above problems, this application provides a method and system for adapting virtual shooting content and space, which solves the problem of low efficiency and easy deviation in content adjustment due to the lack of a unified virtual canvas for overall mapping and visualization layout.

[0004] To achieve the above objectives, the inventors provide a method for adapting virtual shooting content to space, which includes the following steps:

[0005] A virtual canvas is established, and the display areas of each display channel of the fusion unit are drawn on the virtual canvas based on the spatial layout information to form a spatial mapping model; the spatial layout information includes the spatial position, resolution configuration and correspondence between the virtual canvas and the real projection area of ​​at least one fusion unit device; each fusion unit includes several display channels, and each display channel corresponds to a projection output;

[0006] The virtual shooting content is acquired and placed at the target position on the virtual canvas to generate a content mapping matrix; the content mapping matrix records the coordinates of each pixel in the virtual shooting content on the virtual canvas;

[0007] Based on the spatial mapping model and content mapping matrix, the display channel number, channel resolution and pixel ratio corresponding to the virtual shooting content at the target position on the virtual canvas are calculated;

[0008] The virtual shooting content is segmented based on the channel resolution and pixel ratio of the target display channel; and the virtual shooting content corresponding to each display channel belonging to the same fusion unit is synthesized to obtain the synthesized projection content of the corresponding fusion unit.

[0009] The fusion unit receives the corresponding composite projection content and distributes it to the corresponding display channels for projection output.

[0010] Furthermore, the virtual shooting content includes videos and pictures.

[0011] Furthermore, the virtual shooting content can be placed at the target position on the virtual canvas in an interactive manner, including dragging, scaling, and rotating.

[0012] Furthermore, when placing the virtual shooting content at the target position on the virtual canvas, an alignment prompt will automatically appear when the edge of the virtual shooting content is close to the edge or center of the display area of ​​the virtual canvas or display channel.

[0013] Furthermore, the step of calculating the display channel number, channel resolution, and pixel ratio corresponding to the target position of the virtual shooting content on the virtual canvas based on the spatial mapping model and content mapping matrix also includes performing a layout rule algorithm to allocate the screen for several display channels of each fusion unit; the execution of the layout rule algorithm includes the following steps:

[0014] The display area of ​​each display channel in the virtual canvas is converted into the coordinates of each pixel of the virtual captured content;

[0015] Calculate the scaling factor of the virtual shooting content based on the resolution of the virtual shooting content and the resolution configuration of the display channel;

[0016] Based on the scaling factor of the virtual shooting content, the virtual shooting content is repositioned and its order is adjusted to obtain the layout result. The layout result includes the virtual shooting content displayed in each display channel, the coordinates of each pixel of the virtual shooting content displayed in each display channel, and the output resolution of each display channel.

[0017] Furthermore, the step of segmenting the virtual shooting content based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel, and compositing the virtual shooting content corresponding to each display channel belonging to the same fusion unit includes: segmenting the virtual shooting content based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel by calling the FFmpeg multimedia processing interface; and simultaneously calling the FFmpeg module to perform a compositing and generation operation on the virtual shooting content corresponding to each display channel belonging to the same fusion unit.

[0018] Furthermore, the step of the fusion unit receiving the corresponding composite projection content and distributing it to the corresponding display channel for projection output includes the following steps:

[0019] The fusion unit receives the corresponding composite projection content and resolves the composite projection content into the image distribution of the corresponding display channel;

[0020] Distribute the image to the projection output corresponding to the display channel.

[0021] Furthermore, in the step of distributing the image to the projection output corresponding to the display channel, TCP transmission is used to distribute the image to the projection output corresponding to the display channel, and the distribution progress, status updates and task completion notifications are pushed in real time through the WebSocket communication mechanism.

[0022] Furthermore, it also includes saving the virtual canvas configuration, content mapping matrix, and layout results as a configuration file; the virtual canvas configuration includes the virtual shooting content storage address, the scaling ratio of the virtual shooting content on the virtual canvas, and the coordinates of each pixel of the virtual shooting content on the virtual canvas.

[0023] A virtual shooting system that applies the aforementioned method for adapting virtual shooting content to space.

[0024] Unlike existing technologies, the above-mentioned technical solution constructs a virtual canvas and builds a spatial mapping model of the distribution of display channels in the fusion unit. By spatially mapping the display areas of the fusion unit's display channels, the distribution of each fusion unit's display channels can be intuitively presented. This not only achieves accurate mapping of display areas but also significantly improves the efficiency of editing operations. Based on this, after placing the virtual shooting content at the target position on the virtual canvas, the resolution and pixel ratio of the corresponding display channel at the target position on the virtual canvas are calculated to accurately segment the material. This effectively solves the problem of unified management of virtual shooting content in multi-display channel scenarios and ensures the accuracy of content adaptation. The entire method forms a fully integrated adaptation mechanism from spatial layout planning and virtual shooting content segmentation to the synthesis and distribution of composite projection content based on the fusion unit, greatly optimizing the continuity and convenience of the adaptation process.

[0025] The above description of the invention is merely an overview of the technical solution of this application. In order to enable those skilled in the art to better understand the technical solution of this application and to implement it based on the description and drawings, and to make the above-mentioned objectives and other objectives, features and advantages of this application easier to understand, the following description is provided in conjunction with the specific embodiments and drawings of this application. Attached Figure Description

[0026] The accompanying drawings are only used to illustrate the principles, implementation methods, applications, features, and effects of specific embodiments of the present invention and other related contents, and should not be considered as limitations on this application.

[0027] In the accompanying drawings of the instruction manual:

[0028] Figure 1This is a schematic diagram of the virtual shooting content and space adaptation method described in the specific implementation method;

[0029] Figure 2 This is a schematic diagram showing the layout of the virtual shooting content in the fusion channel as described in the specific implementation method;

[0030] Figure 3 A schematic diagram illustrating the division of virtual shooting content by the boundaries of each fusion unit in a specific implementation method;

[0031] Figure 4 This is a schematic diagram illustrating the arrangement of virtual shooting content as described in the specific implementation method;

[0032] Figure 5 This is a schematic diagram illustrating the arrangement of virtual shooting content as described in a specific implementation method. Detailed Implementation

[0033] To illustrate the possible application scenarios, technical principles, implementable specific solutions, and achievable objectives and effects of this application in detail, the following description, in conjunction with the listed specific embodiments and accompanying drawings, provides a detailed explanation. The embodiments described herein are merely illustrative of the technical solutions of this application and are therefore intended to limit the scope of protection of this application.

[0034] In this document, the term "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The term "embodiment" appearing in various places throughout the specification does not necessarily refer to the same embodiment, nor does it specifically limit its independence or connection with other embodiments. In principle, in this application, as long as there are no technical contradictions or conflicts, the technical features mentioned in each embodiment can be combined in any way to form corresponding implementable technical solutions.

[0035] Unless otherwise defined, the technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the use of related terms herein is merely for the purpose of describing particular embodiments and is not intended to limit this application.

[0036] In the description of this application, the term "and / or" is used to describe the logical relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A exists, B exists, and A and B exist simultaneously. Additionally, the character " / " in this document generally indicates that the preceding and following objects have an "or" logical relationship.

[0037] In this application, terms such as “first” and “second” are used only to distinguish one entity or operation from another, and do not necessarily require or imply any actual quantity, hierarchy or order relationship between these entities or operations.

[0038] Without further limitations, the use of terms such as “comprising,” “including,” “having,” or other similar open-ended expressions in this application is intended to cover non-exclusive inclusion, which does not exclude the presence of additional elements in a process, method, or product that includes the stated elements, such that a process, method, or product that includes a list of elements may include not only those defined elements but also other elements not expressly listed, or elements inherent to such a process, method, or product.

[0039] As understood in the Examination Guidelines, in this application, expressions such as "greater than," "less than," and "exceeding" are understood to exclude the stated number; expressions such as "above," "below," and "within" are understood to include the stated number. Furthermore, in the description of the embodiments in this application, "multiple" means two or more (including two), and similar expressions related to "multiple" are also understood in this way, such as "multiple groups" and "multiple times," unless otherwise explicitly specified.

[0040] In the description of the embodiments of this application, the space-related expressions used, such as "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "vertical," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential," indicate the orientation or positional relationship based on the orientation or positional relationship shown in the specific embodiments or drawings. They are only for the purpose of describing the specific embodiments of this application or for the reader's understanding, and do not indicate or imply that the device or component referred to must have a specific position, a specific orientation, or be constructed or operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0041] The processor described in the embodiments of this application can be implemented by hardware, firmware, software, or a combination thereof. It can be a circuit, one or more of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field-programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, or a microprocessor. It also includes other physical, biological, or chemical structures that can implement the same or equivalent functions as the processors listed above, such as biological neurons, quantum computing units, DNA computing units, etc., so that the processor can execute some or all of the steps in the computer program or method involved in the various embodiments of this application, or any combination of the steps mentioned therein.

[0042] The computer program involved in the embodiments can be stored in a computer device readable storage medium, which includes, but is not limited to, disks, magnetic tapes, magnetic cards, floppy disks, flash memory, optical disks, optical cards, read-only memory (ROM), random access memory (RAM), erasable programmable ROM (EPROM), and electrically erasable programmable ROM (EEPROM), etc., and also includes other biological, physical, or chemical structures that can achieve the same or equivalent functions as the storage media listed above, such as DNA, RNA, proteins, and other units with information storage capabilities. In specific embodiments, the storage medium involved can be one of the above-mentioned media types, or a combination of the above-mentioned media types. In different embodiments, the computer program involved in the embodiments can be centrally stored in a single medium, or distributed and stored in multiple media. The memory containing the computer device readable storage medium can be non-volatile memory or random access memory. These computer device readable storage media can be built into the device, or can be connected to the device involved in the embodiments as an external device or part of an external device. In some embodiments, the memory having a computer device readable storage medium is deployed locally; in other embodiments, the memory may be deployed remotely from the processor, for example, as a network-attached memory accessed via RF circuitry or an external port and a communication network, wherein the communication network may be the Internet, one or more intranets, a local area network (LAN), a wide area network (WLAN), a storage area network (SAN), or a suitable combination thereof, as long as computer device access to the memory is enabled. Furthermore, the computer program involved in the embodiments may be stored in plaintext / ciphertext form, or it may be designed as training data, integrated and recombined through model training and implicitly stored in the parameter states of a deep neural network or other machine learning model.

[0043] A method for adapting virtual shooting content to space is proposed. This method constructs a virtual canvas and builds a spatial mapping model of the distribution of display channels in a fusion unit. Spatial mapping is applied to the display areas of all fusion unit display channels, providing a clear view of their distribution. This not only achieves precise mapping of display areas but also significantly improves the efficiency of editing operations. Furthermore, after placing the virtual shooting content at the target position on the virtual canvas, the resolution and pixel ratio of the corresponding display channel at that position are calculated to accurately segment the material. This effectively solves the problem of unified management of virtual shooting content in multi-display-channel scenarios, ensuring the accuracy of content adaptation. The entire method forms a fully integrated adaptation mechanism from spatial layout planning and virtual shooting content segmentation to the synthesis and distribution of fused projection content, significantly optimizing the continuity and convenience of the adaptation process.

[0044] The virtual shooting content and space adaptation method of this application has strong scene applicability and can be widely applied to various virtual shooting scenarios such as panoramic projection, XR studios, and distributed fusion projection systems. In different scenarios, it can accurately segment virtual content based on the spatial mapping model, achieving multi-channel intelligent adaptation of virtual content without the need for large-scale adjustments for specific scenarios. This significantly improves the versatility of the adaptation system, effectively reduces the adaptation cost in different scenarios, and provides good compatibility support for subsequent scenarios that need to expand display channels or fusion devices. There is no need to refactor the core adaptation logic significantly; only the channel and fusion device parameters in the spatial mapping model need to be adjusted in the virtual canvas. New devices can be quickly incorporated and adapted, significantly reducing expansion costs and time, and further enhancing the scalability of the system.

[0045] The following combination Figure 1 An implementation method for adapting virtual shooting content to space is provided, which includes the following steps:

[0046] S10. Establish a virtual canvas and draw the display areas of each display channel of the fusion unit on the virtual canvas based on the spatial layout information to form a spatial mapping model; the spatial layout information includes the spatial position, resolution configuration and correspondence between the virtual canvas and the real projection area of ​​at least one fusion unit device; each fusion unit includes several display channels, and each display channel corresponds to a projection output;

[0047] S20. Acquire virtual shooting content and place the virtual shooting content at the target position on the virtual canvas to generate a content mapping matrix; the content mapping matrix records the coordinates of each pixel in the virtual shooting content on the virtual canvas;

[0048] S30. Based on the spatial mapping model and content mapping matrix, calculate the display channel number, channel resolution and pixel ratio corresponding to the virtual shooting content at the target position on the virtual canvas;

[0049] S40. Based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel, the virtual shooting content is segmented into images; and the virtual shooting content corresponding to each display channel belonging to the same fusion unit is synthesized to obtain the synthesized projection content of the corresponding fusion unit.

[0050] S50: The fusion unit receives the corresponding composite projection content and distributes it to the corresponding display channel for projection output.

[0051] In step S10 above, the establishment of the virtual canvas integrates the scattered projection outputs of each display channel of the fusion unit (at least one, or multiple) into a unified virtual editing space. The virtual canvas has customizable spatial parameters, and its size, coordinates, and partitioning rules can be adjusted according to the actual display scenario (e.g., panoramic projection size, XR studio layout). In some embodiments, a visual operation interface can be provided to more intuitively draw and present the distribution of each display channel of the fusion unit and the layout status of the virtual shooting content, facilitating early planning (e.g., whether display channels conflict, whether the fusion unit installation location is reasonable), and also providing visual support for subsequent virtual shooting content segmentation and adaptation editing.

[0052] In step S10 above, the spatial layout information can be read from the fusion server and may include data such as the spatial location, resolution configuration, and correspondence between the virtual canvas and the actual projection area of ​​at least one fusion device. The above-mentioned drawing the display area of ​​each display channel of the fusion device on the virtual canvas based on the spatial layout information refers to accurately drawing the distribution characteristics of each display channel of the fusion device on the virtual canvas proportionally, combining the spatial layout information, including the display area of ​​each display channel of the fusion device, and clearly defining the boundaries, coordinate range, channel number, and positional relationship between each display area (such as whether they overlap, splicing order, etc.).

[0053] In step S10 above, the spatial mapping model is a mapping relationship model between the virtual canvas and the actual display scene, constructed based on the distribution characteristics of each display channel of the fusion unit on the virtual canvas. In some embodiments, to improve the efficiency and stability of the basic adaptation scene, a fixed mapping model of "each display channel of the fusion unit - display area of ​​the virtual canvas" can be established. The physical location, port attributes, display range, and other parameters of the projection output corresponding to each display channel of the fusion unit in reality are bound and fixed with the specified display area of ​​the virtual canvas, forming a one-to-one mapping rule library to ensure the stability of the display effect. When using it, only the preset mapping rules need to be loaded to quickly achieve accurate adaptation between the virtual scene and the actual display scene without recalibrating the mapping relationship. If only the display parameters of a certain display channel need to be fine-tuned later, the corresponding entries can be modified directly in the rule library, making the operation convenient and efficient. In some embodiments, a dynamic mapping model of "each display channel of the fusion unit - virtual canvas display area" is established. Sensors, such as laser positioning sensors and parameter monitoring modules, are installed on the projection output to collect data such as the position coordinates and resolution of the projection output in real time. The intelligent mapping engine dynamically calculates the corresponding display area of ​​the projection output in the virtual canvas based on this data. When the projection output devices corresponding to each display channel of the fusion unit move or undergo minor position adjustments in the physical space, the sensors can collect data on the changes in the projection output position in real time and automatically trigger the synchronous update of the coordinates and range of the corresponding display area on the virtual canvas. This eliminates the need for manual reconfiguration of the mapping relationship, thus ensuring real-time and accurate mapping between the virtual and real worlds. The projection output refers to the display terminal (such as a split-screen display).

[0054] In step S20 above, the virtual shooting content may include images (such as still images, animated images, etc.), videos, or real-time rendered 3D scenes (such as 3D games, VR / AR experiences, virtual simulation training, etc.). The virtual shooting content can be obtained by manually importing it through a file browser, or by directly retrieving preset virtual shooting content through an integrated material library, or by dynamically capturing and generating it by connecting to a real-time rendering engine, camera acquisition equipment, etc., or by synchronously acquiring it from a cloud material platform through a network interface, in order to meet diverse scene requirements and improve the convenience and flexibility of virtual shooting content adaptation.

[0055] In step S20 above, placing the virtual captured content at the target position on the virtual canvas and generating a content mapping matrix means setting the acquired virtual captured content at the target position on the virtual canvas according to the actual projection expectation, forming a content mapping matrix to ensure that the presentation effect of the virtual captured content on the virtual canvas matches the actual projection expectation. The content mapping matrix records the coordinates of the virtual captured content on the virtual canvas. In some embodiments, a visual operation interface is provided to intuitively present the distribution of the blender and display channels in the virtual canvas. At this time, the virtual captured content can be placed at the target position on the virtual canvas in an interactive manner, including dragging, scaling, and rotating operations. To further improve the editing accuracy and operation efficiency of the virtual captured content layout, intelligent alignment assistance is added when placing the virtual captured content at the target position on the virtual canvas. When the edge of the virtual captured content is dragged or adjusted and reaches a preset proximity threshold with the boundary of the virtual canvas and the display area boundary (including the area edge and the central baseline) of the display channel, an alignment prompt is triggered. The prompts are presented in a visual form, such as displaying adsorption guide lines, highlighting alignment boundaries, or popping up text prompts, which intuitively show the alignment status of the material with the target boundary / baseline, helping to quickly complete accurate positioning, avoiding positional deviations caused by manual adjustments, and reducing the operational difficulty of virtual shooting content interactive layout.

[0056] In practical applications, there are instances where the fusion projector outputs ultra-wide resolution virtual shooting content. To ensure the output meets the aspect ratio requirements of ultra-wide resolution, scaling is usually necessary based on the original ratio, but this sacrifices output resolution. To ensure no loss of output resolution, the display channels can be repositioned and their order adjusted according to the output resolution, thereby ensuring no loss of resolution of the output image source and achieving optimal image layout and reasonable resolution control. In some embodiments, when calculating the display channel number, resolution, and pixel ratio corresponding to the virtual shooting content at the target position on the virtual canvas based on the spatial mapping model and content mapping matrix (step S30 above), the method further includes performing a layout rule algorithm for image allocation for several display channels of each fusion device; the execution of the layout rule algorithm includes the following steps:

[0057] The display area of ​​each display channel in the virtual canvas is converted into the coordinates of each pixel of the virtual captured content;

[0058] Calculate the scaling factor of the virtual shooting content based on the resolution of the virtual shooting content and the resolution configuration of the display channel;

[0059] Based on the scaling factor of the virtual shooting content, the virtual shooting content is repositioned and its order is adjusted to obtain the layout result. The layout result includes the virtual shooting content displayed in each display channel, the coordinates of each pixel of the virtual shooting content displayed in each display channel, and the output resolution of each display channel.

[0060] The following further elaborates on the material arrangement rule algorithm.

[0061] First, a virtual canvas is constructed. The content on the virtual canvas includes the spatial layout of the fusion channel and the content to be adapted for virtual shooting. See [link / reference needed]. Figure 2 As shown;

[0062] The virtual shooting content on the virtual canvas is divided according to the boundaries of each fusion unit, see [link / reference]. Figure 3 As shown;

[0063] The virtual shooting content exceeds the maximum resolution of the current fusion unit according to the current layout, so the virtual shooting content needs to be arranged.

[0064] If the width of the virtual content exceeds the maximum limit, the virtual content will be divided into several segments according to its width, and the excess segments will be stacked along the length direction. See [link to relevant documentation]. Figure 4 As shown;

[0065] If the longer side of the virtual content exceeds the maximum limit, the virtual content will be divided into several segments along its length, and the excess segments will be stacked along the width direction. See [link to relevant documentation]. Figure 5 As shown;

[0066] Simultaneously, a configuration file is generated and sent to the same fusion unit. The configuration file contains the playback position information of the channels in the same fusion unit that need to be located in the final generated virtual shooting content. Finally, the fusion unit restores the content to be played based on the information in this configuration file.

[0067] In step S40 above, the step of segmenting the virtual shooting content based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel, and compositing the virtual shooting content corresponding to each display channel belonging to the same fusion unit, can be processed by professional multimedia processing tools or dedicated virtual production software (such as Disguise, Pixotope, etc.). In some embodiments, based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel, the FFmpeg multimedia processing interface is called to segment the virtual shooting content; at the same time, the FFmpeg module is called to perform a compositing operation on the virtual shooting content corresponding to each display channel belonging to the same fusion unit. FFmpeg, through command line or API calls, can accurately complete the segmentation based on channel resolution and pixel ratio, and supports the splicing and compositing of materials at the fusion unit level, adapting to various audio and video formats.

[0068] In step S50 above, the fusion unit receives the corresponding composite projection content and distributes it to the corresponding display channels for projection output. After receiving the corresponding composite projection content, the fusion unit can automatically parse the image distribution of the corresponding display channels and distribute the image to the corresponding display channels for projection output. This allows for multi-channel splicing and display at the corresponding projection output point, thereby achieving real-time matching between the virtual shooting content and the spatial display.

[0069] In the steps described above for distributing the image to the corresponding display channel for projection output, TCP transmission can be used to distribute the image to the corresponding projection output of the display channel. TCP's retransmission mechanism can avoid packet loss and stuttering during image transmission, ensuring that the projected image is complete and undamaged; it also supports long-distance transmission, enabling cross-space distribution via network and adapting to large-scale multi-projection layouts.

[0070] In the above steps of distributing the image to the corresponding display channel for projection output, the distribution progress, status updates, and task completion notifications can be pushed in real time through the WebSocket communication mechanism. The WebSocket communication mechanism supports synchronous signal output from multiple channels and multiple devices, reducing image misalignment and delay during projection splicing and ensuring the continuity of the overall display effect.

[0071] In some embodiments, the virtual canvas configuration, content mapping matrix, and layout results can be saved as a configuration file. The virtual canvas configuration includes the storage address of the virtual captured content, the scaling ratio of the virtual captured content on the virtual canvas, and the coordinates of each pixel of the virtual captured content on the virtual canvas. Through the configuration file, users can directly project the virtual captured content in subsequent use without repeating the steps of this application, achieving rapid layout reproduction.

[0072] This application also provides a virtual shooting system that applies the aforementioned method for adapting virtual shooting content to space. By constructing a virtual canvas and building a spatial mapping model, the distribution of each fusion unit's display channels can be intuitively presented. This not only achieves precise mapping of the display area but also significantly improves the efficiency of editing operations. Based on the resolution and pixel ratio calculation of the display channel corresponding to the target position, the virtual shooting content is precisely segmented, effectively solving the problem of unified content management in multi-display channel scenarios and ensuring the accuracy of content adaptation. At the same time, the system forms a fully integrated adaptation mechanism from spatial layout planning and content segmentation to compositing projection and distribution. This not only greatly optimizes the continuity and convenience of the adaptation process but also lowers the professional threshold through visual operation. With its flexible layout adjustment capabilities, it adapts to different scenario requirements. Ultimately, through precise collaboration of each stage, it improves the overall efficiency of virtual shooting and the final presentation effect.

[0073] Finally, it should be noted that although the above embodiments have been described in the text and drawings of this application, this should not limit the scope of patent protection of this application. Any technical solutions that are based on the essential concept of this application and utilize the content described in the text and drawings of this application, resulting in equivalent structural or procedural substitutions or modifications, as well as the direct or indirect application of the technical solutions of the above embodiments to other related technical fields, are all included within the scope of patent protection of this application.

Claims

1. A method for adapting virtual shooting content to space, characterized in that, Includes the following steps: A virtual canvas is established, and the display areas of each display channel of the fusion unit are drawn on the virtual canvas based on the spatial layout information to form a spatial mapping model; the spatial layout information includes the spatial position, resolution configuration and correspondence between the virtual canvas and the real projection area of ​​at least one fusion unit device; each fusion unit includes several display channels, and each display channel corresponds to a projection output; Acquire virtual shooting content and place the virtual shooting content at the target position on the virtual canvas to generate a content mapping matrix; The content mapping matrix records the coordinates of each pixel in the virtual captured content on the virtual canvas; Based on the spatial mapping model and content mapping matrix, the display channel number, channel resolution and pixel ratio corresponding to the virtual shooting content at the target position on the virtual canvas are calculated; The virtual shooting content is segmented based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel; The virtual shooting content corresponding to each display channel belonging to the same fusion unit is synthesized to obtain the synthesized projection content of the corresponding fusion unit. The fusion unit receives the corresponding composite projection content and distributes it to the corresponding display channels for projection output.

2. The method for adapting virtual shooting content to space according to claim 1, characterized in that, The virtual shooting content includes videos and pictures.

3. The method for adapting virtual shooting content to space according to claim 1, characterized in that, The virtual shooting content is placed at the target position on the virtual canvas in an interactive manner, including dragging, scaling, and rotating.

4. The method for adapting virtual shooting content to space according to claim 1, characterized in that, When placing virtual content at the target location on the virtual canvas, alignment prompts will automatically appear when the edges of the virtual content are close to the edge or center of the display area of ​​the virtual canvas or display channel.

5. The method for adapting virtual shooting content to space according to claim 1, characterized in that, The step of calculating the display channel number, channel resolution, and pixel ratio corresponding to the target position of the virtual shooting content on the virtual canvas based on the spatial mapping model and content mapping matrix also includes performing a layout rule algorithm to allocate the screen for several display channels of each fusion unit; the calculation of the layout rule algorithm includes the following steps: The display area of ​​each display channel in the virtual canvas is converted into the coordinates of each pixel of the virtual captured content; Calculate the scaling factor of the virtual shooting content based on the resolution of the virtual shooting content and the resolution configuration of the display channel; Based on the scaling factor of the virtual shooting content, the virtual shooting content is repositioned and its order is adjusted to obtain the layout result. The layout result includes the virtual shooting content displayed in each display channel, the coordinates of each pixel of the virtual shooting content displayed in each display channel, and the output resolution of each display channel.

6. The method for adapting virtual shooting content to space according to claim 1, characterized in that, The virtual shooting content is segmented based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel; The virtual shooting content corresponding to each display channel belonging to the same fusion unit is synthesized by: based on the channel resolution and pixel ratio of the virtual shooting content in the target display channel, calling the FFmpeg multimedia processing interface to segment the virtual shooting content; At the same time, the FFmpeg module is invoked to perform compositing and generation operations on the virtual shooting content corresponding to each display channel belonging to the same fusion unit.

7. The method for adapting virtual shooting content to space according to claim 1, characterized in that, The process of the fusion unit receiving the corresponding composite projection content and distributing it to the corresponding display channel for projection output includes the following steps: The fusion unit receives the corresponding composite projection content and resolves the composite projection content into the image distribution of the corresponding display channel; Distribute the image to the projection output corresponding to the display channel.

8. The method for adapting virtual shooting content to space according to claim 7, characterized in that, In the step of distributing the image to the projection output corresponding to the display channel, TCP transmission is used to distribute the image to the projection output corresponding to the display channel, and the distribution progress, status updates and task completion notifications are pushed in real time through the WebSocket communication mechanism.

9. The method for adapting virtual shooting content to space according to claim 5, characterized in that, It also includes saving the virtual canvas configuration, content mapping matrix, and layout results as a configuration file; the virtual canvas configuration includes the virtual shooting content storage address, the scaling ratio of the virtual shooting content on the virtual canvas, and the coordinates of each pixel of the virtual shooting content on the virtual canvas.

Images