A cropping method and system for presenting a two-dimensional video in a CAVE space

Abstract

A cropping method for presenting a two-dimensional video in a CAVE space provided by an embodiment of the present invention includes the steps of: presetting the size of the CAVE space and pre-specifying the position of the optimal viewing point relative to the CAVE space; selecting a two-dimensional video screen suitable for cropping according to the size of the CAVE space, and adjusting the size and position of the video screen to select the screen content suitable for placement on the front screen; cropping the original video screen into five regional screens according to the height of the optimal viewing point, the horizontal distance from the CAVE space, and the sizes of the front, upper, lower, left, and right screens; cropping and producing the five regional screens into a multi-screen screen corresponding to the CAVE space according to the calculated quantitative relationship, and generating a corresponding video file. The present invention also provides a corresponding system. According to the present invention, the presentation form of the two-dimensional video is enriched, and there is no distortion in the video content seen by the viewer at the optimal viewing point, enhancing the immersion of the viewer when watching a traditional two-dimensional video.

Description

Technical Field

[0001] The present invention relates to the technical field of video processing, and particularly to a cropping method and system for presenting a two-dimensional video in a CAVE space. Background Art

[0002] An immersive space is an independent and relatively enclosed artificial space, which is presented as a virtual environment or a space created by humans using tools and technologies. This space can trigger human sensory experiences (mostly visual and auditory) through a certain mechanism, thereby stimulating memories. This is a dynamic process for immersive experiences, which is a gradual transition from sensory experiences to narrative experiences. In the 1970s, the Cave Automatic Virtual Environment (CAVE) space enabled the audience to deeply realize that they were on the "stage" through animated images and carefully arranged sounds. The original design concept of the Cave system was to break through the limitations of head-mounted displays and share virtual reality experiences.

[0003] In the traditional concept, two-dimensional videos are played on two-dimensional screens. Directly cropping a two-dimensional video into multiple parts and presenting them in a three-dimensional space will definitely cause distortion. Similar to converting a panoramic video into multiple screen video files in a CAVE immersive space, there is only one optimal viewing point for the three-dimensional visual space converted from such two-dimensional videos.

[0004] Currently, the vast majority on the market use flat screens to play two-dimensional videos, and viewers have formed the viewing habit of watching videos on two-dimensional screens. At the same time, viewers habitually position themselves as "outsiders" when watching such videos, and the immersion they feel only comes from the content, with a fixed form. There are very few relevant technical solutions on the market currently, and such two-dimensional videos cannot be cropped free of charge in batches according to specific requirements. Summary of the Invention

[0005] In view of this, embodiments of the present invention provide a cropping method and system for presenting a two-dimensional video in a CAVE immersive space, which enriches the presentation form of two-dimensional videos. The video content seen by the audience at the optimal viewing point has no distortion phenomenon, and enhances the immersion of the audience when watching traditional two-dimensional videos.

[0006] To achieve the above object, embodiments of the present invention provide the following technical solutions:

[0007] On the one hand, embodiments of the present invention provide a cropping method for presenting a two-dimensional video in a CAVE immersive space, including the following steps:

[0008] S1. A preset CAVE immersive space size, and the position of the best viewing point relative to the CAVE immersive space is pre-specified, where the best viewing point is outside the CAVE immersive space;

[0009] S2. According to the CAVE immersive space size, select a two-dimensional video screen suitable for cropping, and adjust the size and position of the video screen to select the picture content suitable for placement on the front screen;

[0010] S3. According to the height of the best viewing point, the horizontal distance from the CAVE immersive space, as well as the front screen size, the upper and lower screen sizes, and the left and right screen sizes, crop the original video screen into five regional screens;

[0011] S4. Crop and produce the five regional screens into a multi-screen corresponding to the CAVE immersive space according to the calculated quantitative relationship, and generate a corresponding video file.

[0012] Among them, the quantitative relationship of the five regions after cropping is:

[0013]

[0014] and / or

[0015]

[0016] Among them, a, b, and c are the length, height, and depth of the CAVE space respectively. The front screen size is a×b, the upper and lower screen sizes are a×c, the left and right screen sizes are b×c, and d and e are the height of the best viewing point and the horizontal distance from the immersive CAVE space respectively.

[0017] The resolution of the multi-sided screen of the CAVE immersive space is adjusted according to the size of each screen.

[0018] Among the five regional screens cropped from the original video screen, the front screen is a rectangle, and the others are irregular quadrilaterals;

[0019] After cropping, it is necessary to transform the upper, lower, left, and right irregular quadrilaterals into rectangular videos with specified aspect ratios and resolutions.

[0020] On the other hand, an embodiment of the present invention provides a system for realizing the display of a two-dimensional video in a CAVE immersive space, including:

[0021] A setting module, a preset CAVE immersive space size, and the position of the best viewing point relative to the CAVE immersive space is pre-specified, where the best viewing point is outside the CAVE immersive space;

[0022] A selection module selects a two-dimensional video screen suitable for cropping according to the size of the CAVE immersive space and adjusts the size and position of the video screen to select screen content suitable for placement on the front screen;

[0023] The cropping module crops the original video into five area images according to the height of the best viewing point, the horizontal distance from the CAVE immersive space, and the size of the front screen, the size of the upper and lower screens, and the size of the left and right screens;

[0024] The generation module cuts the five area images according to the calculated quantitative relationship to produce a multi-screen image corresponding to the CAVE immersive space, and generates a corresponding video file.

[0025] Among them, the quantitative relationship of the five areas after clipping is:

[0026]

[0027] and / or

[0028]

[0029] Among them, a, b, and c are the length, height, and depth of the CAVE space respectively. The size of the front screen is a×b, the size of the upper and lower screens is a×c, and the size of the left and right screens is b×c. d and e are the height of the best viewing point and the horizontal distance from the immersive CAVE space respectively.

[0030] The resolution of the multi-sided screens in the CAVE immersive space is adjusted according to the size of each screen.

[0031] Among them, the five regional screens cut from the original video screen, among which the front screen is a rectangle and the others are irregular quadrilaterals;

[0032] After cropping, the top, bottom, left, and right irregular quadrilaterals need to be transformed into rectangular videos with specified frame size and resolution.

[0033] The embodiments of the present invention have the following advantages:

[0034] The present invention breaks through the stereotype that immersive space videos can only be produced using panoramic materials. Videos displayed using this cropping method can also make people feel as if they are in the scene. The effect achieved by implementing this technical solution is suitable for the delivery of video content in museums, exhibition halls, and exhibition halls. It enriches the expression of two-dimensional videos and enhances the audience's sense of immersion when watching traditional two-dimensional videos. The requirements for the two-dimensional video materials to be prepared in the early stage are low, the equipment is small, and the cost is low. It allows free batch rendering of long-term, high-quality, distortion-free video images. It allows staff to test, communicate, and formulate the best viewing points before and after the production to achieve the best visual effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only exemplary. For those of ordinary skill in the art, without creative efforts, other implementation drawings can also be obtained based on the provided drawings.

[0036] The structures, ratios, sizes, etc. shown in this specification are only used to cooperate with the content disclosed in the specification for those familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of the present invention. Therefore, they do not have a substantial technical meaning. Any modification of the structure, change in the proportional relationship, or adjustment of the size, without affecting the effects that the present invention can produce and the purposes that can be achieved, should still fall within the scope that can be covered by the technical content disclosed in the present invention.

[0037] Figure 1 The present invention provides a flowchart of a cropping method for presenting a two-dimensional video in a CAVE immersive space in an embodiment of the present invention;

[0038] Figure 2 It is a diagram of the orientation relationship between the audience, the CAVE immersive space, and the original two-dimensional video in an embodiment of the present invention;

[0039] Figure 3a and Figure 3b They are respectively a schematic diagram of the two-dimensional video screen before cropping in an embodiment of the present invention and a schematic diagram corresponding to the orientation relationship of the CAVE immersive space after cropping;

[0040] Figure 4 It is the left view after the first auxiliary line is made in an embodiment of the present invention;

[0041] Figure 5 It is the front view after the second auxiliary line is made in an embodiment of the present invention;

[0042] Figure 6a and Figure 6b The figures shown respectively illustrate the size relationship between the two-dimensional video cropping and the multi-screens of the CAVE immersive space in an embodiment of the present invention. Specific Embodiments

[0043] The following specific embodiments illustrate the implementation manners of the present invention. Those familiar with this technology can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope protected by the present invention.

[0044] The expected effect achieved by implementing the technical solution provided by the present invention is to specify the best viewing point for the audience, the number, size and resolution of the multi-screen of the CAVE immersive space, and to crop the traditional two-dimensional video into the corresponding number and resolution, so that the video content seen by the audience at the best viewing point is not distorted.

[0045] Reference Figure 1 The embodiment of the present invention provides a method for cropping a two-dimensional video in a CAVE immersive space, comprising the following steps:

[0046] S1, a preset CAVE immersive space size, pre-specifying a position of an optimal viewing point relative to the CAVE immersive space, wherein the optimal viewing point is outside the CAVE immersive space;

[0047] S2, according to the size of the CAVE immersive space, selecting a two-dimensional video screen suitable for cropping and adjusting the size and position of the video screen to select screen content suitable for placement on the front screen;

[0048] S3, according to the height of the best viewing point, the horizontal distance from the CAVE immersive space, and the size of the front screen, the size of the upper and lower screens, and the size of the left and right screens, the original video screen is cropped into five area screens;

[0049] S4, cutting and producing the five regional images into a multi-screen image corresponding to the CAVE immersive space according to the calculated quantitative relationship, and generating a corresponding video file.

[0050] The resolution of the multi-sided screens in the CAVE immersive space is adjusted according to the size of each screen.

[0051] In the embodiment of the present invention, the original video frame is reset to a:b, and the two-dimensional video is cropped into five parts: top, bottom, left, right, and center. The center part is not distorted, and the other parts (including top, bottom, left, and right) are stretched to a certain extent. The cropped top, bottom, left, and right irregular quadrilateral videos are transformed into rectangular videos of specified frame and resolution.

[0052] For the convenience of explanation, the traditional two-dimensional video is cut into 5 videos (upper, lower, front, left, and right). It is assumed that the actual size of the front screen is axb, the actual size of the upper and lower screens is axc, the actual size of the left and right screens is bxc, the height of the best viewing point is d, and the horizontal distance from the immersive CAVE space is e. The data used for testing in the specific embodiment is a=7, b=c=4, d=1.5, and e=2 (unit: meter). Figure 2 This is a diagram of the positional relationship between the audience, the CAVE immersive space, and the original two-dimensional video, where the back is the two-dimensional video before cropping.

[0053] Figure 3a Schematic diagram of a two-dimensional video frame before cropping. As Figure 3a shown, where the rectangle EFGH is the original frame before cropping.

[0054] Figure 3b Schematic diagram corresponding to the orientation relationship of the CAVE immersive space after cropping. Refer to Figure 3b , the cube ABCDIJKL is the CAVE space composed of the cropped frames. The center of the sphere in the middle represents the viewer's viewpoint (optimal viewing point). The rectangle EFGH frame is cropped into 5 regional frames, namely the regions represented by the quadrilaterals EHIK, EIJF, JLGF, KLGH, and IJKL.

[0055] Figure 4 Left view after the first auxiliary line is drawn in the embodiment. Refer to Figure 4 , draw the auxiliary line OU perpendicular to the plane EFGH, and then draw an auxiliary line parallel to EH through point U and intersect it with the plane EFGH at points M and S. Among them, OT is perpendicular to the plane KCDL, and connect QT to intersect the plane KCDL at point R. Among them, triangle ORT and triangle OUS are similar, OT:RT = SU:OU, that is, d:e = US:(c + e), US = d(c + e) / e, QS = US - UQ = d(c + e) / e - d = dc / e. Similarly, MP = (b - d)c / e.

[0056] Figure 5 Front view after the second auxiliary line is drawn in the embodiment.

[0057] This calculation is only carried out on the plane EFGH. Refer to Figure 5 , continue to use the auxiliary line US in the above calculation and intersect it with KL at Q, connect UH, UG, and draw KW and LV perpendicular to GH and intersect it at W and V. Among them, triangle UKQ and triangle HKW are similar, UQ:KQ = KW:HW = QS:HW, that is, d:a / 2 = dc / e:HW, HW = ac / 2e. Similarly, VG = HW = ac / 2e.

[0058] In summary, through calculation, the quantitative relationship of the five regions after cropping is obtained as:

[0059]

[0060] In specific implementation, the quantitative ratio relationship of top:middle:bottom and left:middle:right can have a certain fluctuation.

[0061] Figure 6a And Figure 6b shown respectively are the size relationships of two-dimensional video cropping and multi-screens in the CAVE immersive space.

[0062] in, Figure 6a The original video screen can be cropped with reference to the original video screen, where the five regions correspond to the five screens of the subsequent CAVE immersive space. In process step S2, the standard for adjusting the two-dimensional video material is: first, the original two-dimensional video is scaled and cropped to obtain a two-dimensional video with a frame of a:b; the main screen is placed on the center screen (front screen), and the front, top, bottom, left, and right in the CAVE immersive space are as close to the front, top, ground, left, and right in real life as possible; at the same time, important pictures should not be cut as much as possible.

[0063] The embodiment of the present invention further provides a system for realizing the display of two-dimensional video in a CAVE immersive space, comprising:

[0064] A setting module, presetting the size of the CAVE immersive space, pre-specifying the position of the best viewing point relative to the CAVE immersive space, wherein the best viewing point is outside the CAVE immersive space;

[0065] A selection module selects a two-dimensional video screen suitable for cropping according to the size of the CAVE immersive space, adjusts the size and position of the video screen, and selects screen content suitable for placement on the front screen;

[0066] The cropping module crops the original video into five area images according to the height of the best viewing point, the horizontal distance from the CAVE immersive space, and the size of the front screen, the size of the upper and lower screens, and the size of the left and right screens;

[0067] The generation module cuts the five area images according to the calculated quantitative relationship to produce a multi-screen image corresponding to the CAVE immersive space, and generates a corresponding video file.

[0068] Among them, the quantitative relationship of the five areas after clipping is:

[0069]

[0070] and / or

[0071]

[0072] Among them, a, b, and c are the length, height, and depth of the CAVE immersive space, respectively. The size of the front screen is a×b, the size of the upper and lower screens is a×c, and the size of the left and right screens is b×c. d and e are the height of the best viewing point and the horizontal distance from the immersive CAVE space, respectively.

[0073] The resolution of the multi-sided screens in the CAVE immersive space is adjusted according to the size of each screen.

[0074] Specifically, there are five regional images cropped from the original video image. Among them, the front screen is rectangular, and the others are irregular quadrilaterals. After cropping, the upper, lower, left, and right irregular quadrilaterals need to be transformed into rectangular videos with specified frame sizes and resolutions.

[0075] Compared with the existing processing methods, the present invention breaks through the fixed thinking mode that immersive space videos can only be produced using panoramic materials. The videos displayed after using this cropping method are equally immersive. The effects achieved by implementing this technical solution are applicable to the placement of video content in museums, exhibition halls, and exhibition centers, etc. It enriches the expression forms of two-dimensional videos and enhances the immersion feeling of viewers when watching traditional two-dimensional videos. The requirements for the two-dimensional video materials to be prepared in the early stage are low, with few devices and low costs. It allows for free batch rendering of long-time, high-quality, and non-distorted video images. It allows the staff to test, communicate, and determine the best viewing points in the early and later stages to achieve the best visual effects.

[0076] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the above-described devices, equipment, and units can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0077] In the several embodiments provided in the present application, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are merely illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0078] In addition, in each embodiment of the present application, the functional modules can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0079] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a function call device, or a network device, etc.) to execute all or part of the steps of the methods of various embodiments of this application. Although the present invention has been described in detail above with general descriptions and specific embodiments, based on the present invention, some modifications or improvements can be made to it, which are obvious to those skilled in the art. Therefore, these modifications or improvements made without departing from the spirit of the present invention all fall within the scope of protection required by the present invention.

Claims

1. A cropping method for presenting a two-dimensional video in a CAVE immersive space, characterized in that, It includes the following steps: S1. Preset the size of the CAVE immersive space, and pre-specify the position of the best viewing point relative to the CAVE immersive space, where the best viewing point is outside the CAVE immersive space; S2. According to the size of the CAVE immersive space, select the two-dimensional video picture content suitable for cropping, and adjust the size and position of the video picture to select the picture content suitable for placing on the front screen; S3. According to the height of the best viewing point, the horizontal distance from the CAVE immersive space, as well as the size of the front screen, the size of the upper and lower screens, and the size of the left and right screens, crop the original video picture into five regional pictures; S4. Crop and produce the five regional pictures into a multi-screen picture corresponding to the CAVE immersive space according to the calculated quantitative relationship, and generate the corresponding video file; The quantitative relationship of the five regions after cropping is: Among them, a, b, and c are respectively the length, height, and depth of the CAVE immersive space, the size of the front screen is a×b, the size of the upper and lower screens is a×c, the size of the left and right screens is b×c, and d and e are respectively the height of the best viewing point and the horizontal distance from the immersive CAVE space.

2. The cropping method according to claim 1, characterized in that The resolution of the multi-sided screen of the CAVE immersive space is adjusted according to the size of each screen.

3. The cropping method according to claim 1, characterized in that The original video picture is cropped into five regional pictures. Among them, among the five regions, the front screen is a rectangle, and the others are irregular quadrilaterals; after cropping, the upper, lower, left, and right irregular quadrilaterals need to be transformed into rectangles with specified aspect ratios and resolutions.

4. A system for realizing two-dimensional video display in a CAVE immersive space, characterized in that, It includes: A setting module that presets the size of the CAVE immersive space and pre-specifies the position of the best viewing point relative to the CAVE immersive space, where the best viewing point is outside the CAVE immersive space; A selection module that selects the two-dimensional video picture suitable for cropping according to the size of the CAVE immersive space, and adjusts the size and position of the video picture to select the picture content suitable for placing on the front screen; A cropping module that crops the original video picture into five regional pictures according to the height of the best viewing point, the horizontal distance from the CAVE immersive space, as well as the size of the front screen, the size of the upper and lower screens, and the size of the left and right screens; A generating module that crops and produces the five regional pictures into a multi-screen picture corresponding to the CAVE immersive space according to the calculated quantitative relationship, and generates the corresponding video file; the quantitative relationship of the five regions after cropping is: Among them, a, b, and c are respectively the length, height, and depth of the CAVE immersive space, the size of the front screen is a×b, the size of the upper and lower screens is a×c, the size of the left and right screens is b×c, and d and e are respectively the height of the best viewing point and the horizontal distance from the immersive CAVE space.

5. The system according to claim 4, characterized in that The resolution of the multi-sided screen of the CAVE immersive space is adjusted according to the size of each screen.

6. The system according to claim 4, characterized in that Five regional images cropped from the original video image. Among the five regions, the front screen is rectangular, and the others are irregular quadrilaterals; after cropping, the upper, lower, left, and right irregular quadrilaterals need to be transformed into rectangular videos with specified aspect ratios and resolutions.

Images