360-degree holographic projection imaging device and method
By using rotating surface and control unit processing technology in the three-dimensional image display device, the problem of three-dimensional image inconsistency restricted by the four-pyramid structure is solved, and a 360° wrap-around viewing experience is achieved, improving the display effect.
Patent Information
- Application Number
- CN202411013108.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2024-11-08
AI Technical Summary
The existing three-dimensional image display device adopts a quadrangular structure, which limits the number of display surfaces, resulting in inconsistency of three-dimensional images and affects the viewing experience.
The rotating surface is used instead of the traditional pyramid structure, and the image is processed by the control unit to eliminate image deformation caused by the reflection of the rotating surface, achieving a 360° wrap-around viewing experience.
It realizes a true 360° wraparound stereoscopic image display, eliminating image deformation caused by surface reflection and improving the viewing experience.
Smart Images

Figure CN118915330A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of holographic projection, and in particular to a 360° holographic projection imaging device and method. Background Art
[0002] Holographic projection technology is a technology that uses the interference and diffraction principles of light to record and reproduce the three-dimensional image of an object. However, the 3D display technology presented in stage performances, exhibitions and other activities is often not a strict holographic projection technology. Existing technologies often use reflection mechanisms such as the "Pepper's Ghost" principle to display images in mid-air.
[0003] "Pepper's Ghost" is an old visual effects technology, often used in stage performances, slide presentations, theme parks and other entertainment venues to create transparent phantoms or ghost effects. The basic principle is to use a glass plate or transparent film to project an object into the space where the audience is located, so that the audience sees a transparent phantom that seems to be suspended in the air.
[0004] At present, this kind of image projection has been widely used in publicity and promotion as well as three-dimensional image display.
[0005] However, the existing devices, forms or methods for displaying three-dimensional images using the Pepper's Ghost principle are mostly tetrahedral pyramid structures. These traditional devices or methods have the following disadvantages in use:
[0006] 1. If a tetrahedral pyramid structure is used, only images of four faces can be displayed at the same time.
[0007] 2. If a four-sided pyramid structure is used, when viewing at the junction of two pyramidal surfaces, images from the two surfaces at their respective angles will be observed at the same time, and the three-dimensional image will be discontinuous, thus affecting the viewing experience. Summary of the invention
[0008] The present application aims to solve one of the technical problems in the related art at least to some extent.
[0009] To this end, the first purpose of this application is to propose a 360° holographic projection imaging device, which adopts a rotating surface to replace the traditional pyramid structure and eliminates the image deformation caused by curved surface reflection, thereby ensuring the presentation effect of three-dimensional images and realizing a true 360° surround viewing experience.
[0010] The second purpose of this application is to propose a 360° holographic projection imaging method.
[0011] To achieve the above-mentioned objectives, the first aspect of the present application proposes a 360° holographic projection imaging device, comprising: a base, a display screen, and a phantom medium located between the base and the display screen, the display screen faces the phantom medium, the phantom medium has a rotating surface, the bottom edge of the rotating surface contacts the base, and the vertical projection of the display screen covers the phantom medium.
[0012] Optionally, in one embodiment of the present application, the device further includes:
[0013] A control unit connected to the display screen, the control unit is used to process the original image, eliminate the image deformation caused by the reflection of the rotating surface, and obtain a projected image;
[0014] The display screen displays the projected image;
[0015] When the display screen displays a projected image, it emits light, and the rotating surface of the phantom medium reflects the light, so that a three-dimensional image is presented in a central ring around the phantom medium between the base and the display screen.
[0016] Optionally, in one embodiment of the present application, the device further includes:
[0017] A sensor, the sensor is used to obtain an observation position of a user, wherein the observation position of the user is within 360° around the device;
[0018] The control unit is further configured to generate an image at a corresponding angle based on an observation position of a user, and use the image at the corresponding angle as the original image.
[0019] Optionally, in one embodiment of the present application, the control unit is further used to store images of angles corresponding to all observation positions, and based on the real-time observation position of the user, use the stored images of corresponding angles as original images.
[0020] Optionally, in one embodiment of the present application, the original image is processed to eliminate the image deformation caused by the reflection of the rotating surface to obtain the projected image, including:
[0021] Performing plane projection on the pixel points in the original image to obtain the coordinates of the first virtual image point symmetrical about the plane;
[0022] Combining the shape of the rotating surface and the user's observation position, the coordinates of the second virtual image point of the pixel point in the original image in the phantom medium are obtained by using the knowledge of geometric optics;
[0023] Changing the coordinates of the pixel points in the original image so that the coordinates of the second virtual image point coincide with the coordinates of the first virtual image point;
[0024] The coordinates of all pixels in the original image are changed to obtain an image at the angle corresponding to the observation position, and this image is used as the projection image.
[0025] Optionally, in one embodiment of the present application, the rotation surface is a conical surface, a frustum surface, a hemispherical surface or a hemispherical surface.
[0026] Optionally, in one embodiment of the present application, the base, the phantom medium, and the display screen are placed from bottom to top.
[0027] Optionally, in one embodiment of the present application, the base, the phantom medium, and the display screen are placed from top to bottom.
[0028] Optionally, in one embodiment of the present application, the phantom medium is glass, a spectroscope or a molecular film.
[0029] To achieve the above-mentioned purpose, the second embodiment of the present application proposes a 360° holographic projection imaging method, which is applied to the above-mentioned 360° holographic projection imaging device, including:
[0030] Obtain the user's observation position through sensors;
[0031] The control unit generates an image corresponding to the angle of the observation position as the original image, and processes the original image through the control unit to eliminate the image deformation caused by the reflection of the rotating surface to obtain a projection image;
[0032] The projection image is displayed on a display screen. The light emitted by the display screen is reflected by the rotating surface of the phantom medium, and a three-dimensional image is presented in a ring around the center of the phantom medium between the base and the display screen.
[0033] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0035] Figure 1 This is a schematic diagram of the three-dimensional structure of a 360° holographic projection device according to an embodiment of the present application;
[0036] Figure 2 This is a schematic diagram of the planar structure of a 360° holographic projection device according to an embodiment of the present application;
[0037] Figure 3 This is a hardware principle block diagram of an embodiment of the present application;
[0038] Figure 4 A schematic diagram of the imaging principle of an embodiment of the present application;
[0039] Figure 5 A schematic diagram of the position of virtual image points in a plane phantom medium according to an embodiment of the present application;
[0040] Figure 6 This is a schematic diagram of the structure of an inverted 360° holographic projection imaging device according to an embodiment of the present application;
[0041] Figure 7 This is a schematic diagram of the structure of an upright 360° holographic projection imaging device according to an embodiment of the present application;
[0042] Figure 8 This is a schematic structural diagram of another upright 360° holographic projection imaging device according to an embodiment of the present application;
[0043] Fig. 9 This is a schematic structural diagram of another upright 360° holographic projection imaging device according to an embodiment of the present application;
[0044] Fig.10 A schematic diagram of a flow chart of a 360° holographic projection imaging method provided in an embodiment of the present application; DETAILED DESCRIPTION
[0045] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0046] The following describes the 360° holographic projection imaging device and method of the embodiments of the present application with reference to the accompanying drawings.
[0047] Embodiment 1 of the present application provides a 360° holographic projection imaging device, including:
[0048] A base, a display screen, and a phantom medium located between the base and the display screen, the display screen faces the phantom medium, the phantom medium has a rotation surface, the bottom edge of the rotation surface contacts the base, and the vertical projection of the display screen covers the phantom medium.
[0049] This embodiment uses a rotating surface to replace the traditional pyramid structure, and eliminates the image deformation caused by the curved surface reflection through software, thereby ensuring the presentation effect of the three-dimensional image and realizing a true 360° surround viewing experience.
[0050] The embodiment of the present application also provides a 360° holographic projection device.
[0051] Figure 1 is a schematic diagram of the three-dimensional structure of a 360° holographic projection device according to an embodiment of the present application, Figure 2 Schematic diagram of the planar structure of the 360° holographic projection device according to an embodiment of the present application. Figure 1 , Figure 2As shown, the device includes a lower base 3, an upper display screen 1 placed downward, and a phantom medium 2 of a right-standing circular cone with a known generatrix equation, wherein the bottom edge of the circular cone is supported on the lower base 3, and the orthographic projection of the phantom medium 2 completely falls into the upper display screen 1. The lower base 3 is used to support the phantom medium 2 so that the phantom medium reaches a suitable height. The material of the phantom medium 2 can be selected and is not limited to glass, a spectroscope, a molecular film, etc.
[0052] In some embodiments, a control unit is also included for processing the original image to be projected, offsetting the image deformation caused by the conical surface reflection, and obtaining a projection image for projection; the projection image is used to be displayed on the upper display screen 1.
[0053] The light emitted by the display screen is reflected by the phantom medium of the conical surface, so that a three-dimensional image is presented in a ring shape around the center line of the phantom medium 2 between the lower base 3 and the upper display screen 1. The user's observation position is 360° around the circumference of the device.
[0054] In some embodiments, a sensor is further included for obtaining the observation position of the user; the control unit is further used to generate an image of a corresponding angle according to the observation position, and use the image of the corresponding angle as the projection image.
[0055] Specifically, the sensor may be a camera or an infrared sensor, etc., the main purpose of which is to obtain the specific direction of the user's viewing angle of 360°, and then to facilitate the projection of the image in the corresponding direction.
[0056] In some embodiments, the hardware principle of the sensor 7, the control unit 6 and the upper display screen 1 is as follows: Figure 3 The imaging control module 601 in the control unit 6 generates an image of a corresponding angle as the original image according to the observation position of the user obtained by the sensor; then the image processing module 602 processes the original image to be projected to offset the image deformation caused by the reflection of the conical surface, and obtains a projection image for projection, which is sent to the upper display screen 1 for display via the imaging control module 601.
[0057] In some embodiments, compared with the plane reflection produced by the phantom medium of the traditional tetrahedral structure, the curved surface will affect the reflection trajectory of the light, thereby causing the stereoscopic image to be distorted relative to the original image. The principle of eliminating image deformation in this embodiment is that it is known that the virtual image formed by plane reflection is symmetrical with the original image about the plane, and the formed virtual image is distortion-free, so the virtual image coordinates formed by plane reflection are used as the expected result of distortion correction. Figure 4As shown, P and Q are two points on the display screen, and virtual image points P' and Q' are formed in the phantom medium. For phantom media of cone or other shapes, under the conditions of determining the light source point and the observation position, as long as the Fermat principle is combined and the condition that the incident angle is equal to the reflection angle is used, the light can be tracked and the position of the reflection point can be determined. After determining the observation position, for any point within a specific range on the display screen, there is only one virtual image point corresponding to it. The mapping relationship from the original image to the point virtual image can be derived by geometric optics theory or obtained by optical simulation. With this mapping relationship and the expected result after correction, the expected coordinates of the original image after correction can be solved, and the pixels on the original image are transformed according to this coordinate, and then projected on the display screen to achieve the effect of distortion correction.
[0058] In some embodiments, the image processing principle of the image processing module 602 specifically includes:
[0059] S1, such as Figure 5 As shown, the pixel point P in the original image is projected onto plane 2' to obtain the first virtual image point coordinates P' that are symmetrical about the plane.
[0060] S2. Combining the shape of the conical surface and the user's observation position, the coordinates P' of the second virtual image point of the pixel point in the original image in the phantom medium are obtained by using the knowledge of geometric optics. This mapping relationship is represented by f, that is, f(P) = P'. Figure 2 As shown, in this embodiment, the angle between the conical surface and the lower base 3 is 45°, which can facilitate calculation and imaging. Other angles can also be used.
[0061] S3, changing the coordinates of the pixel point P in the original image so that the processed point P of the second virtual image point coordinate P" just falls on the coordinate position of the first virtual image point P' when being mapped by the f function.
[0062] S4. After changing the coordinates of all pixels in the original image, a new image is generated as the projection image.
[0063] Furthermore, the image processing module 602 can pre-store the images of corresponding angles generated according to all observation positions and the obtained projection images; when the sensor 7 obtains the user's real-time observation position, it directly retrieves and displays the pre-stored projection images.
[0064] Furthermore, the image can be modeled into a 3D model, and then the 3D model can be pre-processed to obtain images of various angles according to all observation positions, and then the images of various angles can be pre-processed to eliminate image deformation and meet the requirements of correctly offsetting the image deformation effect caused by curved surface reflection. This can improve the real-time performance of observation.
[0065] The present application also provides an inverted 360° holographic projection imaging device, such as Figure 6 As shown, it includes an upper base 5, a lower display screen 4 placed upward, and an inverted conical phantom medium 2, and the user's observation position is still around the circumference of the device. The principle of eliminating image deformation is the same as above.
[0066] The present application also provides a vertical 360° holographic projection imaging device. Figure 7 As shown, it includes an upper display screen 1 placed downward, a lower base 3 for support, and a phantom medium 2 with a frustum. The frustum is in the shape of a small top and a large bottom. In this way, the orthographic projection of the phantom medium 2 can completely fall into the upper display screen 1. The principle of eliminating image deformation is the same as above.
[0067] The present application also provides a vertical 360° holographic projection imaging device. Figure 8 As shown, it includes an upper display screen 1 placed downward, a lower base 3 for support, and a hemispherical phantom medium 2. The hemispherical surface is an upper hemispherical surface. The principle of eliminating image deformation is the same as above.
[0068] The present application also provides a vertical 360° holographic projection imaging device. Fig. 9 As shown, it includes an upper display screen 1 placed downward, a lower base 3 for support, and a semi-ellipsoidal phantom medium 2. The semi-ellipsoidal surface is an upper semi-ellipsoidal surface.
[0069] In order to implement the above embodiment, the present application also proposes a 360° holographic projection imaging method, which is applied to the above 360° holographic projection imaging device.
[0070] Fig.10 A schematic flow chart of a 360° holographic projection imaging method provided in an embodiment of the present application.
[0071] like Fig.10 As shown, the 360° holographic projection imaging method comprises the following steps:
[0072] Step 1001, obtaining the user's observation position through a sensor;
[0073] Step 1002, the control unit generates an image at an angle corresponding to the observation position as an original image, and processes the original image through the control unit to eliminate image deformation caused by reflection of the rotating surface, thereby obtaining a projection image;
[0074] Step 1003, displaying the projection image through the display screen, the light emitted by the display screen is reflected by the rotating surface of the phantom medium, and a three-dimensional image is presented in a ring shape around the center of the phantom medium between the base and the display screen.
[0075] It should be noted that the aforementioned explanation of the embodiment of the 360° holographic projection imaging device is also applicable to the 360° holographic projection imaging method of this embodiment, and will not be repeated here.
[0076] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0077] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0078] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0079] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0080] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0081] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0082] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0083] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A 360° holographic projection imaging device, characterized in that: include: A base, a display screen, and a phantom medium located between the base and the display screen, wherein the display screen faces the phantom medium, the phantom medium has a rotation surface, the bottom edge of the rotation surface contacts the base, and the vertical projection of the display screen covers the phantom medium.
2. The 360° holographic projection imaging device according to claim 1, characterized in that: Also includes: A control unit connected to the display screen, the control unit is used to process the original image, eliminate the image deformation caused by the reflection of the rotating surface, and obtain a projected image; The display screen displays the projection image; When displaying the projection image, the display screen emits light, and the rotating surface of the phantom medium reflects the light, so that a three-dimensional image is presented in a central ring around the phantom medium between the base and the display screen.
3. The 360° holographic projection imaging device according to claim 2, characterized in that: Also includes: A sensor, the sensor is used to obtain an observation position of a user, wherein the observation position of the user is within 360° around the device; The control unit is further configured to generate an image at a corresponding angle based on an observation position of a user, and use the image at the corresponding angle as the original image.
4. The 360° holographic projection imaging device according to claim 3, characterized in that: The control unit is also used to store images of angles corresponding to all observation positions, and based on the real-time observation position of the user, use the stored images of angles corresponding to the original images.
5. The 360° holographic projection imaging device according to claim 4, characterized in that: The processing of the original image to eliminate the image deformation caused by the reflection of the rotating surface to obtain the projected image includes: Performing plane projection on the pixel points in the original image to obtain the coordinates of the first virtual image point symmetrical about the plane; Combining the shape of the rotating surface and the observation position of the user, the coordinates of the second virtual image point of the pixel point in the original image in the phantom medium are obtained by using the knowledge of geometric optics; Changing the coordinates of the pixel points in the original image so that the coordinates of the second virtual image point coincide with the coordinates of the first virtual image point; The coordinates of all the pixels in the original image are changed to obtain an image at an angle corresponding to the observation position, and the image is used as the projection image.
6. The 360° holographic projection imaging device according to claim 1, characterized in that: The rotating surface is a conical surface, a frustum surface, a hemispherical surface or a hemispherical surface.
7. The 360° holographic projection imaging device according to claim 1, characterized in that: The base, phantom medium and display screen are placed from bottom to top.
8. The 360° holographic projection imaging device according to claim 1, characterized in that: The base, phantom medium and display screen are placed from top to bottom.
9. The 360° holographic projection imaging device according to claim 1, characterized in that: The phantom medium is glass, a spectroscope or a molecular film.
10. A 360° holographic projection imaging method, characterized in that: The method is applied to the 360° holographic projection imaging device according to claims 1-9, and the method comprises: Acquiring the user's observation position through the sensor; The control unit generates an image corresponding to the angle of the observation position as an original image, and the control unit processes the original image to eliminate the image deformation caused by the reflection of the rotating surface to obtain a projection image; The projection image is displayed through the display screen. The light emitted by the display screen is reflected by the rotating surface of the phantom medium, and a three-dimensional image is presented in a central ring around the phantom medium between the base and the display screen.
