A three-dimensional holographic interactive system and method for digital display cabinets
Through the three-dimensional holographic interactive system and pixel self-luminous technology, the problem of traditional digital showcases being unable to truly restore the three-dimensional sense is solved, and an immersive three-dimensional display and user interactive experience is achieved.
Patent Information
- Application Number
- CN202410178594.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-09
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2044-02-09
AI Technical Summary
Traditional digital display cabinet technology cannot truly restore the three-dimensional sense and spatial position of objects, mainly due to the limitations of simulating three-dimensional effects on a flat display or two-dimensional screen.
A three-dimensional holographic interactive system is used to present three-dimensional images on transparent media through the steps of point cloud data acquisition, three-dimensional model construction, format conversion, three-dimensional imaging and user interactive input conversion, combined with pixel self-illumination technology, and supports real-time user interaction.
It achieves a true three-dimensional display, can restore the three-dimensional sense and spatial position of objects, and provides an immersive display experience and realistic interaction.
Smart Images

Figure CN118038771B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computers, and more specifically, to a three-dimensional holographic interactive system and method for a digital showcase. Background Art
[0002] Digital showcase is a display method that combines physical display with virtual information using advanced computer graphics and display technology. It allows viewers to interact with exhibits in a virtual scene through projection, augmented reality and other technical means, providing a more immersive display experience. However, traditional digital showcase technology mainly uses LCD (Liquid Crystal Display) display, which is based on flat display or simulates three-dimensional effects on a two-dimensional screen, and cannot truly restore the three-dimensional sense and spatial position of objects.
[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention
[0004] The embodiments of the present application provide a three-dimensional holographic interactive system and method for a digital showcase to solve the above-mentioned technical problems.
[0005] According to one aspect of the embodiment of the present application, the present application provides a three-dimensional holographic interactive system for a digital showcase, including a point cloud data acquisition unit, a three-dimensional model construction unit, a format conversion unit, a three-dimensional imaging unit, and an input conversion unit, wherein:
[0006] The above-mentioned point cloud data acquisition unit is used to acquire three-dimensional point cloud data of a preset object through a first preset device, wherein the above-mentioned first preset device includes a sensor and a camera; the above-mentioned three-dimensional model construction unit is used to construct a three-dimensional model of the above-mentioned preset object based on the above-mentioned three-dimensional point cloud data; the above-mentioned format conversion unit is used to convert the above-mentioned three-dimensional model into a target format for holographic display; the above-mentioned three-dimensional imaging unit is used to present the above-mentioned three-dimensional model on a transparent medium based on pixel self-luminous technology to form a virtual three-dimensional image; the above-mentioned input conversion unit is used to acquire user interaction input in real time through a second preset device, and convert the above-mentioned user interaction input into an action on the holographic display scene.
[0007] Furthermore, the above-mentioned three-dimensional holographic interactive system for digital showcases also includes: a model preprocessing unit, used to perform preprocessing operations on the above-mentioned three-dimensional model before converting the above-mentioned three-dimensional model into a target format for holographic display, wherein the above-mentioned preprocessing operations include texture mapping operations, material setting operations and lighting adjustment operations; an interaction mode determination unit, used to determine a preset interaction mode as a mode for the above-mentioned holographic display scene to interact with the user before obtaining the user interaction input in real time through the second preset device, wherein the above-mentioned preset interaction mode includes gesture recognition, touch sensing and sound control.
[0008] Furthermore, the three-dimensional model of the preset object is constructed based on the three-dimensional point cloud data, including: aligning the three-dimensional point cloud data based on a preset point cloud registration algorithm to generate the three-dimensional model;
[0009] The converting the three-dimensional model into a target format for holographic display includes: converting the three-dimensional model into a target format for holographic display, wherein the target format is a point cloud format or a voxel grid format;
[0010] Before presenting the three-dimensional model on the transparent medium based on the pixel self-luminous technology, the method further includes: for each pixel position (x, y) on the plane, performing the following operations:
[0011] Calculate the light direction D(x,y);
[0012] Calculate the angle θ(x,y) between the normal and the direction of the light;
[0013] According to the optical diffraction or interference theory, the imaging light intensity P(x,y) at the above pixel position (x,y) is calculated;
[0014] The above pixel position (x, y) is used to determine the emission direction of the light.
[0015] According to another aspect of an embodiment of the present application, the present application provides a three-dimensional holographic interactive system for a digital display cabinet, including: obtaining three-dimensional point cloud data of a preset object through a first preset device, wherein the first preset device is an optical sensor; constructing a three-dimensional model of the preset object based on the three-dimensional point cloud data; converting the three-dimensional model into a target format for holographic display; presenting the three-dimensional model on a transparent medium based on pixel self-luminous technology to form a virtual three-dimensional image; obtaining user interaction input in real time through a second preset device, and converting the user interaction input into actions on a holographic display scene.
[0016] Furthermore, the three-dimensional model of the preset object is constructed based on the three-dimensional point cloud data, including: aligning the three-dimensional point cloud data based on a preset point cloud registration algorithm to generate the three-dimensional model.
[0017] Furthermore, before converting the three-dimensional model into a target format for holographic display, the method further includes: performing a preprocessing operation on the three-dimensional model, wherein the preprocessing operation includes a texture mapping operation, a material setting operation, and a lighting adjustment operation.
[0018] Furthermore, the above-mentioned converting the above-mentioned three-dimensional model into a target format for holographic display includes: converting the above-mentioned three-dimensional model into a target format for holographic display, wherein the above-mentioned target format is a point cloud format or a voxel grid format.
[0019] Furthermore, before obtaining user interaction input in real time through the second preset device, the method further includes: determining a preset interaction mode as a mode for the holographic display scene to interact with the user, wherein the preset interaction mode includes gesture recognition, touch sensing and sound control.
[0020] Furthermore, before presenting the three-dimensional model on a transparent medium based on the pixel self-luminous technology, the method further includes: for each pixel position (x, y) on the plane, performing the following operations: calculating the light direction D(x, y); calculating the angle θ(x, y) between the normal and the light direction; and calculating the imaging light intensity P(x, y) at the pixel position (x, y) according to the optical diffraction or interference theory; wherein the pixel position (x, y) is used to determine the emission direction of the light.
[0021] Furthermore, the above-mentioned light direction D(x,y)=L(x,y)+V(x,y); wherein V(x,y) is the viewing angle vector at the above-mentioned pixel position (x,y), and L(x,y) is the light source vector at the above-mentioned pixel position (x,y); the angle θ(x,y) between the above-mentioned normal and the above-mentioned light direction=acos(N(x,y)*D(x,y)); wherein * is a multiplication sign, and N(x,y) is the normal vector at the above-mentioned pixel position (x,y); the above-mentioned imaging light intensity P(x,y)=A*(1+cos(2π / λ*d(x,y)*sin(θ(x,y))) / 2); wherein A is a constant, d(x,y) is the distance from the pixel to the surface of the object, and λ is the wavelength of light.
[0022] Based on the embodiments provided in the present application, through the point cloud data acquisition unit, the three-dimensional model construction unit, the format conversion unit, the three-dimensional imaging unit and the input conversion unit, the three-dimensional holographic interactive system for the digital showcase can realize the whole process from data acquisition, scene modeling, holographic imaging to interactive design and sensing, and provide a real three-dimensional display for the digital showcase, which can truly restore the three-dimensional sense and spatial position of the object. At the same time, the pixel self-luminous technology is different from the traditional LCD display method. It does not require a backlight and uses a very thin transparent organic material coating and a transparent glass substrate. When an electric current passes through, these organic materials will emit light to realize the transparent imaging form of the product. Thereby creating a realistic three-dimensional effect, making the user feel that the exhibits are right in front of them. Users can freely observe, rotate and zoom in the virtual scene, so that users can get a more immersive display experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The drawings described herein are used to provide a further understanding of the embodiments of the present invention and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0024] Figure 1 is a structural diagram of an optional three-dimensional holographic interactive system for a digital showcase according to an embodiment of the present application;
[0025] Figure 2 The present invention is a flowchart of an optional three-dimensional holographic interaction method for a digital showcase according to an embodiment of the present application. DETAILED DESCRIPTION
[0026] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0028] First, some nouns or terms that appear in the description of the embodiments of the present application are subject to the following interpretation:
[0029] Digital showcase: A display method that uses advanced computer graphics and display technology to combine physical display with virtual information. It uses technologies such as augmented reality to allow viewers to interact with exhibits in a virtual scene, providing a more immersive display experience.
[0030] OLED (Organic Light-Emitting Diode), also known as organic electroluminescence display, organic light-emitting semiconductor (Organic Electroluminescence Display, OLED). OLED is a current-type organic light-emitting device, which emits light through the injection and recombination of carriers. The luminous intensity is proportional to the injected current. Under the action of the electric field, the holes generated by the anode and the electrons generated by the cathode will move, inject into the hole transport layer and the electron transport layer respectively, and migrate to the light-emitting layer. When the two meet in the light-emitting layer, energy excitons are generated, which excite the light-emitting molecules and finally produce visible light.
[0031] In some solutions of this application, the three-dimensional effect is simulated on a two-dimensional screen based on a flat display, and the three-dimensional sense and spatial position of the object cannot be truly restored. The introduction of the three-dimensional holographic interactive method has brought new breakthroughs to the digital showcase technology. The pixel self-luminous technology can directly generate realistic three-dimensional images in the air, allowing the audience to observe the three-dimensional appearance and motion effects of the exhibits in real time.
[0032] Optionally, as an optional implementation, as Figure 1 As shown, the three-dimensional holographic interactive system for digital showcase provided by the present application includes: a point cloud data acquisition unit 101, a three-dimensional model construction unit 102, a format conversion unit 103, a three-dimensional imaging unit 104 and an input conversion unit 105, wherein:
[0033] The point cloud data acquisition unit 101 is used to acquire three-dimensional point cloud data of a preset object through a first preset device, wherein the first preset device is an optical sensor;
[0034] In some embodiments of the present application, three-dimensional point cloud data of an object may be acquired through a sensor or a camera, and preprocessed, such as denoising, filtering, and registration, to improve data quality and accuracy.
[0035] A three-dimensional model building unit 102, used to build a three-dimensional model of a preset object based on the three-dimensional point cloud data;
[0036] In some embodiments of the present application, point cloud data may be used to construct a three-dimensional model of an object. A point cloud registration algorithm (such as ICP) may be used to align multiple point cloud data to generate a complete three-dimensional model.
[0037] A format conversion unit 103, used to convert the three-dimensional model into a target format for holographic display;
[0038] In some embodiments of the present application, the three-dimensional model can be converted into a format suitable for holographic imaging, such as a point cloud format or a voxel grid format for holographic display.
[0039] The three-dimensional imaging unit 104 is used to present the three-dimensional model on a transparent medium based on the pixel self-luminous technology to form a virtual three-dimensional image;
[0040] Specifically, the pixel self-luminous technology can be an OLED transparent display pixel self-luminous imaging technology.
[0041] In some embodiments of the present application, a holographic device may be used to generate optical interference or diffraction effects, and a three-dimensional model may be presented on a transparent medium to form a virtual three-dimensional image.
[0042] The input conversion unit 105 is used to obtain user interaction input in real time through a second preset device, and convert the user interaction input into an action on the holographic display scene.
[0043] In some embodiments of the present application, corresponding sensors or devices may be used to capture user interaction actions or inputs in real time and convert them into adjustments or operations on the display scene.
[0044] It should be understood that the imaging principle of OLED is the phenomenon of luminescence caused by carrier injection and recombination of organic semiconductor materials and luminescent materials under the drive of electric field. OLED display uses ITO transparent electrode and metal electrode as the anode and cathode of the device respectively. Under a certain voltage drive, electrons and holes are injected from the cathode and anode into the electron and hole transport layers respectively, and electrons and holes migrate to the luminescent layer through the electron and hole transport layers respectively, and meet in the luminescent layer to form excitons and excite the luminescent molecules, which then emit visible light through radiation relaxation and are precisely controlled to the pixel points.
[0045] OLED display technology is different from traditional LCD display. It does not require a backlight and uses a very thin transparent organic material coating and a transparent glass substrate. When current passes through, these organic materials will emit light to achieve a transparent imaging form of the product.
[0046] Optionally, as an optional implementation, the three-dimensional holographic interactive system for a digital showcase further includes:
[0047] A model preprocessing unit, used for performing a preprocessing operation on the three-dimensional model before converting the three-dimensional model into a target format for holographic display, wherein the preprocessing operation includes a texture mapping operation, a material setting operation, and a lighting adjustment operation;
[0048] The interaction mode determination unit is used to determine the preset interaction mode as the mode for the holographic display scene to interact with the user before obtaining the user interaction input in real time through the second preset device, wherein the preset interaction mode includes gesture recognition, touch sensing and sound control.
[0049] In some embodiments of the present application, texture mapping, material setting, and lighting adjustment can be performed on the three-dimensional model as needed to enhance the display effect. The user can design a way to interact with the holographic display scene, such as gesture recognition, touch sensing, or sound control.
[0050] Optionally, as an optional implementation, constructing a three-dimensional model of a preset object based on the three-dimensional point cloud data includes: aligning the three-dimensional point cloud data based on a preset point cloud registration algorithm to generate a three-dimensional model;
[0051] Converting the three-dimensional model into a target format for holographic display includes: converting the three-dimensional model into a target format for holographic display, wherein the target format is a point cloud format or a voxel grid format;
[0052] Before presenting the three-dimensional model on the transparent medium based on the pixel self-luminous technology, the method further includes: for each pixel position (x, y) on the plane, performing the following operations:
[0053] Calculate the light direction D(x,y);
[0054] Calculate the angle θ(x,y) between the normal and the light direction;
[0055] According to the optical diffraction or interference theory, calculate the imaging light intensity P(x,y) at the pixel position (x,y);
[0056] Among them, the pixel position (x, y) is used to determine the emission direction of the light.
[0057] Based on the embodiments provided in this application, the three-dimensional holographic interactive system for digital showcases provided in this application has the following significance: Providing an immersive display experience: Pixel self-luminous technology can create a realistic three-dimensional effect, making the audience feel that the exhibits are right in front of them. The audience can freely observe, rotate, and zoom in the virtual scene to obtain a more immersive display experience. Realizing realistic interaction: Pixel self-luminous technology combined with interactive design allows the audience to interact with virtual objects through gestures, sounds, or touch. The audience can touch and operate the exhibits, obtain relevant information, or perform scene demonstrations to increase participation and attractiveness. Expanding the application field of digital showcases: The three-dimensional holographic interactive method can not only be applied to traditional fields such as museums and art exhibitions, but also play an important role in education, entertainment, medical care and other fields. It can provide students with a more intuitive teaching experience, bring new creative content to the entertainment industry, and at the same time help visualize applications in anatomy and surgical simulation in the medical field.
[0058] Based on the embodiments provided in this application, the three-dimensional holographic interactive system can realize the whole process from data acquisition, scene modeling, holographic imaging to interactive design and sensing, providing realistic three-dimensional display for digital showcases and interactive experience between users and virtual objects.
[0059] Optionally, as an optional implementation, as Figure 2 As shown, the three-dimensional holographic interactive method for a digital showcase provided by the present application includes:
[0060] S201, acquiring three-dimensional point cloud data of a preset object through a first preset device, wherein the first preset device is an optical sensor;
[0061] In some embodiments of the present application, three-dimensional point cloud data of an object may be acquired through a sensor and preprocessed, such as denoising, filtering, and registration, to improve data quality and accuracy.
[0062] S202, constructing a three-dimensional model of a preset object based on the three-dimensional point cloud data;
[0063] In some embodiments of the present application, point cloud data may be used to construct a three-dimensional model of an object. A point cloud registration algorithm (such as ICP) may be used to align multiple point cloud data to generate a complete three-dimensional model.
[0064] S203, converting the three-dimensional model into a target format for holographic display;
[0065] In some embodiments of the present application, the three-dimensional model can be converted into a format suitable for holographic imaging, such as a point cloud format or a voxel grid format for holographic display.
[0066] S204, presenting the three-dimensional model on a transparent medium based on pixel self-luminous technology to form a virtual three-dimensional image;
[0067] Specifically, the pixel self-luminous technology can be an OLED transparent display pixel self-luminous imaging technology.
[0068] In some embodiments of the present application, a holographic device may be used to generate optical interference or diffraction effects, and a three-dimensional model may be presented on a transparent medium to form a virtual three-dimensional image.
[0069] S205, obtaining user interaction input in real time through a second preset device, and converting the user interaction input into an action on the holographic display scene.
[0070] In some embodiments of the present application, corresponding sensors or devices may be used to capture user interaction actions or inputs in real time and convert them into adjustments or operations on the display scene.
[0071] It should be understood that the imaging principle of OLED is the phenomenon of luminescence caused by carrier injection and recombination of organic semiconductor materials and luminescent materials under the drive of electric field. OLED display uses ITO transparent electrode and metal electrode as the anode and cathode of the device respectively. Under a certain voltage drive, electrons and holes are injected from the cathode and anode into the electron and hole transport layers respectively, and electrons and holes migrate to the luminescent layer through the electron and hole transport layers respectively, and meet in the luminescent layer to form excitons and excite the luminescent molecules, which then emit visible light through radiation relaxation and are precisely controlled to the pixel points.
[0072] OLED display technology is different from traditional LCD display. It does not require a backlight and uses a very thin transparent organic material coating and a transparent glass substrate. When current passes through, these organic materials will emit light to achieve a transparent imaging form of the product.
[0073] Optionally, as an optional implementation, constructing a three-dimensional model of a preset object based on three-dimensional point cloud data includes:
[0074] The 3D point cloud data is aligned based on the preset point cloud registration algorithm to generate a 3D model.
[0075] Optionally, as an optional implementation, before converting the three-dimensional model into a target format for holographic display, the method further includes:
[0076] A preprocessing operation is performed on the three-dimensional model, wherein the preprocessing operation includes a texture mapping operation, a material setting operation, and a lighting adjustment operation.
[0077] In some embodiments of the present application, as needed, operations such as texture mapping, material setting, and lighting adjustment may be performed on the three-dimensional model to enhance the display effect.
[0078] Optionally, as an optional implementation, converting the three-dimensional model into a target format for holographic display includes:
[0079] The three-dimensional model is converted into a target format for holographic display, wherein the target format is a point cloud format or a voxel grid format.
[0080] Optionally, as an optional implementation, before obtaining the user interaction input in real time through the second preset device, the method further includes:
[0081] The preset interaction mode is determined as the mode in which the holographic display scene interacts with the user, wherein the preset interaction mode includes gesture recognition, touch sensing, and sound control.
[0082] Optionally, as an optional implementation, before presenting the three-dimensional model on the transparent medium based on the pixel self-luminous technology, the method further includes:
[0083] For each pixel position (x,y) on the plane, perform the following operations:
[0084] Calculate the light direction D(x,y);
[0085] Calculate the angle θ(x,y) between the normal and the light direction;
[0086] According to the optical diffraction or interference theory, calculate the imaging light intensity P(x,y) at the pixel position (x,y);
[0087] Among them, the pixel position (x, y) is used to determine the emission direction of the light.
[0088] Optionally, as an optional implementation, the light direction D(x,y)=L(x,y)+V(x,y);
[0089] Wherein, V(x,y) is the viewing angle vector at the pixel position (x,y), and L(x,y) is the light source vector at the pixel position (x,y);
[0090] The angle between the normal and the light direction θ(x,y) = acos(N(x,y)*D(x,y));
[0091] Where * is a multiplication sign, and N(x,y) is the normal vector at the pixel position (x,y);
[0092] Imaging light intensity P(x,y)=A*(1+cos(2π / λ*d(x,y)*sin(θ(x,y))) / 2);
[0093] Among them, A is a constant, d(x,y) is the distance from the pixel to the surface of the object, and λ is the wavelength of light.
[0094] Based on the embodiments provided in this application, the three-dimensional holographic interactive method for digital showcases provided in this application has the following significance: Providing an immersive display experience: It can create a realistic three-dimensional effect, making the audience feel that the exhibits are right in front of them. The audience can freely observe, rotate, and zoom in the virtual scene to obtain a more immersive display experience. Realize realistic interaction: Pixel self-luminous technology combined with interactive design allows the audience to interact with virtual objects through gestures, sounds, or touch. The audience can touch and operate the exhibits, obtain relevant information, or perform scene demonstrations to increase participation and attractiveness. Expand the application field of digital showcases: The three-dimensional holographic interactive method can not only be applied to traditional fields such as museums and art exhibitions, but also play an important role in education, entertainment, medical care and other fields. It can provide students with a more intuitive teaching experience, bring new creative content to the entertainment industry, and at the same time help visualize applications in anatomy and surgical simulation in the medical field.
[0095] Based on the embodiments provided in this application, the three-dimensional holographic interaction method can realize the whole process from data acquisition, scene modeling, holographic imaging to interactive design and sensing, providing a realistic three-dimensional display for the digital showcase and an interactive experience between the user and the virtual objects.
[0096] It should be noted that the method embodiments of the present application can refer to the embodiments implemented by each unit module in the above-mentioned three-dimensional holographic interactive system for digital showcases, which will not be repeated here. In the above-mentioned embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0097] It should be noted that, for the above-mentioned embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0098] The above specific implementation methods further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A three-dimensional holographic interactive system for a digital showcase, characterized in that: It includes a point cloud data acquisition unit, a three-dimensional model construction unit, a format conversion unit, a three-dimensional imaging unit and an input conversion unit, wherein: The point cloud data acquisition unit is used to acquire three-dimensional point cloud data of a preset object through a first preset device, wherein the first preset device is an optical sensor; The three-dimensional model building unit is used to build a three-dimensional model of the preset object based on the three-dimensional point cloud data; The format conversion unit is used to convert the three-dimensional model into a target format for holographic display; The constructing the three-dimensional model of the preset object based on the three-dimensional point cloud data comprises: aligning the three-dimensional point cloud data based on a preset point cloud registration algorithm to generate the three-dimensional model; The converting the three-dimensional model into a target format for holographic display includes: converting the three-dimensional model into a target format for holographic display, wherein the target format is a point cloud format or a voxel grid format; The three-dimensional imaging unit is used to present the three-dimensional model on a transparent medium based on pixel self-luminous technology to form a virtual three-dimensional image; the three-dimensional model is presented on a transparent medium by generating optical interference or diffraction effect through a holographic device to form a virtual three-dimensional image; The input conversion unit is used to obtain user interaction input in real time through a second preset device, and convert the user interaction input into an action on the holographic display scene; Before presenting the three-dimensional model on the transparent medium based on the pixel self-luminous technology, the method further includes: for each pixel position (x, y) on the imaging plane, performing the following operations: Calculate the light direction D(x, y); Calculate the angle θ(x, y) between the normal and the direction of the light; Calculate the imaging light intensity P(x, y) at the pixel position (x, y) according to optical diffraction or interference theory; Wherein, the pixel position (x, y) is used to determine the emission direction of the light; The light direction D(x, y) = L(x, y) + V(x, y); Wherein, V(x, y) is the viewing angle vector at the pixel position (x, y), and L(x, y) is the light source vector at the pixel position (x, y); The angle between the normal and the light direction is θ(x, y) = acos(N(x, y)*D(x, y)); Wherein, * is a multiplication sign, N(x, y) is the normal vector at the pixel position (x, y); The imaging light intensity P(x, y) = A * (1 + cos(2π / λ * d(x, y) * sin(θ(x, y))) / 2); Where A is a constant, d(x, y) is the distance from the pixel to the surface of the object, and λ is the wavelength of light; The three-dimensional holographic interactive system for the digital showcase also includes: A model preprocessing unit, configured to perform a preprocessing operation on the three-dimensional model before converting the three-dimensional model into a target format for holographic display, wherein the preprocessing operation includes a texture mapping operation, a material setting operation, and a lighting adjustment operation; An interaction mode determination unit is used to determine a preset interaction mode as a mode for the holographic display scene to interact with the user before obtaining user interaction input in real time through a second preset device, wherein the preset interaction mode includes gesture recognition, touch sensing and sound control.
2. A three-dimensional holographic interactive method for a digital showcase, the method being implemented based on the system of claim 1, characterized in that: include: Acquire three-dimensional point cloud data of a preset object through a first preset device, wherein the first preset device includes a sensor and a camera; Constructing a three-dimensional model of the preset object based on the three-dimensional point cloud data; converting the three-dimensional model into a target format for holographic display; The three-dimensional model is presented on a transparent medium based on pixel self-luminous technology to form a virtual three-dimensional image; wherein the three-dimensional model is presented on a transparent medium to form a virtual three-dimensional image by generating an optical interference or diffraction effect through a holographic device; Acquire user interaction input in real time through a second preset device, and convert the user interaction input into an action on the holographic display scene; The constructing of the three-dimensional model of the preset object based on the three-dimensional point cloud data comprises: Aligning the three-dimensional point cloud data based on a preset point cloud registration algorithm to generate the three-dimensional model; Before presenting the three-dimensional model on the transparent medium based on the pixel self-luminous technology, the method further includes: For each pixel position (x, y) on the imaging plane, perform the following operations: Calculate the light direction D(x, y); Calculate the angle θ(x, y) between the normal and the direction of the light; Calculate the imaging light intensity P(x, y) at the pixel position (x, y) according to optical diffraction or interference theory; Wherein, the pixel position (x, y) is used to determine the emission direction of the light; The light direction D(x, y) = L(x, y) + V(x, y); Wherein, V(x, y) is the viewing angle vector at the pixel position (x, y), and L(x, y) is the light source vector at the pixel position (x, y); The angle between the normal and the light direction is θ(x, y) = acos(N(x, y)*D(x, y)); Wherein, * is a multiplication sign, N(x, y) is the normal vector at the pixel position (x, y); The imaging light intensity P(x, y) = A * (1 + cos(2π / λ * d(x, y) * sin(θ(x, y))) / 2); Where A is a constant, d(x, y) is the distance from the pixel to the surface of the object, and λ is the wavelength of light.
3. The three-dimensional holographic interactive method for a digital showcase according to claim 2, characterized in that: Before converting the three-dimensional model into a target format for holographic display, the method further includes: A preprocessing operation is performed on the three-dimensional model, wherein the preprocessing operation includes a texture mapping operation, a material setting operation, and a lighting adjustment operation.
4. The three-dimensional holographic interactive method for a digital showcase according to claim 3, characterized in that: The converting the three-dimensional model into a target format for holographic display comprises: The three-dimensional model is converted into a target format for holographic display, wherein the target format is a point cloud format or a voxel grid format.
5. The three-dimensional holographic interactive method for a digital showcase according to claim 3, characterized in that: Before acquiring the user interaction input in real time through the second preset device, the method further includes: A preset interaction mode is determined as a mode for the holographic display scene to interact with the user, wherein the preset interaction mode includes gesture recognition, touch sensing, and sound control.
Citation Information
Patent Citations
Metacosm display method, device and equipment based on digital twinning and medium
CN116071531A
3D scene image holographic display method, device, system and equipment and storage medium
CN116301379A