An interactive experience system combining AR technology and 3D models

Abstract

This invention discloses an interactive experience system combining AR technology and 3D models, comprising: a model display platform, including 3D printed models, a base, a driving device, a shield, and a first processor; several 3D printed models are mounted on the base; the driving device drives the base to rotate; and the first processor controls the activation of the driving device; and AR glasses, including lenses, a camera, a memory, and a second processor; the camera captures images of objects within the wearer's field of vision; the first and second processors are wirelessly connected; and the second processor acquires the captured object images in real time, identifies whether a 3D printed model exists within the wearer's field of vision, and if so, the model type. Compared to existing technologies, this invention enables a combined virtual and real display of 3D printed product models in conjunction with AR glasses, and allows for effective interaction between the product models and the AR glasses.

Description

Technical Field

[0001] This invention relates to the field of interactive exhibition technology, and more particularly to an interactive experience system that combines AR technology with 3D models. Background Technology

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses various technologies such as multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, and sensing to simulate and apply computer-generated virtual information such as text, images, 3D models, music, and videos to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0003] Currently, exhibitions often combine AR glasses with 3D product models. When visitors wear AR glasses to view the product's 3D model, the glasses play AR videos, achieving a hybrid virtual and real display effect. However, this method simply uses AR glasses to enhance the visitor experience; the lack of interaction between the product's 3D model and the AR glasses results in a limited interactive experience for visitors. Summary of the Invention

[0004] The purpose of this invention is to provide an interactive experience system that combines AR technology with 3D models. The 3D printed product model is used in conjunction with AR glasses to achieve a virtual-real combination display, and the product model interacts effectively with the AR glasses to enhance the visitor experience.

[0005] To achieve the above objectives, the present invention adopts the following technical solution: an interactive experience system combining AR technology and 3D models, comprising:

[0006] The model display platform includes a 3D printed model, a base, a drive device, a baffle and a first processor. Several 3D printed models are set on the base. The base is installed at the output end of the drive device, which is used to drive the base to rotate. The base is set in the cavity of the baffle, and the baffle has notches corresponding to the positions of the 3D printed models. The first processor is used to control the start of the drive device.

[0007] AR glasses include lenses, a camera, a memory, and a second processor. The lenses are equipped with a display light waveguide for displaying video images stored in the memory. The camera is used to capture images of objects within the wearer's field of vision. The first and second processors are wirelessly connected. The second processor is used to acquire the captured object images in real time and identify whether a 3D printed model exists within the wearer's field of vision and, if so, the model type.

[0008] As a further description of the above technical solution:

[0009] AR glasses also include a distance sensor, which detects in the same direction as the wearer's line of sight. The distance sensor is connected to a second processor.

[0010] As a further description of the above technical solution:

[0011] The distance sensor is a FoT matrix optical distance sensor.

[0012] As a further description of the above technical solution:

[0013] AR glasses also include a gesture recognition component, which includes an infrared light source and an infrared image sensor. The infrared light source is used to generate infrared light, and the infrared image sensor is used to receive infrared light reflected from objects in front of the AR glasses, acquire multiple images, and identify the movement trajectory of objects.

[0014] As a further description of the above technical solution:

[0015] The bottom of the baffle is provided with a lifting base, which includes a mounting base and at least one lifting driver. The baffle is fixedly mounted on the mounting base, and the mounting base is fixedly mounted on the output end of the lifting driver.

[0016] As a further description of the above technical solution:

[0017] The lifting actuator is an electric push rod.

[0018] As a further description of the above technical solution:

[0019] The mounting base plate has symmetrically arranged lifting actuators on both sides.

[0020] As a further description of the above technical solution:

[0021] AR glasses also include a posture sensor, which is used to collect the angle information of AR glasses. The second processor calculates the user's head posture information based on the angle information and transmits it to the first processor. The first processor controls the lifting base to rise or fall based on the head posture information.

[0022] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0023] 1. In this invention, visitors wear AR glasses. When a second processor identifies a 3D-printed model within the wearer's field of vision and identifies the model's model number, the second processor controls the display waveguide to play the corresponding video image. After the video image corresponding to the model model finishes playing, the second processor sends a first control signal to the first processor. Upon receiving the first control signal, the first processor controls the drive device to rotate, causing the next 3D-printed model to reveal a gap in the cover, facilitating continued interaction with the AR glasses. The 3D-printed product model, combined with the AR glasses, achieves a virtual-real hybrid display, and the product model effectively interacts with the AR glasses, enhancing the visitor experience. Attached Figure Description

[0024] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a schematic diagram of the structure for recognizing a subject in an interactive experience system that combines AR technology and 3D models. Figure 1 .

[0026] Figure 2 This is a schematic diagram of the structure for recognizing a subject in an interactive experience system that combines AR technology and 3D models. Figure 2 .

[0027] Legend:

[0028] 1. Model display platform; 11. 3D printed model; 12. Base; 13. Drive unit; 14. Cover; 141. Cavity; 142. Notch; 15. Lifting base; 151. Mounting base plate; 152. Lifting driver. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0030] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0031] Please see Figure 1-2 This invention provides a technical solution: an interactive experience system combining AR technology and 3D models, comprising:

[0032] The model display platform 1 includes a 3D printed model 11, a base 12, a drive device 13, a baffle 14, and a first processor. Several 3D printed models 11 are set on the base 12. The base 12 is installed at the output end of the drive device 13. The drive device 13 is used to drive the base 12 to rotate. The base 12 is circular. Several 3D printed models 11 are arranged around the base 12. The base 12 is set in the cavity 141 of the baffle 14. The baffle 14 is provided with notches 142 corresponding to the positions of the 3D printed models 11. The first processor is used to control the drive device 13 to start.

[0033] AR glasses include lenses, a camera, a memory, and a second processor. The lenses are equipped with a display light waveguide for displaying video images stored in the memory. The camera is used to capture images of objects within the wearer's field of vision. The first and second processors are wirelessly connected. The second processor is used to acquire the captured object images in real time and identify whether a 3D printed model 11 exists within the wearer's field of vision and the model type when the 3D printed model 11 exists.

[0034] The AR glasses also include a distance sensor. The distance sensor's detection direction is consistent with the wearer's line of sight. The distance sensor is connected to a second processor and is a FoT matrix optical distance sensor. The distance sensor is used to identify the distance between the AR glasses and the 3D printed model 11. When the distance is not within the optimal viewing distance range (between 0.5 and 1 meter), the second processor calculates the data and controls the display waveguide to show a distance prompt, prompting the visitor to move closer to or away from the model.

[0035] The AR glasses also include a gesture recognition component, which includes an infrared light source and an infrared image sensor. The infrared light source generates infrared light, and the infrared image sensor receives infrared light reflected from objects in front of the AR glasses, acquiring multiple images and recognizing the object's movement trajectory. The gesture recognition component enables the model display platform 1 to be controlled by gestures. When the AR glasses wearer waves their hand within their field of vision, the infrared light generated by the infrared light source is reflected, the infrared image sensor acquires multiple images, recognizes the hand's movement trajectory, and identifies the gesture (e.g., "next"). At this point, the second processor sends the gesture command to the first processor. The first processor, without waiting for the corresponding video image to finish playing, immediately controls the drive device 13 to rotate the next 3D printed model 11 to expose the cover 14, thus achieving gesture control.

[0036] A lifting base 15 is provided at the bottom of the cover 14. The lifting base 15 includes a mounting base 151 and at least one lifting driver 152. The cover 14 is fixedly mounted on the mounting base 151, and the mounting base 151 is fixedly mounted on the output end of the lifting driver 152. The model display platform 1 can adjust the height of the 3D printed model 11 through the lifting base 15 to facilitate visitor interaction.

[0037] The lifting driver 152 is an electric push rod, ensuring precise height adjustment.

[0038] The mounting base plate 151 is provided with symmetrically arranged lifting drivers 152 on both sides to ensure stable distance and height.

[0039] The AR glasses also include a posture sensor, which collects the angle information of the AR glasses. The second processor calculates the user's head posture information based on the angle information and transmits it to the first processor. The first processor controls the lifting base 15 to rise or fall based on the head posture information. The AR glasses use the posture sensor to identify whether the wearer's head is raised, lowered, or level. If the wearer's head is raised, the second processor sends this information to the first processor, which then controls the lifting base 15 to fall. Conversely, if the head is lowered, the lifting base 15 rises. This ensures a good viewing experience and enables interactive viewing.

[0040] Furthermore, once the first processor controls the lifting base 15 to rise or fall and the user's head posture meets the requirements, the second processor prompts the AR glasses wearer to move closer to or further away from the 3D printed model 11 based on the distance identified by the distance sensor.

[0041] Working principle: Visitors wear AR glasses. When the second processor recognizes a 3D printed model 11 within the wearer's field of vision and identifies the model's model number, the second processor controls the display waveguide to play the corresponding video image. After the video image corresponding to that model's model finishes playing, the second processor sends a first control signal to the first processor. Upon receiving the first control signal, the first processor controls the drive device 13 to rotate, causing the next 3D printed model 11 to emerge from the gap in the cover 14 (other models are hidden by the cover), facilitating continued interaction with the AR glasses. The 3D printed product model, combined with the AR glasses, achieves a virtual-real hybrid display, and the product model effectively interacts with the AR glasses, enhancing the visitor experience.

[0042] The above description is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in the present invention, based on the technical solution and inventive concept of the present invention, should be covered within the scope of protection of the present invention.

Claims

1. An interactive experience system combining AR technology and 3D models, characterized in that, include: The model display platform (1) includes a 3D printed model (11), a base (12), a drive device (13), a shield (14) and a first processor. Several 3D printed models (11) are arranged on the base (12). The base (12) is installed at the output end of the drive device (13). The drive device (13) is used to drive the base (12) to rotate. The base (12) is arranged in the cavity (141) of the shield (14). The shield (14) is provided with a notch (142) corresponding to the position of the 3D printed model (11). The first processor is used to control the drive device (13) to start. AR glasses include lenses, a camera, a memory, and a second processor. A display waveguide is disposed within the lens, which displays video images stored in the memory. The camera captures images of objects within the wearer's field of vision. The first and second processors are wirelessly connected. The second processor acquires the captured object images in real time and identifies whether the 3D printed model (11) exists within the wearer's field of vision and the model type when the 3D printed model (11) exists. The AR glasses also include a distance sensor, the detection direction of which is consistent with the line of sight of the AR glasses wearer, and the distance sensor is connected to the second processor; The bottom of the cover (14) is provided with a lifting base (15). The AR glasses also include a posture sensor, which is used to collect the angle information of the AR glasses. The second processor calculates the user's head posture information based on the angle information and transmits it to the first processor. The first processor controls the lifting base (15) to rise or fall based on the head posture information. Visitors wear AR glasses for the tour. When the second processor recognizes the presence of a 3D printed model within the wearer's field of vision and identifies the model's model number, the second processor controls the display waveguide to play the corresponding video image. After the video image corresponding to the model model has finished playing, the second processor sends a first control signal to the first processor. After receiving the first control signal, the first processor controls the drive device to rotate, so that the next 3D printed model reveals a gap in the cover, making it easier for the AR glasses to continue recognition and interaction.

2. The interactive experience system of claim 1, wherein, The distance sensor is a FoT matrix optical distance sensor.

3. The interactive experience system combining AR technology and 3D models according to claim 1, characterized in that, The AR glasses also include a gesture recognition component, which includes an infrared light source and an infrared image sensor. The infrared light source is used to generate infrared light, and the infrared image sensor is used to receive infrared light reflected by objects in front of the AR glasses, acquire multiple images, and identify the movement trajectory of the objects.

4. The interactive experience system of claim 1, wherein, The lifting base (15) includes a mounting base (151) and at least one lifting driver (152). The cover (14) is fixedly mounted on the mounting base (151), and the mounting base (151) is fixedly mounted on the output end of the lifting driver (152).

5. The interactive experience system of claim 4, wherein, The lifting driver (152) is an electric push rod.

6. An interactive experience system combining AR technology and 3D models according to claim 5, characterized in that, The mounting base plate (151) is provided with the lifting drivers (152) arranged symmetrically on both sides.

Images