Interactive intelligent venue device based on augmented reality technology

Abstract

The embodiment of the invention discloses an interactive intelligent venue device based on an augmented reality technology. The application comprises a mode of arranging an augmented reality display device and an augmented reality calibration device in a venue; and designing an internal module of the augmented reality display device, wherein the augmented reality calibration device corresponding to the exhibit interacts with the augmented reality display device through a signal. By adopting the method and the device, interactive and personalized intelligent display contents can be displayed in the venue.

Description

Technical Field

[0001] This application designs a device based on augmented reality technology to upgrade the interactivity and intelligence of the venue. Through the device designed in this application, visitors to the venue can browse immersive, interactive, and personalized display content, improving the information display capabilities of the venue. Background Art

[0002] Venues have many applications in daily life, including commercial promotion, cultural display, museum exhibition, science popularization, astronomy exhibition, etc. When a venue displays information, the presentation form of the information is very important to users. At present, general venue installations have text display, picture display, model display, video display, etc., which lack immersion, interactivity, and personalization. The display information faced by each user is fixed, lacking details and interaction.

[0003] Augmented Reality (AR) is a technology that combines virtual information with the real world. It uses computer-generated information (such as graphics, sound, video, etc.) to enhance the user's perception of the real environment. The core of this technology is to superimpose virtual content on the real scene seen by the user in real time to enhance the user experience.

[0004] Based on the above background, this application designs an interactive and intelligent venue device based on AR technology, and provides its implementation method. Based on the wearable AR display device provided by the venue, when users browse items with AR calibration devices in the venue, they can see rich, interactive, and personalized virtual content in addition to the items themselves, improving the browsing experience and content completeness. Summary of the invention

[0005] The embodiment of the present application provides a device for upgrading the interactivity and intelligence of a venue based on augmented reality technology, which allows venue visitors to browse immersive, interactive, and personalized display content.

[0006] The embodiment of the present application provides a method of arranging an AR display device and an AR calibration device in a venue. Visitors to the venue observe exhibits through the AR display device and can simultaneously see the virtual content corresponding to the exhibits.

[0007] The embodiment of the present application provides a technical process for browsing exhibit information based on AR technology. The technical process provides in detail the internal structure of the AR display device and the process of the AR calibration device interacting with the AR display device through signals.

[0008] Among them, each exhibit is equipped with one or a group of AR calibration devices, which send signals to the outside. The signal carries a unique identification code (ID) of the AR calibration device. When the AR display device views the exhibit, if the direction of the received signal transmission is less than a certain angle, the AR display device will judge that the exhibit is being viewed. At this time, the AR display device runs the augmented reality processing module according to the identification code (ID) of the AR calibration device carried in the signal, generates augmented reality virtual content (including text, pictures, videos, audio), and superimposes it on the real world seen by the AR display device to form rich display content.

[0009] Different exhibits have different corresponding AR calibration devices, and the identification codes (ID) contained in the transmitted signals are also different. Therefore, when the AR display device looks at different exhibits, the augmented reality virtual content it sees is different.

[0010] Furthermore, the embodiment of the present application provides an implementation method of a configurable AR display device. Visitors can adjust the AR display device to generate augmented reality virtual content by operating the settings of the AR display device. Visitors can watch the personalized augmented reality virtual content set by themselves.

[0011] Furthermore, the embodiments of the present application provide a method for expanding the computing power of an AR display device to generate augmented reality virtual content. The augmented reality processing module in the AR display device can interact with the augmented reality processing server in the venue, and send the ID of the AR calibration device and the setting parameters of the augmented reality control module to the server. After the processing is completed, the server sends the augmented reality virtual content back to the AR display device. At this time, the AR display device can display virtual content with a larger computing amount. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0013] Figure 1 This is a venue device deployment diagram based on AR technology provided in an embodiment of the present application.

[0014] Figure 2 This is a technical flow chart of browsing exhibit information based on AR technology provided in an embodiment of the present application.

[0015] Figure 3 This is an example diagram of browsing exhibition information based on AR technology provided in an embodiment of the present application.

[0016] Figure 4 This is an example diagram provided by an embodiment of the present application for determining whether an AR display device is viewing an AR calibration device. DETAILED DESCRIPTION

[0017] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0018] Some of the terms mentioned in this application are explained as follows:

[0019] Augmented Reality: Augmented Reality, referred to as AR in this article, is a technology that combines virtual information with the real world.

[0020] Augmented reality display device: referred to as AR display device. Generally, it is a head-mounted glasses, but there are also other devices (such as handheld display devices). Through this device, you can not only directly see the real scene and objects, but also recognize the signal emitted by the "augmented reality calibration device", so as to superimpose the virtual content on the real scene seen by the user.

[0021] Augmented reality calibration device: referred to as AR calibration device. Each AR calibration device has a different identification code (AR calibration device ID). The AR calibration device sends a specific signal to the outside, and the signal contains the ID of the AR calibration device. The signal can be received by the AR display device.

[0022] Virtual content: digitally generated content, including text, images, videos, and audio.

[0023] For details, see Figure 1 , Figure 1A venue device deployment diagram based on AR technology is provided for an embodiment of the present application. In the venue 101, the display areas on the walls and roofs are covered with exhibits with AR calibration devices 102. Visitors 104 who enter the venue wear AR display devices 103 for viewing. When the visitor 104 visits a specific exhibit, in addition to seeing the exhibit itself through the AR display device 103, the AR display device 103 also receives a signal sent by the AR calibration device 102 of the corresponding exhibit. After receiving the signal, the AR display device 103 displays the virtual content of the corresponding exhibit according to the ID of the AR calibration device 102 carried in the signal, and superimposes it on the real exhibit seen by the user. The virtual content may include: text, pictures, videos, and audio. And the visitor 104 can set parameters on the AR display device 103 to adjust the virtual content he is interested in viewing, so that the virtual content seen by each visitor 104 can be personalized.

[0024] For details, see Figure 2 , Figure 2 A technical flow chart for browsing exhibition information based on AR technology provided in an embodiment of the present application. The flow chart shows the technical process of the visitor 200 viewing the real content and virtual content through the AR display device 201. In order to specifically illustrate the internal structure of the virtual device 201, the internal components and technical processing flow of the device are marked as 202 to 210.

[0025] When the visitor 200 views the real world 212, the real exhibit A 213, and the real exhibit B 216 through the AR display device 201, these real contents are transmitted 204 to the display mirror 202 through the direct display optical module 203 of the AR display device 201. The visitor 200 views the contents of the real world as if he were wearing a pair of ordinary plain glasses.

[0026] When the visitor 200 views the real exhibit A 213 through the AR display device 201, the exhibit is installed with an AR calibration device 214. The AR calibration device 214 sends out a signal 215. When the AR display device 201 is within a certain angle of the emission direction of the signal 215, it will be determined that the signal 215 has been received. At this time, the augmented reality processing module 207 in the AR display device 201 starts to start. The augmented reality processing module 207 first identifies the AR calibration device ID carried in the signal 215, and then displays the virtual content related to the ID according to the corresponding ID, and transmits 208 the virtual content to the display mirror 202. At this time, the visitor 200 can see the exhibited content in the real world and the superimposed virtual content at the same time.

[0027] Furthermore, the AR display device 201 can be controlled and set by the visitor 200. The results of the control and setting are transmitted 206 to the augmented reality processing module 207 by the augmented reality control module 205. At this time, the augmented reality processing module 207 will generate different virtual content according to the settings and transmit 208 to the display mirror. At this time, the visitor 200 sees his own personalized virtual content, which is not exactly the same as the virtual content seen by other visitors.

[0028] Furthermore, when the computing power of the augmented reality processing module 207 of the AR display device 201 is insufficient, part of the processing process can be sent to the augmented reality processing server 211 deployed in the venue. The augmented reality processing module 207 transmits 209 the input parameters required for processing, including the control information input by the augmented reality control module 205 and the ID of the AR calibration device to the augmented reality processing server 211. After the server completes the computing, it transmits 210 the generated virtual content back to the augmented reality processing module 207. The augmented reality processing module 207 merges the virtual content and transmits 208 it to the display mirror 202.

[0029] Furthermore, the whole process of the AR display device 201 viewing the real B exhibit 216 is similar. The difference is that the AR calibration device 217 installed in the real B exhibit 216 carries a different AR calibration device ID in the signal 218 sent out. The augmented reality processing module 207 will overlay and display different virtual contents for different AR calibration device IDs.

[0030] For example, see Figure 3 , Figure 3 An example diagram of browsing exhibition information based on AR technology provided in an embodiment of the present application. Visitors 301 and 302 view real dinosaur exhibits 303. AR display devices 304 and 306 can directly display 305 and 307 the real dinosaur exhibits 303 to visitors 301 and 302.

[0031] Furthermore, the AR calibration device 308 of the real dinosaur exhibit 303 sends a signal 309 to the outside. The AR display device 304 and the AR display device receive the signal 309. The AR display device 304 sees the virtual A content 310 of the dinosaur according to the setting of the visitor 301, and displays 312 to the visitor 301. In contrast, the AR display device 306 sees another virtual B content 311 of the dinosaur according to another setting of the visitor 302, and displays 313 to the visitor 302. Different visitors can see different virtual display contents of the same exhibit, which increases the immersion of the visitors.

[0032] Specifically, see Figure 4 , Figure 4 An example diagram of determining whether an AR display device is viewing an AR calibration device provided in an embodiment of the present application. The direction in which the AR display device 401 is looking directly is 402. The signal 404 emitted by the AR calibration device 403 of exhibit A is captured by the AR display device 401, and the angle 405 between the signal 404 and the viewing direction 402 is judged to be less than the set angle, so it is judged that the exhibit corresponding to the AR calibration device 403 is being viewed. In contrast, after the signal 407 emitted by the AR calibration device 406 of exhibit B is captured by the AR display device 401, it is judged that the angle 408 between the signal 407 and the viewing direction 402 is greater than the set angle, so the AR display device 401 will not generate the exhibit virtual content corresponding to the AR calibration device 406.

[0033] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A device for upgrading the interactivity and intelligence of a venue based on augmented reality technology, characterized in that: By arranging the augmented reality display device and the augmented reality calibration device in a specific combination in the venue, venue visitors can observe the exhibited items through the augmented reality display device and simultaneously see the virtual content corresponding to the exhibited items.

2. The method according to claim 1, characterized in that A technical process for browsing exhibit information based on augmented reality technology is provided. The technical process provides in detail the internal structure of an augmented reality display device and the process of an augmented reality calibration device interacting with the augmented reality display device through signals.

3. The process of claim 2, wherein: Each exhibit is equipped with one or a group of augmented reality calibration devices, which send signals to the outside. The signal carries a unique identification code (ID) of the augmented reality calibration device. When the augmented reality display device is viewing an exhibit, if the emission direction of the received signal is less than a certain angle, the augmented reality display device determines that the exhibit is being viewed. At this time, the augmented reality display device runs the augmented reality processing module according to the identification code (ID) of the augmented reality calibration device carried in the signal to generate augmented reality virtual content (including text, pictures, videos, and audio). The generated virtual content is superimposed on the real world seen by the augmented reality display device, forming rich display content.

4. The process of claim 3, further characterized by: Different exhibits have different corresponding augmented reality calibration devices, and the identification codes (IDs) contained in the transmitted signals are also different. Therefore, when the augmented reality display device looks at different exhibits, the augmented reality virtual content it sees is different.

5. The process of claim 3, further characterized by: The augmented reality display device includes configurable features. Visitors can adjust the augmented reality display device to generate augmented reality virtual content by operating the setting module of the augmented reality display device. Therefore, each visitor can see different and interactive content when viewing the same exhibit.

6. The process of claim 3, further characterized by: A method for expanding the computing power of an augmented reality display device to generate augmented reality virtual content. The augmented reality processing module in the augmented reality display device can interact with the augmented reality processing server in the venue and send the ID of the augmented reality calibration device and the setting parameters of the augmented reality control module to the server. After the processing is completed, the server sends the augmented reality virtual content back to the augmented reality display device. At this time, the augmented reality display device can display virtual content with a larger amount of calculation.

Images