An augmented reality display device and system therefor

Abstract

The application relates to the technical field of display devices, in particular to an augmented reality display device which comprises a display, a placing table, a cantilever, a controller, an angle detection device and a base, the placing table is fixedly installed on the base, one end of the cantilever is rotationally connected with the base, the other end of the cantilever is connected with the display, the display is a display host with a camera at the back, the camera on the display host is arranged towards the tabletop of the placing table, the angle detection device is arranged at the rotationally connected position of the cantilever and the base, the controller is installed on the base, a signal output end of the angle detection device is connected with an input end of the controller, and an output end of the controller is connected with a signal input end of the display host, and the application improves the display effect and the interactive function of the product.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and particularly relates to an augmented reality display device and a system thereof. BACKGROUND

[0002] With the development of AR / VR technology, such technology is more and more widely used in various aspects such as display marketing training. As an important aspect, exhibition display often encounters the demand for marketing display of specific goods by using augmented display technology. Such a solution generally requires good interactivity, easy management of the device, and convenience of users to view the relevant information of the goods.

[0003] Currently, there is also a method of using a real-time picture of a mobile phone to track a product for augmented reality display. However, such a method has many problems, such as great development difficulty, the need to increase obvious markers on the product, and easy loss of tracking. SUMMARY

[0004] In view of the deficiencies in the prior art, the purpose of the present application is to provide an augmented reality display device and a system thereof.

[0005] To achieve the above purpose, the present application provides the following technical scheme: an augmented reality display device, comprising a display, a placement table, a cantilever, a controller, an angle detection device, and a base, the placement table is fixedly installed on the base, one end of the cantilever is rotationally connected with the base, and the other end of the cantilever is connected with the display, the display is a display host with a camera at the back, the camera on the display host is arranged to face the tabletop of the placement table, the angle detection device is arranged at the rotational connection between the cantilever and the base, the controller is installed on the base, a signal output end of the angle detection device is connected with an input end of the controller, and an output end of the controller is connected with a signal input end of the display host.

[0006] Preferably, the angle detection device is a Hall angle sensor, and a detection end of the Hall angle sensor is arranged in cooperation with the rotational connection between the cantilever and the base.

[0007] Preferably, a rotating conductive ring is arranged on the base at the rotational connection between the cantilever and the base, and a signal output end of the angle detection device is connected with an output end of the controller through the rotating conductive ring.

[0008] Preferably, the cantilever is an L-shaped cantilever, the display is installed on a vertical end of the cantilever, and a horizontal end of the cantilever is rotationally connected with the base.

[0009] Preferably, the controller is a single-chip microcomputer control box.

[0010] To achieve the above object, the present application also provides the following technical scheme: a display system of an augmented reality display device, comprising a display host, a display module and an angle calibration module, the display host stores three-dimensional model data of a display commodity, the display module calls the three-dimensional model data for three-dimensional image display, the angle calibration module receives angle data of a Hall angle sensor and matches a corresponding horizontal angle in the three-dimensional model data, a camera of the display host captures a display commodity placed on a placement table and displays a captured image in real time on a display screen of the display host, and the angle calibration module performs three-dimensional contour calibration on the three-dimensional model data and the real-time display image, so that the three-dimensional contour and the real display commodity in the camera are aligned and consistent;

[0011] The working mode of the display system is as follows:

[0012] (1) Place the display product on the placement table;

[0013] (2) Start the device power supply and wait for the system in the display host to start;

[0014] (3) Turn on the camera on the display host and display the image in real time;

[0015] (4) Identify the real-time image through the display module and call the corresponding three-dimensional model for display;

[0016] (5) Receive the angle information of the cantilever through the angle calibration module and match the angle relationship between the three-dimensional model and the real-time image;

[0017] (6) Adjust the consistency of the three-dimensional image and the real-time image for alignment, so that the three-dimensional image and the real-time image are displayed consistently;

[0018] (7) When the cantilever is rotated, the angle calibration module receives angle update data and calculates the position and angle information of the display commodity;

[0019] (8) Adjust the information of the three-dimensional image according to the position and angle information and superimpose it on the real-time captured display commodity image;

[0020] (9) When the user does not rotate the cantilever, the three-dimensional image is static, and when the cantilever is rotated, steps (7) and (8) are performed.

[0021] Compared with the prior art, the present application has the following advantages: the Hall sensor transmits back angle data, the three-dimensional presentation is calculated according to the angle data, and the three-dimensional content is superimposed on the camera image, thereby realizing the display of augmented reality;

[0022] The present application has the advantages of small calculation amount, long continuous running time, good interactivity, etc., and can provide users with novel interactive experience effect, thereby achieving the purpose of display. BRIEF DESCRIPTION OF DRAWINGS

[0023] Fig. 1 It is the front view of the present application;

[0024] Fig. 2 It is the side view of the present application;

[0025] Fig. 3 It is the system working principle flow chart of the present application.

[0026] In the figure: 1, display host; 2, cantilever; 3, placing table; 4, Hall angle sensor, 5, single-chip microcomputer control box; 6, rotating conductive ring; 7, base. DETAILED DESCRIPTION

[0027] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0028] Please refer to Figs. 1-2 The present application provides a technical solution: an augmented reality display device, comprising a display, a placing table 3, a cantilever 2, a controller, an angle detection device, a base 7, the placing table 3 is fixedly installed on the base 7, one end of the cantilever 2 is rotationally connected with the base 7, the other end of the cantilever 2 is connected with the display, the display is a display host 1 with a camera at the back, the camera on the display host 1 is arranged towards the tabletop of the placing table 3, the angle detection device is arranged at the rotational connection between the cantilever 2 and the base 7, the controller is installed on the base 7, the signal output end of the angle detection device is connected with the input end of the controller, and the output end of the controller is connected with the signal input end of the display host 1.

[0029] The display body is a display with touch screen function, the display software with three-dimensional space calculation function is installed in the display host 1, the angle data is transmitted back by the Hall sensor 4, the three-dimensional presentation is calculated according to the angle data in the three-dimensional space by using the software, the three-dimensional content is superimposed on the camera picture, so that the augmented reality display is realized.

[0030] The angle detection device is a Hall angle sensor 4, and the detection end of the Hall angle sensor 4 is arranged in cooperation with the rotational connection between the cantilever 2 and the base 7.

[0031] The rotating conductive ring 6 is arranged at the rotational connection between the cantilever 2 and the base 7 on the base 7, and the signal output end of the angle detection device is connected with the output end of the controller through the rotating conductive ring 6.

[0032] The cantilever 2 is an L-shaped cantilever 2, and the display is mounted on the vertical end of the cantilever 2, and the horizontal end of the cantilever 2 is rotationally connected with the base 7.

[0033] The controller is a single-chip microcomputer control box 5.

[0034] According to the technical scheme, after the start-up operation display program, the actual display goods are placed on the table top, and the user can arbitrarily dial the cantilever 2 or the display, so that the display rotates around the central axis of the base 7, and the rotation angle can be measured by the Hall angle sensor 4, the analog signal is converted into a digital signal by the single-chip microcomputer control box 5, and the signal line hidden in the cantilever is transmitted to the touch screen host, the touch screen host calculates the correct angle image in the software three-dimensional space according to the received angle signal, and the correct angle image is superimposed on the table top picture captured by the camera, so that the three-dimensional content and the real goods are synchronized, and the three-dimensional digital content can also be rotated synchronously with the rotation of the cantilever 2, the superposition effect of augmented reality is realized, and the user can also select some interaction through the touch screen to view the content of interest, and the content is also correctly superimposed through the above mechanism.

[0035] As shown in Fig. 3 A display system of an augmented reality display device, including a display host, a display module and an angle calibration module, the display host stores three-dimensional model data of display goods, the display module calls the three-dimensional model data to display three-dimensional images, the angle calibration module receives angle data of a Hall angle sensor and matches corresponding horizontal angles in the three-dimensional model data, a camera of the display host captures display goods placed on a placement table and displays the captured image on a display screen of the display host in real time, and the angle calibration module calibrates three-dimensional contours of the three-dimensional model data and the real-time display image, so that the three-dimensional contours and the real display goods in the camera are aligned and consistent.

[0036] The working mode of the display system is as follows:

[0037] (1) Place display goods on the placement table;

[0038] (2) Start the power supply of the device and wait for the system in the display host to start;

[0039] (3) Start the camera on the display host and display the image in real time;

[0040] (4) Identify the real-time image by the display module and call the corresponding three-dimensional model for display;

[0041] (5) Receive angle information of the cantilever by the angle calibration module and match the angle relationship between the three-dimensional model and the real-time image;

[0042] (6) Adjust the consistency alignment of the three-dimensional image and the real-time image, so that the three-dimensional image and the real-time image are consistent and displayed;

[0043] (7) When the cantilever is rotated, the angle calibration module receives angle update data, calculates the position and angle information of the displayed goods, and displays the goods in the three-dimensional image and the real-time image.

[0044] (8) According to the position and angle information, the information of the three-dimensional image is adjusted and superimposed on the real-time image of the displayed goods.

[0045] (9) When the user does not rotate the cantilever, the three-dimensional image is static, and when the cantilever is rotated, steps (7) and (8) are executed.

[0046] According to the technical scheme, the software system can be divided into two parts, a single-chip microcomputer program and a three-dimensional display program. The main function of the single-chip microcomputer is to convert the analog signal sent by the Hall angle sensor into a digital signal and transmit it to the three-dimensional display program of the touch screen host. After receiving the angle data, the three-dimensional display program can calculate the position of the displayed goods according to the numerical value, so as to realize correct augmented reality superposition display.

[0047] The content of the three-dimensional display program needs to be customized according to the needs of the specific goods display, or a fixed software framework can be used to develop different interactive content packages for each good. The specific implementation can be determined according to the specific business needs.

[0048] First, the displayed goods can be placed in the middle of the table, and then the power of the device is turned on. The host single-chip microcomputer control box and other devices on the cantilever can be powered by rotating the conductive ring.

[0049] Then open the corresponding augmented reality display program, if the displayed goods are newly placed or adjusted, the calibration module in the program needs to be started, which can correct the position and angle of the goods except the height. Under the calibration module, the outline of the goods in the three-dimensional space can be displayed, and the user can adjust the parameters in a visual way until the three-dimensional outline and the real goods in the camera are aligned, at which time the verification is completed. The calibration here can also be realized by automatic calibration through sensors and the like.

[0050] After calibration, the virtual three-dimensional space in the program is consistent with the real camera picture.

[0051] After the user rotates the cantilever, the rotation angle can be accurately measured by the Hall angle sensor and transmitted to the three-dimensional display program. Since the rotation of the cantilever causes the host and the camera to rotate, the picture taken by the camera will naturally change. The three-dimensional display program accurately obtains the rotation angle, and in the virtual three-dimensional space, only the presentation of the three-dimensional content needs to be recalculated according to the rotation angle to synchronize the three-dimensional display with the change of the picture taken by the camera, ensure the correct superimposition effect, and realize the display of augmented reality. Since the three-dimensional picture is consistent with the real camera picture through the calibration, and the change is synchronized here, the display effect of augmented reality is always correct.

[0052] The present application realizes tracking registration by bypassing the need to constantly calculate the spatial position of the tracked object by image detection and the like in the traditional scheme. The present application places the commodity at the center of the table top, and at the same time, constrains the camera and the host on the cantilever. In this way, the relationship between the position of the commodity and the position of the camera is simplified, so that the relative position can be quickly updated by the value of the angle sensor, and correct display is realized.

[0053] Although embodiments of the present application have been shown and described, it is to be understood that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the present application. The scope of the present application is defined by the appended claims and their equivalents.

Claims

1. An augmented reality display device, characterized by: The application relates to a display device for displaying a product, which comprises a display, a placing table, a cantilever, a controller, an angle detecting device and a base, the placing table is fixedly installed on the base, one end of the cantilever is rotationally connected with the base, the other end of the cantilever is connected with the display, the display is a display host with a camera at the back, the camera on the display host is arranged towards the table top of the placing table, the angle detecting device is arranged at the rotationally connected position of the cantilever and the base, the controller is installed on the base, a signal output end of the angle detecting device is connected with an input end of the controller, and an output end of the controller is connected with a signal input end of the display host. The display system of the application comprises a display host, a display module and an angle calibration module, the display host stores three-dimensional model data of a display product, the display module calls the three-dimensional model data to display a three-dimensional image, the angle calibration module receives angle data of a Hall angle sensor and matches a corresponding horizontal angle in the three-dimensional model data, a camera of the display host captures a display product placed on the placing table and displays a captured image on a display screen of the display host in real time, and the angle calibration module calibrates the three-dimensional contour of the three-dimensional model data and the real-time display image, so that the three-dimensional contour and the real display product in the camera are aligned. The working mode of the display system is as follows: (1) placing a display product on the placing table; (2) starting the power supply of the device and waiting for the system in the display host to start; (3) starting the camera on the display host and displaying an image in real time; (4) identifying the real-time image through the display module and calling a corresponding three-dimensional model for display; (5) receiving angle information of the cantilever through the angle calibration module and matching the angle relationship between the three-dimensional model and the real-time image; (6) adjusting the three-dimensional image and the real-time image to be consistent and aligned, so that the three-dimensional image and the real-time image are displayed consistently; (7) when the cantilever is rotated, the angle calibration module receives updated angle data and calculates the position and angle information of the display product; (8) adjusting the information of the three-dimensional image according to the position and angle information and superimposing the information on the image of the display product captured in real time; (9) when the cantilever is not rotated, the three-dimensional image is static, and when the cantilever is rotated, steps (7) and (8) are executed.

2. The augmented reality display device of claim 1, wherein: The angle detecting device is a Hall angle sensor, and the detecting end of the Hall angle sensor is arranged in cooperation with the rotationally connected position between the cantilever and the base.

3. The augmented reality display device of claim 1 or 2, wherein: A rotating conductive ring is arranged at the rotationally connected position of the cantilever and the base on the base, and the signal output end of the angle detecting device is connected with the output end of the controller through the rotating conductive ring.

4. The augmented reality display device of claim 1, wherein: The cantilever is an L-shaped cantilever, the display is installed on the vertical end of the cantilever, and the horizontal end of the cantilever is rotationally connected with the base.

5. The augmented reality display device of claim 1, wherein: The controller is a single-chip microcomputer control box.

Images