Multi-sensory fusion interactive display device and interactive method

Abstract

The invention relates to a multi-sensory fusion interactive display device which comprises an exhibition stand and a control terminal, an exhibit is arranged on the exhibition stand, a display screen and a loudspeaker are arranged beside the exhibition stand, the control terminal controls work of the display screen and the loudspeaker, the multi-sensory fusion interactive display device further comprises an eyeball capturing system, labels are arranged at bright spots of the exhibit, and the eyeball capturing system is connected with the display screen and the loudspeaker. The eyeball capturing system comprises a display screen and a loudspeaker, labels are arranged on the display screen, text introductions are pasted on the labels, videos corresponding to the labels are stored in the control terminal, the eyeball capturing system can judge which label the human eyes face to according to the orientation of eyeballs, and then the control terminal displays the stored videos through the display screen and the loudspeaker. According to the mode, the bright spots of the exhibit are visually displayed through the labels, a client can notice the bright spots at the first time, meanwhile, the labels also position the eyeball capturing system, and the eyeball capturing system can clearly know which point the client is on.

Description

Technical Field

[0001] This invention relates to a multi-sensory integrated interactive display device and interactive method. Background Technology

[0002] Current product displays typically involve placing the product on a stand with brochures alongside it. This method makes it difficult for target customers to notice the product's highlights, let alone engage them with the brochures.

[0003] Some larger exhibitors will play videos introducing their products on a loop at their booths. However, this method is just a loop and doesn't know what customers really care about. If the video doesn't show what customers care about, they may miss it. Summary of the Invention

[0004] The purpose of this invention is to provide a multi-sensory integrated interactive display device that can intuitively display the customer's attention points.

[0005] Another objective of this invention is to provide a multi-sensory integrated interactive method that allows customers to intuitively obtain the product display points they want.

[0006] This invention provides the following technical solution: a multi-sensory integrated interactive display device, including a display stand and a control terminal. Exhibits are placed on the display stand, and a display screen and a speaker are located beside it. The control terminal controls the operation of the display screen and speaker. It also includes an eye-tracking system. Each highlight of the exhibit is labeled with a text description. The control terminal stores a video corresponding to each label. The eye-tracking system can determine which label a person's eye is looking at based on the direction of their gaze, and then the control terminal displays the stored video through the display screen and the speaker. This method visually displays the highlights of the exhibit using labels, allowing customers to notice them immediately. These labels also provide a location for the eye-tracking system, enabling it to clearly identify which aspect the customer is interested in. The final effect is that when a customer's eye looks at a label, the display screen and speaker play a detailed introduction video corresponding to that label, allowing customers to intuitively understand the aspects of the exhibit they are most interested in. Furthermore, this display method itself is a novel and engaging interactive way to attract crowds.

[0007] As a preferred embodiment of the above technical solution, the eye-tracking system includes a camera and an infrared lamp. This is a typical configuration of an eye-tracking system, and its technology is mature and widely used in consumer-grade mobile phones.

[0008] As a preferred embodiment of the above technical solution, the label includes an arrow section and a content section. The arrow section points to a highlight on the exhibit, and the content section contains a brief description of the highlight. This design allows the content to be directed to other locations when several highlights on an exhibit are in close proximity, thus avoiding detection by an eye-tracking system.

[0009] As a preferred embodiment of the above technical solution, the exhibition stand is equipped with a platform, and the eye-tracking system captures the eyes of customers located at the platform. When there are multiple customers, only the customers at the platform are detected, avoiding system confusion.

[0010] As a preferred embodiment of the above technical solution, the display screen and speaker are positioned directly in front of the platform.

[0011] As a preferred embodiment of the above technical solution, a gravity sensing device is installed on the platform, and the eye-tracking system operates when the gravity sensing device detects a signal.

[0012] An interactive method for a multi-sensory integrated interactive display device includes the following steps: 1) When a customer stands on the platform, the gravity sensor detects a signal and sends this signal to the control terminal, which then activates the eye-tracking system. 2) The eye-tracking system determines which label on the exhibit the user is looking at and sends this information to the control terminal; 3) The control terminal finds the corresponding video based on the content of the label that the customer is looking at, and sends it to the display screen and the speaker for display.

[0013] As a preferred embodiment of the above technical solution, in step 3), if the customer looks at another label during video playback, the control terminal switches to playing the corresponding video; if the customer looks at the video or the original label during video playback, the original video continues to play; if the signal of the gravity sensor disappears during video playback, the display, speaker, and eye-tracking system are turned off.

[0014] Compared with the prior art, the beneficial effects of the present invention are: This method visually highlights the exhibits with labels, allowing customers to notice them immediately. These labels also provide a location for the eye-tracking system, enabling it to pinpoint which aspect the customer is most interested in. The ultimate effect is that when a customer's eye looks at a label, the display screen and speakers play a detailed video explaining that label, allowing customers to intuitively understand their most relevant points about the exhibit. Furthermore, this display method itself is a novel and engaging way to attract foot traffic. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the present invention. Detailed Implementation

[0016] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0017] like Figure 1 As shown, the present invention provides a technical solution: a multi-sensory integrated interactive display device, including a display stand 1 and a control terminal 2. The display stand 1 is provided with exhibits 3, and a display screen 11 and a speaker 12 are provided on one side of the display stand 1. The control terminal 2 controls the operation of the display screen 11 and the speaker 12.

[0018] It also includes an eye-tracking system 4. Each highlight of the exhibit 3 is marked with a label 5, which contains text descriptions. Each label 5 includes an arrow section 51 and a content section 52. The arrow section 51 points to the highlight on the exhibit 3, and the content section 52 provides a brief description of the highlight. This design allows the content to be directed to other locations when several highlights on an exhibit are in close proximity, thus avoiding the need for the eye-tracking system to detect them.

[0019] The control terminal 2 stores a video corresponding to each of the labels 5. The eye-tracking system 4 can determine which label 5 the human eye is facing based on the direction of the eyeball. Then, the control terminal displays the stored video through the display screen 31 and the speaker 32.

[0020] The eye-tracking system 4 includes a camera and infrared lights. This is a typical configuration of an eye-tracking system, and the technology is mature and widely used in consumer mobile phones.

[0021] The booth 1 has a platform 6, and the display screen 111 and speaker 12 are located directly in front of the platform 6. A gravity sensor 61 is installed on the platform 6. When the gravity sensor 61 detects a signal, the eye-tracking system 4 activates. The eye-tracking system 4 captures the eyes of customers located on the platform 6. When there are multiple customers, only those on the platform are detected to avoid system confusion.

[0022] This method visually highlights the exhibits with labels, allowing customers to notice them immediately. These labels also provide a location for the eye-tracking system, enabling it to pinpoint which aspect the customer is most interested in. The ultimate effect is that when a customer's eye looks at a label, the display screen and speakers play a detailed video explaining that label, allowing customers to intuitively understand their most relevant points about the exhibit. Furthermore, this display method itself is a novel and engaging way to attract foot traffic.

[0023] An interactive method for a multi-sensory integrated interactive display device includes the following steps: 1) When a customer stands on the platform, the gravity sensor detects the signal and sends it to the control terminal. The control terminal then activates the eye-tracking system and simultaneously controls the display screen and speakers to play a welcome video, thus reminding the customer that they have entered the exhibition area.

[0024] 2) The eye-tracking system determines which label on the exhibit the user is looking at and sends that information to the control terminal.

[0025] 3) The control terminal locates the corresponding video based on the content of the label the customer is looking at and sends it to the display screen and the speaker for display. If the customer looks at another label during video playback, the control terminal switches to the corresponding video. If the customer looks at the video or the original label during video playback, the original video continues playing. If the signal from the gravity sensor disappears during video playback, the display, speaker, and eye-tracking system are turned off.

[0026] It should be noted that exhibits vary in reality, and the accompanying drawings in the patent are for illustrative purposes only.

Claims

1. A multi-sensory integrated interactive display device, comprising an exhibition stand and a control terminal, wherein exhibits are arranged on the exhibition stand, a display screen and a speaker are arranged beside the exhibition stand, and the control terminal controls the operation of the display screen and the speaker, characterized in that, It also includes an eye-tracking system. Each highlight of the exhibit is marked with a label with a text description. The control terminal stores a video corresponding to each label. The eye-tracking system can determine which label the viewer's eyes are facing based on the direction of their eyes. Then, the control terminal displays the stored video through the display screen and the speaker.

2. The multi-sensory fusion interactive display device according to claim 1, characterized in that: The eye-tracking system includes a camera and infrared lights.

3. The multi-sensory fusion interactive display device according to claim 1, characterized in that: The label includes an arrow section and a content section. The arrow section points to a highlight on the exhibit, and the content section contains a brief description of the highlight.

4. The multi-sensory fusion interactive display device according to claim 1, characterized in that: The exhibition stand is equipped with a platform, and the eye-tracking system captures the eyes of customers located at the platform.

5. The multi-sensory fusion interactive display device according to claim 4, characterized in that: The display screen and speaker are located directly in front of the platform.

6. The multi-sensory fusion interactive display device according to claim 5, characterized in that: The platform is equipped with a gravity sensor. When the gravity sensor detects a signal, the eye-tracking system will activate.

7. The interactive method of a multi-sensory integrated interactive display device as described in claim 6, characterized in that, Includes the following steps: 1) When a customer stands on the platform, the gravity sensor detects a signal and sends this signal to the control terminal, which then activates the eye-tracking system. 2) The eye-tracking system determines which label on the exhibit the user is looking at and sends this information to the control terminal; 3) The control terminal finds the corresponding video based on the content of the label that the customer is looking at, and sends it to the display screen and the speaker for display.

8. The interactive method of a multi-sensory fusion interactive display device according to claim 7, characterized in that, In step 3), if the customer looks at another label during video playback, the control terminal switches to the corresponding video playback. If the customer looks at the video or the original label during video playback, the original video playback continues. If the signal from the gravity sensor disappears during video playback, the display, speaker, and eye-tracking system are turned off.

9. The interactive method of a multi-sensory integrated interactive display device according to claim 7, characterized in that, In step 1), when the gravity sensor detects a signal, the control terminal controls the display screen and speaker to play a welcome video.

Images