System with integration of flat display and floating image display and operating method thereof

Abstract

To provide a system with integration of a flat display and a floating image display, and an operating method thereof.SOLUTION: A system with integration of a flat display and a floating image display includes a flat display module and a floating image display module. In an initialization program, a signal channel is established between the flat display module and the floating image display module, a flat image is displayed by the flat display module, a floating image display signal is generated according to a control command, and a floating image is displayed on the floating image display by the floating image display module. Then, the floating image display module receives user's operation on the floating image and calculates an interaction command, so that the floating image display module updates and displays the floating image according to the interaction command and correspondingly causes the flat display module to display another flat image.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an interaction technology between a planar image and a stereoscopic image, and more particularly to a system that integrates a planar display and an airborne floating image display and provides a function for a user to interact using the airborne floating image, and an operation method thereof.

Background Art

[0002] Currently, as a common method, a user operates a smartphone, a tablet, or a kiosk terminal to interact with the displayed content to achieve the purpose of the operation. In such a method, mainly, the user operates the image content displayed on the planar display by gestures, and the operating system executed in the device detects the gestures, determines the operation commands, and responds to the operation commands with corresponding images. In this way, the purpose of the interactive operation is achieved.

Summary of the Invention

Problems to be Solved by the Invention

[0003] Taking the browsing of a specific image object as an example, the planar display provides a planar image for the user to view. Further, in order to view the image object from a 360-degree angle, it is necessary to provide the display device with an image object having three-dimensional information. Although the user can view the image object from various angles using a controller or gestures, there is no change in the fact that the image object is displayed by rotation or zoom on the planar display. Therefore, there is still room for improvement in the user experience.

Means for Solving the Problems

[0004] To improve the user experience regarding the viewing of stereoscopic image objects and the execution of interactions, this specification discloses a system integrating a flat display and a floating image display and its operating method, enabling a user to interact with the content displayed on the flat display and the floating image display. For example, by using gestures to manipulate the floating image displayed on the floating image display, the content displayed on the flat display is controlled.

[0005] According to an embodiment, a system integrating a flat display and a floating image display mainly includes a flat display module and a floating image display module. Here, in the operating method of the system integrating a flat display and a floating image display, after the system is started, in the initialization program, a signal channel between the flat display module and the floating image display module is established through the communication interface. Then, according to the flat display signal, a flat image is displayed by the display panel of the flat display module. Subsequently, according to the control command, a display signal for the floating image is generated, and the floating image is displayed by the floating image display of the floating image display module.

[0006] Next, the control circuit of the floating image display module receives the user's operation on the floating image and calculates an interaction command. Thus, the control circuit of the floating image display module updates and displays the floating image according to the interaction command. Subsequently, the flat display module receives the interaction command through the signal channel and, accordingly, displays another flat image by the display panel.

[0007] Here, the flat display module and the floating image display module are integrated into one device or two independent devices connected to each other by signals.

[0008] Furthermore, the airborne image display module is connected to an airborne image database via a data transmission circuit, and the airborne image database provides airborne image data for the airborne image display module to display airborne images.

[0009] Furthermore, the system is provided with a gesture sensor connected to the airborne image display module. While the airborne image display module displays an airborne image, the gesture sensor is driven to operate and detect a user's gesture for operating the airborne image.

[0010] Furthermore, when the interaction command is generated according to the gesture, the airborne image display module acquires airborne image data from the airborne image database according to the interaction command, and updates and displays the airborne image.

[0011] Also, when updating and displaying the airborne image, a signal is transmitted to the flat panel display module via a signal channel so as to display a corresponding another flat image on the flat panel display module.

[0012] Furthermore, the control command may be a command for converting and displaying from a flat image to an airborne image. According to the command, the airborne image display module may load airborne image data of an object corresponding to the flat image and display an airborne image corresponding to the flat image.

[0013] To further understand the features and technical content of the present invention, please refer to the following detailed description and drawings of the present invention. However, these descriptions and drawings are for the purpose of merely explaining the present invention and do not limit the protection scope of the present invention in any form.

Brief Description of the Drawings

[0014]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5A

Figure 5B

Figure 5C

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0015] The embodiments of the present invention will be described below with specific examples. A person skilled in the art can understand the advantages and effects of the present invention from the disclosed content. The present invention can be implemented or applied through other different specific embodiments, and various detailed descriptions in this specification can also be modified and changed in various ways without departing from the idea of the present invention based on different perspectives and applications. Also, it should be explained in advance that the drawings of the present invention are only schematically shown and not drawn based on actual dimensions. The following embodiments are used to explain the technical content related to the present invention in more detail, but the disclosed content is not intended to limit the protection scope of the present invention.

[0016] In the specification, terms such as "first", "second", "third", etc. may be used to describe various elements, but it should be understood that these elements should not be limited by these terms. These terms are mainly used to distinguish one element from another element or one feature from another feature. Also, the term "or" in this specification should be understood to include any one or a combination of multiple of the related listed items according to the actual situation.

[0017] The present disclosure provides a system integrating a flat display and an airborne floating image display and an operating method thereof. As its technical concept, a flat display for displaying image information and an airborne floating image display for displaying an airborne floating image are provided in one system, and by browsing and operating the airborne floating image by the user, it is possible to interact with the content displayed on the flat display. The airborne floating image may be a three-dimensional image extended from the content displayed on the flat display, or a virtual control interface used for operating and controlling the content displayed on the flat display.

[0018] FIG. 1 is a schematic diagram showing an external appearance embodiment of an apparatus integrating a flat panel display and an airborne floating image display. Here, an interactive image display device 10 is shown. The interactive image display device 10 is provided with a flat panel display module 101. The flat panel display is not limited to any display technology. For example, it may be a flat panel display module 101 composed of a display panel, a backlight module, and related control circuits, but is not limited thereto. Its main function is to display various flat image information. The interactive image display device 10 is provided with an airborne floating image display module 103 including an airborne floating image display and related control circuits. In the figure, a control platform 100 is provided with a display interface capable of projecting an airborne floating image. Refer to the description of FIG. 2 for the display technology.

[0019] In the interactive image display device 10, the purpose of mutual cooperation between different display technologies is achieved by integrating the flat panel display module 101 and the airborne floating image display module 103 through mechanical design, circuit connection, and software cooperation.

[0020] According to the first embodiment, the flat panel display is arranged in the upper half of the structure of the interactive image display device 10 to display flat image information to the user, while the airborne floating image display is provided on the control platform 100 and is used for the user to interact with the airborne floating image displayed by gestures. Further, the interactive image display device 10 is also provided with a gesture sensor 105. The gesture sensor 105 may be provided inside the airborne floating image display module 103 to assist in detecting the user's gestures, or may be connected to the sensor of the airborne floating image display module 103 via a signal. The interactive image display device 10 is further provided with a control panel 107 for the user to control the operation of the device. For example, the control panel 107 is provided with operation interfaces such as buttons, joysticks, and touch interfaces.

[0021] For example, in one of the operation modes of the interactive image display device 10, when a user views the content displayed on the flat display, the device is operated using the control panel 107. Next, an aerial floating image corresponding to the function the user operates or the content the user views is displayed by the aerial floating image display provided on the control platform 100. The aerial floating image is preferably a three-dimensional image projected as a real image within a certain distance on the display interface. When the user performs a gesture operation and the gesture is detected by the gesture sensor 105, the aerial floating image changes according to the gesture.

[0022] Regarding the display technology of the above-described aerial floating image display, refer to the schematic diagram of the embodiment shown in FIG. 2.

[0023] In the figure, an embodiment in which the aerial floating image display module 103 displays a three-dimensional aerial floating image is shown. In this embodiment, the aerial floating image display 20 is shown. The aerial floating image display 20 mainly includes an optical module 201 and a display panel 202 having an image processor (not shown in this figure) capable of processing display content, and may further have a communication function (including the related communication module, not shown in this figure), and can acquire aerial floating image data from an external image source and display the aerial floating image 203 after image processing.

[0024] According to an embodiment, the optical module 201 of the airborne floating image display 20 is a lens array composed of a plurality of lens elements, and is coupled to face the display panel 202. The display panel 202 is a flat display panel that displays an integrated image composed of a plurality of unit images. Here, the integrated image is composed of a plurality of unit images, and the unit image is an image corresponding to one or a plurality of lens elements of the optical module 201. Each unit image can project the airborne floating image 203 in a method such as one-to-one (each unit image corresponds to one lens element), one-to-many (each unit image corresponds to a plurality of lens elements), and many-to-one (a plurality of unit images correspond to one lens element). Therefore, in order to generate a unit image or an integrated image, it is necessary to consider the characteristics of the components of the entire airborne floating image display 20 and the finally displayed airborne floating image 203. Each of the above unit images corresponds to each lens element of the optical module 201. In an embodiment, each lens element may be composed of one or a plurality of convex lenses and concave lenses. During operation, the plurality of unit images displayed on the display panel 202 are projected by the lens array in the optical module 201 to form a three-dimensional airborne floating image 203 above the airborne floating image display 20. As shown in the figure, a three-dimensional airborne floating image "3D" is schematically shown.

[0025] Furthermore, the airborne floating image display 20 is provided with a gesture sensor 205 (which can be a built-in or external sensor) for detecting the movement of the user's hand 22 with respect to the airborne floating image 203. The gesture sensor 205 may be realized by an image detection method. The main method is to acquire continuous images of some important parts of the hand 22 (for example, fingers, palm, joints) by a camera, and through image processing, mainly the three-dimensional coordinates of each important part in the gesture sensor coordinate system (for example, X represented in a rectangular coordinate system sensor 、Y sensor 、Z sensor or γ, θ, φ represented in a spherical coordinate system), and obtain the image changes before and after a certain time interval. After continuous acquisition, the change amount of the three-dimensional coordinates is obtained, and the three-dimensional coordinates (X device 、Ydevice , Z device ), and finally determines an interaction command for one or any combination of movement, rotation, and zoom operations.

[0026] In another embodiment, the gesture sensor 205 may detect gestures based on the principle of light interruption. As related technologies, first, detection light is irradiated from a light source. When the hand 22 enters the range of this light, the light sensor detects the light spot generated on the hand when the light is interrupted. Next, the amount of reflected light (reflection of the changing part) and the time difference (reflection of the depth) from each important part can be obtained. Similarly, based on the continuous acquisition of these light information, the amount of change in the three-dimensional coordinates due to the gesture is obtained, and an interaction command for one or any combination of movement, rotation, and zoom operations is determined.

[0027] In yet another embodiment, the gesture sensor 205 may include a sound wave generator and a sound wave receiver, and may determine gestures using information related to the reflection of sound waves. When the hand 22 is within the detection range of the gesture sensor 205, the sound wave is blocked, and similarly, a reflected wave is generated. Therefore, the sound wave receiver can detect, based on the change in the sound wave, that is, the amount of spatial change in some important parts of the hand 22, and convert it into the amount of change in the three-dimensional coordinates, thereby determining an interaction command for one or any combination of movement, rotation, and zoom operations.

[0028] In this way, the interaction detection method realized by the gesture sensor 205 using various gesture detection technologies determines an interaction command of one or any combination of movement, rotation, and zoom operations based on the changes in the three-dimensional coordinates of the fingers of the hand 22, the position of the palm of the hand, and the finger joints reflected by the gesture. After that, by referring to the floating image data in the air recorded in the image database (including the color information of the stereoscopic image and the three-dimensional space information), the next floating image data of the floating image 203 by various gesture operations is acquired, and the next stereoscopic image is displayed. The floating image data may include a stereoscopic video composed of a static stereoscopic image or a continuous image. When processing programs such as change detection, coordinate conversion, and stereoscopic image calculation are calculated at high speed, a real-time interaction effect can be realized by immediately reacting to the gesture.

[0029] FIG. 3 shows a schematic diagram of an embodiment of the circuit elements of a system that continues to integrate a flat panel display and a floating image display.

[0030] The system is mainly provided with a flat panel display module 101 and a floating image display module 103 that are connected to each other by signals. According to the embodiment, the flat panel display module 101 and the floating image display module 103 may be integrated into one device, or may be two independent devices connected to each other by signals.

[0031] The flat panel display module 101 is mainly provided with a control circuit 301. The control circuit 301 controls the operation of the flat panel display module 101 and is connected to other circuit elements by signals. The main circuit elements include, for example, a data transmission circuit 303. The flat panel display module 101 acquires image data from the image source 320 via the data transmission circuit 303, and after performing image processing including decoding, decompressing, and converting to image data in a specific format by the image processing processor 305, provides it to the display panel driving circuit 306 to drive the display panel 307 to display a flat image.

[0032] In a system integrating a flat panel display and an airborne floating image display, the flat panel display module 101 and the airborne floating image display module 103 can communicate with each other via a communication interface (e.g., a communication bus) 310, transmit signals to each other, and achieve the purpose of interaction. This embodiment shows that the input / output circuit 309 of the flat panel display module 101 is connected to the communication interface 310. The input / output circuit 309 transmits signals in a specific format, the signals are transmitted to the airborne floating image display module 103 via the communication interface 310, and correspondingly, receives signals generated by the airborne floating image display module 103 via the communication interface 310.

[0033] The airborne floating image display module 103 is provided with a control circuit 331 for controlling the operation of the airborne floating image display module 103. The control circuit 331 is connected by signals to circuit elements within the airborne floating image display module 103 including a data transmission circuit 332. The airborne floating image display module 103 is connected to an airborne floating image database 330 via the data transmission circuit 332. The airborne floating image database 330 provides airborne floating image data including color information and three-dimensional space information of various stereoscopic images for the airborne floating image display module 103 to display airborne floating images, and can provide the airborne floating image data at any time in response to the display request of the airborne floating image of the airborne floating image display module 103.

[0034] After the aerial floating image data is processed by the image processor 333 of the aerial floating image display module 103, the image data of the aerial floating image is generated and provided to the display driving circuit 334 to be converted into a display signal for driving the aerial floating image display 335 to display the aerial floating image. Finally, the aerial floating image display 335 displays the aerial floating image according to the display signal. When the aerial floating image display module 103 projects the aerial floating image onto its display panel, the operation of the gesture sensor 336 is also controlled together to detect the user's gesture for operating the aerial floating image and generate corresponding interaction commands. For example, according to the interaction commands, the aerial floating image data can be obtained from the aerial floating image database 330, the aerial floating image can be updated and displayed, or it can be converted into a signal of a specific format through the input / output circuit 337 and transmitted to the flat panel display module 101 through the signal channel established by the communication interface 310 to cause the flat panel display module 101 to display a corresponding another flat panel image.

[0035] According to the embodiment, when the gesture sensor 336 detects a gesture, the change amount of the three-dimensional coordinates of the user's operation on the aerial floating image based on the gesture can be determined. Thereby, the control circuit 331 determines interaction commands such as movement, rotation, and zoom based on the change amount of the three-dimensional coordinates, and calculates the image coordinate information of the new aerial floating image based on the interaction commands, so as to obtain the aerial floating image data for update, or use the already obtained aerial floating image data to update the currently displayed aerial floating image.

[0036] It should be mentioned here that the change amount of the three-dimensional coordinates corresponding to the gesture detected by the gesture sensor 336 is the coordinate information with the gesture sensor 336 as the reference coordinate system, and then it is provided to the control circuit 331 to perform coordinate conversion, and convert the coordinate information of the interaction commands in the coordinate system formed by the gesture sensor 336 into the coordinate system of the display space of the aerial floating image.

[0037] Here, since each position of the floating image displayed by the floating image display module 103 is known, the relevance in the same coordinate system after the coordinate transformation of the gesture can be obtained, and this relevance indicates the relationship between the three-dimensional coordinates formed by the gesture and the displayed floating image. For example, since the movement gesture moves the floating image in a certain direction, the amount of change in this direction is added to the three-dimensional coordinates of the floating image, and a new floating image is created at the new position. In the control circuit 331, new floating image data can be queried or calculated in real time and supplied to the display driving circuit 334 to form a display image. In the case of a rotation gesture, since the floating image is rotated in one direction, the amount of rotation change is added to the three-dimensional coordinates of the original floating image, that is, new floating image data is formed, and a new floating image is displayed. Similarly, in the case of a zoom gesture, when the size of the floating image changes at the same reference point, the relevant three-dimensional coordinates also change. The control circuit 331 queries the image database or executes real-time calculations to generate new floating image data and supplies it to the display driving circuit 334 to form a display signal.

[0038] The above-mentioned gestures such as movement, rotation, and zoom are arbitrarily combined to form an interaction command, and the image processing processor 333 operates to generate new floating image data. The floating image data is data for directly displaying the floating image on the floating image display 20.

[0039] In yet another embodiment of the system integrating a flat panel display and an airborne floating image display provided by the present disclosure, the airborne floating image display module 103 may be connected to the control system wirelessly (e.g., WiFi, Bluetooth, etc.) or wired (e.g., industry standard interfaces such as USB, RS232, etc.) via a specific communication interface. The implemented control interface is, for example, the control panel 107 shown in FIG. 1. In the control system, a computer system operates and executes a driver program that communicates with the flat panel display module 101 and the airborne floating image display module 103. As a result, interaction commands generated by gesture (or voice or other input methods) operations in the airborne floating image display module 103 are transmitted to the flat panel display module 101 and reflected by the flat panel display module 101. Similarly, the image signal of the image displayed by the flat panel display module 101 is transmitted to the airborne floating image display module 103 via the communication interface 310, and an airborne floating image is displayed in response to being sent back by the airborne floating image display module 103.

[0040] According to the embodiment, the communication interface 310 between the flat panel display module 101 and the airborne floating image display module 103 interprets and edits the information exchanged between the two. The control circuit 301 of the flat panel display module 101 and the control circuit 331 of the airborne floating image display module 103 may respond to messages generated by each other and display the corresponding flat image and airborne floating image, respectively.

[0041] According to the above embodiments, a system integrating a flat panel display and an airborne floating image display can achieve the effect of content conversion between a flat panel image and an airborne floating image. For example, when a user views the content displayed on the flat panel display, under specific conditions or after being triggered by the user, the airborne floating image display module 103 can be driven to display the corresponding airborne floating image. The airborne floating image may be a three-dimensional image of the content displayed on the flat panel display. By using gesture operations, the user can easily view the image of the object shown in the flat panel image from various angles. Next, when a gesture is detected by the gesture sensor, in addition to converting the airborne floating image into an airborne floating image that conforms to the gesture, the flat panel display module 101 can also be driven to display an image that reflects the gesture on the flat panel display. It should be noted here that the method of operating the airborne floating image is not limited to gestures, and may also be voice or other input methods.

[0042] The operation method of the system integrating the flat panel display and the airborne floating image display provided by the present disclosure can refer to the flowchart of the embodiment shown in FIG. 4.

[0043] According to the flowchart of the embodiment, after the system is started (step S401), in the initialization program, a signal channel between the flat panel display module and the airborne floating image display module in the system is established through the above-mentioned communication interface, that is, the signal channel is established by the above-mentioned communication interface (step S403).

[0044] In the planar display module, according to the planar display signal generated by the user's operation of the control panel or the planar display signal preset and generated from the control circuit of the planar display module, it is processed by the image processing processor, and the display panel is driven to display a planar image (step S405). In the floating image display module, according to the control command generated by the user's operation of the control panel or the control command generated from the control circuit of the floating image display module, a display signal of the floating image is generated via the control circuit. According to this display signal of the floating image, floating image data is loaded from the floating image database (step S407), processed by the image processing processor, and a floating image is generated and displayed by the floating image display (step S409).

[0045] According to an embodiment of the first operation mode of the system integrating the planar display and the floating image display, the control command may be a command to convert and display from a planar image to a floating image. Thereby, the floating image display module loads the floating image data of the object corresponding to this planar image from the floating image database. That is, the floating image data may be floating image data describing the color information and three-dimensional space information of the object. The floating image display module displays the floating image corresponding to the planar image.

[0046] Subsequently, the user can operate the floating image with gestures. The gesture sensor detects the operation gesture (step S411). The control circuit of the floating image display module receives the gesture of the user operating the floating image and calculates an interaction command (step S413). In this way, the floating image display module updates the floating image data according to this interaction command (step S415). The process returns to step S407, and according to the command to update the floating image, the updated floating image data is loaded from the floating image database, and the updated floating image is calculated.

[0047] On the one hand, the planar display module receives interaction commands via a signal channel, and correspondingly, the planar image is updated by the display panel, that is, another planar image is displayed (step S417). In this way, the purpose of the interaction between the planar image and the floating image in the air is achieved.

[0048] Refer to FIGS. 5A to 5C, which are schematic diagrams showing embodiments of the second operation mode of the system integrating the planar display and the floating image display in the air, and illustrate examples of performing interactions by the said system.

[0049] In FIG. 5A, an interaction-type image display device 50 is shown, in which a planar display module 501, a floating image display module 503 in the air, and a gesture sensor 505 are integrated, and a control panel 507 is provided on a control platform 500. In this example, the display panel of the planar display module 501 displays, for example, a planar image 511 of a person.

[0050] In FIG. 5B, the user can operate the device via the control panel 507 and request the display of a three-dimensional image of the person. At this time, the floating image display module 503 in the air can load floating image data corresponding to the person from a floating image database in the air, and display a floating image 513 corresponding to the person by a floating image display in the air.

[0051] Next, the user operates the floating image 513 in the air by gestures, and during the operation, the gesture is detected by the gesture sensor 505, and an interaction command is calculated. At this time, as shown in FIG. 5C, the planar display displays another corresponding planar image 515, and during the interaction process, the floating image display module 503 in the air can further calculate a new floating image. In this example, after the floating image in the air is updated, a result that there are two floating images 517 and 519 in the air is obtained.

[0052] The following is an example of the second operation mode. The system first displays content using virtual characters on a flat display. For example, it displays content such as storytelling or product descriptions using audio and video. When the user requests to display the content as a floating image in the air, the system displays a three-dimensionally calculated floating image character on the floating image display and can display the content with audio and dynamic stereoscopic images. At the same time, the user can also interact with the floating image character through gestures, voice, or other input methods. Accordingly, the system can display another flat character image on the flat display in response to the interaction command generated by the user's operation on the floating image. In this way, the user can view and interact in a more intuitive way, and people can become more interested and involved in the situation, for example, improving the learning experience of students in educational applications.

[0053] Refer to FIG. 6, which is a schematic diagram showing an example of executing an interaction, for the third operation mode of the system integrating the flat display and the floating image display.

[0054] In this example, the interaction type image display device 50 loads the floating image data of the floating control interface 603 from the floating image database according to the control command generated by user control, and a virtual floating control interface 603 to be displayed on the floating image display is generated. The virtual floating control interface 603 is, for example, a virtual button, a touch pad, or a joystick, enabling the user to operate the content displayed on the flat display through the floating image. In this example, a trajectory 601 generated by the user's operation is displayed on the flat display.

[0055] For example, a system integrating a flat panel display and an airborne floating image display can implement a gaming machine. The airborne floating image display module can implement control interfaces for various gaming machines, and users can operate the airborne floating control interface with gestures to play games. The trajectory 601 shown in the figure may be the movement route of a certain character in the game. Furthermore, the system can implement a gaming machine integrating a 2D image and a three-dimensional airborne floating image. Through the cooperation of software and hardware, when playing a game using a flat image, it is also possible to operate and control the airborne floating image with gestures, use the airborne floating image to operate a flat game, or display specific information as an airborne floating image.

[0056] FIG. 7 is a diagram showing a first embodiment of the application of a system integrating a flat panel display and an airborne floating image display.

[0057] In this example, it shows that a system integrating a flat panel display and an airborne floating image display is installed in the seat 70 of an airliner or a vehicle. The flat panel display 701 is embedded in the backrest, and the airborne floating image display 702 is embedded in the foldable tray 72.

[0058] In a certain usage scenario, in the initial state, a flat image is displayed on the flat panel display 701. When the user changes the tray 72 from the folded storage state to the usage state, the control switch in the hinge mechanism is triggered, the airborne floating image display module is activated, and the airborne floating image 703 is displayed. In the figure of this example, a virtual character with whom the user can interact is displayed.

[0059] FIG. 8 shows a system integrating a flat panel display and an airborne floating image display applied to a vending machine 80. The vending machine 80 displays information such as products for sale and prices by means of a flat panel display 801, and various products 803 are exhibited. The vending machine 80 is provided with a display platform 82 for installing an airborne floating image display 802.

[0060] In a certain usage scenario, the user can select a product to be purchased via the flat panel display 801 or other operation interfaces, and the control circuit of the vending machine 80 drives the airborne floating image display 802 to display an airborne floating image 805 of the product selected by the user. Thereby, the user can operate and view the three-dimensional image of the product via the airborne floating image 805.

[0061] According to each embodiment of the system integrating the flat panel display and the airborne floating image display described in the present disclosure, by integrating the flat panel display and the airborne floating image display, the purpose of interaction between the flat image and the three-dimensional image can be achieved, and the user experience in product browsing, audiovisual interaction, education, games, etc. can be effectively improved.

[0062] The content disclosed above is only a preferred embodiment of the present invention and does not limit the scope of the claims of the present invention. Therefore, all equivalent technical changes made using the specification and drawings of the present invention are included in the scope of the claims of the present invention.

Description of Reference Numerals

[0063] 10: Interactive Image Display Device 101: Flat Display Module 103: Airborne Floating Image Display Module 105: Gesture Sensor 107: Control Panel 100: Control Platform 20: Airborne Floating Image Display 201: Optical module 202: Display panel 203: Floating image in air 22: Hand 205: Gesture sensor 301: Control circuit 303: Data transmission circuit 320: Image source 305: Image processing processor 306: Display panel driving circuit 307: Display panel 309: Input / output circuit 310: Communication interface 331: Control circuit 332: Data transmission circuit 330: Floating image database in air 333: Image processing processor 334: Display driving circuit 335: Floating image display in air 336: Gesture sensor 337: Input / output circuit 50: Interactive image display device 501: Flat panel display module 503: Floating image display module in air 505: Gesture sensor 507: Control panel 511: Flat image 513: Floating image in air 515: Flat image 517, 519: Floating image in air 500: Control platform 601: Trajectory 603: Floating control interface in air 70: Seat 701: Flat display 72: Tray 702: Floating image display in air 703: Floating image in air 80: Vending machine 801: Flat display 803: Commodity 82: Presentation platform 802: Aerial floating image display 805: Aerial floating image S401~S417: Steps

Claims

1. A flat display module; a floating-in-the-air image display module connected to the flat display module via a communication interface; A system integrating a flat display and a floating image display comprising: The system, which integrates a flat display and a floating image display, comprises: After the system is started, in an initialization program, a signal channel is established between the flat display module and the floating-in-the-air image display module through the communication interface; Displaying a flat image on a display panel of the flat display module according to a flat display signal; According to the control command, a display signal of a floating-in-the-air image is generated, and the floating-in-the-air image display of the floating-in-the-air image display module displays the floating-in-the-air image; A control circuit of the floating-in-the-air image display module receives a user's operation on the floating-in-the-air image and calculates an interaction command; According to the interaction command, the control circuit of the floating-in-the-air image display module updates and displays the floating-in-the-air image; A system integrating a planar display and a floating-in-the-air image display, characterized in that the planar display module receives the interaction command via the signal channel and displays a corresponding different planar image on the display panel.

2. The planar display module and the floating-in-the-air image display module are integrated into one device, or are two independent devices respectively connected to each other by signals; A system integrating the flat display and the floating-in-the-air image display according to claim 1.

3. The floating-in-the-air image display module is connected to a floating-in-the-air image database through a data transmission circuit, and the floating-in-the-air image database provides floating-in-the-air image data for the floating-in-the-air image display module to display the floating-in-the-air image; A system integrating the flat display and the floating-in-the-air image display according to claim 1.

4. A gesture sensor is provided, which is connected to the floating-in-the-air image display module, and the floating-in-the-air image display module displays the floating-in-the-air image, and the gesture sensor is driven to operate and detect the user's gesture to operate the floating-in-the-air image; A system integrating the flat display and the floating-in-the-air image display according to claim 1.

5. When the interaction command is generated according to the gesture, the floating-in-the-air image display module obtains floating-in-the-air image data from a floating-in-the-air image database according to the interaction command, and updates and displays the floating-in-the-air image; A system integrating the flat display and the floating-in-the-air image display according to claim 4.

6. a signal is sent to the planar display module via the signal channel to cause the planar display module to display a corresponding different planar image when updating and displaying the floating-in-the-air image; A system integrating the flat display and the floating-in-the-air image display according to claim 5.

7. The floating-in-the-air image display module comprises a floating-in-the-air image display, the floating-in-the-air image display comprises an optical module and a display panel, the optical module is a lens array composed of a plurality of lens elements, and is coupled to face the display panel, the display panel displays an integrated image composed of a plurality of unit images, each unit image corresponds to one or more lens elements of the optical module, and the plurality of unit images displayed on the display panel are projected by the lens array to form a three-dimensional floating image above the floating-in-the-air image display; A system integrating a flat display according to any one of claims 1 to 6 and a floating-in-the-air image display.

8. Start and initialize the system integrating the flat display and the floating-in-the-air image display, and in the initialization program, a signal channel between the flat display module and the floating-in-the-air image display module is established; displaying a flat image on a display panel of the flat display module in accordance with a flat display signal; According to the control command, a display signal of a floating-in-the-air image is generated, and the floating-in-the-air image display module displays the floating-in-the-air image; A control circuit of the floating-in-the-air image display module receives a user's operation on the floating-in-the-air image and calculates an interaction command; The control circuit of the floating-in-the-air image display module updates and displays the floating-in-the-air image according to the interaction command; The planar display module receives the interaction command through the signal channel, and displays a corresponding different planar image on the display panel; Including, A method for operating a system integrating a flat display and a floating-in-the-air image display, comprising:

9. In the floating-in-the-air image display module, the control circuit loads floating-in-the-air image data from a floating-in-the-air image database, and the floating-in-the-air image is generated by processing the floating-in-the-air image through an image processing processor; A method for operating the system integrating the flat display and the floating-in-the-air image display according to claim 8.

10. the control command is a command for converting the planar image into the floating-in-the-air image and displaying it, and the floating-in-the-air image display module loads the floating-in-the-air image data of an object corresponding to the planar image, and displays the floating-in-the-air image corresponding to the planar image; A method for operating the integrated flat display and floating-in-the-air image display system according to claim 9.

11. The air-floating image data is air-floating image data describing color information and three-dimensional space information of the object. A method for operating the system incorporating the flat display and the floating-in-the-air image display of claim 10.

12. The control command requests the floating-in-the-air image display module to load the floating-in-the-air image data into a floating-in-the-air control interface, and the floating-in-the-air image display module displays the floating-in-the-air control interface, and allows the user to operate the floating-in-the-air control interface to control the display content of the planar display module. A method for operating the integrated flat display and floating-in-the-air image display system according to claim 9.

13. the user manipulates the floating-in-the-air image with a gesture, the gesture is detected by a gesture sensor, and the interaction command is calculated; A method for operating a system integrating a flat display and a floating-in-the-air image display according to any one of claims 8 to 12.

14. The interaction command is generated according to the gesture, and the floating-in-the-air image display module updates and displays the floating-in-the-air image according to the interaction command, and a signal is sent to the planar display module through the signal channel to cause the planar display module to display a corresponding different planar image when updating and displaying the floating-in-the-air image. A method for operating the integrated flat display and floating-in-the-air image display system according to claim 13.

Images