System integrating flat panel display and floating image display and operation method

By integrating a flat display and a floating image display system, using gesture operations to achieve interaction between flat and stereoscopic images, the problem of poor user experience in the prior art is solved, and the interactivity and immersion of browsing stereoscopic images is improved.

CN120179329APending Publication Date: 2025-06-20LIXEL INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411436929.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-12-18
Filing Date
2024-10-15
Publication Date
2025-06-20

AI Technical Summary

Technical Problem

The prior art still has room for improvement in user experience when browsing and interacting with stereoscopic image objects, especially when turning or zooming images on flat displays.

Method used

The system integrating a planar display and a floating image display means that the user operates the floating image through gestures through the signal channel between the planar display module and the floating image display module, and updates the floating image according to interactive instructions, while updating the image content of the planar display accordingly.

Benefits of technology

Improves the interactive experience of users when browsing stereoscopic image objects, providing a more intuitive and immersive way to view and manipulate image objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120179329A_ABST
    Figure CN120179329A_ABST
Patent Text Reader

Abstract

The invention discloses a system for integrating a flat panel display and a floating image display and an operation method. The system comprises a flat panel display module and a floating image display module. In the operation method, the system is started, a signal channel between the flat panel display module and the floating image display module is established in an initialization program, then a flat panel image is displayed by the flat panel display module according to a flat panel display signal, and a floating image display signal is generated according to a control instruction. Therefore, the floating image display of the floating image display module can display a floating image. Afterwards, the floating image display module receives the floating image operated by the user to calculate an interaction instruction, so that the floating image display module can update and display the floating image according to the interaction instruction, and the plane display module correspondingly displays another plane image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a technology for planar and three-dimensional image interaction, in particular to a system and operation method that integrates a planar display and a floating image display and enables a user to interact using the floating image. Background Art

[0002] Currently, when a user commonly operates a mobile phone, a tablet computer, or an information kiosk to interact with the displayed content for an operation purpose, this type of method mainly allows the user to gesture-operate the image content displayed on the planar display. The operating system running in the device senses the gesture and then determines the operation instruction, and then responds to this operation instruction with a corresponding image to achieve the purpose of interactive operation.

[0003] Taking browsing a specific image object as an example, the planar display provides a planar image for the user to browse. Further, if the user wants to view the image object from a 360-degree angle, the display device needs to provide an image object with three-dimensional information. The user can then view the image object from various angles through a controller or gestures, but still views the image object in a rotating or scaling manner on the planar display, and there is still great room for improvement in the user experience. Summary of the Invention

[0004] In order to improve the user experience of browsing three-dimensional image objects and then performing interactions, the disclosure discloses a system and operation method that integrates a planar display and a floating image display, enabling the user to interact with the displayed content of the planar display and the floating image display. For example, the user can gesture-operate the floating image displayed on the floating image display to control the content displayed on the planar display.

[0005] According to an embodiment, the system that integrates a planar display and a floating image display mainly includes a planar display module and a floating image display module. Among them, in the operation method of the system that integrates a planar display and a floating image display, after starting the system and in an initialization program, a signal channel is established between the planar display module and the floating image display module on a communication interface. Then, according to the planar display signal, a planar image is displayed on the display panel of the planar display module, and then a floating image display signal is generated according to a control instruction, and a floating image is displayed on the floating image display of the floating image display module.

[0006] Next, the control circuit of the floating image display module receives the user's operation on the floating image to calculate the interaction instruction. The control circuit of the floating image display module can then update the displayed floating image according to the interaction instruction. After the planar display module receives the interaction instruction through the signal channel, correspondingly, another planar image is displayed on the display panel.

[0007] Among them, the planar display module and the floating image display module are integrated in one device, or are two independent but signal-connected devices.

[0008] Furthermore, the floating image display module can be connected to a floating image database through a data transmission circuit, and the floating image database provides the floating image data for the floating image display module to display the floating image.

[0009] Furthermore, the system is also provided with a gesture sensor. The gesture sensor is connected to the floating image display module. When the floating image is displayed through the floating image display, the gesture sensor is simultaneously driven to operate to sense the gestures of the user operating the floating image.

[0010] Furthermore, when the interaction instruction is generated according to the gesture, the floating image display module can obtain the floating image data from the floating image database according to the operation instruction to update the display of the floating image.

[0011] Moreover, when updating the display of the floating image, a signal can be transmitted to the planar display module through a signal channel, so that the planar display module displays a corresponding another planar image.

[0012] Furthermore, the control instruction can be an instruction for converting the display from a planar image to a floating image. According to the instruction, the floating image display module can load the floating image data of the object corresponding to the planar image, and then display the floating image corresponding to the planar image.

[0013] To enable a further understanding of the features and technical content of the present invention, please refer to the following detailed description and drawings of the present invention. However, the provided drawings are only for reference and illustration, and are not used to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 Schematic diagram of an embodiment of a system showing an integrated planar display and a floating image display;

[0015] Figure 2 Schematic diagram of an embodiment of a floating image display;

[0016] Figure 3 Schematic diagram of an embodiment of the circuit components of a system showing an integrated planar display and a floating image display;

[0017] Figure 4 Flowchart of an embodiment of the operation method of a system showing an integrated planar display and a floating image display;

[0018] Figures 5A to 5C Schematic diagram of one of the embodiments showing the interaction executed by a system applying an integrated planar display and a floating image display;

[0019] Figure 6 Schematic diagram of the second embodiment showing the interaction execution of a system integrating a flat panel display and a floating image display;

[0020] Figure 7 Embodiment diagram of one application of a system integrating a flat panel display and a floating image display; and

[0021] Figure 8 Embodiment diagram of the second application of a system integrating a flat panel display and a floating image display. Detailed implementation manners

[0022] The disclosure proposes a system and an operation method integrating a flat panel display and a floating image display. The technical concept is that in a system, there is a flat panel display for displaying image information and a floating image display for providing a floating image display. The user can browse and operate the floating image to interact with the content displayed on the flat panel display. The floating image can be a three-dimensional image extending from the content displayed on the flat panel display or a virtual control interface for use operation, thereby controlling the content displayed on the flat panel display.

[0023] Figure 1 Schematic diagram of the appearance embodiment of a device integrating a flat panel display and a floating image display, in which an interactive image display device 10 is shown. The interactive image display device 10 is provided with a flat panel display module 101. The flat panel display can use any display technology, for example (but not limited to), a flat panel display module 101 composed of a display panel, a backlight module and related control circuits. Its main function is to display various flat image information. The interactive image display device 10 is provided with a floating image display module 103, including a floating image display and related control circuits. In the figure, a display interface capable of projecting a floating image is shown on a control platform 100. The display technology can refer to Figure 2 the description.

[0024] In the interactive image display device 10, the flat panel display module 101 and the floating image display module 103 are integrated through mechanical design, circuit connection and software cooperation, thereby achieving the purpose of mutual cooperation of different display technologies.

[0025] According to one of the embodiments, a flat panel display is disposed in the upper half of the structure of the interactive image display device 10 for displaying flat panel image information to the user; a floating image display is disposed on a control platform 100 for enabling the user to interact with the displayed floating image by gestures. Further, the interactive image display device 10 is further provided with a gesture sensor 105. The gesture sensor 105 can be disposed within the floating image display module 103 or be a sensor signal-connected to the floating image display module 103 for assisting in sensing the user's gestures. The interactive image display device 10 is further provided with a control panel 107 for providing user control of the operation of the device. For example, the control panel 107 may be provided with operation interfaces such as buttons, joysticks, touch interfaces, etc.

[0026] For example, in one of the operating modes of the interactive image display device 10, when the user views the content displayed on the flat panel display, the user can operate the device using the control panel 107, and then a floating image corresponding to the user operation function or the viewed content is displayed on the floating image display disposed on the control platform 100. Optionally, the floating image is a stereoscopic image projected as a real image within a distance on the display interface, allowing the user to operate by gestures. After the gesture sensor 105 senses the gestures, the floating image will change according to the gestures.

[0027] The display technology of the above floating image display can refer to Figure 2 the schematic diagram of the shown embodiment.

[0028] The figure shows an embodiment diagram of the floating image display module 103 displaying a stereoscopic floating image. In this example, a floating image display 20 is shown. The floating image display 20 mainly consists of an optical module 201 and a display panel 202, and includes an image processor (not shown in this figure) that can process the display content and may have communication capabilities (including relevant communication modules, not shown in this figure) that can obtain floating image data from an external image source and display the floating image 203 after image processing.

[0029] According to an embodiment, the optical module 201 of the floating image display 20 is a lens array composed of multiple lens components, and is relatively combined with the display panel 202. The display panel 202 is a flat display panel for displaying an integrated image composed of a plurality of unit images. Among them, the integrated image is composed of a plurality of unit images, and the unit image is an image corresponding to one or more lens components in the optical module 201. Each unit image can project a floating image 203 in a one-to-one manner (each unit image maps to one lens component), one-to-many (each unit image maps to multiple lens components), many-to-one (multiple unit images map to one lens component), etc. Therefore, it is necessary to consider the component characteristics in the overall floating image display 20 and generate unit images or integrated images for the finally presented floating image 203. Each of the above unit images maps to each lens component in the optical module 201. In one embodiment, each lens component may be composed of one or more convex lenses and concave lenses. During operation, the multiple unit images displayed on the display panel 202 pass through the lens array in the optical module 201 to project a three-dimensional floating image 203 above the floating image display 20, as schematically shown in the figure as a three-dimensional floating image "3D".

[0030] Furthermore, the floating image display 20 is provided with a gesture sensor 205 (which can be an internal or external sensor) for sensing the actions of the user's hand 22 on the floating image 203. The gesture sensor 205 can be achieved by an image detection means. The main method is to use a camera to obtain consecutive images of several key parts of the hand 22 (such as fingers, palm, knuckles). Through image processing, the image changes before and after a time interval can be obtained, mainly the three-dimensional coordinates of each key part in the coordinate system of the gesture sensor (such as Xsensor, Ysensor, Zsensor represented by a rectangular coordinate system, or γ, θ, φ represented by a spherical coordinate system). After continuously obtaining them, the change amount of the three-dimensional coordinates can be obtained, and then converted into the change amount of the three-dimensional coordinates (Xdevice, Ydevice, Zdevice) in the coordinate system of the floating image display 20, such as information such as vectors (displacement, direction), speed (distance and time), etc. Finally, one or any combination of interactive instructions for moving, rotating, and scaling actions can be judged.

[0031] In another embodiment, the gesture sensor 205 can sense gestures using the principle of light interruption. The related technology is to first project a sensing light beam with a light source. When the hand 22 enters this light range, the light sensor can detect the light spot generated on the hand when the light beam is interrupted, and then obtain the amount of reflected light (reflecting the changing part) and the time difference (reflecting the depth) of each key part from it. Similarly, according to the continuously obtained light information, the change amount of the three-dimensional coordinates caused by the gesture can be obtained, and then one or any combination of interactive instructions for moving, rotating, and scaling actions can be judged.

[0032] In yet another embodiment, the gesture sensor 205 may include a sound wave generator and a receiver, and determine gestures by using the information of sound wave reflection. When the hand 22 is within the sensing range of the gesture sensor 205, the sound wave will be blocked, and similarly, a reflected wave will be generated, so that the sound wave receiver can detect the change amount of several key parts of the hand 22 in space according to the change of the sound wave, and then convert it into a three-dimensional coordinate change amount, and one or any combination of movement, rotation, and scaling actions can be determined therefrom for the interactive instruction.

[0033] Thus, the interactive sensing method implemented by the gesture sensor 205 using various gesture sensing technologies can determine one or any combination of movement, rotation, and scaling actions for the interactive instruction based on the changes in the three-dimensional coordinates of the fingers, palm position, and finger joints of the hand 22 reflected by the gesture. Then, by comparing with the floating image data (including the color information and three-dimensional space information of the stereoscopic image) recorded in the image database, the next floating image data of the floating image 203 under various gesture operations is obtained, and the next stereoscopic image is displayed. The floating image data may include a static stereoscopic image or a stereoscopic film formed by consecutive images. When the processing procedures such as change sensing, coordinate conversion, and stereoscopic image calculation can be calculated at high speed, the real-time interaction effect can be reflected in real time according to the gesture.

[0034] Figure 3 Next, a schematic diagram of the circuit components of the system integrating the flat panel display and the floating image display is shown.

[0035] The system is mainly provided with a flat panel display module 101 and a floating image display module 103 that are signal-connected to each other. According to the embodiment, the flat panel display module 101 and the floating image display module 103 can be integrated in one device, or can be respectively implemented as two independent but signal-connected devices.

[0036] The flat panel display module 101 is mainly provided with a control circuit 301 for controlling the operation of the flat panel display module 101 and signal-connecting to other circuit components. The main circuit components are such as a data transmission circuit 303. The flat panel display module 101 obtains image data from the image source 320 through the data transmission circuit 303, and performs image processing through the image processor 305, including decoding, decompressing, and then converting it into image data in a specific format, and provides it to the display panel driving circuit 306 to drive the display panel 307 to display a flat image.

[0037] In a system integrating a flat panel display and a floating image display, the flat panel display module 101 and the floating image display module 103 communicate with each other through a communication interface (such as a communication bus) 310, and can transmit signals to each other for the purpose of interaction. In this example, the input / output circuit 309 of the flat panel display module 101 is connected to this communication interface 310. The input / output circuit 309 is used to transmit signals in a specific format. The signals are transmitted to the floating image display module 103 via the communication interface 310, and correspondingly, the signals generated by the floating image display module 103 are received through the communication interface 310.

[0038] In the floating image display module 103, there is a control circuit 331 that controls the operation of the floating image display module 103. The control circuit 331 is signal-connected to the circuit components in the floating image display module 103, including a data transmission circuit 332. The floating image display module 103 is connected to a floating image database 330 through the data transmission circuit 332. The floating image database 330 provides the floating image data for the floating image display module 103 to display floating images, including the color information and three-dimensional space information of various stereoscopic images, and can provide the floating image data at any time according to the needs of the floating image display module 103 to display floating images.

[0039] After being processed by the image processor 333 of the floating image display module 103, the floating image data generates the image data of the floating image, which is provided to the display driver circuit 334 to be converted into a display signal for driving the floating image display 335 to display the floating image. Finally, the floating image display 335 displays the floating image according to the display signal. When the floating image display module 103 projects a floating image on its display panel, it simultaneously controls the gesture sensor 336 to operate to sense the gestures of the user operating the floating image, and can generate corresponding interaction instructions, including obtaining the floating image data from the floating image database 330 according to the interaction instructions to update the displayed floating image, or converting it into a signal in a specific format through the input / output circuit 337 and transmitting the signal to the flat panel display module 101 through the signal channel established by the communication interface 310, so that the flat panel display module 101 can display a corresponding another flat image.

[0040] According to the embodiment, when the gesture sensor 336 senses a gesture, it can judge the change amount of the stereoscopic coordinates of the user operating the floating image according to the gesture, so that the control circuit 331 can judge the interaction instructions obtained according to the change amount of the stereoscopic coordinates, such as rotation, zoom in, zoom out and other interaction instructions, and then calculate the image coordinate information of the new floating image according to the interaction instructions, thereby obtaining updated floating image data, or using the already obtained floating image data to update the currently displayed floating image.

[0041] It should be noted that the change in the three-dimensional coordinates corresponding to the gesture sensed by the gesture sensor 336 is the coordinate information with the gesture sensor 336 as the reference coordinate system, and then it is provided to the control circuit 331 to perform coordinate conversion, and convert the coordinate information of the interaction instruction in the coordinate system formed by the gesture sensor 336 to the coordinate system of the space where the floating image is displayed.

[0042] Among them, for the floating image displayed by the floating image display module 103, each position of the image is known. Therefore, the correlation of the gesture in the same coordinate system after coordinate conversion can be judged, and this correlation expresses the relationship between the three-dimensional coordinates formed by the gesture and the floating image in the display. For example, moving the gesture causes the floating image to move in a certain direction. Therefore, the change amount in this direction should be added to the three-dimensional coordinates of the floating image. Therefore, a new floating image is obtained at the new position. In the control circuit 331, a new floating image data can be queried or calculated in real time and provided to the display driver circuit 334 to form a display image. If it is a rotation gesture, it will cause the floating image to rotate in a certain direction. Therefore, the rotation change amount should be added to the original three-dimensional coordinates of the floating image, and new floating image data is formed to display the new floating image data. Similarly, if it is a zoom gesture, the size of the floating image changes at the same reference point position, and the relevant three-dimensional coordinates also change accordingly. The control circuit 331 queries the image database or calculates in real time to generate new floating image data and provides it to the display driver circuit 334 to form a display signal.

[0043] The above gestures such as moving, rotating, and zooming can be arbitrarily combined to form an interaction instruction, and then the image processor 333 calculates to generate new floating image data, and the floating image data is the data for directly displaying the floating image on the floating image display 20.

[0044] In another embodiment of the system integrating the flat panel display and the floating image display proposed in the disclosure, the floating image display module 103 can be connected to a control system by wireless (such as WiFi, Bluetooth, etc.) or wired (such as industrial standard interfaces such as USB, RS232, etc.) means through a specific communication interface, and the implemented control interface is Figure 1 the displayed control panel 107. A computer system runs in the control system and executes a driver program for communicating with the flat panel display module 101 and the floating image display module 103, so that the interaction instruction generated by the operation of the floating image display module 103 through gestures (or voice or other input methods) can be transmitted to the flat panel display module 101, and the flat panel display module 101 reflects this interaction instruction; correspondingly, the image signal of the image displayed by the flat panel display module 101 can be transmitted to the floating image display module 103 through the communication interface 310 and then transmitted back to the floating image display module 103 to display the floating image accordingly.

[0045] According to an embodiment, the communication interface 310 between the planar display module 101 and the floating image display module 103 is used to interpret and compile the information exchanged between the two. The control circuit 301 of the planar display module 101 and the control circuit 331 of the floating image display module 103 can respond to the information generated by each other, and display corresponding planar images and floating images respectively.

[0046] According to the above embodiment, the system integrating the planar display and the floating image display can achieve the effect of converting the content of the planar image and the floating image. For example, when the user views the content in the planar display, under specific conditions or after being activated by the user, the floating image display module 103 can be driven to operate to present the corresponding floating image. The floating image can be a three-dimensional image of the content displayed in the planar display, and the user can use gesture operations to conveniently view the images of various angles of the object shown in the planar image. After the gesture sensor senses the gesture, in addition to transforming the floating image to conform to the gesture, the planar display module 101 can also be driven to display an image reflecting the gesture through the planar display. It should be noted here that the method of operating the floating image is not limited to gestures, but can also be voice or other input methods.

[0047] The operation method of the system integrating the planar display and the floating image display proposed in the disclosure can refer to Figure 4 the flowchart of the display embodiment.

[0048] According to this flowchart of the embodiment, after the system is started (step S401), in the initialization program, on the above communication interface, a signal channel between the planar display module and the floating image display module in the system is established, that is, the signal channel established by the above communication interface (step S403).

[0049] In the planar display module, the planar display signal generated according to the user operation control panel or default generated by the control circuit of the planar display module is processed by the image processor and then drives the display panel to display a planar image (step S405). In the floating image display module, according to the control instruction generated by the user operation control panel or the control instruction generated by the control circuit of the floating image display module, the control circuit generates a floating image display signal according to the control instruction. According to this floating image display signal, the floating image data can be loaded from the floating image database (step S407), and after being processed by the image processor, a floating image is generated and displayed through the floating image display (step S409).

[0050] According to an embodiment of the first operating mode of the system integrating a flat panel display and a floating image display, the control instruction can be an instruction for converting a flat panel image into a floating image, which enables the floating image display module to load the floating image data of an object corresponding to this flat panel image from the floating image database. That is, the floating image data can be floating image data describing the color information and three-dimensional space information of this object, thereby enabling the floating image display module to display a floating image corresponding to the flat panel image.

[0051] Next, the user can gesture-operate the floating image, causing the gesture sensor to sense the operation gesture (step S411). After receiving the user's gesture for operating the floating image, the control circuit of the floating image display module calculates an interaction instruction (step S413). In this way, the floating image display module can update the floating image data according to this interaction instruction (step S415). The process can return to step S407, and then load the updated floating image data from the floating image database according to the instruction for updating the floating image, and calculate the updated floating image.

[0052] On the other hand, the flat panel display module receives this interaction instruction through the signal channel, and correspondingly updates the flat panel image on the display panel, that is, displays another flat panel image (step S417). In this way, the purpose of the interactive action between the flat panel image and the floating image is achieved.

[0053] According to the embodiment of the second operating mode of the system integrating a flat panel display and a floating image display, reference can be made to Figures 5A to 5C the schematic diagram showing the embodiment of performing interaction using the system.

[0054] In Figure 5A it shows an interactive image display device 50, which integrates a flat panel display module 501, a floating image display module 503, and a gesture sensor 505, and a control panel 507 is provided on the control platform 500. In this example, the display panel of the flat panel display module 501 displays a flat panel image 511, for example, a person.

[0055] In Figure 5B the user can operate the device through the control panel 507 to request the display of a three-dimensional image of this person. At this time, the floating image display module 503 can load the floating image data corresponding to this person from the floating image database, and then display a floating image 513 corresponding to this person through the floating image display.

[0056] Next, the user can gesture-operate this floating image 513. During the operation, the gesture sensor 505 senses the gesture and calculates an interaction instruction. At this time, as Figure 5CAs shown, the flat panel display shows a corresponding another flat panel image 515, and during the interaction process, the floating image display module 503 may calculate a new floating image. This example shows the result of having two floating images 517 and 519 after updating the floating image.

[0057] Taking the above second operation mode as an example. The system displays preliminary content with a virtual character through the flat panel display, such as showing content with voice and animation, such as storytelling or product description; when the user requests to show content with a floating image, the system displays a floating image character obtained through three-dimensional calculation through the floating image display, and can show content with voice and dynamic stereoscopic images. At the same time, the user can also interact with the floating image character through gestures, voice or other input methods. Correspondingly, the system can display another flat panel character image on the flat panel display in response to the interaction instructions generated by the user operating the floating image. In this way, the user can watch and interact in a more intuitive way, making people enter the scenario more interestingly. For example, in the application of teaching, it can enhance the learning experience of students.

[0058] The third operation mode of the system integrating a flat panel display and a floating image display is as Figure 6 a schematic diagram showing an embodiment of performing interaction.

[0059] This example shows that the interactive image display device 50 loads the floating image data of a floating control interface 603 from the floating image database according to the control instructions generated by the user control, and then generates a virtual floating control interface 603 displayed by the floating image display, such as a virtual button, a touchpad or a joystick, so that the user can operate the content displayed on the flat panel display through the floating image. In this example, a trajectory 601 generated by the user operation is displayed on the flat panel display.

[0060] For example, the system integrating a flat panel display and a floating image display can implement a game console, and various control interfaces of the game console can be implemented through the floating image display module, providing the user with gesture operation of the floating control interface to play the game. The trajectory 601 shown in the figure can be the travel route of a certain character in the game. Further, the system can implement a game console integrating two-dimensional images and three-dimensional floating images. Through the cooperation of software and hardware therein, when playing a game with a flat panel image, gesture operation of the floating image can also be added for control, to operate the flat panel game with the floating image, or specific information can be displayed with the floating image.

[0061] Figure 7 Then, an embodiment diagram of an application of the system integrating a flat panel display and a floating image display is shown.

[0062] This example shows a system integrating a flat panel display and a floating image display installed in a seat 70 of a passenger plane or a vehicle. The backrest is embedded with a flat panel display 701, and a floating image display 702 is embedded in a foldable and retractable tray 72.

[0063] In a usage scenario, in the initial state, a flat image is displayed on the flat panel display 701. When the user turns the tray 72 from the folded and retracted state to the usage state, the control switch in its pivot mechanism is activated, starting the floating image display module to display a floating image 703. This example shows a virtual character, allowing the user to interact with this virtual character.

[0064] Figure 8 Show a system integrating a flat panel display and a floating image display applied to a vending machine 80. In the vending machine 80, information such as the products sold and their prices is displayed on a flat panel display 801, and various products 803 are shown. The vending machine 80 is provided with a display platform 82 for installing the floating image display 802.

[0065] In an application scenario, the user can select the product to be purchased through the flat panel display 801 or other operation interfaces. The control circuit in the vending machine 80 drives the floating image display 802 to display a floating image 805 of the product selected by the user, enabling the user to operate and view the three-dimensional image of the product through the floating image 805.

[0066] According to the descriptions in the specification of various embodiments of the system integrating a flat panel display and a floating image display, by integrating the flat panel display and the floating image display, the purpose of interaction between flat images and three-dimensional images can be achieved, effectively enhancing the user experience in browsing products, audio-visual interaction, teaching, or gaming, etc.

[0067] The content disclosed above is only the preferred and feasible embodiments of the present invention, and does not limit the scope of patent application of the present invention. Therefore, all equivalent technical changes made by using the content of the specification and drawings of the present invention are included in the scope of patent application of the present invention.

Claims

1. A system integrating a flat panel display and a floating image display, characterized in that: The system comprises: a flat panel display module; and a floating image display module connected to the flat display module via a communication interface; The operating method of the system integrating the flat panel display and the floating image display includes: After starting the system and in an initialization procedure, a signal channel between the flat display module and the floating image display module is established on the communication interface; Displaying a flat image on a display panel of the flat display module according to a flat display signal; Generate a floating image display signal according to a control instruction, and display a floating image with a floating image display of the floating image display module; A control circuit of the floating image display module receives a user operating the floating image and calculates an interactive instruction; The control circuit of the floating image display module updates and displays the floating image according to the interactive instruction; and The flat display module receives the interactive instruction through the signal channel, and accordingly displays another flat image on the display panel.

2. The system of integrating a flat panel display and a floating image display as claimed in claim 1, characterized in that: The flat display module and the floating image display module are integrated into one device, or are two independent devices but signal-connected to each other.

3. The system of integrating a flat panel display and a floating image display as claimed in claim 1, characterized in that: The floating image display module is connected to a floating image database through a data transmission circuit, and the floating image database provides the floating image display module with floating image data for displaying the floating image.

4. The system of integrating a flat panel display and a floating image display as claimed in claim 1, characterized in that: The system is provided with a gesture sensor connected to the floating image display module. When the floating image is displayed through the floating image display, the gesture sensor is driven to operate to sense the gesture of the user operating the floating image.

5. The system of integrating a flat panel display and a floating image display as claimed in claim 4, characterized in that: When the interactive instruction is generated according to the gesture, the floating image display module obtains floating image data from a floating image database according to the operation instruction to update and display the floating image.

6. The system of integrating a flat panel display and a floating image display as claimed in claim 5, characterized in that: When the floating image is updated and displayed, a signal is transmitted to the flat display module through the signal channel, so that the flat display module displays another corresponding flat image.

7. The system of integrating a flat panel display and a floating image display according to any one of claims 1 to 6, characterized in that: The floating image display module includes a floating image display, which includes an optical module and a display panel; wherein the optical module is a lens array composed of a plurality of lens components, and is relatively combined with the display panel, and the display panel is used to display an integrated image composed of a plurality of unit images, and each unit image is an image corresponding to one or more lens components in the optical module; wherein the plurality of unit images displayed on the display panel are projected through the lens array to form a three-dimensional floating image above the floating image display.

8. A method for operating a system integrating a flat panel display and a floating image display, characterized in that: The operating method comprises: Starting and initializing the system integrating the flat panel display and the floating image display, and establishing a signal channel between a flat panel display module and a floating image display module in an initialization procedure; Displaying a flat image on a display panel of the flat display module according to a flat display signal; Generate a floating image display signal according to a control instruction, and display a floating image with a floating image display of the floating image display module; A control circuit of the floating image display module receives a user operating the floating image and calculates an interactive instruction; The control circuit of the floating image display module updates and displays the floating image according to the interactive instruction; and The flat display module receives the interactive instruction through the signal channel, and accordingly displays another flat image on the display panel.

9. The operating method of the system integrating a flat panel display and a floating image display according to claim 8, characterized in that: In the floating image display module, the control circuit loads a floating image data from a floating image database, and after being processed by an image processor, the floating image is generated.

10. The operating method of the system integrating a flat panel display and a floating image display according to claim 9, characterized in that: The control instruction is an instruction for converting the plane image into the floating image, so that the floating image display module loads the floating image data of an object corresponding to the plane image, and then displays the floating image corresponding to the plane image.

11. The operating method of the system integrating a flat panel display and a floating image display according to claim 10, characterized in that: The floating image data is floating image data describing the color information and three-dimensional space information of the object.

12. The operating method of the system integrating a flat panel display and a floating image display according to claim 9, characterized in that: The control instruction requires the floating image display module to load the floating image data of a floating control interface, so that the floating image display module displays the floating control interface, and provides the user with the ability to operate the floating control interface to control the display content of the flat display module.

13. The operating method of the system integrating a flat panel display and a floating image display according to any one of claims 8 to 12, characterized in that: The user operates the floating image with a gesture, and a gesture sensor senses the gesture to calculate the interactive instruction.

14. The operating method of the system integrating a flat panel display and a floating image display according to claim 13, characterized in that: When the interactive instruction is generated according to the gesture, the floating image display module updates and displays the floating image according to the operation instruction, and transmits a signal to the flat display module through the signal channel when updating and displaying the floating image, so that the flat display module displays another corresponding flat image.