Interactive system

Abstract

The present invention discloses an interactive system. The interactive system includes an electronic device, a first image display device and a second image display device. The electronic device transmits first image information to the first image display device for display. The electronic device transmits second image information to the second image display device for display. The second image information is displayed as a three-dimensional second image information in a space on one side of the second image display device through the second image display device. The three-dimensional second image information interacts with at least one object.

Description

Technical Field

[0001] The present invention relates to an interactive system, and in particular to an interactive system that directly interacts with three-dimensional image information. Background Art

[0002] In the current field of augmented reality or virtual reality, most of them require the use of users' physical and mental senses to physically interact with electronic devices, rather than intuitively using props or hands to interact with three-dimensional image information.

[0003] Therefore, how to provide an interactive system that allows users to directly interact with three-dimensional image information has become one of the important issues that this business wants to solve. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide an interactive system in view of the deficiencies in the prior art, comprising an electronic device, a first image display device and a second image display device, the electronic device comprising a controller, a storage module and a connection module; a first image display device is electrically connected to the electronic device, the first image display device is a two-dimensional image display device for displaying two-dimensional image information; a second image display device is connected to the electronic device, the second image display device is a three-dimensional image display device; wherein the electronic device is provided with a program, the program at least provides a first image information and a second image information, the controller transmits the first image information to the first image display device for display, the controller transmits the second image information to the second image display device for display, the second image information is transmitted through the second image display device, and the three-dimensional image information of the second image information is displayed in the space on one side of the second image display device; wherein the three-dimensional second image information interacts with at least one object.

[0005] Preferably, it also includes: a sensor, arranged on the electronic device, the first image display device or the second image display device, for detecting at least one three-dimensional coordinate value of the object, the sensor transmits the at least one three-dimensional coordinate value of the object to the controller, and the controller determines multiple second three-dimensional coordinate values ​​of the three-dimensional second image information based on the at least one three-dimensional coordinate value of the object and the multiple first three-dimensional coordinate values ​​of the three-dimensional second image information.

[0006] Preferably, the first image display device is arranged at one side of the electronic device, and the second image display device is arranged on the electronic device.

[0007] Preferably, the second image display device includes: a flat display module; a lens array layer; and a microstructure layer; wherein the flat display module has a display surface, the flat display module provides at least one image information, which is displayed through the lens array layer and the microstructure layer, the lens array layer is arranged on the display surface of the flat display module, receives the light of the image information for adjustment, the lens array layer includes a plurality of lenses, the lens array layer is used to regulate the light field, the microstructure layer is arranged on the lens array layer, the microstructure layer includes a plurality of microstructures, the microstructure layer is used to modulate the angle direction of the light, the microstructure layer receives the light penetrating the lens array layer for adjustment, so that the second image display device displays three-dimensional image information floating in the space on one side of the second image display device.

[0008] Preferably, the lenses of the lens array layer conform to the mirror maker's formula: 1 / f=(n-1)(1 / R1+1 / R2), wherein R1 and R2 are the radii of curvature on both sides of the lens respectively, f is the focal length of the lens, and n is the refractive index of the lens.

[0009] Preferably, the microstructure layer is a dynamic optical component layer, and the microstructure layer has a microstructure functional mode and a non-microstructure functional mode. When the microstructure layer is switched to the microstructure functional mode, it can be used to modulate the angle direction of light.

[0010] Preferably, the microstructure layer is a liquid crystal lens array layer including a plurality of microstructure liquid crystal lenses, and the lens array layer is a liquid crystal lens array layer including a plurality of optically adjustable liquid crystal lenses.

[0011] Preferably, the lens array layer includes a first structure lens array layer and a second structure lens array layer, the first structure lens array layer has a lens structure and can be used to control the light field, and the second structure lens array layer does not have a lens structure.

[0012] Preferably, the second image display device further comprises an electron beam sensor, and the electronic device or the second image display device enables the electron beam sensor to provide an electron beam to the object according to the interaction between the three-dimensional second image information and the object.

[0013] Preferably, the electronic device or the second image display apparatus provides a plurality of control signals to an electronic interactive glove of the object, so that a plurality of tactile feedback components of the electronic interactive glove are activated.

[0014] The invention also discloses an interactive system, which includes an electronic device, a three-dimensional image display device and a sensor. The electronic device includes a controller, a storage module and a connection module; a three-dimensional image display device, the connection module of the electronic device is connected to the three-dimensional image display device; and a sensor, which is arranged on the electronic device or the three-dimensional image display device and is used to detect multiple three-dimensional coordinate values ​​of an object; wherein the electronic device is provided with a program, the program is stored in the storage module, the program at least provides an image information, the controller transmits the image information to the three-dimensional image display device for display, the controller transmits the image information to the three-dimensional display device for display, and the image information is transmitted by the three-dimensional image display device to display a three-dimensional image information in the space on one side of the three-dimensional image display device; wherein the three-dimensional image information at least interacts with the object; wherein the sensor transmits the multiple three-dimensional coordinate values ​​of the object to the controller, and the controller determines the multiple second three-dimensional coordinate values ​​of the three-dimensional image information according to the multiple three-dimensional coordinate values ​​of the object and the multiple first three-dimensional coordinate values ​​of the three-dimensional image information of the second image information; wherein the multiple second three-dimensional coordinate values ​​of the three-dimensional image information determine an action when the three-dimensional image information interacts with the object.

[0015] Preferably, the three-dimensional image display device further comprises an electron beam sensor, and the electronic device or the three-dimensional image display device enables the electron beam sensor to provide an electron beam to the object according to the interaction between the three-dimensional image information and the object.

[0016] Preferably, the electronic device or the three-dimensional image display apparatus provides a plurality of control signals to an electronic interactive device disposed on the object, so as to activate a plurality of tactile feedback components of the electronic interactive device.

[0017] One of the beneficial effects of the present invention is that the interactive system provided by the present invention allows users to intuitively interact with three-dimensional image information to generate corresponding actions and changes without having to wear various types of augmented reality electronic devices.

[0018] To further understand the features and technical contents of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are only for reference and description and are not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of an interactive system according to a first embodiment of the present invention.

[0020] Figure 2A It is a functional block diagram of the interactive system according to the first embodiment of the present invention.

[0021] Figure 2B is another functional block diagram of the interactive system according to the first embodiment of the present invention.

[0022] Figure 3 is another schematic diagram of the interactive system according to the first embodiment of the present invention.

[0023] Figure 4 It is a schematic structural diagram of a second image display device of the present invention.

[0024] Figure 5 The figure is a schematic diagram of a second image display device displaying second image information.

[0025] Figure 6 It is a schematic diagram of the interaction between the second image information and an object.

[0026] Figure 7 is another schematic diagram of the interaction between the second image information and an object.

[0027] Figure 8 is another schematic diagram of the interaction between the second image information and an object.

[0028] Fig. 9 is another schematic diagram of the interaction between the second image information and an object.

[0029] Fig.10 It is a schematic diagram showing that the second image information is displayed according to the first entity and the second entity.

[0030] Fig.11 It is a schematic diagram showing that the second image information is displayed according to the first entity and the second entity.

[0031] Fig.12 is a schematic diagram of an interactive system according to a second embodiment of the present invention.

[0032] Fig.13 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

[0033] Fig.14 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

[0034] Fig.15 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

[0035] Fig.16 is a schematic diagram of an interactive system according to a third embodiment of the present invention.

[0036] Fig.17 is another schematic diagram of the interactive system according to the third embodiment of the present invention. DETAILED DESCRIPTION

[0037] The following is an explanation of the implementation methods of the "interactive system" disclosed in the present invention through specific embodiments. Those skilled in the art can understand the advantages and effects of the present invention from the contents disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and the details in this specification can also be modified and changed in various ways based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are only simple schematic illustrations and are not depicted according to actual dimensions. It is stated in advance. The following implementation methods will further explain the relevant technical contents of the present invention in detail, but the disclosed contents are not intended to limit the scope of protection of the present invention. In addition, the term "or" used in this article may include any one or more combinations of the associated listed items depending on the actual situation.

[0038] [First embodiment]

[0039] See also Figure 1 , Figure 2A , Figure 2B , Figure 3 , Figure 1 is a schematic diagram of an interactive system according to a first embodiment of the present invention. Figure 2A It is a functional block diagram of the interactive system according to the first embodiment of the present invention. Figure 2B is another functional block diagram of the interactive system according to the first embodiment of the present invention. Figure 3 is another schematic diagram of the interactive system according to the first embodiment of the present invention.

[0040] See also Figure 1 The interactive system SYS1 includes an electronic device 1, a first image display device 2 and a second image display device 3. The electronic device 1 is a computer system including a controller 11, a storage module 12 and a connection module 13.

[0041] The first image display device 2 is electrically connected to the electronic device 1. The first image display device 2 is a two-dimensional image display device for displaying two-dimensional image information. The second image display device 3 is connected to the electronic device 1. The second image display device 3 is a three-dimensional image display device. In this embodiment, the second image display device 3 can be connected to the electronic device 1 via a wired communication method or a wireless communication method. The second image display device 3 can communicate with the electronic device 1 using a Wi-Fi communication unit, a Bluetooth communication unit, a Zigbee communication unit (Zigbee), a LoRa communication unit, a Sigfox communication unit, or a NB-IoT communication unit.

[0042] The electronic device 1 further includes a communication module 14. The electronic device 1 can use the communication module 14 to connect the first image display device 2 and the second image display device 3. The communication module 14 can be a wired communication module or a wireless communication module. When the communication module 14 is a wireless communication module, the communication module 14 can be a Wi-Fi communication module, a Bluetooth communication module, a Zigbee communication module (Zigbee), a LoRa communication module, a Sigfox communication module or a NB-IoT communication module.

[0043] The controller 11 is a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC) or a microprocessor (MCU). The storage module 12 is a flash memory, a read-only memory, a programmable read-only memory, an electrically rewritable read-only memory, an erasable programmable read-only memory or an electrically erasable programmable read-only memory.

[0044] The electronic device 1 is provided with a program, and the program provides at least a first image information G1 and a second image information G2. In addition, the program can also be provided to the electronic device 1 by a cloud server. The controller 11 transmits the first image information G1 to the first image display device 2 for display. The controller 11 transmits the second image information G2 to the second image display device 3 for display. The second image information G2 is displayed as a three-dimensional second image information G2 in the space on one side of the second image display device 3 through the second image display device 3. Among them, the three-dimensional second image information G2 interacts with at least one object. For example: the user's hand, the user's finger, the user's palm, a tool, a toy or a prop, etc. In other embodiments, the first image display device 2 can also be used to display three-dimensional image information.

[0045] In addition, the interactive system SYS1 further includes a sensor 7. In this embodiment, the sensor 7 is disposed on the electronic device 1, the first image display device 2 or the second image display device 3, and is used to detect a three-dimensional coordinate value of an object. In this embodiment, the sensor 7 is an image capture unit (CCD). The sensor 7 may also include a sight tracking function to track the sight of a human or an animal.

[0046] The sensor 7 transmits at least one object three-dimensional coordinate value to the controller 11. The controller 11 determines multiple second three-dimensional coordinate values ​​of the three-dimensional second image information G2 based on the at least one object three-dimensional coordinate value and multiple first three-dimensional coordinate values ​​of the three-dimensional second image information G2. That is, the sensor 7 detects the object three-dimensional coordinate value of the object and compares and determines with the multiple first three-dimensional coordinate values ​​of the three-dimensional second image information G2 to determine the multiple second three-dimensional coordinate values ​​of the three-dimensional second image information G2. At this time, the multiple first three-dimensional coordinate values ​​of the three-dimensional second image information G2 are the same or different from the multiple second three-dimensional coordinate values ​​of the three-dimensional second image information G2.

[0047] When the multiple first three-dimensional coordinate values ​​of the three-dimensional second image information G2 are different from the multiple second three-dimensional coordinate values ​​of the three-dimensional second image information G2, the three-dimensional second image information G2 generates an action different from the original three-dimensional second image information G2.

[0048] like Figure 1 As shown, the first image display device 2 and the second image display device 3 are arranged separately from the electronic device 1. Figure 1 In the embodiment, the electronic device 1 is a desktop computer. The first image display device 2 is a liquid crystal display, a micro light emitting diode display (MicroLEDDISPLAY) or an organic light emitting diode display (OLEDDISPLAY).

[0049] See also Figure 2B In other embodiments, the interactive system SYS2 may further include a microphone MP, a speaker SP, and a connection device CON. The controller 11 of the electronic device 1 is electrically connected to the storage module 12, the connection module 13, and the communication module 14. The connection module 13 of the electronic device 1 is connected to the connection device CON. The connection device CON is connected to the microphone MP, the speaker SP, the second image display device 3, and the sensor 7.

[0050] In this embodiment, the connection device CON, the microphone MP, the speaker SP, the second image display apparatus 3 and the sensor 7 may be provided in the same device.

[0051] The microphone MP is used to receive an audio message. When the microphone MP receives a control audio message, the microphone MP transmits the control audio signal to the controller 11 through the connection device CON and the connection module 13 for analysis. The controller 11 further analyzes the control request signal in the control audio message, such as rotation, sitting, and jumping. Then, the controller 11 further controls the action of the three-dimensional second image information G2 displayed on the second image display device 3 according to the control request signal. In this way, the user can interact with the three-dimensional second image information G2 through sound. In addition, the controller 11 can transmit the interactive audio information corresponding to the three-dimensional second image information G2 to the speaker SP for playback, thereby enhancing the user's more comprehensive interactive experience.

[0052] like Figure 3 As shown, the first image display device 2 is arranged on one side of the electronic device 1, and the second image display device 3 is arranged on the electronic device 1. Figure 3 In the embodiment, the electronic device 1 is a laptop computer. That is, the electronic device 1 is a laptop computer with two screens.

[0053] In this embodiment, the first image information G1 and the second image information G2 of the interactive system SYS1 are two image information that can be spliced ​​together, such as maps of different areas. However, the first image information G1 and the second image information G2 can also be two image information that are related in content, such as Figure 3 The second image information G2 in the figure is a virtual keyboard, and the first image information G1 is a note jumping image. In addition, in this embodiment, the second image information G2 can also be a marble, and the first image information G1 is the bouncing path of the marble table.

[0054] See also Figure 4 , Figure 4 It is a schematic structural diagram of a second image display device of the present invention.

[0055] The second image display device 3 includes a flat display module 31 , a lens array layer 32 and a microstructure layer 33 .

[0056] The flat display module 31 has a display surface 311. The flat display module 31 is used to provide two-dimensional second image information G2, and display three-dimensional second image information G2 through the lens array layer 32 and the microstructure layer 33.

[0057] The lens array layer 32 is disposed on the display surface 311 of the flat display module 31, receives the light of the two-dimensional second image information G2 for adjustment, and includes a plurality of lenses 321. The lens array layer 32 is used to adjust the light field.

[0058] The microstructure layer 33 is disposed on the lens array layer 32. The microstructure layer 33 includes a plurality of microstructures. The microstructure layer 33 is used to modulate the angle direction of the light. The microstructure layer 33 receives the light penetrating the lens array layer 32 and adjusts it so that the second image display device 3 displays the three-dimensional image information floating in the space on one side of the second image display device 3.

[0059] The lenses 321 of the lens array layer 32 conform to the mirror maker's formula: 1 / f=(n-1)(1 / R1+1 / R2), where R1 and R2 are the curvature radii of the two sides of the lens 321, f is the focal length of the lens, and n is the refractive index of the lens.

[0060] In addition, the microstructure layer 33 is a dynamic optical component layer. That is, the microstructure layer 33 has a microstructure function mode and a non-microstructure function mode. The microstructure layer 33 can be adjusted to a microstructure function mode and a non-microstructure function mode according to a control signal. When the microstructure layer 33 is switched to the microstructure function mode, it can be used to modulate the angle direction of light. When the microstructure layer 33 is switched to the non-microstructure function mode, the second image display device 3 is used to display two-dimensional image information, and will not display three-dimensional image information floating in the space on one side of the second image display device 3. The microstructure layer 33 is a liquid crystal lens array layer (Liquid Lens Layer), including a plurality of microstructure liquid crystal lenses, and the lens array layer is also a liquid crystal lens array layer (Liquid Lens Layer), including a plurality of optical adjustment liquid crystal lenses. That is, the second image display device 3 is a display device including at least two layers of liquid crystal lens array layers. In other embodiments, the second image display device 3 may include more layers of liquid crystal lens array layers for light adjustment. Furthermore, in other embodiments, the second image display device 3 may set different numbers of second image display devices 3 in different regions for light adjustment. In addition, the lens array layer 32 includes a first structure lens array layer (not shown) and a second structure lens array layer (not shown). The first structure lens array layer (not shown) has a lens structure that can be used to adjust the light field, while the second structure lens array layer (not shown) does not have a lens structure.

[0061] See also Figure 5 , Figure 6 as well as Figure 7 , Figure 5 The figure is a schematic diagram of a second image display device displaying second image information. Figure 6 It is a schematic diagram of the interaction between the second image information and an object. Figure 7 is another schematic diagram of the interaction between the second image information and an object.

[0062] The three-dimensional second image information G2 is a pet dog. Figure 6The multiple first three-dimensional coordinate values ​​G2C1 - G2C3 of the second image information G2 can be detected by the sensor 7 , or directly obtained by the controller 11 from the data of the second image information G2 .

[0063] also, Figure 6 The multiple three-dimensional coordinate values ​​FC1-FC3 of the finger in the image can also be detected by the sensor 7. In addition, the multiple three-dimensional coordinate values ​​FC1-FC3 of the finger are multiple three-dimensional coordinate values ​​in a period of time.

[0064] The controller 11 of the electronic device 1 can determine the second three-dimensional coordinate values ​​G2C1'-G2C3' of the second image information G2 according to the multiple three-dimensional coordinate values ​​FC1-FC3 of the finger and the multiple first three-dimensional coordinate values ​​G2C1-G2C3 of the second image information G2, and further determine the action or deformation state of the second image information G2.

[0065] See also Figure 8 as well as Fig. 9 , Figure 8 and Fig. 9 It is a schematic diagram of the interaction between the second image information and an object.

[0066] The three-dimensional second image information G2-1-G2-3 is a group of whack-a-mole images, and the user can use the prop Tool to hit the multiple three-dimensional second image information G2-1-G2-3. At this time, the controller 11 of the electronic device 1 can calculate based on the multiple three-dimensional coordinate values ​​TC1-TC3 of the prop Tool and the multiple first three-dimensional coordinate values ​​G2-1C1-G2-1C3 of the three-dimensional second image information G2-1 to determine the action of the second image information G2-1 and the multiple second three-dimensional coordinate values ​​G2-1C1'-G2-1C3' of the second image information G2-1.

[0067] See also Fig.10 as well as Fig.11 , Fig.10 It is a schematic diagram showing that the second image information is displayed according to the first entity and the second entity. Fig.11 It is a schematic diagram showing that the second image information is displayed according to the first entity and the second entity.

[0068] exist Fig.10 as well as Fig.11In the embodiment, when the first entity SB1 and the second entity SB2 are set on the second image display device 3, the second image information G2 will be displayed above the second image display device 3. That is, the second image information G2 is associated with the first entity SB1 and the second entity SB2. The sensor 7 can detect the setting positions of the first entity SB1 and the second entity SB2, and then notify the electronic device 1 or the second image display device 3 to provide the second image information G2. The electronic device 1 or the second image display device 3 can detect the electronic tags RD1-RD3 of the first entity SB1 and the second entity SB2 by electronic tags (RFID), light sensing, capacitance sensing, voltage sensing, radar sensing, etc. The sensor 7 can also be an electronic tag sensor, a light sensor, a capacitance sensor, a voltage sensor or a radar sensor.

[0069] Furthermore, the number and form of the first entity SB1 and the second entity SB2 can be adjusted according to actual needs and are not limited in the present invention. In addition, different second image information G2 can be displayed according to the different placement positions of the first entity SB1 and the second entity SB2. Moreover, the electronic device 1 or the second image display device 3 can control the second image information G2 to be active in the first activity area AA1 or other activity areas. That is, the second image information G2 can interact with the first entity SB1 and the second entity SB2 in a storytelling manner.

[0070] [Second embodiment]

[0071] See also Fig.12 , Fig.12 Schematic diagram of an interactive system according to a second embodiment of the present invention. The interactive system SYS2 may only include an electronic device 1 and a three-dimensional image display device 3'. In this embodiment, the structure and function of the electronic device 1 and the three-dimensional image display device 3' are the same as those of the electronic device 1 and the second image display device 3 in the previous embodiment, and are not limited here.

[0072] The electronic device 1 can provide image information to the 3D image display device 3' to display the 3D image information and use an object to interact with the displayed floating 3D image information. Similarly, the interactive system SYS2 also includes a sensor 7, which can be set in the electronic device 1 or the 3D image display device 3'.

[0073] Similarly, the interactive system SYS3 may also include a microphone MP and a speaker SP. The connection module 13 of the electronic device 1 is connected to the microphone MP, the speaker SP, the three-dimensional image display device 3 ′ and the sensor 7 .

[0074] Similarly, in this embodiment, the microphone MP, the speaker SP, the three-dimensional image display device 3 ′ and the sensor 7 may be provided in the same apparatus.

[0075] The microphone MP is used to receive an audio message. When the microphone MP receives a control audio message, the microphone MP transmits the control audio signal to the controller 11 through the connection device CON and the connection module 13 for analysis. The controller 11 further analyzes the control request signal in the control audio message, such as rotation, sitting, and jumping. Then, the controller 11 further controls the action of the three-dimensional second image information G2 displayed on the second image display device 3 according to the control request signal. In this way, the user can interact with the three-dimensional second image information G2 through sound. In addition, the controller 11 can transmit the interactive audio information corresponding to the three-dimensional second image information G2 to the speaker SP for playback, thereby enhancing the user's more comprehensive interactive experience.

[0076] See also Fig.13 , Fig.14 as well as Fig.15 , Fig.13 is another schematic diagram of the interactive system according to the second embodiment of the present invention. Fig.14 is another schematic diagram of the interactive system according to the second embodiment of the present invention. Fig.15 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

[0077] Fig.13 The first electronic device ED1 is a notebook computer. Fig.14 The second electronic device ED2 is a smart phone. Fig.15 The third electronic device ED3 is a tablet computer. Figures 13 to 15 The different first electronic devices ED1, second electronic devices ED2 and third electronic devices ED3 can be connected to the three-dimensional image display apparatus 3' of the present invention to display three-dimensional image information.

[0078] In other embodiments, the electronic devices ED1 - ED3 may also be disposed in the same housing as the three-dimensional image display device 3 ′, or may be disposed together as one electronic device, which is not limited in the present embodiment.

[0079] [Third embodiment]

[0080] See also Fig.16 as well as Fig.17 , Fig.16 is a schematic diagram of an interactive system according to a third embodiment of the present invention. Fig.17 is another schematic diagram of the interactive system according to the third embodiment of the present invention.

[0081] See also Fig.16The three-dimensional image display device 3' may also include an electron beam sensor 37', which can emit an electron beam to the user's hand when the user's hand interacts with the floating three-dimensional image information to interact with the user's hand.

[0082] See also Fig.17 The user can wear an electronic interactive glove, including multiple tactile components (not shown). The electronic interactive glove ECL is connected to the three-dimensional image display device 3' and can receive control signals from the three-dimensional image display device 3', the electronic device ED3 or the server (not shown).

[0083] That is, when the user wears the electronic interactive glove ECL to interact with the floating three-dimensional image information displayed by the three-dimensional image display device 3', the three-dimensional image display device 3', the electronic device ED3 or the server (not shown) can provide multiple control signals to multiple tactile feedback components (not shown) of the electronic interactive glove ECL according to the state of the user's interaction with the floating three-dimensional image information, so as to provide a variety of different tactile sensations to the user. In this embodiment, the tactile feedback component (not shown) is a piezoelectric component.

[0084] [Beneficial Effects of Embodiments]

[0085] One of the beneficial effects of the present invention is that the interactive system provided by the present invention allows users to intuitively interact with three-dimensional image information to generate corresponding actions and changes without having to wear various types of augmented reality electronic devices.

[0086] The contents disclosed above are only preferred feasible embodiments of the present invention, and are not intended to limit the claims of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention's specification and drawings are included in the claims of the present invention.

Claims

1. An interactive system, characterized in that: include: An electronic device includes a controller, a storage module, and a connection module; a first image display device, electrically connected to the electronic device, wherein the first image display device is a one-dimensional image display device, and is used to display one-dimensional image information; a second image display device connected to the electronic device, wherein the second image display device is a three-dimensional image display device; as well as a microphone, receiving a control audio message, the microphone being connected to the controller, and the microphone transmitting the control audio message to the controller; The electronic device is provided with a program, the program at least provides a first image information and a second image information, the controller transmits the first image information to the first image display device for display, the controller transmits the second image information to the second image display device for display, the second image information is displayed as three-dimensional image information of the second image information in a space on one side of the second image display device through the second image display device, the second image information is an image information directly formed on one side of the second image display device by a plurality of light rays, and a user obtains the second image information by viewing with naked eyes; wherein the first image information and the second image information are linked to each other, one or more objects directly contact and interact with the three-dimensional second image information, and the three-dimensional second image information is deformed thereby, when the multiple objects directly contact and interact with the multiple positions of the three-dimensional second image information in multiple directions, the multiple positions of the three-dimensional second image information are calculated based on the three-dimensional second image information and the multiple coordinate values ​​of the multiple objects, and the action or deformation state of the three-dimensional second image information is determined, the three-dimensional second image information that contacts and deforms the multiple objects is not the preset image information, the controller analyzes a control request signal in the audio information, and the controller controls the action of the three-dimensional second image information displayed on the second image display device according to the control request signal; Among them, when a first entity and a second entity are set on the surface of the second image display device, the corresponding second image information is displayed above the second image display device, a sensor detects the respective setting positions of the first entity and the second entity, and the second image display device displays the second image information according to the respective setting positions of the first entity and the second entity. When the sensor detects that the first entity and the second entity are set at different setting positions, the second image display device displays different second image information.

2. The interactive system according to claim 1, characterized in that: The sensor is arranged on the electronic device, the first image display device or the second image display device, and is used to detect at least one three-dimensional coordinate value of the object. The sensor transmits the at least one three-dimensional coordinate value of the object to the controller. The controller determines multiple second three-dimensional coordinate values ​​of the three-dimensional second image information based on the at least one three-dimensional coordinate value of the object and the multiple first three-dimensional coordinate values ​​of the three-dimensional second image information.

3. The interactive system according to claim 2, characterized in that: The first image display device is disposed at one side of the electronic device, and the second image display device is disposed on the electronic device.

4. The interactive system according to claim 3, characterized in that: The second image display device comprises: a flat display module; a lens array layer; and a microstructure layer; Among them, the flat display module has a display surface, the flat display module provides at least one image information, which is displayed through the lens array layer and the microstructure layer. The lens array layer is arranged on the display surface of the flat display module, and receives the light of the image information for adjustment. The lens array layer includes a plurality of lenses, and the lens array layer is used to regulate the light field. The microstructure layer is arranged on the lens array layer, and the microstructure layer includes a plurality of microstructures. The microstructure layer is used to modulate the angle direction of the light. The microstructure layer receives the light that penetrates the lens array layer for adjustment, so that the second image display device displays three-dimensional image information floating in the space on one side of the second image display device.

5. The interactive system according to claim 4, characterized in that: The lenses of the lens array layer conform to the mirror maker's formula: 1 / f=(n-1)(1 / R1+1 / R2), where R1 and R2 are the curvature radii on both sides of the lens, f is the focal length of the lens, and n is the refractive index of the lens.

6. The interactive system according to claim 5, characterized in that: The microstructure layer is a dynamic optical component layer. The microstructure layer has a microstructure function mode and a non-microstructure function mode. When the microstructure layer is switched to the microstructure function mode, it can be used to modulate the angle direction of light.

7. The interactive system according to claim 6, characterized in that: The microstructure layer is a liquid crystal lens array layer, including a plurality of microstructure liquid crystal lenses, and the lens array layer is a liquid crystal lens array layer, including a plurality of optical adjustment liquid crystal lenses.

8. The interactive system according to claim 7, characterized in that: The lens array layer includes a first structure lens array layer and a second structure lens array layer. The first structure lens array layer has a lens structure and can be used to adjust the light field, while the second structure lens array layer does not have a lens structure.

9. The interactive system according to claim 1, wherein: The second image display device further includes an electron beam sensor. The electronic device or the second image display device enables the electron beam sensor to provide an electron beam to the object according to the interaction between the three-dimensional second image information and the object.

10. The interactive system according to claim 1, wherein: The electronic device or the second image display apparatus provides a plurality of control signals to an electronic interactive glove of the object, so that a plurality of tactile feedback components of the electronic interactive glove are activated.

11. An interactive system, characterized in that: include: An electronic device includes a controller, a storage module and a connection module; a three-dimensional image display device, wherein the connection module of the electronic device is connected to the three-dimensional image display device; a sensor, disposed on the electronic device or the three-dimensional image display device, for detecting a plurality of three-dimensional coordinate values ​​of one or more objects; as well as a microphone, receiving a control audio message, the microphone being connected to the controller, and the microphone transmitting the control audio message to the controller; The electronic device is provided with a program, the program is stored in the storage module, the program at least provides image information, the controller transmits the image information to the three-dimensional image display device for display, and the image information is displayed as a three-dimensional image information in a space on one side of the three-dimensional image display device through the three-dimensional image display device; wherein the one or more objects directly contact and interact with the three-dimensional image information, and the three-dimensional image information is calculated based on the three-dimensional image information and multiple coordinate values ​​of the multiple objects to determine the action or deformation state of the three-dimensional image information, and the three-dimensional image information after contacting and deforming with the multiple objects is not the preset image information; wherein the sensor transmits the plurality of three-dimensional coordinate values ​​of the object to the controller, and the controller determines a plurality of second three-dimensional coordinate values ​​of the three-dimensional image information according to the plurality of three-dimensional coordinate values ​​of the object and a plurality of first three-dimensional coordinate values ​​of the three-dimensional image information of the image information; wherein the plurality of second three-dimensional coordinate values ​​of the three-dimensional image information determine an action when the three-dimensional image information interacts with the object; wherein, when the multiple objects directly contact multiple positions of multiple directions of the three-dimensional image information, the multiple positions of the three-dimensional image information are deformed, the controller analyzes a control request signal in the audio information, and the controller controls the action of the three-dimensional image information displayed on the three-dimensional image display device according to the control request signal, the three-dimensional image information is image information directly formed on one side of the three-dimensional image display device by multiple light rays, and a user obtains the three-dimensional image information by viewing with naked eyes; Among them, when a first entity and a second entity are set on the surface of the three-dimensional image display device, the corresponding three-dimensional image information is displayed above the three-dimensional image display device, the sensor detects the respective setting positions of the first entity and the second entity, and the three-dimensional image display device displays the three-dimensional image information according to the respective setting positions of the first entity and the second entity. When the sensor detects that the first entity and the second entity are set at different setting positions, the three-dimensional image display device displays different three-dimensional image information.

12. The interactive system according to claim 11, characterized in that: The three-dimensional image display device further includes an electron beam sensor. The electronic device or the three-dimensional image display device enables the electron beam sensor to provide an electron beam to the object according to the interaction between the three-dimensional image information and the object.

13. The interactive system according to claim 11, characterized in that: The electronic device or the three-dimensional image display device provides a plurality of control signals to an electronic interactive device disposed on the object, so as to enable a plurality of tactile feedback components of the electronic interactive device to operate.

Images