Smart space system
By setting up multiple planar projection surfaces and projection devices in the intelligent space system, combined with interactive human-computer interfaces, the problem of discontinuity of image projection is solved, and the user interaction with the image and a better immersion experience is achieved.
Patent Information
- Application Number
- PCT/CN2024/096061
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-29
- Filing Date
- 2024-05-29
- Publication Date
- 2024-12-05
AI Technical Summary
In the existing immersive experience system, discontinuous image projection makes it impossible for users to interact with the image, affecting the immersion and experience effect.
Design an intelligent space system, by setting multiple planar projection surfaces and projection equipment in the cabin, using the controller to project multimedia images on multiple planar projection surfaces to form continuous images, and equipped with interactive human-computer interfaces, including head-wearing Display device and action capture module allow users to interact with images.
It realizes seamless continuous image projection in the cabin, and users can change the translation and rotation of the image through actions, improving the quality and user experience of the immersive experience.
Smart Images

Figure CN2024096061_05122024_PF_FP_ABST
Abstract
Description
Smart Space System Technical Field
[0001] The present invention relates to an intelligent space system. Background Art
[0002] An immersive experience is one that immerses the user in a specific situation. When a user is in a specific space, image projection can transform it into a unique environment, giving the user a sense of being there. However, when images are projected into a specific space, discontinuities often disrupt the user's overall experience. Furthermore, the user's inability to interact with the images further diminishes the immersive experience.
[0003] Summary of the Invention
[0004] The present invention provides an intelligent space system for providing continuous images, and users can interact with the continuous images.
[0005] An intelligent space system according to the present invention comprises: a cabin having a bottom surface; a first screen located on a side wall of the cabin and connected to the bottom surface; and an interactive human-machine interface comprising: a display system having an imaging device configured to project multiple multimedia images onto the first screen; and a controller signal-connected to the interactive human-machine interface for issuing control commands to the interactive human-machine interface to connect the multiple multimedia images to form a first continuous image, so that the images of the first continuous image appear coherent on the first screen.
[0006] In one embodiment of the present invention, the first screen includes: at least two planar projection surfaces, wherein the at least two planar projection surfaces include a first planar projection surface and a second planar projection surface, wherein the bottom of the first planar projection surface is connected to the first side of the bottom surface, wherein the bottom of the second planar projection surface is connected to the second side of the bottom surface connected to the first side, and the second planar projection surface is connected to the first planar projection surface.
[0007] In one embodiment of the present invention, the imaging device includes at least one projection device, which may include a first projection device and a second projection device, wherein the first projection device projects a first multimedia image of the plurality of multimedia images onto the first planar projection surface, and the second projection device projects a second multimedia image of the plurality of multimedia images onto the second planar projection surface, wherein the controller controls the first projection device and the second projection device to connect the first multimedia image and the second multimedia image to form the first continuous image. The at least one projection device may further be a single projection device that simultaneously projects the first planar projection surface and the second planar projection surface to form the first continuous image.
[0008] In one embodiment of the present invention, the at least two planar projection surfaces further include a third planar projection surface, wherein the bottom of the third planar projection surface is connected to the third side connected to the first side of the bottom surface, and the third planar projection surface is connected to the first planar projection surface, wherein the at least one projection device further includes a third projection device, wherein the third projection device projects a third multimedia image of the multiple multimedia images onto the third planar projection surface, wherein the controller controls the first projection device, the second projection device and the third projection device so that the first multimedia image, the second multimedia image and the third multimedia image are connected to form the first continuous image.
[0009] In one embodiment of the present invention, the at least two planar projection surfaces further include a fourth planar projection surface, wherein the bottom of the fourth planar projection surface is connected to the fourth side of the bottom surface, the fourth side is respectively connected to the second side and the third side, and the fourth planar projection surface is respectively connected to the second planar projection surface and the third planar projection surface, wherein the at least one projection device further includes a fourth projection device, wherein the fourth projection device projects a fourth multimedia image of the multiple multimedia images onto the fourth planar projection surface, wherein the controller controls the first projection device, the second projection device, the third projection device and the fourth projection device so that the first multimedia image, the second multimedia image, the third multimedia image and the fourth multimedia image are connected to form the first continuous image.
[0010] In one embodiment of the present invention, the cabin further includes a second screen located at the bottom of the cabin or the top of the cabin, the second screen being connected to the first screen, wherein the second screen includes a fifth planar projection surface.
[0011] The bottom of the first plane projection surface is connected to the first side of the fifth plane projection surface, wherein the bottom of the second plane projection surface is connected to the second side connected to the first side of the fifth plane projection surface, wherein the at least one projection device includes a fifth projection device, wherein the fifth projection device projects the fifth multimedia image of the multiple multimedia images onto the fifth plane projection surface, wherein the controller controls the first projection device, the second projection device and the fifth projection device so that the first multimedia image, the second multimedia image and the fifth multimedia image are connected to form a second continuous image, so that the pictures of the second continuous image appear coherent on the first screen and the second screen.
[0012] In one embodiment of the present invention, the fourth continuous image can move in the first screen and the second screen along a first direction perpendicular to the normal of the bottom surface, move along a second direction perpendicular to the normal and perpendicular to the first direction, move along a third direction parallel to the normal, or rotate along the first direction, the second direction, or the third direction respectively.
[0013] In one embodiment of the present invention, the first screen includes: a curved projection surface, wherein the bottom of the curved projection surface is connected to the first side of the bottom surface.
[0014] In one embodiment of the present invention, the first screen includes: a full-annular projection surface, wherein the bottom of the full-annular projection surface is connected to the side of the bottom surface.
[0015] In one embodiment of the present invention, the material of the first screen includes glass, glass with adjustable transparency, wood, and metal.
[0016] In one embodiment of the present invention, a portion of the at least one projection device is disposed on the first screen.
[0017] In one embodiment of the present invention, a portion of the at least one projection device is disposed on at least one of the at least two planar projection surfaces.
[0018] In one embodiment of the present invention, the interactive human-machine interface further includes: a head-mounted display device including functions of augmented reality, mixed reality, virtual reality, or a combination thereof.
[0019] In one embodiment of the present invention, the interactive human-machine interface further includes: at least one first lens module, disposed in the cabin and signal-connected to the controller, for tracking the position of the head-mounted display device.
[0020] In one embodiment of the present invention, the interactive human-computer interface further includes: a motion capture module for capturing the movement trajectory of the target to generate a motion capture result. The motion capture module transmits the motion capture result signal to the controller, and the controller changes the multiple multimedia images of the imaging device according to the motion capture result.
[0021] In one embodiment of the present invention, the motion capture module includes: at least one millimeter wave radar or at least one camera.
[0022] In one embodiment of the present invention, the controller includes: a communication device for communicating with the interactive human-machine interface and the Internet; a processor electrically connected to the communication device to provide the cabin with the function of connecting to the Internet; a cloud central processing system communicatively connected to the processor, wherein the cloud central processing system determines the content of the multiple multimedia images according to the instructions of the processor, and transmits the multiple multimedia images to the display system via the communication device.
[0023] In one embodiment of the present invention, the cabin further includes: a desktop connected to the bottom surface or the first screen, wherein the desktop is electrically connected to the controller for inputting instructions to the controller to change the state of the controller.
[0024] Based on the above, the smart space system provided by the present invention can form a seamless continuous image across multiple side walls and the bottom surface of the chamber. Users can also interact with the continuous image, for example, by causing the continuous image to translate or rotate with user actions, providing a better user experience within this smart space system. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] FIG1 is a block diagram of a smart space system according to an embodiment of the present invention.
[0026] 2 to 11 are schematic diagrams of a smart space system according to an embodiment of the present invention. DETAILED DESCRIPTION
[0027] FIG1 is a block diagram of an intelligent space system according to an embodiment of the present invention. As shown in FIG1 , an intelligent space system 1 includes a cabin 100 , an interactive human-machine interface 200 , and a controller 300 .
[0028] A cabin 100 includes a bottom surface and a first screen. The details of these devices will be described in the following paragraphs.
[0029] The interactive human-machine interface 200 includes: a display system 210 having an imaging device 220, wherein the imaging device 220 is used to project a plurality of multimedia images onto a first screen. The details of these devices will be described in the following paragraphs.
[0030] The interactive human-machine interface 200 further includes a projection device 230, a head-mounted display device 260, at least one first lens module 270, and a motion capture module 280. The details of these devices will be described in the following paragraphs.
[0031] The controller 300 is signal-connected to the interactive human-machine interface 200 to issue control commands to the interactive human-machine interface 200, thereby connecting multiple multimedia images to form a first continuous image, so that the images of the first continuous image appear coherently on the first screen. Specifically, the controller 300 includes a communication device 310, a processor 320, and a cloud-based central processing system 330. The details of these devices will be described in the following paragraphs.
[0032] Figure 2 is a schematic diagram of a smart space system according to an embodiment of the present invention. As shown in Figure 2, cavity 100 is a space comprising sidewalls 101, 102, 103, 104, a bottom surface 105, and a top surface 106. In this embodiment, bottom surface 105 is a rectangle, but bottom surface 105 may also have other shapes, such as a polygon, a polygon with one or more curved sides, or other suitable shapes, and the present disclosure is not limited thereto. In this embodiment, the bottoms of sidewalls 101, 102, 103, and 104 are respectively connected to the corresponding sides of bottom surface 105, and the tops of sidewalls 101, 102, 103, and 104 are respectively connected to the corresponding sides of top surface 106.
[0033] FIG3 is a schematic diagram of a smart space system according to an embodiment of the present invention. As shown in FIG3 , FIG3 shows a partial structure of a cavity 100 , including sidewalls 101 , 102 , 103 , a bottom surface 105 , and a top surface 106 of the cavity 100 .
[0034] The first screen 110 is located on a side wall of the cabin 100 and is connected to the bottom surface 105. Specifically, the first screen 110 includes at least two planar projection surfaces. In the embodiment shown in FIG3 , the at least two planar projection surfaces include a first planar projection surface 110A and a second planar projection surface 110B.
[0035] As shown in FIG3 , first planar projection surface 110A is located on sidewall 101. Specifically, first planar projection surface 110A is located on the surface of sidewall 101 located inside cavity 100. The bottom of first planar projection surface 110A is connected to first side 105A of bottom surface 105. In other words, first planar projection surface 110A extends downward to bottom surface 105.
[0036] As shown in FIG3 , second planar projected surface 110B is located on sidewall 102 connected to sidewall 101. Specifically, second planar projected surface 110B is located on the surface of sidewall 102 located inside cavity 100. The bottom of second planar projected surface 120A is connected to second side 105B connected to first side 105A of bottom surface 105. In other words, second planar projected surface 110B extends downward to bottom surface 105. Furthermore, second planar projected surface 110B is connected to first planar projected surface 110A.
[0037] As shown in Figure 3, the cavity 100 further includes an imaging device 220. The imaging device 220 includes at least one projection device 230 for projecting multimedia images onto multiple planar projection surfaces of the first screen.
[0038] As shown in FIG3 , the projection device 230 includes a first projection device 230A and a second projection device 230B, corresponding to the first planar projection surface 110A and the second planar projection surface 110B, respectively. In the embodiment shown in FIG3 , the first projection device 230A and the second projection device 230B are disposed on the top surface 106 to avoid interfering with the images projected on the first planar projection surface 110A and the second planar projection surface 110B. In other embodiments, the first projection device 230A and the second projection device 230B may be disposed at other suitable locations. For example, the first projection device 230A may be disposed at the top of the side surface 101 and the second projection device 230B may be disposed at the top of the side surface 102 , projecting downward onto the first planar projection surface 110A and the second planar projection surface 110B, respectively. In other embodiments, the first projection device 230A may project downward onto the first planar projection surface 110A and the second planar projection surface 110B, and the second projection device 230B may additionally project downward onto the second planar projection surface 110B. In some embodiments, the projection device 230 may be a projector, a short-throw projector, or a projector having similar functions, but the present disclosure is not limited thereto.
[0039] Multimedia image 240 may include multiple parts, such as a first multimedia image 240A and a second multimedia image 240B. First projection device 230A projects first multimedia image 240A onto first planar projection surface 110A, while second projection device 230B projects second multimedia image 240B onto second planar projection surface 110B. In some embodiments, multimedia image 240 may be a video, an image, or one or more of a multimedia image, but the present disclosure is not limited thereto.
[0040] When the first projection device 230A projects the first multimedia image 240A onto the first planar projection surface 110A and the second projection device 230B projects the second multimedia image 240B onto the second planar projection surface 110B, the first multimedia image 240A and the second multimedia image 240B may be independent multimedia images, resulting in image discontinuity between the first multimedia image 240A and the second multimedia image 240B.
[0041] Therefore, the controller 300 controls the first projection device 230A and the second projection device 230B to connect the first multimedia image 240A and the second multimedia image 240B to form the continuous image 250A, so that the images of the continuous image 250A appear coherent.
[0042] In another embodiment, the first projection device 230A projects the first multimedia image 240A of the multimedia image 240 onto the first planar projection surface 110A and the second planar projection surface 110B, and the second projection device 230B projects the second multimedia image 240B of the multimedia image 240 onto the second planar projection surface 110B. In other words, the first multimedia image 240A can span both the first planar projection surface 110A and the second planar projection surface 110B.
[0043] When the first projection device 230A projects the first multimedia image 240A onto the first planar projection surface 110A and the second planar projection surface 110B, and the second projection device 230B projects the second multimedia image 240B onto the second planar projection surface 110B, the first multimedia image 240A and the second multimedia image 240B can be connected into one multimedia image, or they can be independent multimedia images, resulting in image discontinuity between the first multimedia image 240A and the second multimedia image 240B.
[0044] Therefore, the controller 300 controls the first projection device 230A to connect the first multimedia image 240A between the first plane projection surface 110A and the second plane projection surface 110B, so that the first multimedia image 240A and the second multimedia image 240B are connected on the second plane projection surface 110B to form a continuous image 250A, so that the picture of the continuous image 250A appears coherent.
[0045] Specifically, the controller 300 is connected to the first and second projection devices 230A, 230B via a communication device 310. In some embodiments, the communication device 310 can connect to the first and second projection devices 230A, 230B via a wired network, wireless network, Bluetooth communication, or other similar means to control the transmission of multimedia images to the first and second projection devices 230A, 230B. The communication device 310 can also be connected to the Internet to receive commands from external devices or transmit executed results to external devices. The external device can be a desktop computer, laptop computer, tablet computer, smartphone, or other input device with similar functionality.
[0046] The controller 300 further includes a processor 320 and a cloud central processing system 330. The processor 320 is electrically connected to the communication device 310 and the cloud central processing system 330. By linking with the communication device 310, the processor 320 can provide a function of connecting the cabin 100 to the Internet.
[0047] In addition, the processor 320 can issue instructions to the cloud central processing system 330 by linking with the communication device 310 and the cloud central processing system 330. The cloud central processing system 330 determines the content of the multiple multimedia images 240 based on the instructions of the processor 320, and transmits the multiple multimedia images 240 to the display system 210 via the communication device 310. The multiple multimedia images 240 are projected onto the first planar projection surface 110A and the second planar projection surface 110B via the first projection device 230A and the second projection device 230B, and the multimedia images are merged into a continuous image 250A.
[0048] In some embodiments, the processor 320 may be a central processing unit (CPU), a microprocessor, or a component having similar functions. In some embodiments, the cloud central processing system 330 may be a cloud server, wherein the cloud server stores a large amount of multimedia images or can access a large amount of multimedia images via the Internet.
[0049] By forming the continuous image 250A, the user in the cabin 100 can see the continuous image 250A composed of the second multimedia image 240B and the first multimedia image 240A, which sequentially spans the second plane projection surface 110B located on the side wall 102 and the first plane projection surface 110A of the side wall 101, allowing the user to see a larger and more continuous multimedia image, thereby creating a better user experience.
[0050] Figure 4 is a schematic diagram of a smart space system according to an embodiment of the present invention. The cavity 100 shown in Figure 4 is similar to that in Figure 3 , and therefore, the similarities are not repeated here. Compared to Figure 3 , in the embodiment shown in Figure 4 , the at least two planar projection surfaces include, in addition to the first planar projection surface 110A and the second planar projection surface 110B, a third planar projection surface 110C.
[0051] As shown in FIG4 , third planar projected surface 110C is located on sidewall 103. Specifically, third planar projected surface 110C is located on the surface of sidewall 103 located inside cavity 100. The bottom of third planar projected surface 110C is connected to third side 105C, which is connected to first side 105A of bottom surface 105. In other words, third planar projected surface 110C extends downward to bottom surface 105. Furthermore, third planar projected surface 110C is connected to first planar projected surface 110A.
[0052] As shown in FIG4 , the projection device 230 includes, in addition to the first projection device 230A and the second projection device 230B, a third projection device 230C corresponding to the third planar projection surface 110C. In the embodiment shown in FIG4 , the third projection device 230C is disposed on the top surface 106 to avoid interfering with the image projected on the third planar projection surface 110C. In other embodiments, the third projection device 230C may be disposed in other suitable locations. For example, the third projection device 230C may be disposed on the top of the side surface 103 and project downward onto the third planar projection surface 110C.
[0053] 4 , the multimedia image 240 may include multiple parts, such as a third multimedia image 240C in addition to the first multimedia image 240A and the second multimedia image 240B. The third projection device 230C projects the third multimedia image 240C of the multimedia image 240 onto the third planar projection surface 110C.
[0054] When the first projection device 230A projects the first multimedia image 240A onto the first planar projection surface 110A, the second projection device 230B projects the second multimedia image 240B onto the second planar projection surface 110B, and the third projection device 230C projects the third multimedia image 240C onto the third planar projection surface 110C, the first multimedia image 240A, the second multimedia image 240B, and the third multimedia image 240C may be independent multimedia images, resulting in image discontinuity between the first multimedia image 240A, the second multimedia image 240B, and the third multimedia image 240C.
[0055] Therefore, the controller 300 controls the first projection device 230A, the second projection device 230B, and the third projection device 230C to connect the first multimedia image 240A, the second multimedia image 240B, and the third multimedia image 240C to form a continuous image 250B, so that the images of the continuous image 250B appear coherent. By forming the continuous image 250B, the user in the cabin 100 can see the continuous image 250B, which is composed of the second multimedia image 240B, the first multimedia image 240A, and the third multimedia image 240C, and which sequentially spans the second planar projection surface 110B on the side wall 102, the first planar projection surface 110A on the side wall 101, and the third planar projection surface 110C on the side wall 103. This allows the user to see a larger and more continuous multimedia image, thereby providing a better user experience.
[0056] 4 , the continuous image 250C sequentially surrounds the side walls 102, 101, and 103 of the cabin 100. Therefore, when a user stands in the cabin 100 and faces the side wall 101, the continuous image seen by the user will cover more than 180 degrees of the user's viewing angle.
[0057] Figure 5 is a schematic diagram of a smart space system according to an embodiment of the present invention. The cavity 100 shown in Figure 5 is similar to that in Figure 4 , so the common features will not be repeated. Figure 5 is from a different perspective than Figure 4 , and therefore sidewall 101 is not shown. However, the relative positions of sidewall 101, sidewalls 102 and 103, and other components in Figure 5 remain the same as those shown in Figure 4 .
[0058] In the embodiment shown in FIG. 5 , the at least two planar projection surfaces include the first planar projection surface 110A, the second planar projection surface 110B, and the third planar projection surface 110C, and further include a fourth planar projection surface 110D.
[0059] As shown in FIG5 , fourth planar projected surface 110D is located on sidewall 104. Specifically, fourth planar projected surface 110D is located on the surface of sidewall 104 located inside cavity 100. The bottom of fourth planar projected surface 110D is connected to fourth side 105D of bottom surface 105, wherein fourth side 105D is connected to second side 105B and third side 105C, respectively. In other words, fourth planar projected surface 110D extends downward to bottom surface 105. Furthermore, fourth planar projected surface 110D is connected to second planar projected surface 110B and third planar projected surface 110C, respectively.
[0060] As shown in FIG5 , the projection device 230 includes, in addition to the first projection device 230A, the second projection device 230B, and the third projection device 230C, a fourth projection device 230D corresponding to the fourth planar projection surface 110DC. In the embodiment shown in FIG5 , the fourth projection device 230D is disposed on the top surface 106 to avoid interfering with the image projected on the fourth planar projection surface 110D. In other embodiments, the fourth projection device 230D may be disposed in other suitable locations. For example, the fourth projection device 230D may be disposed on the top of the side surface 104 and project downward onto the fourth projection device 230D.
[0061] 5 , the multimedia image 240 may include multiple parts, such as a fourth multimedia image 240D in addition to the first multimedia image 240A, the second multimedia image 240B, and the third multimedia image 240C. The fourth projection device 230D projects the fourth multimedia image 240D of the multimedia image 240 onto the fourth planar projection surface 110D.
[0062] In the embodiments of Figures 3 to 5 , the materials of the first screen 110, i.e., the materials of the first planar projection surface 110A, the second planar projection surface 110B, the third planar projection surface 110C, and the fourth planar projection surface 110D included in the first screen, include glass, glass with adjustable transparency, wood, and metal. In some embodiments, the materials of the first planar projection surface 110A, the second planar projection surface 110B, the third planar projection surface 110C, and the fourth planar projection surface 110D can be the same or different, but the present disclosure is not limited thereto. Therefore, multimedia images can be projected onto the planar projection surfaces of the first screen made of a variety of different materials, adapting to a variety of projection environments.
[0063] When the first projection device 230A projects the first multimedia image 240A onto the first planar projection surface 110A, the second projection device 230B projects the second multimedia image 240B onto the second planar projection surface 110B, the third projection device 230C projects the third multimedia image 240C onto the third planar projection surface 110C, and the fourth projection device 230D projects the fourth multimedia image 240D onto the fourth planar projection surface 110D, the first multimedia image 240A, the second multimedia image 240B, the third multimedia image 240C, and the fourth multimedia image 240C may be independent multimedia images, resulting in image discontinuity between the first multimedia image 240A, the second multimedia image 240B, the third multimedia image 240C, and the fourth multimedia image 240D.
[0064] Therefore, the controller 300 controls the first projection device 230A, the second projection device 230B, the third projection device 230C, and the fourth projection device 230D to connect the first multimedia image 240A, the second multimedia image 240B, the third multimedia image 240C, and the fourth multimedia image 240D to form a continuous image 250C, so that the images of the continuous image 250C appear coherent. By forming the continuous image 250C, the user in the cabin 100 can see the continuous image 250C, which is composed of the second multimedia image 240B, the first multimedia image 240A, the third multimedia image 240C, and the fourth multimedia image 240D, which sequentially spans the second planar projection surface 110B on the side wall 102, the first planar projection surface 110A on the side wall 101, the third planar projection surface 110C on the side wall 103, and the fourth planar projection surface 110D on the side wall 104. This allows the user to see a larger and more continuous multimedia image, thereby providing a better user experience.
[0065] 5 , the continuous image 250C sequentially surrounds all side walls 102 , 101 , 103 , and 104 of the cabin 100 . Therefore, the continuous image 250C can surround the user 360 degrees without interruption.
[0066] In another embodiment, the continuous image provided by the smart space system may extend to the bottom or top surface of the cavity in addition to the side surface of the cavity, thereby creating a more complete continuous image.
[0067] Figure 6 is a schematic diagram of a smart space system according to an embodiment of the present invention. The cavity 100 shown in Figure 6 is similar to that in Figure 3 , and therefore, similarities will not be repeated. Compared to Figure 3 , the embodiment shown in Figure 6 further includes a second screen 120 connected to the first screen 110. In this embodiment, the second screen 120 is located at the bottom 105 of the cavity 100. In other embodiments, the second screen 120 may also be located at the top 106 of the cavity 100, and this disclosure is not limited thereto.
[0068] In the embodiment shown in FIG6 , second screen 120 includes fifth planar projection surface 120A. The bottom of first planar projection surface 110A is connected to first side 105A of fifth planar projection surface 120A, and the bottom of second planar projection surface 110B is connected to second side 105B of fifth planar projection surface 120A, which is connected to first side 105A. In other words, fifth planar projection surface 120A is connected to first planar projection surface 110A and second planar projection surface 110B of the first screen, respectively.
[0069] As shown in FIG6 , the projection device 230 includes, in addition to the first projection device 230A and the second projection device 230B, a fifth projection device 230E corresponding to the fifth planar projection surface 120A. In the embodiment shown in FIG6 , the fifth projection device 230E is disposed on the top surface 106 to avoid interfering with the image projected on the fifth planar projection surface 120A. In other embodiments, the fifth projection device 230E may be disposed in other suitable locations. For example, the fifth projection device 230E may be disposed on the top of any side surface 101, 102, 103, or 104, projecting downward onto the fifth planar projection surface 120A.
[0070] In other embodiments, if the fifth plane projection surface 120A is located on the top surface 106 (not shown), the corresponding fifth projection device 230E can be configured at the bottom of any side surface 101, 102, 103, or 104, and projected upward onto the fifth plane projection surface 120A located on the top surface 106, or configured on the bottom surface 105, without affecting the appropriate position for user movement.
[0071] 6 , the multimedia image 240 may include multiple parts, such as a fifth multimedia image 240E in addition to the first multimedia image 240A and the second multimedia image 240B. The fifth projection device 230E projects the fifth multimedia image 240E of the multimedia image 240 onto the fifth planar projection surface 120A.
[0072] When the first projection device 230A projects the first multimedia image 240A onto the first planar projection surface 110A, the second projection device 230B projects the second multimedia image 240B onto the second planar projection surface 110B, and the fifth projection device 230E projects the fifth multimedia image 240E onto the fifth planar projection surface 120A, the first multimedia image 240A, the second multimedia image 240B, and the fifth multimedia image 240E may be independent multimedia images, resulting in image discontinuity between the first multimedia image 240A, the second multimedia image 240B, and the fifth multimedia image 240E.
[0073] Therefore, the controller 300 controls the first projection device 230A, the second projection device 230B and the fifth projection device 230E to connect the first multimedia image 240A, the second multimedia image 240B and the fifth multimedia image 240E to form a continuous image 250D, so that the picture of the continuous image 250D appears coherent.
[0074] Specifically, the controller 300 controls the first projection device 230A and the second projection device 230B to form a continuous image on the sidewall of the cavity in a manner similar to that shown in FIG3 . The controller 300 then connects this continuous image with the fifth multimedia image 240E on the fifth planar projection surface 120A to form a continuous image 250D.
[0075] By forming a continuous image 250D, the user in the cabin 100 can see the continuous image 250B composed of the second multimedia image 240B, the first multimedia image 240A and the fifth multimedia image 240E, which sequentially spans the second plane projection surface 110B located on the side wall 102, the first plane projection surface 110A of the side wall 101, and the fifth plane projection surface 120A extending to the bottom surface 105. In addition to being able to see the multimedia images located on the side wall, the user can also see continuous images extending to different directions (such as the bottom surface), thereby creating a better user experience.
[0076] In the embodiment shown in FIG6 , without loss of generality, the first screen may also include a first planar projection surface 110A, a second planar projection surface 110B, and a third planar projection surface 110C as shown in FIG4 , or include a first planar projection surface 110A, a second planar projection surface 110B, a third planar projection surface 110C, and a fourth planar projection surface 110D as shown in FIG5 . In both cases, a continuous image can be formed in a manner similar to that shown in FIG6 .
[0077] In the embodiments shown in Figures 2 to 6, each sidewall of the cavity 100 is a plane. However, in other embodiments, at least one sidewall of the cavity may not be a plane.
[0078] Figure 7 is a schematic diagram of a smart space system according to an embodiment of the present invention. Please refer to Figure 7. The cavity 100B shown in Figure 7 is similar to the cavity 100 shown in Figure 2, except that in the cavity 100B shown in Figure 7, the first screen includes a curved projection surface 112, located on a side wall (e.g., side wall 101) corresponding to the cavity 100 shown in Figure 2. The bottom of the curved projection surface 112 is connected to at least one side edge of the bottom surface 105. Furthermore, corresponding to the curved projection surface 112, the bottom surface 105 and the top surface 106 each have a curved side edge to correspond to the curved projection surface. Therefore, in this embodiment, the first screen can be a variety of curved surfaces. In other embodiments, the first screen can also have more curved projection surfaces, for example, by replacing at least one, two, or all of the side surfaces 102, 103, or 104 of the cavity 100B with curved projection surfaces. This allows the smart space system to be adapted to a wider range of environments and provide a better user experience.
[0079] 7 , the first screen including the curved projection surface 112 of the cavity 100B may also be combined with a second screen located on the bottom surface 105 or the top surface 106 to combine the multimedia images on the first and second screens to form a continuous image.
[0080] FIG8 is a schematic diagram of a smart space system according to an embodiment of the present invention. The cavity 100C shown in FIG8 is similar to the cavity 100 shown in FIG2 , with the difference being that, in the cavity 100C shown in FIG8 , the first screen 110 includes an annular projection surface 114, wherein the bottom of the annular projection surface 114 is connected to the side of the bottom surface 105. Specifically, the annular projection surface 114 is located at the side walls 101, 102, 103, and 104 corresponding to the cavity 100 shown in FIG2 . The bottom of the annular projection surface 114 is connected to the side of the bottom surface 105. Therefore, in this embodiment, the first screen can be a variety of curved surfaces, so that the smart space system can be applied to more shaped environments to produce a better user experience.
[0081] 8 , the first screen including the annular projection surface 114 of the cavity 100C may also be combined with a second screen located on the bottom surface 105 or the top surface 106 to combine the multimedia images on the first and second screens to form a continuous image.
[0082] In the embodiments shown in Figures 3 to 6 , the cavity 100 includes an imaging device 220. The imaging device 220 includes at least one projection device (e.g., projection devices 230A, 230B, 230C, and 230D) for projecting multimedia images onto multiple planar projection surfaces (e.g., planar projection surfaces 110A, 110B, 110C, and 110D) of a first screen. To provide a better user experience, the projection device must be appropriately positioned.
[0083] FIG9 is a schematic diagram of a smart space system according to an embodiment of the present invention. Please refer to FIG9 . Without loss of generality, FIG9 uses the first projection device 230A and the first planar projection surface 110A as an example, but is also applicable to other projection devices 230B, 230C, and 230D.
[0084] As shown in Figure 9, Figure 9 is a side view of the sidewall 101 of the chamber 100. The sidewall 101 is connected to the bottom surface 105. Unlike Figures 3 to 6, in this embodiment, the first projection device 230A is located on the top of the sidewall 101 and projects downward, projecting multimedia images onto a first planar projection surface 110A located on the sidewall 101 inside the chamber 100. In other words, the first projection device 230A is located inside the chamber 100 and can project directly onto the first planar projection surface 110A. The first projection device 230A is also located on at least one of the at least two planar projection surfaces of the first screen 110, namely, the first planar projection surface 110A. This reduces the distance between the projection devices 230A, thereby minimizing external interference when the projection devices 230A project multimedia images onto the first planar projection surface 110A.
[0085] The smart space system disclosed herein not only forms continuous multimedia images on the first and second screens formed by the side walls and / or bottom (or top) surfaces, but can also interact with users to create a better user experience.
[0086] FIG10 is a schematic diagram of a smart space system according to an embodiment of the present invention. Please refer to FIG10 . The interactive human-machine interface 200 further includes a head-mounted display device 260 , a first lens module 270 , and a motion capture module 280 .
[0087] A head-mounted display device 260 is worn by a user within cavity 100. Head-mounted display device 260 can generate various images, such as augmented reality, mixed reality, virtual reality, or a combination thereof. In some embodiments, head-mounted display device 260 can be a helmet-mounted display, a glasses-mounted display, or other similar devices, although this disclosure is not limited thereto. The virtual images generated by head-mounted display device 260 are combined with the continuous images displayed within cavity 100 to enhance the user experience.
[0088] The interactive human-machine interface 200 includes multiple first lens modules 270 disposed within the chamber 100 and connected to the controller 300 via signals to track the position of the head-mounted display device 260. As shown in FIG10 , the chamber 100 includes multiple first lens modules 270, disposed on sidewalls 101, 102, 103, and 104 (not shown). In some embodiments, the number of first lens modules 270 is greater than or equal to one, and the number of first lens modules 270 depends on actual needs. Because the user can move freely within the chamber 100 while wearing the head-mounted display device 260, after the first lens module 270 captures an image of the head-mounted display device 260, it can transmit the image to the controller 300 to calculate the precise position of the head-mounted display device 260 (i.e., the user) within the chamber. The controller 300 can also change the continuous images displayed on the first and second screens according to the position of the head-mounted display device 260.
[0089] The multiple motion capture modules 280 of the interactive human-machine interface 200 are arranged in the cabin 100 and are connected to the controller 300 by signal to track the user's movements, such as the user's hand movements, but are not limited to this. As shown in Figure 10, the cavity 100 includes multiple motion capture modules 280, which are respectively arranged on the side walls 101, 102, 103 and 104 (not shown). In some embodiments, the number of motion capture modules 280 is greater than or equal to 1, and the number of motion capture modules 280 depends on actual needs. In some embodiments, the motion capture module 280 can be a millimeter wave radar or a camera, and the camera can be a visible light camera or an invisible light camera, or one with similar functions, but the present disclosure is not limited to this.
[0090] Since the user can move freely in the cavity 100 and can interact with the images based on the continuous images viewed, when the motion capture module 280 captures the user's movements, it is used to capture the target's movement trajectory, such as intercepting the movement trajectory of the user's hand, to generate a motion capture result. The motion capture module 280 transmits the motion capture result signal to the controller 300. The controller 300 changes the multiple multimedia images 240 of the imaging device 220 according to the motion capture result, and changes the continuous images displayed on the first screen and the second screen accordingly. For example, if the continuous image is based on a library scene, the continuous image displayed on the first screen and the second screen can be changed accordingly according to the hand movements captured by the motion capture module 280, such as generating actions such as turning pages of a book or picking up a book.
[0091] On the other hand, the controller 300 can move or rotate the continuous image on the first screen and / or the second screen based on the motion capture signal detected by the motion capture module 280. Taking FIG6 as an example, the continuous image 250D can be moved on the first screen 110 and the second screen 120 along a first direction X perpendicular to the normal of the bottom surface 105, along a second direction Y perpendicular to the normal of the bottom surface 105 and perpendicular to the first direction X, along a third direction Z parallel to the normal of the bottom surface 105, or rotated along the first direction, the second direction, or the third direction, respectively, to adjust the viewing angle between the user and the continuous image and enhance the user experience.
[0092] FIG11 is a schematic diagram of a smart space system according to an embodiment of the present invention. Referring to FIG11 , the cavity 100 further includes a desktop 130. The desktop 130 is located inside the cavity 100 and is connected to the bottom surface 105 or the first screen. The desktop 130 can be a foldable desktop or a fixed desktop. The desktop 130 is electrically connected to the processor 320 of the controller 300 through a port (not shown) located on the bottom surface 105 or on the first screen. The user can use the desktop 130 to input instructions to the processor 320 in the controller 300 to change the state of the controller 300 or to view the state of the controller 300. The desktop 130 may include a display and an input device, or may be connected to a desktop computer, a laptop computer, a tablet computer, or other devices in an external manner, but the present disclosure is not limited thereto.
[0093] In summary, the smart space system provided by the present invention can form a seamless, continuous image across multiple sidewalls and the bottom surface of a chamber. Users can also interact with the continuous image, for example, by causing it to translate or rotate with their movements, providing a better user experience within this smart space system.
Claims
1. An intelligent space system, characterized in that: include: Cabin, including: bottom surface; A first screen, located on a side wall of the cabin and connected to the bottom surface; and Interactive human-machine interface, including: A display system having an imaging device, wherein the imaging device is used to project a plurality of multimedia images onto the first screen; and The controller is connected to the interactive human-machine interface signal to issue a control command to the interactive human-machine interface to connect the multiple multimedia images to form a first continuous image, so that the pictures of the first continuous image are presented continuously on the first screen.
2. The smart space system according to claim 1, characterized in that: The first screen comprises: at least two planar projection surfaces, wherein the at least two planar projection surfaces comprise a first planar projection surface and a second planar projection surface, wherein the bottom of the first planar projection surface is connected to the first side of the bottom surface, The bottom of the second plane projection surface is connected to the second side of the bottom surface connected to the first side, and the second plane projection surface is connected to the first plane projection surface.
3. The intelligent space system according to claim 2, characterized in that: The imaging device comprises at least one projection device, wherein the at least one projection device comprises at least a first projection device and a second projection device. The first projection device may project a first multimedia image of the plurality of multimedia images onto the first planar projection surface and the second planar projection surface, and the second projection device may project a second multimedia image of the plurality of multimedia images onto the second planar projection surface. The controller controls the first projection device and the second projection device to connect the first multimedia image with the second multimedia image to form the first continuous image.
4. The intelligent space system according to claim 3, characterized in that: wherein the at least two planar projection surfaces further include a third planar projection surface, The bottom of the third plane projection surface is connected to the third side of the bottom surface connected to the first side, and the third plane projection surface is connected to the first plane projection surface. wherein the at least one projection device further comprises a third projection device, wherein the third projection device projects a third multimedia image of the plurality of multimedia images onto the third planar projection surface, The controller controls the first projection device, the second projection device and the third projection device to connect the first multimedia image, the second multimedia image and the third multimedia image to form the first continuous image.
5. The smart space system according to claim 4, characterized in that: wherein the at least two planar projection surfaces further include a fourth planar projection surface, The bottom of the fourth plane projection surface is connected to the fourth side of the bottom surface, the fourth side is respectively connected to the second side and the third side, and the fourth plane projection surface is respectively connected to the second plane projection surface and the third plane projection surface. wherein the at least one projection device further comprises a fourth projection device, wherein the fourth projection device projects a fourth multimedia image of the plurality of multimedia images onto the fourth planar projection surface, The controller controls the first projection device, the second projection device, the third projection device and the fourth projection device to connect the first multimedia image, the second multimedia image, the third multimedia image and the fourth multimedia image to form the first continuous image.
6. The smart space system according to claim 4, characterized in that: The cabin further includes a second screen located at the bottom of the cabin or the top of the cabin, and the second screen is connected to the first screen. wherein the second screen comprises a fifth planar projection surface, The bottom of the first plane projection surface is connected to the first side of the fifth plane projection surface. wherein the bottom of the second plane projection surface is connected to the second side of the fifth plane projection surface connected to the first side, wherein the at least one projection device comprises a fifth projection device, wherein the fifth projection device projects a fifth multimedia image of the plurality of multimedia images onto the fifth planar projection surface, The controller controls the first projection device, the second projection device and the fifth projection device to connect the first multimedia image, the second multimedia image and the fifth multimedia image to form a second continuous image, so that the pictures of the second continuous image appear coherently on the first screen and the second screen.
7. The smart space system according to claim 6, characterized in that: The fourth continuous image can move in the first screen and the second screen along a first direction perpendicular to the normal of the bottom surface, along a second direction perpendicular to the normal and perpendicular to the first direction, along a third direction parallel to the normal, or rotate along the first direction, the second direction, or the third direction, respectively.
8. The smart space system according to claim 1, characterized in that: The first screen comprises: a curved projection surface, wherein the bottom of the curved projection surface is connected to the first side of the bottom surface.
9. The smart space system according to claim 1, characterized in that: The first screen comprises: a full annular projection surface, wherein the bottom of the full annular projection surface is connected to the side of the bottom surface.
10. The smart space system according to claim 1, characterized in that: The materials of the first screen include: glass, glass with adjustable transparency, wood and metal.
11. The smart space system according to claim 3, characterized in that: A portion of the at least one projection device is disposed on the first screen.
12. The smart space system according to claim 3, characterized in that: A portion of the at least one projection device is disposed on at least one of the at least two planar projection surfaces.
13. The smart space system according to claim 1, characterized in that: The interactive human-machine interface further comprises: A head mounted display device includes functions of augmented reality, mixed reality, virtual reality, or a combination thereof.
14. The smart space system according to claim 13, characterized in that: The interactive human-machine interface further comprises: At least one first lens module is disposed in the cabin and is signal-connected to the controller for tracking the position of the head-mounted display device.
15. The smart space system according to claim 1, characterized in that: The interactive human-machine interface further comprises: A motion capture module is used to capture the moving track of the target to generate a motion capture result. The motion capture module transmits the motion capture result signal to the controller, and the controller changes the multiple multimedia images of the imaging device according to the motion capture result.
16. The smart space system according to claim 15, characterized in that: The action capture module comprises: At least one millimeter-wave radar or at least one camera.
17. The smart space system according to claim 1, characterized in that: The controller comprises: A communication device for communicating with the interactive human-machine interface and the Internet; A processor, electrically connected to the communication device, providing a function of connecting the cabin to the Internet; A cloud central processing system is communicatively connected to the processor, wherein the cloud central processing system determines the content of the multiple multimedia images according to the instructions of the processor and transmits the multiple multimedia images to the display system via the communication device.
18. The smart space system according to claim 1, characterized in that: The cabin also includes: A desktop is connected to the bottom surface or the first screen, wherein the desktop is electrically connected to the controller for inputting instructions to the controller to change the state of the controller.
Citation Information
Patent Citations
Immersive 5D projection inner cabin
CN113596434A
3D active stereo interactive immersive virtual reality CAVE system
CN114035681A
Virtual perception system and method based on projection
CN115022615A
Universe five-folding-screen interactive display system and method
CN116055706A
Immersive display enclosure
GB201518878D0
