INTERACTIVE PROJECTION SYSTEM AND INTERACTIVE DISPLAY METHOD FOR PROJECTION SYSTEM - Patent application

Abstract

To provide an interactive projection system and an interactive display method of a projection system.SOLUTION: An interactive projection system includes a biological shaped housing, a first projection device and an interactive sensing device disposed inside the biological shaped housing, and a controller. The biological shaped housing includes a light-transmissive curved projection area. The first projection device projects a first physiological image onto the curved projection area. The interactive sensing device obtains an input signal. The controller is electrically connected to the first projection device and the interactive sensing device to identify the input signal and obtain user instructions. The controller controls the first projection device to project a second physiological image to the curved projection area on the basis of user instructions. The first physiological image and the second physiological image display physiological features corresponding to the curved projection area at a position on the biological shaped housing. In the interactive projection system of the present invention and the interactive display method of the projection system, it is possible to change a display appearance of a biological shaped model according to a user's operation and provide a dynamic image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a projection display technology, and in particular to an interactive projection system and an interactive display method for a projection system. [Background technology]

[0002] In the prior art, when a lecturer explains physiological information such as human body organs to students, he or she usually uses a plastic biological model as a teaching aid. However, the color paint on the surface of the plastic biological model is a fixed pattern and cannot show dynamic effects. Some biological models have a removable surface layer or overlapping parts to show physiological anatomical structures, but they need to be removed artificially and the overall content provided is limited. In addition, when a lecturer wants to provide a dynamic display effect to help students understand physiological knowledge more intuitively, they often have no choice but to use a flat display to display flat images. This is very lacking in stereoscopic and realistic effects.

[0003] Therefore, there is a demand in the industry for a three-dimensional biological model that can change the display content in real time according to the instructor's needs during the lesson, and that can provide a dynamic / static display function or generate interesting interactions with users by changing facial expressions.

[0004] The "Background Art" section is intended to facilitate understanding of the present invention, and the contents disclosed in the "Background Art" may include some configurations other than the prior art known to those skilled in the art. The contents disclosed in the "Background Art" do not imply that the contents or the problems that one or more embodiments of the present invention are intended to solve were already understood or recognized by those skilled in the art prior to the filing of the present invention. Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention provides an interactive projection system and an interactive display method for a projection system, in which a biological model can change its display appearance according to user's operation and provide dynamic images. [Means for solving the problem]

[0006] Other objects and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0007] To achieve one, some or all of the above objects or other objects, an embodiment of the present invention provides an interactive projection system. The interactive projection system includes a bio-shaped housing, a first projection device, an interaction sensing device, and a controller. The bio-shaped housing includes a curved projection area, the curved projection area being translucent. The first projection device is disposed inside the bio-shaped housing and projects a first physiological image onto the curved projection area. The interaction sensing device is disposed on the bio-shaped housing and receives an input signal. The controller is electrically connected to the first projection device and the interaction sensing device. The controller identifies the input signal and receives a user command. The controller controls the first projection device according to the user command to project a second physiological image onto the curved projection area. The first physiological image and the second physiological image display physiological characteristics corresponding to the positions of the curved projection area on the bio-shaped housing.

[0008] To achieve one, some or all of the above objects or other objects, an embodiment of the present invention provides an interactive display method for a projection system, the projection system including a bio-shaped housing. The bio-shaped housing includes a curved projection area having light-transmitting properties. The interactive display method includes the following steps: projecting a first physiological image onto the curved projection area by a first projection device disposed inside the bio-shaped housing; obtaining an input signal by an interaction sensing device; identifying the input signal by a controller and obtaining a user command; and controlling the first projection device according to the user command to project a second physiological image onto the curved projection area. The first physiological image and the second physiological image display physiological characteristics corresponding to the positions of the curved projection area in the bio-shaped housing.

[0009] As a result, the embodiments of the present invention have at least one of the following advantages or effects: The interactive projection system and interactive display method of the projection system of the present invention obtain a user command through an interaction sensing device, and change the image projected on the curved projection area of ​​the bio-shaped housing according to the user command, thereby providing a good interaction effect and changing the appearance of the bio-shaped housing according to the needs of the user.

[0010] In order to make the above features and advantages of the present invention more clear and understandable, the following detailed description is given with reference to the accompanying drawings and examples. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram of an interactive projection system according to one embodiment of the present invention. [Diagram 2] 2 is a schematic diagram of the arrangement of components in the interactive projection system 100 of FIG. 1. [Figure 3A] FIG. 2 is a schematic diagram of a first physiological image according to an embodiment of the present invention. [Figure 3B] FIG. 4 is a schematic diagram of a second physiological image according to an embodiment of the present invention. [Figure 3C] FIG. 4 is a schematic diagram of a second physiological image according to another embodiment of the present invention. [Figure 4] 1 is a schematic diagram of an interactive projection system according to another embodiment of the present invention. [Diagram 5] 4 is a flowchart showing an interactive display method of a projection system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The above and other technical contents, features and effects of the present invention will be more clearly described in the detailed description of the preferred embodiments with reference to the following drawings. The directional terms referred to in the following embodiments, such as up, down, left, right, front or rear, are only directions referring to the drawings. Therefore, the directional terms used are for the purpose of explanation only and do not limit the present invention.

[0013] FIG. 1 is a block diagram of an interactive projection system according to an embodiment of the present invention. Referring to FIG. 1, the interactive projection system 100 includes a bio-shaped housing S, a first projection device 110, an interaction sensing device 120, a controller 130, and a storage device 140. FIG. 2 is a schematic diagram of the component arrangement of the interactive projection system 100 of FIG. 1. For simplicity, the controller 130 and the storage device 140 are not shown in FIG. 2. Referring to FIG. 1 and FIG. 2 at the same time, the bio-shaped housing S is shown with a dashed line to clearly show the internal components of the bio-shaped housing S. In this embodiment, the shape of the bio-shaped housing S is a human body shape, including a head and a body, but in another embodiment, the outer shape of the bio-shaped housing S may be a partial human body shape, an organ shape, or an animal shape. The present invention does not limit the outer shape of the bio-shaped housing S.

[0014] For further explanation, in FIG. 1, the controller 130 and the memory device 140 are disposed inside the bio-shaped housing S, but this is not essential. In another embodiment, the controller 130 and the memory device 140 may be disposed on the bottom base of the bio-shaped housing S or outside the bio-shaped housing S, and connected to the first projection device 110 and the interaction sensing device 120 in a wired or wireless manner. The present invention does not limit the number of first projection devices 110 and curved projection areas PA. FIG. 2 shows an example in which the interactive projection system 100 includes two first projection devices 110 (111, 112), which project onto the curved projection areas PA1 and PA2, respectively.

[0015] The biological body S includes at least one curved projection area PA. The curved projection area PA is translucent, and the area of ​​the biological body S other than the curved projection area PA is non-translucent. A first projection device 110 is installed inside the biological body S, and projects a first physiological image onto the curved projection area PA. The first projection device 110 is, for example, a rear projection type projection device, and the curved projection area PA is, for example, a rear projection optical film or optical plate having a three-dimensional curved surface change.

[0016] An interaction sensing device 120 is installed on the bio-shaped housing S to obtain an input signal. In this embodiment, the interaction sensing device 120 is a touch panel, which is disposed outside the curved projection area PA of the bio-shaped housing S and conforms to the contour of the bio-shaped housing S. The interaction sensing device 120 senses a touch operation by a user and generates a corresponding input signal.

[0017] The controller 130 is electrically connected to the first projection device 110, the interaction sensing device 120 and the storage device 140. The controller 130 can receive an input signal from the interaction sensing device 120, identify the input signal, and obtain a user command. Then, the controller 130 controls the first projection device 110 to project a second physiological image onto the curved projection area PA according to the user command. The first physiological image and the second physiological image display physiological features that correspond to the positions of the curved projection area PA on the bio-shaped housing S.

[0018] Specifically, the controller 130 may be, for example, a central processing unit (CPU), or other programmable general-purpose or dedicated microprocessor, digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), or other types of elements or combinations of the above elements, but the present invention is not limited thereto. The memory device 140 may be, for example, a removable random access memory (RAM), a read-only memory (ROM), a flash memory, or similar elements or combinations of the above elements. The memory device 140 stores the first and second physiological images, and other data or programs to be executed by the interactive projection system 100. The first and second physiological images may be static or dynamic images. In another embodiment, the interactive projection system 100 may receive image data of the first physiological image and the second physiological image from outside the bio-shaped housing S, for example, via an interface such as a high-definition multimedia interface (HDMI (registered trademark)), a video graphics array (VGA) interface, a universal serial bus (USB), or a wireless connection method.

[0019] More specifically, the curved projection area PA1 located at the epigastrium of the biological shaped housing S has the undulating curve of a human chest. The device for sensing interaction 120 attached to the outside of the curved projection area PA1 also has the curve of a human chest. The curved projection area PA2 located on the face of the biological shaped housing S has the three-dimensional undulations of a face. The shape of the device for sensing interaction 120 attached to the outside of the curved projection area PA2 also has the contours of facial features.

[0020] 3A is a schematic diagram of a first physiological image according to an embodiment of the present invention, and FIG. 3B is a schematic diagram of a second physiological image according to an embodiment of the present invention. In the embodiment of FIG. 3A and FIG. 3B, the first physiological image is an exterior image of the bio-shaped housing S, and the second physiological image displays the internal physiological features of the bio-shaped housing S. The internal physiological features may be, for example, an organ image, a muscle image, a blood vessel image, or a skeleton image.

[0021] 1, 2, 3A and 3B, the first physiological image projected by the first projection device 111 is a human body skin image, and the first physiological image projected by the first projection device 112 is a face image. Here, when looking at the biological shape housing S, the appearance is a complete human body model (as shown in FIG. 3A). After the user clicks the interaction sensing device 120 on the epigastrium, the controller 130 controls the first projection device 111 according to the touch operation to project the second physiological image. At this time, the display content of the curved projection area PA1 changes from the human body appearance (FIG. 3A) to an organ perspective image (as shown in FIG. 3B), and the second physiological image is an organ image. The controller 130 may also control the first projection device 112 to project different images accordingly. For example, in FIG. 3A, the eyes of the human body model are open, but in FIG. 3B, the eyes of the human body model are closed.

[0022] In short, a user can operate the interactive projection system 100 to easily change the display appearance of a mannequin, for example, from a human body model to a human anatomical mannequin, thus avoiding the traditional need to artificially change the display content by removing and attaching them, or the confusion of using multiple physical mannequins with different appearances.

[0023] In another embodiment, the first physiological image and the second physiological image are different appearance images of the bio-shaped housing S. The controller 130 can change the facial expression or the outer shape of the curved projection area PA. For example, the first physiological image and the second physiological image can be appearance images of different skin colors, ages, races, or images of normal skin and allergic skin. In another embodiment, the first physiological image and the second physiological image respectively display internal physiological features corresponding to different depths of the bio-shaped housing S. For example, the first physiological image is an image of the dermis layer, and the second physiological image is an image of the subcutaneous tissue. Through touch operations, the interactive projection system 100 can reveal the physiological structure of the human body layer by layer. In another embodiment, the first physiological image and the second physiological image display the same organ of the bio-shaped housing S, but the display contents are different. For example, the first physiological image is an image of a normal lung, and the second physiological image is an image of a lung with a different degree of disease, or the first physiological image displays the appearance of the lung, and the second physiological image displays a cross-sectional image of the lung. In another embodiment, the first physiological image and the second physiological image projected by the first projection device 112 display different facial expressions of a human face, and the different facial expressions can be generated by the interaction sensing device 120 to interact with the user. The present invention does not limit the display contents of the first physiological image and the second physiological image.

[0024] In one embodiment, the controller 130 may further enlarge or reduce the first physiological image based on a user command to generate a second physiological image. Figure 3C is a schematic diagram of a second physiological image according to another embodiment of the present invention. Referring to Figures 1, 2, 3B and 3C, the first physiological image is an image of internal organs of a normal human torso, as shown in Figure 3B. After the user clicks on the stomach on the touch panel (interaction sensing device 120) of the curved projection area PA1, the controller 130 controls the first projection device 111 to project the enlarged stomach image as the second physiological image, as shown in Figure 3C.

[0025] The interaction sensing device 120 of the present invention may include an image capturing device or a microphone in addition to using a tactile device. The image capturing device or microphone may be located at any position of the biomorphic housing S, for example, at the head or throat. The present invention is not limited by the type, variety, and location of the interaction sensing device 120.

[0026] In one embodiment, the interaction sensing device 120 is an image capture device, such as a charge coupled device (CCD), a camera, a time-of-flight sensor (TOF sensor), or an optical sensor. The interaction sensing device 120 (e.g., a camera) senses a user's gesture and generates an input signal. The controller 130 identifies the input signal to obtain a user command. Specifically, when the user waves his / her hand to the right, waves his / her hand up, or makes a hand gesture of the number 1 or 2, the controller 130 captures the user's hand gesture image (e.g., captures continuous images of the hand gesture change) through the interaction sensing device 120, and determines based on the hand gesture image that the user wants to change the first projection device 110 to project a second physiological image.

[0027] In one embodiment, the interaction sensing device 120 is a microphone. The interaction sensing device 120 receives the user's voice and generates an input signal. The controller 130 identifies the input signal to obtain the user's command. Specifically, when the user says "zoom in", the interaction sensing device 120 (microphone) receives the user's voice and transmits the input signal to the controller 130, which obtains the user's command (zoom in) through voice identification and enlarges the display image accordingly, for example, as in the embodiment of FIG. 3B and FIG. 3C.

[0028] In one embodiment, the controller 130 may further determine the target physiological structure of the user through the interaction sensing device 120, and mark the target physiological structure in the first physiological image or the second physiological image. For example, when the controller 130 determines that the target physiological structure of the user is the heart based on the user's command, the first projection device 110 may highlight the target physiological structure by changing the color of the heart, flashing the image of the heart, or attaching a special symbol to the heart, to make it clear to other viewers that the current commentary target is the heart. Alternatively, the first projection device 110 may change the projection to include the beating heart, and other organs may remain static images. In another embodiment, the first physiological image may display the appearance of a living organism, and after the user selects the position of the torso where the lungs are located, the second physiological image may display the lungs organs in a perspective view at the position of the lungs, while other parts of the body may maintain their original appearance display.

[0029] In brief, the interaction sensing device 120 can generate an input signal by sensing the user's touch operation, hand gesture, or voice, or a combination thereof, and the controller 130 can determine the user's command based on the input signal, such as the user's touch position, image enlargement or reduction, the target physiological structure to be selected, or the display content to be changed. Through the interaction sensing device 120 and the first projection device 110, the user can change the display content in real time according to the teaching or lecture, and show the dynamic or static pathological analysis or physiological characteristics. The first and second physiological images of the present invention are projected on the surface of the three-dimensional biological shape housing S, and the display content can reflect the physiological structure at the projection position, so that the viewer can more intuitively understand the biological physiological structure, which is advantageous for teaching. In addition, the user can obtain a good interaction effect.

[0030] 4 is a schematic diagram of an interactive projection system according to another embodiment of the present invention. Referring to FIG. 1 and FIG. 4, the interactive projection system 200 is similar to the interactive projection system 100, but the interactive projection system 200 further includes a second projection device 210. The interactive projection system 200 can implement the above-mentioned embodiments in the same manner. The second projection device 210 is installed inside the bio-shaped housing S. The controller 130 controls the second projection device 210 according to a user command to project a third physiological image.

[0031] The bio-shaped housing S further includes a projection aperture O, which is, for example, a hole in the bio-shaped housing S, and corresponds to the size of the image light beam. The second projection device 210 is, for example, a front projection projector. The third physiological image is projected by the projection aperture O onto a display surface P on the outer surface of the bio-shaped housing S, for example, a projection screen or a wall. In FIG. 4, when the user says "external projection" to the microphone (interaction sensing device 120), the controller 130 correspondingly controls the second projection device 210 to project the third physiological image onto the display surface P. The third physiological image may be the display content of the first or second physiological image, or other supplementary data. The user may provide supplementary explanations or display clearer image content with the third physiological image projected by the second projection device 210. The present invention does not limit the display content of the third physiological image.

[0032] It is particularly important to note that the first and second physiological images are projected onto a curved surface, whereas the third physiological image can be projected onto a flat surface, and therefore the first and second physiological images need to be deformed or bent in advance compared to the third physiological image.

[0033] 5 is a flowchart showing an interactive display method for a projection system according to an embodiment of the present invention. The interactive display method 300 can be applied to the interactive projection system 100 and the interactive projection system 200. The steps of the interactive display method 300 will be described below by combining the component reference numbers of the above embodiment.

[0034] In step S310, a first physiological image is projected onto the curved projection area PA by the first projection device 110 installed inside the bio-shaped housing S. In step S320, an input signal is acquired by the interaction sensing device 120. In step S330, the controller 130 identifies the input signal acquired in step S320 and acquires a user command. Finally, in step S340, the controller 130 controls the first projection device 110 according to the user command to project a second physiological image onto the curved projection area PA, and the first physiological image and the second physiological image display physiological features corresponding to the positions in the bio-shaped housing S in the curved projection area PA.

[0035] Implementation details of the interactive display method 300 are omitted here because they are sufficiently suggested, taught or explained from the embodiment shown in FIGS.

[0036] To sum up, the embodiments of the present invention have at least one of the following advantages or effects: The interactive projection system and interactive display method of the projection system of the present invention use an interaction sensing device to sense a user's touch operation, hand gestures, or voice, and change the display content on the curved projection area of ​​the organism-shaped housing, thereby avoiding the confusion of manual conversion by the user and providing a dynamic exhibition effect. In addition, the image projected on the curved projection area corresponds to the physiological characteristics of the corresponding position, allowing the viewer to more intuitively understand the physiological structure of the organism.

[0037] The above is only a preferred embodiment of the present invention, and should not be construed as limiting the scope of the present invention. All simple and equivalent changes and modifications made based on the claims and the contents of the specification of the present invention belong to the scope of the present invention. In addition, any embodiment or claim of the present invention does not necessarily achieve all the objectives, advantages or features of the present invention. In addition, the abstract and the title of the invention are used for patent search, and do not limit the scope of the invention. In addition, the terms "first", "second", etc. mentioned in the specification indicate the names of elements, and do not limit the upper or lower limit of the number of elements. [Explanation of symbols]

[0038] 100, 200 Interactive Projection System 110, 111, 112 First projection device 120 Interaction sensing device 130 Controller 140 Storage device 210 Second projection device 300 Interactive display method S Bio-shaped housing O Projection aperture PA, PA1, PA2 curved projection area P display surface S310~S340 Interactive display steps

Claims

1. 1. An interactive projection system, comprising: the interactive projection system includes a biomorphic enclosure, a first projection device, an interaction sensing device, a controller, and a storage device; the biomorphic housing includes a curved projection area, the curved projection area having optical transparency; The first projection device is disposed inside the bio-shaped housing and projects a first physiological image onto the curved projection area; the interaction sensing device is disposed on the biomorphic enclosure and receives an input signal; the controller is electrically connected to the first projection device and the interaction sensing device, the controller identifies the input signal and obtains a user command; The controller controls the first projection device to project a second physiological image onto the curved projection area according to the user command; the first physiological image and the second physiological image display physiological characteristics whose curved projection regions correspond to positions on the bio-shaped housing; a storage device storing the first physiological image and the second physiological image, the storage device being coupled to the controller; The interactive projection system, characterized in that the first physiological image and the second physiological image are different external images of the bio-shaped housing, or the first physiological image displays an external image of the bio-shaped housing and the second physiological image displays internal physiological features of the bio-shaped housing, or the first physiological image and the second physiological image each display internal physiological features corresponding to different depths of the bio-shaped housing, or the first physiological image and the second physiological image display the same organ of the bio-shaped housing but have different display contents.

2. The interactive projection system of claim 1 , wherein the external shape of the bio-shaped housing is a human body shape, an organ shape, or an animal shape.

3. the interaction sensing device is a touch panel, disposed outside the curved projection area of ​​the bio-shaped housing and conforming to a contour of the bio-shaped housing; The interaction sensing device senses a user's touch operation and generates the input signal; The interactive projection system of claim 1 , wherein the controller identifies the input signal to obtain the user command.

4. the interaction sensing device is an image capture device, the interaction sensing device senses a user's gesture and generates the input signal; The interactive projection system of claim 1 , wherein the controller identifies the input signal to obtain the user command.

5. The interaction sensing device is a microphone, the interaction sensing device receives a user's voice and generates the input signal; The interactive projection system of claim 1 , wherein the controller identifies the input signal to obtain the user command.

6. The interactive projection system of claim 1 , wherein the controller enlarges or reduces the first physiological image to generate the second physiological image based on the user command.

7. An interactive projection system comprising: the interactive projection system includes a biomorphic housing, a first projection device, a second projection device, an interaction sensing device, and a controller; the biomorphic housing includes a curved projection area, the curved projection area having optical transparency; The first projection device is disposed inside the bio-shaped housing and projects a first physiological image onto the curved projection area; the second projection device is disposed within the bio-shaped enclosure, the bio-shaped enclosure including a projection aperture; the interaction sensing device is disposed on the biomorphic enclosure and receives an input signal; the controller is electrically connected to the first projection device and the interaction sensing device, the controller identifies the input signal and obtains a user command, and the controller controls the first projection device to project a second physiological image onto the curved projection area according to the user command; The controller controls the second projection device to project a third physiological image according to the user command; the third physiological image is projected by the projection aperture onto a display surface on an exterior surface of the bio-shaped housing; The first physiological image and the second physiological image display physiological features whose curved projection regions correspond to locations on the bio-shaped enclosure.

8. The interactive projection system of claim 1 , wherein the controller determines a target physiological structure of the user through the interaction sensing device, and marks the target physiological structure in the first physiological image or the second physiological image.

9. 1. A method for interactive display of a projection system, comprising: the projection system includes a bio-shaped enclosure, the bio-shaped enclosure including a curved projection area having optical transparency; The interactive display method includes: projecting a first physiological image onto the curved projection area by a first projection device disposed inside the bio-shaped housing; acquiring an input signal by an interaction sensing device; identifying the input signal by a controller and obtaining a user command; and controlling the first projection device to project a second physiological image onto the curved projection area according to the user command by the controller. the first physiological image and the second physiological image display physiological characteristics whose curved projection regions correspond to positions on the bio-shaped housing; The interactive display method is characterized in that the first physiological image and the second physiological image are different external images of the bio-shaped housing, or the first physiological image displays an external image of the bio-shaped housing and the second physiological image displays internal physiological features of the bio-shaped housing, or the first physiological image and the second physiological image display internal physiological features corresponding to different depths of the bio-shaped housing, or the first physiological image and the second physiological image display the same organ of the bio-shaped housing but have different display contents.

10. The interactive display method according to claim 9, wherein the external shape of the biological shaped case is a human body shape, an organ shape, or an animal shape.

11. The step of the controller controlling the first projection device to project the second physiological image onto the curved projection area according to the user command includes:

10. The interactive display method of claim 9, further comprising the step of: enlarging or reducing the first physiological image to generate the second physiological image based on the user command.

12. A method for interactive display of a projection system, comprising: the projection system includes a bio-shaped enclosure, the bio-shaped enclosure including a curved projection area having optical transparency; The interactive display method includes: projecting a first physiological image onto the curved projection area by a first projection device disposed inside the bio-shaped housing; acquiring an input signal by an interaction sensing device; identifying the input signal by a controller and obtaining a user command; The controller controls the first projection device to project a second physiological image onto the curved projection area according to the user command, and the controller controls a second projection device disposed inside the bio-shaped housing to project a third physiological image according to the user command; the first physiological image and the second physiological image display physiological characteristics whose curved projection regions correspond to positions on the bio-shaped housing; The method of interactive display, wherein the third physiological image is projected onto a display surface on an outer surface of the bio-shaped housing through a projection aperture provided in the bio-shaped housing.

13. The interactive display method further comprises:

10. The interactive display method of claim 9, further comprising the steps of: determining a target physiological structure of a user by the interaction sensing device; and marking the target physiological structure in the first physiological image or the second physiological image.

14. The step of the interaction sensing device acquiring the input signal includes: The interactive display method according to claim 9, further comprising the step of sensing a touch operation, a hand gesture or a voice of a user by the interaction sensing device, and generating the input signal.

Images