Projection system and projection operation method

Abstract

To provide a projection system and a projection operation method that have a function of changing a face image of a stereoscopic model by voice control and providing various different face images.SOLUTION: In a projection system 100, a projection method includes projecting a face image onto a face projection area of a biological shape housing S by a projection device installed inside the biological shape housing S. The face projection area has translucency and has a curved surface. A controller identifies a voice signal received by a sound collection device. When the controller acquires an identification result, if projection data stored in a storage device includes target projection data corresponding to the identification result, the controller controls the projection device to project the face image based on the target projection data, or if the projection data stored in the storage device does not include the target projection data, the controller controls a communication device to receive the target projection data from an external device, and stores it in the storage device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a projection display technology, and more particularly to a projection system and a projection operation method for projecting a face image onto a face projection area of ​​a bio-shaped housing by a projection device installed inside the housing. [Background technology]

[0002] In general three-dimensional biological models, facial expressions or appearances are all fixed, and they cannot be freely changed or have dynamic display effects. Therefore, if a three-dimensional biological model that allows users to change their facial expressions or appearances as desired and has the function of dynamic / static display can be provided, it will be advantageous to realize a biological model with more vitality and improve the user experience.

[0003] The "Background Art" section is intended to facilitate understanding of the present invention, and the contents disclosed in the "Background Art" may include some configurations other than the prior art known to those skilled in the art. The contents disclosed in the "Background Art" do not imply that the contents or the problems that one or more embodiments of the present invention are intended to solve were already understood or recognized by those skilled in the art prior to the filing of the present invention. Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides a projection system and a projection operation method that have the function of changing the facial image of a three-dimensional model through voice control and providing a variety of different facial images.

[0005] Other objects and advantages of the present invention can be better understood from the technical features disclosed in the present invention.

[0006] In order to achieve one, some or all of the above objects, or other objects, an embodiment of the present invention provides a projection system. The projection system includes a bio-shaped housing, a projection device, a sound collection device, a controller, a communication device, and a storage device. The bio-shaped housing includes a face projection area. The face projection area is translucent and curved. The projection device is disposed inside the bio-shaped housing and projects a face image onto the face projection area. The sound collection device receives an audio signal. The storage device stores a plurality of projection data. The controller is electrically connected to the projection device, the sound collection device, the communication device, and the storage device. The controller identifies the audio signal, and further, when the controller obtains an identification result based on the audio signal, if the projection data includes target projection data corresponding to the identification result, the controller selects target projection data from the projection data and controls the projection device to project the face image based on the target projection data; if the projection data does not include the target projection data, the controller controls the communication device to receive target projection data from an external device, stores the target projection data in the storage device, and the controller controls the projection device to project the face image based on the target projection data.

[0007] In order to achieve one, some or all of the above objects or other objects, an embodiment of the present invention provides a projection operation method for projecting a facial image, the projection operation method including the steps of: receiving an audio signal by an audio collection device; identifying the audio signal by a controller; when the controller obtains an identification result based on the audio signal, if a plurality of projection data stored in the storage device includes target projection data corresponding to the identification result, the controller selects target projection data from the projection data, and if the projection data does not include the target projection data, the controller controls a communication device to receive target projection data from an external device and stores the target projection data in the storage device; and controlling a projection device by the controller to project a facial image onto a facial projection area based on the target projection data, the facial projection area being located in a bio-shaped housing, the facial projection area being translucent and curved, and the projection device being disposed inside the bio-shaped housing.

[0008] From the above, the embodiment of the present invention has at least one of the following advantages or effects: The projection system and projection operation method of the present invention use a sound collection device to obtain an audio signal, and select target projection data to be projected based on the audio signal. If the target projection data is not stored in the projection system, the communication device is used to actively download target projection data corresponding to the audio signal from an external device, and the downloaded target projection data is stored in the storage device. Therefore, the projection system and projection operation method of the present invention have the function of changing the facial image of the three-dimensional model by voice control, and providing a variety of different facial images.

[0009] In order to make the above features and advantages of the present invention more clear and understandable, the following detailed description is given with reference to the accompanying drawings and examples. [Means for solving the problem]

[0010] Other objects and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0011] To achieve one, some or all of the above objects or other objects, an embodiment of the present invention provides:

[0012] In order to make the above features and advantages of the present invention more clear and understandable, the following detailed description is given with reference to the accompanying drawings and examples. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram of a projection system according to one embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of a projection state of the projection system 100 of FIG. [Figure 3A] 1 is a schematic diagram of a face image according to an embodiment of the present invention. [Figure 3B] FIG. 4 is a schematic diagram of a face image according to another embodiment of the present invention. [Figure 4A]FIG. 4 is a schematic diagram of a face image according to yet another embodiment of the present invention. [Figure 4B] FIG. 4 is a schematic diagram of a face image according to yet another embodiment of the present invention. [Diagram 5] 4 is a flowchart of a method for operating a projection system according to one embodiment of the present invention. [Figure 6] 4 is a flowchart of a method of projection operation of a projection system according to another embodiment of the present invention. [Figure 7] 4 is a flowchart of a method of projection operation of a projection system according to another embodiment of the present invention. [Figure 8] 4 is a flowchart of a method of projection operation of a projection system according to another embodiment of the present invention. [Figure 9] 4 is a flowchart of a method of projection operation of a projection system according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The above and other technical contents, features and effects of the present invention will be more clearly described in the following detailed description of preferred embodiments with reference to the drawings. Directional terms mentioned in the following embodiments, such as up, down, left, right, front or rear, are only directions referring to the drawings. Therefore, the directional terms used are for the purpose of explanation only and do not limit the present invention.

[0015] FIG. 1 is a block diagram of a projection system according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of the projection state of the projection system 100 in FIG. 1. Referring to FIG. 1 and FIG. 2 at the same time, the projection system 100 includes at least a bio-shaped housing S, a projection device 110, a sound collection device 120, a controller 130, a storage device 140, and a communication device 150, and the controller 130 is electrically connected to the projection device 110, the sound collection device 120, the communication device 150, and the storage device 140. For simplicity, the sound collection device 120, the controller 130, the storage device 140, and the communication device 150 are not shown in the schematic diagram 2. In order to clearly show the internal elements of the bio-shaped housing S, the bio-shaped housing S is shown with a dashed line. In this embodiment, the appearance of the bio-shaped housing S is in the shape of a human being and includes a human head. In another embodiment, the appearance of the bio-shaped housing S may be the head of an animal or an animated character. The present invention is not limited to the appearance of the bio-shaped housing S.

[0016] To explain further, in Fig. 1, all of the elements 120 to 150 are shown inside the bio-shaped housing S, but this is not essential. In another embodiment, the controller 130, the storage device 140 and the communication device 150 may be disposed on the bottom base of the bio-shaped housing S or outside the bio-shaped housing S, and the projection device 110 and the sound collection device 120 may be connected by wire or wireless communication. Also, the sound collection device 120 may be disposed at any part of the bio-shaped housing S or outside the bio-shaped housing S, and the present invention is not limited thereto.

[0017] Specifically, the controller 130 may be, for example, a central processing unit (CPU), or other programmable general-purpose or dedicated microprocessor, digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), or other similar device, or a combination of the above devices, but the present invention is not limited thereto. The storage device 140 may be, for example, a removable random access memory (RAM), a read-only memory (ROM), a flash memory, or other similar device, or a combination of the above devices. The storage device 140 stores a plurality of projection data, and data or programs to be executed by the projection system 100. The projection data may be a static image or a dynamic image.

[0018] 2, the bio-shaped housing S includes a face projection area PA, i.e., the face projection area PA is located in the bio-shaped housing S. The projection device 110 is installed inside the bio-shaped housing S and projects a face image onto the face projection area PA. The face projection area PA is, for example, located at the head of the bio-shaped housing S, and the face projection area PA has translucency and is a curved surface. For example, the projection device 110 is a rear projection type projection device, and the face projection area PA is a rear projection optical film having a three-dimensional facial contour, as shown in the partially enlarged schematic diagram of FIG. 2.

[0019] The sound collecting device 120 receives a voice signal (voice) generated by a user, for example, a microphone. The controller 130 can identify the voice signal received by the sound collecting device 120. After the controller 130 obtains the identification result based on the voice signal, if the projection data in the storage device 140 includes target projection data corresponding to the identification result, the controller 130 selects target projection data from the projection data, and controls the projection device 110 to project a face image based on the target projection data. If the projection data in the storage device 140 does not include target projection data, the controller 130 controls the communication device 150 to receive target projection data from the external device 200 (shown in FIG. 1) and store the target projection data in the storage device 140. The controller 130 further controls the projection device 110 to project a face image based on the target projection data.

[0020] In detail, the storage device 140 further stores a lookup table. The lookup table can record preset voice commands and correspondingly reproduced projection data. After the controller 130 obtains the voice signal identification result, it can use the lookup table to select the target projection data corresponding to the identification result. The contents of the voice signal include, for example, facial expression, appearance, emotion, or character (role), etc. The facial expression includes, for example, raising eyebrows, frowning, smiling, laughing, crying, etc. The appearance includes, for example, skin color, facial features, gender, etc. The emotion includes, for example, joy, anger, sadness, happiness, etc. The character includes, for example, an anime character or a real human being.

[0021] 3A is a schematic diagram of a face image according to one embodiment of the present invention, and FIG. 3B is a schematic diagram of a face image according to another embodiment of the present invention. In one embodiment, a look-up table records the correspondence between a plurality of facial expression descriptions and a plurality of projection data, as shown in the following table:

[0022] [Table 1] Considering the cost, the capacity of the storage device 140 may be limited, so the storage device 140 does not store all the projection data in the lookup table, for example, only stores the projection data #001, #002, #003, and does not store the projection data #004. In the embodiment of FIG. 3A, after the user issues a command to the sound collection device 120, the controller 130 identifies that the voice signal contains the keyword "smile", and the controller 130 obtains the target projection data #003 using the lookup table. Then, the controller 130 reads the target projection data #003 from the storage device 140, and controls the projection device 110 to project a smiling face image on the face of the bio-shaped housing S according to the target projection data #003. In the embodiment of FIG. 3B, when the user speaks the keyword "laugh" to the sound collection device 120, the controller 130 identifies the voice signal, and uses the lookup table to find that the target projection data is the projection data #004. However, since the target projection data #004 is not stored in the storage device 140, the controller 130 further controls the communication device 150 to connect to the external device 200 via a network and download the projection data #004 from the external device 200. Finally, the controller 130 controls the projection device 110 to project a smiling face image onto the face of the life-shaped housing S based on the target projection data #004.

[0023] Here, the communication device 150 is a wireless communication device supporting various wireless communication standards such as Bluetooth, WiFi, Worldwide Interoperability for Microwave Access (WiMax), Near Field Communication (NFC), Long Term Evolution (LTE), etc., or a wired communication device supporting Ethernet. The external device 200 is an electronic device such as a cloud server or a computer main body. The present invention is not limited thereto.

[0024] Through voice control, the user can change the expression or appearance of the biomorphic housing S as needed. Alternatively, the projection data can be dynamic image data. In one embodiment, the projection system 100 can display the progression of the human body's facial expression change from smiling (as shown in FIG. 3A) to laughing (as shown in FIG. 3B).

[0025] In another embodiment, the projection data stored in the storage device 140 is a facial expression module. The facial expression module may include a variety of different emotional expressions, a variety of pictorial expressions, or a variety of realistic human (real human) expressions of the same character. For example, one facial expression module may include a variety of expressions, such as joy, anger, sadness, and happiness, of the same human character. The controller 130 may replace the facial expression module in the storage device 140 through the communication device 150. For example, the user may change the facial image of the biomorphic housing S through voice control, for example, transforming the character facial image. Or, when the biomorphic housing S originally shows an animated facial image (i.e., pictorial expressions), the user may choose to change the appearance of the biomorphic housing S to a realistic human expression, etc.

[0026] This allows the projection system 100 to present a variety of facial features in the face projection area PA of the biomorphic housing S, even if the storage device 140 has limited capacity, and does not limit the user to only a few options.

[0027] 1, in one embodiment, the projection system 100 further includes a temperature sensing device 160. The temperature sensing device 160 is electrically connected to the controller 130 and senses an environmental temperature. The projection device 110 may include an image processor 112. The controller 130 controls the image processor 112 according to the environmental temperature sensed by the temperature sensing device 160 to adjust the color temperature of the facial image. Specifically, when the environmental temperature is high, the color temperature value corresponding to the adjusted facial image is low, and when the environmental temperature is low, the color temperature value of the adjusted facial image is high.

[0028] 4A and 4B are schematic diagrams of face images according to two other embodiments of the present invention. In the embodiment of FIG. 4A, the controller 130 determines that the environmental temperature is high, so the image processor 112 adjusts the color temperature corresponding to the target projection data to be lower, for example, from 5500K to 5000K, so that the facial color finally shown by the facial projection area PA is shifted to the warmer side. In the embodiment of FIG. 4B, the controller 130 determines that the environmental temperature is low, so the image processor 112 adjusts the color temperature corresponding to the target projection data to be higher, for example, from 5500K to 6000K, so that the facial color finally shown by the facial projection area PA is shifted to the cooler side. In this way, the projection system 100 of this embodiment can actively adjust the color temperature of the facial image according to the environmental temperature, and give people different visual experiences. When the weather is hot, the facial color of the human model becomes red, and when the weather is cold, the facial color of the human model becomes white, so that the human model becomes more realistic.

[0029] In another embodiment, when the environmental temperature is high, the color temperature value corresponding to the adjusted face image is also high, and when the environmental temperature is low, the color temperature value of the adjusted face image is also low. In another embodiment, the controller 130 can adjust the color tone of the target projection data by controlling the image processor 112 according to the environmental temperature. Those skilled in the art can adjust the color tone according to the above teachings and application needs, and the present invention is not limited thereto.

[0030] 5 is a flow chart of a projection scanning method 300 of a projection system according to an embodiment of the present invention. The projection scanning method 300 is applied to the projection system 100. The steps of the projection scanning method 300 will be described below with reference to the element references of the above embodiment.

[0031] In step S310, the projection system 100 receives an audio signal through the sound collection device 120. In step S320, the projection system 100 identifies the audio signal through the controller 130, and in step S330, the projection system 100 obtains an identification result through the controller 130 based on the audio signal. After obtaining the identification result, in step S340, it is determined whether the projection data stored in the storage device 140 includes target projection data corresponding to the identification result. If the projection data in the storage device 140 includes target projection data corresponding to the identification result, it means that the target projection data has already been stored in the storage device 140, and the projection system 100 performs step S350 to select the target projection data from the projection data in the storage device 140 through the controller 130. Specifically, the projection system 100 can select the target projection data corresponding to the identification result using the lookup table. Then, in step S370, the controller 130 controls the projection device 110 to project the face image into the face projection area PA based on the target projection data.

[0032] On the other hand, if the projection data in the storage device 140 does not include the target projection data corresponding to the identification result, it means that the target projection data does not exist in the storage device 140 at this time, and then perform step S360, in which the controller 130 controls the communication device 150 to receive the target projection data corresponding to the identification result from the external device 200, and store the target projection data in the storage device 140. Then, perform step S370, so that the face image can be projected based on the target projection data.

[0033] 6 to 8 are flowcharts of a projection operation method of a projection system according to another embodiment of the present invention. More specifically, FIGS. 6 to 8 show projection operation methods 301 to 303 derived from the projection operation method 300 of FIG. 5, and the same reference numerals denote the same steps, so they will not be repeated here.

[0034] In another embodiment, the controller 130 may not be able to identify the voice signal and may not be able to obtain the identification result, for example, when the background noise is too loud, the controller 130 does not support the language or vocabulary data contained in the identification voice signal, etc. Therefore, as shown in FIG. 6, the projection operation method 301 is derived from the projection operation method 300, and compared with the projection operation method 300, the projection operation method 301 can include steps S332 and S334 performed after receiving the voice signal in step S310 and identifying the voice signal in step S320. In step S332, if the controller 130 cannot obtain the identification result based on the voice signal, the controller 130 then performs step S334, in which the controller 130 controls the projection device 110 to project an error notification image to indicate the identification failure, and informs the user of the identification failure, and may consider providing another voice signal.

[0035] In another embodiment, as shown in Fig. 7, a projection operation method 302 is derived from the projection operation method 300. Compared with the projection operation method 300, the projection operation method 302 can include steps S342 and S344 performed after the steps S310, S320 and S330. As shown in Fig. 7, after obtaining the identification result, if the controller 130 determines in step S342 that the projection data in the storage device 140 does not include the target projection data, before step S360 in which the controller 130 controls the communication device 150 to receive the target projection data from the external device 200 and store the target projection data in the storage device 140, step S344 is performed, in which the controller 130 controls the projection device 110 to project a download request notification image, to inform and alert the user that the data download step will be performed soon.

[0036] In another embodiment, as shown in Fig. 8, a projection operation method 303 is derived from the projection operation method 300, and compared with the projection operation method 300, the projection operation method 303 can include a step S336 performed after the steps S310, S320 and S330. After obtaining the identification result, if it has not yet been determined whether the projection data in the storage device 140 includes the target projection data, as shown in Fig. 8, step S336 is first performed to allow the controller 130 to determine that the content of the audio signal includes a download command, and then steps S360 and S370 are performed. Specifically, for example, if the user knows in advance that the target projection data does not exist in the storage device 140, the user can issue a direct download command (e.g., “download laughing out loud”) to the projection system 100, and the projection system 100 can directly download the target projection data (e.g., the target projection data corresponding to “laughing out loud”) from the external device 200 without first determining in the controller 130 whether the target projection data exists in the storage device 140, thereby saving the controller 130 time in searching for the target projection data.

[0037] 9 is a flow chart of a projection operation method 400 of a projection system according to another embodiment of the present invention. The projection operation method 400 is applied to the projection system 100. Hereinafter, the steps of the projection operation method 300 will be described with reference to the element references of the above embodiment. The projection operation method 400 includes steps S410 and S420. In step S410, the temperature sensing device 160 senses the environmental temperature. Then, in step S420, the image processor 112 adjusts the color temperature of the face image based on the environmental temperature sensed in step S410. Also, the projection operation method 400 may be performed in parallel with the projection operation method 300, and the present invention is not limited thereto.

[0038] Those skilled in the art can understand the implementation details of the projection manipulation methods 300, 301, 302, 303 and 400 with reference to the embodiments of FIGS.

[0039] To sum up, the embodiment of the present invention has at least one of the following advantages or effects: The projection system and projection operation method of the present invention allow the user to easily change the facial image of the bio-shaped housing by issuing a command on the sound collection device. In addition, the function of automatically downloading target projection data from an external device allows the diversification of facial images of the projection system to be realized without consuming memory capacity.

[0040] The above content is only a preferred embodiment of the present invention, and should not be used to limit the scope of the present invention. In other words, all simple and equivalent changes and modifications made based on the claims and the contents of the specification of the present invention belong to the scope of the present invention. In addition, any embodiment or solution of the present invention does not necessarily achieve all the objectives, advantages or features disclosed in the present invention. In addition, the abstract and the title of the invention are used for patent search, and do not limit the scope of the rights of the present invention. In addition, the terms "first", "second", etc. mentioned in the specification or claims indicate the names of elements or distinguish different embodiments or scopes, and do not limit the upper or lower limit of the number of elements. [Explanation of symbols]

[0041] 100 Projection System 110 Projection device 112 Image Processor 120 Sound recording device 130 Controller 140 Storage device 150 Communication Equipment 160 Temperature sensing device 300, 301, 302, 303, 400 Projection operation method S Bio-shaped housing PA Face Projection Area S310, S320, S330, S332, S334, S336, S340, S342, S344, S350, S360, S370, S410, S420 Steps of the projection operation method.

Claims

1. 1. A projection system comprising: The projection system includes a biomorphic housing, a projection device, a sound collection device, a communication device, a storage device, a temperature sensing device, and a controller; the bio-shaped housing includes a face projection area, the face projection area has translucency and is a curved surface; the projection device includes an image processor and is disposed within the bio-shaped housing to project a facial image onto the facial projection area; The audio pickup device receives an audio signal; the storage device stores a plurality of projection data; the controller is electrically connected to the projection device, the sound pickup device, the communication device and the storage device; When the controller identifies the audio signal, and the controller obtains an identification result based on the audio signal, When the plurality of projection data includes target projection data corresponding to the identification result, the controller selects the target projection data from the plurality of projection data, and controls the projection device to project the face image according to the target projection data; or If the plurality of projection data does not include the target projection data, the controller controls the communication device to receive the target projection data from an external device, and stores the target projection data in the storage device, and the controller controls the projection device to project the face image based on the target projection data; the temperature sensing device is electrically connected to the controller and senses an environmental temperature; 4. A projection system, comprising: a controller for controlling the image processor to adjust a color temperature of the facial image based on the environmental temperature.

2. The projection system according to claim 1 , wherein the higher the environmental temperature, the lower the color temperature corresponding to the adjusted face image.

3. the storage device further stores a lookup table; 2. The projection system of claim 1, wherein the controller uses the look-up table to select the target projection data corresponding to the identification result.

4. The projection system of claim 1 , wherein the content of the audio signal includes a facial expression description, an appearance description, an emotional description, or a character.

5. the plurality of projection data are facial expression modules; the controller using the communication device to replace the facial expression module in the storage device; 2. The projection system of claim 1, wherein the facial expression modules include a variety of different emotional expressions of the same character, a plurality of cartoon-style expressions, or a plurality of realistic human expressions.

6. 2. The projection system of claim 1, wherein when the controller cannot obtain the identification result based on the audio signal, the controller controls the projection device to project an error notification image.

7. 2. The projection system according to claim 1, characterized in that, when the controller obtains the identification result based on the audio signal and determines that the target projection data is not included in the plurality of projection data, the controller controls the projection device to project a download request notification image.

8. The projection system of claim 1, characterized in that when the controller obtains the identification result based on the voice signal, and when the controller determines that the content of the voice signal includes a download command, the controller controls the communication device based on the download command, receives the target projection data corresponding to the identification result from the external device, and stores the target projection data in the storage device.

9. A projection operation method for projecting a face image, comprising: The projection operation method includes: A sound pickup device receives an audio signal; a controller identifying the audio signal; When the controller obtains an identification result based on the voice signal, if a plurality of projection data stored in a storage device includes target projection data corresponding to the identification result, the controller selects the target projection data from the plurality of projection data; and if the plurality of projection data does not include the target projection data, the controller controls a communication device to receive the target projection data from an external device, and stores the target projection data in the storage device; the controller controls a projection device to project the face image onto a face projection area based on the target projection data; a temperature sensing device sensing an environmental temperature; and an image processor adjusting a color temperature of the facial image based on the environmental temperature; The face projection area is located on a bio-shaped housing, the face projection area has translucency and is a curved surface, A projection operation method, characterized in that the projection device is installed inside the bio-shaped housing.

10. The projection operation method according to claim 9, further comprising adjusting the color temperature corresponding to the facial image to be lowered when the environmental temperature becomes high.

11. The projection operation method according to claim 9, wherein the content of the audio signal includes a facial expression description, an appearance description, an emotional description or a character.

12. the plurality of projection data are facial expression modules; said communication device replacing said facial expression module in said storage device; 10. The method of claim 9, wherein the facial expression module includes a variety of different emotional expressions of the same character, a plurality of pictorial expressions, or a plurality of realistic human expressions.

13. The projection operation method according to claim 9, characterized in that, when the controller cannot obtain the identification result based on the audio signal, the controller controls the projection device to project an error notification image.

14. The projection operation method of claim 9, characterized in that when the controller obtains the identification result based on the audio signal and determines that the target projection data is not included in the plurality of projection data, the controller controls the communication device to receive the target projection data from the external device, and before the step of storing the target projection data in the storage device, the controller controls the projection device to project a download request notification image.

15. The projection operation method according to claim 9, characterized in that, when the controller obtains the identification result based on the voice signal, and when the controller determines that the content of the voice signal includes a download command, the controller controls the communication device based on the download command, receives the target projection data corresponding to the identification result from the external device, and stores the target projection data in the storage device.

Images