Projection system, terminal device, projection device, and control method therefor

Abstract

To provide a projection system, a terminal device, a projection device, and a control method therefor.SOLUTION: A control method includes the following steps of: sending an original instruction from a terminal device to a cloud server; inputting the original instruction into a natural language model through the cloud server; if the original instruction corresponds to an operation of a projection device, generating a standard instruction based on the original instruction through the natural language model, receiving the standard instruction through the cloud server and controlling the projection device on the basis of the standard instruction; and if the original instruction does not correspond to the operation of the projection device, generating feedback information on the basis of the original instruction through the natural language model, and sending the feedback information to at least one of the terminal device and the projection device through the cloud server. A voice control function can be implemented by a projection system, a terminal device, a projection device, and a control method therefor.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a display technology, and more particularly to a projection system, a terminal device, a projection device, and a control method thereof. [Background technology]

[0002] Currently, the method of controlling a projector requires a user to manually operate a remote control for the projector or to operate a man-machine interface on the projector to set up related projection settings, making the conventional method of controlling a projector very inconvenient.

[0003] It should be noted that the "Background Art" section is intended only to aid in understanding the present invention, and therefore the contents disclosed in the "Background Art" section include well-known technologies not known to those skilled in the art. Therefore, the contents disclosed in the "Background Art" section do not imply that the contents or the problems that one or more embodiments of the present invention are intended to solve were already known to those skilled in the art prior to the filing of the present invention. Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides a projection system, a terminal device, a projection device, and a control method thereof that are capable of implementing a voice control function. [Means for solving the problem]

[0005] Other objects and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0006] In order to achieve some or all of the above objects or other objects, a method for controlling a projection device of the present invention comprises the following steps: a terminal device sends an original command to a cloud server; the cloud server inputs the original command into a natural language processing model; if the original command corresponds to an operation of the projection device, a standard command is generated based on the original command by the natural language processing model, and the standard command is received via the cloud server, and the projection device is controlled based on the standard command; if the original command does not correspond to an operation of the projection device, feedback information is generated based on the original command by the natural language processing model, and the feedback information is sent to at least one of the terminal device and the projection device via the cloud server.

[0007] In order to achieve some or all of the above objects or other objects, the projection system of the present invention includes a projection device, a cloud server, and a terminal device. The terminal device is connected to the cloud server and the projection device, and is used to send an original command to the cloud server. The cloud server inputs the original command into a natural language processing model. If the original command corresponds to an operation of the projection device, the natural language processing model generates a standard command based on the original command, and the cloud server receives the standard command and controls the projection device based on the standard command. If the original command does not correspond to an operation of the projection device, the natural language processing model generates feedback information based on the original command, and at least one of the terminal device and the projection device is used to receive and display the feedback information.

[0008] In order to achieve some or all of the above objects or other objects, the projection device of the present invention comprises a projection module, a processor and a communication interface. The processor is connected to the projection module. The communication interface is connected to the processor and is used for connecting to a cloud server. The processor is configured to perform the following operations: send an original command to the cloud server via the communication interface; receive a projector control code sent from the cloud server via the communication interface if the original command corresponds to an operation of the projection device; and drive the projection module based on the projector control code.

[0009] In order to achieve some or all of the above objects or other objects, a terminal device of the present invention is used for controlling a projection device. The terminal device includes a screen and a processor. The screen is used for displaying a control interface. The processor is connected to the screen. The processor is configured to perform the following operations: receive an original command from the control interface; if the original command corresponds to an operation of the projection device, output a projector control code from the terminal device to the projection device, and drive the projection device to perform the operation corresponding to the projector control code; the projector control code corresponds to the original command and projection device information; if the original command does not correspond to an operation of the projection device, display feedback information via the control interface.

[0010] In this way, the projection system, terminal device, projection device and their control method of the present invention can use a natural language processing model to quickly identify voice commands input by the user, automatically generate corresponding standard commands to control the projection device, and effectively realize voice control functions.

[0011] In order to make the above features and advantages of the present application more clearly comprehensible, specific examples are given below in conjunction with the accompanying drawings for the detailed description. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram of a projection system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of a terminal device according to an embodiment of the present invention. [Diagram 3] FIG. 3 is a flowchart of a projection method in one embodiment of the present invention. [Figure 4] FIG. 4 is a schematic diagram showing communication of a voice control process in one embodiment of the present invention. [Diagram 5]FIG. 5 is a flow chart of the registration and subscription of the voice control process in one embodiment of the present invention. [Figure 6] FIG. 6 is a flow chart of the authentication of a voice control process in one embodiment of the present invention. [Figure 7] FIG. 7 is a schematic diagram of a projection system according to a second embodiment of the present invention. [Figure 8] FIG. 8 is a schematic diagram of a projection system according to a third embodiment of the present invention. [Figure 9] FIG. 9 is a schematic diagram of a projection device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] In view of the above and other technical contents, features and effects of the present application, the preferred embodiments of the present invention will be described in detail with reference to the drawings below. The directional terms (e.g., up, down, left, right, front or back, etc.) mentioned in the following embodiments are merely directions for referring to the attached drawings. Therefore, the directional terms used are intended to explain the present application, and are not intended to limit the present application.

[0014] FIG. 1 is a schematic diagram of a projection system according to a first embodiment of the present invention. Referring to FIG. 1, the projection system 100 includes a terminal device 110, a projection device 120, a cloud server 130, and a natural language processing model 140. The terminal device 110 is connected to the projection device 120 and the cloud server 130. The cloud server 130 is connected to the natural language processing model 140. In this embodiment, the terminal device 110 communicates between the projection device 120 and the cloud server 130 by a wired and / or wireless communication method. The wired communication method is, for example, by a cable. The wireless communication method is, for example, Wifi (registered trademark), Bluetooth (registered trademark), and / or the Internet. The cloud server 130 is connected to the natural language processing model 140 via, for example, the Internet.

[0015] In this embodiment, the terminal device 110 has a voice input function. The terminal device 110 may be, for example, a smartphone, a remote control for the projection device 120, or other portable devices, or an electronic device with a voice input function. The projection device 120 (projector) may be, for example, a communication interface and a projection module. In this embodiment, a user uses the terminal device 110 to perform voice input, input a voice command for controlling the projection device 120, and perform voice recognition and command generation using the terminal device 110, the cloud server 130, and the natural language processing model 140, thereby realizing the function of controlling the projection device 120 by voice.

[0016] In this embodiment, the natural language processing model 140 is, for example, a chatbot. The chatbot is equipped with a machine learning algorithm, and is, for example, a pre-trained chatbot such as Chat Generative Pre-trained Transformer (ChatGPT), Microsoft Bing, Google Bard, or ERNIE Bot, which can generate conversations, or a dedicated chatbot that has learned data in a specific field. The natural language processing model 140 is used to perform natural language processing and understanding, dialogue management, speech-to-text, text-to-speech, etc. The natural language processing model 140 can recognize various languages ​​and accents. In this embodiment, the natural language processing model 140 is installed in the cloud server 130 or a third-party cloud server, and the cloud server 130 and the third-party cloud server each have a processor and a storage device, and the storage device has, for example, a storage medium, and the storage device is used to store a chatbot equipped with a machine learning algorithm, and the processor is used, for example, to execute the algorithm.

[0017] FIG. 2 is a schematic diagram of a terminal device in an embodiment of the present invention. Referring to FIG. 2, the terminal device in each embodiment of the present invention can realize the terminal device 110 as shown in FIG. 2. The terminal device 110 is, for example, a smartphone, a tablet, a personal computer, or other electronic devices. The terminal device 110 includes a processor 111, a screen 112, and a communication interface 113. The processor 111 is connected to the screen 112 and the communication interface 113. In this embodiment, the processor 111 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), other programmable general-purpose or specific-purpose microprocessor, a digital signal processor (DSP), a programmable controller, an application specific integrated circuit (ASIC), a programmable logic device (PLD), or other similar processing device. The terminal device 110 may include multiple processors, and the multiple processors may be the same processor or a combination of different processors. The terminal device 110 also includes a storage device (not shown). The storage device may be, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, a hard disk, or other circuits or chips having similar functions or combinations of these devices or circuits and chips. The storage device stores one or more application programs, which are executed by the processor 111 after being installed in the terminal device 110.In this embodiment, the screen 112 is used to display an image, such as a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, or an Organic Light Emitting Diode (OLED) display. The terminal device 110 also includes a sound collection device such as a microphone, which is connected to the processor 111. The communication interface 113 is, for example, a chip or circuit that uses a wired and / or wireless communication technology or a mobile communication technology. The mobile communication technology is, for example, a Global System for Mobile Communications (GSM), a third-generation mobile communication technology (3G), a fourth-generation mobile communication technology (4G), or a fifth-generation mobile communication technology (5G), etc.

[0018] FIG. 3 is a flowchart of a projection method in an embodiment of the present invention. FIG. 4 is a schematic diagram showing communication of a voice control process in an embodiment of the present invention. Referring to FIG. 1 to FIG. 4, the projection system 100 can execute, for example, the following steps S310 to S340 to realize the voice control function. The user 400 can input a voice command 410 for controlling the projection device 120 using the sound collection device of the terminal device 110. In step S310, the user can use the terminal device 110 to send an original command 420 to the cloud server 130. In this embodiment, the processor 111 of the terminal device 110 can display a control interface on the screen 112 by, for example, an application program, and receive the original command 420 through the control interface. For example, the control interface includes an option (virtual button) of a recording function that activates the sound collection device, and when the sound collection device is activated, the control interface can receive the voice command 410 through the sound collection device. The original command 420 is obtained by converting the voice command 410 in a natural language format input by the user into a text command through the voice recognition model of the cloud server 130, and using the text command as the original command 420. Alternatively, the original command 420 is the voice command 410 in a natural language format input by the user, and the voice command 410 input by the user is directly uploaded to the natural language processing model 140, and the natural language processing model 140 is used to read the voice command 410 as the original command 420. In one embodiment, the processor 111 of the terminal device 110 can also convert the voice command 410 input by the user into a text command, and provide the text command to the cloud server 130 as the original command. In one embodiment, the control interface also includes an option (virtual button) to input a text command, and the processor 111 of the terminal device 110 can provide the text command input by the user to the cloud server 130 as the original command 420.

[0019] In step S320, the cloud server 130 inputs the original command 420 to the natural language processing model 140. In this embodiment, the cloud server 130 can input the original command 420 and the rule command 430 to the natural language processing model 140. In one embodiment, the rule command 430 is stored in a storage device of the cloud server 130 in advance. In step S325, the natural language processing model 140 identifies whether the original command 420 corresponds to an operation that can be performed by the projection device 120. In step S330, if the original command 420 corresponds to an operation of the projection device 120, the natural language processing model 140 generates and outputs a standard command 440 in a non-natural language format based on the original command 420, and also receives the standard command 440 via the cloud server 130 and controls the projection device 120 based on the standard command 440.

[0020] In step S340, if the original command 420 does not correspond to the operation of the projection device 120, the natural language processing model 140 generates feedback information 450 based on the original command 420, and transmits the feedback information 450 to at least one of the terminal device 110 and the projection device 120 via the cloud server 130. For example, the feedback information 450 may be displayed as an image and / or text on the screen 112 of the terminal device 110, may be projected by the projection device 120 onto a projection target (such as a wall or a projection screen), or the feedback information 450 may be reproduced as an audio signal using a speaker of the terminal device 110 or the projection device 120.

[0021] The standard command 440 may be a command that can be deciphered by the projection device 120. The cloud server 130 transmits the standard command 440 to the terminal device 110, so that the terminal device 110 can output the standard command 440 to the projection device 120 to control the projection device 120. Alternatively, the terminal device 110 further converts the standard command 440 into a projector control code corresponding to the model of the projection device 120 based on the projection device information of the projection device 120, and outputs the projector control code to the projection device 120 to control the projection device 120. The projection device information includes, for example, the model and / or model number of the projection device 120.

[0022] In one embodiment, the cloud server 130 can further convert the standard command 440 into a projector control code based on the projection device information of the projection device 120 to control the projection device 120. The terminal device 110 receives the projector control code from the cloud server 130 and sends the projector control code to the projection device 120. If the original command 420 corresponds to at least one operation among a plurality of operations that the projection device 120 can perform, the terminal device 110 outputs the projector control code to the projection device 120 to drive the projection device 120 to perform the operation corresponding to the projector control code. The projector control code corresponds to the original command 420 and the projection device information. If the original command does not correspond to the operations that the projection device 120 can perform, the terminal device 110 displays feedback information 450 to the user 400 through the control interface.

[0023] The rule command 430 is configured, for example, to limit the command that the natural language processing model 140 can output only to projector control codes that are decipherable by the projection device 120 or convertible to the projection device 120. For example, the rule command 430 can limit the natural language processing model 140 to output only standard commands 440 that are executable by the projection device 120. The standard commands 440 are, for example, "power on", "power off", "volume up", "volume down", "connect to HDMI (registered trademark) 1", "connect to HDMI 2", etc., or codes equivalent thereto. In addition, the rule command 430 requests the natural language processing model 140 to induct (classify) the original command 420 into any of the above standard commands 440 or into another standard command 440 after analyzing the meaning of the original command 420 received by the natural language processing model 140. For example, a user can input an original command 420 such as "too loud" or "a little quieter", which means that the natural language processing model 140 can identify the command to turn down the volume of the projection device 120, and the original command 420 will be reduced to a standard command 440 of "turn down the volume". The rule command 430 includes rules, for example, consisting of tens, hundreds or thousands of characters, and the rule command 430 added every time the cloud server 130 issues the original command 420 to the natural language processing model 140 is the same. The cloud server 130 can optimize the rule command 430 from time to time, for example, increase or decrease the number of conditions of the rule command 430, to achieve faster feedback speed, lower cost and more accurate feedback.

[0024] If the original command 420 is reduced to the above-mentioned standard command 440, the natural language processing model 140 automatically identifies the original command 420 as corresponding to at least one operation of the projection device 120, and feeds back the corresponding standard command 440 to the cloud server 130. If the original command 420 is classified as not being the standard command 440, the natural language processing model 140 automatically identifies the original command 420 as not corresponding to an operation of the projection device 120, and sends feedback information 450 to at least one of the terminal device 110 and the projection device 120 to notify the user 400 that the voice command 410 / original command 420 cannot be executed. In one embodiment, when the original command 420 corresponds to at least one operation of the projection device 120, the natural language processing model 140 simultaneously generates a standard command 440 and feedback information 450 corresponding to the standard command 440, and the feedback information 450 is transmitted to at least one of the terminal device 110 and the projection device 120 to inform the user 400 that the projection device 120 has completed at least one operation corresponding to the original command 420. The process of inducing the original command 420 to the standard command 440 is not an existing table search means, but the natural language processing model 140 directly analyzes the meaning of the original command 420 and the meaning of the standard command 440, so there is no need to build a command table in advance to list the corresponding original commands.

[0025] The cloud server 130 may also request, through the rule command 430, that the content of the standard command 440 and / or the feedback information 450 output by the natural language processing model 140 be limited to the hardware of the projection device 120 used by the user 400. For example, if the projection device 120 only has a first High Definition Multimedia Interface (HDMI) connection interface and a second HDMI connection interface, the rule command 430 may restrict the natural language processing model 140 to automatically return feedback information 450 indicating that the model cannot be executed to the user 400 and not generate the standard command 440 when the natural language processing model 140 receives an original command 420 that requests the use or connection of a third HDMI connection interface or higher or other types of connection interfaces. Alternatively, a rule command 430 can be defined requesting the natural language processing model 140 to assume that all subsequent feedback (standard commands 440 and feedback information 450) is the projection device 120 itself, the rule command 430 informing the natural language processing model 140 of what hardware the assumed projection device 120 has and what operations it can perform, and the natural language processing model 140 can feed back the corresponding standard commands 440 and feedback information 450 based on the position of the assumed projection device 120.

[0026] In this embodiment, the natural language processing model 140 can generate different standard commands 440 based on the type of the original command 420. The types of the original command 420 include a single control command, a multiple control command, a composite control command, and a question-answer command. The single control command is a request corresponding to the original command 420, and is a command that only adjusts one parameter of the projection device 120 or includes only one operation. If the natural language processing model 140 determines that the original command 420 is a single control command, the rule command 430 is configured to restrict the natural language processing model 140 from generating a standard command 440 corresponding to the single operation. For example, the original command 420 is a single control command such as turning down the volume or switching the connection target. The natural language processing model 140 generates a standard command 440 corresponding to the single operation of turning down the volume or switching the connection target. The multiple control command is a request corresponding to the original command 420, and is a command that includes multiple single operations. When the natural language processing model 140 determines that the original command 420 is a multiple control command, the rule command 430 is configured to restrict the natural language processing model 140 from generating a standard command 440 corresponding to multiple single operations. For example, the original command 420 is a multiple control command such as turning down the volume and switching the connection target. The natural language processing model 140 generates multiple standard commands 440 corresponding to multiple single operations such as turning down the volume and switching the connection target. The composite control command is a request corresponding to the original command 420, and includes a command to adjust multiple parameters of the projection device 120. The original command 420 is, for example, a composite control command to adjust the visual effect of the projection screen, such as an instruction to "improve the color of the screen." The rule command 430 is configured to restrict the natural language processing model 140 from generating a standard command 440 corresponding to multiple single operations. For example, the natural language processing model 140 generates multiple standard commands 440 to adjust multiple parameters such as the color gamut, brightness, and sharpness of the projection screen.

[0027] The question-answering command is a request corresponding to the original command 420, which is a single or multiple control commands that ask a question instead of controlling the projection device 120. For example, the original command 420 is a question such as "What services can you provide?" or "What is the weather like today?". If the natural language processing model 140 determines that the original command 420 is a question-answering command, the rule command 430 is configured to restrict the natural language processing model 140 from generating and feeding back the feedback information 450 to the cloud server 130, or restrict the cloud server 130 from connecting to other network resources or databases to generate the feedback information 450 and further sending the feedback information 450 back to the terminal device 110 or the projection device 120 to provide a response to the user 400. If the request corresponding to the original command 420 is for advice on watching movies, the natural language processing model 140 can analyze the usage status, viewing habits and other related data of the projection device 120 of the user 400 and provide advice individually. For example, the natural language processing model 140 can recommend a particular genre of movies, music, or programs based on the preferences of the user 400, thereby allowing the user 400 to better enjoy the entertainment and convenience provided by the projection system 100.

[0028] FIG. 5 is a flowchart of the registration and subscription of the voice control process in an embodiment of the present invention. Referring to FIG. 1, FIG. 2 and FIG. 5, when a user uses the voice control function, the projection system 100 can, for example, perform the following steps S510 to S590 to realize the registration and subscription of the voice control function. In step S510, the user can launch an application program of the terminal device 110. In step S520, the terminal device 110 can connect to the cloud server 130 to check the registration status of the voice control service. If the cloud server 130 determines that the terminal device 110 has not yet been registered, in step S530, the cloud server 130 requests the terminal device 110 to register or terminate control. If the cloud server 130 determines that the terminal device 110 has already been registered, in step S540, the cloud server 130 can check the subscription status of the voice control service corresponding to the terminal device 110. If the voice control service of the terminal device 110 has already been subscribed, in step S590, the terminal device 110 can enter the control interface. The screen 112 of the terminal device 110 can display a relevant operation screen of the control interface. If the voice control service of the terminal device 110 has not been subscribed to, in step S550, the cloud server 130 allows the terminal device 110 to enter a subscription process.

[0029] If the user has not yet registered for the subscription, the cloud server 130 ends control in step S560. If the user has completed the subscription registration, the cloud server 130 can save the subscription in step S570. In step S580, the cloud server 130 can return information that the subscription registration is successful to the terminal device 110. In step S590, the terminal device 110 can enter a control interface. Thus, the projection system 100 can perform an effective voice control service subscription operation.

[0030] FIG. 6 is a flowchart of the authentication of the voice control process in an embodiment of the present invention. Referring to FIG. 1, FIG. 2 and FIG. 6, the user can pair the terminal device 110 with the projection device 120. The projection system 100 can, for example, perform the following steps S610 to S670 to realize identity verification. In step S610, the user can start an application program of the terminal device 110. In step S620, the user can pair the terminal device 110 with the projection device 120. The terminal device 110 can scan the pairing information of the projection device 120 to obtain the projection device information of the projection device 120. The pairing information can be obtained, for example, by a two-dimensional barcode (such as a QR code (registered trademark)), or the terminal device 110 can obtain a connection list that can be connected to the projection device 120 via WiFi or Bluetooth, and the user 400 can select the projection device 120 that the user wants to pair with from the connection list to obtain the pairing information. The terminal device 110 can display a pairing interface (including a camera shooting screen) through the screen 112. The pairing interface scans the pairing information of the projection device 120 to obtain the projection device information of the projection device 120 (such as a two-dimensional barcode reader).

[0031] In step S630, the user can input account information into the terminal device 110. The terminal device 110 can send the projection device information and the account information to the cloud server 130. In step S640, the cloud server 130 can perform account authentication. If the authentication fails, in step S650, the cloud server 130 can return authentication failure information to the terminal device 110. If the authentication is successful, that is, if the cloud server 130 authenticates the account information corresponding to the terminal device 110, in step S660, the cloud server 130 notifies the terminal device 110 to let the terminal device 110 enter the control interface, so that the control interface can be displayed on the screen 112 and the registration and subscription services related to the embodiment of FIG. 5 described above can be performed. If voice control is performed, in step S670, the terminal device 110 sends the original command 420 to the cloud server 130, and the projection system 100 can perform the process described in FIG. 3 described above. In this embodiment, the storage device of the cloud server 130 and / or the natural language processing model 140 can store relevant historical data corresponding to the account information, so that the standard command 440 and the feedback information 450 generated by the natural language processing model 140 are consistent with previous answers. In one embodiment, the rule command 430 corresponding to each account information is stored in the storage device of the natural language processing model 140, so that the cloud server 130 does not need to resend the same rule command 430 to the natural language processing model 140.

[0032] FIG. 7 is a schematic diagram of a projection system according to a second embodiment of the present invention. The projection system 700 in FIG. 7 has similar technical features, operation processes and advantages associated with the projection system 100 in FIG. 1, and only the differences are described below. Referring to FIG. 7, the projection system 700 includes a terminal device 710, a projection device 720, and a cloud server 730. In this embodiment, a natural language processing model 731 is embedded in the cloud server 730 and can be realized in the same server. In this embodiment, a user can input an original command through the terminal device 710 and send the original command to the cloud server 730. The cloud server 730 can input the original command into the natural language processing model 731.

[0033] FIG. 8 is a schematic diagram of a projection system according to a third embodiment of the present invention. FIG. 9 is a schematic diagram of a projection device according to an embodiment of the present invention. The projection system 800 in FIG. 8 has similar technical features, operation processes and advantages as those of the projection system 100 in FIG. 1, and only the differences are described below. Referring to FIG. 8 and FIG. 9, the projection system 800 includes a projection device 820, a cloud server 830, and a natural language processing model 840. The projection device 820 is connected to the cloud server 830. The cloud server 830 is connected to the natural language processing model 840. In this embodiment, the projection device 820 includes a processor 821, a projection module 822, and a communication interface 823. The processor 821 is connected to the projection module 822 and the communication interface 823. The projection module 822 includes related optical elements, such as a light source, a light valve, a projection lens, and the like, and related circuit elements, but this is not intended to limit the present invention. The communication interface 823 is connected to the cloud server 830. The communication between the projection device 820 and the cloud server 830 is performed using wired and / or wireless communication means. The wired communication means includes a cable, etc. The wireless communication means includes Wifi, Bluetooth, and / or the Internet, etc. The cloud server 830 is connected to the natural language processing model 840, for example, via the Internet. In one embodiment, the natural language processing model 840 is also embedded in the cloud server 830.

[0034] In this embodiment, the projection device 820 further includes a sound pickup device for receiving the original command 420 from the user 400. The processor 821 can send the original command 420 to the cloud server 830 through the communication interface 823. In response, if the cloud server 830 determines that the original command 420 corresponds to the operation of the projection device 820, it can further convert the standard command 440 into a projector control code based on the projection device information of the projection device 820. The processor 821 can receive the projector control code sent from the cloud server 830 through the communication interface 823, and the processor 821 can drive the projection module 822 based on the projector control code. Or, the cloud server 830 can directly send the standard command 440 and / or the feedback information 450 back to the projection device 820, and the processor 821 of the projection device 820 can further convert the standard command 440 into a projector control code to control the projection device 820.

[0035] In one embodiment, the projection system 800 may further include a terminal device 810, which is connected to the projection device 820. The terminal device 810 may have, for example, a voice input function. The terminal device 810 may be a remote control for the projection device 820 or an electronic device with a voice input function. If the terminal device 810 is in communication with the cloud server 830, the cloud server 830 may directly return the feedback information 450 to the terminal device 810. If the terminal device 810 is not in communication with the cloud server 830, the cloud server 830 may return the feedback information 450 to the terminal device 810 via the projection device 820. In this embodiment, a user may use the terminal device 810 to perform voice input and input an original command 420 in a voice format for controlling the projection device 820. The terminal device 810 may transmit the original command 420 to the projection device 820, and transmit the original command 420 to the cloud server 830 via the projection device 820.

[0036] In this embodiment, the original command 420 is a natural language command input by the user 400 via the terminal device 810, and the cloud server 830 can convert the natural language command into a text command and use the text command as the original command 420. Alternatively, in one embodiment, the processor 821 can convert the voice command 410 input by the user 400 via the terminal device 810 into a text command and send the text command to the cloud server 830 as the original command 420.

[0037] In summary, the projection system, terminal device, projection device and their control method of the present invention can receive a natural language command from a user through a terminal device / projection device, connect to or execute a natural language processing model through a cloud server, immediately identify the natural language command input by the user, and automatically generate a corresponding standard command. The standard command is returned to the projection device through the terminal device or directly sent to the projection device, effectively realizing the voice control function of the projection device.

[0038] The above are only preferred embodiments of the present application, and the scope of the present application is not limited thereto. Simple equivalent changes and modifications made based on the claims of the present application and the specification of the present application also fall within the scope of the claims of the present application. In addition, any embodiment or claim of the present application does not necessarily achieve all of the objectives, advantages or features disclosed in the present application. In addition, the abstract and the title of the invention are for use in patent search, and do not limit the scope of the claims of the present application. In addition, the terms "first", "second", etc. mentioned in the specification or claims are only for naming elements or for distinguishing different embodiments or ranges, and are not intended to limit the upper or lower limits on the quantity of elements. [Explanation of symbols]

[0039] 100, 700, 800: Projection System 110, 710, 810: Terminal equipment 111, 821: Processor 112: Screen 113, 823: Communication interface 120, 720, 820: Projection device 130, 730, 830: Cloud servers 140, 731, 840: Natural Language Processing Models 400:User 410: Voice command 420: Original Order 430: Regulation Directive 440: Standard Directive 450: Feedback information 822: Projection module S310~S340, S510~S590, S610~S670: Step

Claims

1. A method for controlling a projection device, comprising the steps of: sending an original command from the terminal device to a cloud server; the cloud server inputting the original command into a natural language processing model; When the original command corresponds to an operation of the projection device, a standard command is generated based on the original command by the natural language processing model, and the cloud server receives the standard command and controls the projection device based on the standard command; if the original command does not correspond to an operation of the projection device, feedback information is generated based on the original command by the natural language processing model, and the cloud server sends the feedback information to at least one of the terminal device and the projection device; 13. A method for controlling a projection device, comprising:

2. 2. The method of claim 1, further comprising the step of: converting a voice command into a character command by the terminal device, and using the character command as the original command.

3. The method for controlling a projection device according to claim 1 , further comprising the steps of: the terminal device transmitting the original command to the projection device; and the projection device transmitting the original command to the cloud server.

4. The method for controlling a projection device according to claim 1 , further comprising the step of: inputting the original command and a rule command into the natural language processing model by the cloud server.

5. When the original command corresponds to an operation of the projection device, the steps include: the natural language processing model outputs the standard command and the feedback information corresponding to the standard command based on the original command and the rule command; The method of controlling a projection device according to claim 4 , further comprising a step of: the cloud server transmitting the feedback information to at least one of the terminal device and the projection device.

6. The method of claim 1 , further comprising the step of scanning the pairing information of the projection device by the terminal device to obtain the projection device information of the projection device.

7. The projection device control method according to claim 6 , wherein the step of receiving the standard command by the cloud server further includes a step of converting the standard command into a projector control code based on the projection device information.

8. The step of controlling the projection device based on the standard command includes: receiving the projector control code from the cloud server by the projection device; The method for controlling a projection device according to claim 7 , further comprising the step of receiving the projector control code from the cloud server by the terminal device and transmitting the projector control code to the projection device.

9. The step of controlling the projection device based on the standard command includes: receiving the standard command from the cloud server by the terminal device; 7. The method for controlling a projection device according to claim 6, further comprising the step of converting the standard command into a projector control code based on the projection device information by the terminal device, and outputting the projector control code to the projection device.

10. The step of generating the standard command based on the original command by the natural language processing model includes: generating the standard command corresponding to an individual operation by the natural language processing model when the natural language processing model determines that the original command is an individual control command; The method for controlling a projection device as described in claim 1, further comprising a process of generating the standard command corresponding to multiple individual operations by the natural language processing model when the natural language processing model determines that the original command is multiple control commands or a composite control command.

11. The method for controlling a projection device according to claim 1 , wherein the natural language processing model functions as a chatbot.

12. A projection device; A cloud server; a terminal device connected to the cloud server and the projection device and used to transmit an original command to the cloud server; the cloud server is configured to input the original command into a natural language processing model, and if the original command corresponds to an operation of the projection device, the natural language processing model is configured to generate a standard command based on the original command, and the cloud server is configured to receive the standard command, and a process of controlling the projection device based on the standard command; When the original command does not correspond to an operation of the projection device, the natural language processing model generates feedback information based on the original command, and at least one of the terminal device and the projection device is used to receive and display the feedback information.

13. The projection system according to claim 12, characterized in that the terminal device converts a voice command into a text command, and the text command is further used as the original command.

14. The projection system according to claim 12 , wherein the terminal device is configured to transmit the original command to the projection device, and the projection device is used to transmit the original command to the cloud server.

15. The projection system of claim 12 , wherein the cloud server inputs the original command and the rule command into the natural language processing model.

16. The projection system of claim 15, characterized in that when the original command corresponds to an operation of the projection device, the natural language processing model outputs the standard command and the feedback information corresponding to the standard command based on the original command and the rule command, and the cloud server is further used to transmit the feedback information to at least one of the terminal device and the projection device.

17. The projection system according to claim 12 , wherein the terminal device is further used to scan pairing information of the projection device to obtain projection device information of the projection device.

18. 20. The projection system of claim 17, wherein the cloud server is used to convert the standard command into a projector control code based on the projection device information.

19. The projection system of claim 17, characterized in that the projection device receives a projector control code from the cloud server, or the terminal device is used to receive the projector control code from the cloud server and transmit the projector control code to the projection device.

20. The projection system according to claim 17, characterized in that the terminal device is used to receive the standard command from the cloud server, convert the standard command into a projector control code based on the projection device information, and output the projector control code to the projection device.

21. If the natural language processing model determines that the original command is a standalone control command, generating the standard command corresponding to a standalone operation; The projection system of claim 12, wherein the natural language processing model is used to generate the standard command corresponding to multiple individual operations when the natural language processing model determines that the original command is a multiple control command or a composite control command.

22. A projection module; a processor connected to the projection module; A communication interface connected to the processor and used to connect to a cloud server; A projection device comprising: The processor, Sending an original command to the cloud server via the communication interface; receiving a projector control code sent from the cloud server via the communication interface if the original command corresponds to an operation of the projection device; a projection device configured to perform a function for controlling the projection module based on the projector control code;

23. 23. The projection device of claim 22, wherein the processor is configured to convert a voice command to a text command and to use the text command as the original command.

24. The processor, Sending the original command to the cloud server via the communication interface; The projection device of claim 22 , further comprising: a communication interface configured to receive feedback information transmitted from the cloud server.

25. The projection device of claim 24, wherein the feedback information is generated based on the original instruction and the rule instruction through a natural language processing model, and the natural language processing model is stored in the cloud server or connected to the cloud server via a wireless network.

26. A terminal device for controlling a projection device, a screen used to display a control interface; a processor connected to the screen; A terminal device comprising: The processor, receiving an original command via the control interface; outputting a projector control code to the projection device via the terminal device when the original command corresponds to an operation of the projection device, and driving the projection device to execute an operation corresponding to the projector control code, the projector control code corresponding to the original command and projection device information; displaying feedback information through the control interface when the original command and the operation of the projection device do not correspond; 23. A terminal device for controlling a projection device, comprising:

27. The processor, displaying a pairing interface on the screen; scanning the pairing information of the projection device through the pairing interface to obtain the projection device information of the projection device; displaying the control interface on the screen when account information corresponding to the terminal device is authenticated by the cloud server; 27. The terminal device according to claim 26, characterized in that it is adapted to execute the following:

Images