Projection system, terminal device, projection device and control method thereof

Abstract

The present invention proposes a projection system, a terminal device, a projection device and a control method thereof. The control method comprises the following steps: sending an original instruction to a cloud server by means of a terminal device; inputting the original instruction into a natural language model by means of the cloud server; in response to the original instruction corresponding to the operation of the projection device, generating a standard instruction according to the original instruction by means of the natural language model, and receiving the standard instruction by means of the cloud server to control the projection device according to the standard instruction; and in response to the original instruction not corresponding to the operation of the projection device, generating feedback information according to the original instruction by means of the natural language model, and sending the feedback information to at least one of the terminal device and the projection device by means of the cloud server. The projection system, the terminal device, the projection device and the control method thereof of the present invention can realize a voice control function.

Description

Technical Field

[0001] The present invention relates to a display technology, and in particular to a projection system, a terminal device, a projection device and a control method thereof. Background Art

[0002] Currently, the existing projector control method is that the user manually operates the remote control of the projector or operates the human-machine interface on the projector to operate the relevant projection settings of the projector. Therefore, the traditional projector control method is quite inconvenient.

[0003] The "background technology" section is only used to help understand the content of the present invention. Therefore, the content disclosed in the "background technology" section may contain some prior art that is not known to those skilled in the art. The content disclosed in the "background technology" section does not mean that the content or the problem to be solved by one or more embodiments of the present invention has been known or recognized by those skilled in the art before the application of the present invention. Summary of the invention

[0004] The invention provides a projection system, a terminal device, a projection device and a control method thereof, which can realize a voice control function.

[0005] Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0006] To achieve one or part or all of the above purposes or other purposes, the control method of the projection device of the present invention includes the following steps: sending an original instruction to a cloud server through a terminal device; inputting the original instruction into a natural language model through the cloud server; in response to the original instruction corresponding to the operation of the projection device, generating a standard instruction according to the original instruction through the natural language model, and receiving the standard instruction through the cloud server to control the projection device according to the standard instruction; and in response to the original instruction not corresponding to the operation of the projection device, generating feedback information according to the original instruction through the natural language model, and sending the feedback information to at least one of the terminal device and the projection device through the cloud server.

[0007] To achieve one or part or all of the above purposes or other purposes, the projection system of the present invention includes a projection device, a cloud server and a terminal device. The terminal device is coupled to the cloud server and the projection device, and is used to send an original instruction to the cloud server. The cloud server inputs the original instruction into a natural language model. In response to the original instruction corresponding to the operation of the projection device, the natural language model generates a standard instruction according to the original instruction, and the cloud server receives the standard instruction to control the projection device according to the standard instruction. In response to the original instruction not corresponding to the operation of the projection device, the natural language model is used to generate feedback information according to the original instruction, and at least one of the terminal device and the projection device is used to receive and display the feedback information.

[0008] To achieve one or part or all of the above purposes or other purposes, the projection device of the present invention includes a projection module, a processor and a communication interface. The processor is coupled to the projection module. The communication interface is coupled to the processor and is used to connect to a cloud server, and the processor is configured to execute: sending an original instruction to the cloud server via the communication interface; receiving a projector control code sent by the cloud server via the communication interface in response to the original instruction corresponding to the operation of the projection device; and driving the projection module according to the projector control code.

[0009] To achieve one or part or all of the above purposes or other purposes, the terminal device of the present invention is used to control a projection device. The terminal device includes a screen and a processor. The screen is used to display a control interface. The processor is coupled to the screen. The processor is configured to perform: receiving an original instruction through the control interface; in response to the original instruction corresponding to the operation of the projection device, outputting a projector control code to the projection device through the terminal device to drive the projection device to perform an operation corresponding to the projector control code, wherein the projector control code corresponds to the original instruction and the projection device information; and in response to the original instruction not corresponding to the operation of the projection device, displaying feedback information through the control interface.

[0010] Based on the above, the projection system, terminal device, projection device and control method thereof of the present invention can use a natural language model to instantly identify the voice commands input by the user and automatically generate corresponding standard commands to control the terminal device, thereby effectively realizing the voice control function.

[0011] In order to make the above features and advantages of the present application more obvious and easy to understand, the following embodiments are specifically described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a schematic diagram of a projection system according to a first embodiment of the present invention.

[0013] Figure 2 is a schematic diagram of a terminal device according to an embodiment of the present invention.

[0014] Figure 3 4 is a flow chart of a projection method according to an embodiment of the present invention.

[0015] Figure 4 It is a communication diagram of a voice control process according to an embodiment of the present invention.

[0016] Figure 5 This is a registration and subscription flowchart of a voice control process according to an embodiment of the present invention.

[0017] Figure 6 It is a verification flow chart of the voice control process according to an embodiment of the present invention.

[0018] Figure 7 is a schematic diagram of a projection system according to a second embodiment of the present invention.

[0019] Figure 8 is a schematic diagram of a projection system according to a third embodiment of the present invention.

[0020] Fig. 9 FIG. 1 is a schematic diagram of a projection device according to an embodiment of the present invention.

[0021] Reference numerals list

[0022] 100, 700, 800: projection system

[0023] 110, 710, 810: terminal device

[0024] 111, 821: Processor

[0025] 112: Screen

[0026] 113, 823: Communication interface

[0027] 120, 720, 820: projection device

[0028] 130, 730, 830: Cloud Server

[0029] 140, 731, 840: Natural language model

[0030] 400:User

[0031] 410: Voice command

[0032] 420: Original instruction

[0033] 430: Rule Instructions

[0034] 440: Standard Instructions

[0035] 450: Feedback

[0036] 822: Projection module

[0037] S310~S340, S510~S590, S610~S670: steps. DETAILED DESCRIPTION

[0038] The aforementioned and other technical contents, features and effects of the present application will be clearly presented in the following detailed description of a preferred embodiment with reference to the drawings. The directional terms (e.g., up, down, left, right, front or back, etc.) mentioned in the following embodiments are only the directions of the reference drawings. Therefore, the directional terms used are used to illustrate and not to limit the present application.

[0039] Figure 1 Schematic diagram of a projection system according to a first embodiment of the present invention. Figure 1 The projection system 100 includes a terminal device 110, a projection device 120, a cloud server 130 and a natural language model 140. The terminal device 110 is coupled to the projection device 120 and the cloud server 130. The cloud server 130 is coupled to the natural language model 140. In this embodiment, the terminal device 110, the projection device 120 and the cloud server 130 can communicate with each other by wired and / or wireless communication methods. The wired communication method is, for example, a cable. The wireless communication method includes, for example, Wifi, Bluetooth and / or the Internet. The cloud server 130 can be connected to the natural language model 140, for example, by means of the Internet.

[0040] In this embodiment, the terminal device 110 may have a voice input function. The terminal device 110 may be, for example, a smart phone, a remote control of the projection device 120, or other smart portable devices or electronic devices with a voice input function. The projection device 120 may, for example, include a communication interface and a projection module. In this embodiment, the user may perform voice input through the terminal device 110 to input relevant voice commands for controlling the projection device 120, and the terminal device 110, the cloud server 130, and the natural language model 140 may perform relevant voice recognition and command generation to realize the function of voice control of the projection device 120.

[0041] In this embodiment, the natural language model 140 may be, for example, a chatbot (ChatBot), which has a machine learning algorithm. The chatbot may be, for example, any pre-trained chatbot such as Chat Generative Pre-trained Transformer (ChatGPT), Microsoft Bing, Google Bard, or ERNIE Bot, or may be a dedicated chatbot trained with data in a specific field. The natural language model 140 may be used to perform natural language processing and semantic understanding, dialogue management, speech-to-text, and text-to-speech, etc. The natural language model 140 may recognize multiple languages ​​and multiple accents. In this embodiment, the natural language model 140 may be set in the cloud server 130 or a third-party cloud server. The cloud server 130 and the third-party cloud server may include a processor and a storage device. The storage device is used to store, for example, a chatbot having a machine learning algorithm, and the processor is used to execute the above algorithm.

[0042] Figure 2 is a schematic diagram of a terminal device according to an embodiment of the present invention. Figure 2 The terminal devices of the various embodiments of the present invention can implement the following Figure 2The terminal device 110 shown. The terminal device 110 may be, for example, a smart phone, a tablet computer, a personal computer or other electronic device. The terminal device 110 may include a processor 111, a screen 112 and a communication interface 113. The processor 111 is coupled to the screen 112 and the communication interface 113. In this embodiment, the processor 111 may include, for example, a central processing unit (CPU), a graphics processing unit (GPU) or other programmable general or special microprocessor (Microprocessor), a digital signal processor (DSP), a programmable controller, an application specific integrated circuit (ASIC), a programmable logic device (PLD), other similar processing devices or a combination of these devices. The terminal device 110 may also include a storage device (not shown). The storage device is, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk or other circuits or chips with similar functions or a combination of these devices, circuits and chips. The storage device stores one or more application programs, which are executed by the processor 111 after being installed in the terminal device 110. In this embodiment, the screen 112 is used to display images, and the screen 112 can be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display or an organic light emitting diode (OLED) display. The terminal device 110 can also include a sound receiving device, such as a microphone, and the sound receiving device is coupled to the processor 111. The communication interface 113 is, for example, a chip or circuit using wired and / or wireless communication technology or mobile communication technology. The mobile communication technology is, for example, the Global System for Mobile Communications (GSM), the third-generation mobile communication technology (3G), the fourth-generation mobile communication technology (4G) or the fifth-generation mobile communication technology (5G).

[0043] Figure 34 is a flow chart of a projection method according to an embodiment of the present invention. Figure 4 FIG. 1 is a communication diagram of a voice control process according to an embodiment of the present invention. Figures 1 to 4 , the projection system 100 may perform, for example, the following steps S310 to S340 to implement the voice control function. The user 400 may input a voice command 410 for controlling the projection device 120 through the sound receiving device of the terminal device 110. In step S310, the user may send an original command 420 to the cloud server 130 through the terminal device 110. In this embodiment, the processor 111 of the terminal device 110 may display a control interface on the screen 112 through an application, and may receive the original command 420 through the control interface. For example, the control interface includes an option for activating a recording function of the sound receiving device. When the sound receiving device is activated, the control interface may receive the voice command 410 through the sound receiving device. The original command 420 may be converted into a text command by the speech recognition model of the cloud server 130 from the voice command 410 in the form of natural language input by the user, so as to use the text command as the original command 420. Alternatively, the original instruction 420 may be a voice instruction 410 in a natural language form input by the user, and the voice instruction 410 input by the user may be directly uploaded to the natural language model 140, and the natural language model 140 may be used to read the voice instruction 410 to use the voice instruction 410 as the original instruction 420. In one embodiment, the processor 111 of the terminal device 110 may first convert the voice instruction 410 input by the user into a text instruction, and then provide the text instruction as the original instruction 420 to the cloud server 130. In one embodiment, the control interface may also include an option to input a text instruction, and the processor 111 of the terminal device 110 may provide the text instruction input by the user as the original instruction 420 to the cloud server 130.

[0044] In step S320, the cloud server 130 may input the original instruction 420 into the natural language model 140. In this embodiment, the cloud server 130 may input the original instruction 420 and the rule instruction 430 into the natural language model 140 together. In one embodiment, the rule instruction 430 has been pre-stored in the storage device of the cloud server 130. In step S325, the natural language model 140 identifies whether the original instruction 420 corresponds to the operation of the projection device 120. In step S330, in response to the original instruction 420 corresponding to the operation of the projection device 120, the natural language model 140 may generate and output a standard instruction 440 in a non-natural language form according to the original instruction 420, and receive the standard instruction 440 through the cloud server 130 to control the projection device 120 according to the standard instruction 440.

[0045] In step S340, in response to the original instruction 420 not corresponding to the operation of the projection device 120, the natural language model 140 may generate feedback information 450 according to the original instruction 420, and send the feedback information 450 to at least one of the terminal device 110 and the projection device 120 through the cloud server 130. For example, the feedback information 450 may be displayed in the form of graphics on the screen 112 of the terminal device 110 or projected on the projection target through the projection device 120, or the feedback information 450 may be played in the form of an audio signal through the speaker of the terminal device 110 or the projection device 120.

[0046] The standard command 440 may be, for example, a command that can be interpreted by the projection device 120. The cloud server 130 may send the standard command 440 to the terminal device 110, so that the terminal device 110 outputs the standard command 440 to the projection device 120 to control the projection device 120. Alternatively, the terminal device 110 may further convert the standard command 440 into a projector control code corresponding to the model of the projection device 120 according to the projection device information of the projection device 120, and output the projector control code to the projection device 120. The projection device information may include, for example, the model or type of the projection device 120.

[0047] In one embodiment, the cloud server 130 may further convert the standard instruction 440 into a projector control code according to the projection device information of the projection device 120 to control the projection device 120. The terminal device 110 may receive the projector control code from the cloud server 130 and send the projector control code to the projection device 120. When the original instruction 420 corresponds to the operation of the projection device 120, the terminal device 110 may output the projector control code to the projection device 120 to drive the projection device 120 to perform the operation corresponding to the projector control code. The projector control code corresponds to the original instruction 420 and the projection device information. When the original instruction does not correspond to the operation of the projection device 120, the terminal device 110 may display feedback information 450 to the user 400 through the control interface.

[0048] Specifically, the rule instruction 430 may be used to limit the natural language model 140 to only output instructions that can be interpreted by the projection device 120 or can be converted into a projector control code of the projection device 120. For example, the rule instruction 430 may limit the natural language model 140 to only output standard instructions 440 that can be executed by the projection device 120. The standard instructions 440 may be, for example, "power on", "power off", "volume up", "volume down", "connect HDMI1", "connect HDMI2", etc. or their codes, and require the natural language model 140 to parse the semantics of the received original instruction 420 and summarize the original instruction 420 into any of the above standard instructions 440, or summarize it into other standard instructions 440. For example, the user may input original instructions 420 such as "too loud" or "turn down the volume", and the meaning of which can be identified by the natural language model 140 as the desire to reduce the volume of the projection device 120, so the original instruction 420 will be summarized as the standard instruction 440 of "lower the volume". The rule instruction 430 may include, for example, a rule consisting of tens, hundreds, or thousands of characters, and the rule instruction 430 added each time the cloud server 130 issues the original instruction 420 to the natural language model 140 may be the same. In addition, the cloud server 130 may also optimize the rule instruction 430 at any time, for example, by increasing or decreasing the number of conditions of the rule instruction 430, to achieve faster feedback speed, lower cost, or more accurate feedback.

[0049] When the original instruction 420 is classified as the above-mentioned standard instruction 440, the natural language model 140 can automatically identify the original instruction 420 as corresponding to the operation of the projection device 120, and feedback the standard instruction 440 that meets the requirements to the cloud server 130. When the original instruction 420 is classified as not belonging to the standard instruction 440, the natural language model 140 can automatically identify the original instruction 420 as not corresponding to the operation of the projection device 120, and the natural language model 140 can send feedback information 450 to at least one of the terminal device 110 and the projection device 120 to inform the user 400 that the instruction cannot be executed. In one embodiment, when the original instruction 420 corresponds to the operation of the projection device 120, the natural language model 140 will simultaneously generate the standard instruction 440 and the feedback information 450 corresponding to the standard instruction 440, and the feedback information 450 can be transmitted to at least one of the terminal device 110 and the projection device 120 to inform the user 400 that the projection device 120 has completed the operation corresponding to the original instruction 420. The above process of summarizing the original instruction 420 into the standard instruction 440 is not the existing table lookup method, but the natural language model 140 directly parses the semantics of the original instruction 420 and the semantics of the standard instruction 440, so there is no need to establish an instruction table in advance and list the corresponding original instructions.

[0050] The cloud server 130 may also request, through the rule instruction 430, that the natural language model 140 be limited to standard instructions 440 and / or feedback information 450 of the hardware of the projection device 120 used by the feedback user 400. For example, assuming that the projection device 120 only has a first High Definition Multimedia Interface (HDMI) connection interface and a second HDMI connection interface, the rule instruction 430 may limit that when the natural language model 140 receives an original instruction 420 requesting to use or connect to a third HDMI connection interface or other types of connection interfaces, the natural language model 140 will automatically reply with feedback information 450 that the user cannot execute, and the natural language model 140 will not generate standard instructions 440. Alternatively, the rule instructions 430 may also be defined to require that all subsequent feedback (standard instructions 440 and feedback information 450) from the natural language model 140 must assume that it is the projection device 120, and the rule instructions 430 may inform the natural language model 140 what hardware its assumed projection device 120 has and what operations it can perform, so that the natural language model 140 can feedback corresponding standard instructions 440 and feedback information 450 based on the perspective of its assumed projection device 120.

[0051] In this embodiment, the natural language model 140 can generate different standard instructions 440 according to the type of the original instruction 420. The types of the original instruction 420 include single control instructions, multiple control instructions, compound control instructions and question-and-answer instructions. The single control instruction is an instruction corresponding to the original instruction 420 that only requires adjustment of one parameter of the projection device 120 or only includes one operation. When the natural language model 140 determines that the original instruction 420 is a single control instruction, the rule instruction 430 is used to limit the natural language model 140 to generate a standard instruction 440 corresponding to the single operation. For example, the original instruction 420 may be a single control instruction such as lowering the volume or switching a connection object. The natural language model 140 can generate a standard instruction 440 corresponding to a single operation, that is, generate a standard instruction 440 corresponding to lowering the volume or switching a connection object. Multiple control instructions are instructions corresponding to the original instruction 420 that require multiple single operations. When the natural language model 140 determines that the original instruction 420 is a plurality of control instructions, the rule instruction 430 is used to limit the natural language model 140 to generate standard instructions 440 corresponding to a plurality of single operations. For example, the original instruction 420 may be, for example, a plurality of control instructions for lowering the volume and switching the connection object. The natural language model 140 may generate standard instructions 440 corresponding to a plurality of single operations, that is, generate a plurality of standard instructions 440 that can lower the volume and switch the connection object. The compound control instruction is a requirement corresponding to the original instruction 420, including adjusting a plurality of parameters of the projection device 120. The original instruction 420 may be, for example, a compound control instruction for adjusting the visual effect of the projection screen, and the original instruction 420 may be, for example, "please improve the color of the screen". The rule instruction 430 is used to limit the natural language model 140 to generate standard instructions 440 corresponding to a plurality of single operations. For example, the natural language model 140 generates a plurality of standard instructions 440 for adjusting a plurality of parameters such as the color gamut, brightness, and sharpness of the projection screen.

[0052] The question-and-answer instruction is a single or multiple control instruction that asks questions instead of controlling the projection device 120. The original instruction 420 is, for example, "What services can you provide" or "What is the weather like today". When the natural language model 140 determines that the original instruction 420 is a question-and-answer instruction, the rule instruction 430 is used to limit the natural language model 140 to generate feedback information 450 to the cloud server 130, or the cloud server 130 is connected to other network resources or databases to generate feedback information 450, and the feedback information 450 is further transmitted back to the terminal device 110 or the projection device 120 to provide a response to the user 400. In addition, when the request corresponding to the original instruction 420 is to ask for suggestions on watching movies, the natural language model 140 can also analyze the usage status, viewing habits and other relevant data of the projection device 120 of the user 400, and provide personalized suggestions. For example, the natural language model 140 can recommend specific types of movies, music or programs according to the preferences of the user 400, so that the user 400 can better enjoy the entertainment and convenience brought by the projection system 100.

[0053] Figure 5 This is a registration and subscription flow chart of the voice control process of an embodiment of the present invention. Figure 1 , Figure 2 as well as Figure 5 When the user uses the voice control function, the projection system 100 may execute, for example, the following steps S510 to S590 to register and subscribe to the voice control function. In step S510, the user may start the application of the terminal device 110. In step S520, the terminal device 110 may connect to the cloud server 130 to check the registration status of the voice control service. If the cloud server 130 determines that the terminal device 110 has not been registered, then in step S530, the cloud server 130 requires the terminal device 110 to register or terminate the control. If the cloud server 130 determines that the terminal device 110 has been registered, then in step S540, the cloud server 130 may check the subscription status of the voice control service corresponding to the terminal device 110. If the voice control service of the terminal device 110 is subscribed, then in step S590, the terminal device 110 may enter the control interface. The screen 112 of the terminal device 110 may display the relevant operation screen of the control interface. If the voice control service of the terminal device 110 is not subscribed, then in step S550 , the cloud server 130 may enable the terminal device 110 to enter a subscription process.

[0054] In step S560, if the user has not subscribed yet, then in step S560, the cloud server 130 may end the control. If the user completes the subscription, then in step S570, the cloud server 130 may store the subscription result. In step S580, the cloud server 130 may return a subscription success message to the terminal device 110. In step S590, the terminal device 110 may enter the control interface. Therefore, the projection system 100 can perform an effective subscription operation for the voice control service.

[0055] Figure 6 FIG. 1 is a flow chart of the verification of the voice control process according to an embodiment of the present invention. Figure 1 , Figure 2 as well as Figure 6 , the user can pair the terminal device 110 with the projection device 120. The projection system 100 can execute, for example, the following steps S610 to S670 to implement identity verification. In step S610, the user can start the application of the terminal device 110. In step S620, the user can pair the terminal device 110 with the projection device 120. The terminal device 110 can obtain the projection device information of the projection device 120 by scanning the pairing information of the projection device 120. The pairing information can be realized, for example, by a two-dimensional barcode (such as a QR code) or by a connection list of WiFi or Bluetooth. The user 400 can select the projection device 120 to be paired from the connection list to obtain the pairing information. Specifically, the terminal device 110 can display a pairing interface (such as a camera shooting screen) through the screen 112. The pairing interface can execute scanning of the pairing information of the projection device 120 to obtain the projection device information of the projection device 120 (such as two-dimensional barcode scanning).

[0056] In step S630, the user may input account information in the terminal device 110. The terminal device 110 may send the projection device information and the account information to the cloud server 130. In step S640, the cloud server 130 may perform account verification. If the verification fails, in step S650, the cloud server 130 may return verification failure information to the terminal device 110. If the verification succeeds, indicating that the account information corresponding to the terminal device 110 is verified by the cloud server 130, in step S660, the cloud server 130 may notify the terminal device 110 so that the terminal device 110 enters the control interface, thereby displaying the control interface through the screen 112, and executing the above-mentioned Figure 5 When voice control is performed, in step S670, the terminal device 110 may send the original command 420 to the cloud server 130, and the projection system 100 may perform the above-mentioned Figure 3In this embodiment, since the storage device of the cloud server 130 and / or the natural language model 140 can store relevant historical data corresponding to the account information, the standard instruction 440 and the feedback information 450 generated by the natural language model 140 are consistent with the previous answer. In one embodiment, the rule instruction 430 corresponding to each account information can be stored in the storage device of the natural language model 140, so the cloud server 130 does not need to repeatedly transmit the same rule instruction 430 to the natural language model 140.

[0057] Figure 7 is a schematic diagram of a projection system according to a second embodiment of the present invention. Figure 7 The projection system 700 and Figure 1 The related technical features, operation procedures and advantages of the projection system 100 are similar, and only the differences are described below. Figure 7 , the projection system 700 includes a terminal device 710, a projection device 720, and a cloud server 730. In this embodiment, the natural language model 731 can be built into the cloud server 730 to be implemented in the same server. In this embodiment, the user can input the original command through the terminal device 710, and send the original command to the cloud server 730 through the terminal device 710. The cloud server 730 can input the original command into the natural language model 731.

[0058] Figure 8 is a schematic diagram of a projection system according to a third embodiment of the present invention. Fig. 9 FIG. 1 is a schematic diagram of a projection device according to an embodiment of the present invention. Figure 8 The projection system 800 and Figure 1 The related technical features, operation procedures and advantages of the projection system 100 are similar, and only the differences are described below. Figure 8 and Fig. 9, the projection system 800 includes a projection device 820, a cloud server 830 and a natural language model 840. The projection device 820 is coupled to the cloud server 830. The cloud server 830 is coupled to the natural language model 840. In this embodiment, the projection device 820 may include a processor 821, a projection module 822 and a communication interface 823. The processor 821 is coupled to the projection module 822 and the communication interface 823. The projection module 822 may include, for example, related optical components such as a light source, a light valve and a projection lens and related circuit components, and the present invention is not limited thereto. The communication interface 823 may be connected to the cloud server 830. The projection device 820 and the cloud server 830 may communicate with each other by wired and / or wireless communication methods. The wired communication method is, for example, a cable. The wireless communication method includes, for example, Wifi, Bluetooth and / or the Internet. The cloud server 830 may be connected to the natural language model 840 by, for example, the Internet. In one embodiment, the natural language model 840 may also be built into the cloud server 830 .

[0059] In this embodiment, the projection device 820 further includes a sound receiving device for receiving the original instruction 420 from the user 400. The processor 821 can send the original instruction 420 to the cloud server 830 via the communication interface 823. In this regard, when the cloud server 830 determines that the original instruction 420 corresponds to the operation of the projection device 820, the cloud server 830 can further convert the standard instruction 440 into a projector control code according to the projection device information of the projection device 820, and the processor 821 can receive the projector control code sent by the cloud server 830 via the communication interface 823, and the processor 821 can drive the projection module 822 according to the projector control code. Alternatively, the cloud server 830 can directly return the standard instruction 440 and / or feedback information 450 to the projection device 820, and the processor 821 of the projection device 820 can further convert the standard instruction 440 into a projector control code to control the projection device 820.

[0060] In one embodiment, the projection system 800 may further include a terminal device 810, which is coupled to the projection device 820. The terminal device 810 may, for example, have a voice input function. The terminal device 810 may, for example, be a remote controller of the projection device 820 or an electronic device having a voice input function. If the terminal device 810 is also communicatively connected to the cloud server 830, the cloud server 830 may directly return the feedback information 450 to the terminal device 810. If the terminal device 810 is not communicatively connected to the cloud server 830, the cloud server 830 may return the feedback information 450 to the terminal device 810 via the projection device 820. In this embodiment, the user may perform voice input via the terminal device 810 to input the original command 420 in the form of voice for controlling the projection device 820. The terminal device 810 may send the original command 420 to the projection device 820, so as to send the original command 420 to the cloud server 830 via the projection device 820.

[0061] In this embodiment, the original instruction 420 may be a natural language instruction input by the user 400 through the terminal device 810, and the cloud server 830 may convert the natural language instruction into a text instruction to use the text instruction as the original instruction 420. Alternatively, in one embodiment, the processor 821 may convert the voice instruction 410 input by the user 400 through the terminal device 810 into a text instruction, and use the text instruction as the original instruction 420 to send to the cloud server 830.

[0062] In summary, the projection system, terminal device, projection device and control method thereof of the present invention can receive the user's natural language command through the terminal device, and can connect or execute the natural language model through the cloud server to instantly identify the natural language command input by the user and automatically generate corresponding standard commands. The standard command can be transmitted back to the projection device through the terminal device, or directly sent to the projection device, so as to effectively realize the voice control function of the projection device.

[0063] The above description is only the preferred embodiment of the present application, and it cannot be used to limit the scope of implementation of the present application, that is, all simple equivalent changes and modifications made in accordance with the claims of the present invention and the specification of the present invention are still within the scope of the patent of the present application. In addition, any embodiment or claim of the present application does not have to achieve all the purposes, advantages or features disclosed in this application. In addition, the abstract of the specification and the name of the invention are only used to assist in the retrieval of patent documents, and are not used to limit the scope of rights of the present application. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only used to name the name of the element or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. A method for controlling a projection device, characterized in that: The control method comprises the following steps: Sending original commands to the cloud server via the terminal device; Inputting the original instruction into a natural language model via the cloud server; In response to the original instruction corresponding to the operation of the projection device, generating a standard instruction according to the original instruction by the natural language model, and receiving the standard instruction by the cloud server to control the projection device according to the standard instruction; as well as In response to the original instruction not corresponding to the operation of the projection device, feedback information is generated according to the original instruction by the natural language model, and the feedback information is sent to at least one of the terminal device and the projection device by the cloud server.

2. The control method of the projection device according to claim 1, characterized in that: The control method further comprises the following steps: The terminal device converts the voice command into a text command, and uses the text command as the original command.

3. The control method of the projection device according to claim 1, characterized in that: The step of sending the original command to the cloud server includes: The terminal device sends the original command to the projection device, so that the projection device sends the original command to the cloud server.

4. The control method of the projection device according to claim 1, characterized in that: The step of inputting the original instruction into the natural language model comprises: The original instructions and rule instructions are input into the natural language model through the cloud server.

5. The control method of the projection device according to claim 4, characterized in that: The steps corresponding to the operation of the projection device in response to the original instruction include: Outputting the standard instruction and the feedback information corresponding to the standard instruction according to the original instruction and the rule instruction by means of the natural language model; and The feedback information is sent to at least one of the terminal device and the projection device by the cloud server.

6. The control method of the projection device according to claim 1, characterized in that: The control method further comprises the following steps: Scanning the pairing information of the projection device by the terminal device to obtain the projection device information of the projection device; and The projection device information and account information are sent to the cloud server via the terminal device.

7. The control method of the projection device according to claim 6, characterized in that: The step of receiving the standard instruction by the cloud server also includes: The cloud server converts the standard command into a projector control code according to the projection device information.

8. The control method of the projection device according to claim 7, characterized in that: The step of controlling the projection device according to the standard instruction also includes: By receiving the projector control code from the cloud server by the projection device, or The projector control code is received from the cloud server by the terminal device, and the projector control code is sent to the projection device.

9. The control method of the projection device according to claim 6, characterized in that: The step of controlling the projection device according to the standard instruction also includes: Receiving the standard command from the cloud server by the terminal device; and The terminal device converts the standard command into a projector control code according to the projection device information, and outputs the projector control code to the projection device.

10. The control method of the projection device according to claim 1, characterized in that: The step of generating the standard instruction according to the original instruction by using the natural language model comprises: In response to the natural language model determining that the original instruction is a single control instruction, generating the standard instruction corresponding to the single operation by means of the natural language model; and In response to the natural language model determining that the original instruction is a plurality of control instructions or a compound control instruction, the standard instruction corresponding to a plurality of single operations is generated by means of the natural language model.

11. The control method of the projection device according to claim 1, characterized in that: The natural language model is a chatbot.

12. A projection system, characterized in that: The projection system comprises: Projection device; Cloud servers; and a terminal device, the terminal device is coupled to the cloud server and the projection device, and is used to send an original command to the cloud server, wherein the cloud server inputs the original instruction into a natural language model, in response to the original instruction corresponding to the operation of the projection device, the natural language model generates a standard instruction according to the original instruction, and the cloud server receives the standard instruction to control the projection device according to the standard instruction; and In response to the original instruction not corresponding to the operation of the projection device, the natural language model is used to generate feedback information according to the original instruction, and at least one of the terminal device and the projection device is used to receive and display the feedback information.

13. The projection system according to claim 12, characterized in that: The terminal device is also used to convert the voice command into a text command, and use the text command as the original command.

14. The projection system according to claim 12, characterized in that: The terminal device sends the original command to the projection device, and the projection device is used to send the original command to the cloud server.

15. The projection system according to claim 12, characterized in that: The cloud server is used for inputting the original instruction and the rule instruction into the natural language model.

16. The projection system according to claim 15, characterized in that: In response to the original instruction corresponding to the operation of the projection device, the natural language model is also used to output the standard instruction and the feedback information corresponding to the standard instruction according to the original instruction and the rule instruction, and the cloud server is used to send the feedback information to at least one of the terminal device and the projection device.

17. The projection system according to claim 12, characterized in that: The terminal device is also used to scan the pairing information of the projection device to obtain the projection device information of the projection device, and the terminal device is used to send the projection device information and account information to the cloud server.

18. The projection system according to claim 17, characterized in that: The cloud server is used for converting the standard command into a projector control code according to the projection device information.

19. The projection system according to claim 17, wherein: The projection device is used to receive the projector control code from the cloud server, or the terminal device receives the projector control code from the cloud server and sends the projector control code to the projection device.

20. The projection system according to claim 17, wherein: The terminal device is used for receiving the standard command from the cloud server, and the terminal device is used for converting the standard command into a projector control code according to the projection device information, and outputting the projector control code to the projection device.

21. The projection system according to claim 12, characterized in that: In response to the natural language model determining that the original instruction is a single control instruction, the natural language model is used to generate the standard instruction corresponding to the single operation; as well as In response to the natural language model determining that the original instruction is a plurality of control instructions or a compound control instruction, the natural language model is used to generate the standard instruction corresponding to a plurality of single operations.

22. A projection device, characterized in that: The projection device comprises: Projection module; A processor, the processor is coupled to the projection module; A communication interface coupled to the processor and used to connect to a cloud server, wherein the processor is configured to execute: Sending the original command to the cloud server via the communication interface; In response to the original instruction corresponding to the operation of the projection device, receiving a projector control code sent by the cloud server via the communication interface; and The projection module is driven according to the projector control code.

23. The projection device according to claim 22, characterized in that: The processor is configured to perform: The voice command is converted into a text command, and the text command is used as the original command.

24. The projection device according to claim 22, characterized in that: The processor is configured to perform: Sending the original command to the cloud server via the communication interface; and The feedback information sent by the cloud server is received via the communication interface.

25. The projection device according to claim 24, characterized in that: The feedback information is generated according to the original instruction and the rule instruction via a natural language model, wherein the natural language model is stored in the cloud server or connected to the cloud server via a wireless network.

26. A terminal device for controlling a projection device, characterized in that: The terminal device comprises: A screen, the screen being used to display a control interface; and A processor is coupled to the screen, and the processor is configured to execute: Receiving original instructions via the control interface; In response to the original instruction corresponding to the operation of the projection device, outputting a projector control code to the projection device by the terminal device to drive the projection device to perform the operation corresponding to the projector control code, wherein the projector control code corresponds to the original instruction and the projection device information; and In response to the original instruction not corresponding to the operation of the projection device, feedback information is displayed via the control interface.

27. The terminal device according to claim 26, characterized in that The processor is configured to perform: Displaying a pairing interface on the screen; Scanning the pairing information of the projection device through the pairing interface to obtain the projection device information of the projection device; and In response to the account information corresponding to the terminal device being verified by the cloud server, the control interface is displayed on the screen.

Images