Projection system, projection device and control method thereof

Abstract

The invention provides a projection system, a projection device and a control method thereof. The control method of the projection device comprises the following steps: sending a first original instruction by means of a terminal device; in response to the first original instruction corresponding to a picture correction operation of the projection device, projecting an adjustment picture by means of the projection device, the adjustment picture comprising at least one pattern array and at least one adjustment reference point; sending, by the terminal device, a second original instruction; and adjusting the position of at least one adjustment reference point in the adjustment picture by means of the projection device in response to the second original instruction corresponding to the position of at least one adjustment reference point in the adjustment picture, the at least one adjustment reference point being located in the corresponding at least one pattern array. The projection system, the projection device and the control method thereof provided by the invention can realize the function of correcting the projection picture.

Description

Technical Field

[0001] The present invention relates to a display technology, and in particular to a projection system, a projection device and a control method thereof. Background Art

[0002] The current control method of the projector is that the user manually operates the remote control of the projector or operates the human-machine interface on the projector to adjust the projection image (such as keystone correction). Therefore, the conventional method of adjusting the projection image of the projector is inconvenient.

[0003] The "background technology" section is only used to help understand the content of the present invention. Therefore, the content disclosed in the "background technology" section may contain some known technologies that are not known to those skilled in the art. The content disclosed in the "background technology" section does not mean that the content or the problems to be solved by one or more embodiments of the present invention have been known or recognized by those skilled in the art before the application of the present invention. Summary of the invention

[0004] The invention provides a projection system, a projection device and a control method thereof, which can realize the function of correcting the projection picture.

[0005] Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0006] To achieve one or part or all of the above purposes or other purposes, the control method of the projection device of the present invention includes the following steps: sending a first original instruction by a terminal device; in response to the first original instruction corresponding to the screen correction operation of the projection device, projecting an adjustment screen by the projection device, wherein the adjustment screen includes at least one pattern array and at least one adjustment reference point; sending a second original instruction by the terminal device; and in response to the second original instruction corresponding to the position of at least one adjustment reference point in the adjustment screen, adjusting the position of at least one adjustment reference point in the adjustment screen by the projection device, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array.

[0007] To achieve one or part or all of the above purposes or other purposes, the projection system of the present invention includes a terminal device and a projection device. The terminal device is used to send a first original instruction and a second original instruction. The projection device is coupled to the terminal device. In response to the first original instruction corresponding to the screen correction operation of the projection device, the projection device is used to project an adjustment screen. The adjustment screen includes at least one pattern array and at least one adjustment reference point. In response to the second original instruction corresponding to the position of adjusting at least one adjustment reference point in the adjustment screen, the projection device is used to adjust the position of at least one adjustment reference point in the adjustment screen. The at least one adjustment reference point is located in the corresponding at least one pattern array.

[0008] To achieve one or part or all of the above purposes or other purposes, the projection device of the present invention includes a projection module, a communication interface and a processor. The projection module is used to project an adjustment picture. The communication interface is used to receive a first original instruction and a second original instruction. The processor is coupled to the projection module and the communication interface. The processor is configured to execute: in response to the first original instruction corresponding to the picture correction operation of the projection device, control the projection module to project the adjustment picture, wherein the adjustment picture includes at least one pattern array and at least one adjustment reference point; and in response to the second original instruction corresponding to the position of at least one adjustment reference point in the adjustment picture, control the projection module to adjust the position of at least one adjustment reference point in the adjustment picture, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array.

[0009] Based on the above, the projection system, projection device and control method thereof of the present invention can instantly identify the commands input by the user and automatically generate corresponding commands to control the projection device to achieve the function of correcting the projection image.

[0010] In order to make the above features and advantages of the present application more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 FIG. 4 is a schematic diagram of a projection system according to an embodiment of the present invention.

[0012] Figure 2 is a flow chart of a method for controlling a projection device according to an embodiment of the present invention.

[0013] Figure 3 It is a schematic diagram of the configuration relationship between a projection device and a projection target according to an embodiment of the present invention.

[0014] Figure 4 FIG. 4 is a schematic diagram of an adjustment screen according to an embodiment of the present invention.

[0015] FIG. 5A to FIG. 5E It is a schematic diagram of adjusting the adjustment screen according to an embodiment of the present invention.

[0016] Figure 6 FIG. 1 is a schematic diagram of a projection device according to an embodiment of the present invention.

[0017] Description of reference numerals:

[0018] 100: Projection System

[0019] 110, 610: Projection device

[0020] 120: Terminal device

[0021] 130, 630: Cloud Server

[0022] 140: Natural Language Model

[0023] 300: Projection target

[0024] 300F: Correction frame

[0025] 301, 302: Light path

[0026] 400, 500: Adjust the screen

[0027] 401, 501: outer frame

[0028] 402, 502: Inner frame

[0029] 411~414、511~514:Pattern array

[0030] 611: Processor

[0031] 612: Projection module

[0032] 613: Communication interface

[0033] P1~P4: Adjust the reference point

[0034] C1: Projection center point

[0035] D1, D2, D3: Direction

[0036] K1: Distance

[0037] L1: Length

[0038] α: adjacent edge

[0039] β: length

[0040] θ: Angle

[0041] S210~S240: steps. DETAILED DESCRIPTION

[0042] The other technical contents, features and effects mentioned above in this application will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms mentioned in the following embodiments, such as up, down, left, right, front or back, etc., are only the directions with reference to the accompanying drawings. Therefore, the directional terms used are used for explanation and not for limiting this application.

[0043] Figure 1 FIG. 1 is a schematic diagram of a projection system according to an embodiment of the present invention. Figure 1 The projection system 100 includes a projection device 110, a terminal device 120, a cloud server 130, and a natural language model 140. The terminal device 120 is coupled to the projection device 110 and the cloud server 130. The cloud server 130 is also coupled to the natural language model 140. In this embodiment, the projection device 110, the terminal device 120, and the cloud server 130 can communicate with each other through wired and / or wireless communication methods. The wired communication method is, for example, a cable. The wireless communication method includes, for example, Wifi, Bluetooth, and / or the Internet. The natural language model 140 can be stored in the cloud server 130 or connected to the cloud server 130 through a wireless network.

[0044] In the present embodiment, the terminal device 120 may have a voice and / or text input function. The terminal device 120 may be, for example, a smart phone, a tablet computer, a personal computer, a remote controller of the projection device 110, or other smart portable devices or electronic devices with input functions. The projection device 110 (projector) may, for example, include a communication interface and a projection module. In the present embodiment, the user may input commands through the terminal device 120 to input original commands for controlling the projection device 110, and the terminal device 120, the cloud server 130, and the natural language model 140 may perform relevant original command recognition and generate standard commands for controlling the projection device 110 to realize the function of controlling the projection device 110.

[0045] In this embodiment, the terminal device 120 includes, for example, at least one processor, a screen, and a communication interface. The processor is coupled to the screen and the communication interface. The at least one processor may include, for example, a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessor, a digital signal processor (DSP), a programmable controller, an application specific integrated circuit (ASIC), a programmable logic device (PLD), other similar processing devices, or a combination of these devices. The terminal device 110 may also include a storage device (not shown). The storage device is, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or other circuits or chips with similar functions, or a combination of these devices, circuits, and chips. The storage device stores one or more applications, which are executed by the processor after being installed in the terminal device 120. In the present embodiment, the screen is used to display images, and the screen may be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, or an organic light emitting diode (OLED) display. The terminal device may also include a sound receiving device, such as a microphone, and the sound receiving device is coupled to the processor. The communication interface is, for example, a chip or circuit using wired and / or wireless communication technology or mobile communication technology. Mobile communication technology is, for example, the Global System for Mobile Communications (GSM), third-generation mobile communication technology (3G), fourth-generation mobile communication technology (4G), or fifth-generation mobile communication technology (5G).

[0046] In this embodiment, the natural language model 140 may be, for example, a chatbot (ChatBot), which has a machine learning algorithm. The chatbot may be, for example, any pre-trained chatbot such as Chat Generative Pre-trained Transformer (ChatGPT), Microsoft Bing, Google Bard, or ERNIE Bot, or may be a dedicated chatbot trained with data in a specific field. The natural language model 140 may be used to perform natural language processing and semantic understanding, dialogue management, speech recognition (speech-to-text), and text-to-speech, etc. The natural language model 140 may recognize multiple languages ​​and multiple accents. In this embodiment, the natural language model 140 may be set in the cloud server 130 or a third-party cloud server. The cloud server 130 and the third-party cloud server may include at least one processor and a storage device. The storage device is used, for example, to store a chatbot with a machine learning algorithm, and at least one processor is used, for example, to execute the above-mentioned algorithm.

[0047] Figure 2 FIG. 1 is a flow chart of a method for controlling a projection device according to an embodiment of the present invention. Figure 1 as well as Figure 2 , the projection device 110 may execute the following steps S210 to S240. In the present embodiment, the user may input the first original instruction and the second original instruction in the terminal device 120 in the form of voice or text. For example, the processor of the terminal device 120 may display a control interface on the screen through an application, and may receive the original instruction through the control interface. The control interface includes an option for activating the recording function of the sound receiving device. When the sound receiving device is activated, the control interface may receive the original instruction in the form of voice through the sound receiving device. The control interface may also include an option for inputting text instructions. The processor of the terminal device 120 may input the original instruction in the form of text input by the user. In the present embodiment, the first original instruction, for example, corresponds to the operation of the user wanting the projection device 110 to project an adjustment screen. The second original instruction, for example, corresponds to the operation of the user wanting to adjust the position of the adjustment reference point of the adjustment screen projected by the projection device 110.

[0048] In step S210, the terminal device 120 may send a first original instruction. In step S220, in response to the first original instruction corresponding to the screen correction operation of the projection device 110, the projection device 110 may project an adjustment picture to the projection target, wherein the adjustment picture includes at least one pattern array and at least one adjustment reference point. For example, a user may input a voice instruction (first original instruction) in a natural language form such as "I want to correct the picture" or "I want to adjust the tilted picture" through the terminal device 120, and the terminal device 120 or the cloud server 130 may provide the corresponding standard instruction (first standard instruction) or projector control code (first projector control code) to the projection device 110, so that the projection device 110 can perform the screen correction operation according to the corresponding standard instruction or projector control code, and project the adjustment picture to the projection target.

[0049] In step S230, the terminal device 120 may send a second original instruction. In step S240, in response to the second original instruction corresponding to the position of at least one adjustment reference point in the adjustment screen, the projection device 110 may adjust the position of at least one adjustment reference point in the adjustment screen, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array. In the present embodiment, the at least one pattern array may, for example, include a checkered pattern array, a dot pattern array, or a pattern array of other arbitrary shapes. The at least one adjustment reference point may be adjusted to any position on any pattern in the at least one pattern array, such as the center point or vertex of the pattern. For example, the at least one adjustment reference point may be adjusted to any checkered pattern in the at least one checkered pattern array, or may be adjusted to any dot pattern in the at least one dot pattern array.

[0050] For example, the pattern array is a grid pattern array, and each grid has a corresponding coordinate value. At least one adjustment reference point is, for example, the four corner vertices of a quadrilateral adjustment screen. The user can, for example, input a natural language voice command (second original command) such as "I want to adjust the upper left corner of the adjustment screen to the coordinates (4, 3)" through the terminal device 120. Then, the terminal device 120 or the cloud server 130 can provide the corresponding standard command (second standard command) or projector control code (second projector control code) to the projection device 110, so that the projection device 110 can adjust the upper left corner of the adjustment screen to the coordinates (4, 3) according to the corresponding standard command or projector control code.

[0051] In steps S210 and S230, the terminal device 120 may send a first original instruction and a second original instruction to the cloud server 130. The cloud server 130 may receive the first original instruction and the second original instruction, and input the corresponding rule instruction, the first original instruction, and the second original instruction into the natural language model 140. The rule instruction may, for example, be an instruction for limiting the natural language model 140 to finally output only instructions that can be interpreted by the projection device 110 or can be converted into a projector control code of the projection device 110. The natural language model 140 may convert the first original instruction and the second original instruction into a first standard instruction and a second standard instruction respectively according to the rule instruction, and return the first standard instruction and the second standard instruction to the cloud server 130. The cloud server 130 may receive the first standard instruction and the second standard instruction to control the projection device 110 to project and adjust the adjustment screen. The cloud server 130 may further send the first standard instruction and the second standard instruction to the terminal device 120, so as to control the projection device 110 to project and adjust the position of the adjustment reference point in the adjustment screen through the terminal device 120.

[0052] In one embodiment, the projection device 110 may also be communicatively connected to the cloud server 130. The terminal device 120 may send the first original command and the second original command to the projection device 110, so that the projection device 110 sends the first original command and the second original command to the cloud server 130. The cloud server 130 may send the first standard command and the second standard command to the projection device 110 to directly control the projection device 110 to project and adjust the position of the adjustment reference point in the adjustment screen.

[0053] In another embodiment, the terminal device 120 or the cloud server 130 may further include a speech recognition model to convert the first original instruction and the second original instruction in the form of voice data into the first original instruction and the second original instruction in the form of text data, and then input them into the natural language model 140. Alternatively, the natural language model 140 may also directly interpret the first original instruction and the second original instruction in the form of voice data.

[0054] In this embodiment, the first standard command and the second standard command may be, for example, commands that can be interpreted by the projection device 110. The cloud server 130 may send the first standard command and the second standard command to the terminal device 120, so that the terminal device 120 outputs the first standard command and the second standard command to the projection device 110 to control the projection device 110. Alternatively, the terminal device 120 may further convert the first standard command and the second standard command into a first projector control code and a second projector control code corresponding to the model of the projection device 110 according to the projection device information of the projection device 110, and output the projector control code to the projection device 110. The projection device information may include, for example, the model or type of the projection device 110. Alternatively, in one embodiment, the cloud server 130 may further convert the first standard command and the second standard command into a first projector control code and a second projector control code according to the projection device information of the projection device 110 to control the projection device 110. The projection device 110 may receive the first projector control code and the second projector control code from the cloud server 130.

[0055] In one embodiment, the terminal device 120 may receive the first projector control code and the second projector control code from the cloud server 130, and send the first projector control code and the second projector control code to the projection device 110. When the first original instruction and the second original instruction correspond to the operation of the projection device 110, the terminal device 120 may output the first projector control code and the second projector control code to the projection device 110 to drive the projection device 110 to perform the operation corresponding to the first projector control code and the second projector control code (e.g., projecting an adjustment screen and adjusting an adjustment screen). The first projector control code and the second projector control code correspond to the first original instruction and the second original instruction, respectively. In one embodiment, if the original instruction does not correspond to the operation of the projection device 110, the natural language model 140 may generate feedback information according to the original instruction, and send the feedback information to at least one of the terminal device 120 and the projection device 110 through the cloud server 130 to inform the user that the projection device 110 cannot perform the operation. For example, the feedback information may be displayed in the form of graphics on the screen of the terminal device 120 or projected onto a projection target by the projection device 110 , or the feedback information may be played in the form of audio by a speaker of the terminal device 120 or the projection device 110 .

[0056] The projection device 110 of this embodiment can realize convenient and fast adjustment of the projection screen to achieve accurate trapezoidal correction effect. In addition, the data format and content of the voice command can be determined according to the type of the natural language model 140. The specific implementation methods of the adjustment screen and adjustment of the adjustment screen of this embodiment will be described in detail by the following multiple embodiments.

[0057] refer to Figures 1 to 4 , Figure 3 It is a schematic diagram of the configuration relationship between a projection device and a projection target according to an embodiment of the present invention. Figure 4 2 is a schematic diagram of an adjustment screen of an embodiment of the present invention. In this embodiment, the user can issue a (first) original command by voice control, so that the projection device 110 projects the adjustment screen (step S220). The user can adjust the position of the projection device 110 according to the projection screen projected by the projection device 110. Figure 3 As shown, the projection target 300 is, for example, a projection screen, a desktop or a wall, and the projection target 300 is, for example, a plane, which is, for example, parallel to the plane formed by the extension of the direction D2 (horizontal direction) and the direction D3 (vertical direction), and the projection device 110 can project toward the projection target 300 in the direction D1 (horizontal direction), and the directions D1 to D3 are, for example, perpendicular to each other. Figure 4 As shown, the projection device 110 can project Figure 4 The adjustment screen 400 shown. The adjustment screen 400 includes an outer frame 401, an inner frame 402, and a plurality of pattern arrays 411-414. The pattern arrays 411-414 may respectively include checkered pattern arrays corresponding to the upper left corner, upper right corner, lower left corner, and lower right corner of the adjustment screen 400, and the adjustment reference points P1-P4 are respectively located in the corresponding pattern arrays 411-414. The pattern arrays 411-414 are respectively located between the outer frame 401 and the inner frame 402, and the adjustment reference points P1-P4 are, for example, the four vertices of the outer frame 401. The inner frame 402 is, for example, the border of the projection screen area of ​​the projection device 110 during actual projection. In one embodiment, the adjustment reference points P1-P4 are, for example, the four vertices of the inner frame 402 or other points located in the pattern arrays 411-414.

[0058] In this embodiment, the user can manually adjust the position of the projection device 110 so that the correction frame 300F of the projection target 300 (eg, the outer frame edge of the projection screen) can be located between the outer frame 401 and the inner frame 402. Figure 3As shown, the outer frame 401 of the adjustment picture 400 can be projected onto the projection target 300 along the optical path 301 of the image light beam, and the inner frame 402 of the adjustment picture 400 can be projected onto the projection target 300 along the optical path 302 of the image light beam. The distance from the projection center point C1 of the adjustment picture 400 to the position of the outer frame 401 on either side can be, for example, a length L1, and the distance from the projection center point C1 of the adjustment picture 400 to the projection device 110 is K1. For example, taking the projection ratio of 0.5 as an example, when the correction frame 300F is located between the outer frame 401 and the inner frame 402, the left and right rotation angle of the projection device 110 can be controlled within plus or minus 4.04°, so that the tilt angle and image deformation of the projection device 110 are within a controllable range to increase the correction accuracy. The distance relationship can be as shown Figure 3 As shown, assume that the length L1 is 100 cm and the distance K1 is 100 cm. The adjacent edge α is The length β of the opposite side is a preset known length, for example, 10 cm, and the length β of the opposite side can be, for example, the shortest distance between the outer frame 401 and the inner frame 402 in the direction D2. Therefore, the angle θ can be calculated by the following formula (1) and formula (2). The angle θ≈4.04°.

[0059]

[0060] θ=arctan(0.0704)≈4.04°……………Formula (2)

[0061] Refer to Figure 4 In this embodiment, the pattern arrays 411 to 414 may be grid pattern arrays corresponding to four coordinate systems. The grid pattern array may be, for example, a 10×10 grid of a coordinate system, and the spacing of each grid may be, for example, 10 pixels. In this embodiment, the grid in the lower left corner is used as the starting coordinate (0,0) for example. The positive x-axis of the coordinate system may face the direction opposite to the direction D2, and the positive y-axis of the coordinate system may face the direction D3. The position of the above-mentioned starting coordinate (0,0), the directions of the positive x-axis and the positive y-axis of the coordinate system may be adjusted according to the usage, and the present invention is not specifically limited.

[0062] In this embodiment, the user can adjust the positions of the adjustment reference points P1-P4 by voice control (i.e., step S230), and the displacement of the adjustment reference points P1-P4 can be calculated by referring to the following formulas (3) to (6). In the following formulas (3) to (6), DP1-DP4 are respectively the displacements of the adjustment reference points P1-P4. The unit of the displacement DP1-DP4 is pixel distance (pixel). (X1, Y1), (X2, Y2), (X3, Y3) and (X4, Y4) are respectively the target adjustment coordinates of the adjustment reference points P1-P4, that is, according to the (second) original instruction provided by the user, the adjustment reference points P1-P4 are moved to the target adjustment coordinates.

[0063] DP1=(X1×10, (Y1-10)×10)…………Formula (3)

[0064] DP2=((X2-10)×10, (Y2-10)×10)…………Formula (4)

[0065] DP3=(X3×10, Y3×10)…………Formula (5)

[0066] DP4=((X4-10)×10.Y4×10)…………Formula (6)

[0067] For example, assuming that the (second) original instruction output by the user is to adjust the adjustment reference point P1 to the target adjustment coordinate (8, 2), the displacement of the target adjustment coordinate is (80, -80) (the unit is pixel distance, and the positive and negative signs represent the direction). Assuming that the (second) original instruction output by the user is to adjust the adjustment reference point P2 to the target adjustment coordinate (4, 7), the displacement of the target adjustment coordinate is (-60, -30). Assuming that the (second) original instruction output by the user is to adjust the adjustment reference point P3 to the target adjustment coordinate (6, 3), the displacement of the target adjustment coordinate is (60, 30). Assuming that the (second) original instruction output by the user is to adjust the adjustment reference point P4 to the target adjustment coordinate (5, 5), the displacement of the target adjustment coordinate is (-50, 50). In one embodiment, the projection device 110 may calculate the adjustment angle and deformation amount required for adjusting the adjustment image 400 projected by the projection device 110 according to the second original instruction. For example, the projection device 110 may obtain the adjustment angle and deformation amount by calculating the slope change of the adjustment reference points P1-P4 according to the adjustment reference points P1-P4 or the displacement amounts DP1-DP4.

[0068] The pattern, shape, number and number of adjustment reference points of the pattern array of the present invention are not limited to Figure 4 In one embodiment, the number of the pattern arrays and the number of the adjustment reference points of the present invention can be at least one respectively.

[0069] FIG. 5A to FIG. 5E FIG. 1 is a schematic diagram of adjusting an adjustment screen according to an embodiment of the present invention. Figure 1 as well as FIG. 5A to FIG. 5E For example, Figure 5A As shown, the user can use voice control to make the projection device 110 project the adjustment screen 500 onto the projection target 300, wherein the adjustment screen 500 includes an outer frame 501, an inner frame 502, and a plurality of pattern arrays 511-514. The pattern arrays 511-514 may respectively include quadrilateral pattern arrays. In this embodiment, since the adjustment screen 500 before correction is a tilted screen or an irregular quadrilateral screen, the shape presented by the pattern arrays 511-514 is, for example, a tilted or irregular quadrilateral. The adjustment reference points P1-P4 are respectively located in the corresponding pattern arrays 511-514. The pattern arrays 511-514 are respectively located between the outer frame 501 and the inner frame 502, and the adjustment reference points P1-P4 are the four vertices of the outer frame 501. The user can adjust the positions of the adjustment reference points P1~P4 of the adjustment screen 500 one by one through voice control, so that the correction frame 300F on the projection target 300 can be located between the outer frame 501 and the inner frame 502 of the adjustment screen, or the outer frame 501 of the adjustment screen 500 overlaps with the correction frame 300F on the projection target 300.

[0070] like FIG. 5A to FIG. 5B As shown, the user may input, for example, the (second) original instruction of "move the adjustment reference point P1 in the upper left corner to the coordinate (7,7)". After conversion by the cloud server 130 and the natural language model 140, the projection device 110 may adjust the position of the adjustment reference point P1 to the original adjustment screen 500 (such as Figure 5A The coordinates (7, 7) of the upper left corner of the adjustment screen 500 are updated, and the adjustment reference point P1 of the upper left corner of the adjustment screen 500 is adjusted as shown in FIG. Figure 5B The adjusted reference point P1 may be located at the top left corner of the correction frame 300F of the projection target 300 , for example.

[0071] like FIG. 5B to FIG. 5C As shown, the user may input, for example, the (second) original instruction of "move the adjustment reference point P2 in the upper right corner to the coordinate (3,3)". After conversion by the cloud server 130 and the natural language model 140, the projection device 110 may correspondingly adjust the position of the adjustment reference point P2 to the original adjustment screen 500 (such as Figure 5B The coordinates (3, 3) of the upper right corner of the adjustment screen 500 are set, and the adjustment reference point P2 of the upper right corner of the adjustment screen 500 is updated. The result after adjustment is as follows: Figure 5CThe adjusted reference point P2 may be located at the top right corner of the correction frame 300F of the projection target 300 , for example.

[0072] like FIG. 5C to FIG. 5D As shown, the user may input, for example, the (second) original instruction of "move the adjustment reference point P3 in the lower left corner to the coordinates (3,5)". After conversion by the cloud server 130 and the natural language model 140, the projection device 110 may correspondingly adjust the position of the adjustment reference point P3 to the original adjustment screen 500 (such as Figure 5C The coordinates (3, 5) of the lower left corner of the adjustment screen 500 are set, and the adjustment reference point P3 of the lower left corner of the adjustment screen 500 is updated. The result after adjustment is as follows: Figure 5D The adjusted reference point P3 may be located at the vertex position of the lower left corner of the correction frame 300F of the projection target 300 , for example.

[0073] like FIG. 5D to FIG. 5E As shown, the user may input, for example, the (second) original instruction of "move the adjustment reference point P4 in the lower right corner to the coordinates (7, 8)". After conversion by the cloud server 130 and the natural language model 140, the projection device 110 may correspondingly adjust the position of the adjustment reference point P4 to the original adjustment screen 500 (such as Figure 5D The coordinates (7, 8) of the lower right corner of the adjustment screen 500 are updated, and the adjustment reference point P4 of the lower right corner of the adjustment screen 500 is adjusted as shown in FIG. Figure 5E The adjusted reference point P4 may be located at the vertex position of the lower right corner of the correction frame 300F of the projection target 300 , for example.

[0074] In this embodiment, since the adjusted picture 500 after correction is a non-tilted picture, the pattern arrays 511-514 are in the shape of rectangular grids. The four sides of the outer frame 501 of the adjusted picture 500 can be respectively parallel to the four sides of the correction frame 300F, for example, the outer frame 501 can overlap with the correction frame 300F, the correction frame 300F is located between the outer frame 501 and the inner frame 502, or the correction frame 300F at least partially overlaps with the outer frame 501 or the inner frame 502. In this way, the projection picture of the projection device 110 can be corrected, and the projection picture of the projection device 110 is located in the inner frame 502 of the adjusted picture 500, so as to effectively eliminate the trapezoidal distortion problem of the projection picture.

[0075] Figure 6 FIG. 1 is a schematic diagram of a projection device according to an embodiment of the present invention. Figure 6 In this embodiment, the projection device 610 includes at least one processor 611, a projection module 612 and a communication interface 613. The projection module can project the above Figure 4The projection device 610 may further include a storage device (not shown). The storage device may be, for example, a fixed or removable random access memory (RAM), a read-only memory (ROM), a flash memory, a hard disk, or other circuits or chips with similar functions or a combination of these devices.

[0076] In this embodiment, the projection module 612 may include, for example, related optical components such as a light source, a light valve, and a projection lens, and related circuit components. The communication interface 613 may be connected to the cloud server 630. The projection device 610 and the cloud server 630 may communicate with each other by wired and / or wireless communication methods. The wired communication method is, for example, a cable. The wireless communication method includes, for example, Wifi, Bluetooth, and / or the Internet.

[0077] In this embodiment, the communication interface 613 is, for example, a chip or circuit using wired and / or wireless communication technology or mobile communication technology, such as the Global System for Mobile Communications, third / fourth / fifth generation mobile communication technology, etc.

[0078] The projection device 610 may also have a built-in sound receiving device (microphone) to directly receive the first original instruction and the second original instruction in the form of voice data from the user. The at least one processor 611 may send the first original instruction and the second original instruction to the cloud server 630 via the communication interface 613. In one embodiment, the communication interface 613 may be connected to the terminal device (such as the above-mentioned Figure 1 The terminal device 120 of the embodiment receives a first original instruction and a second original instruction.

[0079] In this embodiment, the projection device 610 can communicate with the cloud server 630 via the communication interface 613 to provide the first original instruction and the second original instruction to the cloud server 630. The cloud server 630 can input the first original instruction and the second original instruction into the natural language model, and the natural language model can generate the corresponding first standard instruction and the second standard instruction. The cloud server 630 can directly provide the first standard instruction and the second standard instruction to the projection device 610. In this embodiment, the cloud server 630 can be connected to the natural language model, for example, by the Internet. In one embodiment, the natural language model can also be built into the cloud server 630.

[0080] In this embodiment, at least one processor 611 can receive the first standard command and the second standard command through the communication interface 613. At least one processor 611 can convert the first standard command and the second standard command into the first projector control code and the second projector control code according to the projection device information to control the projection module 612 and adjust the adjustment screen. The projection device 610 of this embodiment can directly detect the user's voice signal and generate a corresponding voice original command. The projection device 610 of this embodiment can obtain the corresponding standard command through the cloud server 630 and the natural language model to realize the function of effectively adjusting the adjustment screen by voice.

[0081] In addition, the specific implementation methods and related technical details of the original instructions, standard instructions and projector control codes of this embodiment can be referred to above. Figures 1 to 5E The embodiments of the present invention are described in detail herein, so no further details will be given here.

[0082] In summary, the projection system, projection device and control method thereof of the present invention have at least one of the following advantages. The projection system, projection device and control method thereof of the present invention can receive the natural language command of the user through the terminal device or the projection device, and can instantly identify the natural language command input by the user, and automatically generate corresponding standard commands, so that the projection device can project the adjustment picture, and adjust the position of the adjustment reference point of the adjustment picture, so as to realize the effective projection picture correction function.

[0083] However, the above is only the preferred embodiment of the present application, and it cannot be used to limit the scope of implementation of the present application. That is, all simple equivalent changes and modifications made according to the claims and the content of the invention are still within the scope of the patent of the present application. In addition, any embodiment or claim of the present application does not have to achieve all the purposes, advantages or features disclosed in this application. In addition, the abstract and title (invention name) are only used to assist in the retrieval of patent documents, and are not used to limit the scope of rights of the present application. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only used to name the name of the element or to distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. A method for controlling a projection device, characterized in that: The control method of the projection device comprises the following steps: Sending a first original command via a terminal device; In response to the first original instruction corresponding to the picture correction operation of the projection device, projecting an adjustment picture by the projection device, wherein the adjustment picture includes at least one pattern array and at least one adjustment reference point; sending a second original instruction by the terminal device; and In response to the second original instruction corresponding to adjusting the position of the at least one adjustment reference point in the adjustment screen, the position of the at least one adjustment reference point in the adjustment screen is adjusted by the projection device, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array.

2. The control method of the projection device according to claim 1, characterized in that: The at least one pattern array includes at least one grid pattern array, and the at least one adjustment reference point can be adjusted to any grid pattern in the at least one grid pattern array, or the at least one pattern array includes at least one dot pattern array, and the at least one adjustment reference point can be adjusted to any dot pattern in the at least one dot pattern array.

3. The control method of the projection device according to claim 1, characterized in that: The control method of the projection device also includes the following steps: Receiving the first original instruction by a cloud server, and inputting the first original instruction into a natural language model; Receiving the second original instruction by the cloud server, and inputting the second original instruction into the natural language model; The step of projecting the adjustment picture by the projection device comprises: Generate a first standard instruction according to the first original instruction by using the natural language model, and receive the first standard instruction by using the cloud server to control the projection device to project the adjustment picture; The step of adjusting the position of the at least one adjustment reference point in the adjustment picture by the projection device comprises: A second standard instruction is generated according to the second original instruction by the natural language model, and the second standard instruction is received by the cloud server to control the projection device to adjust the position of the at least one adjustment reference point in the adjustment frame.

4. The control method of the projection device according to claim 3, characterized in that: The steps of sending the first original instruction by the terminal device and sending the second original instruction by the terminal device include: The terminal device sends the first original command to the projection device, and the projection device sends the first original command to the cloud server; and The terminal device sends the second original command to the projection device, and the projection device sends the second original command to the cloud server.

5. The control method of the projection device according to claim 3, characterized in that: The step of inputting the first original instruction and the second original instruction into the natural language model comprises: Inputting the first original instruction and the rule instruction into the natural language model through the cloud server, so that the natural language model outputs the first standard instruction according to the first original instruction and the rule instruction; and The second original instruction and the rule instruction are input into the natural language model through the cloud server, so that the natural language model outputs the second standard instruction according to the second original instruction and the rule instruction.

6. The control method of the projection device according to claim 3, characterized in that: The control method of the projection device also includes the following steps: The cloud server sends the first standard command to the terminal device, so that the terminal device controls the projection device according to the first standard command.

7. The control method of the projection device according to claim 6, characterized in that: The step of controlling the projection device by the terminal device according to the first standard instruction includes: The terminal device converts the first standard command into a first projector control code according to the projection device information to control the projection device.

8. The control method of the projection device according to claim 3, characterized in that: The step of receiving the first standard instruction by the cloud server also includes: The cloud server converts the first standard command into a first projector control code according to the projection device information.

9. The control method of the projection device according to claim 8, characterized in that: The step of controlling the projection device according to the first standard instruction also includes: Receiving the first projector control code from the cloud server by the projection device; or The first projector control code is received from the cloud server by the terminal device, and the first projector control code is sent to the projection device.

10. The control method of the projection device according to claim 1, characterized in that: The step of adjusting the position of the at least one adjustment reference point in the adjustment frame by the projection device further includes: The adjustment angle and deformation amount of the adjustment screen are calculated according to the second original instruction.

11. The control method of the projection device according to claim 1, characterized in that: The adjustment screen further includes an outer frame and an inner frame, the at least one pattern array is located between the outer frame and the inner frame, the at least one adjustment reference point is a vertex of the outer frame, and the step of adjusting the position of the at least one adjustment reference point in the adjustment screen by the projection device further includes: Adjust the adjustment picture so that the correction frame on the projection target is located between the outer frame and the inner frame; or The adjustment screen is adjusted until the outer frame overlaps the correction frame on the projection target.

12. A projection system, characterized in that: The projection system comprises a terminal device and a projection device, wherein: The terminal device is used to send a first original command and a second original command; and The projection device is coupled to the terminal device; wherein in response to the first original instruction corresponding to the image correction operation of the projection device, the projection device is used to project an adjustment image, wherein the adjustment image includes at least one pattern array and at least one adjustment reference point; and In response to the second original instruction corresponding to adjusting the position of at least one adjustment reference point in the adjustment picture, the projection device is used to adjust the position of the at least one adjustment reference point in the adjustment picture, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array.

13. The projection system according to claim 12, characterized in that: The at least one pattern array includes at least one grid pattern array, and the at least one adjustment reference point can be adjusted to any grid pattern in the at least one grid pattern array, or the at least one pattern array includes at least one dot pattern array, and the at least one adjustment reference point can be adjusted to any dot pattern in the at least one dot pattern array.

14. The projection system according to claim 12, characterized in that: The projection system also includes a cloud server for receiving the first original instruction and the second original instruction, and inputting the first original instruction and the second original instruction into a natural language model, wherein the natural language model is used to generate a first standard instruction based on the first original instruction, and to generate a second standard instruction based on the second original instruction, the cloud server is used to receive the first standard instruction to control the projection device to project the adjustment screen, and the cloud server is used to receive the second standard instruction to control the projection device to adjust the position of the at least one adjustment reference point in the adjustment screen.

15. The projection system according to claim 14, characterized in that: The terminal device is used for sending the first original command and the second original command to the projection device, and the projection device is used for sending the first original command and the second original command to the cloud server.

16. The projection system according to claim 14, characterized in that: The cloud server is used to input the first original instruction and the rule instruction into the natural language model, so that the natural language model outputs the first standard instruction according to the first original instruction and the rule instruction. Furthermore, the cloud server is used to input the second original instruction and the rule instruction into the natural language model together, so that the natural language model outputs the second standard instruction according to the second original instruction and the rule instruction.

17. The projection system according to claim 14, characterized in that: The cloud server is used to send the first standard command to the terminal device, and the terminal device is used to control the projection device according to the first standard command.

18. The projection system according to claim 17, characterized in that: The terminal device is used for converting the first standard instruction into a first projector control code according to the projection device information to control the projection device.

19. The projection system according to claim 14, characterized in that: The cloud server is used for converting the first standard command into a first projector control code according to the projection device information.

20. The projection system according to claim 19, characterized in that The projection device is used to receive the first projector control code from the cloud server; or The terminal device is used for receiving the first projector control code and the second projector control code from the cloud server, and sending the first projector control code to the projection device.

21. The projection system according to claim 12, characterized in that: The natural language model is stored in the cloud server or connected to the cloud server via a wireless network.

22. A projection device, characterized in that: The projection device includes a projection module, a communication interface and a processor, wherein: The projection module is used to project the adjustment picture; The communication interface is used to receive a first original instruction and a second original instruction; and The processor is coupled to the projection module and the communication interface, and the processor is configured to execute: In response to the first original instruction corresponding to the image correction operation of the projection device, controlling the projection module to project the adjustment image, wherein the adjustment image includes at least one pattern array and at least one adjustment reference point; and In response to the second original instruction corresponding to adjusting the position of at least one adjustment reference point in the adjustment picture, the projection module is controlled to adjust the position of the at least one adjustment reference point in the adjustment picture, wherein the at least one adjustment reference point is located in the corresponding at least one pattern array.

23. The projection device according to claim 22, characterized in that: The communication interface is further used for sending the first original command and the second original command to the cloud server, and for receiving the first projector control code and the second projector control code sent by the cloud server.

24. The projection device according to claim 22, characterized in that: The communication interface is also used to send the first original instruction and the second original instruction to the cloud server, and to receive the first standard instruction and the second standard instruction sent by the cloud server. The processor is used to convert the first standard instruction and the second standard instruction into the first projector control code and the second projector control code according to the projection device information to control the projection module and adjust the adjustment screen.

25. The projection device according to claim 22, characterized in that: The processor is configured to execute: calculating an adjustment angle and a deformation amount of adjusting the adjustment frame according to the second original instruction.

26. The projection device according to claim 22, characterized in that: The adjustment screen also includes an outer frame and an inner frame, the at least one pattern array is located between the outer frame and the inner frame, the at least one adjustment reference point is the vertex of the outer frame, wherein the processor is configured to execute: controlling the projection module to adjust the adjustment screen to a correction frame on the projection target to be located between the outer frame and the inner frame, or adjusting the adjustment screen to a point where the outer frame overlaps with the correction frame on the projection target.

Images