Projection system and projection method

Abstract

The invention provides a projection system and a projection method. The projection system comprises a projection module, an image acquisition device, an input device and a processor. The processor is configured to: receive an input signal of an input device and generate an input instruction according to the input signal; driving the image acquisition device to acquire a target acquisition image, wherein the target acquisition image comprises a target image corresponding to the target object; transmitting the target captured image and the input instruction to a cloud server; receiving an analysis result generated by an artificial intelligence operation module from the cloud server based on the input instruction and the target image; determining display information according to an analysis result, and calculating a display position of the display information in the projection range; and driving the projection module to project an information image with display information. According to the projection system and the projection method provided by the invention, the target information corresponding to the target object can be projected and displayed around the target object in time.

Description

Technical Field

[0001] This invention relates to a projection mechanism for interacting with an artificial intelligence module, and more particularly to a projection system and projection method. Background Technology

[0002] With the development of projection technology, projectors can be used in more and more venues and spaces. In addition, with the advent of the artificial intelligence (AI) era, in addition to combining the technology of generating content using AI models with projectors, the technology of recognition using AI models can also be combined with projectors and applied to more venues and spaces.

[0003] Currently, the application scenarios of combining AI model technology with projectors are mostly to set or operate the internal functions of the projector through the AI ​​model, such as turning the projector on and off, adjusting the projector's color mode, etc. There has been no further integration of recognition-type AI models and content-generating AI models with projectors to upgrade the smart home functions of projectors.

[0004] The "Background Art" paragraph is only used to help understand the content of this invention. Therefore, the content disclosed in the "Background Art" paragraph may include some known technologies that are not known to those skilled in the art. The content disclosed in the "Background Art" paragraph does not mean that the content or the problems to be solved by one or more embodiments of this invention were known or understood by those skilled in the art prior to this application. Summary of the Invention

[0005] This invention provides a projection system and projection method that can instantly project and display target information corresponding to a target object around the target object.

[0006] Other objects and advantages of the present invention can be further understood from the technical features disclosed herein.

[0007] To achieve one, some, or all of the above objectives, or other objectives, the projection system of the present invention is used for communication connection to a cloud server, the cloud server having an artificial intelligence (AI) computing module. The projection system includes: a projection module, an input device, a processor, and an image capturing device; wherein the processor is connected to the projection module, the image capturing device, and the input device. The processor is configured to: receive at least one input signal from the input device and generate an input command based on the input signal; after receiving the input signal, drive the image capturing device to capture an image of a target environment space containing a target object, and acquire a target captured image, wherein the target captured image includes a target image corresponding to the target object; after receiving the target captured image, transmit the target captured image and the input command to the cloud server; receive analysis results from the cloud server, wherein the analysis results include target information corresponding to the target object, the analysis results being generated by the AI ​​computing module based on the input command and the target image; determine display information based on the analysis results, and calculate the display position of the display information within the projection range, wherein the display information includes the target information; and drive the projection module to project an information image containing the display information into the target environment space.

[0008] The projection method of the present invention is used in a projection system and a cloud server connected to the projection system. The projection system includes a projection module, an image capturing device, an input device, and a processor. The processor is connected to the projection module, the image capturing device, and the input device. The cloud server has an AI computing module. The projection method includes the following steps performed by the processor: receiving at least one input signal from the input device and generating an input command based on the input signal; after receiving the input signal, driving the image capturing device to capture an image towards a target environment space containing a target object and acquiring a target captured image, wherein the target captured image includes a target image corresponding to the target object; after receiving the target captured image, transmitting the target captured image and the input command to the cloud server; receiving an analysis result from the cloud server, wherein the analysis result includes target information corresponding to the target object, the analysis result being generated by the AI ​​computing module based on the input command and the target image; determining display information based on the analysis result and calculating the display position of the display information within the projection range, wherein the display information includes the target information; and driving the projection module to project an information image containing the display information towards the target environment space.

[0009] Based on the above, the present invention provides a projection system with an image capturing device and a projection module. It is equipped with an AI computing module located in the cloud to perform AI calculations, identifying target objects such as objects or text in the images captured by the image capturing device of the projection system. After the target information of the target object is identified by the AI ​​computing module, the target information can be projected and displayed next to the actual target object in real time through the projection module. This facilitates viewing for the user. Attached Figure Description

[0010] Figure 1 This is a schematic diagram of an application scenario of a projection system according to the first embodiment of the present invention.

[0011] Figure 2 This is a flowchart of the projection method according to the first embodiment of the present invention.

[0012] Figure 3 This is a schematic diagram of the projected information image according to the first embodiment of the present invention.

[0013] Figure 4 This is a flowchart illustrating the overall operation of the projection system according to the first embodiment of the present invention.

[0014] Figure 5 This is a block diagram of a projection system according to a second embodiment of the present invention.

[0015] Figure 6 This is a block diagram of a projection system according to a third embodiment of the present invention.

[0016] Figure 7 This is a block diagram of a projection system according to the fourth embodiment of the present invention.

[0017] Figure 8 This is a block diagram of a projection system according to the fifth embodiment of the present invention.

[0018] Figure 9 This is a block diagram of a projection system according to the sixth embodiment of the present invention.

[0019] Figure 10 This is a block diagram of a projection system according to the seventh embodiment of the present invention.

[0020] Figure 11 This is a flowchart illustrating the overall operation of a projection system according to another embodiment of the present invention.

[0021] Explanation of reference numerals in the attached figures:

[0022] 100: Projection System

[0023] 110: Processor

[0024] 120: Projection Module

[0025] 130: Image capturing device

[0026] 140: Input device

[0027] 150: Cloud Server

[0028] 160: AI computing module

[0029] 300: Information Images

[0030] 310: Target Information

[0031] 320: Object Image

[0032] 500, 600, 700, 800: Projectors

[0033] 510: Communication Module

[0034] 910: Voice Player

[0035] 1010: Image Processing Unit

[0036] R1: Capture Range

[0037] R2: Projection range

[0038] T: Target object

[0039] S205~S230, S405~S415: Steps. Detailed Implementation

[0040] The foregoing descriptions and other technical contents, features, and effects of this invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms used in the following embodiments, such as up, down, left, right, front, or back, are merely for reference to the accompanying drawings. Therefore, the directional terms used are for illustrative purposes and not for limiting the invention.

[0041] Figure 1 This is a schematic diagram illustrating an application scenario of the projection system according to the first embodiment of the present invention. In this embodiment, the projection system 100, equipped with an artificial intelligence (AI) computing module 160, identifies a target object T in the actual space, calculates the target information for the target object T, and projects the target information onto the surrounding area of ​​the target object T in the actual space in real time. The artificial intelligence (AI) computing module 160 is located in a cloud server 150.

[0042] Please refer to Figure 1The projection system 100 includes a processor 110, a projection module 120, an image capturing device 130, and an input device 140. The processor 110 is coupled to the projection module 120, the image capturing device 130, and the input device 140. There may be one or more processors 110; for ease of explanation, only one processor 110 is shown here. The coupling is, for example, an electrical signal connection.

[0043] The processor 110 may be a central processing unit (CPU), a physical processing unit (PPU), a programmable microprocessor, an embedded control chip, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital data processor (DDP), a digital controller, or other similar devices.

[0044] The projection module 120 receives image data from the processor 110 and projects the image data onto a projection target such as a screen, tabletop, or wall to form a projected image. The projection module 120 includes components such as an imaging element (e.g., a light valve), a projection lens, a light source, and optical elements for transmitting the light beam (e.g., mirrors, beam splitters, lenses, etc.). The light source includes, for example, a light-emitting diode (LED), a laser diode (LD), or a combination thereof. The imaging element (e.g., the light valve) is, for example, a reflective light modulator such as a liquid crystal on silicon panel (LCoS panel) or a digital micromirror device (DMD). In some embodiments, the imaging element (e.g., a light valve) may also be a transparent liquid crystal panel, an electro-optic modulator, a magneto-optic modulator, an acousto-optic modulator (AOM), or other transmissive light modulators.

[0045] The image capturing device 130 may be, for example, a camera or a video camera that employs a charge-coupled device (CCD) lens or a complementary metal oxide semiconductor transistor (CMOS) lens. The image capturing device 130 may be configured within a projector, or it may be a separate device distinct from the projector, used for external connection to the projector; it is not limited to these options.

[0046] In this embodiment, the input device 140 is used to receive user input operations and generate corresponding input signals accordingly. The input device 140 can be electrically connected to the processor 110, or it can communicate with the processor 110 via a communication module to transmit input signals to the processor 110. The input device 140 may be, for example, a voice receiver (microphone) used to receive the user's voice as a voice input signal. Alternatively, in another embodiment, the input device 140 may be, for example, an infrared remote control device. When the projection module 120 projects a virtual keyboard image, the user's input operations can be received through the operation of the infrared remote control device to generate input signals. Alternatively, in other embodiments, the input device 140 may be, for example, a portable smart device, where an input interface is displayed on the portable smart device's screen via an application program, thereby generating input signals through user input operations. Furthermore, in other embodiments, the projection system 100 may include multiple input devices 140, which is not limited here.

[0047] In this embodiment, the processor 110 may have a built-in communication module to enable network transmission. The communication module may use technologies such as Wireless Local Area Networks (WLAN), Wi-Fi, Bluetooth, Near-Field Communication (NFC), or Infrared (IR).

[0048] In this embodiment, an image capturing device 130 is used to acquire a target image, and an AI computing module 160 located on a cloud server 150 is used to identify a target object T located within the capturing range R1 in the target image, thereby obtaining target information for the target object T. Then, the projection module 120 is driven to project an information image including the target information within the projection range R2. For example, the projection module 120 can instantly project and display the information image next to the target object T. Here, the capturing range R1 of the image capturing device 130 and the corresponding projection range R2 of the projection module 120 partially or completely overlap. Therefore, it is clear that the target information (display information) to be projected to the position adjacent to the target object T can be clearly determined.

[0049] The projection system 100 may include a memory coupled to the processor 110, or the processor 110 may have a built-in memory. In one embodiment, the memory may pre-store the coordinate relationship between the capture range R1 of the image capturing device 130 and the projection range R2 of the projection module 120, i.e., the coordinate relationship obtained after performing coordinate transformation operations between the two ranges in advance. In another embodiment, when the projection system 100 is first started, the capture range R1 of the image capturing device 130 and the projection range R2 of the projection module 120 may be corrected to obtain the coordinate relationship between the capture range R1 and the projection range R2, and then stored in the memory of the projection system 100.

[0050] Figure 2 This is a flowchart of the projection method according to the first embodiment of the present invention. Please refer to... Figure 1 and Figure 2 In step S205, the processor 110 receives an input signal from the input device 140 and generates an input command based on the input signal. Next, after receiving the input signal, in step S210, the processor 110 drives the image capturing device 130 to capture images of the target environment space containing the target object T, and acquires a target captured image. Here, the target captured image includes a target image corresponding to the target object T.

[0051] After the processor 110 receives the target captured image, in step S215, the processor 110 transmits the target captured image and input command to the cloud server 150. Furthermore, in step S220, the processor 110 receives the analysis results from the cloud server 150. Here, the analysis results include target information corresponding to the target object T. The analysis results are generated by the AI ​​computing module 150 based on the input command and the target image in the target captured image.

[0052] In one embodiment, the cloud server 150 uses the AI ​​computing module 160 to perform image recognition on the captured image based on input commands to obtain the target image of the corresponding target object T. Then, based on the input commands, it queries and automatically generates target information corresponding to the target object T. Here, the AI ​​computing module 160 is an AI model that supports image recognition. For example, the AI ​​computing module 160 can be implemented using a large language model that supports image recognition, such as a Chat Generative Pre-trained Transformer (ChatGPT), Google Gemini, or Claude. However, this is only an example and is not a limitation.

[0053] The input command serves as a prompt for the AI ​​processing module 160. Based on the input command (prompt), the AI ​​processing module 160 identifies the target object T (e.g., a physical object) corresponding to the target image from the captured image. After further performing AI calculations on the target object T, it generates analysis results. These analysis results include target information such as the type, size, appearance, recipe, or nutritional value of the target object T. The target information can be presented in text format, as a voice signal, or simultaneously in both text format and voice signal. The cloud server 150 transmits the analysis results back to the projection system 100.

[0054] In step S225, the processor 110 determines the display information and calculates the display position of the display information within the projection range R2 based on the analysis results. For example, after the cloud server 150 performs image recognition on the target captured image based on the input command through the AI ​​computing module 160, it can obtain the target image corresponding to the target object T and the coordinate information of the target image (e.g., the coordinates of the four corners of the target image) from the target captured image, and encapsulate the coordinate information of the target image into the analysis results to be transmitted to the projection system 100. Accordingly, the processor 110 can determine the display position of the display information within the projection range R2 based on the coordinate information of the target image.

[0055] In one embodiment, in the projection system 100, the processor 110 pre-stores the coordinate relationship between the capture range R1 and the projection range R2 of the corresponding image capturing device 130. For example, the projection system 100 includes a memory that pre-stores the coordinate relationship between the capture range R1 and the projection range R2. The processor 110 can read the coordinate relationship between the capture range R1 and the projection range R2 from the memory, and based on the coordinate relationship, calculate the coordinate position of the target image in the target captured image within the projection range R2. Furthermore, based on the coordinate position and the analysis result, the processor 110 determines the display position of the display information within the projection range R2. Here, the target object T and the display information on the projected information image have an adjacent configuration relationship in the target environment space.

[0056] The processor 110 can calculate the first coordinate information of the target object T located in the capture range R1 based on the analysis results returned by the cloud server 150. The first coordinate information is, for example, the coordinate positions P1, P2, P3, and P4 of the target image corresponding to the target object T relative to the four corners of the capture range R1. Next, the processor 110 calculates the second coordinate information of the target image (corresponding to the target object T) in the target captured image in the projection range R2 based on the coordinate relationship between the capture range R1 and the projection range R2. For example, based on the coordinate relationship, the four coordinate positions P1, P2, P3, and P4 of the capture range R1 are converted into four coordinate positions P1', P2', P3', and P4' of the projection range R2. The second coordinate information includes the coordinate positions P1', P2', P3', and P4'. Afterward, the processor 110 can determine the display position of the display information in the projection range R2 based on the second coordinate information in the projection range R2.

[0057] Subsequently, in step S230, the processor 110 drives the projection module 120 to project an information image containing display information toward the target environment space. In one embodiment, the display information may only include target information. In another embodiment, the analysis result includes not only target information but also an object image corresponding to the target object T. The object image may be an AI-synthesized image generated by the AI ​​computing module 160, or an image searched by the AI ​​computing module 160 from publicly available online sources.

[0058] Figure 3 This is a schematic diagram of the projected information image according to the first embodiment of the present invention. Please refer to... Figure 3 The information displayed in the information image 300 includes target information 310 and object image 320. For example... Figure 3As shown, the target information 310 and the object image 320 are located around the target object T. That is, the target object 310 and the display information 310 on the projected information image 300 have an adjacent configuration relationship in the target environment space.

[0059] Figure 4 This is a flowchart illustrating the overall operation of the projection system according to the first embodiment of the present invention. This embodiment is based on... Figure 2 Application examples of steps S205 to S230. Please refer to... Figure 1 and Figure 4 In step S405, the processor 110 receives a start signal and, in response to the start signal, activates the image capturing device 130 and / or the input device 140. For example, the start signal may come from the operation of the input interface of a portable smart device, thereby causing the processor 110 to activate the image capturing device 130 and / or the input device 140 (microphone). Alternatively, the start signal may come from a button on an infrared remote control device, thereby activating the image capturing device 130 and / or the input device 140 (microphone) through the user's operation of the button. Or, the start signal may come from a physical button disposed on the projector housing where the projection module 120 is located, thereby activating the image capturing device 130 and / or the input device 140 (microphone) through the user's operation of the physical button.

[0060] In step S410, the processor 110 determines whether an input signal has been received. If an input signal is received, steps S205 to S230 are executed. After projecting the information image, the processor 110 returns to step S410 and continues to determine whether another input signal has been received. If so, steps S205 to S230 are continued. If no other input signal is received, the recognition process stops, and the process returns to the state before step S410.

[0061] In one embodiment, the processor 110 and the projection module 120 can be configured within a projector, while the image capturing device 130 and the input device 140 can be configured within the projector or connected externally to the projector, depending on the actual application. The second to fifth embodiments are described below.

[0062] Figure 5 This is a block diagram of a projection system according to a second embodiment of the present invention. Figure 5 In the projection system 100, there are a projector 500 and an image capturing device 130 and an input device 140 connected to the projector 500. The projector 500 includes a processor 110, a projection module 120, and a communication module 510. In the second embodiment, the communication module 510 is not configured within the processor 110, but is configured within the projector 500 and connected to the processor 110 to perform network transmission functions, but is not limited thereto.

[0063] The communication module 510 is coupled to the processor 110 and communicatively connected to the input device 140 and the image capturing device 130. The communication module 510 receives target captured images from the image capturing device 130 and input signals from the input module 130. Furthermore, the communication module 510 transmits the target captured images and input signals to the processor 110, and also transmits the target captured images and corresponding input commands to the cloud server 150.

[0064] The communication module 510 can be one or any combination of a Bluetooth transmitter and receiver, a WiFi module, an NFC module, an IR module, a wired communication interface, and a wireless communication interface. The wired communication interface can be implemented using a Universal Serial Bus (USB) port, a General Purpose Interface Bus (GPIB) port, or a Local Area Network (LAN) port. The wireless communication interface can be implemented using a WLAN interface, a cellular network communication interface, or a combination thereof.

[0065] In one embodiment, the input device 140 is wirelessly connected to the communication module 510 of the projector 500. The input device 140 may be, for example, an infrared remote control or a portable smart device, such as a smartphone, head-mounted display, smart TV, smartwatch, tablet computer, all-in-one computer, or laptop computer.

[0066] In an architecture where the input device 140 is an infrared remote control device, the infrared remote control device transmits an infrared activation signal (as the activation signal) to the communication module 510 of the projector 500. The communication module 510 transmits the infrared activation signal to the processor 110, which drives the projection module 120 to project a keyboard image with multiple key options and receives one or more infrared control signals (as input signals) from the infrared remote control device. For example, the input device 140 selects one or more key options on the keyboard image to generate corresponding infrared control signals. The processor 110 generates text content based on the received infrared control signals (input signals) and generates input instructions based on the text content.

[0067] In the architecture of the input device 140 as a portable smart device, the portable smart device includes an application corresponding to the projector 500. After the application is opened, the portable smart device displays an input interface. By performing an input operation on the input interface, at least one wireless control signal (as an input signal) is generated. The communication module 510 receives the at least one wireless control signal (input signal) and transmits it to the processor 110. The processor 110 generates an input command based on the received at least one wireless control signal (input signal).

[0068] Figure 6 This is a block diagram of a projection system according to a third embodiment of the present invention. Figure 6 In this system, projection system 100 includes a projector 600 and an image capturing device 130 externally connected to the projector 600. The projector 600 includes a processor 110, a projection module 120, an input device 140, and a communication module 510. The communication module 510 is coupled to both the processor 110 and the image capturing device 130. The communication module 510 receives a target captured image from the image capturing device 130. Furthermore, the communication module 510 transmits the target captured image and an input command corresponding to the input signal to a cloud server 150. Here, the input device 140 is, for example, a voice receiver (microphone). The voice receiver receives at least one voice signal, which is an input signal. After receiving the at least one voice signal, the input device 140 transmits it to the processor 110, and the processor 110 generates an input command based on the received at least one voice signal (input signal).

[0069] Figure 7 This is a block diagram of a projection system according to a fourth embodiment of the present invention. Figure 7 In the projection system 100, a projector 700 and an input device 140 connected to the projector 700 are included. The projector 700 includes a processor 110, a projection module 120, an image capturing device 130, and a communication module 510. The processor 110 is coupled to the projection module 120, the image capturing device 130, and the communication module 510. The communication module 510 transmits the target captured image and input commands corresponding to the input signals to a cloud server 150 (e.g., [missing information]). Figure 1 (As illustrated). In this embodiment, the input device 140 is wirelessly connected to the communication module 510 of the projector 500. The input device 140 is, for example, an infrared remote control device or a portable smart device. The architecture of the input device 140 as an infrared remote control device and the architecture of the input device 140 as a portable smart device can be referred to the above description, and will not be repeated here.

[0070] Figure 8 This is a block diagram of a projection system according to a fifth embodiment of the present invention. Figure 8 In the projection system 100, a projector 800 is included. The projector 800 includes a processor 110, a projection module 120, an image capturing device 130, an input device 140, and a communication module 510. The processor 110 is coupled to the projection module 120, the image capturing device 130, the input device 140, and the communication module 510.

[0071] In one embodiment, each of the projectors 500, 600, 700, and 800 further includes at least one storage device. The storage device may be implemented using any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or other similar devices or combinations thereof. Computer-executable program code, comprising one or more instructions, is stored in the storage device. The storage device is connected to a processor 110, which executes the one or more instructions to implement the steps of the projection method described above.

[0072] Figure 9 This is a block diagram of a projection system according to the sixth embodiment of the present invention. Figure 9 In the middle, projection system 100 and Figure 1 The difference in the projection system lies in that, in addition to including a processor 110, a projection module 120, an image capturing device 130, and an input device 140, the projection system 100 also includes a communication module 510 and a voice player 910. The communication module 510 and the voice player 910 are respectively coupled to the processor 110. After determining the display information for the corresponding target object, the processor 110 can further convert the display information into target voice information, and then drive the voice player 910 to play the target voice information. For example, while the projection module 120 projects an image with display information, the voice player 910 can be driven to play the target voice information.

[0073] Figure 10 This is a block diagram of a projection system according to the seventh embodiment of the present invention. Figure 10 In the middle, projection system 100 and Figure 1The difference between the projection systems is that, in addition to including a processor 110, a projection module 120, an image capturing device 130, and an input device 140, the projection system 100 also includes a communication module 510 and an image processing unit 1010. The processor 110 is coupled to both the communication module 510 and the image processing unit 1010. The image processing unit 1010 receives display information and display position from the processor 110 to generate an information image and transmits the information image to the projection module 120. The image processing unit 1010 is, for example, a graphics processing unit (GPU).

[0074] In practical applications, each of the projectors 500, 600, 700, and 800 can be operated using an application (APP) or an input device 140, such as an infrared remote control or a portable smart device. For example, when the projector is turned on, the APP stored inside the projector can drive the projection module 120 to project a virtual keyboard image, or the input device 140 can be used to drive the projection module 120 to project a virtual keyboard image. The input device 140 can then select the key options on the keyboard image, thereby generating an input signal. Upon receiving the input signal, the processor 110 drives the image capturing device 130 to take a picture.

[0075] Taking the input device 110, which includes an infrared remote control device and a voice receiver, as an example, please refer to [reference needed]. Figure 1 Target object T (e.g., apple) (see reference) Figure 1 The image capture device 130 can be placed in a target environment space, which may include a table for placing the target object T. The target object T is placed within the capture range R1 of the image capture device 130. When the user presses a button on the infrared remote control device or executes the APP installed on the projection system 100, a start signal is generated. The processor 110 starts the image capture device 130 and the voice receiver (input device) according to the start signal. If the user says "Please tell me what this is", the voice receiver will transmit the received voice signal as an input signal to the processor 110, and the processor 110 will drive the image capture device 130 to capture an image within its capture range R1 (target environment space).

[0076] The processor 110 generates an input command (a prompt word to be input to the AI ​​computing module 160) based on the input signal "Please tell me what this is". The processor 110 controls the image capturing device 130 to capture an image within its capturing range R1 and generate a target captured image, which is then transmitted to the processor 110. The processor 110 then transmits the target captured image and the input command (prompt word) to the cloud server 150 via the communication module 510. The AI ​​computing module 160 of the cloud server 150 recognizes the input command through voice recognition and identifies the target image corresponding to the target object T in the target captured image through image recognition. The AI ​​computing module 160 obtains analysis results based on the target captured image and the input command. The analysis results obtained by the AI ​​computing module 160 may include target information such as the type, size, appearance, recipe, or nutritional value of the target object T. The analysis results can be in text or voice format.

[0077] The cloud server 150 transmits the analysis results (e.g., in text format) back to the projection system 100. The projection system 100 receives the analysis results from the cloud server 150 via the communication module 510. The processor 110 determines the display information and calculates the display position based on the analysis results, generates an information image, and drives the projection module 120 to project the information image. Additionally, in Figure 10 In this embodiment, the processor 110 can transmit the analysis results to the image processing unit 1010, whereby the image processing unit 1010 determines the display information and calculates the display position based on the analysis results, thereby generating an information image. Next, the image processing unit 1010 transmits the information image to the projection module 120, which projects the image to form an information image corresponding to the analysis results. The projected information image includes, for example,... Figure 3 The target information 310 for the target object T (e.g., an apple) is shown. Figure 3 As shown, the target information 310 is displayed on the information image 300 around the target object T. That is, the target object 310 and the displayed information 310 on the projected information image 300 have an adjacent configuration relationship in the target environment space.

[0078] Alternatively, the position of the information to be displayed on the information image can be preset for users to view.

[0079] In other embodiments, it is not limited to projecting the display information corresponding to the target object T through the projection module 120; it can also be as follows: Figure 9As shown, the processor 110 can generate target speech information based on the analysis results and transmit it to the voice player 910 to play the target speech information. On the other hand, in another embodiment, when the processor 110 receives the analysis results, if it receives a user's voice command, such as the voice command "please read aloud", the processor 110 will transmit the corresponding "please read aloud" input command to the AI ​​computing module 160 of the cloud server 150 for processing via the communication module 510. After processing, the cloud server 150 will provide the processor 110 with analysis results containing semantic information, so that the processor 110 can control the voice player 910 to play the speech based on the semantic information in the analysis results.

[0080] In another embodiment, the user can also simultaneously say "Please tell me what this is" and "Please read aloud" as input signals. At this time, the processor 110 will transmit the input commands corresponding to "Please tell me what this is" and "Please read aloud" to the AI ​​computing module 160 of the cloud server 150 through the communication module 510 for AI computing and recognition. The cloud server 150 will then provide the analysis results to the processor 110, including semantic information related to the reading. The processor 110 will then drive the projection module 120 to project information images based on the analysis results, and also control the voice player 910 to play the target voice information.

[0081] In another embodiment, the input device 110 includes an infrared remote control and a voice receiver as an example. The target object T can also be a foreign language book or magazine that needs to be translated. The page to be translated can be placed in a target environment space, which may include, for example, a table for placing the target object. The target object T is placed, for example, within the capture range R1 (target environment space) of the image capturing device 130. When the user presses a button on the infrared remote control or executes the APP installed on the projection system 100, the processor 110 activates the image capturing device 130 and the voice receiver. Suppose the user says the voice signal "Please translate this book into Chinese," the voice receiver will transmit the received voice signal as an input signal to the processor 110, and the processor 110 will drive and control the image capturing device 130 to capture an image within its capture range R1 (target environment space).

[0082] The processor 110 generates an input command (a prompt word to be input to the AI ​​computing module 160) based on the input signal "Please translate this book into Chinese". The processor 110 controls the image capturing device 130 to capture an image of the target environment space within its capturing range R1 and generate a target captured image, which is then transmitted to the processor 110. The processor 110 then transmits the target captured image and the input command (prompt word) to the cloud server 150 via the communication module 510. The AI ​​computing module 160 of the cloud server 150 recognizes the input command through voice recognition and determines the language of the text in the target image through image recognition. The AI ​​computing module 160 then determines that a translation service is needed and transmits the analysis result (i.e., the translated text) back to the projection system 100.

[0083] The processor 110 determines the information to be displayed based on the analysis results, calculates the display position, generates an information image with translated text, and drives the projection module 120 to project the information image. The projected content includes the translated text, which can be displayed around the pages of a book or magazine on the information image.

[0084] Figure 11 This is a flowchart illustrating the overall operation of a projection system according to another embodiment of the present invention. This embodiment is based on... Figure 2 In this embodiment, the processor 110 determines whether the target object has changed, based on the application example of steps S205 to S230. Please refer to... Figure 1 , Figure 4 and Figure 11 The process of this embodiment is the same as Figure 4 The difference lies in step S230, after projecting the information image, proceeding to step S415, where the processor 110 determines whether a change in the target object T is detected. If so, proceed to step S210. If not, return to step S410. The processor 110 can determine whether the target object T has changed by detecting, for example, a user turning pages in a book or magazine, or detecting a change in the target object using a sensor. The detector can be an image capturing device 130 or an infrared sensor, etc., and this invention is not limited to these. For example, after the user turns a page, if the processor 110 determines that the target object T has changed, it will automatically drive the image capturing device 130 to capture the next page and transmit the currently acquired target image to the cloud server 150. This allows the AI ​​computing module 160 to continuously update and return the translated text of the currently acquired target image until the user gives the voice command "Stop translation function" to end the translation function. Translating to Chinese is just an example; it can also be translated to other languages, and is not limited to this. Through the above process, the projection system in this case can generate updated information images in real time according to changes in the target object.

[0085] The above-described method of providing voice commands is an example and is not limited to it. Any method that can receive user-required commands falls under the concept to be protected in this case. For example, in other embodiments, the user can also provide input signals to the processor 110 through text input. For example, the projection module 120 can project a keyboard image with multiple key options. The user can input text on the virtual keyboard image through, for example, an infrared remote control device and provide the input signals to the processor 110.

[0086] In summary, this invention combines AI technology with a projection system, upgrading the smart home functionality of the projection system and enabling its application in more venues and occasions. In the above embodiments, the projection system, equipped with an image capturing device and a projection module, is paired with a cloud-based AI computing module to perform AI calculations. This allows the system to identify images or physical objects within the projection range of the projection module, calculate information about the target object, and project it in real-time around the object. This facilitates viewing for the user.

[0087] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Any simple equivalent changes and modifications made in accordance with the claims and description of the invention are still within the scope of this patent. Furthermore, no embodiment or claim of the present invention needs to achieve all the objectives, advantages, or features disclosed in the invention. In addition, the abstract and title (invention title) are only used to assist in patent document retrieval and are not intended to limit the scope of the invention. Furthermore, the terms "first," "second," etc., mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. A projection system, characterized by The projection system is used for communication connection with a cloud server, the cloud server has an artificial intelligence operation module, the projection system includes a projection module, an input device, a processor and an image capturing device; wherein the processor is connected to the projection module, the image capturing device and the input device, wherein the processor is configured to: receive at least one input signal from the input device, and generate an input instruction according to the at least one input signal; after receiving the at least one input signal, drive the image capturing device to capture images towards a target environment space with a target object, and obtain a target captured image, wherein the target captured image includes a target image corresponding to the target object; after receiving the target captured image, transmit the target captured image and the input instruction to the cloud server; receive an analysis result from the cloud server, wherein the analysis result includes target information corresponding to the target object, the analysis result is generated by the artificial intelligence operation module based on the input instruction and the target image; determine display information according to the analysis result, and calculate the display position of the display information in the projection range, wherein the display information includes the target information; and drive the projection module to project an information image with the display information towards the target environment space.

2. The projection system of claim 1, wherein, The processor pre-stores the coordinate relationship between the capturing range of the image capturing device and the projection range, and the processor is configured to: based on the coordinate relationship, calculate the coordinate position of the target image in the target captured image in the projection range; and based on the coordinate position and the analysis result, determine the display position of the display information in the projection range, wherein the target object and the display information on the projected information image have a neighboring configuration relationship in the target environment space.

3. The projection system of claim 1, wherein, The projection system includes a projector, the image capturing device is circumscribed around the projector, the projector includes the projection module, the processor and a communication module, the communication module is coupled to the processor, the input device and the image capturing device, wherein the processor drives the image capturing device to capture images through the communication module, receives the target captured image from the image capturing device through the communication module, and transmits the target captured image and the input instruction to the cloud server through the communication module.

4. The projection system of claim 3, wherein, The projector includes the input device, the input device includes a voice receiver, the voice receiver is used to receive at least one voice signal, the at least one voice signal is the at least one input signal.

5. The projection system of claim 3, wherein, The input device is wirelessly connected to the communication module of the projector, the input device is an infrared remote control device, the infrared remote control device is used to transmit at least one infrared control signal to the communication module of the projector, the at least one infrared control signal is the at least one input signal, wherein the processor is configured to: driving the projection module to project a keyboard image having a plurality of key options; receiving the at least one infrared control signal from the infrared remote control device, wherein the at least one key option on the keyboard image is selected by the input device to correspondingly generate the at least one infrared control signal; generating text content according to the at least one infrared control signal; and generating the input instruction according to the text content.

6. The projection system of claim 3, wherein, The input device is wirelessly connected to the communication module of the projector, and the input device is a portable smart device configured to transmit at least one wireless control signal to the communication module of the projector, wherein the at least one wireless control signal is the at least one input signal.

7. The projection system of claim 6, wherein, The portable smart device includes an application corresponding to the projector, and when the application is opened, the portable smart device correspondingly displays an input interface, and the at least one wireless control signal is correspondingly generated by performing an input operation on the input interface.

8. The projection system of claim 1, wherein, The projection system includes a projector, wherein the projector includes the image capturing device, the projection module, the processor, and the communication module, and the communication module is respectively coupled to the processor and the input device.

9. The projection system of claim 8, wherein, The projector includes the input device, and the input device includes a voice receiver configured to receive at least one voice signal, wherein the at least one voice signal is the at least one input signal, and the processor is configured to: receive the at least one voice signal from the voice receiver and generate the input instruction according to the at least one voice signal; and transmit the target captured image and the input instruction to the cloud server via the communication module.

10. The projection system of claim 8, wherein, The input device is wirelessly connected to the communication module of the projector, and the input device is an infrared remote control device configured to transmit at least one infrared control signal to the communication module of the projector, wherein the at least one infrared control signal is the at least one input signal, and the processor is configured to: drive the projection module to project a keyboard image having a plurality of key options; receive the at least one infrared control signal from the infrared remote control device, wherein the at least one key option on the keyboard image is selected by the input device to correspondingly generate the at least one infrared control signal; generate text content according to the at least one infrared control signal; generate the input instruction according to the text content; and transmit the target captured image and the input instruction to the cloud server via the communication module.

11. The projection system of claim 8, wherein, The input device is wirelessly connected to the communication module of the projector, and the input device is a portable smart device configured to transmit at least one wireless control signal to the communication module of the projector, wherein the at least one wireless control signal is the at least one input signal, and the processor is configured to: receive the at least one wireless control signal from the portable smart device via the communication module; and transmitting the target captured image and the input instruction to the cloud server via the communication module.

12. The projection system of claim 11, wherein, The portable smart device includes an application corresponding to the projector, and after the application is opened, the portable smart device corresponds to display an input interface, and by performing input operations on the input interface, the at least one wireless control signal is generated.

13. The projection system of claim 1, wherein, The processor is configured to: receive a start signal; and in response to the start signal, start the image capturing device and / or the input device.

14. The projection system of claim 1, wherein, The projection system further includes a voice player coupled to the processor, wherein the processor is configured to: convert the display information into target voice information, and drive the voice player to play the target voice information.

15. The projection system of claim 1, wherein, The capturing range corresponding to the image capturing device and the projection range corresponding to the projection module partially or entirely overlap.

16. The projection system of claim 2, wherein, The projection system further includes an image processing unit coupled to the projection module and the processor, respectively, wherein the image processing unit receives the display information and the display position from the processor to generate the information image, and transmits the information image to the projection module.

17. A projection method characterized by, The projection method is used in a projection system and a cloud server communicatively connected to the projection system, the projection system includes a projection module, an image capturing device, an input device, and a processor, the processor is connected to the projection module, the image capturing device, and the input device, the cloud server has an artificial intelligence operation module, the projection method includes the following steps performed by the processor: receiving at least one input signal from the input device, and generating an input instruction according to the at least one input signal; after receiving the at least one input signal, driving the image capturing device to capture images towards a target environment space having a target object, and obtaining a target captured image, wherein the target captured image includes a target image corresponding to the target object; after receiving the target captured image, transmitting the target captured image and the input instruction to the cloud server; receiving an analysis result from the cloud server, wherein the analysis result includes target information corresponding to the target object, the analysis result is generated by the artificial intelligence operation module based on the input instruction and the target image; determining display information according to the analysis result, and calculating a display position of the display information in a projection range, wherein the display information includes the target information; and driving the projection module to project an information image having the display information towards the target environment space.

18. The projection method of claim 17, wherein, The processor pre-stores a coordinate relationship between a capturing range corresponding to the image capturing device and the projection range, wherein the step of determining the display information according to the analysis result and calculating the display position of the display information in the projection range performed by the processor further includes: based on the coordinate relationship, calculating a coordinate position of the target image in the target captured image in the projection range; and Based on the coordinate position and the analysis result, the display position of the display information in the projection range is determined, wherein the at least one target object and the display information on the projected information image have a neighboring configuration relationship in the target environment space.

19. The projection method of claim 17, wherein, The projection system includes a projector, the image capturing device is coupled to the projector, the projector includes the projection module, the processor and the communication module, the communication module is coupled to the processor, the input device and the image capturing device respectively, wherein the processor drives the image capturing device to capture images through the communication module, receives the target captured image from the image capturing device through the communication module, and transmits the target captured image and the input instruction to the cloud server through the communication module.

20. The projection method of claim 19, wherein, The projector includes the input device, the input device includes a voice receiver, and the voice receiver is used to receive at least one voice signal, wherein the at least one voice signal is the at least one input signal.

21. The projection method of claim 19, wherein, The input device is wirelessly connected to the communication module of the projector, the input device is an infrared remote control device, the infrared remote control device is used to transmit at least one infrared control signal to the communication module of the projector, the at least one infrared control signal is the at least one input signal, wherein the step of receiving the at least one input signal from the input device through the processor and generating the input instruction according to the at least one input signal further includes: Driving the projection module to project a keyboard image with multiple key options; Receiving the at least one infrared control signal from the infrared remote control device, wherein at least one key option on the keyboard image is selected through the input device to correspondingly generate the at least one infrared control signal; and Generating text content according to the at least one infrared control signal; and Generating the input instruction according to the text content.

22. The projection method of claim 19, wherein, The input device is wirelessly connected to the communication module of the projector, the input device is a portable smart device, the portable smart device is used to transmit at least one wireless control signal to the communication module of the projector, and the at least one wireless control signal is the at least one input signal.

23. The projection method of claim 22, wherein, The portable smart device includes an application corresponding to the projector, wherein the projection method further includes the following steps: After starting the application through the portable smart device, a display input interface is displayed through the portable smart device; and By performing input operations on the input interface, the at least one wireless control signal is correspondingly generated.

24. The projection method of claim 17, wherein, The projection system includes a projector, the projector includes the image capturing device, the projection module, the processor and the communication module, the communication module is coupled to the processor and the input device, and the target captured image and the input instruction are transmitted to the cloud server through the communication module.

25. The projection method of claim 24, wherein, The projector includes the input device, the input device includes a voice receiver, the voice receiver is used to receive at least one voice signal, the at least one voice signal is the at least one input signal.

26. The projection method of claim 24, wherein, The input device is wirelessly connected to the communication module of the projector, the input device is an infrared remote control device, the infrared remote control device is used to transmit at least one infrared control signal to the communication module of the projector, the at least one infrared control signal is the at least one input signal, wherein the step of receiving the at least one input signal from the input device and generating the input instruction according to the at least one input signal through the processor further includes: Driving the projection module to project a keyboard image with multiple key options; Receiving the at least one infrared control signal from the infrared remote control device, wherein at least one key option on the keyboard image is selected by the input device to correspondingly generate the at least one infrared control signal; Generating text content according to the at least one infrared control signal; and Generating the input instruction according to the text content.

27. The projection method of claim 24, wherein, The input device is wirelessly connected to the communication module of the projector, the input device is a portable smart device, the portable smart device is used to transmit at least one wireless control signal to the communication module of the projector, the at least one wireless control signal is the at least one input signal.

28. The projection method of claim 27, wherein, The portable smart device includes an application corresponding to the projector, wherein the projection method further includes the following steps: After starting the application through the portable smart device, a display input interface is displayed through the portable smart device; and By performing input operations on the input interface, the at least one wireless control signal is correspondingly generated.

29. The projection method of claim 17, wherein, The projection method further includes the following steps executed by the processor: Receiving a start signal; and In response to the start signal, starting the image capture device and / or the input device.

30. The projection method of claim 17, wherein, The projection system further includes a voice player coupled to the processor, wherein the projection method further includes the following steps executed by the processor: Converting the display information into target voice information; and Driving the voice player to play the target voice information.

31. The projection method of claim 17, wherein, The capture range corresponding to the image capture device and the projection range corresponding to the projection module partially or entirely overlap.

32. The projection method of claim 18, wherein, The projection method further includes an image processing unit coupled to the projection module and the processor, respectively, wherein the image processing unit receives the display information and the display position from the processor to generate the information image, and transmits the information image to the projection module.

Images