Display system, display apparatus and control method thereof

Abstract

The invention provides a display system, a display apparatus and a control method thereof. The control method of the display device comprises the following steps of: executing one of a first program and a second program by the display device to obtain an input drawing file; a standard instruction is generated based on the input drawing file by means of the artificial intelligence model. The operation setting of the display device is adjusted by the display device based on the standard instruction. The first program includes acquiring a first original drawing file related to an environment where the display device is located by driving the image capturing device, and using the first original drawing file as an input drawing file. The second program comprises the following steps: driving the image processing module to capture the multimedia content of the display device so as to obtain a second original drawing file, and taking the second original drawing file as an input drawing file. According to the display system, the display device and the control method thereof, the operation setting of the display device can be automatically adjusted based on the environment or the multimedia content of the display device.

Description

Technical Field

[0001] The present invention relates to a display technology, and more particularly to a display system, a display device and a control method thereof. Background Art

[0002] Generally speaking, the control method of a display device (such as a projector) is mostly performed by a user manually operating a remote controller of the display device or a human-machine interface on the display device. Therefore, the traditional control method of the display device is quite inconvenient.

[0003] Specifically, the user needs to have relevant knowledge of the display device. For example, when adjusting the function of the display device by means of a remote control, the user needs to learn the meaning of each item on the menu of the display device and how to adjust the operation settings of the display device according to the usage scenario, and the user needs to manually adjust the operation settings of the display device. Therefore, the existing adjustment operation setting method of the display device is inconvenient.

[0004] The "background technology" section is only used to help understand the content of the present invention. Therefore, the content disclosed in the "background technology" section may contain some known technologies that are not known to those skilled in the art. The content disclosed in the "background technology" section does not mean that the content or the problems to be solved by one or more embodiments of the present invention have been known or recognized by those skilled in the art before the application of the present invention. Summary of the invention

[0005] The present invention provides a display system, a display device and a control method thereof, which can automatically adjust the operation settings of the display device based on the environment or the multimedia content of the display device.

[0006] Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0007] To achieve one or part or all of the above purposes or other purposes, the control method of the display device of the present invention includes the following steps: executing one of the first program and the second program by the display device to obtain an input image file; generating standard instructions based on the input image file by the artificial intelligence model; and adjusting the operation settings of the display device based on the standard instructions by the display device. Here, the first program includes: acquiring a first original image file related to the environment where the display device is located by driving the imaging device, and using the first original image file as the input image file. The second program includes: capturing the multimedia content of the display device by driving the image processing module to obtain a second original image file, and using the second original image file as the input image file.

[0008] To achieve one or part or all of the above purposes or other purposes, the display system of the present invention includes an imaging device, a display device and an artificial intelligence model, wherein: the imaging device is used to obtain a first original image file related to the environment in which the display device is located; the display device is coupled to the artificial intelligence model, and the display device includes: an image processing module, which is used to capture the multimedia content of the display device to obtain a second original image file; and a processor, which is coupled to the imaging device and the image processing module. The processor is configured to execute: using the first original image file from the imaging device or the second original image file from the image processing module as an input image file; and adjusting the operation settings of the display device based on standard instructions from the artificial intelligence model. The artificial intelligence model is configured to execute: generating standard instructions based on the input image file.

[0009] To achieve one or part or all of the above purposes or other purposes, the display device of the present invention includes: an imaging device for acquiring a first original image file related to the environment in which the display device is located; an image processing module for capturing multimedia content of the display device to obtain a second original image file; and a processor coupled to the imaging device and the image processing module, wherein the processor is configured to execute: using the first original image file from the imaging device or the second original image file from the image processing module as an input image file; and adjusting the operating settings of the display device based on standard instructions corresponding to the input image file.

[0010] Based on the above, the display system, display device and control method of the present invention can analyze the input image file and then infer the current environment of the display device or the multimedia content of the display device, so that the display device automatically adjusts its operation settings to meet the usage scenario of the display device. Accordingly, the user experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 is a schematic diagram of a display system according to an embodiment of the present invention.

[0012] Figure 2 is a flow chart of a control method of a display device according to an embodiment of the present invention.

[0013] Figure 3 is a schematic diagram of a display system according to another embodiment of the present invention.

[0014] Figure 4 is a flow chart of a method for controlling a display device according to another embodiment of the present invention.

[0015] Figure 5 is a flow chart of a method for controlling a display device according to another embodiment of the present invention.

[0016] Description of reference numerals:

[0017] 100: Display system

[0018] 100A: Display device

[0019] 100B: Artificial Intelligence Model

[0020] 100C: Imaging device

[0021] 100D: Cloud Server

[0022] 110: Processor

[0023] 120: Image processing module

[0024] 310: Connection interface

[0025] 320: Display module

[0026] 330: Gravity sensor

[0027] S210~S230: Steps

[0028] S401~S417: Steps

[0029] S501~S525: steps. DETAILED DESCRIPTION

[0030] The above-mentioned other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms mentioned in the following embodiments, such as up, down, left, right, front or back, etc., are only the directions with reference to the accompanying drawings. Therefore, the directional terms used are used to illustrate and not to limit the present invention.

[0031] Figure 1 is a schematic diagram of a display system according to an embodiment of the present invention. Figure 1 The display system 100 includes a display device 100A, an artificial intelligence model 100B, and an imaging device 100C. The display device 100A, the artificial intelligence model 100B, and the imaging device 100C communicate with each other via wired and / or wireless communication.

[0032] In this embodiment, the display device 100A is, for example, a projector, an interactive flat panel display (IFP), or a touch display, etc. The display device 100A includes a processor 110 and an image processing module 120 . The processor 110 is coupled to the image processing module 120 .

[0033] The processor 110 is, for example, a central processing unit (CPU), a physical processing unit (PPU), a programmable microprocessor, an embedded control chip, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or other similar devices.

[0034] The image processing module 120 may be implemented by actual hardware such as a graphics processing unit (GPU). In other embodiments, the image processing module 120 may also be composed of one or more program code segments stored in a memory and executed by the processor 110 .

[0035] The display device 100A further includes a storage device. The storage device may be implemented by any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk or other similar device or a combination of these devices. The storage device includes one or more program code segments, which are executed by the processor 110 after being installed to implement the following control method.

[0036] In the present embodiment, the artificial intelligence model 100B is, for example, a chatbot with a machine learning algorithm. The chatbot is, for example, any pre-trained chatbot such as Chat Generative Pre-trained Transformer (Chat GPT), Microsoft Bing, Google Bard, or ERNIEBot, or a dedicated chatbot trained with data in a specific field. The artificial intelligence model 100B can be used to perform input image recognition, natural language processing (NLP) and semantic understanding, dialogue management, speech-to-text, and text-to-speech. In the present embodiment, the artificial intelligence model 100B is set in a cloud server different from the display device 100A, and the artificial intelligence model 100B communicates with the display device 100A by wired and / or wireless communication. The cloud server includes a processor, a communication device, and a storage device. The storage device is used, for example, to store a chatbot with a machine learning algorithm, and the processor is used, for example, to execute the algorithm. The communication device is used to communicate with the display device 100A. In other embodiments, the artificial intelligence model 100B can also be set in the projection device 100A.

[0037] The imaging device 100C is, for example, a video camera or a still camera that uses a charge coupled device (CCD) lens or a complementary metal oxide semiconductor transistor (CMOS) lens. In one embodiment, the imaging device 100C may be integrated with the display device 100A, or built into the display device 100A. In another embodiment, the imaging device 100C is, for example, disposed separately from the display device 100A. The imaging device 100C is, for example, disposed at a position adjacent to the display panel of the display device 100A. The imaging device 100C may be, for example, a video camera or a monitor disposed at the location of the display device 100A.

[0038] Figure 2 is a flow chart of a control method of a display device according to an embodiment of the present invention. Figure 1 and Figure 2In step S210, the display device 100A executes one of the first program and the second program to obtain an input image file. The input image file may include pixel data and image information, for example. The first program includes step S211. In step S211, the processor 110 drives the imaging device 100C to obtain a first original image file related to the environment in which the display device 100A is located, and uses the first original image file as the input image file. The second program includes step S213. In step S213, the multimedia content of the display device 100A is captured by driving the image processing module 120 to obtain a second original image file, and the second original image file is used as the input image file.

[0039] The second original image file may be obtained by capturing the multimedia content currently displayed or projected by the display device 100A through the image processing module 120. For example, the second original image file is captured from the display screen of the display device 100A playing the multimedia content, or the second original image file is captured from the projection screen of the display device 100A projecting the multimedia content. Alternatively, the second original image file may also be obtained by capturing the multimedia content recorded in the display device 100A that has not been displayed or projected. For example, when the display device 100A plays or projects the multimedia content, the second original image file is captured from the multimedia content that has not been played or projected.

[0040] After obtaining the input image, in step S220, the artificial intelligence model 100B generates standard instructions based on the input image. Specifically, the artificial intelligence model 100B generates standard instructions based on rule instructions and the input image. The rule instructions are used to tell the artificial intelligence model 100B the operations currently supported by the display device 100A and the scope of each operation. The rule instructions may include multiple operations that can be performed by the display device 100A and the range corresponding to each operation. Different models of display devices 100A may have different rule instructions. The multiple operations that can be performed by the display device 100A include adjusting any combination of the following: display mode, brightness, volume, background color, contrast, refresh rate (Variable Refresh Rate, VRR) and other operations that can be performed by the display device 100A.

[0041] The standard instructions generated by the artificial intelligence model 100B can correspond to the operation settings of the display device 100A. The operation settings are, for example: selection of display mode, selection of the background color of the display or projection target, selection of contrast, selection of brightness, selection of volume, on / off switch of the refresh rate, etc. The selectable range of the display mode includes, for example, education, movie, game, presentation, or other suitable modes. The selectable range of the background color includes, for example, white, green, yellow, pink, or other suitable colors. The adjustable range of the contrast is, for example, from 0 to 10 levels. The adjustable range of the brightness is, for example, from 0 to 10 levels. The adjustable range of the volume is, for example, from 0 to 30 levels. The adjustable range of the refresh rate (VRR) is, for example, on and off.

[0042] The regular instructions also include instructions for instructing the artificial intelligence model 100B to analyze the input document to obtain the environment corresponding to the first original document or the multimedia type corresponding to the second original document, so that the artificial intelligence model 100B analyzes the operation settings that the display device 100A needs to adjust according to the environment or multimedia type.

[0043] For example, the regular instructions are used to require the artificial intelligence model 100B to analyze the content of the input document with the display device 100A as the role and generate appropriate standard instructions within the scope of each operation supported by the display device 100A. The content of the regular instructions is, for example, "You are now a display device 100A. You can control the display mode of the display device 100A. The selectable range of the display mode includes, for example, education, movie, game, presentation, or other suitable modes. You can also control the background color of the display device 100A. The selectable range of the background color includes, for example, white, green, yellow, pink, or other suitable colors. You can also control the brightness displayed by the display device 100A. The adjustable range of the brightness is, for example, from 0 to 10 levels. You can also control the volume of the display device 100A. The adjustable range of the volume is, for example, from 0 to 30 levels. After analyzing the content of the input document, identify the environment where the input document is located or the multimedia type being played, and return the standard instructions and / or feedback information of the display mode, background color, brightness, and volume of the display device 100A suitable for this environment or this type."

[0044] In step S230, the display device 100A adjusts the operation settings of the display device 100A based on the standard instructions. The operation settings include at least one operation recorded in the rule instructions. The artificial intelligence model 100B analyzes the environment in which the display device 100A is located and / or the multimedia type of the multimedia content presented, and provides an overall usage scenario analysis result. The artificial intelligence model 100B determines which operations of the display device 100A need to be adjusted in this usage scenario, so that the display device 100A automatically adjusts to the appropriate setting value to reduce the user's operating burden and provide the best viewing experience.

[0045] Figure 3 is a schematic diagram of a display system according to another embodiment of the present invention. Figure 3 The display system 100 further includes a cloud server 100D, and the display device 100A further includes a connection interface 310 , a display module 320 and a gravity sensor 330 .

[0046] The cloud server 100D includes a processor, a communication device and a storage device. The storage device is used to store one or more program code snippets, for example, and the processor is used to execute the above one or more program code snippets. The communication device is used to communicate with the display device 100A and the artificial intelligence model 100B. In this embodiment, the display device 100A, the artificial intelligence model 100B and the cloud server 100D are implemented by three independent hardware devices. In other embodiments, the artificial intelligence model 100B can also be set in the cloud server 100D. Alternatively, the display device 100A and the cloud server 100D can be integrated into one hardware device.

[0047] The connection interface 310 may be implemented by a Bluetooth (BT) connector, a High Definition Multimedia Interface (HDMI) port, or a Universal Serial Bus (USB) port, etc. The connection interface 310 receives multimedia signals from an external electronic device.

[0048] The display device 100A may further include a communication device for communicating with the artificial intelligence model 100B and the cloud server 100D. The connection interface 310 can also be connected to a communication device to receive multimedia signals through the network. The communication interface can be a chip or circuit using a local area network (LAN) technology, a wireless local area network (WLAN) technology, or a mobile communication technology. An example of a local area network is Ethernet. An example of a wireless local area network is Wi-Fi. Examples of mobile communication technologies include the Global System for Mobile Communications (GSM), third-generation mobile communication technology (3G), fourth-generation mobile communication technology (4G), fifth-generation mobile communication technology (5G), etc.

[0049] The display module 320 can be implemented by a projection module (for example, including imaging elements, projection lenses, light source modules, optical elements for transmitting light beams, etc.), a display panel of an interactive flat panel display (IFP) or a touch display, etc. The multimedia content corresponding to the multimedia signal is displayed (presented) via the display module 320.

[0050] The gravity sensor 330 is coupled to the processor 110 to assist the processor 110 in determining whether the position of the display device 100A is moved. In other embodiments, a gyroscope or an acceleration sensor may also be used to assist the processor 110 in determining whether the position of the display device 100A is moved.

[0051] Figure 4 is a flow chart of a control method of a display device according to another embodiment of the present invention. Figure 4 In step S401, the display device 100A obtains an input image file by photographing the environment via the image capturing device 100C or capturing multimedia content via the image processing module 120. That is, the processor 110 executes the first program or the second program to obtain the input image file.

[0052] The time point for executing the first program may be, for example, triggering the imaging device 100C when the display device 100A is just turned on, or detecting whether the display device 100A is moved by the gravity sensor 330, and triggering the imaging device 100C when the display device 100A is moved and then placed stably.

[0053] Specifically, when the display device 100A is just turned on, the processor 110 drives the imaging device 100C to capture images to obtain a first original image file related to the environment where the display device 100A is located (for example, including the entire space, the projection surface, or the display surface). Alternatively, the processor 110 uses the gravity sensor 330 to detect whether the position of the display device 100A has been moved. In response to the gravity sensor 330 detecting that the position of the display device 100A has been moved, the processor 110 drives the imaging device 100C to obtain a first original image file related to the environment where the display device 100A is located.

[0054] The time point for executing the second program may be, for example, triggering the image processing module 120 to capture images when a multimedia signal is received via the connection interface 310, or triggering the image processing module 120 to capture images when the input of the connection interface 310 switches from one multimedia signal to another multimedia signal.

[0055] Specifically, the processor 110 determines whether a multimedia signal corresponding to the multimedia content is received through the connection interface 310 by monitoring the connection interface 310. In response to determining that the multimedia signal is received, the processor 110 drives the image processing module 120 to capture the multimedia content displayed by the display device 100A to obtain a second original image file. Alternatively, the processor 110 drives the image processing module 120 to capture the multimedia content that has not yet been displayed to the display device 100A in the multimedia content to obtain a second original image file.

[0056] The processor 110 can also determine whether the input of the connection interface 310 is switched to another multimedia signal corresponding to another multimedia content by monitoring the connection interface 310. In response to determining that the input of the connection interface 310 is switched to another multimedia signal, the processor 110 drives the image processing module 120 to capture another multimedia content displayed by the display device 100A to obtain a third original image file, and uses the third original image file as the input image file. Alternatively, the processor 110 drives the image processing module 120 to capture another multimedia content that has not been displayed on the display device 100A in another multimedia content to obtain a third original image file.

[0057] When the display device 100A displays multimedia content, the user can also actively activate the screenshot function through remote control operation or voice control to obtain the input image file.

[0058] After obtaining the input image, in step S403, the display device 100A transmits the input image to the cloud server 100D. Then, in the cloud server 100D, in response to receiving the input image from the display device 100A, in step S405, the cloud server 100D transmits the input image and the rule instruction to the artificial intelligence model 100B. Here, the cloud server 100D stores the rule instruction in advance. For example, the display device 100A may transmit the rule instruction to the cloud server 100D in advance. Alternatively, the user may upload the rule instruction corresponding to the display device 100A to the cloud server 100D through other electronic devices.

[0059] In the artificial intelligence model 100B, in step S407, the artificial intelligence model 100B generates a standard instruction based on the rule instruction and the input image file. The rule instruction is used to require the artificial intelligence model 100B to convert the input image file into a standard instruction, and the rule instruction is used to limit the converted standard instruction to the operation setting of controlling the display device 100A. In one embodiment, the rule instruction includes a plurality of operations executable by the display device 100A and the range corresponding to each operation, and includes an instruction for instructing the artificial intelligence model 100B to analyze the input image file to obtain the environment corresponding to the first original image file or the multimedia type corresponding to the second original image file.

[0060] In one embodiment, the artificial intelligence model 100B uses a model that can parse image content, such as ChatGPT4. ChatGPT4 can summarize and infer the standard instructions that the display device 100A should set based on the objects recognized by the input image and the restrictions of the rule instructions. For example, when the artificial intelligence model 100B recognizes that there is a green background color of the projection wall in the input image, the corresponding standard instruction is "wall color = green"; when it recognizes that the scene corresponding to the input image is "classroom", the corresponding standard instruction is "display mode = education"; when it recognizes that the input image corresponds to multimedia content and the multimedia type is "movie", the corresponding standard instruction is "display mode = movie", etc. The rule instructions will require the artificial intelligence model 100B to summarize the corresponding usage scenario (scene or multimedia type) after recognizing the input image, so as to generate one or more standard instructions based on the usage scenario, so as to achieve the purpose of controlling the operation settings of the display device 100A according to the usage scenario.

[0061] In the process of parsing the input image file, the artificial intelligence model 100B can parse the image information of the input image file to determine whether the input image file is obtained by the imaging device 100C or the image processing module 120. When determining that the input image file is obtained by the imaging device 100C, the artificial intelligence model 100B can further determine the environment by identifying the position or background of the objects in the input image file. For example, when it is recognized that the input image file includes multiple desks and chairs, the environment is determined to be a "classroom". Therefore, the standard instructions that the artificial intelligence model 100B can provide are, for example, "display mode = education". In addition, when determining that the input image file is obtained by the image processing module 120, the artificial intelligence model 100B can further determine the multimedia type of the input image file (table text, presentation, movie, dark scene game, bright scene game, etc.) by analyzing the overall grayscale brightness of the input image file, whether there are text or strings in the input image file, etc. For example, when the overall grayscale of the input image is dark (e.g., the average grayscale value is less than the preset grayscale value), the multimedia type is determined to be a horror movie. At this time, the standard instruction that the artificial intelligence model 100B can provide is, for example, "display mode = movie". Alternatively, when the overall grayscale of the input image is bright, the multimedia type is determined to be a presentation. At this time, the standard instruction that the artificial intelligence model 100B can provide is, for example, "display mode = presentation".

[0062] In addition, in step S407, the artificial intelligence model 100B can also generate corresponding feedback information. For example, the feedback information can be used to inform the user of the current location, and the standard instructions are used to indicate which operating settings to adjust. Unlike previous technologies, the operating settings of the display device 100B are determined by the artificial intelligence model 100B, which uses the information obtained after identifying the input image file as the basis for judgment, rather than being determined by pre-established fixed instructions or parameter tables, which makes the control of the display device 100A more flexible. It is not limited to providing feedback information for the artificial intelligence model 100B, and it can be adjusted according to the usage conditions.

[0063] In step S409, the artificial intelligence model 100B transmits the standard command and feedback information to the cloud server 100D. In response to receiving the feedback information from the artificial intelligence model 100B, the cloud server 100D transmits the feedback information to the display device 100A in step S411, so that the display device 100A displays the feedback information in a visual presentation through the display module 320. Alternatively, in other embodiments, the display device 100A may also present the feedback information in the form of voice output via a speaker. For example, the cloud server 100D or the display device 100A may convert the text-based feedback information into voice-based feedback information, and then play the voice-based feedback information through the speaker of the display device 100A.

[0064] In response to receiving the standard command from the artificial intelligence model 100B, the cloud server 100D converts the standard command into a control code in step S413, and transmits the control code to the display device 100A in step S415. For example, the cloud server 100D converts the standard command into a control code according to a command protocol format that can be received by the display device 100A, and then transmits the control code to the display device 100A. In addition, in other embodiments, the display device 100A can also convert the standard command into a control code according to a command protocol format that it can execute. The control code of each different model of the display device 100A may be different.

[0065] In step S417, the display device 100A executes the control code to adjust the operation settings of the display device 100A. For example, the processor 110 further switches to the parameter setting of the display mode of "classroom" according to the environment of "classroom", and further automatically adjusts the parameter value of at least one of the brightness, volume, background color, contrast and update rate according to the range indicated by the standard instruction. For example, the processor 110 controls the light source intensity of the light source module in the projection module, the output power of the speaker, etc. through the control code.

[0066] Figure 5 is a flow chart of a control method of a display device according to another embodiment of the present invention. Figure 5 In step S501, the display device 100A is turned on. Next, in step S503, the processor 110 of the display device 100A executes a first program to drive the imaging device 100C to capture images to obtain input images. Then, the artificial intelligence model 100B obtains standard instructions based on the input images. Then, in step S505, the processor 110 adjusts the operation settings of the display device 100A based on the standard instructions.

[0067] In step S507, the processor 110 determines whether the position of the display device 100A is moved by the gravity sensor 330. If it is determined that the position of the display device 100A is moved, the processor 110 returns to step S503 and executes the first program. If it is determined that the position of the display device 100A is not moved, in step S509, the processor 110 determines whether a multimedia signal is received through the connection interface 310 by monitoring the connection interface 310.

[0068] If it is determined that the multimedia signal is not received, the process returns to step S507. If it is determined that the multimedia signal is received, in step S511, the processor 110 executes the second program to drive the image processing module 120 to obtain the input image file in the corresponding multimedia content. Then, the artificial intelligence model 100B obtains the standard instruction based on the input image file. In step S511, the processor 110 adjusts the operation setting of the display device 100A based on the standard instruction.

[0069] In step S515, the processor 110 determines whether another multimedia signal is received by monitoring the connection interface 310. If it is determined that another multimedia signal is not received and the multimedia content corresponding to the previously received multimedia signal continues to be displayed, in step S521, the processor 110 determines whether the position of the display device 100A is moved by the gravity sensor 330. If it is determined that the position of the display device 100A is not moved, the process returns to step S515. If it is determined that the position of the display device 100A is moved, steps S523 and S525 (same as steps S503 and S505) are executed, and then the process returns to step S515.

[0070] If it is determined that another multimedia signal is received, it means that the input source has changed, and step S517 is executed to re-capture the input image file in the corresponding other multimedia content, so that the artificial intelligence model 100B regenerates the standard instruction and provides it to the display device 100A. In step S519, the processor 110 adjusts the operation settings of the display device 100A based on the standard instruction. Then, the process returns to step S515 until the display device 100A is turned off and the process is terminated.

[0071] The display device 100A can further provide a manual adjustment mechanism. The display device 100A generates an adjustment instruction based on the user input, adjusts the operation setting of the display device 100A, and transmits the adjustment instruction to the cloud server 100D. Afterwards, the cloud server 100D updates the rule instruction based on the adjustment instruction to generate an updated rule instruction. For example, after the display device 100A automatically adjusts the operation setting, the user can further adjust other parameter values ​​or functions. The processor 110 records the parameter value or function adjusted by the user as adjustment data and transmits the adjustment data to the cloud server 100D. The adjustment data can be used as the user personalized information of the display device 100B. The cloud server 100D can update the original rule instruction and allow the artificial intelligence model 100B to analyze the usage scenario with the updated rule instruction, thereby establishing the operation setting of the personalized usage scenario.

[0072] For example, the user can adjust the operation settings of the display device 100A by remote control operation or voice control operation, and the processor 110 further converts the control code of the adjustment item into a personalized instruction, and uploads this personalized instruction and the serial number or identification code (identify, ID) of the display device 100A to the cloud server 100D to record the user's personalized preference settings. The cloud server 100D generates an updated rule instruction based on this personalized instruction and the original rule instruction. The updated rule instruction can, for example, inform the artificial intelligence model 100B of the operations and new ranges currently supported by the display device 100A, so that the subsequent artificial intelligence model 100B can generate standard instructions based on the user's preferences, and then the display device 100A can be adjusted to a suitable parameter value based on the user's preferences. In one embodiment, the above-mentioned step of converting the control code of the adjustment item into a personalized instruction can also be performed by the cloud server 100D. This embodiment can establish a control process with a user feedback mechanism through the aforementioned program. When the user operates the on-screen display (OSD) control of the display device 100A, a confirmation option can be added to interact with the user in a question-and-answer format, allowing the user to decide whether to execute the operation settings of the display device 100A and store them as user personalized information. The result of this interaction can be regarded as a judgment on whether to update the rule instructions.

[0073] In summary, with the image analysis technology of artificial intelligence, the present invention can analyze, by artificial intelligence, how to adjust the operation settings to conform to the display environment of the usage scenario when the display device is in various different usage scenarios. For example, when used in a classroom, the display mode, the background color of the projection wall, and the volume are automatically set. Users do not need to learn the knowledge related to the display device and the control functions of operating the display device. After simplifying the operation steps to the greatest extent, the best viewing effect can still be achieved. In addition, through the user feedback mechanism, the feedback data can be recorded by the cloud server and used to update the rule instructions, thereby establishing a personalized usage scenario.

[0074] However, the above are only the preferred embodiments of the present invention, and the scope of implementation of the present invention cannot be limited thereby. That is, all simple equivalent changes and modifications made according to the claims of the present invention and the content of the invention still fall within the scope covered by the patent of the present invention. In addition, any embodiment or claim of the present invention does not have to achieve all the purposes, advantages or features disclosed in the present invention. In addition, the abstract and the title (invention name) are only used to assist in the retrieval of patent documents and do not limit the scope of rights of the present invention. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and do not limit the upper or lower limits of the number of elements.

Claims

1. A method for controlling a display device, It is characterized in that The control method comprises the following steps: Executing one of the first program and the second program by the display device to obtain an input image file; Generate standard instructions based on the input image file by an artificial intelligence model; as well as By adjusting the operating setting of the display device based on the standard instruction, Wherein, the first procedure includes: Acquiring a first original image file related to the environment where the display device is located by driving an image capturing device, and using the first original image file as the input image file; Wherein, the second procedure includes: The multimedia content of the display device is captured by driving the image processing module to obtain a second original image file, and the second original image file is used as the input image file.

2. The control method according to claim 1, It is characterized in that The step of generating the standard instruction based on the input image file by the artificial intelligence model includes: The standard instruction is generated by the artificial intelligence model based on rule instructions and the input image, wherein the rule instructions include multiple operations executable by the display device and a range corresponding to each of the multiple operations, and the operation setting includes at least one of the multiple operations.

3. The control method according to claim 2, It is characterized in that The rule instructions also include instructions for instructing the artificial intelligence model to analyze the input image to obtain the environment corresponding to the first original image or the multimedia type corresponding to the second original image, so that the artificial intelligence model analyzes the operating settings that need to be adjusted for the display device based on the environment or the multimedia type.

4. The control method according to claim 2, It is characterized in that The control method further includes executing the following steps by means of a cloud server: In response to receiving the input image from the display device, transmitting the input image and the rule instruction to the artificial intelligence model; and In response to receiving the standard command from the artificial intelligence model, the standard command is converted into a control code, and the control code is transmitted to the display device so that the display device executes the control code, thereby adjusting the operation setting of the display device.

5. The control method according to claim 4, It is characterized in that The control method further includes executing the following steps by the cloud server: The standard command and feedback information are received from the artificial intelligence model, and the feedback information is transmitted to the display device, so that the display device presents the feedback information through at least one of a display module and a speaker.

6. The control method according to claim 4, It is characterized in that The control method further comprises: generating an adjustment instruction based on a user input by the display device, adjusting the operation setting of the display device, and transmitting the adjustment instruction to the cloud server; and The cloud server updates the rule instruction based on the adjustment instruction to generate an updated rule instruction.

7. The control method according to claim 2, It is characterized in that The plurality of operations that can be performed by the display device include adjusting any combination of the following: display mode, brightness, volume, background color, contrast, and refresh rate.

8. The control method according to claim 1, It is characterized in that The first procedure also includes: detecting whether the position of the display device is moved by driving a gravity sensor of the display device; and In response to the gravity sensor detecting that the position of the display device is moved, the imaging device is driven to acquire the first original image file related to the environment where the display device is located.

9. The control method according to claim 1, It is characterized in that The second procedure also includes: By monitoring the connection interface of the display device, determining whether a multimedia signal corresponding to the multimedia content is received through the connection interface; In response to determining that the multimedia signal is received, executing the following steps: Driving the image processing module to capture the multimedia content of the display device to obtain the second original image file; By monitoring the connection interface, determining whether the input of the connection interface is switched to another multimedia signal corresponding to another multimedia content; and In response to determining that the input of the connection interface is switched to the other multimedia signal, the image processing module is driven to capture the other multimedia content of the display device to obtain a third original image file, and the third original image file is used as the input image file.

10. A display system, It is characterized in that The display system includes an imaging device, a display device, and an artificial intelligence model, wherein: The imaging device is used to acquire a first original image file related to the environment where the display device is located; The display device is coupled to the artificial intelligence model, and the display device includes an image processing module and a processor, wherein: The image processing module is used to capture the multimedia content of the display device to obtain a second original image file; and The processor is coupled to the imaging device and the image processing module, wherein the processor is configured to execute: Using the first original image file from the imaging device or the second original image file from the image processing module as an input image file; and adjusting operational settings of the display device based on standard instructions from the artificial intelligence model; and The artificial intelligence model is configured to execute: generating the standard instruction based on the input image file.

11. The display system according to claim 10, It is characterized in that The artificial intelligence model is configured to perform: The standard instruction is generated based on a rule instruction and the input image, wherein the rule instruction includes a plurality of operations executable by the display device and a range corresponding to each of the plurality of operations, wherein the operation setting includes at least one of the plurality of operations.

12. The display system according to claim 11, It is characterized in that The rule instructions also include instructions for instructing the artificial intelligence model to analyze the input image to obtain the environment corresponding to the first original image or the multimedia type corresponding to the second original image, so that the artificial intelligence model analyzes the operating settings that need to be adjusted for the display device based on the environment or the multimedia type.

13. The display system according to claim 11, It is characterized in that The display system further includes a cloud server, the cloud server is coupled to the display device and the artificial intelligence model, and the cloud server is configured to execute: In response to receiving the input image from the display device, transmitting the input image and the rule instruction to the artificial intelligence model; and In response to receiving the standard command from the artificial intelligence model, the standard command is converted into a control code, and the control code is transmitted to the display device so that the display device executes the control code, thereby adjusting the operation setting of the display device.

14. The display system according to claim 13, It is characterized in that The cloud server is configured to execute: The standard command and feedback information are received from the artificial intelligence model, and the feedback information is transmitted to the display device, so that the display device presents the feedback information through at least one of a display module and a speaker.

15. The display system according to claim 13, It is characterized in that The display device is configured to perform: generating an adjustment instruction based on a user input by the processor, adjusting the operation setting of the display device, and transmitting the adjustment instruction to the cloud server, The cloud server is configured to execute: updating the rule instruction based on the adjustment instruction to generate an updated rule instruction.

16. The display system according to claim 11, It is characterized in that The plurality of operations that can be performed by the display device include adjusting any combination of the following: display mode, brightness, volume, background color, contrast, and refresh rate.

17. The display system according to claim 11, It is characterized in that The display device further includes a gravity sensor, The processor is also configured to perform: driving the gravity sensor to detect whether the position of the display device is moved; and In response to the gravity sensor detecting that the position of the display device is moved, the imaging device is driven to acquire the first original image file related to the environment where the display device is located.

18. The display system according to claim 10, It is characterized in that The display device further includes a connection interface, wherein the connection interface is coupled to the processor. The processor is further configured to perform: By monitoring the connection interface, determining whether a multimedia signal corresponding to the multimedia content is received through the connection interface; In response to determining that the multimedia content is received, performing the following steps: Driving the image processing module to capture the multimedia content of the display device to obtain the second original image file; By monitoring the connection interface, determining whether the input of the connection interface is switched to another multimedia signal corresponding to another multimedia content; as well as In response to determining that the input of the connection interface is switched to the other multimedia signal, the image processing module is driven to capture the other multimedia content of the display device to obtain a third original image file, and the third original image file is used as the input image file.

19. A display device, It is characterized in that The display device includes an image capturing device, an image processing module and a processor, wherein: The imaging device is used to acquire a first original image file related to the environment where the display device is located; The image processing module is used to capture the multimedia content of the display device to obtain a second original image file; and The processor is coupled to the imaging device and the image processing module, wherein the processor is configured to execute: Using the first original image file from the imaging device or the second original image file from the image processing module as an input image file; and The operational settings of the display device are adjusted based on standard instructions corresponding to the input image.

Images