Display system, display device and control method therefor

The display system addresses the inconvenience of manual control by using an AI-driven display system that adjusts settings based on environmental and multimedia inputs, enhancing user experience and operational efficiency.

JP2025084091APending Publication Date: 2025-06-02CORETRONIC CORPORATION
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024198707
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-21
Filing Date
2024-11-14
Publication Date
2025-06-02

AI Technical Summary

Technical Problem

Conventional display device control methods require manual operation and user knowledge, making them inconvenient for adjusting operation settings based on location environments or multimedia content.

Method used

A display system that includes an image acquisition device, a display device connected to an artificial intelligence model, and a video processing module, which automatically adjusts operation settings by generating standard commands based on input image files acquired from the environment or multimedia content.

Benefits of technology

The system improves user experience by automatically adjusting display settings to match usage scenarios, reducing the burden of manual operation and enhancing the viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025084091000001_ABST
    Figure 2025084091000001_ABST
Patent Text Reader

Abstract

To provide a display system, a display device and a control method therefor.SOLUTION: A method comprises: acquiring an input image file by executing one of a first program and a second program by a display device; generating standard instructions by an artificial intelligence model based upon the input file; and adjusting operation settings of the display device by the display device according to the standard instructions. The first program is programmed to drive an image acquisition device to acquire a first original image file related to a location environment of the display device, the first original image file being an input image file. The second program is programmed to drive a video processing module to acquire a multimedia content of the display device as a second original image file, the second original image file being an input image file.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to display technology, and more particularly, to a display system, a display device, and a control method thereof.

Background Art

[0002] Generally speaking, regarding the control method of a display device (for example, a projector), it is often performed by a user manually operating the remote control of the display device or operating the human-computer interaction on the display device. Therefore, the conventional control method of a display device is quite inconvenient.

[0003] Specifically, the user needs to have knowledge related to the display device. For example, when adjusting the functions of the display device by the remote control, the user needs to study the meaning of each item on the menu of the display device and how to adjust the operation settings of the display device according to the usage scenario. In addition, the user also needs to manually operate the operation settings of the display device. Therefore, the conventional method for adjusting the operation settings of a display device is very inconvenient.

[0004] It should be noted that this "Background Art" section is only for helping the understanding of the content of the present invention. Therefore, the content disclosed in this "Background Art" section may include technologies unknown to those skilled in the art. Therefore, the content disclosed in this "Background Art" section does not mean that the content, or the problems to be solved by one or more embodiments of the present invention, have been well-known to those skilled in the art before the filing of the present invention.

Summary of the Invention

Problems to be Solved by the Invention

[0005] An object of the present invention is to provide a display system, a display device, and a control method thereof that can automatically adjust the operation settings of the display device based on the location environment or the multimedia content of the display device.

[0006] Other objects and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

Means for Solving the Problems

[0007] In order to achieve one or some or all of the above-mentioned objects or other objects, the control method of a display device according to the present invention includes the following steps, that is, by executing one of a first program and a second program by the display device, an input image file is acquired; a standard command is generated based on the input image file by an artificial intelligence model; and the operation settings of the display device are adjusted based on the standard command by the display device. Here, the first program includes acquiring a first original image file related to the environment (location environment) where the display device is located by driving an image acquisition device, and using the first original image file as the input image file. The second program includes acquiring a second original image file by driving a video processing module to acquire the multimedia content of the display device, and using the second original image file as the input image file.

[0008] In order to achieve one or some or all of the above-mentioned objects or other objects, the display system according to the present invention includes an image acquisition device, a display device, and an artificial intelligence model. Among them, the image acquisition device is used to acquire a first original image file related to the location environment of the display device, the display device is connected to the artificial intelligence model, and the display device includes a video processing module used to acquire a second original image file by acquiring the multimedia content of the display device; and a processor connected to the image acquisition device and the video processing module. The processor is configured to perform the following, that is, using the first original image file from the image acquisition device or the second original image file from the video processing module as the input image file; and adjusting the operation settings of the display device based on the standard command from the artificial intelligence model. The artificial intelligence model is configured to execute generating a standard command based on the input image file.

[0009] To achieve one or some or all of the above objects or other objects, the display device according to the present invention includes an image acquisition device used to acquire a first original image file related to the location environment of the display device; a video processing module used to acquire a second original image file by acquiring the multimedia content of the display device; and a processor connected to the image acquisition device and the video processing module, wherein the processor is configured to perform the following operations, that is, use the first original image file from the image acquisition device or the second original image file from the video processing module as an input image file; and adjust the operation settings of the display device based on the standard instructions corresponding to the input image file.

Effects of the Invention

[0010] As described above, the display system, display device and its control method according to the present invention can analyze (analyze) the input image file to infer (speculate / estimate) the current location environment of the display device or the multimedia content of the display device, so that the display device can automatically adjust its operation settings to match the usage situation of the display device. Thereby, the user experience can be improved.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0012] The above-described and other technical contents, features, functions, and effects of the present invention will become clear from the following detailed description of preferred embodiments based on the attached drawings. Note that terms regarding directions mentioned in the following embodiments, such as up, down, left, right, front, and back, are merely in the directions of the attached drawings. Therefore, the terms of the directions used are only for explaining the present invention and not for limiting the present invention.

[0013] FIG. 1 is a diagram showing a display system according to an embodiment of the present invention. As shown in FIG. 1, the display system 100 includes a display device 100A, an artificial intelligence model 100B, and an image acquisition device 100C. The display device 100A, the artificial intelligence model 100B, and the image acquisition device 100C communicate with each other by wired and / or wireless communication methods.

[0014] In this embodiment, the display device 100A is, for example, a display such as a projector, an Interactive Flat Panel (IFP), or a touch display. The display device 100A includes a processor 110 and a video processing module 120. The processor 110 is connected to the video processing module 120.

[0015] The processor 110 is, for example, a Central Processing Unit (CPU), a Physics Processing Unit (PPU), a Programmable Microprocessor, an embedded control chip, a Digital Signal Processor (DSP), an Application Specific Integrated Circuits (ASIC), or other similar devices. There may be one or more processors 110.

[0016] The video processing module 120 can be implemented by actual hardware such as a Graphics Processing Unit (GPU). In other embodiments, the video processing module 120 may consist of one or more program code fragments, be stored in a memory, and may be executed by the processor 110.

[0017] The display device 100A further includes a memory. The memory may be implemented by adopting any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or other similar devices, or a combination of these devices. The memory includes one or more program code fragments, and after such program code fragments are installed, they can be executed by the processor 110 to implement the following control method.

[0018] In this embodiment, the artificial intelligence model 100B is, for example, a chatbot having a machine learning algorithm. The chatbot may be, for example, any one of the trained chatbots such as Chat GPT (Chat Generative Pre-trained Transformer), Microsoft Bing, Google Bard, ERNIE Bot, or a dedicated chatbot trained with data in a specific field. The artificial intelligence model 100B can be used to perform input image file recognition (identification), natural language processing (NLP) and understanding, dialogue management, speech-to-text conversion, text-to-speech conversion, etc. In this embodiment, the artificial intelligence model 100B is provided in a cloud server different from the display device 100A, and the artificial intelligence model 100B and the display device 100A communicate with each other by wired and / or wireless communication methods. The cloud server includes a processor, a communication device, and a memory. The memory is used, for example, to store a chatbot having a machine learning algorithm, and the processor is used, for example, to execute such an algorithm. The communication device is used to establish a communication connection with the display device 100A. In other embodiments, the artificial intelligence model 100B may be provided in the projection device 100A.

[0019] The image acquisition device 100C is, for example, an imaging device or a camera using a CCD (Charge Coupled Device) lens or a CMOS (Complementary Metal Oxide Semiconductor Transistors) lens. In one embodiment, the image acquisition device 100C may be provided integrally with the display device 100A or may be built into the display device 100A. In another embodiment, the image acquisition device 100C is, for example, arranged separately from the display device 100A. The image acquisition device 100C may be, for example, an imaging device or a monitor installed at a position adjacent to the display panel of the display device 100A or installed at the location of the display device 100A.

[0020] FIG. 2 is a flowchart of a control method for a display device according to an embodiment of the present invention. As shown in FIGS. 1 and 2, in step S210, the display device 100A executes one of the first program and the second program to acquire an input image file. The input image file may include, for example, pixel data and video information. The first program includes step S211. In step S211, the processor 110 drives the image acquisition device 100C to acquire a first original image file related to the environment where the display device 100A is located, and uses the first original image file as the input image file. The second program includes step S213. In step S213, the video processing module 120 is driven to acquire a second original image file by acquiring the multimedia content of the display device 100A, and uses the second original image file as the input image file.

[0021] The second original image file may be obtained by the video processing module 120 acquiring the multimedia content currently being displayed or projected on the display device 100A. For example, the second original image file is acquired from the display screen on which the display device 100A is playing multimedia content, or the second original image file is acquired from the projection screen on which the display device 100A is projecting multimedia content. Alternatively, the second original image file may further be obtained (extracted) by the video processing module 120 from multimedia content recorded on the display device 100A that has not yet been displayed or projected. For example, when the display device 100A plays or projects multimedia content, the second original image file is acquired from the multimedia content that has not yet been played or projected.

[0022] After obtaining the input image file, in step S220, the artificial intelligence model 100B generates a standard command based on the input image file. Specifically, the artificial intelligence model 100B generates a standard command based on a rule command and the input image file. The rule command is used to notify (report) the artificial intelligence model 100B of the operations that the display device 100A can currently support and the scope of each operation. The rule command may include a plurality of operations that the display device 100A can execute and the scope corresponding to each operation. Different models of the display device 100A may have different rule commands. The plurality of operations that the display device 100A can execute includes adjusting any of the following combinations, namely, the display mode, brightness, volume, background color, contrast, refresh rate (Variable Refresh Rate, VRR), and other executable operations of the display device 100A.

[0023] The standard commands generated by the artificial intelligence model 100B may correspond to the operation settings of the display device 100A. The operation settings may include, for example, selection of the display mode, selection of the background color of the display or projection target, selection of the contrast, selection of the brightness, selection of the volume, switching (on / off) of the update rate, etc. The selectable range of the display mode includes, for example, education, movie, game, presentation, or other appropriate modes. The selectable range of the background color includes, for example, white, green, yellow, pink, or other appropriate colors. The adjustable range of the contrast is, for example, 0 to 10 levels. The adjustable range of the brightness is, for example, 0 to 10 levels. The adjustable range of the volume is, for example, 0 to 30 levels. The adjustable range (optional) of the update rate (VRR) is, for example, on or off.

[0024] The regular commands further include commands for instructing the artificial intelligence model 100B to analyze the input image file to obtain the location environment corresponding to the first original image file or the type of multimedia corresponding to the second original image file. Thereby, the artificial intelligence model 100B can analyze the operation settings that the display device 100A needs to adjust based on the location environment or the type of multimedia.

[0025] For example, a rule instruction is used to require that the artificial intelligence model 100B analyzes the content of the input image file with the display device 100A as a role and generates appropriate standard instructions within the scope of each operation that the display device 100A can support. The content of the rule instruction is, for example, as follows: "You are currently a single display device 100A, and you can control the display mode of the display device 100A. The selectable range of the display mode includes, for example, education, movies, games, presentations, or other appropriate modes. You can also control the background color of the display device 100A. The selectable range of the background color includes, for example, white, green, yellow, pink, or other appropriate colors. You can also control the brightness displayed on the display device 100A. The adjustable range of the brightness is, for example, from 0 to 10 levels. You can also control the volume of the display device 100A. The adjustable range of the volume is, for example, from 0 to 30 levels. After analyzing the content of the input image file, recognize the location environment of the input image file or the type of the multimedia to be played, and return the standard instructions and / or feedback information of the display mode, background color, brightness, and volume of the display device 100A suitable for the environment or the type."

[0026] In step S230, the display device 100A adjusts the operation settings of the display device 100A based on the standard instructions. The operation settings include at least one operation recorded in the rule instruction. The artificial intelligence model 100B analyzes the location environment of the display device 100A and / or the type of the multimedia content to be displayed, provides an overall usage scenario analysis result, and determines which operations of the display device 100A need to be adjusted under this usage scenario. As a result, the display device 100A can automatically adjust to appropriate setting values, reducing the burden of user operations and achieving an optimal viewing experience.

[0027] FIG. 3 is a diagram showing a display system according to another embodiment of the present invention. As shown in FIG. 3, the display system 100 further includes a cloud server 100D, and the display device 100A further includes a connection interface 310, a display module 320, and a gravity sensor 330.

[0028] The cloud server 100D includes a processor, a communication device, and a memory. The memory is used, for example, to store one or more program code fragments, and the processor is used, for example, to execute the one or more program code fragments described above. The communication device is used to establish a communication connection with the display device 100A and the artificial intelligence model 100B. In this embodiment, the display device 100A, the artificial intelligence model 100B, and the cloud server 100D are realized by three independent hardware devices. In other embodiments, the artificial intelligence model 100B may be provided in the cloud server 100D. Alternatively, the display device 100A and the cloud server 100D can also be integrated into one hardware device.

[0029] The connection interface 310 can be realized by adopting a Bluetooth (BT) connector, a High Definition Multimedia Interface (HDMI) port, a Universal Serial Bus (USB), etc. The display device 100A receives a multimedia signal from an external electronic device via the connection interface 310.

[0030] The display device 100A may further include a communication device for making a communication connection with the artificial intelligence model 100B and the cloud server 100D. The connection interface 310 may be connected to the communication device to receive multimedia signals via a network. The communication device may be a chip or a circuit using Local Area Network (LAN) technology, Wireless LAN (WLAN) technology, or mobile communication technology. The local area network may be, for example, Ethernet. The wireless local area network may be, for example, Wi-Fi. The mobile communication technology may be, for example, GSM (Global System for Mobile Communications), 3G (third-Generation), 4G (fourth-Generation), 5G (fifth-Generation, 5G) technology, etc.

[0031] The display module 320 can be realized by adopting a display panel of a display such as a projection module (for example, components such as a pixel element, a projection lens, a light source module, and an optical element for propagating a light beam), an Interactive Flat Panel (IFP), or a touch display. The display module 320 displays (presents) multimedia content corresponding to the multimedia signal.

[0032] The gravity sensor 330 is connected to the processor 110 and is used to assist the processor 110 in determining whether the position of the display device 100A has moved. The gravity sensor 330 may be other suitable sensors such as a gyroscope or an acceleration sensor.

[0033] FIG. 4 is a flowchart of a method for controlling a display device according to another embodiment of the present invention. As shown in FIG. 4, in step S401, the display device 100A acquires an input image file by having the image acquisition device 100C photograph the location environment or by having the video processing module 120 obtain multimedia content. That is, the processor 110 executes the first program or the second program to acquire the input image file.

[0034] The timing for executing the first program is, for example, as follows. That is, immediately after the power of the display device 100A is turned on, the image acquisition device 100C is triggered, or in combination with the gravity sensor 330, the presence or absence of movement of the display device 100A is detected, and the image acquisition device 100C is triggered when the display device 100A is stably placed after moving.

[0035] Specifically, immediately after the power of the display device 100A is turned on, the processor 110 drives the image acquisition device 100C to obtain an image, thereby acquiring a first original image file related to the location environment of the display device 100A (for example, including the entire space, the projection surface, or the display surface). Alternatively, the processor 110 detects the presence or absence of movement of the position of the display device 100A by means of the gravity sensor 330. In response to the detection by the gravity sensor 330 that there is movement of the position of the display device 100A, the processor 110 drives the image acquisition device 100C to obtain a first original image file related to the location environment of the display device 100A.

[0036] The timing for executing the second program is, for example, as follows. When a multimedia signal is received via the connection interface 310, the video processing module 120 is triggered to obtain an image, or when the input of the connection interface 310 is switched from one multimedia signal to another multimedia signal, the video processing module 120 is triggered to obtain an image file.

[0037] Specifically, the processor 110 monitors the connection interface 310 to determine whether a multimedia signal corresponding to multimedia content is received via the connection interface 310. In response to determining that the multimedia signal is received, the processor 110 drives the video processing module 120 to obtain a second original image file by obtaining the multimedia content to be displayed on the display device 100A. Alternatively, the processor 110 drives the video processing module 120 to obtain a second original image file by obtaining the multimedia content that has not yet been displayed on the display device 100A among the multimedia content.

[0038] The processor 110 can further monitor the connection interface 310 to determine whether the input of the connection interface 310 is switched to another multimedia signal corresponding to another multimedia content. In response to determining that the input of the connection interface 310 is switched to another multimedia signal, the processor 110 obtains a third original image file by obtaining the other multimedia content to be displayed on the display device 100A by the video processing module 120, and drives to use the third original image file as the input image file. Alternatively, the processor 110 drives the video processing module 120 to obtain a third original image file by obtaining the other multimedia content that has not yet been displayed on the display device 100A among the other multimedia content.

[0039] When the display device 100A displays multimedia content, the user can also obtain the input image file by spontaneously activating the screenshot function by remote control operation or voice control.

[0040] After obtaining the input image file, in step S403, the display device 100A transmits the input image file to the cloud server 100D. Subsequently, in response to receiving the input image file from the display device 100A, in step S405, the cloud server 100D transmits the input image file and the rule instruction to the artificial intelligence model 100B. Here, the rule instruction is pre-stored in the cloud server 100D. For example, the display device 100A may transmit the rule instruction to the cloud server 100D in advance. Alternatively, the user may upload the rule instruction corresponding to the display device 100A to the cloud server 100D in advance by another electronic device.

[0041] In step S407, the artificial intelligence model 100B generates a standard instruction based on the rule instruction and the input image file. The rule instruction is used to require the artificial intelligence model 100B to convert the input image file into a standard instruction, and the rule instruction is used to limit (constrain) that the converted standard instruction becomes an operation setting for controlling the display device 100A. In one embodiment, the rule instruction includes a plurality of executable operations of the display device 100A and the range corresponding to each operation, and the artificial intelligence model 100B analyzes the input image file to obtain the location environment corresponding to the first original image file or the instruction for instructing to obtain the type of the multimedia corresponding to the second original image file.

[0042] In one embodiment, the artificial intelligence model 100B uses a model capable of analyzing video content, such as ChatGPT4. ChatGPT4 can induce and infer the standard commands that the display device 100A should set based on the objects recognized from the input image file and the constraints of the regular commands. For example, when the artificial intelligence model 100B recognizes that the background color of the input image file is a green projection wall, the corresponding standard command is "wall color=green"; when it is recognized that the corresponding location scene of the input image file is "classroom", the corresponding standard command is "display mode=education"; when the input image file corresponds to multimedia content and the type of multimedia is recognized as "movie", the corresponding standard command is "display mode=movie". The regular commands can require the artificial intelligence model 100B to induce (infer) the corresponding usage scene (location scene or type of multimedia) after recognizing the input image file, thereby generating one or more standard commands based on the usage scene to achieve the purpose of controlling the operation settings of the display device 100A according to the usage scene.

[0043] When the artificial intelligence model 100B analyzes the input image file, by analyzing the video information of the input image file, it can determine whether the input image file was acquired by the image acquisition device 100C or by the video processing module 120. When it is determined that the input image file was acquired by the image acquisition device 100C, the artificial intelligence model 100B can further determine the location environment by identifying the arrangement position of the objects or the background in the input image file. For example, when it is identified that the input image file contains multiple desks and chairs, it can be determined that the location environment is a "classroom". Therefore, a standard command that the artificial intelligence model 100B can provide is, for example, "display mode=education". Also, when it is determined that the input image file was acquired by the video processing module 120, the artificial intelligence model 100B can further analyze the overall grayscale (tone) brightness and darkness of the input image file, whether there is text or a character string in the input image file, etc., to determine the multimedia type of the input image file (for example, text in a table, presentation, movie, game with a dark scene, game with a bright scene, etc.). For example, when the overall tone of the input image file is dark (for example, the average tone value is smaller than a predetermined tone value), it is determined that the multimedia type is a horror movie, and at this time, a standard command that the artificial intelligence model 100B can provide is, for example, "display mode=movie". Or, when the overall tone of the input image file is bright, it is determined that the multimedia type is a presentation, and at this time, a standard command that the artificial intelligence model 100B can provide is, for example, "display mode=presentation".

[0044] Also, in step S407, the artificial intelligence model 100B can further generate corresponding feedback information. For example, the feedback information is used to notify (report) the user of the current location, and the standard command can be used to indicate what operation settings to adjust. Different from the prior art, the operation settings of the display device 100B are not determined by a pre-established fixed command or parameter table, but are determined by the artificial intelligence model 100B, and the information obtained after the recognition of the input image file is used as the basis for judgment, so the control of the display device 100A becomes more flexible. Note that the artificial intelligence model 100B is not necessarily limited to providing feedback information, and can also be adjusted as appropriate according to the usage situation.

[0045] In step S409, the artificial intelligence model 100B transmits the standard command and the feedback information to the cloud server 100D. In response to receiving the feedback information from the artificial intelligence model 100B, in step S411, the cloud server 100D transmits the feedback information to the display device 100A, so that the display device 100A visually displays the feedback information by the display module 320. Alternatively, in other embodiments, the display device 100A can further present the feedback information in the form of audio output by a speaker. For example, after the cloud server 100D or the display device 100A converts the text-form feedback information into audio-form feedback information, the display device 100A can reproduce the audio-form feedback information by a speaker.

[0046] In response to receiving a standard command from the artificial intelligence model 100B, the cloud server 100D converts the standard command into a control code in step S413 and transmits the control code to the display device 100A in step S415. For example, the cloud server 100D converts the standard command into a control code according to the command protocol format that the display device 100A can receive and transmits the control code to the display device 100A. Also, in other embodiments, the display device 100A can also convert the standard command into a control code according to the command protocol format that it can execute. Note that if the models of the display devices 100A are different, the control codes may also be different.

[0047] In step S417, the display device 100A adjusts the operation settings of the display device 100A by executing the control code. For example, based on the location environment being "classroom", the processor 110 switches to the parameter setting where the display mode is "classroom" and automatically adjusts at least one parameter value among brightness, volume, background color, contrast, and update rate based on the range indicated by the standard command. For example, the processor 110 can control the light source intensity of the light source module in the projection module, the output power of the speaker, etc. through the control code.

[0048] Figure 5 is a flowchart of a control method for a display device according to another embodiment of the present invention. As shown in Figure 5, in step S501, the power of the display device 100A is turned on. Subsequently, in step S503, the processor 110 of the display device 100A executes the first program and drives the image acquisition device 100C to obtain an input image file by obtaining an image. Then, the artificial intelligence model 100B obtains a standard command based on the input image file. After that, in step S505, the processor 110 adjusts the operation settings of the display device 100A based on the standard command.

[0049] In step S507, the processor 110 determines whether there is a movement of the position of the display device 100A by the gravity sensor 330. If it is determined that there is a movement of the position of the display device 100A, the process returns to step S503, and the processor 110 executes the first program. When it is determined that there is no movement of the position of the display device 100A, in step S509, the processor 110 monitors the connection interface 310 to determine whether a multimedia signal has been received via the connection interface 310.

[0050] If it is determined that the multimedia signal has not been received, the process returns to step S507. When it is determined that the multimedia signal has been received, in step S511, the processor 110 executes the second program and drives the video processing module 120 to obtain an input image file from the corresponding multimedia content. Thereafter, the artificial intelligence model 100B obtains a standard command based on the input image file. In step S511, the processor 110 adjusts the operation settings of the display device 100A based on the standard command.

[0051] In step S515, the processor 110 monitors the connection interface 310 to determine whether another multimedia signal has been received. If it is determined that another multimedia signal has not been received and it is determined to continuously display the multimedia content corresponding to the previously received multimedia signal, in step S521, the processor 110 determines whether there is a movement of the position of the display device 100A by the gravity sensor 330. If it is determined that there is no movement of the position of the display device 100A, the process returns to step S515. If it is determined that there is a movement of the position of the display device 100A, steps S523 and S525 (the same as steps S503 and S505) are executed, and then the process returns to step S515.

[0052] When it is determined that another multimedia signal is being received, it indicates that the input source has changed. By executing step S517, the input image file is re-acquired from the corresponding other multimedia content, and thereby, the artificial intelligence model 100B generates standard instructions again and provides them to the display device 100A. In step S519, the processor 110 adjusts the operation settings of the display device 100A based on the standard instructions. Thereafter, it returns to step S515, and such processing ends when the power of the display device 100A is turned off.

[0053] The display device 100A can further provide a manual adjustment mechanism. Based on the user's input, the display device 100A generates an adjustment instruction, adjusts the operation settings of the display device 100A, and transmits the adjustment instruction to the cloud server 100D. Thereafter, the cloud server 100D updates the rule instruction based on the adjustment instruction to generate an updated rule instruction. For example, after the display device 100A automatically adjusts the operation settings, the user can further adjust other parameter values or functions. The processor 110 records the parameter values or functions adjusted by the user as adjustment data and transmits the adjustment data to the cloud server 100D. The adjustment data can be the personalized information of the user of the display device 100B. The cloud server 100D updates the original rule instruction so that the artificial intelligence model 100B can analyze the usage scenario based on the updated rule instruction to establish the operation settings for the personalized usage scenario.

[0054] For example, the user can adjust the operation settings of the display device 100A through remote control operations or voice control operations, convert the control code of the adjustment item into a personalized command by the processor 110, and upload this personalized command and the number or identifier (identify, ID) of the display device 100A to the cloud server 100D together to record the user's personal preference settings. The cloud server 100D generates an updated rule command based on this personalized command and the original rule command. The updated rule command can, for example, notify (report) the operations and new ranges that the current display device 100A can support to the artificial intelligence model 100B, so that the artificial intelligence model 100B can generate a standard command based on the user's preferences. As a result, the display device 100A can be adjusted to appropriate parameter values based on the user's preferences. In one embodiment, the step of converting the control code of the above-mentioned adjustment item into a personalized command may be executed by the cloud server 100D. In this embodiment, a control flow with a user feedback mechanism can be established by the aforementioned program. When the user operates the on-screen display (OSD) control of the display device 100A, by adding a confirmation option for interacting with the user in a question-and-answer format, the user can be made to determine whether it is necessary to execute the operation settings of the display device 100A and store them as the user's personalized information. This interaction result can be regarded as a judgment on whether to update the rule command.

[0055] From the above, the present invention can analyze, by means of the image analysis technology of artificial intelligence, how to adjust the operation settings to match the display environment of the usage scenario when the display device is in various different usage scenarios by artificial intelligence. For example, when used in a classroom, the display mode, the background color of the projection wall, and the volume can be automatically set. The user does not need to study the knowledge related to the display device and the control functions for operating the display device, and can obtain the best viewing effect even after simplifying the operation steps. In addition, due to the user feedback mechanism, feedback data can be recorded in the cloud server and used to update the regular instructions, so a personalized usage scenario can also be established.

[0056] The present invention has been disclosed as above based on the foregoing preferred embodiments. However, the foregoing preferred embodiments are not intended to limit the present invention. Those skilled in the art can make minor changes and refinements to the present invention without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention is based on what is defined in the appended claims. In addition, any embodiment or claims of the present invention do not need to achieve all the aspects or advantages or features disclosed in the present invention. In addition, a part of the abstract and the name of the invention are only for assisting in the search of documents and do not limit the scope of rights of the present invention. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only for naming elements or distinguishing different embodiments or scopes, and are not for limiting the upper or lower limits of the quantity of elements.

Description of Reference Numerals

[0057] 100: Display system 100A: Display device 100B: Artificial intelligence model 100C: Image acquisition device 100D: Cloud server 110: Processor 120: Video processing module 310: Connection interface 320: Display module 330: Gravity sensor S210~S230: Steps S401~S417: Steps S501~S525: Steps

Claims

1. 1. A method for controlling a display device, comprising the steps of: The display device executes one of a first program and a second program to obtain an input image file; An artificial intelligence model generates standard commands based on the input image file; and adjusting an operational setting of the display device based on the standard command; The first program is acquiring a first original image file associated with an environment in which the display device is located by driving an image acquisition device, and setting the first original image file as the input image file; The second program is The method includes obtaining a second original image file by driving a video processing module to obtain multimedia content for the display device, and the second original image file is the input image file.

2. 2. The method of claim 1 , The step of generating the standard command based on the input image file by the artificial intelligence model includes: the artificial intelligence model generates the standard command based on a rule command and the input image file; A method, wherein the rule instructions include a plurality of executable operations of the display device and a range corresponding to each of the plurality of operations, and the operational setting includes at least one of the plurality of operations.

3. 3. The method of claim 2, The method, wherein the rule instructions further include instructions for instructing the artificial intelligence model to analyze the input image file to obtain the environment corresponding to the first original image file or the type of multimedia corresponding to the second original image file, thereby allowing the artificial intelligence model to analyze the operational settings that need to be adjusted by the display device based on the environment or the type of multimedia.

4. 3. The method of claim 2 further comprising: The cloud server In response to receiving the input image file from the display device, transmitting the input image file and the rule instructions to the artificial intelligence model; and The method includes, in response to receiving the standard command from the artificial intelligence model, converting the standard command into control code and transmitting the control code to the display device, thereby causing the display device to execute the control code to adjust the operational settings of the display device.

5. The method of claim 4, further comprising: The method includes a step of the cloud server receiving the standard instructions and feedback information from the artificial intelligence model and transmitting the feedback information to the display device, thereby causing the display device to present the feedback information through at least one of a display module and a speaker.

6. The method of claim 4, further comprising: The display device generates adjustment instructions based on user input to adjust the operational settings of the display device, and transmits the adjustment instructions to the cloud server; and The method includes a step of generating updated rule instructions by the cloud server updating the rule instructions based on the adjustment instructions.

7. 3. The method of claim 2, The method, wherein the operable operations of the display device include adjusting any combination of a display mode, brightness, volume, background color, contrast, and update rate.

8. 2. The method of claim 1 , The first program further comprises: Detecting whether or not the position of the display device has moved using a gravity sensor of the display device; and The method includes, in response to detection by the gravity sensor of a change in position of the display device, driving the image capture device to capture the first original image file associated with the environment in which the display device is located.

9. 2. The method of claim 1 , The second program further comprises: monitoring a connection interface of the display device to determine whether a multimedia signal corresponding to the multimedia content is received by the connection interface; and In response to determining that the multimedia signal has been received, Obtaining the second original image file by driving the image processing module to obtain the multimedia content of the display device; monitoring the connection interface to determine whether an input of the connection interface has been switched to another multimedia signal corresponding to another multimedia content; and The method includes, in response to determining that the input of the connection interface has been switched to the other multimedia signal, driving the video processing module to obtain the other multimedia content of the display device to obtain a third original image file, and setting the third original image file as the input image file.

10. 1. A display system comprising: An image capture device, a display device, and an artificial intelligence model, the image capture device is adapted to capture a first original image file associated with an environment in which the display device is located; The display device is connected to the artificial intelligence model, and the display device includes an image processing module and a processor; the image processing module is used for obtaining a second original image file by obtaining the multimedia content of the display device; the processor is connected to the image capture device and the image processing module; The processor includes: the first original image file from the image capture device or the second original image file from the video processing module as an input image file; and configured to perform adjusting operational settings of the display device based on standard instructions from the artificial intelligence model; The artificial intelligence model is configured to generate the standard instructions based on the input image file.

11. 11. The display system of claim 10, the artificial intelligence model is configured to generate the standard instructions based on rule instructions and the input image file; A display system, wherein the rule instructions include a plurality of executable operations of the display device and a range corresponding to each of the plurality of operations, and the operation setting includes at least one of the plurality of operations.

12. 12. A display system according to claim 11, comprising: The rule instructions further include instructions for instructing the artificial intelligence model to analyze the input image file to obtain the environment corresponding to the first original image file or the type of multimedia corresponding to the second original image file, thereby allowing the artificial intelligence model to analyze the operational settings that need to be adjusted by the display device based on the environment or the type of multimedia.

13. 12. A display system according to claim 11, comprising: Further including a cloud server, The cloud server is connected to the display device and the artificial intelligence model; The cloud server includes: In response to receiving the input image file from the display device, transmitting the input image file and the rule instructions to the artificial intelligence model; and A display system configured to, in response to receiving the standard command from the artificial intelligence model, convert the standard command into a control code and transmit the control code to the display device, thereby causing the display device to execute the control code to adjust the operational settings of the display device.

14. 14. A display system according to claim 13, comprising: A display system, wherein the cloud server is configured to receive the standard instructions and feedback information from the artificial intelligence model, and transmit the feedback information to the display device, thereby causing the display device to present the feedback information through at least one of a display module and a speaker.

15. 14. A display system according to claim 13, comprising: The display device is configured to execute the steps of: generating an adjustment command based on a user input by the processor; adjusting the operation settings of the display device; and transmitting the adjustment command to the cloud server; The cloud server is configured to execute the step of updating the rule instructions based on the adjustment instructions to generate updated rule instructions.

16. 12. A display system according to claim 11, comprising: The plurality of operable operations of the display device include adjusting any combination of display mode, brightness, volume, background color, contrast, and update rate.

17. 12. A display system according to claim 11, comprising: The display device further includes a gravity sensor; The processor further comprises: Detecting whether or not the position of the display device has moved by the gravity sensor; and A display system configured to, in response to detection by the gravity sensor of a movement in the position of the display device, drive the image capture device to capture the first original image file associated with the environment in which the display device is located.

18. 11. The display system of claim 10, The display device further includes a connection interface, the connection interface being connected to the processor; The processor further comprises: monitoring the connection interface to determine whether a multimedia signal corresponding to the multimedia content is received by the connection interface; and In response to determining that the multimedia content has been received, Obtaining the second original image file by driving the image processing module to obtain the multimedia content of the display device; monitoring the connection interface to determine whether an input of the connection interface has been switched to another multimedia signal corresponding to another multimedia content; and A display system configured to, in response to determining that the input of the connection interface has been switched to the other multimedia signal, drive the video processing module to obtain the other multimedia content of the display device to obtain a third original image file, and use the third original image file as the input image file.

19. A display device, comprising: An image capture device, an image processing module, and a processor, the image capture device is adapted to capture a first original image file associated with an environment in which the display device is located; the image processing module is used for obtaining a second original image file by obtaining the multimedia content of the display device; the processor is connected to the image capture device and the image processing module; The processor includes: the first original image file from the image capture device or the second original image file from the video processing module as an input image file; and A display device configured to perform adjusting operational settings of the display device based on standard instructions corresponding to the input image file.

Citation Information

Patent Citations

  • Device and program for control of display mode

    JP2011075733A

  • Information provision device, information provision method, and program

    JP2022051185A

  • Information processing device and information processing method

    WO2019207900A1

  • Implementations and methods for using mobile devices to communicate with a neural network semiconductor

    WO2023133155A1