Display device and control method therefor
By introducing a micromirror array and controller into the display device, regional light modulation of the target object is achieved, solving the problem of color information loss in traditional image display technology and improving the accuracy of color adjustment and visual effect.
Patent Information
- Application Number
- PCT/CN2026/096235
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-13
- Filing Date
- 2026-05-11
- Publication Date
- 2026-11-19
AI Technical Summary
In traditional image display technology, when the overall image is modulated based on a unified color gamut mode, it is impossible to meet the diverse color requirements of different objects and scenes, resulting in loss of color information and poor visual effects.
By introducing a micromirror array and controller into the display device, the target object and its area are determined, and the target color gamut mode is used for regional light modulation. Control commands for the regional micromirror array are generated to achieve fine light modulation of the image to be displayed.
It improves the accuracy of color adjustment, avoids color loss, meets the diverse color display needs in complex image scenes, and enhances the visual effect.
Smart Images

Figure CN2026096235_19112026_PF_FP_ABST
Abstract
Description
Display devices and methods for controlling display devices
[0001] Related applications
[0002] This application claims priority to Chinese patent application No. 2025106166456, filed on May 13, 2025, entitled "Display Device and Control Method of Display Device", and Chinese patent application No. 2025106167139, filed on May 13, 2025, entitled "Projection Device and Projection Method", the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of image display technology, and more particularly to a display device and a method for controlling the display device. Background Technology
[0004] With the rapid development of display technology, display devices have been widely used in diverse scenarios such as home entertainment, business presentations, and education and training.
[0005] In traditional image display technology, in order to achieve the color presentation of an image, the overall image color is usually modulated directly based on a unified color gamut mode.
[0006] However, in real-world scenarios, an image often contains multiple different objects and scenes, each with significantly different color requirements. This limits the effectiveness of simply modulating the overall color of an image. Furthermore, when directly modulating the color of an image, significant differences in color gamut between the original and target gamuts can easily lead to color information loss. For example, when converting a wide color gamut image to a narrow color gamut mode, some vibrant colors cannot be accurately mapped, resulting in decreased color saturation and blurred details. Summary of the Invention
[0007] This application provides a display device and a method for controlling the display device, which can solve the problem that the methods of color modulation of the entire image in related technologies have certain limitations.
[0008] In a first aspect, a display device is provided, comprising:
[0009] At least one controller, and a micromirror array connected to said at least one controller;
[0010] The at least one controller is configured to:
[0011] Identify at least one target object in the image to be displayed and the target region corresponding to the target object;
[0012] Determine the mode identifier of the target color gamut mode corresponding to the target object, as well as the region information of the target area;
[0013] Based on the target color gamut mode corresponding to the mode identifier, control commands are generated to control the micromirror array corresponding to the region information and sent to the micromirror array.
[0014] The micromirror array is configured to flip in response to a control command sent by at least one controller to perform light modulation on the image to be displayed.
[0015] In the above technical solution, the at least one controller can determine the target object and its corresponding target region in the image to be displayed, and then obtain the target color gamut mode identifier corresponding to the target object and the region information corresponding to the target region. Based on the above information, a control command is generated to control the regional micromirror array, thereby realizing the regional light modulation of the target object in the image to be displayed. Using this method, the target color gamut mode can be adaptively adapted to the characteristics of different target objects in the image to be displayed. Furthermore, by performing light modulation only on the target region, compared with traditional full-image processing, the accuracy of color adjustment can be improved, effectively meeting the diverse color display needs in complex image scenes, and avoiding the problem of color interference between different target objects when performing overall adjustment. By performing light modulation on the regional micromirror array to indirectly modulate the color gamut of the image to be displayed, each target region can undergo fine-grained light modulation under the target color gamut mode. Even during the conversion process with large differences in color gamut range, color information can be preserved to the greatest extent through flexible control of the micromirror array, avoiding color loss due to color gamut mismatch.
[0016] In a second aspect, a control method for a display device is provided, applied to the display device of the first aspect, the display device including at least one controller and a micromirror array connected to the at least one controller; the control method for the display device includes:
[0017] Identify at least one target object in the image to be displayed and the target region corresponding to the target object; determine the mode identifier of the target color gamut mode corresponding to the target object, and the region information of the target region;
[0018] Based on the target color gamut mode corresponding to the mode identifier, control commands are generated to control the micromirror array corresponding to the region information and sent to the micromirror array.
[0019] The micromirror array flips in response to the control command to perform light modulation on the image to be displayed.
[0020] Thirdly, a display device is provided, including a projection host, the projection host including a system processor, a display control unit, a light source and a light valve;
[0021] The system processor is configured to: decode the bitstream to obtain a target image, the target image being an image to be projected by the projection host; determine the color value of each pixel in the target image based on the original color data of the target image; and send the color value of each pixel in the target image to the display control unit.
[0022] The display control unit is configured to: receive color values of each pixel in the target image sent by the system processor; determine at least one region of interest in the target image and target values corresponding to multiple pixels in the target image based on the color values of each pixel, wherein the target values are the values obtained by binary conversion of the color values of the corresponding pixels; determine weight datasets corresponding to the multiple pixels based on the at least one region of interest, wherein the weight datasets include weights corresponding to each bit in a binary number, and at least two pixels in the multiple pixels have different weight datasets; control the light source to emit light based on the color values of each pixel in the target image; and control the light valve to modulate the light emitted by the light source based on the target values and weight datasets corresponding to the multiple pixels, so as to project the target image.
[0023] In this scheme, a corresponding weight dataset is determined for each pixel based on the region of interest in the target image, and at least two pixels have different weight datasets. This ensures that different weight datasets are used to process pixels according to the characteristics of different regions in the image, avoiding the limitation of using a uniform weight dataset to process all pixels in the same way. This avoids the limitations of uniformly modulating the color of the entire image, and enables processing of different content regions in the image that better matches their visual characteristics, thereby significantly improving the visual effect of the projection of these regions.
[0024] Fourthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by a display device, causes the display device to perform the control method of the display device in the second aspect.
[0025] Fifthly, a computer program product is provided, comprising: a computer program that, when run by a display device, causes the display device to execute the control method for the display device described in the second aspect.
[0026] It is understandable that the beneficial effects of the second, fourth, and fifth aspects mentioned above can be found in the relevant descriptions in the first aspect above, and will not be repeated here. Attached Figure Description
[0027] To more clearly illustrate the technical solutions in the embodiments of this application or the conventional technology, the drawings used in the description of the embodiments or the conventional technology will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the disclosed drawings without creative effort.
[0028] Figure 1 shows a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application;
[0029] Figure 2 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment;
[0030] Figure 3 illustrates an operational scenario of pointing a remote control according to some embodiments of this application;
[0031] Figure 4 illustrates a control scenario diagram of a pointing remote control provided by some embodiments of this application;
[0032] Figure 5 illustrates a configuration block diagram of a display device 200 according to an exemplary embodiment;
[0033] Figure 6 illustrates a system block diagram in a display device 200 according to an exemplary embodiment;
[0034] Figure 7 shows a timing interaction diagram of a display control method in a display device in some embodiments of this application;
[0035] Figure 8 illustrates an exemplary application scenario of determining a target partition in a control method for a display device according to an embodiment of this application.
[0036] Figure 9 illustrates an exemplary implementation of a control method for generating control instructions in a display device control method according to an embodiment of this application.
[0037] Figure 10 illustrates an application scenario of light modulation in a control method for a display device according to an embodiment of this application.
[0038] Figure 11 illustrates a schematic diagram of a display device according to another embodiment of this application;
[0039] Figure 12 illustrates a timing interaction diagram of a display control method in a display device provided in another embodiment of this application.
[0040] Figure 13 is a schematic diagram of the color gamut ranges corresponding to a DCI-P3 and a three-color laser TV respectively, provided in some embodiments of this application;
[0041] Figure 14 is a schematic diagram of a projection device provided in some embodiments of this application;
[0042] Figure 15 is a schematic diagram of an installation method of a projection host provided in some embodiments of this application;
[0043] Figure 16 is a flowchart of a display device control method provided in some embodiments of this application;
[0044] Figure 17 is a schematic diagram of a target image provided in some embodiments of this application;
[0045] Figure 18 is a schematic diagram of a sub-region in a target image provided in some embodiments of this application;
[0046] Figure 19 is a schematic diagram of a color component provided in some embodiments of this application;
[0047] Figure 20 is a schematic diagram of determining a target weight dataset according to some embodiments of this application;
[0048] Figure 21 is a structural block diagram of a projection device 1000 provided in some embodiments of this application. Detailed Implementation
[0049] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0050] Hereinafter, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.
[0051] Specific details, such as particular system architectures and techniques, are set forth for illustrative purposes and not for limitation, to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods are omitted to avoid unnecessary detail that could obscure the description of this application.
[0052] Figure 1 illustrates a schematic diagram of an operational scenario between a display device and a control device according to some embodiments of this application. As shown in Figure 1, a user can operate the display device 200 via a smart device 300 or a control device 100.
[0053] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.
[0054] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.
[0055] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.
[0056] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.
[0057] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
[0058] Figure 2 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in Figure 2, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.
[0059] In this embodiment of the application, the control device can be a remote control with pointing function. Here, the control device can be called a pointing remote control. The pointing remote control introduces a brand-new interaction method, gets rid of the operation limitations of traditional remote control, and the operation method is like using a laser pointer. It can accurately point to the target control without having to switch icons step by step, which is efficient and convenient.
[0060] In some embodiments, the remote control has a pointing switch on its body. When the pointing switch is turned on, it enters pointing mode, where the user can point, slide, and perform other operations using the cursor. When the pointing switch is turned off, the remote control switches from pointing mode to traditional button mode, where the user can use the up / down / left / right / confirm buttons.
[0061] In some embodiments, after turning on the pointing switch and entering the pointing mode, the pointing mode can coexist with the traditional button mode. Users can use the cursor to point, slide, and select, or use the confirmation key and the up / down / left / right / volume keys.
[0062] In some embodiments, the remote control is in a low-power mode in traditional button mode; however, when the pointing switch is turned on and pointing mode is entered, the remote control is no longer in low-power mode. Therefore, in some embodiments, a charging interface, such as a Type-C interface, can be configured for the remote control.
[0063] In some embodiments, the pointing remote control is a remote control device capable of detecting its own position and orientation in three-dimensional space. The pointing remote control has a built-in gyroscope for detecting the remote control's rotation angle and its movement acceleration. Through sensors, the pointing remote control can determine its pointing position in three-dimensional space in real time. The pointing position can include position coordinates and pointing direction, where the position coordinates are the physical position of the remote control relative to the display device (e.g., horizontal distance, vertical height, etc.). The pointing direction is the pointing angle of the remote control (e.g., horizontal and vertical angles relative to the display device).
[0064] In some embodiments, after the remote control obtains its pointing position in three-dimensional space, it can send the pointing position data to the display device. This allows the display device to obtain the pointing position and perform screen coordinate transformation, thus mapping the remote control's pointing position to the screen coordinate system. At this point, the display device updates the cursor position based on the calculated screen coordinates. When the user moves the remote control, its sensors continuously detect changes in position and direction and send the data to the display device. The display device updates the cursor position in real time, and the cursor moves in the direction pointed by the remote control.
[0065] Figure 3 illustrates an operational scenario of pointing to a remote control provided by some embodiments of this application. As shown in Figure 3, the user can change the pointing position of the remote control 20, so that the display device displays the cursor 30 on the user interface 10 in real time according to the pointing position.
[0066] In some embodiments, the pointing remote control can control the cursor on the user interface. The cursor can be moved by pointing the remote control at different areas of the screen for precise selection. The pointing remote control can switch between multiple modes. When the pointing switch is on, the pointing function is enabled, allowing for pointing, swiping, and clicking operations using the cursor. When the pointing switch is off, the pointing function is disabled. When the pointing function is off, the pointing remote control can operate in button mode, allowing for control of the display device using traditional button operations. The pointing remote control supports various operation methods such as skipping, tapping, selecting, swiping, and dragging, making content browsing more convenient.
[0067] In some embodiments, when the pointing function of the pointing remote control is enabled, the OK button among the ordinary buttons on the pointing remote control can be shared under the pointing function. Figure 4 exemplarily illustrates a control scenario diagram of a pointing remote control provided by some embodiments of this application. As shown in Figure 4, if a user wants to perform a confirmation operation, they can press the OK button (for example, press the touch area filled in black in Figure 4) to enable the display device to obtain the confirmation operation.
[0068] Figure 5 illustrates an exemplary configuration block diagram of a display device 200 according to an exemplary embodiment. As shown in Figure 5, the display device 200 includes at least one of a display 260, a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, an audio output interface 270, a memory, a power supply, and a user interface.
[0069] In some embodiments, the controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.
[0070] The display 260 includes: a display screen assembly for presenting images; a driving assembly for driving image display; an assembly for receiving image signals from the controller and controlling the display of video content, image content, and menu control interface; and a user interface for user operation.
[0071] The display 260 may be an LCD display, an OLED display, or a projection display, and may also be a projection device and a projection screen.
[0072] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
[0073] The user interface can be configured to receive control signals from a control device 100 (e.g., a remote control pointing at a device). These control signals may include the position information of the control device in three-dimensional space. When the control signal is the position information of the control device in three-dimensional space, the controller can perform coordinate transformation to obtain position information in two-dimensional space, and display the cursor on the user interface using this two-dimensional position information. In some embodiments, the control signal may also include position information in two-dimensional space. When the control signal includes position information in two-dimensional space, the control device has a coordinate transformation function. The control device performs coordinate transformation on the position information it detects in three-dimensional space to obtain position information in two-dimensional space, and sends this two-dimensional position information to the display device, thereby causing the display device to display the cursor on the user interface using the two-dimensional position information.
[0074] Detector 230 is configured to acquire signals from the external environment or through interaction with the external environment. For example, detector 230 includes a light receiver, such as a sensor for acquiring ambient light intensity. Alternatively, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures. Or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0075] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.
[0076] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.
[0077] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0078] The controller 250 controls the operation of the display device and responds to user operations by executing various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can perform operations related to the object selected by the user command.
[0079] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.
[0080] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0081] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, view, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0082] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.
[0083] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.
[0084] Operating systems can be divided into different modules or layers based on the functions they implement. For example, as shown in Figure 6, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.
[0085] In some embodiments, at least one application runs in the application layer. This application may include: application 1, application 2, application 3, application 4, etc. These applications may be built-in Windows programs, system settings programs, or clock programs; they may also be applications developed by third-party developers. For example, application 1 may be a karaoke application, and application 2 may be a video application. In specific implementations, the application packages in the application layer are not limited to the examples above.
[0086] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.
[0087] As shown in Figure 6, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: Activity Manager, used to interact with all activities running in the system; Location Manager, used to provide system services or applications with access to system location services; Package Manager, used to retrieve various information related to application packages currently installed on the device; Notification Manager, used to control the display and clearing of notification messages; and Window Manager, used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0088] In some embodiments, the Activity Manager is configured to manage the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager is configured to manage all window programs, such as obtaining the screen size, determining whether a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, dithering the display, distorting the display, etc.).
[0089] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.
[0090] In some embodiments, the kernel layer is a layer between hardware and software. As shown in Figure 6, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0091] Based on the above explanation, it can be concluded that with the rapid development of display technology, display devices have been widely used in diverse scenarios such as home entertainment, business presentations, and education and training.
[0092] In traditional image display technology, in order to achieve the color presentation of an image, the overall image color is usually modulated directly based on a unified color gamut mode.
[0093] However, modulating the color of an entire image still has certain limitations. In real-world scenarios, an image often contains multiple different objects and scenes, each with significantly different color requirements. For example, in landscape photography, elements such as blue sky, white clouds, vegetation, and rocks require different color saturation and contrast to showcase their texture and detail. If a uniform color gamut mode is used for overall modulation, it can easily lead to color distortion in some objects, blurred details, or difficulty in highlighting key information, failing to meet diverse visual needs.
[0094] Furthermore, when directly modulating the color of an image, if the color gamut range differs significantly from the original color gamut, color information can easily be lost during the conversion process. For example, when converting a wide color gamut image to a narrow color gamut mode, many vibrant colors contained in the wide color gamut, such as supersaturated reds and greens, lack corresponding mapping values in the narrow color gamut space. Traditional overall modulation methods typically employ simple compression or truncation strategies to complete the conversion, forcibly mapping the excess colors to the narrow color gamut boundary values. This results in a significant decrease in color saturation, making originally vibrant colors appear dull and lifeless, and smoothing out the transitions between colors, creating obvious color banding. Image details become blurred, severely impacting visual perception and information delivery.
[0095] Based on this, in order to meet the diverse color display needs in complex image scenarios, this application provides a display device, including a first controller, a second controller connected to the first controller, and a micromirror array connected to the second controller. The micromirror array is configured to flip in response to a control command sent by the second controller to perform light modulation on the image to be displayed.
[0096] In some embodiments, the first controller and the second controller may be two independent controllers or the same controller; this application does not impose any limitations on this. It is understood that the following description uses the first controller and the second controller as examples only and is not intended to be limiting.
[0097] During the light modulation process, a light source component can provide light to the micromirror array. This light source component can be located behind or to the side of the micromirror array, providing light to it. The light source component can be an LED light source, a miniLED light source, etc., offering higher brightness and better color performance.
[0098] The first controller and the second controller can be configured to perform the steps shown in FIG7. Referring to FIG7, FIG7 shows a timing interaction diagram of a display control method in a display device in some embodiments of this application. The first controller is configured to perform the following steps.
[0099] S701. Determine at least one target object in the image to be displayed and the target area corresponding to the target object.
[0100] In one embodiment, the first controller can be considered as the main system in the display device, and is configured to be responsible for the overall management and coordination of the operation of the entire display device.
[0101] The image to be displayed is the image that will be presented on the display device. It can be generated by processing various video signal sources (such as camera shooting, video file playback, computer graphics rendering, etc.).
[0102] As an example, the first controller can acquire at least one video signal and generate an image to be displayed based on the video signal.
[0103] The aforementioned video signal is an electronic signal containing image and audio information, used to transmit video content between different devices. The video signal can include various formats and standards; for example, it can be an HDMI (High-Definition Multimedia Interface) signal, a VGA (Video Graphics Array) signal, an OSD (On-Screen Display) signal, etc. These signals can transmit image and sound information generated by video sources (such as computers, game consoles, cameras, and set-top boxes) to display devices through different interfaces and transmission methods.
[0104] In another embodiment, after generating the image to be displayed, the first controller can also convert the signal corresponding to the image to be displayed into a low-voltage differential signal and transmit it to the display to display the image.
[0105] The display itself has already been explained above and will not be repeated here. It should be noted that acquiring at least one video signal and generating the image to be displayed based on it ensures the diversity of signal sources. Furthermore, low-voltage differential signals have strong anti-attenuation capabilities, enabling stable long-distance transmission, and are compatible with various display interface standards, allowing for adaptation to different types of display devices without the need for additional signal conversion devices or complex adaptation adjustments.
[0106] The aforementioned target object refers to a specific object in the image to be displayed that has specific characteristics or is of interest. For example, in a landscape image, clouds in the sky, airplanes, and cars on the ground could be considered target objects; in a medical image, tumors or organs might be considered target objects. The target object can be a specific type of object pre-defined by the user, or it can be an object with special attributes automatically identified according to some algorithm or rule; there is no limitation on this.
[0107] For example, the first controller may, in response to a determination command sent by the remote control device, determine the object in the image to be displayed that the cursor of the remote control device is currently pointing to as the target object.
[0108] The remote control device can be a pointing remote control as shown in the example above. When the display device displays the image to be displayed, the user can hold the remote control and point it at an object in the image. At this time, the object is identified as the target object of interest to the user.
[0109] It should be noted that after determining the target object based on the above interaction process, the first controller can also determine the target object in the subsequent images to be displayed as the object of interest to the user.
[0110] For example, the display device presents an image to be displayed. This could be an artwork containing various elements, an interface with multiple application icons, or a video containing a rich scene. The user holds a remote control and moves the cursor over the image using control components (such as a touchpad or directional keys).
[0111] When the cursor points to an object of interest to the user, the user can press a confirmation button (such as the "OK" button or confirmation button) on the remote control device, causing the remote control device to send a confirmation command to the first controller. After receiving the confirmation command, the first controller can identify the object in the image to be displayed, which is currently being pointed to by the cursor, as the target object.
[0112] Furthermore, after identifying the target object, when the display device displays subsequent images to be displayed, the first controller can extract the features of the target object (e.g., the shape features, color features, etc. of the target object) based on preset feature extraction rules, and identify objects in the subsequent images that have similar features to the target object as objects of interest to the user.
[0113] For example, in a video, the initial target object is a person in the video. When that person appears again in a subsequent frame of the video, the first controller can also identify that person in the subsequent frame as the target object.
[0114] In addition, users can provide feedback on the target object determined by the first controller via a remote control device. For example, if the first controller incorrectly identifies an object as the target object, the user can use the remote control device to correct it and reselect the target object of true interest.
[0115] In another embodiment, the first controller can also identify the image to be displayed and determine the target object based on a preset image recognition model. The image recognition model can be pre-trained based on training data containing multiple objects. In this case, the target object can be set by the user, or a preset set of multiple objects can be selected as the target object.
[0116] The first controller may determine the target object based solely on the image recognition model, or solely on the determination command sent by the remote control device; or, it may determine the target object based on both the image recognition model and the determination command sent by the remote control device, without any limitation.
[0117] For example, the first controller can use a preset image recognition model to analyze the footage (images to be displayed) of a documentary on the screen. During training, the image recognition model has learned the features of various objects (e.g., animals), including the appearance, size, and color of different animals. During the playback of the documentary, the image recognition model can identify various objects in the footage, such as tigers, monkeys, and birds, and mark these identified objects as potential target objects.
[0118] During playback, if the user becomes interested in an animal not identified as the target (e.g., a parrot), the user can move the cursor on the remote control to the image area where the parrot is located and send a confirmation command to the first controller. At this time, the first controller can identify the parrot as the target.
[0119] During subsequent playback, the first controller can also identify the parrot in each image to be displayed as the target object, and at the same time identify the object originally identified by the image recognition model as the target object.
[0120] It should be noted that manually selecting a target object of interest by responding to a confirmation command sent by the remote control device can meet the user's personalized needs and improve the user experience. Furthermore, using a preset image recognition model to determine the target object can achieve automated target object identification.
[0121] The target region mentioned above refers to the area occupied by the target object in the image to be displayed. Typically, the target region can be represented by a rectangle, polygon, or other shape, defining the position and size information of the target object in the image to be displayed, so as to perform targeted processing on the target object, such as color modulation, image enhancement, or other operations on the target region alone.
[0122] For example, a target region can be represented by (a, b, h, w). Here, a and b can represent the pixel position of the top-left vertex of the target region, and h and w can represent the length and width of the target region, respectively.
[0123] In one embodiment, after a target object is identified through an image recognition model or a determination command, the first controller can further extract the contour information of the target object. Then, based on the boundary coordinates of the contour, the smallest rectangular or polygonal region that can contain the entire target object is calculated; this region is the target region. For example, for an irregularly shaped object, the target region is determined by calculating its circumscribed rectangle, or the region formed by the pixel coordinates covered by the irregular shape is determined as the target region.
[0124] As an example, the first controller can determine the target image partition in the image to be displayed where the target object is located, and define the target image partition as the target area.
[0125] The image to be displayed includes multiple preset image partitions. For example, 12 preset image partitions. In this embodiment, the number of preset image partitions is not limited.
[0126] For example, refer to Figure 8, which illustrates an application scenario of determining a target partition in a control method for a display device according to an embodiment of this application. The image to be displayed can be pre-divided into 12 preset image partitions. When the target object is located in preset image partition 1, preset image partition 1 is determined to be the target area. At this time, the remaining preset image partitions where no target object exists are determined to be non-target areas.
[0127] For example, when the target object is located in both preset image partition 2 and preset image partition 3, both preset image partition 2 and preset image partition 3 are determined to be the target area.
[0128] For example, when two or more objects, such as target object 1 and target object 2, are located in preset image partition 4, preset image partition 4 is determined to be a target object partition.
[0129] In another embodiment, the first controller may also determine the region composed of pixels corresponding to the target object in the image to be displayed as the target region.
[0130] For example, based on the detection of a target object, the first controller can perform pixel-level segmentation of the target object to determine whether each pixel belongs to the target object. For instance, for some simple target objects, threshold segmentation can be used to distinguish the target from the background based on features such as the grayscale value or color value of the pixels. For complex target objects, accurate pixel-level segmentation can be achieved based on region growing, level sets, and deep learning semantic segmentation models (e.g., U-Net, DeepLab, etc.).
[0131] When segmenting using the above method, the target object can be separated from the background of the image to be displayed, resulting in a binary mask image, where white pixels represent the target object and black pixels represent the background.
[0132] Finally, based on the pixel-level segmentation results, the region consisting of all pixels belonging to the target object is determined as the target region. For example, by traversing each pixel in the mask image, the coordinates of all white pixels can be determined, and the region formed by the pixels in the image to be displayed corresponding to those coordinates can be determined as the target region.
[0133] Understandably, by dividing the image to be displayed into multiple preset image partitions, the first controller can quickly locate the partition where the target object is located and define it as the target region. This approach reduces the computational load on the first controller and increases processing speed. Defining the region composed of pixels corresponding to the target object as the target region allows for more refined operations, accurately outlining the object's contours. Furthermore, subsequent modulation based on the micromirror array corresponding to this target region can improve the display detail of the image.
[0134] In one embodiment, the number of target objects can be one or more, and there is no limitation thereto. It is understood that when there are multiple target objects, there will also be multiple corresponding target regions.
[0135] However, when there are many target areas, although display detail can be increased, a large amount of computation is required. When there are few target areas, although the computational load can be reduced, the display detail of the image to be displayed will be reduced after light modulation.
[0136] In other words, to improve display detail, it is often necessary to divide the image to be displayed into more detailed sections, increasing the number of target areas. When there are many target areas, the first and second controllers can perform more precise color and light modulation for each target area, thereby significantly improving display detail and making the image texture and color transitions more delicate and realistic.
[0137] However, a large number of target areas will cause the first and second controllers to process more signals, and the amount of computation will increase exponentially, greatly reducing the efficiency of data processing and causing display delays or stuttering.
[0138] Conversely, reducing the number of target areas can reduce computational load, improve data processing speed, and ensure timely display, but the area of each target area will increase, the graininess of color modulation and light modulation will be enhanced, making it difficult to accurately present complex color changes and subtle differences in the picture, resulting in loss of display details and affecting the overall visual effect.
[0139] Therefore, in order to balance display detail and computational load, it is particularly important to reasonably divide the target area. As an example, the first controller can determine the display configuration parameters when the image to be displayed is shown, and then determine the maximum number of partitions for the target area based on the display configuration parameters.
[0140] In one embodiment, the display configuration parameters are configured to describe various characteristics of the display device playing the image to be displayed. For example, the display configuration parameters include at least the display frame rate, and may also include parameters such as resolution and viewing mode, without limitation.
[0141] In one embodiment, the maximum number of partitions is the maximum number that can be achieved when dividing the image to be displayed into target regions. It should be noted that dividing the image to be displayed into target regions corresponding to the maximum number of partitions can not only improve the detail of the image to be displayed after light modulation as much as possible, but also maintain the timeliness of data processing.
[0142] It should be added that if the actual number of target objects in the image to be displayed is less than or equal to the maximum number of partitions, it indicates that the first controller can determine the target area corresponding to each target object. If the actual number of target objects in the image to be displayed is greater than the maximum number of partitions, it indicates that the first controller can partition only the target objects corresponding to the maximum number of partitions, and does not need to determine the target areas corresponding to the remaining target objects.
[0143] In this embodiment, when the actual number of target objects in the image to be displayed is greater than the maximum number of partitions, the first controller can determine the target objects and their corresponding target areas in descending order of their preset priority; or, based on the coverage area of each target object, determine the target objects and their corresponding target areas in descending order of their coverage area. In this embodiment, the method for determining the target objects and their corresponding maximum number of partitions when the actual number of target objects in the image to be displayed is not limited.
[0144] In one embodiment, the first controller may pre-store a correspondence table recording the relationship between different display frame frequencies and the maximum number of partitions. Once the display frame frequency is determined, the first controller determines the corresponding maximum number of partitions by looking up the correspondence table. Alternatively, the first controller may dynamically calculate the maximum number of partitions using a preset algorithm. For example, the maximum number of partitions may be equal to the ratio of a fixed coefficient to the display frame frequency (if the ratio is not an integer, it may be rounded up or down). In this embodiment, the method for determining the maximum number of partitions based on display configuration parameters is not limited.
[0145] It should be noted that when determining the maximum number of partitions using the above method, the maximum number of partitions corresponding to a higher display frame rate should be at least less than or equal to the maximum number of partitions corresponding to a lower display frame rate. In other words, the higher the display frame rate, the smaller the maximum number of partitions.
[0146] For example, if a user is watching a live game stream on a display device, the video signal output by the first controller to the monitor has a display frame rate of 120Hz. After detecting this display frame rate, the first controller can determine, based on a pre-set correspondence table, that the maximum number of partitions in the target area is 10. That is, since a high frame rate means a fast update speed for the image (to be displayed), each frame needs to be processed quickly. If the number of target partitions is too large, it will lead to excessive computation, making it impossible to complete processing in time, resulting in stuttering. Therefore, a relatively small number of partitions can be selected to ensure smooth display of the game screen.
[0147] When a user presents a slideshow using a display device, the frame rate may be set to 30Hz due to the low slide transition frequency. In this case, the first controller can determine, based on the correspondence table, that the maximum number of partitions in the target area can reach 20. That is, because of the low frame rate, the first controller will have sufficient time to process the images to be displayed. Furthermore, increasing the maximum number of partitions for the target object allows for more precise color and brightness adjustments to the target area, improving the display details of text, images, and other content in the slideshow.
[0148] In this embodiment, determining the maximum number of partitions in the target area based on the display frame rate of the image to be displayed achieves a dynamic balance between display detail and processing efficiency. A higher display frame rate paired with a smaller maximum number of partitions ensures smooth playback of the story while reducing computation and increasing processing speed. Conversely, a lower display frame rate paired with a larger maximum number of partitions satisfies the need for smooth display of dynamic scenes while enhancing the display detail of the image through fine color modulation. Furthermore, flexibly adjusting the number of partitions based on display configuration parameters avoids inefficiency caused by blindly pursuing fine modulation and prevents sacrificing display quality for improved timeliness, enabling the display device to adaptively partition the image to be displayed according to different scenario requirements.
[0149] S702. Determine the mode identifier of the target color gamut mode corresponding to the target object, as well as the area information of the target area.
[0150] In one embodiment, the aforementioned target color gamut mode is a mode used to define how the color of a target object is light-modulated. Light modulation based on different color gamut modes can cause the same color data to present different visual effects when displayed. For example, light modulation based on a standard color gamut mode allows the colors of the image to be displayed to be shown within a conventional color range. However, light modulation based on a wide color gamut mode enables the image to display richer and more vibrant colors, expanding the range of color representation.
[0151] The aforementioned pattern identifier is a symbol, code, or name used to uniquely identify the target color gamut mode. Through the pattern identifier, it can be clearly determined which color gamut mode should be used for light modulation of the target object, so as to accurately control the color display effect.
[0152] In one embodiment, the first controller may pre-store the color gamut mode corresponding to each target object, and each color gamut mode has a unique identifier in order to determine the mode identifier corresponding to the target color gamut mode.
[0153] The aforementioned area information can be either an area identifier or the pixel coordinates of the pixels that form the area; there is no limitation on which.
[0154] For example, referring to Figure 8, when the image to be displayed includes multiple preset image partitions, since the target image partition where the target object is located is determined as the target region, the first controller can directly determine the region identifier corresponding to the target image partition as the aforementioned region information. When the region composed of pixels corresponding to the target object in the image to be displayed is determined as the target region, the first controller can determine the pixel position of the pixel as the target region.
[0155] It should be noted that, as illustrated in the example of S701 above, when two or more objects, such as target object 1 and target object 2, are located in the preset image partition 4, it can be determined that the preset image partition 4 is also a target object partition. However, in this case, when control commands are subsequently generated based on the target color gamut mode corresponding to the mode identifier to control the micromirror array corresponding to the region information and sent to the micromirror array, one target region (preset image partition 4) will correspond to at least two mode identifiers, resulting in two different control commands.
[0156] At this time, if the second controller modulates light on a target area (preset image partition 4) based on control commands corresponding to two or more mode identifiers, there will be a conflict, resulting in problems such as color disorder and abnormal brightness in the displayed image.
[0157] Therefore, to address the aforementioned issues, when a single target area corresponds to at least two mode identifiers, the first controller can introduce a decision mechanism to determine the corresponding mode identifier. For example, the first controller can prioritize the mode identifier of the target color gamut mode corresponding to the highest-priority target object within the target area, based on the priority of multiple target objects. Alternatively, it can determine the coverage area of each target object within the target area and use the mode identifier of the target color gamut mode corresponding to the target object with the largest coverage area as the mode identifier for that target area. Furthermore, through a comprehensive evaluation of priority weights and / or coverage area size, a unique mode identifier for the target area is ultimately determined, thereby ensuring the consistency and stability of the optical modulation process and effectively avoiding display anomalies caused by multi-mode conflicts.
[0158] S703, send the mode identifier and area information to the second controller.
[0159] In one embodiment, after obtaining the pattern identifier and the area information, the first controller can send the pattern identifier and the area information to the second controller, so that the second controller can control the micromirror array to perform optical modulation on each target object in a regional manner based on subsequent steps (e.g., step S704).
[0160] It is understood that in embodiments where the first controller and the second controller are the same controller, step S703 may also be omitted.
[0161] In some embodiments, the second controller can be configured to perform the following steps:
[0162] S704. Based on the target color gamut mode corresponding to the mode identifier, generate control commands to control the micromirror array corresponding to the region information, and send them to the micromirror array.
[0163] In one embodiment, the second controller may also have multiple color gamut modes and a mode identifier corresponding to each color gamut mode pre-set. Then, after receiving the mode identifier and region information sent by the first controller, the second controller determines the target color gamut mode based on the mode identifier.
[0164] In one embodiment, when the region information is a region identifier, the micromirror array can also be pre-divided into multiple regional micromirror arrays, each corresponding to a preset image partition. That is, the second controller can pre-store the correspondence between region identifiers and regional micromirror arrays. Then, based on this correspondence, the regional micromirror array corresponding to the region identifier is determined to perform optical modulation on the target region.
[0165] When the region information is in pixel coordinates, each micromirror in the micromirror array can correspond to a single pixel. In this case, the second controller can determine the region micromirror array corresponding to the target region based on all the pixel coordinates in the region information.
[0166] It should be noted that a micromirror array is an array structure composed of multiple tiny mirrors, typically used in display devices to modulate and control light. Each micromirror can be independently adjusted in angle. By controlling the angles of different micromirrors, the direction and intensity of light reflection can be precisely controlled, thereby adjusting display parameters such as brightness and color in different areas of the image.
[0167] For example, a micromirror array can consist of millions of independently controlled digital micromirrors (e.g., chips ranging from 0.2 inches to 1.38 inches, with resolutions from 720p to 4K). Each digital micromirror corresponds to a pixel and can be independently flipped (±12° or ±17°) to achieve an "on" (bright) or "off" (dark) state by reflecting light. Each digital micromirror array is controlled by an independent SRAM (Static Random Access Memory) unit, in conjunction with hardware driver circuitry (a high-speed, high-precision controller supports partitioned data input and processing) and software algorithms to achieve the division of the micromirror array into regions, thereby modulating the light of the micromirror array corresponding to the target region.
[0168] Based on the above explanation, it can be assumed that a regional micromirror array can correspond to a control command to control the flipping of each micromirror in that regional micromirror array.
[0169] The control commands may include identifiers indicating whether the micromirror is turned on or off, as well as the control time for turning on or off, without limitation.
[0170] In this embodiment, the first controller can determine the target object and its corresponding target region in the image to be displayed, and then obtain the target color gamut mode identifier corresponding to the target object and the region information corresponding to the target region, and transmit it to the second controller. Based on the above information, the second controller can control the regional micromirror array to achieve regional light modulation of the target object. Using this method, the target color gamut mode can be adaptively adapted to the characteristics of different target objects in the image to be displayed. Furthermore, by selectively modulating light only on the target region, compared to traditional full-image processing, the accuracy of color adjustment can be improved, effectively meeting the diverse color display needs in complex image scenes, and avoiding the problem of color interference between different target objects during overall adjustment. By modulating light on the regional micromirror array to indirectly modulate the color gamut of the image to be displayed, each target region can undergo fine-grained light modulation under the target color gamut mode. Even during conversions with large differences in color gamut range, color information can be preserved to the greatest extent through flexible control of the micromirror array, avoiding color loss due to color gamut mismatch.
[0171] In one embodiment, the second controller can convert the color parameters corresponding to the target color gamut mode into specific control commands for the regional micromirror array. These control commands control the angle and duration of adjustment for each micromirror to achieve the desired light modulation effect.
[0172] As an example, the second controller can generate control commands for controlling the regional micromirror array according to steps S901-S903 as shown in Figure 9.
[0173] S901. Determine the RGB color components corresponding to the various color parameters in the target color gamut mode.
[0174] In one embodiment, the second controller may be a display controller or a digital micromirror device (DMD). A DMD is a device that uses a micromirror array to control light reflection to display an image.
[0175] In one embodiment, the aforementioned color parameters include, but are not limited to, parameters such as hue, saturation, and brightness of a single color, and are not limited thereto. For example, taking a, d, and e as representing the hue, saturation, and brightness parameters of a single color, respectively, and r (red), g (green), b (blue), c (cyan), m (magenta), y (yellow), and w (white) as representing colors, the various color parameters included in the color gamut mode can be ar, ag, ab, ac, am, ay, aw, dr, dg, db, dc, dm, dy, dw, er, eg, eb, ec, em, ey, ew, etc. For example, ar represents the hue of red, ag represents the hue of green, and other color parameters are similar. At least one of the color parameters corresponding to different color gamut modes is different.
[0176] In one embodiment, RGB color components refer to the values of the three color channels: Red, Green, and Blue. Different combinations of these three components can represent a variety of visible colors. In the RGB color mode, the value range of each color component is typically from 0 to 255, where 0 represents the lowest intensity and 255 represents the highest intensity. For example, the RGB value of pure red is (255, 0, 0), indicating that the red component has the highest intensity, while the green and blue components have an intensity of 0; pure green is (0, 255, 0); pure blue is (0, 0, 255); white is (255, 255, 255), indicating that all three color components have the highest intensity; and black is (0, 0, 0), indicating that all three color components have the lowest intensity.
[0177] In one embodiment, the second controller can pre-set a relationship model between hue (a), saturation (d), and lightness (e) and the RGB color space, converting each color parameter into its corresponding RGB color component. For example, the relationship model includes, but is not limited to, the HSV (Hue, Saturation, Lightness) color model and the HSL (Hue, Saturation, Lightness) color model, and is not limited thereto.
[0178] Based on the above description, the second controller can obtain the RGB color components corresponding to each color parameter.
[0179] S902. For any RGB color component, decompose each color value in the RGB color component into bit plane data corresponding to multiple bit planes.
[0180] In one embodiment, the bit-plane data is divided into first data representing the micromirror being turned on and second data representing the micromirror being turned off. In this embodiment, the specific values of the first and second data are not limited. For example, the first data can be 1 and the second data can be 0.
[0181] In one embodiment, a bit plane is a method of storing and processing image data. Taking a common computer screen as an example, in a computer, the pixel color values of an image are usually represented by binary numbers. For example, in an 8-bit grayscale image, the grayscale value of each pixel is described by an 8-bit binary number, with a value range of 0-255. From a storage perspective, a plane formed by collecting the information corresponding to the same bit for all pixels is called a bit plane.
[0182] An image can be considered as a superposition of multiple bit planes. Taking an 8-bit depth image as an example, it can be considered as 8 bit planes, from the least significant bit (LSB, bit 0) to the most significant bit (MSB, bit 7). Typically, the higher bit planes contain the main visual information of the image, such as edges and contours; the lower bit planes mainly contain finer details and have less impact on the visual effect of the image.
[0183] Bit plane data is information stored on a bit plane. Each bit plane stores the binary value of the corresponding bit for all pixels, and the combination of multiple binary values can reflect the characteristics of the image on that bit plane. For example, in an 8-bit color image (each color value in the RGB color components is 8 bits), the highest bit bit of the red component's bit plane data records the highest bit information of the red component of all pixels.
[0184] For example, an RGB color component contains color values corresponding to three color channels (R, G, and B color channels). Taking the red component (R color value) as an example, the second controller can decompose the R color value into a binary drive signal and represent it in binary. If the red component is 150, it becomes 10010110 in binary. Then, the 0th plane data is 0, the 1st plane data is 1, the 2nd plane data is 1, the 3rd plane data is 0, the 4th plane data is 1, the 5th plane data is 0, the 6th plane data is 0, and the 7th plane data is 1.
[0185] In one embodiment, after obtaining the bit plane data of multiple bit planes corresponding to each color value in each RGB color component, the bit plane data can be stored in the above-mentioned static random access memory so that the bit plane data can be called in real time.
[0186] S903. Within a preset time window, control instructions are generated sequentially based on each bit plane and its corresponding bit plane data.
[0187] In one embodiment, the aforementioned preset time window refers to a period of time pre-set for completing a specific operation (such as controlling the micromirror array to flip to display an image). The preset time window can be set according to the actual situation and is not limited thereto.
[0188] In one embodiment, the second controller can process each bit plane sequentially based on a pre-set bit plane order, reading bit plane data from the static random access memory. Each bit plane data corresponds to the state information of each micromirror in the regional micromirror array on that bit plane. That is, whether the micromirror should be in the "on" (flipped +12°) or "off" (flipped -12°) state. For example, a bit plane data of 1 indicates that the micromirror is "on", and a bit plane data of 0 indicates that the micromirror is "off".
[0189] Based on this, the second controller can control the flipping of each micromirror in the regional micromirror array via electronic signals within a preset time window, according to the read bit plane data. That is, when the bit plane data is "1", the corresponding micromirror is flipped to the "on" (+12°) state, reflecting light into the imaging optical path, corresponding to the bright parts of the image; when the bit plane data is "0", the micromirror is flipped to the "off" (-12°) state, preventing light from reflecting into the imaging optical path, corresponding to the dark parts of the image. Furthermore, by processing each bit plane sequentially and controlling the flipping state of the micromirrors according to the bit plane data, a complete grayscale image is finally synthesized.
[0190] In processing color images, the bit plane data of the three color components (red, green, and blue, i.e., RGB color components) are usually processed in a similar way to form a color image.
[0191] In this embodiment, the RGB color components corresponding to the target color gamut mode are determined. For any RGB color component, each color value in the RGB color component is decomposed into multiple bit plane data, so that the micromirror's on and off states are represented by the first and second data, respectively. Based on this, within a preset time window, control commands are generated sequentially based on the bit planes and corresponding data, so that the adjustment of each color channel no longer restricts each other. When processing images containing rich color levels, the red, green, and blue color channels can be adjusted independently and with high precision simultaneously according to their respective bit plane data. Different channels can flexibly adjust the micromirror state according to the needs of the corresponding color areas in the image, which not only expands the range of color adjustment but also achieves fine control over each color channel. Furthermore, by processing the RGB color channels in parallel, the color distortion or loss of detail caused by mutual interference of channel adjustments in traditional technologies is avoided, significantly improving the image's color reproduction and expressiveness.
[0192] It should be noted that within the preset actual window, the flipping time of the micromirrors corresponding to each bit plane can be the same or different.
[0193] However, different bit planes have varying degrees of importance for image display. Higher bit planes typically contain the main outlines and large areas of color information, significantly impacting the overall visual effect; lower bit planes involve more detailed image information. By assigning a larger time weight to higher bit planes, resulting in longer control times, the micromirror array can have more time to accurately present the main features of the image, thus highlighting important information within a limited timeframe and improving the overall image quality and clarity.
[0194] Therefore, in order to improve the overall quality and clarity of the image to be displayed, the second controller can also determine the control time corresponding to each bit plane within a preset time window, based on the preset time weight corresponding to each bit plane. Then, control commands are generated sequentially according to the data of each bit plane and the corresponding control time.
[0195] For example, based on the above explanation of bit planes, each bit plane represents grayscale information at different precision levels. Therefore, the preset time weight corresponding to a bit plane with a higher precision level is greater than the preset time weight corresponding to a bit plane with a lower precision level. Furthermore, by assigning a larger time weight to the higher precision bit planes, thus making their corresponding control time longer, the micromirror array can have more time to accurately present the main features of the image.
[0196] As an example, the preset time weights corresponding to each bit plane can be shown in Table 1 below:
[0197] Table 1:
[0198] Here, Bit n represents the nth bit plane; the larger the number, the higher the precision level of the grayscale information corresponding to the bit plane. The preset time weight of bit plane 7 is 1 / 2, meaning that half of the time resources will be allocated to this bit plane during the control of the micromirror array flipping process. Because it is in a high bit position, it has a significant impact on the overall outline and main visual features of the image. The preset time weight of bit plane 6 is 1 / 4, and the allocated time resources account for one-quarter, making it less important than bit plane 7. And so on, from bit plane 5 to bit plane 0, the preset time weights are 1 / 8, 1 / 16, 1 / 32, 1 / 64, 1 / 128, and 1 / 256 respectively. As the bit plane changes from high bit to low bit, the weight gradually decreases, and the allocated time resources become less and less. The low bit planes have a relatively small impact on the image and mainly carry subtle detail information.
[0199] Setting the preset time weights for each bit plane using the aforementioned fixed ratio is simple and systematic, making it easy to implement and control in hardware circuitry. The second controller can quickly calculate the control time for each bit plane based on the fixed ratio, facilitating hardware design and optimization, and reducing hardware design complexity and cost.
[0200] As an example, taking 10010110 as an example, the 0th plane data is 0, the 1st plane data is 1, the 2nd plane data is 1, the 3rd plane data is 0, the 4th plane data is 1, the 5th plane data is 0, the 6th plane data is 0, and the 7th plane data is 1. When the 0th plane data is read, the micromirror can be controlled to flip to the "off" (-12°) state for a duration of 1 / 256 × T, where T is a preset time window. Then, when the next plane data is read, for example, the 2nd plane data is 1, the second controller can control the micromirror to flip to the "on" (-12°) state for a duration of 1 / 128 × T.
[0201] Based on the above explanation, different bit planes represent grayscale information of different precision levels. By assigning different control times to each bit plane through preset time weights, targeted processing can be performed according to the importance of grayscale information. For high-bit planes carrying key color and contour information, a longer control time is allocated to ensure that the micromirror array has sufficient time to accurately flip, so as to finely present the core details and color levels of the image. For low-bit planes, a relatively shorter control time is allocated according to their influence on the overall color, which improves processing efficiency while ensuring overall color harmony. This method achieves fine and dynamic adjustment of color channels, enabling red, green, and blue color channels to perform high-precision restoration of key color information and quickly process secondary information when processed in parallel, avoiding color deviation or loss of detail caused by uniform processing time.
[0202] Furthermore, although the preset time weight corresponding to the aforementioned low-level plane is relatively small, it is a non-zero value. This suggests that while the detailed information in the low-level plane has a relatively small impact on the overall image effect, it still plays a role in the realism and detail of the image. Therefore, by reasonably setting the time weight, a balance between the overall image and its details can be achieved while ensuring the accurate presentation of the main features of the image.
[0203] In another embodiment, when generating control commands based on each bit plane data and its corresponding control time, the bit plane data can be read sequentially from high to low precision level to generate control commands. Alternatively, the bit plane data can be read sequentially from low to high precision level to generate control commands.
[0204] Understandably, reading bit-plane data based on a clear and orderly processing flow allows hardware and software systems to be designed and operated according to fixed rules. Furthermore, when the second controller controls the micromirror array to flip, the complexity of the control circuitry and algorithms can be simplified, development costs and technical difficulties reduced, and the stability and reliability of the system improved.
[0205] It should be noted that when operating according to the order of accuracy from high to low, the high-level plane data that has the greatest impact on color rendering is processed first. This ensures that the basic color outlines and key hues in the image to be displayed can be presented quickly and accurately, laying a solid foundation for subsequent color detail supplementation. As the control flow moves to the lower-level plane, the details and hierarchical information of the rich colors are gradually supplemented, so that the micromirror array is always finely constructed around the core color throughout the modulation process.
[0206] Therefore, in this embodiment, bit plane data can be read in descending order of precision level to generate control commands. Furthermore, this descending order of processing fully leverages the parallel adjustment capabilities of the multi-color channel processing units. Red, green, and blue color channels can simultaneously process their respective bit plane data according to precision order, without interference and with high efficiency. In contrast, traditional micromirror array control methods lack ordered processing of color data precision levels, which can easily lead to the loss of critical color information or secondary information interfering with the presentation of primary colors, making it difficult to guarantee accurate color reproduction when processing complex images.
[0207] For ease of explanation, please refer to Figure 10, which exemplarily illustrates an application scenario of light modulation in a control method for a display device according to an embodiment of this application. The data transmission interface and related control signals include horizontal synchronization (HSYNC), frame synchronization (VSYNC), and pixel clock (PCLK) signals, which collaboratively control the rhythm and position of data loading to achieve control of the micromirror array. Details are as follows:
[0208] The frame synchronization (VSYNC) signal marks the start of data for a frame of image to be displayed. When a VSYNC pulse is detected, the loading of data for a new frame of image to be displayed can be considered to have begun. In the horizontal direction, each pulse of the horizontal synchronization (HSYNC) signal determines the starting position of a line of data. For example, after VSYNC is triggered, preparation for loading a frame of image to be displayed begins, and subsequently, HSYNC pulses guide the loading process for each line of data.
[0209] The Pixel Clock (PCLK) provides a time base for loading pixel data. One pixel's bit plane data is transferred within each clock cycle of the PCLK. For example, at a PCLK frequency of 10MHz, 10M pixels of data can be transferred per second. Data is transferred sequentially pixel by pixel, transferring the bit plane data of the red (R), green (G), blue (B), and other color components to SRAM in turn.
[0210] Following the row order of the image to be displayed, the bit plane data corresponding to the target region is loaded into SRAM pixel by pixel from left to right and from top to bottom. For example, for a target region with a width of W pixels and a height of H rows, the bit plane data corresponding to the W pixels of the first row is loaded first, then the second row is loaded, and so on, until the bit plane data of all pixels in the H rows is loaded.
[0211] During the loading process, each bit plane is processed sequentially from the most significant bit (MSB) to the least significant bit (LSB) according to the bit plane weight, so as to control the corresponding micromirrors to flip based on the bit plane data, until the bit plane data corresponding to each color value in each RGB color component is completed.
[0212] It should be added that, for other areas not including the target object, in order to improve display details, the micromirror arrays corresponding to other areas can be adjusted according to the default color gamut mode. In some embodiments, when the second controller generates control commands to control the micromirror array corresponding to the area information based on the target color gamut mode corresponding to the mode identifier and sends them to the micromirror array, it can also use the default color gamut mode to control the remaining micromirrors in the micromirror array (micromirrors not belonging to the area micromirror array) to modulate the light of the remaining background in the image to be displayed. That is, the first controller only needs to send the area information corresponding to the target area and the mode identifier corresponding to the target object, without needing to send the area information of other areas and the identifier corresponding to the default color gamut mode.
[0213] For ease of explanation, please refer to Figures 11 and 12. Figure 11 shows a schematic diagram of the structure of a display device provided in another embodiment of this application, and Figure 12 shows a timing interaction diagram of a display control method in a display device provided in another embodiment of this application.
[0214] When an image to be displayed is acquired, the first controller can acquire the display configuration parameters for displaying the image, and determine the maximum number of partitions in the target area based on the display configuration parameters.
[0215] The first controller sends the image to be displayed to the monitor for display. During the display process, the image can be identified based on a preset image recognition model to determine the target object, and the region formed by the pixels corresponding to the target object in the image is defined as the target region. If the number of target regions exceeds the maximum number of partitions, target objects with higher priority or larger coverage areas can be selected sequentially based on their priority or the coverage area of the target region, until the target objects corresponding to the maximum number of partitions are obtained.
[0216] Then, the first controller can determine the mode identifier of the target color gamut mode corresponding to the target object, as well as the region information of the target area, and send the mode identifier and region information to the second controller. For example, the pixel position corresponding to the pixel covered by the target object can be used as the region information.
[0217] For each target region, given its corresponding mode identifier and region information, the second controller can determine the RGB color components corresponding to various color parameters in the target color gamut mode. For example, it can convert parameters such as hue, saturation, and brightness into RGB color components.
[0218] Then, for any RGB color component, the second controller can decompose each color value in the RGB color component into bit plane data corresponding to multiple bit planes. For example, 0 or 1.
[0219] Finally, the second controller can determine the control time corresponding to each bit plane based on the preset time weight, and generate control commands according to the precision level of each bit plane, from high to low, based on the data of each bit plane and the corresponding control time, and send them to the micromirror array. For example, the generated control commands can include the control time and the bit plane data indicating whether the micromirrors are turned on or off.
[0220] The micromirror array can be flipped in response to control commands sent by a second controller to achieve light modulation of the target object of the image to be displayed on the screen. For example, the control time corresponding to when the bit plane data is 0 is when the micromirrors are off, and the control time corresponding to when the bit plane data is 1 is when the micromirrors are on. During the above process, the light source component provides light to the micromirror array.
[0221] Furthermore, for the remaining micromirrors corresponding to other non-target areas, the second controller can control the remaining micromirrors according to the default color gamut mode. This control method can be similar to the control method corresponding to the regional micromirror array, and will not be described in detail. Based on this, it can be assumed that when there are no target objects in the image to be displayed, the first and second controllers can also generate control commands according to the default color gamut mode and send them to the micromirror array to complete the light modulation of the image to be displayed.
[0222] In another embodiment, as shown in FIG7, the display device can be used to implement the control method of the display device described in the above method embodiments.
[0223] The display device may include one or more memories storing programs that can be run by a controller to generate instructions, causing the controller to execute the control method for the display device described in the above method embodiments according to the instructions.
[0224] In some embodiments, the memory may also store data. The controller may also read the data stored in the memory, which may be stored at the same memory address as the program, or stored at a different memory address.
[0225] The controller and memory can be set up separately or integrated together; for example, integrated on the system on chip (SOC) of the terminal device.
[0226] In some embodiments, the display device may be a projection device. The following describes a display device control method provided in another embodiment of this application, using a projection device as an example.
[0227] Before providing a detailed explanation of the display device control method provided in this embodiment, the terms, application scenarios, and projection devices involved in this embodiment will be introduced first.
[0228] The RGB color system is a color system that uses red, green, and blue as its basic colors. Based on the human eye's heightened sensitivity to these three colors, the RGB system uses them as primary colors. Each primary color typically ranges from 0 to 255 (in 8-bit color depth), representing the intensity or brightness level of that color. By adjusting the intensity ratios of these three primary colors, almost all colors from black (where all colors have zero intensity) to white (where all colors have their maximum intensity) can be mixed. Specifically, RGB color values can be represented by a triplet (R, G, B), where R represents the intensity of red light, G represents the intensity of green light, and B represents the intensity of blue light. For example, RGB(255, 0, 0) represents pure red, RGB(0, 255, 0) represents pure green, RGB(0, 0, 255) represents pure blue, and RGB(255, 255, 255) represents white.
[0229] The XYZ color system, also known as the CIE 1931 XYZ color space, is a system developed by the International Commission on Illumination (CIE) based on the RGB system. It uses mathematical methods to select three ideal primary colors (X, Y, Z) to replace the actual three primary colors (red, green, and blue). In the XYZ system, the Y value represents the brightness information of a color, while x = X / (X+Y+Z), y = Y / (X+Y+Z), and z = Z / (X+Y+Z) (x+y+z=1) represent the chromaticity of the color. The XYZ color system solves the problem of potentially negative tristimulus values in the RGB system, resulting in a more uniform color distribution and variation.
[0230] Chromaticity Diagram: A chromaticity diagram is a planar diagram representing various chromatic colors using points at different locations. It was developed by the International Commission on Illumination (CIE) in 1931, hence the name CIE chromaticity diagram. In the chromaticity diagram, the x-coordinate represents the proportion of red primary color, the y-coordinate represents the proportion of green primary color, and the z-coordinate representing blue primary color can be derived from x + y + z = 1. The points on the chromaticity diagram represent the hue and saturation of various chromatic colors. By connecting the points on the chromaticity diagram, the mixing and variation of colors can be visually observed. The CIE chromaticity diagram (also known as a horseshoe diagram) includes a tongue-shaped region. This tongue-shaped region represents all naturally visible colors in the CIE 1931 chromaticity diagram. Because this region is tongue-shaped, it is also called the "tongue curve" diagram. The outer curve of the tongue is the trajectory line of all visible monochromatic light colors, with each point representing the color of a specific wavelength of monochromatic light, ranging from 390 nm to 760 nm. The bottom straight line connects the two ends of the tongue-shaped curve, forming a closed area. The colors within the tongue-shaped area include all colors that can be physically achieved.
[0231] Chromaticity coordinates: These are the coordinate values used to represent the chromaticity of a color on a chromaticity diagram, typically represented by two coordinates: x and y. Chromaticity coordinates are based on the XYZ color system and are obtained by calculating x = X / (X+Y+Z) and y = Y / (X+Y+Z). Chromaticity coordinates uniquely determine the chromaticity (hue and saturation) of a color, regardless of its lightness. In a chromaticity diagram, every point corresponds to a specific chromaticity coordinate, allowing for accurate description and comparison of chromaticity differences between different colors.
[0232] Color gamut: A method of encoding a color, describing the total number of colors a technical system can produce. On a chromaticity diagram, color gamut is typically represented as a closed region containing the colors that the system can accurately reproduce.
[0233] Color gamut standards are methods for encoding and defining colors, specifying the range of colors that a particular device, system, or media can accurately reproduce. Color gamut standards are typically presented in the form of a color space, represented as a closed region on a chromaticity diagram. The colors within this region represent all the colors covered by the standard. The core of color gamut standards is ensuring the consistency and repeatability of colors across different devices, platforms, and media. For example, BT2020, BT709, and DCI-P3 are three different color gamut standards, and their representation on a chromaticity diagram reflects their respective range and capabilities of color reproduction. The XYZ color system provides the basic framework and theoretical basis for color gamut standards. Color gamut standards are usually implemented by defining specific color gamut ranges (such as triangular regions) based on the XYZ color space. During the development and application of color gamut standards, it is often necessary to convert color values from other color systems (such as RGB) to XYZ values for comparison and calibration within a unified color space. As an example, please refer to Figure 13, which is a schematic diagram of the color gamut ranges corresponding to a DCI-P3 and a three-color laser TV respectively, provided in an embodiment of this application.
[0234] Color Gamut Table: Different color gamut standards correspond to different color gamut tables. A color gamut table includes the coordinates of red (R), green (G), and blue (B). These three coordinates are the vertices of the corresponding color gamut triangles in the chromaticity diagram, determining the size and shape of the color coverage area. The positions of the triangles formed by the R, G, and B coordinates differ for different color gamut standards.
[0235] RGB-XYZ Conversion Coefficients: Converting color values from the RGB color system to the XYZ color system requires specific conversion coefficients. These coefficients describe the mapping relationship between the RGB and XYZ color systems. Different color gamut standards define different color ranges; therefore, the conversion coefficients used when converting RGB color values to the XYZ color space will also differ. In some cases, the conversion between the RGB and XYZ color systems is achieved through a linear transformation, which can be represented by a 3×3 matrix. The elements in the matrix are the conversion coefficients, and the color values in the RGB color system can be converted to values in the XYZ color system using the following formula (1).
[0236] In formula (1) above, a 11 To a 33 These are the RGB-XYZ conversion coefficients, where R, G, and B are the color components in the RGB color system, and X, Y, and Z are the color components in the XYZ color system.
[0237] The application scenarios of this embodiment will be introduced next.
[0238] During image projection, the projector needs to determine projection parameters based on the original color data carried by the image. These parameters typically include color parameters. For example, for any color component in the color value of any pixel in the image, this color component is converted into a binary number. Based on the weight dataset and this binary number, the duty cycle corresponding to that color component is determined. Similarly, the duty cycle corresponding to each color component of each pixel in the image can be determined. Then, according to the duty cycle corresponding to the corresponding color component, the light valve is driven to modulate the light emitted by the light source, thereby achieving image projection. The weight dataset includes the weights corresponding to each bit in the binary number. Determining the duty cycle corresponding to a color component based on the weight dataset and the binary number means multiplying the value of each bit in the binary number by its corresponding weight to obtain the duty cycle corresponding to each bit. The sum of the duty cycles of each bit in the binary number is then determined as the duty cycle corresponding to that color component.
[0239] In related technologies, projectors typically use a globally unified weighted dataset to process the color value of each pixel (i.e., all pixels use the same weighted dataset when determining the duty cycle corresponding to each color component), thereby obtaining the duty cycle corresponding to each color component of each pixel in the image. For example, the color value of pixel 1 in the image includes three color components: red, green, and blue. The value of the red component is 255, the value of the green component is 200, and the value of the blue component is 128, that is, the color value is (255, 200, 128). After performing binary conversion on these three color components, the binary number of the red component is 11111111, the binary number of the green component is 11001000, and the binary number of the blue component is 10000000. The binary number consists of 8 bits. In the weighted dataset, the weight of the first bit (the least significant bit) from least significant to most significant is 1 / 256, the weight of the second bit is 1 / 128, the weight of the third bit is 1 / 64, the weight of the fourth bit is 1 / 32, the weight of the fifth bit is 1 / 16, the weight of the sixth bit is 1 / 8, the weight of the seventh bit is 1 / 4, and the weight of the eighth bit (the most significant bit) is 1 / 2. The above weighted dataset is used to calculate the duty cycle for each of the red, green, and blue color components. In this case, the duty cycle for the red component is... The duty cycle corresponding to the green component is: The duty cycle corresponding to the blue component is: Currently, the display period of an image frame is typically divided into three sub-periods: red (R), green (G), and blue (B). Each sub-period corresponds to the activation time of a light source of one color. In this case, for any pixel, the switching time of the corresponding micromirror (DMD) is driven according to the duty cycle of each color component of that pixel. For example, if the duty cycle of the red component is 100%, then the DMD micromirror remains "on" for 100% of the sub-period corresponding to the red component; if the duty cycle of the green component is 72.125%, then the DMD micromirror remains "on" for 72.125% of the sub-period corresponding to the green component; and if the duty cycle of the blue component is 50%, then the DMD micromirror remains "on" for 50% of the sub-period corresponding to the blue component. In this way, the persistence of vision effect of the human eye can be effectively utilized to synthesize color images.
[0240] However, because images often possess rich content and diverse visual features, the different content within an image is crucial for the viewer's visual experience and the accurate transmission of information. Processing the image using a uniform weighted dataset as described above may result in poor projection visual effects in certain areas.
[0241] Based on this, this embodiment provides a display device control method that can determine the weight dataset corresponding to each pixel in the target image based on at least one region of interest (also called the target region), and project the target image based on the target values (i.e., the binary numbers corresponding to the pixel color values) and weight datasets corresponding to multiple pixels. Since this embodiment can determine the corresponding weight dataset for each pixel based on the region of interest, and at least two pixels among multiple pixels have different weight datasets, it ensures that different weight datasets are used to process pixels according to the characteristics of pixels in different regions of the image. This avoids using a uniform weight dataset for all pixels, thus enabling processing that better matches the visual characteristics of different content areas in the image, significantly improving the visual effect of the projection of these areas. Since the duty cycle is configured to drive the light valve to modulate the light emitted by the light source, calculating the duty cycle using the weight dataset corresponding to each pixel allows for more precise modulation of the light emitted by the light valve, thereby more accurately restoring the color of each pixel in the image during projection and improving the color display effect of the projected image.
[0242] The projection device involved in this embodiment will be described next.
[0243] Please refer to Figure 14, which is a schematic diagram of a projection device according to an exemplary embodiment. The projection device includes a projection host 01, which includes a system processor 11 (similar to the first controller in the foregoing embodiment), a display control unit 12 (similar to the second controller in the foregoing embodiment), a light source 13, and a light valve 14.
[0244] The system processor 11 decodes the bitstream to obtain the target image, which is the image to be projected by the projector. Based on the original color data of the target image, it determines the color value of each pixel in the target image and sends the color values of each pixel in the target image to the display control unit. The display control unit 12 receives the color values of each pixel in the target image sent by the system processor; based on the color values of each pixel in the target image, it determines at least one region of interest in the target image and the target values corresponding to multiple pixels in the target image, where the target values are the values obtained by binary conversion of the color values of the corresponding pixels; based on at least one region of interest, it determines the weight datasets corresponding to multiple pixels, where the weight datasets include the weights corresponding to each bit in the binary number, and at least two pixels have different weight datasets; based on the color values of each pixel in the target image, it controls the light source to emit light; and based on the target values and weight datasets corresponding to multiple pixels, it controls the light valve to modulate the light emitted by the light source to achieve projection of the target image.
[0245] In some embodiments, the bitstream can be encoded data from an external input, or encoded data generated based on an external image or video source. For example, the external video source can be a network video source, a video source transmitted via a High Definition Multimedia Interface (HDMI), or a video source stored in a storage medium such as a hard disk; this application embodiment does not impose any limitations on this.
[0246] In some embodiments, the display control unit 12 can control the light source 13 to illuminate based on the color values of each pixel in the target image, so as to emit light that matches the color values of multiple pixels. The display control unit 12 can also control the light valve 14 to modulate the light emitted by the light source 13 based on the target values and weight datasets corresponding to multiple pixels, so as to realize the projection of the target image.
[0247] Light source 13 is used to provide a light source illumination beam. Light source 13 can be a laser light source, in which case it can include a laser of at least one color, such as a blue laser; it can also be a dual-color laser, such as a blue laser and a red laser; of course, it can also be a three-color laser light source, such as a laser including three colors: red (RED, R), green (Green, G), and blue (Blue, B), to provide a three-color laser illumination beam.
[0248] The light valve 14 (also known as an amplitude modulation component) is a component capable of controlling the amplitude (or intensity) of light passing through it, thereby enabling dynamic display of images or videos. Furthermore, the amplitude modulation component can be a transmissive liquid crystal display (LCD), a liquid crystal on silicon (LCOS), or a digital micromirror device (DMD) chip, among other types. DMD chips are typically used in digital light processing (DLP) projection architectures.
[0249] Taking light source 13 as a three-color laser source as an example, in a laser projection device without a phase light modulator (PLM), the lasers of the three-color laser source sequentially emit laser beams of R, G, and B colors, which are then sequentially projected onto the amplitude modulator. Taking the DMD as an example, the amplitude modulator maintains the same timing as the three-color laser beam emission. The DMD receives the duty cycles corresponding to each of the three color components. Based on the duty cycle corresponding to each color component, it controls the positive or negative angle flips of thousands of tiny mirrors on the DMD surface. This modulates the amplitude of the laser beam corresponding to the color component projected onto the DMD, achieving projection imaging. That is, when a red laser beam projects onto the DMD, the DMD modulates the amplitude of the red laser beam according to the duty cycle corresponding to the red component, and so on. In a laser projection device including a PLM, the lasers of the three-color laser source sequentially emit laser beams of R, G, and B colors, which are then sequentially projected onto the PLM. The PLM modulates the phase of the laser beam incident on it to shape and homogenize the laser. Then, the phase-modulated laser beam is emitted onto the DMD for amplitude modulation to complete the subsequent laser projection step.
[0250] It should be understood that in the above laser projection process, although the three laser beams for a complete frame of image are emitted sequentially, the sequential emission speed is relatively fast, and the human eye has the characteristic of visual persistence, which enables the laser projection device to display the image to be projected.
[0251] In some embodiments, the projection device further includes a projection screen 02, and the projection host 01 can communicate with the projection screen 02. This communication connection can be wired or wireless, and this embodiment does not limit this. The projection host 101 can be installed in various ways. For example, as shown in Figure 15, the installation methods of the projection host 101 include desktop front projection, desktop rear projection, ceiling-mounted front projection, and ceiling-mounted rear projection. Desktop front projection means the projection host 101 is placed on a desktop, with the user and the projection host 101 on the same side and in front of the projection screen 102. Desktop rear projection means the projection host 101 is placed on a desktop, with the user and the projection host 101 on opposite sides of the projection screen 102. Ceiling-mounted front projection means the projection host 101 is fixed to the ceiling of the room, with the user and the projection host 101 on the same side and in front of the projection screen 102. Ceiling-mounted rear projection means the projection host 101 is fixed to the ceiling of the room, with the user and the projection host 101 on opposite sides of the projection screen 102. The projection screen 102 can be mounted on a wall or suspended from the ceiling, and of course, it can also be installed in other ways.
[0252] Those skilled in the art should understand that the functions of the above-described projection host 01 and projection screen 02 are merely examples. Other existing or future functions that may be applicable to the embodiments of this application should also be included within the scope of protection of the embodiments of this application, and are hereby incorporated by reference.
[0253] It should be noted that the application scenarios and execution entities described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the emergence of new application scenarios and devices, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.
[0254] The display device control method provided in this embodiment will now be explained in detail.
[0255] Figure 16 is a flowchart of a display device control method provided in some embodiments of this application, which is applied to a projection host. Referring to Figure 16, the method includes the following steps.
[0256] Step 1601: Determine at least one region of interest in the target image and the target values corresponding to multiple pixels in the target image. The target values are the values of the color values of the corresponding pixels after binary conversion. The target image is the image to be projected by the projection host.
[0257] In some embodiments, the process of determining at least one region of interest in a target image includes: identifying the target image based on the color values of each pixel in the target image to obtain at least one region of interest in the target image.
[0258] In some implementations, the target image can be input into the recognition model to obtain the location of at least one region in the target image output by the recognition model, as well as the type of the corresponding region. For any region in the at least one region, if the type of the region is one of the region types, then the region is determined to be the region of interest.
[0259] For example, the region type includes at least one of the following: blue sky region, white cloud region, green area region, flower region, and skin color region. A blue sky region refers to a region of interest containing blue sky; a white cloud region refers to a region of interest containing white clouds; a green area region refers to a region of interest containing green grass; a flower region refers to a region of interest containing flowers; and a skin color region refers to a region of interest containing skin color. As an example, Figure 5 is a schematic diagram of a target image provided in an embodiment of this application. This target image includes two regions of interest: a white cloud region and a flower region.
[0260] In one possible implementation, the target image is divided into multiple sub-regions. In this case, for any one of the multiple sub-regions, the sub-region is input into the recognition model to obtain the type of the sub-region output by the recognition model. If the type of the region is one of the above-mentioned region types, then the sub-region is determined to be the region of interest.
[0261] For example, referring to Figure 18, the target image can be divided into 16 sub-regions on average. In some other possible implementations, the number of target regions can also be determined according to the display configuration parameters, as described in the foregoing embodiments. This embodiment does not limit the number of sub-regions. It should be noted that the target image can be a single image or a video frame from a video; this embodiment does not limit this.
[0262] This embodiment does not specifically limit the method of determining the region of interest. For example, the pointing remote control in the previous embodiment can also be used to determine the region of interest.
[0263] In some implementations, the color value includes multiple color components, and the target value includes target values corresponding to each of the multiple color components. In this case, the process of determining the target values corresponding to the multiple pixels in the target image based on the color values of each pixel in the target image includes: for any color component of the target pixel in the target image, converting the color component into a binary number to obtain the target value corresponding to that color component. Processing the multiple color components of the target pixel in the same way yields the target values corresponding to the multiple color components of the target pixel. The target pixel is any pixel in the target image.
[0264] In one possible implementation, the aforementioned multiple color components are the three color components of the RGB color system: Red, Green, and Blue.
[0265] As an example, if the red component is 255, then the target value corresponding to the red component after converting it to a binary number is 11111111.
[0266] In some implementations, the projection host includes a system processor and a display control unit. The system processor can decode the bitstream to obtain the target image, determine the color value of each pixel in the target image based on the original color data of the target image, and send the color values of each pixel in the target image to the display control unit. The target image is the image to be projected by the projection host. The display control unit can then receive the color values of each pixel in the target image sent by the system processor and execute the above steps 1601 and 1602.
[0267] Step 1602: Based on at least one region of interest, determine the weight datasets corresponding to multiple pixels respectively. The weight datasets include the weights corresponding to each bit in the binary number. Among the multiple pixels, at least two pixels have different weight datasets.
[0268] Based on the region type of at least one region of interest, determine the weight datasets corresponding to the pixels included in at least one region of interest; determine the weight datasets corresponding to the pixels included in other regions of the target image as the default weight datasets, and the other regions are the regions in the target image other than at least one region of interest.
[0269] For example, the region type includes at least one of the following: blue sky region, white cloud region, green area region, flower region, and skin color region. The color value includes multiple color components, the weight dataset includes a weight dataset of multiple color components, and the weight dataset of the target color component corresponding to at least two pixels among the multiple pixels is different. The target color component includes at least one of the multiple color components.
[0270] For example, please refer to Figure 19, which is a schematic diagram of a color component provided in this embodiment. The multiple color components are the red, green, and blue color components in the RGB color system. Each color component corresponds to a weight dataset. These weight datasets can be the same or different, or at least two color components may have the same weight dataset. This embodiment does not limit this. Having at least two pixels with different weight datasets means that at least two pixels have different weight datasets corresponding to the same color component. For example, the red component of pixel 1 and the red component of pixel 2 in the target image have different weight datasets.
[0271] Since color components (such as red, green, and blue) are the basic elements that constitute the colors of an image, the distribution, intensity, and visual impact of different color components vary in an image. By setting a separate weight dataset for each color component, different weight values can be assigned to the binary bits of each color component, thereby achieving fine-grained control over the brightness, saturation, and other characteristics of each color component. For example, when processing images containing rich color transitions, the depth of the red area can be enhanced by adjusting the weight dataset of the red component. This fine-grained control makes the color representation of the projected image closer to the original scene, improving color fidelity.
[0272] In some implementations, the process of determining the weight datasets corresponding to the pixels included in at least one region of interest based on the region type of at least one region of interest includes: determining at least one influencing component corresponding to the target region type from multiple color components, wherein the target region type is the region type of the target region of interest, the target region of interest is any one of the at least one regions of interest, and the at least one influencing component refers to the color component that affects the visual display effect of the image corresponding to the target region type; determining the target weight dataset from multiple candidate weight datasets corresponding to the target influencing component, and determining the target weight dataset as the weight dataset of the target influencing component corresponding to the pixels included in the target region of interest, wherein the target influencing component is any one of the at least one influencing component corresponding to the target region of interest; if the multiple color components also include other components besides the at least one influencing component, then the weight dataset of the other components is determined as the default weight dataset of the other components.
[0273] In some implementations, based on the correspondence between region type and at least one color component, at least one color component corresponding to the target region type is determined, and at least one color component is determined as the at least one influence component.
[0274] As an example, at least one color component corresponding to the blue sky area is a blue component; at least one color component corresponding to the white cloud area is a red, blue, and green component; at least one color component corresponding to the green field area is a green component; at least one color component corresponding to the flower area is a red component; and at least one color component corresponding to the skin color area is a red component.
[0275] In some embodiments, the process of determining the target weight dataset from multiple candidate weight datasets corresponding to the target influence component includes: determining a first color saturation of the target interest region based on the color value of each pixel in the target interest region, wherein the first color saturation is configured to describe the average color saturation of the target interest region; and determining the target weight dataset from multiple candidate weight datasets corresponding to the target influence component based on the first color saturation.
[0276] For any pixel in the target image, determine the color saturation of that pixel based on its color value. Process each pixel in the target image in the same way to obtain the color saturation of each pixel individually. The average of the color saturations of all pixels in the target image is then determined as the first color saturation.
[0277] In some embodiments, the original color data of a pixel is the pixel's component in the RGB color system. In this case, based on the pixel's component in the RGB color system, the pixel's component in the HSV / HSL color system is determined according to a relevant algorithm, and the saturation component of the pixel in the HSV / HSL color system is determined as the color saturation corresponding to that pixel.
[0278] The HSV color system consists of three components: hue, saturation, and value. Hue represents the basic color type, such as red, green, and blue. Hue is usually represented by an angle, ranging from 0° to 360° (or 0 to 1, if normalized). For example, red corresponds to 0° (or 360°), green to 120°, and blue to 240°. Saturation represents the purity or intensity of a color. Higher saturation means a more vibrant color; lower saturation means a color closer to gray. Saturation typically ranges from 0 to 1 (or 0% to 100%). Value represents the lightness or darkness of a color. Higher value means a brighter color; lower value means a darker color. In the HSV model, value also ranges from 0 to 1 (or 0% to 100%). The HSL color system also consists of three components: hue, saturation, and value. Hue, like in HSV, defines color type by angle. Saturation: Also represents color purity (0% is gray, 100% is pure color). Lightness: Represents the brightness of a color (0% is black, 50% is pure color, 100% is white). HSV's lightness only considers the brightness of pure color, while HSL's lightness takes into account the mixing ratio of color and white, resulting in a more uniform lightness variation for the same parameters.
[0279] Please refer to Figure 20. Figure 8 is a schematic diagram of determining a target weight dataset according to some embodiments of this application. Multiple candidate weight datasets include a first weight dataset. The weight corresponding to the i-th bit in the binary number included in the first weight dataset is greater than the weight corresponding to the i-th bit in the binary number included in the default weight dataset. In this case, if the first color saturation is lower than the first saturation threshold, the first weight dataset is determined as the target weight dataset.
[0280] When the first color saturation of the target region of interest is lower than the first saturation threshold, it indicates that the overall color of that region is not vibrant enough and the contrast is insufficient. In this case, this embodiment uses a first weighted dataset to process the color components. Since the weight corresponding to the i-th bit in the binary number included in the first weighted dataset is greater than the weight corresponding to the i-th bit in the binary number included in the default weighted dataset, that is, the weight of each bit in the first weighted dataset is increased compared to the default dataset. A larger weight means that the calculated duty cycle of the color component is increased. Since the switching time of the micromirror device (DMD) is directly related to the duty cycle, determining the first weighted dataset as the target weighted dataset can extend the time that the micromirror corresponding to the low-saturation image region is in the "on" state in the sub-cycle corresponding to the corresponding color component, thereby improving the display effect of that color component.
[0281] In some embodiments, referring to Figure 20, multiple candidate weight datasets include a second weight dataset. The weight corresponding to the i-th bit in the binary number included in the second weight dataset is less than the weight corresponding to the i-th bit in the binary number included in the default weight dataset. In this case, if the first color saturation is higher than the second saturation threshold, the second weight dataset is determined as the target weight dataset.
[0282] When the first color saturation of the target region of interest is higher than the second saturation threshold, it indicates that the overall color of that region is too vibrant. In this case, this embodiment uses a second weighted dataset to process the color components. Since the weight of the i-th bit in the binary number included in the second weighted dataset is less than the weight of the i-th bit in the binary number included in the default weighted dataset, that is, the weight of each bit in the first weighted dataset is reduced compared to the default dataset. The smaller weight means that the calculated duty cycle of the color component is reduced. Since the switching time of the micromirror device (DMD) is directly related to the duty cycle, determining the second weighted dataset as the target weighted dataset can shorten the time that the micromirror corresponding to the high-saturation image region is in the "on" state in the sub-cycle corresponding to the corresponding color component, thereby improving the display effect of that color component.
[0283] In some embodiments, the second saturation threshold is equal to or greater than the first saturation threshold. If the second saturation threshold is greater than the first saturation threshold, and the first color saturation is higher than the first saturation threshold but lower than the second saturation threshold, then the default weight dataset corresponding to the target influence component is determined as the target weight dataset.
[0284] It should be noted that in the embodiments of this application, "higher than" can be understood as greater than, or greater than or equal to. When "higher than" is understood as greater than, "lower than" can be understood as less than or equal to. When "higher than" is understood as greater than or equal to, "lower than" can be understood as less than. The following uses of "higher than" and "lower than" can refer to this interpretation.
[0285] If the number of at least one influencing component is less than 3, then the weight dataset corresponding to one or two of the three color components (red, green, and blue) is determined using the above method. Therefore, it is also necessary to determine the weight dataset corresponding to the remaining color components. That is, if the multiple color components include other components besides at least one influencing component, then the weight dataset of the other components is determined as the default weight dataset of the other components.
[0286] It should be noted that the above process first determines at least one influencing component corresponding to the target region type, then determines the corresponding weight dataset for the influencing component, and determines the corresponding weight dataset for other categories in the multiple color classifications besides the influencing component. It can be understood that in some embodiments, the weight dataset corresponding to the target region type (including the weight datasets corresponding to multiple color components) can also be determined from the weight dataset corresponding to the region type, and the weight dataset corresponding to the target region type can be determined as the weight dataset corresponding to the pixels included in the region of interest. That is, this method does not require determining the influencing component, but directly determines the "weight datasets corresponding to multiple color components" corresponding to the target region type from the correspondence. This application does not limit the implementation method of determining the weight dataset corresponding to the target region type.
[0287] It should be noted that the above method allows for adjustment of the projected color by modifying the weight datasets corresponding to different region types. Different weight datasets result in different duty cycles calculated for the pixel color values, thus leading to different color gamut ranges. The color gamuts achievable with different weight datasets are shown in Table 2 below.
[0288] Table 2
[0289] Table 2 above shows the hue, saturation, and lightness (L) of red, green, blue, cyan, magenta, yellow, and white in different color gamuts. These colors are the vertices corresponding to the color gamuts in the chromaticity diagram, determining the size and shape of the color coverage area. 'a' represents the hue of the corresponding color; 'b' represents the saturation of the corresponding color; and 'c' represents the lightness of the corresponding color. A color in the chromaticity diagram can be uniquely represented by a, b, and c. In some cases, the coordinate values of the color in the chromaticity diagram can also be used to represent the color; this application does not limit this approach. When colors are represented by a, b, and c, a... r 1 refers to the offset of the hue of red in color gamut 1 relative to the hue of red in the default color gamut; b r 1 refers to the offset of red saturation in color gamut 1 relative to red saturation in the default color gamut; c r The value 1 refers to the offset of the brightness of red in color gamut 1 relative to the brightness of red in the default color gamut. Other colors in color gamut 1 and other colors in other color gamuts have similar meanings to the red in color gamut 1 mentioned above, and will not be repeated here.
[0290] Furthermore, the default color gamut in Table 1 above refers to the color gamut that can be presented after processing the corresponding color components according to the default weight datasets corresponding to the red component, green component, and blue component. Color gamut 1 refers to the color gamut that can be presented after processing the corresponding color components according to the weight dataset corresponding to the blue sky region; color gamut 2 refers to the color gamut that can be presented after processing the corresponding color components according to the weight dataset corresponding to the white cloud region; color gamut 3 refers to the color gamut that can be presented after processing the corresponding color components according to the weight dataset corresponding to the green area; color gamut 4 refers to the color gamut that can be presented after processing the corresponding color components according to the weight dataset corresponding to the flower region; and color gamut 5 refers to the color gamut that can be presented after processing the corresponding color components according to the weight dataset corresponding to the skin color region.
[0291] Step 1603: Project the target image based on the target value and weight dataset corresponding to multiple pixels.
[0292] In some embodiments, the projection host includes a display control unit, a light source, and a light valve. After the display control unit determines the target values and weight datasets corresponding to multiple pixels according to steps 1601-1602 above, it can control the light source to emit light based on the color values of each pixel in the target image; and control the light valve (such as a DMD) to modulate the light emitted by the light source based on the target values and weight datasets corresponding to multiple pixels, so as to realize the projection of the target image.
[0293] In some embodiments, the process of controlling the light valve to modulate the light emitted by the light source based on the target values and weight datasets corresponding to multiple pixels includes: for any one of the multiple color components of the target pixel, multiplying the value of each bit in the target value corresponding to that color component by its corresponding weight to obtain the duty cycle corresponding to each bit, and then determining the sum of the duty cycles of each bit in the binary number as the duty cycle corresponding to that color component. Processing each color component in the same way yields the duty cycle corresponding to each color component. Then, based on the duty cycle corresponding to each color component, a driving signal for the micromirror corresponding to the target pixel in the light valve is generated to control the micromirror to modulate the light emitted by the light source.
[0294] This embodiment determines the corresponding weight dataset for each pixel based on the region of interest, and at least two pixels among multiple pixels have different weight datasets. This ensures that different weight datasets are used to process pixels according to the characteristics of different regions in the image, avoiding the uniform processing method applied to all pixels with a single weight dataset. This allows for more precise processing of regions with different content in the image, significantly improving the visual effect of the projection of these regions. Since the duty cycle is used to drive the light valve to modulate the light emitted by the light source, calculating the duty cycle using the weight dataset corresponding to each pixel allows for more precise modulation of the light emitted by the light valve. This results in more accurate color reproduction of each pixel in the image during projection, improving the color display effect of the projected image.
[0295] Furthermore, since color components (such as red, green, and blue) are the basic elements constituting image color, the distribution, intensity, and visual impact of different color components vary in an image. By setting a separate weight dataset for each color component, different weight values can be assigned to the binary bits of each color component, thereby achieving fine-grained control over the brightness, saturation, and other characteristics of each color component. For example, when processing images containing rich color transitions, the depth of the red area can be enhanced by adjusting the weight dataset of the red component. This fine-grained control makes the color representation of the projected image closer to the original scene, improving color reproduction. When the first color saturation of the target region of interest is lower than the first saturation threshold, it indicates that the overall color of that region is not vibrant enough and the contrast is insufficient. In this embodiment, a first weighted dataset is used to process the color components. Since the weight corresponding to the i-th bit in the binary number included in the first weighted dataset is greater than the weight corresponding to the i-th bit in the binary number included in the default weighted dataset (i.e., the weight of each bit in the first weighted dataset is increased compared to the default dataset), a larger weight means a larger duty cycle for the calculated color component. Since the switching time of the micromirror device (DMD) is directly related to the duty cycle, determining the first weighted dataset as the target weighted dataset can extend the time the micromirror corresponding to the low-saturation image region remains in the "on" state within the sub-cycle corresponding to the corresponding color component, thus improving the display effect of that color component. When the first color saturation of the target region of interest is higher than the second saturation threshold, it indicates that the overall color of that region is too vibrant. In this case, this embodiment uses a second weighted dataset to process the color components. Since the weight of the i-th bit in the binary number included in the second weighted dataset is less than the weight of the i-th bit in the binary number included in the default weighted dataset, that is, the weight of each bit in the first weighted dataset is reduced compared to the default dataset. The smaller weight means that the calculated duty cycle of the color component is reduced. Since the switching time of the micromirror device (DMD) is directly related to the duty cycle, determining the second weighted dataset as the target weighted dataset can shorten the time that the micromirror corresponding to the high-saturation image region is in the "on" state in the sub-cycle corresponding to the color component, thereby improving the display effect of the color component.
[0296] Figure 21 is a structural block diagram of a projection device 1000 provided in some embodiments of this application. The projection device 1000 includes a projection host 1001. The projection host 1001 may include a system processor 1003, a memory 1004, a display control unit 1005, a light source 1006, and a light valve 1007. Optionally, the projection device also includes a projection screen 1002, which is used to display graphics, text, icons, videos, and other information. In some embodiments, the projection device is a laser projection device.
[0297] The system processor 1003 includes one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 1003 can be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The system processor 1003 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the system processor 1003 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the system processor 1003 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.
[0298] The memory 1004 may include one or more computer-readable storage media, which may be non-transitory. The memory 1004 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1004 are used to store at least one instruction, which is executed to implement the display device control method provided in the embodiments of this application.
[0299] The display control unit 1005 can generate a drive signal for the light source 1006 to control the light source 1006 to emit light, and can also generate a drive signal for the light valve 1007 to control the light valve 1007 to modulate the light emitted by the light source 1006 to achieve image projection.
[0300] Those skilled in the art will understand that the structure shown in FIG21 does not constitute a limitation on the projection device 1000, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0301] This application also provides a computer program product that, when executed by a controller, implements the control method of the display device in any of the method embodiments of this application.
[0302] The computer program product can be stored in memory, for example, as a program. The program is eventually converted into an executable object file that can be executed by the controller after processes such as preprocessing, compilation, assembly, and linking.
[0303] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the control method of the display device in any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.
[0304] The computer-readable storage medium is, for example, memory. Memory can be volatile or non-volatile, or it can include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0305] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, a+b, a+c, b+c, or a+b+c, where a, b, and c can be single or multiple.
[0306] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0307] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0308] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and modules described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0309] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0310] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. A display device comprising: at least one controller, and a micro-mirror array connected with the at least one controller; the at least one controller is configured to: determine at least one target object in a to-be-displayed image and a target region corresponding to the target object; determine a mode identifier of a target gamut mode corresponding to the target object, and region information of the target region; generate a control instruction for controlling a region micro-mirror array corresponding to the region information based on the target gamut mode corresponding to the mode identifier, and send the control instruction to the micro-mirror array; the micro-mirror array is configured to flip in response to the control instruction sent by the at least one controller to complete light modulation on the to-be-displayed image.
2. The display device of claim 1, wherein, The at least one controller includes a first controller and a second controller, the second controller is connected with the first controller, and the micro-mirror array is connected with the second controller, wherein: the first controller is configured to determine at least one target object in a to-be-displayed image and a target region corresponding to the at least one target object; determine a mode identifier of a target gamut mode corresponding to the target object, and region information of the target region; and send the mode identifier and the region information to the second controller; the second controller is configured to generate the control instruction for controlling the region micro-mirror array corresponding to the region information based on the target gamut mode corresponding to the mode identifier, and send the control instruction to the micro-mirror array.
3. The display device according to claim 1 or 2, wherein, Before determining at least one target object in a to-be-displayed image and a target region corresponding to the target object, the at least one controller is further configured to: determine a display configuration parameter when the to-be-displayed image is displayed; the display configuration parameter at least includes a display frame frequency; determine a maximum partition number of the target region based on the display configuration parameter; the maximum partition number corresponding to a high display frame frequency is less than or equal to the maximum partition number corresponding to a low display frame frequency.
4. The display device according to claim 1 or 2, wherein, Determining at least one target object in a to-be-displayed image and a target region corresponding to the target object includes: in response to a determination instruction sent by a remote control device, determining an object in the to-be-displayed image currently pointed to by a cursor of the remote control device as a target object; and / or, determining the target object based on a preset image recognition model to recognize the to-be-displayed image; determining a region corresponding to the target object in the to-be-displayed image as the target region.
5. The display device of claim 4, wherein, The to-be-displayed image includes a plurality of image partitions, and determining a region corresponding to the target object in the to-be-displayed image as the target region includes: determining a target image partition in the to-be-displayed image where the target object is located, and determining the target image partition as the target region; the to-be-displayed image includes a plurality of preset image partitions; or, determining a region composed of pixels corresponding to the target object in the to-be-displayed image as the target region.
6. The display device according to any one of claims 1-5, wherein, Generating a control instruction for controlling a region micro-mirror array corresponding to the region information based on the target gamut mode corresponding to the mode identifier includes: determining a plurality of color parameters in the target color gamut mode correspond to RGB color components respectively; for any one of the RGB color components, decomposing each color value in the RGB color component into bit plane data corresponding to a plurality of bit planes respectively; the bit plane data includes first data representing micro-mirror opening and second data representing micro-mirror closing; in a preset time window, generating the control instruction based on each bit plane and corresponding bit plane data in sequence.
7. The display device of claim 6, wherein, Each of the bit planes represents gray scale information of different accuracy levels. In a preset time window, the control instruction is generated based on each bit plane and corresponding bit plane data in sequence, including: in the preset time window, determining a control time corresponding to each bit plane based on a preset time weight corresponding to the bit plane; the preset time weight corresponding to the bit plane with a high accuracy level is greater than the preset time weight corresponding to the bit plane with a low accuracy level; generating the control instruction in sequence according to each bit plane data and corresponding control time.
8. The display device of claim 7, wherein, Generating the control instruction in sequence according to each bit plane data and corresponding control time includes: generating the control instruction in sequence according to each bit plane data and corresponding control time based on the order from high to low of each accuracy level.
9. The display device of claim 1, wherein, When a target region corresponds to at least two mode identifiers, the at least one controller is further configured to: determine the mode identifier of the target color gamut mode corresponding to the target object with the highest priority as the mode identifier corresponding to the target region according to the priority of the plurality of target objects in the target region; or determine the coverage area of each target object in the target region, and determine the mode identifier of the target color gamut mode corresponding to the target object with the largest coverage area as the mode identifier of the target region.
10. The display device of claim 1, wherein, For non-target regions in the target image other than target regions, the micro-mirrors corresponding to the non-target regions are controlled according to a default color gamut mode.
11. A control method of a display apparatus, applied to a display apparatus, the display apparatus comprising at least one controller, and a micro-mirror array connected with the at least one controller. The control method of the display device includes: determining at least one target object in a to-be-displayed image and a target region corresponding to the target object; determining a mode identifier of a target color gamut mode corresponding to the target object and region information of the target region; generating a control instruction for controlling a region micro-mirror array corresponding to the region information based on the target color gamut mode corresponding to the mode identifier, and sending the control instruction to the micro-mirror array; The micro-mirror array flips in response to the control instruction to complete light modulation on the to-be-displayed image. 12.The control method of a display device according to claim 11, wherein, Before determining at least one target object in a to-be-displayed image and a target region corresponding to the object, it further includes: determining a display configuration parameter when the to-be-displayed image is displayed; the display configuration parameter at least includes a display frame frequency; determining a maximum partition number of the target region based on the display configuration parameter; the maximum partition number corresponding to a high display frame frequency is less than or equal to the maximum partition number corresponding to a low display frame frequency. 13.The control method of a display device according to claim 11, wherein, The determining of the at least one target object in the to-be-displayed image and the target region corresponding to the target object comprises: In response to a determination instruction sent by a remote control device, an object in the to-be-displayed image currently pointed to by a cursor of the remote control device is determined as a target object; And / or, based on a preset image recognition model, the target object in the to-be-displayed image is determined. The target region is determined as the target region corresponding to the target object in the to-be-displayed image.
14. A display device comprising a projection host, the projection host comprising a system processor, a display control unit, a light source and a light valve; The system processor is configured to: decode a bitstream to obtain a target image, the target image being an image to be projected by the projection host, determine color values of each pixel point in the target image based on original color data of the target image, and send the color values of each pixel point in the target image to the display control unit; The display control unit is configured to receive color values of each pixel point in the target image sent by the system processor. Based on the color values of each pixel point in the target image, at least one region of interest in the target image and target values corresponding to a plurality of pixel points included in the target image are determined, the target values being numerical values obtained by binary conversion of the color values of the corresponding pixel points; Based on the at least one region of interest, a weight data set corresponding to the plurality of pixel points is determined, the weight data set comprising weights corresponding to each bit in a binary number, and the weight data sets corresponding to at least two pixel points in the plurality of pixel points being different; Based on the color values of each pixel point in the target image, the light source is controlled to emit light; Based on the target values and the weight data sets corresponding to the plurality of pixel points, the light valve is controlled to modulate the light emitted by the light source to realize projection of the target image.
15. The method of claim 14, wherein, The display control unit is configured to: Based on the region type of the at least one region of interest, a weight data set corresponding to the pixel points included in the at least one region of interest is determined; The weight data set corresponding to the pixel points included in other regions in the target image is determined as a default weight data set, the other regions being regions in the target image other than the at least one region of interest.
16. The method of claim 15, wherein, The color values comprise a plurality of color components, the weight data set comprises a weight data set of the plurality of color components, and the weight data sets of target color components corresponding to at least two pixel points in the plurality of pixel points are different, the target color components comprising at least one color component in the plurality of color components.
17. The method of claim 16, wherein, The display control unit is configured to: From the plurality of color components, at least one influence component corresponding to a target region type is determined, the target region type being a region type of a target region of interest, the target region of interest being any one of the at least one region of interest, and the at least one influence component being a color component affecting the visual display effect of a picture corresponding to the target region type; The target weight data set is determined from a plurality of candidate weight data sets corresponding to the target influence component, and the target weight data set is determined as a weight data set of the target influence component corresponding to pixel points included in the target region of interest, the target influence component being any one of at least one influence component corresponding to the target region of interest; If the plurality of color components further include other components in addition to the at least one influence component, the weight data set of the other components is determined as a default weight data set of the other components.
18. The method of claim 17, wherein, The display control unit is configured to: determine a first color saturation of the target region of interest based on color values of each pixel point in the target region of interest, the first color saturation being configured to describe an average color saturation of the target region of interest; determine the target weight data set from a plurality of candidate weight data sets corresponding to the target influence component based on the first color saturation.
19. The method of claim 18, wherein, The plurality of candidate weight data sets include a first weight data set, and a weight corresponding to an i-th bit of a binary number included in the first weight data set is greater than a weight corresponding to the i-th bit of a binary number included in the default weight data set; The display control unit is configured to: if the first color saturation is lower than a first saturation threshold, the first weight data set is determined as the target weight data set.
20. The method of claim 18, wherein, The plurality of candidate weight data sets include a second weight data set, and a weight corresponding to an i-th bit of a binary number included in the second weight data set is less than a weight corresponding to the i-th bit of a binary number included in the default weight data set; The display control unit is configured to: if the first color saturation is higher than a second saturation threshold, the second weight data set is determined as the target weight data set.
