Display driving board and electronic equipment
By dynamically generating and integrating candidate graphic materials of UI components in the MCU of the display driver board, the problems of large memory capacity and high cost in the prior art are solved, and high-quality UI screen display effect is achieved.
Patent Information
- Application Number
- CN202311500275.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-10
- Publication Date
- 2025-05-13
AI Technical Summary
In the prior art, the display driver board needs to pre-store a large number of UI component graphics materials, resulting in large memory capacity, high cost, and difficult to achieve high-quality UI screen display effects.
By dynamically generating and fusion of basic UI components in the MCU of the display driver board, candidate graphic materials are generated, and high-quality UI pictures are created. The specific method includes the MCU obtaining the basic graphic materials of the UI component according to the control instructions, generating candidate graphic materials by fusing with the lower graphic materials, and applying these candidate graphic materials in the UI screen.
It reduces the memory capacity required on the display driver board, reduces hardware costs, and improves the display effect and delicateness of the UI screen.
Smart Images

Figure CN119993000A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of display technology, and in particular to a display driving board and an electronic device. Background Art
[0002] With the development of display technology, display technology has been widely used in home appliances. The display device of the home appliance can be provided with a display driver board and a display panel, and the display driver board stores various graphic materials for display. The display driver board can display pre-stored graphic materials to display the parameters or status of the home appliance according to the control instructions of the home appliance motherboard.
[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0004] The purpose of the present disclosure is to overcome the deficiencies of the above-mentioned prior art and provide a display driver board and an electronic device to improve the display effect of a UI screen.
[0005] According to one aspect of the present disclosure, there is provided a display driving board, comprising:
[0006] A memory configured to store basic graphic materials of at least one UI component;
[0007] an MCU configured to obtain, in response to a first control instruction, a basic graphic material and a lower-layer graphic material of at least one first selected UI component from the memory, obtain a candidate graphic material of the first selected UI component according to the basic graphic material and the lower-layer graphic material of the first selected UI component, and generate a UI screen having the first selected UI component according to the candidate graphic material of the first selected UI component;
[0008] The basic graphic material of the first selected UI component includes a first pattern and a second pattern that are complementary, the pixels of the first pattern are pixels of a first color, and the pixels of the second pattern are pixels other than the pixels of the first color;
[0009] The candidate graphic material of the first selected UI component includes complementary third and fourth patterns; the shape of the fourth pattern of the candidate graphic material of the first selected UI component is the same as the shape of the second pattern of the basic graphic material of the first selected UI component; the color of the pixels of the third pattern of the candidate graphic material of the first selected UI component is the same as the color of the pixels at the same position of the underlying graphic material.
[0010] According to an embodiment of the present disclosure, the MCU is further configured to generate a UI screen having the first selected UI component and the lower-layer graphic material according to the candidate graphic material of the first selected UI component and the lower-layer graphic material.
[0011] According to an embodiment of the present disclosure, the color of the fourth pattern of the candidate graphic material of the first selected UI component is the same as the color of the second pattern of the basic graphic material of the first selected UI component.
[0012] According to an embodiment of the present disclosure, a shape of the third pattern of the candidate graphic material of the first selected UI component is consistent with a shape of the first pattern of the basic graphic material of the first selected UI component.
[0013] According to one embodiment of the present disclosure, the first color is black.
[0014] According to an implementation manner of the present disclosure, the lower layer graphic material is a wallpaper graphic material.
[0015] According to an embodiment of the present disclosure, the MCU is configured to sequentially perform a fusion operation on each pixel of the basic graphic material of the first selected UI component;
[0016] Performing a fusion operation on any one of the pixels includes:
[0017] Determine whether the color of the pixel to be processed is the first color;
[0018] If the color of the pixel to be processed is not the first color, the fusion operation ends;
[0019] If the color of the pixel to be processed is the first color, determine the reference pixel corresponding to the pixel to be processed, and change the color of the pixel to be processed to the color of the corresponding reference pixel; the reference pixel corresponding to the pixel to be processed is a pixel located in the lower layer of graphic material, and the pixel to be processed and the corresponding reference pixel have the same position in the UI screen.
[0020] According to an embodiment of the present disclosure, the MCU is configured as follows:
[0021] Acquire the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component;
[0022] Obtaining the position information of the starting pixel of the lower-layer graphic material in the UI screen;
[0023] Determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-layer graphic material according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen, the position information of the pixel to be processed in the basic graphic material of the first selected UI component, and the position information of the starting pixel of the lower-layer graphic material in the UI screen;
[0024] The color information of the reference pixel is obtained according to the position information of the reference pixel in the lower-layer graphic material.
[0025] According to an embodiment of the present disclosure, the MCU is configured as follows:
[0026] Determine the position information of the pixel to be processed in the UI screen according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component;
[0027] Use the position information of the pixel to be processed in the UI screen as the position information of the reference pixel corresponding to the pixel to be processed in the UI screen, and determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-level graphic material based on the position information of the reference pixel corresponding to the pixel to be processed in the UI screen and the position information of the starting pixel of the lower-level graphic material in the UI screen.
[0028] According to one embodiment of the present disclosure, the MCU is also configured to obtain basic graphic materials of at least one second selected UI component from the memory in response to a second control instruction, and generate and store multiple candidate graphic materials of the second selected UI component based on the basic graphic materials of the second selected UI component, and is configured to select one candidate graphic material of the second selected UI component as the selected graphic material according to the second control instruction, and generate the UI screen based on the selected graphic material.
[0029] According to an embodiment of the present disclosure, the second selected UI component is a dynamic effect component that needs to display a plurality of different graphic materials in sequence;
[0030] The MCU is further configured to repeatedly execute a dynamic loop process; any one of the dynamic loop processes includes sequentially displaying each candidate graphic material of the second selected UI component in different UI screens.
[0031] According to an embodiment of the present disclosure, the basic graphic material of the second selected UI component is stored in an independent memory;
[0032] The MCU is further configured to disconnect the communication between the MCU and the independent memory after acquiring each candidate graphic material of the second selected UI component.
[0033] According to an implementation manner of the present disclosure, the MCU is provided with a video memory; each candidate graphic material of the second selected UI component is stored in the video memory.
[0034] According to an embodiment of the present disclosure, the video memory includes at least one frame buffer and a display layer, and the display layer is used to store the UI screen;
[0035] The MCU is configured to generate each candidate graphic material of the second selected UI component according to the basic graphic material of the second selected UI component, and store each candidate graphic material of the second selected UI component in the frame buffer;
[0036] The MCU is also configured to repeatedly execute a dynamic loop process; any one of the loop processes includes, in turn, determining each candidate graphic material of the second selected UI component as a selected graphic material, and generating a UI screen with the selected graphic material after each determination of the selected graphic material and storing it in the display layer.
[0037] According to an embodiment of the present disclosure, the MCU is further configured to clear each candidate graphic material of the second selected UI component when the second selected UI component does not need to be displayed.
[0038] According to an embodiment of the present disclosure, the basic graphic material of the second selected UI component includes a complementary first pattern and a second pattern, the pixels of the first pattern are pixels of a first color, and the pixels of the second pattern are pixels other than the pixels of the first color;
[0039] The MCU is also configured to use a rotation algorithm to sequentially generate each candidate graphic material of the second selected UI component; generating any one of the candidate graphic materials of the second selected UI component includes: rotating the second pattern of the basic graphic material of the second selected UI component by a preset angle to generate the second pattern of the candidate graphic material of the second selected UI component, and filling the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located with a first color to form the candidate graphic material of the second selected UI component; wherein the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located refers to a rectangular area composed of adjacent M1 rows of pixels * N1 columns of pixels; M1 and N1 are positive integers.
[0040] According to one embodiment of the present disclosure, the MCU is also configured to, in response to the third control instruction, obtain basic graphic materials of at least one third selected UI component from the memory, and generate candidate graphic materials of the third selected UI component based on the basic graphic materials of the third selected UI component and the third control instruction, and generate a UI screen having the candidate graphic materials of the third selected UI component based on the candidate graphic materials of the third selected UI component; the third selected UI component is a pointer component.
[0041] According to one embodiment of the present disclosure, the MCU is also configured to determine the position information of the candidate graphic material of the third selected UI component based on the relative position of the pointer swing center in the candidate graphic material of the third selected UI component, and based on the target position of the pointer swing center in the UI screen.
[0042] According to an embodiment of the present disclosure, the third control instruction includes a pointer parameter, and the pointer component can adjust the pointer angle according to the pointer parameter; the MCU is further configured to: sequentially generate a first UI screen, a second UI screen, and a third UI screen for frame-by-frame display;
[0043] Generating the first UI screen includes: responding to a first pointer parameter, generating a first candidate graphic material according to the basic graphic material of the third selected UI component, and generating the first UI screen according to the first candidate graphic material;
[0044] Generating the third UI screen includes: generating a second candidate graphic material according to the basic graphic material of the selected UI component in response to the second pointer parameter, and generating the third UI screen according to the second candidate graphic material;
[0045] Generating the second UI screen includes: responding to the second pointer parameter, obtaining a mask graphic material, and generating the second UI screen according to the mask graphic material; wherein the mask graphic material includes a complementary first area and a second area; the first area of the mask graphic material is an area where the first candidate graphic material and the second candidate graphic material overlap with each other; the second area of the mask graphic material is an area of the first candidate graphic material that does not overlap with the second candidate graphic material; the color of the pixels of the mask graphic material in the first area is the same as the color of the pixels of the first candidate graphic material at the same position; the color of the pixels of the mask graphic material in the second area is black.
[0046] According to an embodiment of the present disclosure, the MCU includes a video memory, the video memory includes at least one frame buffer and a display layer, and the display layer is used to store the UI screen;
[0047] The MCU is configured to store the basic graphic material of the third selected UI component in the frame buffer, and generate candidate graphic material of the third selected UI component based on the basic graphic material of the third selected UI component located in the frame buffer and write it into the display layer to update the pattern of the selected UI component in the UI screen.
[0048] According to an embodiment of the present disclosure, the MCU is further configured to, in response to a fourth control instruction, obtain a basic graphic material of at least one fourth selected UI component from the memory, obtain a candidate graphic material of the fourth selected UI component according to the basic graphic material of the fourth selected UI component, and generate a UI screen having the fourth selected UI component according to the candidate graphic material of the fourth selected UI component;
[0049] The basic graphic material of the fourth selected UI component includes a first pattern and a second pattern that are complementary to each other, pixels of the first pattern are pixels of a second color, and pixels of the second pattern are pixels other than pixels of the second color;
[0050] The candidate graphic materials of the fourth selected UI component include complementary third and fourth patterns; the fourth pattern of the candidate graphic materials of the fourth selected UI component has the same shape and different color as the second pattern of the basic graphic material of the fourth selected UI component; the third pattern of the candidate graphic materials of the fourth selected UI component has the same shape and the same color as the first pattern of the basic graphic material of the fourth selected UI component.
[0051] According to an embodiment of the present disclosure, the MCU is further configured to sequentially perform a color change operation on each pixel of the basic graphic material of the fourth selected UI component;
[0052] Performing a color change operation on any one of the pixels includes:
[0053] Determine whether the color of the pixel to be processed is the second color;
[0054] If the color of the pixel to be processed is the second color, the color changing operation ends;
[0055] If the color of the pixel to be processed is not the second color, the color of the pixel to be processed is modified to a third color.
[0056] According to an embodiment of the present disclosure, the memory includes at least one of an independent memory located outside the MCU and an internal memory located inside the MCU.
[0057] According to an embodiment of the present disclosure, the MCU is further configured as follows:
[0058] Determine the selected UI component according to the control instruction;
[0059] Determining storage information of a basic graphic material of the selected UI component according to the selected UI component, the storage information including memory information where the basic graphic material is stored and address information in the memory;
[0060] According to the storage information of the basic graphic material of the selected UI component, the basic graphic material of the selected UI component is read from the corresponding memory.
[0061] According to an embodiment of the present disclosure, the MCU is further configured to determine, according to the control instruction, a UI component that needs to be displayed as a selected UI component.
[0062] According to another aspect of the present disclosure, there is provided an electronic device, comprising the above-mentioned display driver board, and a display panel and a device mainboard;
[0063] The device mainboard is used to send control instructions to the display driver board;
[0064] The display panel is used to display a UI screen under the drive of the display driving board.
[0065] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0067] Figure 1 It is a schematic diagram of a partial structure of a household appliance in one embodiment of the present disclosure.
[0068] Figure 2 It is a schematic diagram of some pointer graphic materials stored in FLASH in the related art.
[0069] Figure 3 It is a schematic diagram of part of fan graphic materials stored in FLASH in the related art.
[0070] Figure 4 A schematic diagram of a UI screen in one embodiment of the present disclosure.
[0071] Figure 5 This is a schematic diagram of a process in which an MCU generates a UI screen based on basic graphic materials in one embodiment of the present disclosure.
[0072] Figure 6 This is a schematic diagram of a process in which an MCU obtains basic graphic materials according to a control instruction in one embodiment of the present disclosure.
[0073] Figure 7 It is a schematic diagram of the storage format of data of graphic materials in one embodiment of the present disclosure.
[0074] Figure 8-1 to Figure 8-3 This is a schematic diagram of the effect of fusing the basic graphic material of the first selected UI component with the underlying graphic material in one embodiment of the present disclosure. Figure 8-1 A basic graphic material for a first selected UI component of an example; Figure 8-2 is an example of underlying graphic material; Figure 8-3 It is the candidate graphic material of the first selected UI component after fusion.
[0075] Figure 9-1 to Figure 9-2 Schematic diagram of the principle of the upper-layer graphic material generating a black mask on the lower-layer graphic material in the related art. Figure 9-1 An example of a digital graphic material with a black mask is shown; Figure 9-2 This example shows the masking effect of a graphic material with a black mask on a wallpaper.
[0076] Figure 10-1 to Figure 10-2 This is a schematic diagram of the principle that the upper-layer graphic material does not generate a black mask on the lower-layer graphic material in one embodiment of the present disclosure. Figure 10-1 An example of a digital graphic material that has been fused with a wallpaper graphic material. Figure 10-2 The example shows that after merging with the wallpaper graphic material, the black masking problem of the upper graphic material on the wallpaper is eliminated.
[0077] Fig.11 This is a schematic diagram of a process in which an MCU merges a basic graphic material of a first selected UI component with a lower-level graphic material in one embodiment of the present disclosure.
[0078] Figure 12-1 to Figure 12-3 This is a schematic diagram of a process of using an image compression method to generate supplementary graphic materials in one embodiment of the present disclosure. Figure 12-1 An example of a basic graphic material. Figure 12-2 This example shows an intermediate graphic generated based on the basic graphic material. Figure 12-3 An example of a supplementary graphic material generated from an intermediate graphic.
[0079] Figure 13-1 to Figure 13-2This is a schematic diagram of a process of using an image generation method to generate supplementary graphic materials in one embodiment of the present disclosure. Figure 13-1 An example of a basic graphic material. Figure 13-2 This example shows a supplementary graphic material generated based on a basic graphic material.
[0080] Figure 14-1 to Figure 14-2 This is a schematic diagram of a process for determining pattern pixels of supplementary graphic materials according to pattern pixels of basic graphic materials in one embodiment of the present disclosure. Figure 14-1 An example of a pattern of a basic graphic material is shown, and the two ends of the line segment respectively indicate the origin of the pattern of the basic graphic material and a pattern pixel. Figure 14-2 An example of a pattern of a supplementary graphic material is shown, and the two ends of the line segment respectively indicate the origin of the pattern of the supplementary graphic material and a pattern pixel.
[0081] Fig.15 This is a schematic diagram of a principle of generating a plurality of candidate graphic materials according to a basic graphic material, and enabling a display panel PNL to display a UI component according to one candidate graphic material in an embodiment of the present disclosure.
[0082] Fig.16 This is a schematic diagram of a process in which an MCU obtains each candidate graphic material of a second selected UI component according to a basic graphic material of the second selected UI component in an implementation manner of the present disclosure.
[0083] Fig.17 This is a schematic diagram of a process in which an MCU controls a second selected graphic material to present a dynamic effect in one embodiment of the present invention.
[0084] Fig.18 This is a schematic diagram of a principle of generating a candidate graphic material according to a basic graphic material, and enabling a display panel PNL to display a UI component according to the candidate graphic material in an implementation manner of the present disclosure.
[0085] Figure 19-1 to Figure 19-4 This is a schematic diagram of a process of generating candidate graphic materials of a pointer component according to a basic graphic material of a pointer component in one embodiment of the present disclosure. Figure 19-1 This example demonstrates the basic graphics material of the pointer component. Figure 19-2 This example demonstrates generating the intermediate graphics of a pointer component based on the basic graphics material of the pointer component. Figure 19-3 An example is provided for generating a candidate graphic material of a pointer component according to an intermediate graphic of the pointer component. Figure 19-4 A partial enlarged image of the pointer root area of the candidate graphic material of the pointer component.
[0086] Figure 20-1 to Figure 20-3 This is a schematic diagram of the pattern of the pointer component in three consecutive UI frames when switching from an old pointer to a new pointer in the related art. Figure 20-1 In the related art, the pointer component in the UI screen is an old pointer graphic material. Figure 20-2 In the related art, the pointer component in the UI screen is covered by a black mask. Figure 20-3 In the related art, the pointer component in the UI screen is a new pointer graphic material.
[0087] Figure 21-1 to Figure 21-3 This is a schematic diagram of patterns of a pointer component in three consecutive UI frames when switching from an old pointer to a new pointer in one embodiment of the present disclosure. Figure 21-1 In this implementation, the pointer component in the UI screen is an old pointer graphic material. Figure 21-2 In this implementation, the old pointer graphic material in the UI screen is partially masked. Figure 21-3 In the related art, the pointer component in the UI screen is a new pointer graphic material.
[0088] Figure 22-1 to Figure 22-2 This is a schematic diagram of the effect of changing the color of the basic graphic material of the fourth selected UI component in one embodiment of the present disclosure. Figure 22-1 A basic graphic material for an exemplary fourth selected UI component; Figure 22-2 The candidate graphic material of the fourth selected UI component after color change.
[0089] Fig.23 This is a schematic diagram of a process of performing a color change operation on a basic graphic material of a fourth selected UI component in one embodiment of the present disclosure.
[0090] Figure 24-1 to Figure 24-3 This is a schematic diagram of obtaining two candidate graphic materials of a digital component according to the basic graphic material of the digital component in an embodiment of the present disclosure. Figure 24-1 An example of a basic graphic material of a digital component is shown, wherein the pattern pixels of the basic graphic material are orange and the pattern of the basic graphic material forms a hollow “1”. Figure 24-2 A candidate graphic material of the digital component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 24-3 An example of a candidate graphic material for the digital component is shown, the pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue.
[0091] Figure 25-1 to Figure 25-4 In one embodiment of the present disclosure, a schematic diagram of obtaining three candidate graphic materials of a fan component according to a basic graphic material of the fan component is shown. Figure 25-1 An example of a basic graphic material of a fan component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is a fan. Figure 25-2A candidate graphic material of the fan component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 25-3 An example of a candidate graphic material for the fan component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue. Figure 25-4 An example of a candidate graphic material for the fan component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is apple green.
[0092] Figure 26-1 to Figure 26-3 This is a schematic diagram of obtaining two candidate graphic materials of an outdoor icon component according to a basic graphic material of the outdoor icon component in an embodiment of the present disclosure. Figure 26-1 An example of a basic graphic material of an outdoor icon component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material forms a hollow “outdoor”. Figure 26-2 An example of a candidate graphic material for the outdoor icon component is shown, and the candidate graphic material is the same as the basic graphic material. Figure 26-3 An example of a candidate graphic material for the outdoor icon component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue.
[0093] Figure 27-1 to Figure 27-3 This is a schematic diagram of obtaining two candidate graphic materials of a digital component according to the basic graphic material of the digital component in an embodiment of the present disclosure. Figure 27-1 An example of a basic graphic material of a digital component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is the number "1". Figure 27-2 A candidate graphic material of the digital component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 27-3 An example of a candidate graphic material for the digital component is shown, the pattern of the candidate graphic material is the same as the basic graphic material, but the color is red.
[0094] Figure 28-1 to Figure 28-4 This is a schematic diagram of obtaining three candidate graphic materials of a rotating arrow component according to a basic graphic material of the rotating arrow component in an embodiment of the present disclosure. Figure 28-1 The following example illustrates a basic graphic material of a rotating arrow component. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is two semicircular arrows connected end to end. Figure 28-2 An example of a candidate graphic material for the rotating arrow component is shown, and the candidate graphic material is the same as the basic graphic material. Figure 28-3 An example of a candidate graphic material for the rotating arrow component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue. Figure 28-4An example of a candidate graphic material for the rotating arrow component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is apple green.
[0095] Figure 29-1 to Figure 29-3 This is a schematic diagram of obtaining two candidate graphic materials of a pointer component according to a basic graphic material of the pointer component in an embodiment of the present disclosure. Figure 29-1 An example of a basic graphic material of a pointer component is shown. The pattern pixels of the basic graphic material are apple green, and the pattern of the basic graphic material is in the shape of a pointer. Figure 29-2 A candidate graphic material of the pointer component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 29-3 A candidate graphic material of the pointer component is illustrated. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is white. DETAILED DESCRIPTION
[0096] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in a variety of forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure will be comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar structures, and thus their detailed description will be omitted. In addition, the drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale.
[0097] Although relative terms such as "upper" and "lower" are used in this specification to describe the relative relationship of one component of the illustration to another component, these terms are used in this specification only for convenience, such as according to the orientation of the examples described in the drawings. It is understood that if the device of the illustration is turned upside down, the component described as "upper" will become the component "lower". When a structure is "on" other structures, it may mean that the structure is formed integrally on the other structure, or that the structure is "directly" disposed on the other structure, or that the structure is "indirectly" disposed on the other structure through another structure.
[0098] The terms "a", "an", "the", "said" and "at least one" are used to indicate the presence of one or more elements / components / etc.; the terms "including" and "having" are used to express an open-ended inclusive meaning and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first", "second" and "third" etc. are used merely as labels and are not intended to limit the quantity of their objects.
[0099] The present disclosure provides an electronic device, which may be provided with a device mainboard (e.g., a home appliance mainboard) and a display device. The device mainboard may send a control instruction to the display device, such as sending a serial port instruction to the display device (e.g., sending a control instruction by selecting a UI component RT through a universal asynchronous receiver transmitter), and the display device may generate and display a UI (user interface) screen in response to the control instruction. Optionally, the electronic device may be a home appliance, a numerical control device, a vehicle-mounted device, or other types of devices.
[0100] See also Figure 1 The display device may include a display driving board CTR and a display panel PNL, and the display driving board has an MCU (microprocessor) and a memory. Figure 1 In the example, the memory of the display driver board includes an internal memory located inside the MCU (such as the read-only memory ROM of the MCU) and an independent memory located outside the MCU (such as a flash memory F basic graphic material SH). In the memory, the graphic materials required for each UI component of the UI screen are stored. Furthermore, the display driver board also has a connector. The MCU can generate a UI screen to be displayed in response to the control instructions of the device motherboard, and transmit the data of the UI screen to the display panel PNL through the connector (for example, transmitted to the display panel PNL through an LVDS signal), thereby driving the display panel PNL to display the UI screen.
[0101] In the related art, all the graphic materials required by the UI component are stored in an independent memory. Figure 2 When a UI screen has a pointer component as a UI component, 100 pointer graphic materials at different angles need to be stored in an independent memory ( Figure 2 Only some pointer graphic materials are illustrated in the figure). The MCU can read a corresponding one from each pointer graphic material and display it on the display panel PNL according to the result to be displayed. Figure 3 When the UI screen has a fan component as a UI component, the independent memory may store at least 12 fan graphic materials with different rotation angles. The MCU enables the display panel PNL to play the 12 fan graphic materials in a loop to display the fan dynamic effect.
[0102] In other words, in the related art, each graphic material required by any UI component is pre-stored in the independent memory of the display driver board. The MCU reads the required graphic material from the independent memory according to the control instruction and displays it on the display panel PNL. This requires a larger capacity of the independent memory, resulting in a higher hardware cost of the independent memory.
[0103] In the embodiment of the present disclosure, the display driver board CTR is configured so that at least part of the graphic materials are generated by the display driver board rather than pre-stored in the memory, so as to reduce the capacity of the memory on the display driver board and reduce the cost of the display driver board. For example, the MCU of the display driver board can generate new graphic materials based on the pre-stored graphic materials to reduce the number of pre-stored graphic materials.
[0104] Figure 4 This is an example diagram of a UI screen in one embodiment of the present disclosure. The UI screen has a specific type of icon for displaying information such as status and parameters. These icons can be static icons or dynamic icons. It is understandable that the dynamic effect of dynamic icons requires multiple UI screens to be displayed in sequence to ultimately achieve. In the embodiments of the present disclosure, icons that are basically located in the same position or area and implement the same function are called UI components. For example, in Figure 4 In the example, the UI screen has a pointer component for displaying a pointer (e.g., UI component X1), a rotating icon component for displaying a rotating dynamic effect (e.g., UI component X2), a text component for displaying text (e.g., UI component X3), a blowing component for displaying a blowing status (e.g., UI component X4), a WIFI component for networking status (e.g., UI component X5), a dashboard component for displaying a scale (e.g., UI component X6), a digital component for displaying numbers (e.g., UI component X7), etc. For each UI component that needs to be displayed, only one graphic material is displayed on each frame. For a UI component that displays a dynamic effect, the display panel PNL needs to cyclically display multiple different graphic materials of the UI component.
[0105] It is understandable that the UI screen does not necessarily need to display all UI components, but displays at least a portion of the UI components as needed. In the embodiment of the present disclosure, the UI components that need to be displayed are referred to as selected UI components. For example, when the electronic device is operating normally, the UI component for reporting an error does not need to be displayed on the display panel PNL, and the UI component for reporting an error is a non-selected UI component. When an electronic device runs incorrectly and needs to report an error through the UI component, the UI component for reporting an error needs to be displayed on the display panel PNL, and the UI component is a selected UI component. In one example, the UI screen can be determined by a combination of various selected UI components.
[0106] In one embodiment of the present disclosure, the MCU is configured to determine, according to the control instruction, a UI component that needs to be displayed as a selected UI component.
[0107] exist Figure 1In the example, the memory of the display driver board includes at least one of an independent memory outside the MCU and an internal memory inside the MCU. The independent memory can be located outside the MCU and can be communicatively connected with the MCU, for example, SPI communication can be performed. The independent memory can be used to store graphic materials, and the MCU can generate a UI screen based on these graphic materials. It is understandable that the graphic materials can be stored not only in the independent memory, but in some embodiments, the graphic materials can also be stored in the internal memory of the MCU (such as the read-only memory of the MCU). It is understandable that in some other embodiments, the display driver board may not be provided with an independent memory, but the required graphic materials are stored in the internal memory of the MCU.
[0108] In one embodiment of the present disclosure, the MCU is configured to generate a UI screen with a selected UI component according to a control instruction. For example, the MCU is configured to generate a UI screen with a selected UI component according to a control instruction through the following operations S101 to S103.
[0109] Operation S101 : acquiring basic graphic material of at least one selected UI component in response to a control instruction; for example, acquiring basic graphic material of at least one selected UI component from a memory.
[0110] Operation S102: acquiring candidate graphic materials of the selected UI component according to the basic graphic material of the selected UI component; at least one of the candidate graphic materials is different from the basic graphic material.
[0111] Operation S103: generating a UI screen having the selected UI component according to the candidate graphic materials of the selected UI component.
[0112] In this embodiment, the display driver board does not need to store the various graphic materials of all UI components. For at least some UI components, the display driver board can only store its basic graphic materials; when the UI component needs to be displayed (at this time, the UI component is the selected UI component), the candidate graphic materials required by the UI component are obtained according to the basic graphic materials of the UI component, thereby meeting the needs of normal display; it will not cause the selected UI component to display abnormally due to the lack of graphic materials, ensuring the normal UI screen. Therefore, the number of graphic materials stored in the display driver board is greatly reduced, and the capacity of the memory used in the display driver board can be reduced, thereby reducing the hardware cost of the display driver board. In particular, it is conducive to reducing the capacity of independent memory.
[0113] Moreover, since the candidate graphic materials of the UI component can be generated by the basic graphic materials of the UI component, the types and delicacy of the graphic materials that can be used to generate the UI screen can be better, so that the display effect of the PNL is better. For example, in the related art, a UI component may need to pre-store 100 graphic materials to achieve a better display. However, by adopting the technical solution provided by the embodiment of the present disclosure, not only can only one basic graphic material of the UI component be stored to save hardware capacity, but also more than 100 candidate graphic materials can be generated based on the basic graphic material of the UI component, for example, 200 different candidate graphic materials or 300 different candidate graphic materials can be generated, thereby making the display effect (especially the dynamic effect) of the UI component more delicate and smooth.
[0114] In the embodiment of the present disclosure, the graphic material can be divided into initial graphic material and supplementary graphic material according to the source of the graphic material. Among them, the initial graphic material is pre-stored in the display driver board; when the display driver board is restarted, these initial graphic materials still exist. For example, in some examples, the graphic material stored in the independent memory on the display driver board can be the initial graphic material. For another example, in some examples, the graphic material stored in the ROM (read-only memory) of the MCU is the initial graphic material. It can be understood that the basic graphic material of the UI component is the initial graphic material. The supplementary graphic material is a new graphic material generated based on the initial graphic material after the display driver board is powered on. In some examples, the supplementary graphic material can be stored in the video memory of the MCU and cleared when the display driver board is powered off.
[0115] In one embodiment of the present disclosure, the MCU is configured to obtain basic graphic materials of at least one selected UI component from an independent memory in response to the control instruction.
[0116] In another embodiment of the present disclosure, the MCU is configured to obtain basic graphic materials of at least one selected UI component from an internal memory in response to the control instruction.
[0117] Of course, in some other embodiments of the present disclosure, the MCU may also be configured to respond to control instructions, obtain basic graphic materials of some selected UI components from an independent memory, and obtain basic graphic materials of some selected UI components from an internal memory.
[0118] In one example, the candidate graphic materials acquired by the MCU and the UI screen generated by the MCU can be saved in the MCU, for example, in the video memory of the MCU. The MCU can call the saved candidate graphic materials to generate the UI screen. In another example, the MCU can generate candidate graphic materials based on the basic graphic materials, and in the process of generating the candidate graphic materials, use the data of the candidate graphic materials to update the data of the UI screen. In this way, the synchronization of candidate graphic material generation and UI screen generation can be achieved; in this process, there is no need to save the candidate graphic materials or form independent candidate graphic materials, but the candidate graphic materials are reflected in the UI screen.
[0119] Optionally, the video memory of the MCU includes at least one frame buffer and a display layer. The UI screen generated by the MCU can be stored in the display layer; the data in the display layer can be forwarded to the display panel through the connector, so that the display panel displays the UI screen.
[0120] In one example, the MCU can obtain the basic graphic material of the selected UI component from the memory and save the basic graphic material in the frame buffer; in the process of generating candidate graphic materials based on the basic graphic material of the selected UI component, the MCU can use the data of the candidate graphic material to update the data of the UI screen in the display layer, and finally the UI screen has the candidate graphic material.
[0121] In another example, the MCU can obtain the basic graphic material of the selected UI component from the memory and save the basic graphic material in the frame buffer; when the MCU generates the candidate graphic material based on the basic graphic material of the selected UI component, the candidate graphic material can be saved in the frame buffer. When the MCU generates the UI screen based on the candidate graphic material, it can read the data of the candidate graphic material from the frame buffer, and write the data of the candidate graphic material into the display layer during the reading process to update the data of the UI screen in the display layer, so that the UI screen finally has the candidate graphic material.
[0122] In one example, a program or software product for implementing the required functions, or executable instructions for implementing the required functions may be stored in an internal memory of the MCU (eg, a read-only memory ROM of the MCU).
[0123] In one example, the MCU may not need to read the basic graphic material of the non-selected UI component and obtain the candidate graphic material of the non-selected UI component, thereby avoiding the power consumption and calculation amount caused by reading the basic graphic material and obtaining the candidate graphic material. On the one hand, this can reduce the power consumption of the display driver board, and on the other hand, it can also reduce the requirements for hardware and reduce costs, such as avoiding the use of an MCU with higher computing power and avoiding the use of an MCU with a larger video memory. Of course, in other embodiments of the present disclosure, the MCU may also read the basic graphic material of the non-selected UI component without obtaining the candidate graphic material of the non-selected UI component, or may read the basic graphic material of the non-selected UI component and obtain each candidate graphic material of the non-selected UI component.
[0124] In some embodiments of the present disclosure, each UI component has a basic graphic material; the MCU can determine which UI component or components are selected UI components according to the control instruction, and read the basic graphic materials of each selected UI component. For example, when the basic graphic materials of the UI components are pre-stored in an independent memory, the MCU can read the basic graphic materials of the selected UI components from the independent memory.
[0125] In some other embodiments of the present disclosure, only some UI components have basic graphic materials. For example, at least one UI component has multiple graphic materials, and an independent memory stores each graphic material of the UI component; or at least one UI component has only one graphic material. When the UI component that is not set with basic graphic materials is the selected UI component, the MCU can directly read the required graphic materials from the memory.
[0126] In some embodiments of the present disclosure, at least one UI component has only one graphic material. When the UI component is a selected UI component, the MCU can directly read the graphic material of the UI component and generate a UI screen based on the graphic material.
[0127] In some embodiments of the present disclosure, the initial graphic materials of at least some UI components can be stored in an independent memory, for example, the basic graphic materials of at least some UI components are stored in an independent memory. In this way, compared with the related art, a smaller number of graphic materials stored in an independent memory can meet the needs of normal display, which enables the display driver board to use an independent memory of smaller volume, thereby achieving the purpose of reducing the cost of the display driver board. As an example, the initial graphic materials of each UI component (as the basic graphic materials of the UI component) are pre-stored in an independent memory.
[0128] In some embodiments of the present disclosure, the initial graphic material of at least one UI component, such as the basic graphic material of at least one UI component, can be stored in the internal memory of the MCU, such as the ROM (read-only memory) of the MCU. When the UI component is the selected UI component, the MCU does not need to read the initial graphic material of the UI component from the independent memory, but reads the initial graphic material of the UI component from the internal memory, such as reading the basic graphic material of the UI component from the internal memory.
[0129] In the related art, the ROM of the MCU only stores program codes, which will cause the storage space of the ROM of the MCU to be wasted. In this embodiment, some of the initial graphic materials are stored in the internal memory of the MCU, which can improve the hardware utilization of the MCU, and is also conducive to further reducing the volume of the independent memory and further reducing the cost of the display driver board. In this embodiment, the initial graphic materials of some UI components are stored in the independent memory, and the initial graphic materials of some UI components are stored in the internal memory of the MCU.
[0130] Optionally, the following method can be used to assist in infringement determination: the host computer can determine whether the control instruction is transmitted to the MCU, and the communication between the independent memory and the MCU can be observed through an oscilloscope. Restart the device (to ensure that the graphic material of the UI screen does not come from the video memory of the MCU). If no SPI communication is observed between the MCU receiving the control instruction and the display panel PNL displaying the image, it can be considered that the graphic material required for the UI screen comes from the internal memory of the MCU, and the electronic device, display device or display driver board may have adopted the technical solution provided by this embodiment.
[0131] Optionally, the preset graphic material (used as an initial graphic material) can be converted into an RGB dot matrix array through an algorithm. In the code stored in the MCU, a new array variable is defined for the preset graphic material, and the dot matrix array data is assigned to the array variable. The code logic of the MCU is modified so that when the preset graphic material needs to be displayed, the data is not retrieved from the independent memory, but directly retrieved from the internal memory (such as ROM) of the MCU.
[0132] It is understandable that the above embodiments illustrate the organization form of the graphic materials of the UI component (storing only basic graphic materials or storing individual graphic materials) and possible storage locations (storing in an independent memory or storing in the internal memory of the MCU). In the embodiments of the present disclosure, the graphic materials of the UI component may also be organized in other forms or stored in other locations.
[0133] In an embodiment of the present disclosure, the MCU is further configured to obtain basic graphic materials of the selected UI component according to the control instruction through the following operations S201 to S203.
[0134] Operation S201, determining the selected UI component according to the control instruction. For example, the control instruction includes parameters or states to be displayed; the MCU determines which UI components or which UI components are used to display these parameters or states according to the parameters or states to be displayed included in the control instruction, and sets them as the selected UI components.
[0135] Operation S202, determining storage information of the basic graphic material of the selected UI component according to the selected UI component, the storage information including memory information and address information in the memory where the basic graphic material is stored. Determining the memory information where the basic graphic material is stored may include whether the memory storing the basic graphic material is an internal memory or an independent memory, and the specific number or partition information of the memory. The address information of the basic graphic material in the memory may be address-related information of the basic graphic material in the memory, for example, including the address of the starting pixel of the basic graphic material in the basic graphic material and size information such as the length and width of the basic graphic material.
[0136] Operation S203, reading the basic graphic material of the selected UI component from the corresponding memory according to the storage information of the basic graphic material of the selected UI component. It is understandable that if the selected UI component has no basic graphic material, for example, only one graphic material, the MCU can obtain the graphic material of the selected UI component.
[0137] Optionally, there may be multiple control instructions, and different control instructions may determine different types of selected UI components. Of course, in some cases, at least one control instruction may also be used to determine multiple selected UI components.
[0138] In one embodiment of the present disclosure, see Figure 7 When the graphic material is stored in the display driver board, the data of each pixel of the graphic material is stored in the display driver board, for example, in an independent memory of the display driver board or in the MCU (the display memory and / or read-only memory ROM of the MCU). The data of any pixel includes the data of the red sub-pixel R, the data of the green sub-pixel G, and the data of the blue sub-pixel B. For example, in the display memory, the data of each pixel includes 8-bit data of the red sub-pixel R, 8-bit data of the green sub-pixel G, and 8-bit data of the blue sub-pixel B.
[0139] For example, in Figure 7In the illustrated graphic material, the first pixel P1 is a white pixel, and its pixel data may be 0XFF (data of red sub-pixel R) FF (data of green sub-pixel G) FF (data of blue sub-pixel B). The second pixel P2 is a black pixel, and its pixel data may be 0X00 (data of red sub-pixel R) 00 (data of green sub-pixel G) 00 (data of blue sub-pixel B). 0X represents 16-bit data.
[0140] Optional, see Figure 7 On the display driver board, the graphic material is saved as a rectangular shape, and its data range covers the rectangular area formed by M rows of pixels * N columns of pixels (M and N are both positive integers). For the pattern part in the graphic material, its pixels are not black pixels. For the part without pattern, due to hardware, data format and configuration reasons, its pixels are not set to transparent, but to black. It can be understood that for different graphic materials, their sizes can be different. In other words, M and N of different graphic materials can be different. Of course, they can also be the same.
[0141] Optionally, the fact that the graphic material is saved as a rectangular shape does not necessarily mean that M is different from N. In some embodiments of the present disclosure, M may also be the same as N.
[0142] In one embodiment of the present disclosure, the address of the starting pixel of the graphic material can be used as the address of the graphic material. The size of the graphic material can be obtained, such as the width size along the pixel row direction (such as the number of pixel columns) and the length size along the pixel column direction (such as the number of pixel rows). According to the address of the starting pixel of the graphic material and the size of the graphic material, the position and range of the graphic material on the UI screen can be obtained.
[0143] In one example, the pixel at the upper left corner of the graphic material may be used as the starting pixel of the graphic material.
[0144] In an embodiment of the present disclosure, the MCU is configured to obtain candidate graphic materials of the selected UI component based on the basic graphic material of the selected UI component, and at least one of the candidate graphic materials is different from the basic graphic material. In one example, the MCU can obtain one candidate graphic material at a time; among the candidate graphic materials that can be obtained, at least one candidate graphic material is different from the basic graphic material. In this example, when obtaining a candidate graphic material based on the basic graphic material at a certain time, the basic graphic material may be the same as the candidate graphic material, of course, it may also be different. In another example, the MCU can obtain each candidate graphic material of the selected UI component based on the basic graphic material of the selected UI component. Among the obtained candidate graphic materials, at least one candidate graphic material is different from the basic graphic material; when generating a UI screen, the MCU selects a candidate graphic material of the selected UI component as the selected graphic material according to the control instruction, and generates the UI screen according to the selected graphic material.
[0145] In one implementation strategy, the basic graphic material can also be used as a candidate graphic material. In other words, at least one candidate graphic material of the selected UI component is the same as the basic graphic material of the selected UI component. For example, for a fan component used for a rotating dynamic effect, the basic graphic material of the fan component can be a candidate graphic material of the fan component. In one example, one or more supplementary graphic materials can be generated based on the basic graphic material of the selected UI component and using an algorithm corresponding to the selected UI component, and each supplementary graphic material is different from the basic graphic material. Both the basic graphic material and the supplementary graphic material are candidate graphic materials for the selected UI component. In the UI screen, one of the candidate graphic materials is used to display the UI component each time.
[0146] In another implementation strategy, the basic graphic material is not a candidate graphic material. In other words, any candidate graphic material of the selected UI component is different from the basic graphic material of the selected UI component. In one example, one or more supplementary graphic materials can be generated according to the basic graphic material of the selected UI component and the algorithm corresponding to the selected UI component, and each supplementary graphic material is different from the basic graphic material; the supplementary graphic material of the selected UI component is the candidate graphic material of the selected UI component. For example, when a digital component is displayed on a wallpaper, the basic graphic material of the digital component includes a complementary first pattern and a second pattern, the pixels of the first pattern are black pixels, and the pixels of the second pattern are non-black pixels. The candidate graphic material of the digital component may include a complementary third pattern and a fourth pattern; the fourth pattern of the candidate graphic material has the same shape and color as the first pattern of the basic graphic material; the color of the pixels of the third pattern of the candidate graphic material is the same as the color of the pixels at the same position of the wallpaper. In other words, the black area in the basic graphic material can be filled with wallpaper to realize the fusion of the UI component and the wallpaper, and obtain the candidate graphic material fused with the wallpaper.
[0147] Optionally, at least one of the color, pattern size, pattern position and pattern shape of the supplementary graphic material is different from that of the basic graphic material; and the supplementary graphic material is generated based on the basic graphic material. For example, the supplementary graphic material of the selected UI component can be formed by performing one or more of pattern shape change, pattern position change, pattern size change or color change on the basic graphic material of the selected UI component.
[0148] Of course, it is understandable that for different selected UI components, the same implementation strategy can be used to obtain candidate graphic materials, or different implementation strategies can be used to obtain candidate graphic materials. For example, among two selected UI components, the basic graphic material of one selected UI component is not used as a candidate graphic material of the selected UI component; the basic graphic material of the other selected UI component can be used as a candidate graphic material of the selected UI component, or it can not be used as a candidate graphic material of the selected UI component.
[0149] In one example, the MCU generates candidate graphic materials for the selected UI component based on the control instruction and the basic graphic materials of the selected UI component. For example, the MCU adjusts one or more of the shape, color, position, size, etc. of the basic graphic material according to the parameters or states indicated in the control instruction, so that the candidate graphic material can be used to display the indicated parameters or states. Of course, it is understandable that if the basic graphic material of the selected UI component can be directly used to display the indicated state or parameters, the basic graphic material can be directly used to generate the UI screen, or used as a candidate graphic material for the generation of the UI screen.
[0150] In the related art, two selected UI components may overlap or partially overlap in the UI screen. In this case, the upper selected UI component will block the lower selected UI component. In some cases, especially when the non-pattern part of the upper selected UI component is all pure color (such as the first color), it will seriously affect the overall effect of the UI screen.
[0151] In one embodiment of the present disclosure, the MCU is configured as follows:
[0152] In response to the first control instruction, the basic graphic material (eg, Figure 8-1 The illustrated graphic material) and the underlying graphic material (e.g. Figure 8-2 Graphic materials used as examples);
[0153] According to the basic graphic material of the first selected UI component and the lower-layer graphic material, the candidate graphic material of the first selected UI component (for example, Figure 8-3 Graphic materials used as examples);
[0154] A UI screen having the first selected UI component is generated according to the candidate graphic material of the first selected UI component.
[0155] In this embodiment, the first selected UI component is one of the selected UI components, which is the upper layer selected UI component, for example, a UI component of a preset type or a selected UI component of a preset position. In this embodiment, the lower layer graphic material is a graphic material of another selected UI component, which can be either the initial graphic material of the lower layer selected UI component or the supplementary graphic material of the lower layer selected UI component. The first selected UI component and the lower layer selected UI component may overlap or partially overlap in the UI screen.
[0156] Among them, see Figure 8-1, the basic graphic material of the first selected UI component includes a complementary first pattern P1 and a second pattern P2, the pixels of the first pattern P1 are pixels of a first color, and the pixels of the second pattern P2 are pixels other than the pixels of the first color. For example, Figure 8-1 In the basic graphic material of the first selected UI component in the example, pattern "2" is the second pattern of the graphic material; the solid color pattern surrounding the filled rectangular area is the first pattern of the material image.
[0157] The candidate graphic material of the first selected UI component includes a complementary third pattern P3 and a fourth pattern P4; the shape of the fourth pattern P4 of the candidate graphic material of the first selected UI component is the same as the shape of the second pattern P2 of the base graphic material of the first selected UI component; the color of the pixels of the third pattern P3 of the candidate graphic material of the first selected UI component is the same as the color of the pixels at the same position of the underlying graphic material. In effect, the base graphic material of the first selected UI component and the underlying graphic material are merged to form the candidate graphic material of the first selected UI component. For example, Figure 8-2 For the lower layer graphic material, Figure 8-3 for Figure 8-1 and Figure 8-2 The graphic material formed after fusion is used as a candidate graphic material for the first selected UI component. Figure 8-3 The pattern "2" and Figure 8-1 The pattern "2" is consistent with Figure 8-3 The fourth pattern; Figure 8-3 The pattern other than "2" and Figure 8-2 Consistent, as Figure 8-3 The third pattern.
[0158] In the embodiments of the present disclosure, the same position of pixels of two different graphic materials refers to the same position of pixels of the two different graphic materials in the UI screen, rather than the same relative position of pixels in the graphic materials. For example, if the coordinates of a pixel of the upper graphic material in the UI screen are (m, n), and the coordinates of a pixel of the lower graphic material in the UI screen are also (m, n), then the positions of the two pixels are the same. Wherein, m and n are both positive integers.
[0159] In this embodiment, a material fusion method is used to obtain the candidate graphic material of the upper selected UI component, so that the content of the lower graphic material is integrated into the candidate graphic material of the upper selected UI component. When the UI screen is generated together with the candidate graphic material of the upper selected UI component (i.e., the first selected UI component) and the lower graphic material, although the upper selected UI component and the lower selected UI component overlap, the candidate graphic material of the upper selected UI component blocks the lower graphic material; however, there is no blocking effect at the position of the first pattern, which makes the second pattern embedded on the lower selected UI component, thereby improving the display effect of the UI screen.
[0160] In one example, the first color is black. In the related art, the basic graphic material of the first selected UI component is directly used as the upper graphic material, and the first pattern of the upper graphic material is equivalent to a black mask, which greatly reduces the overall display effect of the UI screen. In the example of the embodiment of the present disclosure, the candidate graphic material of the first selected UI component is used as the upper graphic material, and the content of the third pattern of the upper graphic material is completely consistent with the content of the lower graphic material, that is, the content of the lower graphic material is integrated into the upper graphic material, which effectively eliminates the black mask of the upper graphic material and greatly improves the display effect.
[0161] In an example of this implementation, the MCU is further configured to generate a UI screen having the first selected UI component and the lower-layer graphic material according to the candidate graphic material of the first selected UI component and the lower-layer graphic material. For example, the lower-layer graphic material is a wallpaper graphic material, and the first selected UI component is a digital component, a text component, or a symbol component above the wallpaper graphic material.
[0162] In an example of this implementation, the color of the fourth pattern of the candidate graphic material of the first selected UI component is the same as the color of the second pattern of the basic graphic material of the first selected UI component. In other words, in this example, when the MCU generates the candidate graphic material based on the basic graphic material, it only adjusts the first pattern of the basic graphic material, and does not adjust the color and shape of the second pattern.
[0163] In an example of this implementation, the shape of the third pattern of the candidate graphic material of the first selected UI component is consistent with the shape of the first pattern of the basic graphic material of the first selected UI component. In this implementation, when the third pattern of the candidate graphic material of the first selected UI component is generated according to the first pattern of the basic graphic material of the first selected UI component, only the filling content (e.g., color) of the first pattern of the basic graphic material of the first selected UI component may be adjusted, and its shape may not be adjusted.
[0164] For example, the color of the third pattern of the candidate graphic material of the first selected UI component is different from the color of the first pattern of the basic graphic material of the first selected UI component, and the shape of the third pattern of the candidate graphic material of the first selected UI component is the same as the shape of the first pattern of the basic graphic material of the first selected UI component; the color and shape of the fourth pattern of the candidate graphic material of the first selected UI component are both the same as the color and shape of the second pattern of the basic graphic material of the first selected UI component.
[0165] Figure 9-1 to Figure 9-2 Schematic diagram of the principle of the upper-layer graphic material generating a black mask on the lower-layer graphic material in the related art. Figure 9-1 An example of a digital graphic material with a black mask is shown; Figure 9-2 This example shows the masking effect of a graphic material with a black mask on a wallpaper.
[0166] Figure 9-2 The UI screen shown includes two number components (with patterns of 2 and 6 respectively) and a symbol component (with a pattern of ° C) to display the temperature as a combination. The UI screen also includes a wallpaper component. Figure 9-1 The graphic material of the digital component with a pattern of 2 includes the pattern "2" (the second pattern) and the non-pattern part (the first pattern) is set to black. Similarly, the graphic materials of the remaining digital components and symbol components include a pattern part (the second pattern) and a black part (the first pattern) that fills the rectangular area. As upper-layer UI components, the digital components and symbol components can be displayed on the wallpaper component as a lower-layer UI component. In this way, the black part of the upper-layer component will form a black mask to cover the pattern of the wallpaper component, reducing the display effect.
[0167] Figure 10-1 An example of a digital graphic material (a candidate graphic material for a digital component) after material fusion with a wallpaper graphic material in an embodiment of the present disclosure is provided. Figure 10-2 The example shows that after merging with the wallpaper graphic material, the black masking problem of the upper graphic material (the candidate graphic material of the digital component) on the wallpaper is eliminated, which improves the display effect.
[0168] Figure 10-1 The illustrated graphic material is a candidate graphic material of the digital component "2". The basic graphic material of the digital component "2" is as follows: Figure 9-1 As shown. Figure 9-1 In the basic graphic material shown in the example, white pixels form a pattern of "2", which is the second pattern of the basic graphic material; black pixels fill the area outside the pattern of "2", forming the first pattern of the basic graphic material. Figure 10-1In the candidate graphic material shown in the example, the "2" pattern is retained as the fourth pattern of the candidate graphic material, and the pattern composed of the remaining area is the third pattern of the candidate graphic material. The color of the pixels of the third pattern in the candidate graphic material is the same as the color of the pixels in the same position in the wallpaper graphic material; in other words, in effect, the graphics of the wallpaper graphic component replaces the graphics in the first pattern of the basic graphic material; the portion other than the fourth pattern of the candidate graphic material is filled with the wallpaper graphic material; the candidate graphic material is a fusion of the second pattern in the basic graphic material and the wallpaper graphic material. Figure 10-2 In the example UI screen, the pattern of the upper selected UI component (such as the pattern "2", "6", "℃", etc.) is integrated with the wallpaper, and the upper selected UI component does not generate a black mask that blocks the lower selected UI component, which improves the display effect.
[0169] In one example, the lower layer selected UI component is a static component, which does not change repeatedly frame by frame to show dynamic effects. In this way, the lower layer graphic material that cooperates with each candidate graphic material of the upper layer selected UI component is one graphic material instead of multiple graphic materials, which can reduce the amount of hardware calculation and the generation speed of the candidate graphic material of the first selected UI component. For example, the lower layer selected UI component is a wallpaper component, especially a static wallpaper component, so the lower layer graphic material is a wallpaper graphic material.
[0170] Of course, in other examples of the present disclosure, the wallpaper component may also be a dynamic wallpaper component to improve the display effect. Furthermore, each candidate graphic material of the wallpaper component may be pre-stored in a memory, such as in an independent memory or in an internal memory of the MCU (such as the ROM of the MCU); the MCU may directly read each candidate graphic material of the wallpaper component without generating them one by one. When the MCU generates the candidate graphic material of the first selected UI component, it may use a candidate graphic material of the wallpaper component as the lower-layer graphic material, or use each candidate graphic material of the wallpaper component as the lower-layer graphic material in turn and generate the candidate graphic material of the first selected UI component corresponding to each lower-layer graphic material.
[0171] In an example of this implementation, the first selected UI component is a digital component for displaying numbers or a symbol component for displaying symbols. It can be understood that this does not limit all digital components to be the first selected UI component, nor does it limit all digital components to be the first selected UI component.
[0172] In one embodiment of the present disclosure, see Fig.11The MCU is configured to perform a fusion operation on each pixel of the basic graphic material of the first selected UI component in sequence, for example, taking the first pixel to the last pixel of the basic graphic material as pixels to be processed in sequence, and performing a fusion operation on the pixels to be processed after determining the pixels to be processed.
[0173] Performing a fusion operation on any one of the pixels includes:
[0174] Determine whether the color of the pixel to be processed is the first color;
[0175] If the color of the pixel to be processed is not the first color, the fusion operation ends;
[0176] If the color of the pixel to be processed is the first color, determine the reference pixel corresponding to the pixel to be processed, and change the color of the pixel to be processed to the color of the corresponding reference pixel; the reference pixel corresponding to the pixel to be processed is a pixel located in the lower layer of graphic material, and the pixel to be processed and the corresponding reference pixel have the same position in the UI screen.
[0177] In this way, the MCU can automatically identify the first pattern of the basic graphic material of the first selected UI component, and adjust the color of each pixel of the first pattern of the basic graphic material of the first selected UI component to the color of the pixel at the same position of the underlying graphic material, so that the pattern of the underlying graphic material is integrated into the candidate graphic material of the first selected UI component.
[0178] In an example of this implementation, the MCU is configured as:
[0179] Acquire the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component;
[0180] Obtaining the position information of the starting pixel of the lower-layer graphic material in the UI screen;
[0181] Determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-layer graphic material according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen, the position information of the pixel to be processed in the basic graphic material of the first selected UI component, and the position information of the starting pixel of the lower-layer graphic material in the UI screen;
[0182] The color information of the reference pixel is obtained according to the position information of the reference pixel in the lower-layer graphic material.
[0183] In this example, the starting pixel of the graphic material is the first pixel of the graphic material, such as the pixel in the upper left corner of the graphic material. The position of a pixel in the graphic material refers to the relative position of the pixel in the graphic material and the starting pixel of the graphic material, for example, the coordinates of the starting pixel are set to (0,0). The position information of a pixel in the UI screen is the position of the pixel in the UI screen relative to the starting pixel of the UI screen; for example, the position of the starting pixel of the UI screen in the UI screen is (0,0). In one example, the starting pixel in the UI screen is located in the upper left corner of the UI screen.
[0184] In one embodiment of the present disclosure, the MCU is configured as follows:
[0185] Determine the position information of the pixel to be processed in the UI screen according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component;
[0186] Use the position information of the pixel to be processed in the UI screen as the position information of the reference pixel corresponding to the pixel to be processed in the UI screen, and determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-level graphic material based on the position information of the reference pixel corresponding to the pixel to be processed in the UI screen and the position information of the starting pixel of the lower-level graphic material in the UI screen.
[0187] For example, the position information (eg, coordinates) of the starting pixel of the basic graphic material of the first selected UI component in the UI screen is (i 1 ,j 1 ), the position information (e.g., coordinates) of the starting pixel of the basic graphic material of the first selected UI component in the basic graphic material of the first selected UI component is (0,0), and the position information (e.g., coordinates) of the pixel to be processed in the basic graphic material of the first selected UI component is (i 2 ,j 2 Then, the position information (eg, coordinates) of the pixel to be processed in the UI screen is (i 1 +i 2 , j 1 +j 2 ). The position information (eg coordinates) of the reference pixel corresponding to the pixel to be processed in the UI screen is (i 1 +i 2 , j 1 +j 2 ). The position information of the starting pixel of the lower-level graphic material in the UI screen (for example, the coordinates are (i 3 ,j 3), the position information (e.g., coordinates) of the starting pixel of the lower-layer graphic material in the lower-layer graphic material is (0,0), then the position information (e.g., coordinates) of the reference pixel corresponding to the pixel to be processed in the lower-layer graphic material is (i 1 +i 2 -i 3 , j 1 +j 2 -j 3 ).
[0188] When determining infringement of a display driver board, display device, and electronic device, the following method may be used to assist: If the display panel PNL has a wallpaper function (for example, displaying a landscape background), and at least some UI components are integrated into the wallpaper in terms of display effect, for example, the rectangular area where the pattern portion of at least some UI components is located is either the pattern of the UI component or the wallpaper, then the display driver board, display device, and electronic device may have adopted the technical solution of this implementation.
[0189] When determining infringement of display driver boards, display devices and electronic devices, the following method can also be used to assist: export pre-stored graphic materials of UI components from the display driver board, and compare the exported graphic materials with the actual effects displayed by the UI components on the display panel PNL; if the display effect of the UI component is inconsistent with the exported graphic materials, for example, the black area in the UI material changes to other patterns when displayed, then the display driver board, display device and electronic device may have adopted the technical solution of this implementation.
[0190] In one example, the MCU is configured to implement the following process:
[0191] The lower-layer graphic material (e.g., the graphic material of the wallpaper component) and the upper-layer graphic material (e.g., the basic graphic material of the first selected UI component) are loaded into the MCU and stored in the video memory of the MCU. For example, the lower-layer graphic material and the upper-layer graphic material are stored in the form of unsigned integer one-dimensional arrays.
[0192] Get the coordinates, length and width data of the upper layer graphic material.
[0193] The color of the black pixels of the upper-layer graphic material is changed to the color of the pixels at the same position in the lower-layer graphic material until all pixels of the upper-layer graphic material are traversed; in this way, the upper-layer graphic material is a fused graphic material that is fused with the lower-layer graphic material, and the fused graphic material serves as a candidate graphic material for the first selected UI component.
[0194] In some embodiments of the present disclosure, the MCU is configured to use at least one of a rotation algorithm, a translation algorithm, a scaling algorithm, etc. to process the basic graphic material of the selected UI component to form a supplementary graphic material, and fill the rectangular area where the supplementary graphic material is located to form the supplementary graphic material of the selected UI component. The rectangular area where the supplementary graphic material is located refers to a rectangular area composed of adjacent M1 rows of pixels and N1 columns of pixels; M1 and N1 are positive integers.
[0195] In one embodiment of the present disclosure, the MCU is configured to generate supplementary graphic materials using an image compression method. In this embodiment, the MCU rotates the basic graphic materials of the selected UI component as a whole according to a preset algorithm, and fills the rectangular area occupied by the rotation, for example, with black display.
[0196] Figure 12-1 to Figure 12-3 The figure shows a process of generating a candidate graphic material of a fan component by using an image compression method. Figure 12-1 The basic graphic material of a fan component; when generating a supplementary graphic material of the fan component, each pixel point (black pixel and non-black pixel) of the entire basic graphic material can be rotated. Since the graphic material needs to be stored in the form of a matrix or array on the display driver board, the stored graphic material must be rectangular. Figure 12-2 This example shows an intermediate graphic generated from a base graphic material. Figure 12-2 After the basic graphic material is rotated, some areas of the rectangular area where it is located (especially the areas where the four corners are located) have no data (i.e., blank areas). These places need to be set with data, i.e., fill these blank areas. Figure 12-3 This example shows a supplementary graphic material generated from an intermediate graphic. Figure 12-3 , these blank areas can be filled with black, that is, the pixels of these blank areas are set to black. Therefore, the size of the generated supplementary graphic material becomes larger. On the one hand, when the selected UI component adopts the supplementary graphic material for display, the size of the supplementary graphic material may be too large and obscure other UI components. On the other hand, when the UI component is a full-screen component or a component close to full-screen display, the size of the supplementary graphic material may be larger than the size (pixel size) of the display panel PNL, and then the display panel PNL may be unable to display the supplementary graphic material.
[0197] In another embodiment of the present disclosure, the MCU is configured to generate supplementary graphic materials using an image generation algorithm. When obtaining supplementary graphic materials based on basic graphic materials, the positions and colors of the various pattern pixels of the supplementary graphic materials of the selected UI component can be determined based on the various pattern pixels of the basic graphic materials of the selected UI component (i.e., the pixels of the second pattern of the basic graphic materials), using at least one of the algorithms for changing the shape, position or color, such as a rotation algorithm, a translation algorithm, a scaling algorithm, and a color change algorithm. Then, the non-pattern pixels of the supplementary graphic materials can be determined based on the rectangular area or preset size where the pattern of the supplementary graphic materials is located (for example, the color of the non-pattern pixels of the supplementary graphic materials is set to black).
[0198] Figure 13-1 to Figure 13-2 The process of this image generation algorithm is illustrated. Figure 13-1 An example of a basic graphic material. Figure 13-2 This example shows a supplementary graphic material generated based on the basic graphic material. Figure 13-1 and Figure 13-2 This implementation helps reduce the size of the supplementary graphic material, thereby reducing the storage space required to store the supplementary graphic material, and helps reduce the possible impact of the selected UI component on other UI components.
[0199] by Figure 14-1 and Figure 14-2 Taking the illustrated process as an example, the process of generating a pattern of a supplementary graphic material according to the second pattern of the basic graphic material of the selected UI component is exemplarily described. Figure 14-1 A pattern (second pattern) of a basic graphic material of a UI component (rotating component) for displaying a rotating dynamic effect is exemplified. The display driver board also needs other graphic materials of the rotating component to enable the display panel PNL to display a dynamic effect. Therefore, the display driver board can display the basic graphic material (for example, Figure 14-1 A pattern of a basic graphic material) generates multiple supplementary graphic materials (such as Figure 14-2 The display driver board makes these candidate graphic materials sequentially and cyclically displayed on the display panel PNL in a preset order, so that the rotating icon component presents a rotating dynamic effect.
[0200] In this example, the MCU is configured to rotate the pattern in the basic graphic material using a rotation algorithm to generate a pattern of the supplementary graphic material. For example, the MCU can obtain the coordinates of the origin (rotation center) of the basic graphic material, the angle that needs to be rotated for each frame to achieve a dynamic effect (for example, a rotation of 15°), the position of each pattern pixel of the basic graphic material (in Figure 14-1 In the figure, the two ends of the line segment mark a pattern pixel and the origin in the basic graphic material. The position of each pattern pixel of the supplementary graphic material required for each frame can be determined by using trigonometric function related algorithms (in Figure 14-2 In the figure, the two ends of the line segment are used to mark the corresponding pattern pixels and origin in the supplementary graphic material).
[0201] In particular, for a square basic graphic material, the sizes of the generated complementary graphic materials can be kept consistent, that is, the length and width of the complementary graphic material are consistent with the basic graphic material. In particular, the complementary graphic material can be applied to a full-screen rotation special effect.
[0202] In some embodiments of the present disclosure, see Fig.15 The MCU is also configured to, in response to a second control instruction, obtain a basic graphic material of at least one second selected UI component from the memory, and generate and store a plurality of candidate graphic materials of the second selected UI component based on the basic graphic material of the second selected UI component, and is configured to select a candidate graphic material of the second selected UI component as the selected graphic material according to the second control instruction, and generate the UI screen according to the selected graphic material.
[0203] For example, see Fig.16 After receiving the second control instruction, the MCU can read the basic graphic material from the memory, and then sequentially obtain multiple candidate graphic materials based on the basic graphic material; each candidate graphic material can be stored in the frame buffer of the MCU. Fig.15 , each time a UI screen is generated, the MCU may select a candidate graphic material from the frame buffer as the selected graphic material of the second selected UI component, and generate a UI screen having the second selected UI component according to the selected graphic material, so that the UI screen is saved in the display layer. Fig.15 In the example, the display layer DPL only illustrates the selected graphic material, rather than fully displaying the UI screen in the display layer DPL. This is to more intuitively reflect that a selected graphic material is selected from the candidate graphic materials in the frame buffer FB and written into the display layer DPL, rather than that only the selected graphic material is saved in the display layer DPL.
[0204] In this embodiment, after acquiring the basic graphic material of the second selected UI component, the MCU can acquire various candidate graphic materials that may be required by the second selected UI component, and store these candidate graphic materials, for example, in a frame buffer. In this way, when generating a UI screen, the required graphic materials can be directly selected from the candidate graphic materials of the second selected UI component that have been acquired in advance, without recalculating and generating, which can reduce the impact of insufficient computing power of the display driver board (especially the MCU) on the frame rate, and avoid the frame rate of the second selected UI component being reduced, resulting in an unsmooth display effect.
[0205] In one example, see Fig.16 , the MCU can obtain the basic graphic material of the second selected UI component and store it in the frame buffer, so that the basic graphic material of the second selected UI component is also used as the candidate graphic material of the second selected UI component.
[0206] In one example, see Fig.16 , the MCU can call the basic graphic material of the second selected UI component from the frame buffer and generate the supplementary graphic material of the second selected UI component, and each supplementary graphic material and the basic graphic material are used together as candidate graphic materials of the second selected UI component.
[0207] Optionally, the MCU can determine the selected graphic material in each display frame according to the display effect that the second selected UI component needs to present. For example, in one example, the second selected UI component is a static graphic component for displaying different states (such as a pointer component that displays different temperatures). The MCU can select a candidate graphic material that matches the state parameter from each candidate graphic material of the second selected UI component according to the state parameter in the second control instruction, and use the selected candidate graphic material as the selected graphic material of the second selected UI component; the MCU generates a UI screen according to the selected graphic material so that the second selected UI component in the UI screen can display a specific state. When the state parameter in the second control instruction changes, the MCU can re-determine the selected graphic material of the second selected UI component, for example, select a candidate graphic material that matches the new state parameter as the selected graphic material of the second selected UI component, and make the new selected graphic material update the second selected UI component in the UI screen, that is, regenerate the UI screen according to the selected graphic material of the second selected UI component.
[0208] In another example, the second selected UI component is a dynamic effect component that needs to display multiple different graphic materials in sequence, such as a fan component that needs to display a rotating effect. Then the MCU is also configured to repeatedly perform a dynamic loop process; any one of the dynamic loop processes includes displaying each candidate graphic material of the second selected UI component in different UI screens in sequence. For example, any one of the dynamic loop processes includes: determining each candidate graphic material of the second selected UI component as a selected graphic material in sequence, and generating a UI screen with the selected graphic material after each determination of the selected graphic material and storing it in the display layer.
[0209] For example, see Fig.17 A dynamic cycle process includes: taking each candidate graphic material of the second selected UI component as the selected graphic material in turn, and generating a UI screen having the selected graphic material according to the selected graphic material after each selected graphic material is determined. For example, in the order of the first candidate graphic material to the last candidate graphic material of the second selected UI component, each candidate graphic material is determined as the selected graphic material in turn; after a selected graphic material is determined, a UI screen is generated according to the candidate graphic material.
[0210] For example, the candidate graphic materials of the second selected UI component include the first candidate graphic material, the second candidate graphic material, and the mth candidate graphic material (the last graphic material, m is a positive integer); when executing a dynamic loop process, the first candidate graphic material is first used as the selected graphic material, and a UI screen having the first candidate graphic material is generated according to the selected graphic material, so that the display panel displays the first candidate graphic material. Then the second candidate graphic material is used as the selected graphic material, and a UI screen having the second candidate graphic material is generated, so that the display panel displays the second candidate graphic material. In this way, each candidate graphic material is used as the selected graphic material and a UI screen is generated in turn, until the mth candidate graphic material is used as the selected graphic material and a UI screen having the mth candidate graphic material is generated according to the mth candidate graphic material, so that the UI screen having the mth candidate graphic material is displayed on the PNL.
[0211] exist Fig.17 In the example of , when the selected graphic material is the last candidate graphic material of the second selected UI component, the next selected graphic material can be set as the first candidate graphic material of the second selected UI component. In this way, after completing a dynamic cycle process, the dynamic cycle process is re-executed.
[0212] In this embodiment, when the MCU displays the dynamic effect of the second selected UI component, it is not necessary to calculate and generate each frame of the second selected UI component. Fig.15 In the example, the second selected UI component is a dynamic effect component that needs to display multiple different graphic materials in sequence, such as a dynamic fan component. The MCU can obtain each candidate graphic material of the dynamic effect component based on the basic graphic material of the dynamic effect component and store each candidate graphic material in the frame buffer FB. The pattern part (such as the fan pattern) in each candidate graphic material is different (for example, the rotation angle is different). The MCU cyclically selects each candidate graphic material as the selected graphic material in a preset order, so that the pattern of the dynamic effect component of the UI screen located in the display layer DPL is the pattern of each candidate graphic material in turn, and then the dynamic effect component of the display panel PNL cyclically displays the pattern of each candidate graphic material in turn, so that the dynamic effect component displays a dynamic effect. In this process, the MCU does not need to recalculate and generate the candidate graphic material every time the UI screen is generated, but directly calls the required candidate graphic material from the frame buffer FB, which avoids the influence of the MCU's calculation speed on the UI screen generation speed, and can also reduce the overall power consumption of the MCU.
[0213] In one example, the display layer DPL stores a UI screen for display; after selecting a candidate graphic material from the frame buffer FB as the selected graphic material, the pixel data of the selected graphic material can be overwritten with the pixel data of the pixel at the same position of the UI screen in the display layer DPL, thereby updating the UI screen in the display layer DPL. In other words, generating the candidate graphic material according to the basic graphic material and generating the UI according to the candidate graphic material can be asynchronous.
[0214] In one example, the MCU is configured to display each candidate graphic material frame by frame in sequence when executing any one of the dynamic loop processes. In this example, each candidate graphic material of the second selected UI component is displayed for a duration of one frame each time, so that each candidate graphic material of the second selected UI component is refreshed in sequence at a high frequency. It is understandable that in other embodiments of the present disclosure, the display duration of the candidate graphic material of the second selected UI component can also be a multi-frame duration. For example, each candidate graphic material of the second selected UI component is displayed for a duration of 2 frames, 3 frames, or 4 frames each time.
[0215] In one example, see Fig.17, the MCU is also configured to, when the second selected UI component does not need to be displayed, clear the various candidate graphic materials of the second selected UI component. For example, when the MCU determines that the dynamic effect needs to be ended according to the control instruction, it clears the various candidate graphic materials of the corresponding second selected UI component. In other words, when a second selected UI component no longer needs to be displayed, the display driver board can clear the various candidate graphic materials of the second selected UI component. This can free up space for storing various candidate graphic materials, such as freeing up space for the frame buffer. It can be understood that clearing the various candidate graphic materials of the second selected UI component means that the display driver board can no longer obtain the various candidate graphic materials, which can be achieved by deleting the address information of the candidate graphic material, or by resetting or overwriting the data of each pixel of the candidate graphic material, or by other methods.
[0216] For example, after the display driver board clears a candidate graphic material, the data in the storage space occupied by the candidate graphic material may remain unchanged until being overwritten by the data of other graphic materials.
[0217] In one example, when the MCU receives a control instruction to end a certain dynamic effect, the MCU may clear each candidate graphic material in the frame buffer FB of the UI component that displays the dynamic effect to release the storage space of the frame buffer.
[0218] In one example, the basic graphic material of the second selected UI component includes a first pattern and a second pattern that are complementary, the pixels of the first pattern are pixels of a first color, and the pixels of the second pattern are pixels other than the pixels of the first color;
[0219] The MCU is further configured to sequentially generate candidate graphic materials for the second selected UI component using a rotation algorithm.
[0220] Generating any one of the candidate graphic materials of the second selected UI component includes: rotating the second pattern of the basic graphic material of the second selected UI component by a preset angle to generate the second pattern of the candidate graphic material of the second selected UI component, and filling the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located with a first color to form the candidate graphic material of the second selected UI component; wherein the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located refers to a rectangular area composed of adjacent M1 row pixels * N1 column pixels; M1 and N1 are positive integers.
[0221] In other words, in this example, the MCU is configured to employ an image generation algorithm to generate respective supplementary graphic materials for the second selected UI component.
[0222] In one example, the MCU is configured to implement a dynamic effect of a second selected UI component by the following method.
[0223] The MCU is configured to receive a control instruction from the device mainboard, and determine whether to play the special effect according to the control instruction (e.g., the RT instruction of the selected UI component). If the dynamic effect of the UI component is not played according to the control instruction, the control instruction of the device mainboard is continuously received until the dynamic effect of the UI component (at this time, the second selected UI component) is played according to the second control instruction (one of the control instructions).
[0224] The MCU is further configured to obtain the candidate graphic material of the second selected UI component and store it in the frame buffer FB until each candidate graphic material of the second selected UI component is obtained. Wherein, obtaining any candidate graphic material includes: creating an array in the frame buffer FB to store the pixel data of the candidate graphic material; sequentially calculating the position of each pixel in the basic graphic material in the candidate graphic material and assigning a value, for example, using a trigonometric function algorithm to calculate the position of the pixel in the basic graphic material in the candidate graphic material according to the rotation angle and the origin coordinates.
[0225] The MCU is also configured to cyclically call the candidate graphic materials of the second selected UI component and generate a UI screen, so that each candidate graphic material is displayed in turn on the display panel PNL to present a dynamic effect until it is determined that the dynamic effect of the second selected UI component needs to be stopped; after it is determined that the dynamic effect of the second selected UI component needs to be stopped, each candidate graphic material of the selected UI component is cleared from the video memory.
[0226] In this example, the following feature A) and feature B) will be presented.
[0227] Feature A), the actual display effect of the second selected UI component will exceed the effect that can be achieved by the graphic material of the second selected UI component stored in the memory. For example, the number of frames at which the display panel PNL displays the dynamic effect of the second selected UI component is higher than the number of graphic materials stored in the independent memory of the second selected UI component, or the graphic material presented by the display panel PNL when displaying the second selected UI component does not exist in the independent memory. Therefore, feature A) can be applied to infringement determination. Specifically, the graphic material in the memory of a display driver board is exported and compared with the dynamic effect that the display device can display; if the actual dynamic effect of a certain UI component is higher than the effect that can be achieved by the graphic material in the memory (for example, the graphic material presented by the UI component in a certain frame is not stored in the memory, or the number of frames when the UI component presents the dynamic effect is higher than the number of graphic materials in the memory of the UI component, etc.), then the display driver board, the display device, and the electronic device using the display device may have adopted the technical solution of the embodiment of the present disclosure.
[0228] Feature B) can significantly reduce the total amount of graphic materials in the memory while achieving the same dynamic effect, for example, to less than 1 / 3 of the theoretical total amount. Specifically, the total amount of graphic materials theoretically required for each UI component (theoretical total amount) can be determined based on the dynamic effect presented by each UI component. Generally, only when the technical solution provided by the embodiment of the present disclosure is adopted, the total capacity of graphic materials in the memory can be reduced to less than 1 / 3 of the theoretical total amount.
[0229] Therefore, this feature B) can be applied to infringement determination. Specifically, the total amount of graphic materials theoretically required for each UI component (theoretical total amount) can be determined based on the dynamic effects presented by each UI component. Each graphic material is exported from the memory and the actual total amount of the graphic material is determined. If the actual total amount is less than 1 / 3 of the theoretical total amount, the display driver board, display device, and electronic device using the display device may have adopted the technical solution of the embodiment of the present disclosure.
[0230] In an example of this implementation, the basic graphic material of the second selected UI component is stored in an independent memory;
[0231] See also Fig.16 The MCU is further configured to disconnect the communication between the MCU and the independent memory after acquiring each candidate graphic material of the second selected UI component.
[0232] For example, after the MCU obtains each candidate graphic material of the second selected UI component from the independent memory, the communication between the MCU and the independent memory can be disconnected, for example, the SPI communication between the MCU and the independent memory is terminated. In this way, the power consumption of the display driver board can be reduced.
[0233] This implementation may have the following characteristics: when the second selected UI component is playing the dynamic effect normally, the communication between the independent memory and the MCU is disconnected, and the dynamic effect of the UI is still playing normally. Correspondingly, this feature can also be applied to infringement determination. Specifically, if a display device is playing the dynamic effect of a second selected UI component normally, then the SPI connection between the MCU and the independent memory is disconnected. If the dynamic effect of the second selected UI component is still playing normally, and the electronic device, display device and display driver board may have applied the technical solution of this implementation.
[0234] In some embodiments of the present disclosure, see Fig.18 The MCU is also configured to, in response to the third control instruction, obtain basic graphic materials of at least one third selected UI component from the memory, generate candidate graphic materials of the third selected UI component according to the basic graphic materials of the third selected UI component and the third control instruction, and generate a UI screen having the candidate graphic materials of the third selected UI component according to the candidate graphic materials of the third selected UI component.
[0235] Optionally, the third selected UI component is a pointer component. In the related art, it is often necessary to save hundreds of graphic materials of the pointer component to achieve a good display effect. In this embodiment, only the basic graphic materials of the pointer component are saved to display the pointer component very efficiently, which can greatly reduce the capacity of the memory in the display driver board.
[0236] Optionally, the MCU includes a video memory, the video memory includes at least one frame buffer and a display layer, and the display layer is used to store the UI screen;
[0237] The MCU is configured as:
[0238] storing the basic graphic material of the third selected UI component in the frame buffer;
[0239] The candidate graphic material of the third selected UI component is generated according to the basic graphic material of the third selected UI component in the frame buffer and written into the display layer to update the pattern of the selected UI component in the UI screen.
[0240] In one example, before the MCU needs to replace the candidate graphic material of the third selected UI component each time, the MCU generates a new candidate graphic material based on the basic graphic material 3, and generates a new UI screen based on the new candidate graphic material. In other words, the MCU generates a candidate graphic material of the third selected UI component based on the basic graphic material of the third selected UI component each time. For example, the MCU can generate candidate graphic materials based on the basic graphic material according to the parameters or status indicated by the third control instruction and use the candidate graphic materials to generate or update the UI screen, so that the UI screen can display the parameters or status indicated by the control instruction.
[0241] For example, in Fig.18 In the example, a video memory is set on the MCU, and the video memory includes at least one frame buffer FB and a display layer DPL. Among them, the frame buffer FB and the display layer DPL are each specific areas in the video memory for storing picture data. The MCU is configured to be able to obtain the basic graphic material of the pointer component in response to the third control instruction, and store the basic graphic material of the pointer component in the frame buffer FB. The MCU is also configured to generate candidate graphic materials of the pointer component and write the candidate graphic materials into the display layer DPL according to the parameters provided by the third control instruction and the algorithm corresponding to the pointer component. In this example, writing the candidate graphic material of the pointer component into the display layer DPL realizes the storage of the candidate graphic material in the display layer DPL on the one hand, and the update of the UI screen in the display layer DPL on the other hand, so that the UI screen in the display layer DPL has the candidate graphic material. When the display driver board drives the display panel PNL according to the display layer DPL, the UI screen displayed by the display panel PNL can have the expected pointer component.
[0242] Optional, in Fig.18 In the example, the display layer DPL only illustrates the candidate graphic materials of the pointer component, rather than fully displaying the UI screen in the display layer DPL. This is to more intuitively reflect the generation of candidate graphic materials based on the basic graphic materials located in the frame buffer FB, rather than referring to the display layer DPL only storing the candidate graphic materials. In one example, the display layer DPL stores the UI screen for display; after generating the candidate graphic materials of the third selected UI component or in the process of generating the candidate graphic materials of the third selected UI component, the pixel data of the pixel at the corresponding position in the display layer DPL can be overwritten by the pixel data of the candidate graphic materials, thereby realizing the update of the UI screen in the display layer DPL. In other words, generating candidate graphic materials based on the basic graphic materials and generating UI based on the candidate graphic materials can be performed simultaneously. Of course, it may not be performed synchronously.
[0243] In one example, see Figure 19-1 to Figure 19-3, an image compression method can be used to generate various supplementary graphic materials of the pointer component based on the basic graphic material of the pointer component. For example, the basic graphic material of the pointer component (see Figure 19-1 ) is rotated according to a preset angle (determined by the MCU according to the third control instruction), and the rotated material (see Figure 19-2 ) is filled with black pixels to obtain the candidate graphic material of the pointer component (see Figure 19-3 ). Of course, an image generation algorithm may also be used to generate candidate graphic materials for the pointer component.
[0244] In the related art, Figure 2 For example, although the display driver board pre-saves the various graphic materials of the pointer component and the positions of these graphic materials in the UI screen. However, due to the different inclination angles of the pointer components in these graphic materials, the relative positions of the swing centers of the pointers in the graphic materials are not the same in the graphic materials (for example, the swing center of the pointer component is the root pixel of the pointer pattern, but the root pixel is not set at the top corner of the graphic material). This results in that the positions of the swing centers of the pointers of different graphic materials (for example, the root of the pointer) in the UI screen are not the same, affecting the display effect of the pointer.
[0245] In one embodiment of the present disclosure, the MCU is also configured to determine the position information of the candidate graphic material of the third selected UI component based on the relative position of the pointer swing center in the candidate graphic material of the third selected UI component, and based on the target position of the pointer swing center in the UI screen.
[0246] For example, the MCU is configured as:
[0247] According to the third control instruction, obtaining the basic graphic material of the pointer component;
[0248] Determine shape information of candidate graphic materials of the pointer component by using a rotation algorithm according to the basic graphic material of the pointer component and the third control instruction;
[0249] Based on the relative position of the pointer swing center in the candidate graphic material of the pointer component and the target position of the pointer swing center in the UI screen, the position information of the candidate graphic material of the pointer component (for example, the coordinates of the starting pixel of the candidate graphic material in the UI screen) is determined.
[0250] A UI screen is generated according to the candidate graphic materials of the pointer component and the position information of the candidate graphic materials of the pointer component.
[0251] In this way, when the MCU displays the pointer component according to different candidate graphic materials of the pointer component, the position of the pointer swing center in the UI screen remains unchanged, thereby avoiding the change of the pointer swing center and reducing the display effect.
[0252] Optionally, the MCU is configured such that, when acquiring each supplementary graphic material through a rotation algorithm, the origin of rotation may be the swing center of the pointer in the basic graphic material.
[0253] Optionally, the swing center of the pointer component may be the root of the pointer pattern, such as a pixel at the root of the pointer pattern.
[0254] The following is an example of how to determine the position of the candidate graphic material by taking the swing center of the pointer component as the root pixel of the pointer.
[0255] See also Figure 19-4 , the MCU is configured to, when acquiring the candidate graphic material according to the basic graphic material of the pointer component, calculate the horizontal distance (in pixels) and the vertical distance (in pixels) between the root pixel of the pointer pattern of the candidate graphic material and a vertex of the candidate graphic material according to the angle of rotation of the pointer, using an algorithm based on the Taylor series. In one case, the position information of the candidate graphic material and the relative position information of the root pixel of the pointer in the candidate graphic material can be saved; when generating a UI screen according to the candidate graphic material, the UI screen can be generated together according to the relative position information and the position information of the candidate graphic material; specifically, the actual position of the candidate graphic material in the UI screen is corrected using the relative position information so that the coordinates of the root pixel of the pointer pattern are the target position or the same as the coordinates of the root pixel of the pointer pattern of other candidate graphic materials. In another case, the position information of the candidate graphic material can be corrected according to the relative position information; when generating the UI screen according to the corrected position information of the candidate graphic material, the position of the root pixel of the pointer pattern in the UI screen can be made the target position or the same as the coordinates of the root pixel of the pointer pattern of other candidate graphic materials.
[0256] In one embodiment of the present disclosure, the third control instruction includes a pointer parameter, that is, a parameter that needs to be indicated by a pointer component. The MCU can adjust the graphic material used by the pointer component according to the pointer parameter so that the pointer points to the parameter to be displayed. In other words, the pointer component can adjust the pointer angle according to the pointer parameter.
[0257] In the related art, when the display panel PNL displays the pointer component, the pointer will flicker when the angle changes. Specifically, the old pointer disappears first, and then the new pointer is displayed. This is because in the related art, the new pointer is replaced according to the following method:
[0258] See also Figure 20-1 to Figure 20-3 , in the last frame before the replacement, use the old pointer graphics material (such as Figure 20-1 In the subsequent mask frame, a black mask with the same size and position as the old pointer graphic material is used (as shown in Figure 20-2 Therefore, in the mask frame, the pointer is not displayed on the display panel PNL, which is manifested as the pointer completely disappearing. In the first frame after the replacement, the new pointer graphic material (such as Figure 20-3 The UI screen is formed and displayed (as shown), so that a new pointer is displayed on the display panel PNL. As a result, the display panel PNL presents the following process as a whole: the old pointer is displayed, the pointer completely disappears, and the new pointer is displayed. Since the pointer completely disappears in the mask frame, the flickering feeling is obvious.
[0259] In one embodiment of the present disclosure, the third control instruction includes a pointer parameter, and the pointer component can adjust the pointer angle according to the pointer parameter.
[0260] The MCU is further configured to sequentially generate a first UI picture, a second UI picture, and a third UI picture for frame-by-frame display.
[0261] Wherein, generating the first UI screen includes: responding to the first pointer parameter, generating a first candidate graphic material according to the basic graphic material of the third selected UI component (see Figure 21-1 ), and generates the first UI screen according to the first candidate graphic material; the first UI screen is the last frame before the pointer is switched, and the pointer component uses the old pointer.
[0262] Generating the third UI screen includes: responding to the second pointer parameter, generating a second candidate graphic material according to the basic graphic material of the third selected UI component (see Figure 21-3 ), and generate the third UI screen according to the second candidate graphic material. The third UI screen is the first frame after the pointer is switched, and the pointer component adopts a new pointer.
[0263] Generating the second UI screen includes: responding to the second pointer parameter, obtaining a mask graphic material (see Figure 21-2), generate the second UI screen according to the mask graphic material; wherein the mask graphic material includes a first area and a second area that complement each other; the first area of the mask graphic material is the area where the first candidate graphic material and the second candidate graphic material overlap with each other; the second area of the mask graphic material is the area of the first candidate graphic material that does not overlap with the second candidate graphic material; the color of the pixels of the mask graphic material in the first area is the same as the color of the pixels of the first candidate graphic material at the same position; the color of the pixels of the mask graphic material in the second area is black.
[0264] Therefore, in this embodiment, the first UI screen displays the old pointer, the second UI screen displays part of the old pointer, and the area where the part of the old pointer is located overlaps with the area where the new pointer is located, and the third UI screen displays the new pointer. This can avoid the problem of the pointer completely disappearing during the pointer switching process, making the pointer switching effect smoother and reducing pointer flickering.
[0265] As follows, an example is used to illustrate the display of the pointer component. In this example, the method for MCU to implement pointer switching includes the following operations:
[0266] Operation A1), according to the value that the pointer needs to point to, calculate the angle that the pointer needs to rotate, and then the MCU rotates the basic graphic material to generate a candidate graphic material (see Figure 19-3 ). For example, the MCU receives a third control instruction, which includes making the pointer point to a certain value. The MCU can determine the angle that the pointer in the basic graphic material needs to rotate according to the value to be pointed to, then read the basic graphic material from the memory, and generate the candidate graphic material according to the determined rotation angle.
[0267] Operation A2) converts the pointer rotation angle into radians and inputs the algorithm based on Taylor series to obtain the relative position of the root pixel of the pointer in the candidate graphic material, for example Figure 19-4 The horizontal and vertical distances in.
[0268] For example, after obtaining the candidate graphic material, the MCU converts the angle value into a radian value and inputs it into the Taylor series algorithm to obtain the corresponding sin value, thereby calculating the horizontal and vertical distances between the pointer root pixel and the corner of the candidate graphic material.
[0269] Operation A3) determines the position of the candidate graphic material according to the coordinates of the root pixel of the pointer in the UI screen and the relative position of the root pixel of the pointer in the candidate graphic material.
[0270] In this example, the position of the graphic material in the UI screen is the coordinate of the upper left corner pixel of the graphic material in the UI screen. In the UI screen, the pixel columns are numbered in ascending order from left to right, and the first column is numbered 0. In the UI screen, the pixel rows are numbered in ascending order from top to bottom, and the first row is numbered 0. In other words, the coordinates of the upper left corner pixel are (0,0).
[0271] Assuming the target root coordinates of the pointer are (x, y), the horizontal distance (the horizontal distance between the pointer root pixel and the nearest vertical edge in the candidate graphic material) and the vertical distance (the vertical distance between the pointer root pixel and the bottom edge in the candidate graphic material) calculated by Taylor's formula are a and b respectively, and the width (the number of pixels in the row direction) and height (the number of pixels in the column direction) of the generated candidate graphic material are w and h respectively. Then the coordinates where the candidate graphic material needs to be placed are:
[0272] 1) When the pointer is within 90° of the upper left corner of the pointer root pixel, the coordinates of the position of the candidate graphic material should be (x-w+a,y-h+b);
[0273] 2) When the pointer is within 90° of the upper right corner of the pointer root pixel, the coordinates of the position of the candidate graphic material should be (xa, y-h+b).
[0274] Operation A4), when the pointer changes its angle, first partially mask the old pointer. Specifically, mask the area where the old pointer and the new pointer do not overlap with each other with black, so that the display panel PNL only displays part of the old pointer. Then, the display panel PNL displays the new pointer.
[0275] For example, the position coordinates, width information and height information of the new pointer graphic material and the old pointer graphic material are used to calculate the position of the overlapping part of the new pointer graphic material and the old pointer graphic material; then a black mask is applied to the non-overlapping part of the old pointer graphic material in the UI screen, and then the new pointer graphic material is displayed.
[0276] In some electronic devices, some components are needed to display different states by changing colors. In other words, some graphic materials have exactly the same shape but different colors. In the related art, these graphic materials with the same pattern but different colors need to be stored one by one, which leads to an increase in storage space and an increase in hardware costs.
[0277] In some embodiments of the present disclosure, at least one of these UI components may only pre-store one basic graphic material. Other candidate graphic materials of these UI components may be obtained based on the basic graphic material. Figure 22-1 and Figure 22-2 The MCU is also configured to:
[0278] In response to the fourth control instruction, the basic graphic material (eg, Figure 22-1 Graphic material shown);
[0279] According to the basic graphic material of the fourth selected UI component, the candidate graphic material of the fourth selected UI component is obtained (for example, Figure 22-2 Graphic material shown);
[0280] And, a UI screen having the fourth selected UI component is generated according to the candidate graphic material of the fourth selected UI component.
[0281] The basic graphic material of the fourth selected UI component includes a complementary first pattern (eg Figure 22-1 pattern Y1 in) and a second pattern (e.g. Figure 22-1 The pixels of the first pattern are pixels of a second color, and the pixels of the second pattern are pixels other than pixels of the second color;
[0282] The candidate graphic material of the fourth selected UI component includes a complementary third pattern (eg Figure 22-2 Pattern Y3 in the figure) and the fourth pattern (e.g. Figure 22-2 The fourth pattern of the candidate graphic material of the fourth selected UI component has the same shape and different color as the second pattern of the basic graphic material of the fourth selected UI component; the third pattern of the candidate graphic material of the fourth selected UI component has the same shape and the same color as the first pattern of the basic graphic material of the fourth selected UI component.
[0283] In this way, the MCU can change the color of the second pattern of the basic graphic material of the fourth selected UI component to generate the supplementary graphic material.
[0284] In one example, the second color is black.
[0285] In one example, the MCU is configured to obtain the supplementary graphic material of the fourth selected UI component according to the basic graphic material of the fourth selected UI component; wherein the supplementary graphic material is generated by changing the color of the non-black part of the basic graphic material. For example, the color of all non-black pixels in the basic graphic material is changed to another color. In other words, after reading the basic graphic material, the MCU can generate a new supplementary graphic material by reshaping the color of the basic graphic material, and the color of the supplementary graphic material is different from that of the basic graphic material, but the shape is the same.
[0286] In one example, when displaying the fourth selected UI component, if the required graphic material is the same as the basic graphic material of the fourth selected UI component, the UI screen can be directly generated based on the basic graphic material of the fourth selected UI component. If the required graphic material is different from the basic graphic material of the fourth selected UI component, a supplementary graphic material (as a candidate graphic material) as the required graphic material is generated based on the basic graphic material, and the UI screen is generated based on the supplementary graphic material.
[0287] Optional, see Fig.23 The MCU is further configured to sequentially perform a color change operation on each pixel of the basic graphic material of the fourth selected UI component. For example, in the order of the first pixel to the last pixel of the basic graphic material of the fourth selected UI component, each pixel is sequentially used as a pixel to be processed, and after determining the pixel to be processed, a color change operation is performed on the processed form.
[0288] Performing a color change operation on any one of the pixels includes:
[0289] Determine whether the color of the pixel to be processed is the second color;
[0290] If the color of the pixel to be processed is the second color, the color changing operation ends;
[0291] If the color of the pixel to be processed is not the second color, the color of the pixel to be processed is modified to a third color.
[0292] In one example, the MCU may complete the display of a fourth selected UI component by executing the following process:
[0293] The MCU receives the fourth control instruction, and then responds to the fourth control instruction to obtain the address information and size information (such as height information and width information) of the basic graphic material of the fourth selected UI component in the memory (such as F basic graphic material SH); then reads the basic graphic material of the fourth selected UI component from the memory. After that, the MCU traverses each pixel of the basic graphic material and determines whether the color of each pixel needs to be changed. If the color of the pixel needs to be changed, the color of the pixel is changed. In this way, after the traversal is completed, the candidate graphic material of the fourth selected UI component is obtained, and the candidate graphic material of the fourth selected UI component is displayed on the display panel PNL.
[0294] Figure 24-1 to Figure 24-3 This is a schematic diagram of obtaining two candidate graphic materials of a digital component according to the basic graphic material of the digital component in an embodiment of the present disclosure. Figure 24-1An example of a basic graphic material of a digital component is shown, wherein the pattern pixels of the basic graphic material are orange and the pattern of the basic graphic material forms a hollow “1”. Figure 24-2 A candidate graphic material of the digital component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 24-3 An example of a candidate graphic material for the digital component is shown, the pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue.
[0295] Figure 25-1 to Figure 25-4 In one embodiment of the present disclosure, a schematic diagram of obtaining three candidate graphic materials of the fan component according to the basic graphic material of the fan component. Figure 25-1 An example of a basic graphic material of a fan component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is a fan. Figure 25-2 A candidate graphic material of the fan component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 25-3 An example of a candidate graphic material for the fan component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue. Figure 25-4 An example of a candidate graphic material for the fan component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is apple green.
[0296] Figure 26-1 to Figure 26-3 This is a schematic diagram of obtaining two candidate graphic materials of an outdoor icon component according to a basic graphic material of the outdoor icon component in an embodiment of the present disclosure. Figure 26-1 An example of a basic graphic material of an outdoor icon component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material forms a hollow “outdoor”. Figure 26-2 An example of a candidate graphic material for the outdoor icon component is shown, and the candidate graphic material is the same as the basic graphic material. Figure 26-3 An example of a candidate graphic material for the outdoor icon component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue.
[0297] Figure 27-1 to Figure 27-3 This is a schematic diagram of obtaining two candidate graphic materials of a digital component according to the basic graphic material of the digital component in an embodiment of the present disclosure. Figure 27-1 An example of a basic graphic material of a digital component is shown. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is the number "1". Figure 27-2 A candidate graphic material of the digital component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 27-3 An example of a candidate graphic material for the digital component is shown, the pattern of the candidate graphic material is the same as the basic graphic material, but the color is red.
[0298] Figure 28-1 to Figure 28-4 This is a schematic diagram of obtaining three candidate graphic materials of a rotating arrow component according to a basic graphic material of the rotating arrow component in an embodiment of the present disclosure. Figure 28-1 The following example illustrates a basic graphic material of a rotating arrow component. The pattern pixels of the basic graphic material are orange, and the pattern of the basic graphic material is two semicircular arrows connected end to end. Figure 28-2 An example of a candidate graphic material for the rotating arrow component is shown, and the candidate graphic material is the same as the basic graphic material. Figure 28-3 An example of a candidate graphic material for the rotating arrow component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is blue. Figure 28-4 An example of a candidate graphic material for the rotating arrow component is shown. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is apple green.
[0299] Figure 29-1 to Figure 29-3 This is a schematic diagram of obtaining two candidate graphic materials of a pointer component according to a basic graphic material of the pointer component in an embodiment of the present disclosure. Figure 21-1 An example of a basic graphic material of a pointer component is shown. The pattern pixels of the basic graphic material are apple green, and the pattern of the basic graphic material is in the shape of a pointer. Figure 29-2 A candidate graphic material of the pointer component is illustrated, and the candidate graphic material is the same as the basic graphic material. Figure 29-3 A candidate graphic material of the pointer component is illustrated. The pattern of the candidate graphic material is the same as the basic graphic material, but the color is white.
[0300] Optionally, the following methods can be used to assist in infringement determination:
[0301] The graphic material in the memory of the electronic device, display device or display driver board is exported. If the graphic material displayed on the display panel PNL does not exist in the exported graphic material, but there is a graphic material with the same shape in the exported graphic material, then the electronic device, display device or display driver board may adopt the technical solution provided by this embodiment.
[0302] Optionally, the following method may be further used to assist in infringement determination: read the MCU log, if a color change (reshaping) log is found before the UI component is displayed, then the electronic device, display device or display driver board may have adopted the technical solution provided by this implementation.
[0303] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.
Claims
1. A display driver board, comprising: A memory configured to store basic graphic materials of at least one UI component; an MCU configured to obtain, in response to a first control instruction, a basic graphic material and a lower-layer graphic material of at least one first selected UI component from the memory, obtain a candidate graphic material of the first selected UI component according to the basic graphic material and the lower-layer graphic material of the first selected UI component, and generate a UI screen having the first selected UI component according to the candidate graphic material of the first selected UI component; The basic graphic material of the first selected UI component includes a first pattern and a second pattern that are complementary, the pixels of the first pattern are pixels of a first color, and the pixels of the second pattern are pixels other than the pixels of the first color; The candidate graphic material of the first selected UI component includes complementary third and fourth patterns; the shape of the fourth pattern of the candidate graphic material of the first selected UI component is the same as the shape of the second pattern of the basic graphic material of the first selected UI component; the color of the pixels of the third pattern of the candidate graphic material of the first selected UI component is the same as the color of the pixels at the same position of the underlying graphic material.
2. The display driving board according to claim 1, wherein: The MCU is further configured to generate a UI screen having the first selected UI component and the lower-layer graphic material according to the candidate graphic material of the first selected UI component and the lower-layer graphic material.
3. The display driving board according to claim 1, wherein: The color of the fourth pattern of the candidate graphic material of the first selected UI component is the same as the color of the second pattern of the base graphic material of the first selected UI component.
4. The display driving board according to claim 1, wherein: The shape of the third pattern of the candidate graphic material of the first selected UI component is consistent with the shape of the first pattern of the basic graphic material of the first selected UI component.
5. The display driving board according to claim 1, wherein: The first color is black.
6. The display driving board according to claim 1, wherein: The lower layer graphic material is a wallpaper graphic material.
7. The display driving board according to claim 1, wherein: The MCU is configured to sequentially perform a fusion operation on each pixel of the basic graphic material of the first selected UI component; Performing a fusion operation on any one of the pixels includes: Determine whether the color of the pixel to be processed is the first color; If the color of the pixel to be processed is not the first color, the fusion operation ends; If the color of the pixel to be processed is the first color, determine the reference pixel corresponding to the pixel to be processed, and change the color of the pixel to be processed to the color of the corresponding reference pixel; the reference pixel corresponding to the pixel to be processed is a pixel located in the lower layer of graphic material, and the pixel to be processed and the corresponding reference pixel have the same position in the UI screen.
8. The display driving board according to claim 7, wherein: The MCU is configured as: Acquire the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component; Obtaining the position information of the starting pixel of the lower-layer graphic material in the UI screen; Determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-layer graphic material according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen, the position information of the pixel to be processed in the basic graphic material of the first selected UI component, and the position information of the starting pixel of the lower-layer graphic material in the UI screen; The color information of the reference pixel is obtained according to the position information of the reference pixel in the lower-layer graphic material.
9. The display driving board according to claim 8, wherein: The MCU is configured as: Determine the position information of the pixel to be processed in the UI screen according to the position information of the starting pixel of the basic graphic material of the first selected UI component in the UI screen and the position information of the pixel to be processed in the basic graphic material of the first selected UI component; Use the position information of the pixel to be processed in the UI screen as the position information of the reference pixel corresponding to the pixel to be processed in the UI screen, and determine the position information of the reference pixel corresponding to the pixel to be processed in the lower-level graphic material based on the position information of the reference pixel corresponding to the pixel to be processed in the UI screen and the position information of the starting pixel of the lower-level graphic material in the UI screen.
10. The display driving board according to claim 1, wherein: The MCU is also configured to, in response to a second control instruction, obtain a basic graphic material of at least one second selected UI component from the memory, and generate and store a plurality of candidate graphic materials of the second selected UI component based on the basic graphic material of the second selected UI component, and is configured to select a candidate graphic material of the second selected UI component as a selected graphic material according to the second control instruction, and generate the UI screen according to the selected graphic material.
11. The display driving board according to claim 10, wherein: The second selected UI component is a dynamic effect component that needs to display a plurality of different graphic materials in sequence; The MCU is further configured to repeatedly execute a dynamic loop process; any one of the dynamic loop processes includes sequentially displaying each candidate graphic material of the second selected UI component in different UI screens.
12. The display driving board according to claim 10, wherein: The basic graphic material of the second selected UI component is stored in an independent memory; The MCU is further configured to disconnect the communication between the MCU and the independent memory after acquiring each candidate graphic material of the second selected UI component.
13. The display driving board according to claim 10, wherein: The MCU is provided with a video memory; each candidate graphic material of the second selected UI component is stored in the video memory.
14. The display driving board according to claim 13, wherein: The video memory includes at least one frame buffer and a display layer, and the display layer is used to store the UI screen; The MCU is configured to generate each candidate graphic material of the second selected UI component according to the basic graphic material of the second selected UI component, and store each candidate graphic material of the second selected UI component in the frame buffer; The MCU is further configured to repeatedly execute a dynamic loop process; Any of the loop processes includes determining each candidate graphic material of the second selected UI component as a selected graphic material in turn, and generating a UI screen with the selected graphic material after each determination of the selected graphic material and storing it in the display layer. 15 . The display driving board according to claim 10 , wherein the MCU is further configured to, when the second selected UI component does not need to be displayed, clear each candidate graphic material of the second selected UI component.
16. The display driving board according to claim 10, wherein: The basic graphic material of the second selected UI component includes a first pattern and a second pattern that are complementary to each other, the pixels of the first pattern are pixels of a first color, and the pixels of the second pattern are pixels other than the pixels of the first color; The MCU is further configured to sequentially generate candidate graphic materials of the second selected UI component using a rotation algorithm; Generating any one of the candidate graphic materials of the second selected UI component includes: rotating the second pattern of the basic graphic material of the second selected UI component by a preset angle to generate the second pattern of the candidate graphic material of the second selected UI component, and filling the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located with a first color to form the candidate graphic material of the second selected UI component; wherein the rectangular area where the second pattern of the candidate graphic material of the second selected UI component is located refers to a rectangular area composed of adjacent M1 row pixels * N1 column pixels; M1 and N1 are positive integers.
17. The display driving board according to claim 1, wherein: The MCU is further configured to, in response to the third control instruction, obtain a basic graphic material of at least one third selected UI component from the memory, generate a candidate graphic material of the third selected UI component according to the basic graphic material of the third selected UI component and the third control instruction, and generate a UI screen having the candidate graphic material of the third selected UI component according to the candidate graphic material of the third selected UI component; The third selected UI component is a pointer component.
18. The display driving board according to claim 17, wherein: The MCU is also configured to determine the position information of the candidate graphic material of the third selected UI component based on the relative position of the pointer swing center in the candidate graphic material of the third selected UI component, and based on the target position of the pointer swing center in the UI screen.
19. The display driving board according to claim 17, wherein: The third control instruction includes a pointer parameter, and the pointer component can adjust the pointer angle according to the pointer parameter; the MCU is further configured to: sequentially generate a first UI screen, a second UI screen, and a third UI screen for frame-by-frame display; Generating the first UI screen includes: responding to a first pointer parameter, generating a first candidate graphic material according to the basic graphic material of the third selected UI component, and generating the first UI screen according to the first candidate graphic material; Generating the third UI screen includes: generating a second candidate graphic material according to the basic graphic material of the selected UI component in response to the second pointer parameter, and generating the third UI screen according to the second candidate graphic material; Generating the second UI screen includes: responding to the second pointer parameter, obtaining a mask graphic material, and generating the second UI screen according to the mask graphic material; wherein the mask graphic material includes a complementary first area and a second area; the first area of the mask graphic material is an area where the first candidate graphic material and the second candidate graphic material overlap with each other; the second area of the mask graphic material is an area of the first candidate graphic material that does not overlap with the second candidate graphic material; the color of the pixels of the mask graphic material in the first area is the same as the color of the pixels of the first candidate graphic material at the same position; the color of the pixels of the mask graphic material in the second area is black.
20. The display driving board according to claim 17, wherein: The MCU includes a video memory, the video memory includes at least one frame buffer and a display layer, and the display layer is used to store the UI screen; The MCU is configured to store the basic graphic material of the third selected UI component in the frame buffer, and generate candidate graphic material of the third selected UI component based on the basic graphic material of the third selected UI component located in the frame buffer and write it into the display layer to update the pattern of the selected UI component in the UI screen.
21. The display driving board according to claim 1, wherein: The MCU is further configured to, in response to a fourth control instruction, obtain a basic graphic material of at least one fourth selected UI component from the memory, obtain a candidate graphic material of the fourth selected UI component according to the basic graphic material of the fourth selected UI component, and generate a UI screen having the fourth selected UI component according to the candidate graphic material of the fourth selected UI component; The basic graphic material of the fourth selected UI component includes a first pattern and a second pattern that are complementary to each other, pixels of the first pattern are pixels of a second color, and pixels of the second pattern are pixels other than pixels of the second color; The candidate graphic materials of the fourth selected UI component include complementary third and fourth patterns; the fourth pattern of the candidate graphic materials of the fourth selected UI component has the same shape and different color as the second pattern of the basic graphic material of the fourth selected UI component; the third pattern of the candidate graphic materials of the fourth selected UI component has the same shape and the same color as the first pattern of the basic graphic material of the fourth selected UI component.
22. The display driving board according to claim 21, wherein: The MCU is further configured to sequentially perform a color change operation on each pixel of the basic graphic material of the fourth selected UI component; Performing a color change operation on any one of the pixels includes: Determine whether the color of the pixel to be processed is the second color; If the color of the pixel to be processed is the second color, the color changing operation ends; If the color of the pixel to be processed is not the second color, the color of the pixel to be processed is modified to a third color.
23. The display driving board according to any one of claims 1 to 22, wherein: The memory includes at least one of an independent memory located outside the MCU and an internal memory located inside the MCU.
24. The display driving board according to claim 23, wherein: The MCU is also configured to: Determine the selected UI component according to the control instruction; Determining storage information of a basic graphic material of the selected UI component according to the selected UI component, the storage information including memory information where the basic graphic material is stored and address information in the memory; According to the storage information of the basic graphic material of the selected UI component, the basic graphic material of the selected UI component is read from the corresponding memory.
25. The display driving board according to any one of claims 1 to 22, wherein: The MCU is further configured to determine, according to the control instruction, a UI component that needs to be displayed as a selected UI component.
26. An electronic device comprising the display driver board according to any one of claims 1 to 25, and comprising a display panel and a device mainboard; The device mainboard is used to send control instructions to the display driver board; The display panel is used to display a UI screen under the drive of the display driving board.