Display refreshing method
By implementing partial refresh display on the display end, the problem of low refresh efficiency of existing displays is solved, thereby improving display efficiency and user experience.
Patent Information
- Application Number
- PCT/CN2024/088951
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-19
- Publication Date
- 2025-10-23
AI Technical Summary
Existing displays can only scan line by line based on the full-screen image, resulting in low refresh rate.
By implementing partial refresh display on the display end, only the local content that needs to be updated is refreshed, reducing unnecessary refresh workload and data volume.
It improves display refresh efficiency, reduces unnecessary refresh workload and data volume, and enhances the user experience.
Smart Images

Figure CN2024088951_23102025_PF_FP_ABST
Abstract
Description
Display refresh method TECHNICAL FIELD
[0001] The present application relates to the technical field of display, in particular to a display refresh method. BACKGROUND
[0002] With the popularity of intelligent devices, as an important component for interacting with users, display screens can bring users a smoother operation experience by improving the refresh rate.
[0003] However, the current display screen can only perform line-by-line scanning based on the obtained full-screen image to realize refresh display, and the efficiency of refresh display is low.
[0004] SUMMARY
[0005] The present application provides a display refresh method to solve the problems in the related art.
[0006] According to a first aspect of an embodiment of the present application, a display refresh method is provided, applied to a display end, wherein the display end includes a display area in which an image is displayed; the method comprises:
[0007] obtaining a display instruction;
[0008] in a case where it is determined that local refresh display is needed for the current display area, determining local refresh content and a local refresh position based on the obtained display instruction;
[0009] in a case where no refresh display is currently performed, refreshing and displaying the determined local refresh content to the current display area at the determined local refresh position.
[0010] Optionally, the method further comprises:
[0011] in a case where it is determined that overall refresh display is needed for the current display area, determining overall refresh content based on the obtained display instruction;
[0012] in a case where no refresh display is currently performed, refreshing and displaying the determined overall refresh content to the entire current display area.
[0013] Optionally, the case where overall refresh display is needed for the current display area includes at least one of the following:
[0014] the time length between the current time and the time when the overall display area was last refreshed is greater than a preset period of time;
[0015] the number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number;
[0016] The obtained display instruction includes: overall refresh content.
[0017] Optionally, the case that the display needs to be refreshed locally for the current display area includes at least one of the following:
[0018] The obtained display instruction includes: local refresh content and a local refresh position.
[0019] In a case where it is determined that the current display area as a whole does not need to be refreshed, a display instruction is obtained.
[0020] A display instruction is obtained.
[0021] Optionally, the method further includes:
[0022] In a case where the current display is being refreshed, after waiting for the current refresh display to be completed, the determined local refresh content is refreshed and displayed in the current display area at the determined local refresh position.
[0023] Optionally, the method further includes: pre-storing an image frame currently displayed.
[0024] After determining the local refresh content and the local refresh position based on the obtained display instruction, the method further includes: based on a local starting content of the local refresh position in the stored image frame, performing frame interpolation processing on the determined local refresh content to obtain at least one local frame interpolation content.
[0025] The determined local refresh content is refreshed and displayed in the current display area at the determined local refresh position.
[0026] The obtained local frame interpolation content and the determined local refresh content are sequentially refreshed and displayed in the current display area at the determined local refresh position.
[0027] Optionally, the display end includes pixel-level driving; and the determined local refresh content is refreshed and displayed in the current display area at the determined local refresh position.
[0028] Based on the pixel-level driving, the determined local refresh content is refreshed and displayed in the current display area at a pixel point located at the determined local refresh position.
[0029] Optionally, the display area includes a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; and in a case where the corresponding row switch signal and the corresponding column switch signal are turned on, the corresponding pixel point is used for refresh display.
[0030] The determined partial refresh content is refreshed and displayed into the current display area, and the determined partial refresh position comprises:
[0031] In the current display area, for the pixel point located at the determined partial refresh position, the corresponding row switch signal and the corresponding column switch signal are adjusted to a signal representing opening;
[0032] The determined partial refresh content is refreshed and displayed into the current display area, and the pixel point located at the determined partial refresh position.
[0033] Optionally, the obtained display instruction comprises an overall refresh content; the method further comprises: pre-storing a currently displayed image frame;
[0034] The method further comprises:
[0035] For the overall refresh content in the obtained display instruction, a difference part is determined with the stored image frame; based on the determined difference part, the partial refresh content and the partial refresh position are determined.
[0036] Optionally, the case requiring partial refresh comprises: obtaining a display instruction in a case where it is determined that the current display area as a whole does not need to be refreshed;
[0037] The method further comprises:
[0038] In a case where it is determined that the current display area as a whole needs to be refreshed, the overall refresh content contained in the obtained display instruction is determined;
[0039] In a case where the current display area as a whole does not need to be refreshed, the determined overall refresh content is refreshed and displayed into the current display area as a whole.
[0040] Optionally, the display end is connected with a control end;
[0041] The display instruction is obtained by: obtaining a display instruction sent by the control end;
[0042] The display instruction sent by the control end comprises any one of the following:
[0043] Overall refresh content;
[0044] Partial refresh content and partial refresh position.
[0045] Optionally, the control end is configured to: send a display instruction in a case where it is determined that the current display of the display end has not been performed.
[0046] Optionally, the determining that the display terminal is not currently performing refresh display comprises at least one of the following:
[0047] The control terminal determines, based on the amount of image data last transmitted, that the display terminal has completed refresh display of the image last transmitted at the current time.
[0048] The control terminal receives an idle signal transmitted by the display terminal; the idle signal is used to represent that the display terminal is not currently performing refresh display.
[0049] Optionally, the idle signal is in any one of the following forms: high level, low level, and pulse signal.
[0050] Optionally, the control terminal is configured to:
[0051] determine whether the display terminal is currently performing refresh display when it is necessary to transmit a display instruction;
[0052] transmit the display instruction when it is determined that the display terminal is not currently performing refresh display.
[0053] wait until the display terminal completes refresh display, and then transmit the display instruction, when it is determined that the display terminal is currently performing refresh display.
[0054] Optionally, the determining that the display terminal is currently performing refresh display comprises at least one of the following:
[0055] The control terminal determines, based on the amount of image data last transmitted, that the display terminal has not completed refresh display of the image last transmitted at the current time.
[0056] The control terminal receives a busy signal transmitted by the display terminal; the busy signal is used to represent that the display terminal is currently performing refresh display.
[0057] Optionally, the need to perform partial refresh comprises that the display instruction obtained includes partial refresh content and a partial refresh location.
[0058] The determining, based on the display instruction obtained, of the partial refresh content and the partial refresh location comprises:
[0059] determining the partial refresh content and the partial refresh location included in the display instruction obtained.
[0060] Optionally, the method further comprises:
[0061] determining the full refresh content in the display instruction obtained when it is determined that the display instruction obtained includes full refresh content.
[0062] display the determined overall refresh content to the current display region as a whole in a case that no refresh display is currently being performed.
[0063] Optionally, the method further comprises: in a case that it is determined that the current display region as a whole needs to be refreshed, sending an overall refresh trigger signal to the control terminal;
[0064] The display instruction comprises:
[0065] The display instruction comprises:
[0066] Optionally, the case that the current display region as a whole needs to be refreshed comprises at least one of the following:
[0067] The time length between the current time and the time when the display region as a whole was last refreshed is greater than a preset periodic time length;
[0068] It is detected that there are pixel points in the display region that have not been refreshed for a preset detection time length.
[0069] Optionally, the control terminal is configured to:
[0070] determine the maximum length of a data packet received by the display terminal;
[0071] determine a display instruction comprising local refresh content and a local refresh position;
[0072] split the local refresh content and the local refresh position in the determined display instruction into at least one group of corresponding relationships between refresh content and refresh positions, and generate data packets based on each of the corresponding relationships obtained by the splitting; the length of each of the generated data packets is not greater than the determined maximum length of a data packet;
[0073] send the generated data packets to the display terminal, so that the display terminal obtains the determined display instruction.
[0074] According to a second aspect of an embodiment of the present application, another display refresh method is provided, and a display terminal comprises a display region in which an image is displayed; the method comprises:
[0075] a control terminal sends a display instruction to the display terminal;
[0076] the display terminal obtains the display instruction sent by the control terminal; in a case that it is determined that the current display region needs to be refreshed locally, the display terminal determines local refresh content and a local refresh position based on the obtained display instruction; and in a case that no refresh display is currently being performed, the display terminal displays the determined local refresh content to the current display region at the determined local refresh position.
[0077] Optionally, the method further comprises:
[0078] In a case where it is determined that the current display area as a whole needs to be refreshed and displayed, the display terminal determines the overall refresh content based on the obtained display instruction; and in a case where the current display area as a whole does not need to be refreshed and displayed, the determined overall refresh content is refreshed and displayed to the current display area as a whole.
[0079] Optionally, the case where the current display area as a whole needs to be refreshed and displayed comprises at least one of the following:
[0080] A time length between the current time and a time when the display area as a whole was last refreshed is greater than a preset periodic time length;
[0081] It is detected that a number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number;
[0082] The obtained display instruction comprises the overall refresh content.
[0083] Optionally, the case where the current display area as a whole does not need to be refreshed and displayed comprises at least one of the following:
[0084] The obtained display instruction comprises the local refresh content and the local refresh position.
[0085] In a case where it is determined that the current display area as a whole does not need to be refreshed and displayed, the display terminal obtains the display instruction.
[0086] The display instruction is obtained.
[0087] Optionally, the method further comprises:
[0088] In a case where the current display area is being refreshed and displayed, the display terminal waits until the current refresh and display are completed, and then refreshes and displays the determined local refresh content to the current display area at the determined local refresh position.
[0089] Optionally, the method further comprises that the display terminal pre-stores an image frame that is currently displayed.
[0090] After the local refresh content and the local refresh position are determined based on the obtained display instruction, the method further comprises that the display terminal performs frame interpolation processing on local start content at the local refresh position in the stored image frame and the determined local refresh content, to obtain at least one local frame-interpolated content.
[0091] The refreshing and displaying of the determined local refresh content to the current display area at the determined local refresh position comprises:
[0092] The display end displays the obtained partial frame content and the determined partial refresh content in the current display region in sequence, and the determined partial refresh position.
[0093] Optionally, the display end comprises pixel-level driving; and the displaying the determined partial refresh content in the current display region in the determined partial refresh position comprises:
[0094] The display end displays the determined partial refresh content in the current display region in the determined partial refresh position based on the pixel-level driving.
[0095] Optionally, the display region comprises a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; and the corresponding pixel point is used for refresh display when the corresponding row switch signal and the corresponding column switch signal represent opening.
[0096] The displaying the determined partial refresh content in the current display region in the determined partial refresh position comprises:
[0097] In the current display region, the corresponding row switch signal and the corresponding column switch signal of the pixel point in the determined partial refresh position are adjusted to signals representing opening.
[0098] The determined partial refresh content is displayed in the current display region in the pixel point in the determined partial refresh position.
[0099] Optionally, the obtained display instruction comprises overall refresh content; and the method further comprises: the display end pre-stores a currently displayed image frame.
[0100] The determining the partial refresh content and the partial refresh position based on the obtained display instruction comprises:
[0101] The display end determines a difference part for the overall refresh content in the obtained display instruction and the stored image frame, and determines the partial refresh content and the partial refresh position based on the determined difference part.
[0102] Optionally, the case requiring partial refresh comprises: obtaining a display instruction in a case where it is determined that the current display region as a whole does not need to be refreshed.
[0103] The method further comprises:
[0104] The display end determines overall refresh content contained in the obtained display instruction in a case where it is determined that the current display region as a whole needs to be refreshed, and displays the determined overall refresh content to the current display region as a whole in a case where no refresh display is currently performed.
[0105] Optionally, the display instruction sent by the control terminal comprises any one of the following:
[0106] entire content refreshing;
[0107] partial content refreshing and partial refreshing position.
[0108] Optionally, the control terminal sends the display instruction when it is determined that the display terminal is not currently performing refreshing display.
[0109] Optionally, the determination that the display terminal is not currently performing refreshing display comprises at least one of the following:
[0110] the control terminal determines, based on the amount of image data sent last time, that the display terminal has completed refreshing display of the image sent last time at the current time;
[0111] the control terminal receives an idle signal sent by the display terminal; the idle signal is used to represent that the display terminal is not currently performing refreshing display.
[0112] Optionally, the idle signal is in any one of the following forms: high level, low level, and pulse signal.
[0113] Optionally, when the control terminal needs to send a display instruction, it judges whether the display terminal is currently performing refreshing display; when it is determined that the display terminal is not currently performing refreshing display, it sends the display instruction; when it is determined that the display terminal is currently performing refreshing display, it waits until the display terminal completes refreshing display, and then sends the display instruction.
[0114] Optionally, the determination that the display terminal is currently performing refreshing display comprises at least one of the following:
[0115] the control terminal determines, based on the amount of image data sent last time, that the display terminal has not completed refreshing display of the image sent last time at the current time;
[0116] the control terminal receives a busy signal sent by the display terminal; the busy signal is used to represent that the display terminal is currently performing refreshing display.
[0117] Optionally, the need for partial refreshing comprises that the obtained display instruction comprises partial refreshing content and partial refreshing position.
[0118] the determination of the partial refreshing content and the partial refreshing position based on the obtained display instruction comprises:
[0119] the display terminal determines the partial refreshing content and the partial refreshing position contained in the obtained display instruction.
[0120] Optionally, the method further comprises:
[0121] The display end determines the overall refresh content in the obtained display instruction, and displays the determined overall refresh content to the current display region as a whole in a case where the current display region is not being refreshed.
[0122] Optionally, the method further comprises: in a case where it is determined that the current display region as a whole needs to be refreshed, the display end sends an overall refresh trigger signal to the control end.
[0123] The display instruction comprises:
[0124] The display end obtains the display instruction sent by the control end and containing overall refresh content based on the received overall refresh trigger signal.
[0125] Optionally, the case where the current display region as a whole needs to be refreshed comprises at least one of the following:
[0126] The time length between the current time and the time when the display region as a whole was last refreshed is greater than a preset period length.
[0127] It is detected that there are pixel points in the display region that have not been refreshed for a preset detection time length.
[0128] Optionally, the control end determines a maximum length of a data packet, determines a display instruction containing local refresh content and a local refresh position, splits the local refresh content and the local refresh position in the determined display instruction into at least one corresponding relationship between refresh content and a refresh position, generates data packets based on each corresponding relationship obtained by the splitting, the length of each generated data packet is not greater than the determined maximum length of the data packet, and sends the generated data packets to the display end, so that the display end obtains the determined display instruction.
[0129] According to a third aspect of an embodiment of the present application, a display refreshing apparatus is provided, which is applied to a display end and comprises a display region in which an image is displayed, and the apparatus comprises:
[0130] An obtaining unit, configured to obtain a display instruction.
[0131] A local unit, configured to, in a case where it is determined that the current display region needs to be refreshed locally, determine local refresh content and a local refresh position based on the obtained display instruction, and display the determined local refresh content to the current display region and the determined local refresh position in a case where the current display region is not being refreshed.
[0132] Optionally, the apparatus further comprises:
[0133] a whole unit, configured to, in a case where it is determined that refresh display is needed for a whole of a current display region, determine whole refresh content based on the obtained display instruction; and in a case where refresh display is not currently being performed, refresh display the determined whole refresh content to the whole of the current display region.
[0134] Optionally, the case where refresh display is needed for the whole of the current display region comprises at least one of the following:
[0135] a time length between a current time and a time when the whole of the display region was last refreshed is greater than a preset periodic time length;
[0136] a number of pixel points in the display region that have not been refreshed for a preset detection time length is greater than a preset number is detected;
[0137] the obtained display instruction comprises the whole refresh content.
[0138] Optionally, the case where refresh display is needed for a part of the current display region comprises at least one of the following:
[0139] the obtained display instruction comprises the partial refresh content and the partial refresh position.
[0140] in a case where it is determined that the whole of the current display region does not need to be refreshed, the display instruction is obtained;
[0141] the display instruction is obtained.
[0142] Optionally, the partial unit is further configured to:
[0143] in a case where refresh display is currently being performed, wait until the current refresh display is completed, and then refresh display the determined partial refresh content to the current display region at the determined partial refresh position.
[0144] Optionally, the apparatus further comprises a frame filling unit, configured to: pre-store an image frame that is currently being displayed; after determining the partial refresh content and the partial refresh position based on the obtained display instruction, perform frame filling processing on partial starting content at the partial refresh position in the stored image frame and the determined partial refresh content, to obtain at least one partial frame filling content; and refresh display the obtained partial frame filling content and the determined partial refresh content to the current display region at the determined partial refresh position.
[0145] Optionally, the display terminal comprises pixel-level driving; and the partial unit is configured to:
[0146] Based on the pixel-level driving, the determined local refresh content is refreshed and displayed in the current display area at the pixel points located at the determined local refresh position.
[0147] Optionally, the display area includes a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; in a case where the corresponding row switch signal and the corresponding column switch signal represent opening, the corresponding pixel point is used for refresh display.
[0148] The local unit is used for:
[0149] In the current display area, for the pixel points located at the determined local refresh position, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing opening.
[0150] The determined local refresh content is refreshed and displayed in the current display area at the pixel points located at the determined local refresh position.
[0151] Optionally, the obtained display instruction includes overall refresh content; the local unit is further used for: pre-storing a currently displayed image frame; determining a difference part for the overall refresh content in the obtained display instruction and the stored image frame; determining the local refresh content and the local refresh position based on the determined difference part.
[0152] Optionally, the case where local refresh is needed includes: obtaining a display instruction in a case where it is determined that the current display area as a whole does not need to be refreshed.
[0153] The device further includes an overall unit, configured to: in a case where it is determined that the current display area as a whole needs to be refreshed, determine overall refresh content included in the obtained display instruction; and in a case where the current display is not being refreshed, refresh and display the determined overall refresh content to the current display area as a whole.
[0154] Optionally, the display end is connected with a control end.
[0155] The obtaining unit is configured to: obtain a display instruction sent by the control end.
[0156] The display instruction sent by the control end includes any of the following:
[0157] Overall refresh content;
[0158] Local refresh content and a local refresh position.
[0159] Optionally, the control end is configured to: in a case where it is determined that the current display of the display end is not being refreshed, send a display instruction.
[0160] Optionally, the determining that the display terminal is not currently performing refresh display comprises at least one of the following:
[0161] The control terminal determines, based on the amount of image data last transmitted, that the display terminal has completed refresh display of the image last transmitted at the current time.
[0162] The control terminal receives an idle signal transmitted by the display terminal; the idle signal is used to represent that the display terminal is not currently performing refresh display.
[0163] Optionally, the idle signal is in any one of the following forms: high level, low level, and pulse signal.
[0164] Optionally, the control terminal is configured to:
[0165] determine whether the display terminal is currently performing refresh display in a case where display instructions need to be transmitted;
[0166] transmit display instructions in a case where it is determined that the display terminal is not currently performing refresh display;
[0167] transmit display instructions after the display terminal completes refresh display in a case where it is determined that the display terminal is currently performing refresh display.
[0168] Optionally, the determining that the display terminal is currently performing refresh display comprises at least one of the following:
[0169] The control terminal determines, based on the amount of image data last transmitted, that the display terminal has not completed refresh display of the image last transmitted at the current time.
[0170] The control terminal receives a busy signal transmitted by the display terminal; the busy signal is used to represent that the display terminal is currently performing refresh display.
[0171] Optionally, the case where partial refresh needs to be performed comprises that the display instructions obtained include partial refresh content and a partial refresh location.
[0172] The partial unit is configured to:
[0173] determine the partial refresh content and the partial refresh location included in the display instructions obtained.
[0174] Optionally, the apparatus further comprises an overall unit configured to:
[0175] determine overall refresh content in the display instructions obtained in a case where the display instructions obtained include overall refresh content.
[0176] display the determined overall refresh content to the current display region as a whole in a case where it is determined that the current display region as a whole needs to be refreshed.
[0177] Optionally, the overall unit is further configured to: in a case where it is determined that the current display region as a whole needs to be refreshed, send an overall refresh trigger signal to the control terminal.
[0178] The obtaining unit is configured to:
[0179] obtain the display instruction containing the overall refresh content sent by the control terminal based on the received overall refresh trigger signal.
[0180] Optionally, the case where the current display region as a whole needs to be refreshed includes at least one of the following:
[0181] a time length between a current time and a time when the display region as a whole was last refreshed is greater than a preset periodic time length;
[0182] detecting that there are pixel points in the display region that have not been refreshed for a preset detection time length.
[0183] Optionally, the control terminal is configured to:
[0184] determine a maximum length of a data packet received by the display terminal;
[0185] determine a display instruction containing local refresh content and a local refresh position;
[0186] split the local refresh content and the local refresh position in the determined display instruction into at least one corresponding relationship between refresh content and a refresh position, and generate data packets based on each corresponding relationship obtained by the splitting; the length of each generated data packet is not greater than the determined maximum length of the data packet;
[0187] send the generated data packets to the display terminal, so that the display terminal obtains the determined display instruction.
[0188] According to a fourth aspect of an embodiment of the present application, a display refresh system is provided, and the system includes: a display terminal and a control terminal; the display terminal includes a display region in which an image is displayed;
[0189] The control terminal is configured to: send a display instruction to the display terminal;
[0190] The display terminal is configured to: obtain the display instruction sent by the control terminal; in a case where it is determined that the current display region needs to be refreshed locally, determine local refresh content and a local refresh position based on the obtained display instruction; and in a case where no refresh display is currently being performed, display the determined local refresh content to the current display region at the determined local refresh position.
[0191] Optionally, the display terminal is configured to:
[0192] In a case where it is determined that the current display region as a whole needs to be refreshed, based on the obtained display instruction, determining the overall refresh content;
[0193] In a case where the current display region as a whole does not need to be refreshed, obtaining the display instruction.
[0194] Optionally, the case where the current display region as a whole needs to be refreshed comprises at least one of the following:
[0195] A time length between a current time and a time when the last refresh of the display region as a whole is performed is greater than a preset periodic time length;
[0196] It is detected that a number of pixel points in the display region that have not been refreshed for a preset detection time length is greater than a preset number;
[0197] The obtained display instruction comprises the overall refresh content.
[0198] Optionally, the case where the current display region as a whole does not need to be refreshed comprises at least one of the following:
[0199] The obtained display instruction comprises the local refresh content and the local refresh position.
[0200] In a case where it is determined that the current display region as a whole does not need to be refreshed, obtaining the display instruction.
[0201] Obtaining the display instruction.
[0202] Optionally, the display terminal is configured to:
[0203] In a case where the current display region as a whole needs to be refreshed, waiting for the current refresh to be completed, and then refreshing the determined local refresh content to the current display region at the determined local refresh position.
[0204] Optionally, the display terminal is configured to:
[0205] After determining the local refresh content and the local refresh position based on the obtained display instruction, performing frame interpolation processing on a local starting content at the local refresh position in the stored image frame and the determined local refresh content to obtain at least one local frame-interpolated content.
[0206] In a case where the current display region as a whole needs to be refreshed, waiting for the current refresh to be completed, and then refreshing the determined local refresh content to the current display region at the determined local refresh position.
[0207] Optionally, the display end comprises pixel-level driving; and the display end is configured to:
[0208] Based on the pixel-level driving, the determined local refresh content is refreshed and displayed in the current display region at the pixel points located at the determined local refresh position.
[0209] Optionally, the display region comprises a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; and in a case where the corresponding row switch signal and the corresponding column switch signal represent opening, the corresponding pixel point is configured to refresh and display.
[0210] The display end is configured to:
[0211] In the current display region, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing opening for the pixel points located at the determined local refresh position.
[0212] The determined local refresh content is refreshed and displayed in the current display region at the pixel points located at the determined local refresh position.
[0213] Optionally, the obtained display instruction comprises overall refresh content; and the display end is further configured to: pre-store a current displayed image frame.
[0214] For the overall refresh content in the obtained display instruction, a difference part is determined with the stored image frame; based on the determined difference part, a local refresh content and a local refresh position are determined.
[0215] Optionally, the case where local refresh is required comprises: obtaining a display instruction in a case where it is determined that the current display region as a whole does not need to be refreshed.
[0216] The display end is further configured to: in a case where it is determined that the current display region as a whole needs to be refreshed, determine overall refresh content contained in the obtained display instruction; and in a case where the current display is not being refreshed, refresh and display the determined overall refresh content to the current display region as a whole.
[0217] Optionally, the display end is connected with a control end.
[0218] The display end is configured to: obtain a display instruction sent by the control end.
[0219] The display instruction sent by the control end comprises any of the following:
[0220] Overall refresh content;
[0221] Local refresh content and a local refresh position.
[0222] Optionally, the control terminal is configured to: send the display instruction when it is determined that the display terminal is not currently performing refresh display.
[0223] Optionally, the determination that the display terminal is not currently performing refresh display comprises at least one of:
[0224] The control terminal determines, based on the amount of image data sent last time, that the display terminal has completed refresh display of the image sent last time at the current time.
[0225] The control terminal receives an idle signal sent by the display terminal; the idle signal is used to represent that the display terminal is not currently performing refresh display.
[0226] Optionally, the idle signal is in any one of the following forms: high level, low level, and pulse signal.
[0227] Optionally, the control terminal is configured to:
[0228] determine whether the display terminal is currently performing refresh display when it is necessary to send the display instruction;
[0229] send the display instruction when it is determined that the display terminal is not currently performing refresh display;
[0230] send the display instruction after the display terminal completes refresh display when it is determined that the display terminal is currently performing refresh display.
[0231] Optionally, the determination that the display terminal is currently performing refresh display comprises at least one of:
[0232] The control terminal determines, based on the amount of image data sent last time, that the display terminal has not completed refresh display of the image sent last time at the current time.
[0233] The control terminal receives a busy signal sent by the display terminal; the busy signal is used to represent that the display terminal is currently performing refresh display.
[0234] Optionally, the need to perform partial refresh comprises that the obtained display instruction comprises partial refresh content and partial refresh position.
[0235] The display terminal is configured to:
[0236] determine the partial refresh content and the partial refresh position comprised in the obtained display instruction.
[0237] Optionally, the display terminal is further configured to:
[0238] In a case where it is determined that the obtained display instruction includes overall refresh content, determining the overall refresh content in the obtained display instruction;
[0239] In a case where it is determined that the obtained display instruction includes overall refresh content, determining the overall refresh content in the obtained display instruction;
[0240] Optionally, the display terminal is further configured to: in a case where it is determined that the current display region needs to be refreshed as a whole, send an overall refresh trigger signal to the control terminal;
[0241] Optionally, the display terminal is further configured to: in a case where it is determined that the current display region needs to be refreshed as a whole, send an overall refresh trigger signal to the control terminal;
[0242] Optionally, the case where the current display region needs to be refreshed as a whole includes at least one of the following:
[0243] A time length between a current time and a time when the display region was last refreshed as a whole is greater than a preset periodic time length;
[0244] It is detected that there are pixel points in the display region that have not been refreshed for a preset detection time length.
[0245] Optionally, the control terminal is configured to:
[0246] determine a maximum length of a data packet received by the display terminal;
[0247] determine a display instruction including partial refresh content and a partial refresh position;
[0248] split the partial refresh content and the partial refresh position in the determined display instruction into at least one corresponding relationship between refresh content and a refresh position, and generate data packets based on each corresponding relationship obtained by the splitting; the length of each generated data packet is not greater than the determined maximum length of the data packet;
[0249] send the generated data packets to the display terminal, so that the display terminal obtains the determined display instruction.
[0250] According to the above embodiments, the display terminal refreshes the display region locally, reduces the amount of data that needs to be refreshed, and can further improve the efficiency of refresh display.
[0251] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS
[0252] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present application and, together with the specification, serve to explain the principles of the present application.
[0253] Fig. 1 is a flow diagram illustrating a display refreshing method according to an embodiment of the present application;
[0254] Fig. 2 is a structural diagram illustrating a pixel in a display area according to an embodiment of the present application;
[0255] Fig. 3 is a flow diagram illustrating another display refreshing method according to an embodiment of the present application;
[0256] Fig. 4 is a diagram illustrating an interaction mechanism between a display screen and a system according to an embodiment of the present application;
[0257] Fig. 5 is a diagram illustrating a principle of an interaction flow between a display screen and a system according to an embodiment of the present application;
[0258] Fig. 6 is a diagram illustrating a principle of another interaction flow between a display screen and a system according to an embodiment of the present application;
[0259] Fig. 7 is a diagram illustrating a principle of another interaction flow between a display screen and a system according to an embodiment of the present application;
[0260] Fig. 8 is a diagram illustrating a principle of another interaction flow between a display screen and a system according to an embodiment of the present application;
[0261] Fig. 9 is a diagram illustrating a principle of a display screen feature signal according to an embodiment of the present application;
[0262] Fig. 10 is a diagram illustrating a principle of an interaction mechanism between a display screen and a system according to an embodiment of the present application;
[0263] Fig. 11 is a diagram illustrating a principle of another interaction mechanism between a display screen and a system according to an embodiment of the present application;
[0264] Fig. 12 is a diagram illustrating a principle of an interaction data packet between a display screen and a system according to an embodiment of the present application;
[0265] Fig. 13 is a diagram illustrating a principle of a data packet interaction according to an embodiment of the present application;
[0266] Fig. 14 is a diagram illustrating a principle of another data packet interaction according to an embodiment of the present application;
[0267] Fig. 15 is a structural diagram illustrating a pixel-level intelligent driving architecture according to an embodiment of the present application;
[0268] Fig. 16 is a structural diagram illustrating another pixel-level intelligent driving architecture according to an embodiment of the present application;
[0269] Fig. 17 is a structural diagram illustrating another pixel-level intelligent driving architecture according to an embodiment of the present application;
[0270] Fig. 18 is a structural schematic diagram of a display refreshing device according to an embodiment of the present application;
[0271] Fig. 19 is a structural schematic diagram of a display refreshing system according to an embodiment of the present application;
[0272] Fig. 20 is a hardware structural schematic diagram of a computer device configured by the method according to an embodiment of the present application. DETAILED DESCRIPTION
[0273] The exemplary embodiments will be described in detail herein with reference to the attached drawings. The following description is only exemplary and is not intended to represent all aspects in accordance with the present application. Rather, the following description is intended only to represent some aspects in accordance with the present application, as detailed in the appended claims.
[0274] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of the relevant data need to comply with the relevant laws, regulations and standards of the country and region, and provide corresponding operation portal for the user to choose authorization or refusal.
[0275] With the popularity of smart devices, the display screen as an important component for interaction with the user can bring a more smooth operation experience to the user by improving the refresh rate.
[0276] However, the current display screen can only perform line-by-line scanning based on the obtained full-screen image to realize refreshing display, and the efficiency of refreshing display is low.
[0277] The embodiments of the present application disclose a display refreshing method.
[0278] In the present method, the display end can be improved, and the display end can be a device or terminal with display function, for example, a display or a device with a display screen, so that the display end has the ability to support local refreshing display and provides the function of local refreshing display.
[0279] Specifically, only the local content that needs to be updated can be refreshed for the display area of the display end.
[0280] For example, for the display of a video, there can be more content that is completely the same between adjacent video frames and needs no update, and only a small amount of different content needs to be updated. Therefore, only the different content needs to be updated for the display area of the display end, and no full-screen refresh is needed. For any pixel point in the display area, if no update is needed during the display of adjacent video frames, the pixel point does not need to be refreshed using the method, which can reduce the workload and data volume of refresh display and improve the efficiency of refresh display compared with the full-screen refresh method.
[0281] For example, for a display screen, a pop-up window notification display can be needed at any time, and the originally displayed content does not need to be updated. Therefore, only the content of the window needs to be updated for the display area of the display end, and no full-screen refresh is needed, which can reduce the workload and data volume of refresh display and improve the efficiency of refresh display.
[0282] As can be seen, in the method, because the display end is used for local refresh display to provide the function of local refresh display, the data volume of refresh display is reduced, and the efficiency of refresh display can be further improved.
[0283] For example, full-screen scanning refresh is needed originally, and all pixel points need to be refreshed each time refresh display is performed. If the display end supports local refresh, a plurality of rows in the display area can be refreshed to complete one refresh display, and the efficiency of refresh display is improved.
[0284] In addition, to facilitate the improvement of the efficiency and accuracy of refresh display, the display end can support pixel-level local refresh, that is, the refresh display of a single pixel point can be supported. Details can be seen in the following explanation.
[0285] In addition, the display end can also actively initiate a request. Specifically, the display end can actively initiate a request for refresh display according to its own needs. Because the display end can more conveniently analyze and determine its own situation, the display end can more quickly and conveniently perform refresh display. Details can be seen in the following explanation.
[0286] The following explains a display refresh method provided by the embodiment of the application in detail.
[0287] As shown in FIG. 1, FIG. 1 is a flowchart of a display refresh method according to the embodiment of the application.
[0288] The method can be applied to a display end.
[0289] The embodiment of the application does not limit the specific form of the display end. Alternatively, the display end can be a device or terminal with a display function, or a device or terminal including a display screen.
[0290] The display end can be a display that can be connected to other devices for display. The display end can also be a display component that is assembled with other components into a device, such as a mobile device, a mobile phone, a smart bracelet, an AR device, a VR device, a computer, a tablet computer, and the like.
[0291] It should be noted that the display end in the method flow can be any product or component with display function, such as electronic paper, mobile phone, tablet computer, television, notebook computer, digital photo frame, navigation device, and the like.
[0292] The display end can include a display area displaying an image. The display end can currently display an image frame, so that partial content update can be performed based on the displayed image frame, and local refresh display can be facilitated.
[0293] The method can include the following steps.
[0294] S101: Obtain a display instruction.
[0295] S102: In a case where it is determined that local refresh display needs to be performed for the current display area, determine local refresh content and a local refresh position based on the obtained display instruction.
[0296] S103: In a case where the current display area is not currently being refreshed, refresh and display the determined local refresh content at the determined local refresh position.
[0297] The method flow described above can refresh and display the display area of the display end locally, thereby reducing the amount of data that needs to be refreshed and displayed, and further improving the efficiency of refresh display.
[0298] In the method flow described above, the refresh display can be performed on the display area of the display end to display an image. For example, the display screen pixels of the display end can be refreshed to display specific display values (color or brightness, and the like).
[0299] The case where the current display area of the display end is not currently being refreshed can be a case where the display area of the display end is continuously displaying an image without being refreshed. For example, the display area pixels of the display end are not currently being refreshed.
[0300] For ease of understanding, the refresh rate of the display end can represent the number of times the display end is refreshed and displayed within 1 second. There can be a time period without refresh between adjacent two refresh displays. After the last refresh display is completed, the display end can maintain image display until the next refresh display is started. The case where the image display is maintained can be regarded as the case where the refresh display is not performed.
[0301] The display region can be a region of a component for display that is actually used for display. The component for display is not limited, and can specifically be a display screen or a pixel array, and the display region can be a region of the display screen or the pixel array that is used for display.
[0302] Regarding the display region, several examples are provided for the convenience of understanding.
[0303] There are various styles of display screens at present, which adapt to different actual needs. For example, a spliced screen can splice multiple display screens according to needs, and can select all or part of the display screens to display according to a control instruction; a folding screen can display a single screen or all screens according to a folding condition.
[0304] It can be seen that the display screen can display part or all of the display screen, that is, full-screen display or local display.
[0305] Therefore, the display region can be a region of a component for display that is actually used for display, and can specifically be a full-screen region of the display component or a local region of the display component.
[0306] The current display region of the display end can be a display region of the display end that is currently used for display.
[0307] For example, the display component in the display end can be a folding screen, and in a folding condition, only part of the screen of the folding screen displays an image, and the current display region of the display end is the part of the screen that currently displays the image.
[0308] For another example, the display component in the display end can be a spliced screen of 10 screens, and can specifically be a spliced screen on a stage. According to a control instruction, 4 screens currently display images, and the other 6 screens currently do not display images, and the current display region of the display end can be the 4 screens that currently display the images.
[0309] Further, the refreshing display can be refreshing display of the display region, which can be refreshing display of a local part of the display region or refreshing display of the entire display region.
[0310] The local refreshing display can be refreshing display of a local part of the display region, and the corresponding whole refreshing display can be refreshing display of the entire display region.
[0311] In a specific example, when the display region is a full-screen region of the display component of the display end, the whole refreshing display can include full-screen refreshing display of the display component.
[0312] The method flow above explains that the display end can support local refreshing display, and in an optional embodiment, the display end can continuously perform local refreshing display.
[0313] Specifically, the display terminal can continuously determine that local refresh display is needed during the display process, so that the local refresh display can be performed multiple times, thereby improving the efficiency of the refresh display.
[0314] The display terminal can obtain the updated local image content, or the display terminal itself can determine the updated local image content, thereby performing local refresh display.
[0315] For example, in the scenario where the external device sends continuous video frames to the display terminal for display, the external device can directly send the local video frame that needs to be updated. Specifically, the local video frame can be a plurality of pixel points scattered in different positions, or pixel points in a local region. The display terminal can use the received local video frame as a display instruction, or determine the local refresh content and perform local refresh display, thereby displaying the continuous video frames.
[0316] For example, in the scenario where the external device sends continuous video frames to the display terminal for display, the external device can directly send the complete continuous video frames, and the display terminal itself can determine the difference content between adjacent video frames, determine the local video frame that needs to be updated, and further perform local refresh display.
[0317] The external device can be a device or component for providing image content to the display terminal for display. The external device and the display terminal can belong to the same device.
[0318] In another optional embodiment, the display terminal can also support global refresh display, that is, the current display region can be refreshed and displayed as a whole.
[0319] Therefore, the display terminal can perform global refresh display when global refresh display is needed.
[0320] Specifically, if there is no pixel point with the same position and the same display information between the image to be displayed and the currently displayed image, global refresh display can be performed.
[0321] In addition, due to the material limitation of the display component, the pixel point can malfunction, such as brightness reduction, electrical leakage, etc., after a long time without refresh. Therefore, global refresh display can reduce the risk of pixel point malfunction.
[0322] In this embodiment, the display terminal can support local refresh display and global refresh display, so that the display terminal can select the refresh display mode according to the actual needs, thereby improving the flexibility of the refresh display and facilitating adaptation to more needs.
[0323] In an optional embodiment, the display terminal can have two states, one being currently refreshing the display, and the other being not currently refreshing the display.
[0324] Optionally, the display terminal currently refreshing the display can mean that the display terminal is currently refreshing the display area, and is in the process of refreshing the display. The display terminal not currently refreshing the display can mean that the display terminal is not currently refreshing the display area, and can specifically mean that the display terminal has completed the previous refreshing of the display and has not yet started the next refreshing of the display.
[0325] In a specific example, the display terminal can be refreshing the full screen at a refresh rate of 10 Hz, that is, the display terminal needs to refresh the full screen once in 1 / 10 second. Within 1 / 10 second, the full screen refreshing can be completed within 1 / 60 second, and the remaining time can be regarded as not currently refreshing the display.
[0326] In another specific example, the display terminal can refresh at a non-fixed refresh rate. After each refreshing is completed, the display terminal can be regarded as not currently refreshing the display until the display terminal starts the next refreshing of the display.
[0327] Optionally, in order to reduce the conflict of refreshing the display, the next refreshing of the display can be started only after the previous refreshing of the display is completed, that is, the next refreshing of the display needs to be performed when the display terminal is not currently refreshing the display.
[0328] The embodiment is not limited to the subject judging the state of the display terminal. Optionally, the state of the display terminal can be judged by an external device or by the display terminal itself.
[0329] The display terminal itself judging the state of the display terminal can improve the accuracy and precision of judging the state of the display terminal.
[0330] The display terminal itself can specifically determine whether the display terminal is currently refreshing the display or not currently refreshing the display.
[0331] The embodiment is not limited to the specific judging manner of the state of the display terminal.
[0332] Optionally, the display component in the display terminal can feed back the current refreshing of the display. For example, the pixel array can generate a signal indicating that the current refreshing of the display is completed after the refreshing of the display is completed, so as to facilitate the display terminal to determine that the current refreshing of the display is completed and that the display terminal is not currently refreshing the display. The pixel array can also generate a signal indicating that the current refreshing of the display is being performed when the refreshing of the display is started, so as to facilitate the display terminal to determine that the current refreshing of the display is being performed.
[0333] Optionally, the display terminal can also determine the time length required for refreshing display according to the time length required for refreshing display.
[0334] Specifically, the display terminal can determine the time length required for refreshing display according to the current refreshing display, so that the display terminal can determine that the current refreshing display is completed after the determined time length from the start of the current refreshing display, and the display terminal is not currently performing refreshing display.
[0335] The embodiment does not limit the specific manner in which the display terminal determines the time length required for completing the current refreshing display. Specifically, the display terminal can determine the time length required for completing the current refreshing display in combination with various factors of the current refreshing display.
[0336] For example, if the current refreshing display is full refreshing display, the display terminal can determine the time length required for completing the current refreshing display according to the amount of data required for refreshing, in particular, the number of pixel rows required for refreshing. If the current refreshing display is partial refreshing display, the display terminal can determine the time length required for completing the current refreshing display according to the number of pixels required for refreshing.
[0337] In addition, the pixel position to be refreshed can also be used as a factor for determining the time length required for completing the current refreshing display.
[0338] For example, the pixels close to the driving end have a short effective charging time length required due to weak signal attenuation effect on the panel, and the charging in this area can be completed in a short time length. If the display area is far from the driving end, the impedance on the panel trace is large, and a longer time length is required for charging, so a longer time length is required for completing the charging.
[0339] Optionally, factors such as temperature, humidity, brightness, and the like can be used to determine the time length required for completing the current refreshing display.
[0340] Correspondingly, the display terminal can determine the time length required for completing the current refreshing display in combination with various factors, so as to facilitate the determination of the current state of the display terminal itself.
[0341] Specifically, the influence of the factors of refreshing display on the time length required for completing the refreshing display can be determined through experiments or other manners. Thus, the corresponding relationship between the various factors of refreshing display and the time length required for completing the refreshing display can be determined, so as to facilitate the display terminal to determine the time length required for completing the current refreshing display in the future.
[0342] Specifically, the display terminal can determine the time length required for completing the current refreshing display according to the current refreshing display, so that the display terminal can determine that the current refreshing display is completed after the determined time length from the start of the current refreshing display, and the display terminal is not currently performing refreshing display.
[0343] Based on the current state of the display end, in the case that the display end is not currently performing refresh display, refresh display can be performed. Specifically, refresh display can be performed according to actual display requirements.
[0344] For example, based on the requirement of content update or other requirements, it is determined whether to perform partial refresh display or overall refresh display.
[0345] It should be emphasized that, compared with the fixed full-screen refresh mode, the display end in the embodiment can support partial refresh display and overall refresh display, thereby improving the flexibility of refresh display. When the display screen is not currently performing refresh display, partial refresh display or full-screen refresh display can be selected according to the requirement of content difference, and the respective refresh time and the respective alternating time of the two states are not limited.
[0346] In addition, compared with the mode of performing refresh display at a fixed frequency, it is provided that refresh display can be performed in the case that the display end is not currently performing refresh display, thereby not limiting refresh display at a fixed frequency and improving the flexibility of refresh display.
[0347] The display end itself can also determine the current state, and the display end can ensure that the pixels in the display end are charged in place through internal driving timing logic design, so as to determine that refresh display is completed, thereby ensuring excellent image quality.
[0348] In order to support partial refresh display, in an optional embodiment, the display end can support pixel-level partial refresh display, specifically, the display end can perform refresh display for a single pixel, thereby improving the accuracy of refresh display.
[0349] For example, in the case of determining that only a single pixel needs to be refreshed, the display end can refresh only the pixel according to the pixel coordinates.
[0350] The embodiment does not limit the specific way of implementing pixel-level refresh display.
[0351] Optionally, each pixel can correspond to a row switch signal and a column switch signal.
[0352] In the case that the row switch signal and the column switch signal are both open, the corresponding pixel can receive a pixel refresh signal and can perform refresh display.
[0353] Otherwise, the corresponding pixel can not receive a pixel refresh signal and cannot perform refresh display. Specifically, this can be the case that the row switch signal is closed and / or the column switch signal is closed.
[0354] Therefore, the row switch signal and the column switch signal corresponding to each pixel in the pixel array can be controlled to realize pixel-level control, control the pixels in the pixel array that can perform refresh display, and facilitate pixel-level refresh display.
[0355] Specifically, for the pixel point that needs to be refreshed, the corresponding row switch signal and column switch signal are adjusted to a signal representing opening, so that refresh display can be performed.
[0356] It can be understood that for local refresh display, the row switch signal and the column switch signal of part of the pixels in the display area can be opened. For overall refresh display, the row switch signal and the column switch signal of all the pixels in the display area can be opened.
[0357] For more detailed explanations, please refer to the following.
[0358] It should be noted that the above method flow explains the process of obtaining display instructions for refresh display once, and it can be understood that the process of refresh display each time can refer to the explanation of the method flow.
[0359] The following explains each aspect of the above method flow in detail.
[0360] I. S101: Obtain a display instruction.
[0361] The method flow is not limited to the specific content of the display instruction.
[0362] Optionally, the display instruction can be an instruction for instructing the display end to perform refresh display. Specifically, it can include image content that the display end needs to refresh display, which can be complete image content or partial image content. It can also include indication information for refresh display, such as refresh display mode of image content, refresh position of image content, and the like.
[0363] In an optional embodiment, the obtained display instruction can include a next frame of image frame for display, or can be used to determine a next frame of image frame. For example, in the case of displaying a video on the display end, the refresh rate can be 60Hz, so that a next frame of video frame can be periodically obtained as a display instruction for refresh display.
[0364] The method flow is not limited to the specific form of the display instruction.
[0365] Optionally, since the display end can support local refresh display and overall refresh display, the display instruction can include local refresh content or overall refresh content accordingly.
[0366] The refresh content included in the display instruction can not match the specific refresh display manner. Based on the partial refresh content included in the display instruction, the display end can perform overall refresh display. Based on the overall refresh content included in the display instruction, the display end can perform partial refresh display.
[0367] The partial refresh content can be image content required to be refreshed by partial refresh display, and the size can be smaller than the size of the current display area of the display end.
[0368] The size of the partial refresh content can be smaller than the size of the current display area of the display end. For example, the size of the partial refresh content can be 10*10 pixels, and the size of the current display area of the display end can be 1000*1000 pixels. The resolution of the partial refresh content can be smaller than the resolution of the current display area of the display end.
[0369] The size of the overall refresh content can be the same as the size of the current display area of the display end. The resolution of the overall refresh content can be the same as the resolution of the current display area of the display end.
[0370] In addition, in the process of performing partial refresh display, in addition to the partial image content required to be refreshed, the display area position required to be refreshed can also not be required, or the display area position required to be refreshed can also be required to be specified.
[0371] Optionally, if the partial image content required to be refreshed can be directly positioned to the display area position required to be refreshed, the refresh position can not be required to be specified. For example, the partial image content can include the complete boundary of the current display area of the display end, so as to be directly positioned to the refresh position. Of course, a fixed refresh position can also be specified for partial refresh display.
[0372] Optionally, the display area position required to be refreshed by the partial refresh content can also be specified.
[0373] Therefore, the display instruction can include the partial refresh content and the partial refresh position. The partial refresh position can be the position of the partial refresh content in the display area, or can be the position of the partial refresh content required to be displayed in the display area, so as to refresh and display the partial refresh content to the corresponding partial refresh position by the display end. The display instruction can include the partial refresh content and the corresponding partial refresh position.
[0374] The method flow does not limit the specific form of the partial refresh position, and the form of the partial refresh content can be determined, pixel point coordinates can be used, or area position can be used, or specified pixel rows and columns can be used.
[0375] For example, in the case that the local refresh content is scattered multiple pixels, the local refresh position can include the pixel coordinates corresponding to each pixel.
[0376] For example, in the case that the local refresh content is scattered multiple regions, the local refresh position can include the region positions corresponding to each region.
[0377] For example, in the case that the local refresh content is a single region, the local refresh position can include the region position of the region.
[0378] For example, in the case that the local refresh content is multiple pixel rows and columns, the local refresh position can include corresponding pixel row and column identification information.
[0379] In addition, in a specific example, the local refresh content can be in the form of a complete image, wherein the image content that is not updated can be marked at the pixel points with an update-free mark, which can be a null value or a star or other special symbol; and the image content that is updated can record the pixel value at the pixel points, thereby facilitating the determination of the local refresh content and the corresponding local refresh position.
[0380] Therefore, optionally, the display instruction can include any of the following: 1) the overall refresh content; 2) the local refresh content; 3) the local refresh content and the local refresh position, specifically the local refresh content and the corresponding local refresh position.
[0381] It should be noted that the method flow does not limit the number of refresh contents included in the display instruction, and can include multiple local refresh contents and corresponding different local refresh positions. Each local refresh content can correspond to a local refresh position.
[0382] For example, the local refresh content can be scattered multiple region contents, and different local refresh contents can correspond to different local refresh positions.
[0383] For ease of understanding, a specific example is given below.
[0384] In the scenario of playing a video for display at the display end, the display instruction can be the next frame of video image frame that the display end obtains and needs to display. The specific form of the next frame of video image frame can be the overall refresh content, that is, the complete image content matching the current display area as a whole.
[0385] Taking a rectangular screen of the currently displayed video as an example, the overall refresh content can be the complete video image frame of the next frame.
[0386] The specific form of the next frame of video image frame can also be partial refresh content. The partial refresh content can be displayed on the basis of continuously displaying the current frame of image, and only the content of the display area is refreshed to finally display the next frame of video image frame.
[0387] For example, there is only one difference between the two adjacent frames of video images, so that only the difference part can be updated on the basis of displaying the current frame of image to display the next frame of image.
[0388] Of course, for the partial refresh content, the corresponding partial refresh position can be additionally matched to facilitate the display end to determine the display area position for partial refresh.
[0389] For example, the position of the difference part can be represented in the form of pixel point coordinates, and specifically can be the coordinates of four vertices of a rectangle, so that the partial refresh content can be refreshed and displayed in the rectangular area in the display area.
[0390] The method flow is not limited to the acquisition method and source of the display instruction.
[0391] Optionally, the display instruction can be acquired by the display end from an external device, or can be acquired by the display end from the local.
[0392] Specifically, the display end can receive the image sent by the external device and determine it as the display instruction; the display end can receive the image sent by the external device and use it to determine the display instruction; or the display end can determine the display instruction from the local.
[0393] In a specific example, the display end can be used to display the image provided by the external device, and the display end can be an external screen connected to the external device by wired or wireless means. The display end can take the image sent by the external device as the display instruction.
[0394] In another specific example, the display end can be a device with storage capability, such as a mobile phone, a computer, etc., so as to acquire the display instruction from the local.
[0395] In addition, optionally, the display end can actively initiate the demand for refresh display to acquire the display instruction. Specifically, the display end can initiate the demand for refresh display to the external device, the external device can generate image content in response to the demand and send it to the display end, and the display end can acquire the corresponding display instruction.
[0396] II. S102: In the case where it is determined that partial refresh display is needed for the current display area, based on the acquired display instruction, the partial refresh content and the partial refresh position are determined.
[0397] The method process does not limit the specific situation of local refresh display, and the specific situation can be determined according to the requirement.
[0398] If the local refresh display needs to be continuously performed, it can be directly determined that the local refresh display needs to be performed for each display instruction obtained.
[0399] If the local refresh display needs to be periodically performed, it can be determined whether the local refresh display needs to be performed based on a period.
[0400] If the local refresh display needs to be performed according to the indication of the external device, the indication of the external device can be received, and it is determined that the local refresh display needs to be performed in the case that the external device indicates that the local refresh display needs to be performed.
[0401] In a specific example, the display end can receive the indication information sent by the external device, and determine that the local refresh display needs to be performed. The external device can agree with the display end in advance on the format of the indication information, so as to facilitate the external device to control the refresh display mode of the display end through the indication information, that is, the local refresh display or other refresh display mode.
[0402] Optionally, the case that the local refresh needs to be performed can include at least one of the following:
[0403] 1) The display instruction obtained includes local refresh content and local refresh position.
[0404] 2) The display instruction is obtained in the case that it is determined that the whole current display area does not need to be refreshed.
[0405] 3) The display instruction is obtained.
[0406] The above three cases are only used for illustrative description, and it can be understood that the case that the local refresh needs to be performed can also include other cases, for example, the display instruction obtained contains local refresh content, and the like.
[0407] Optionally, if it is determined that the display instruction obtained contains local refresh content and local refresh position, it can be determined that the local refresh display needs to be performed.
[0408] In a specific example, the display instruction can be obtained locally from the display end, or the display instruction can be obtained from the external device. As long as it is determined that the display instruction contains local refresh content and corresponding local refresh position, it can be determined that the local refresh display needs to be performed.
[0409] For the external device, the display end can be sent the display instruction containing the local refresh content and the local refresh position, so that the display end performs the local refresh display, and the efficiency of the refresh display is improved.
[0410] Optionally, since the display end can also support overall refresh display, that is, it is necessary to perform refresh display for the overall current display area of the display end, so that the overall refresh display can be excluded, and partial refresh display is performed in addition to the overall refresh display.
[0411] Therefore, in the case where it is determined that the overall current display area does not need to be refreshed, that is, in the case where it is determined that overall refresh display is not needed, if the display instruction is obtained, it can be determined that partial refresh display is needed.
[0412] In a specific example, the display end can need to periodically perform overall refresh display to reduce the risk of device failure, and in addition to the periodic overall refresh display, refresh display is needed, and then partial refresh display can be performed to improve the efficiency of refresh display.
[0413] Optionally, the case of overall refresh display can also not be considered, and it is determined that partial refresh display is needed each time refresh display is performed.
[0414] Therefore, as long as the display instruction is obtained, it can be determined that partial refresh display is needed to improve the efficiency of refresh display.
[0415] The method flow does not limit the specific way of determining whether partial refresh display is needed, and can be set according to the corresponding case where it is determined that partial refresh display is needed.
[0416] For example, if it is determined that partial refresh display is needed each time refresh display is performed, it can be directly determined that partial refresh display is needed without judgment.
[0417] For another example, if the display instruction obtained contains partial refresh content and partial refresh position, it can be determined that partial refresh display is needed, so it is necessary to detect whether the display instruction contains partial refresh content and partial refresh position.
[0418] The specific detection method can be to compare with the size or resolution of the current display area, or to detect through identification information representing partial refresh in the display instruction, etc.
[0419] For example, the display instruction can also include indication information of partial refresh display needed.
[0420] The method flow does not limit the judgment timing of determining whether partial refresh display is needed. It can be set according to the corresponding case where it is determined that partial refresh display is needed.
[0421] Optionally, the judgment can be made in advance, and it can be determined in advance whether the partial refresh display is needed. Specifically, the judgment can be made before the display instruction is acquired or during the acquisition of the display instruction. The judgment can also be made in real time, i.e., after the display instruction is acquired.
[0422] For example, if it is determined that the partial refresh display is needed every time the display is refreshed, the judgment can not be needed, and it can be determined in advance that the partial refresh display is needed.
[0423] Therefore, after the display instruction is acquired, the partial refresh content and the partial refresh position can be determined directly based on the acquired display instruction. The judgment is not needed, and thus the efficiency of the display refresh is improved.
[0424] For example, if the display instruction acquired contains the partial refresh content and the partial refresh position, it can be determined that the partial refresh display is needed. Thus, after the display instruction is acquired, the real-time judgment is needed, i.e., the display instruction is detected to determine whether it contains the partial refresh content and the partial refresh position, and it is determined whether the refresh display is needed.
[0425] In S102, the partial refresh content and the partial refresh position can also be determined based on the acquired display instruction.
[0426] The method flow does not limit the specific way of determining the partial refresh content and the partial refresh position.
[0427] Optionally, the partial refresh content and the partial refresh position can be acquired directly based on the display instruction, or the partial refresh content and the partial refresh position can be acquired indirectly based on the display instruction through comparison or other methods.
[0428] In an optional embodiment, the display instruction can contain the partial refresh content, and thus the partial refresh content contained in the display instruction can be determined directly.
[0429] If the display instruction also contains the partial refresh position, the partial refresh position contained in the display instruction can be determined directly.
[0430] In the display instruction, the partial refresh content can correspond to the partial refresh position, and in particular, when there are multiple scattered partial refresh contents, the partial refresh contents can correspond to different partial refresh positions respectively.
[0431] For example, the display instruction can contain the partial refresh content of multiple rectangular local areas, and further contain the partial refresh positions corresponding to the partial refresh contents respectively, so that the partial refresh contents can be refreshed and displayed to the corresponding partial refresh positions respectively.
[0432] For the convenience of understanding, in a specific example, the partial refresh content and the partial refresh position contained in the display instruction can be generated locally by the display terminal or generated by an external device.
[0433] The display terminal or the external device can generate the partial refresh content and the partial refresh position according to the generated adjacent image frames, or generate the partial refresh content and the partial refresh position according to content requirements, such as an additional pop-up window notification. Specifically, the content of the pop-up window notification can be determined as the partial refresh content, and a rectangular region in the image frame can be set as the partial refresh position of the pop-up window notification.
[0434] Optionally, the display instruction can also contain the overall refresh content. The overall refresh content can be the image content required to be displayed when the current display area is refreshed and displayed as a whole. The size of the overall refresh content can be the same as the size of the current display area.
[0435] Based on the overall refresh content in the display instruction, the difference part can be determined by comparing with the currently displayed image frame, and the partial refresh content and the partial refresh position can be determined according to the difference part.
[0436] The embodiment does not limit the way of determining the difference part. Optionally, the pixel point values at the same position of the overall refresh content and the currently displayed image frame can be compared. If it is found that the pixel point values at the same position are different, the found pixel point values in the overall refresh content can be determined as the difference part, and the found pixel point positions can also be used to determine the partial refresh position.
[0437] The specific comparison method can be comparing pixel points one by one, or comparing blocks after partitioning, locating the blocks with differences, and further comparing pixel points one by one in the blocks with differences.
[0438] The embodiment does not limit the specific way of determining the partial refresh content based on the difference part.
[0439] It should be noted that the partial refresh content can contain the image content of the difference part, that is, the pixel point values of the difference part. The partial refresh content can further contain part of the image content other than the difference part, so as to facilitate subsequent operations.
[0440] For example, in the case where the difference part is a plurality of pixel points scattered in a small area, if the entire area is determined as the partial refresh content, it can not only contain all the contents of the difference part to form a regular shape, but also facilitate positioning and subsequent refresh display.
[0441] Therefore, optionally, the partial refresh content can be determined based on the difference part. The partial refresh content can be the difference part directly, or a partial region containing the difference part.
[0442] Correspondingly, the embodiment is not limited to the way of determining the partial refresh position based on the difference part.
[0443] After the partial refresh content is determined, the position of the partial refresh content in the whole refresh content (i.e., the whole image) can be determined as the partial refresh position. The partial refresh position can be the position of the partial refresh content in the current display region.
[0444] For ease of understanding, in an example, after the partial refresh content of the rectangular region is determined, the coordinate positions of the four vertices of the rectangular region in the whole refresh content can be determined as the information of the partial refresh position, so that the corresponding rectangular region can be located in the current display region, and the partial refresh content can be displayed.
[0445] In addition, optionally, if it is determined through comparison that there is no difference between the whole refresh content and the currently displayed image frame, the display can not be refreshed, and the currently displayed image frame can be maintained.
[0446] In an optional embodiment, since the image comparison needs to be performed by the display end, in order to reduce the calculation amount required for image comparison and determination of the partial refresh content, a plurality of regions can be divided in advance for the image. When it is detected that any pixel point in the region has different values, the image content of the whole refresh content in the region can be determined as the partial refresh content.
[0447] The embodiment is not limited to the specific region division manner and division form. Optionally, the whole refresh content and the stored image frame can be divided into at least two partial regions according to the same division manner. Specifically, the whole refresh content can be divided into a plurality of regions with the same size, or a plurality of regions with different sizes, or a plurality of rectangular regions, etc.
[0448] Optionally, for any partial region obtained by division, when it is detected that any pixel point at the same position between the whole refresh content and the stored image frame has different values, the image content of the whole refresh content in the partial region can be determined as the partial refresh content.
[0449] If it is detected that the pixel point at the same position between the whole refresh content and the stored image frame has the same value, it can be determined that the image content of the whole refresh content in the partial region is not the partial refresh content.
[0450] Of course, each local region obtained by division can be compared in this way.
[0451] The embodiment can reduce the amount of calculation required for image comparison and determination of local refresh content by pre-division of the region, and improve the efficiency of determination of local refresh content.
[0452] III. S103: In the case where the current display is not being refreshed, the determined local refresh content is refreshed and displayed in the current display region, and the determined local refresh position.
[0453] Optionally, after the local refresh content and the local refresh position are determined, the local refresh display can be further performed.
[0454] According to the display characteristics of the display terminal, in order to reduce the conflict of refresh display, the local refresh display can be performed in the case where the current display is not being refreshed.
[0455] If the current display is being refreshed, the local refresh display can be performed after the current refresh display is completed.
[0456] In a specific example, the display terminal can perform full-screen refresh at a refresh rate of 10 Hz, that is, the full-screen refresh needs to be performed once in 1 / 10 second. Within 1 / 10 second, the full-screen refresh can be completed within 1 / 60 second, and the remaining time can be regarded as the current display not being refreshed.
[0457] Therefore, the method flow described above can further include: in the case where the current display is being refreshed, waiting for the current refresh display to be completed, and then refreshing and displaying the determined local refresh content in the current display region and the determined local refresh position.
[0458] The embodiment does not limit the specific waiting method. Optionally, a cyclic detection method can be used to periodically detect whether the current refresh display is completed until it is detected that the current refresh display has been completed and the current display is not being refreshed. Optionally, the display terminal can also update and maintain the state of the refresh display. In the case where the display terminal is refreshing the display, it can be marked as a busy state or a state of being refreshed. In the case where the display terminal completes the refresh display and is not refreshing the display, it can be marked as an idle state or a state of no refresh display, so as to facilitate subsequent judgment of whether the current display is being refreshed according to the state.
[0459] The method flow does not limit the way in which the display terminal determines whether the current display is being refreshed.
[0460] Optionally, the state of the display component can be updated and maintained by the display terminal to represent whether the current display is being refreshed.
[0461] For example, the display end can update the busy state or the idle state according to whether the display component is currently refreshing the display, so as to determine whether the display area is currently refreshing the display.
[0462] Of course, the display component of the display end can also feed back whether the current display is refreshing.
[0463] As for the specific partial refresh display, the method flow does not limit the specific refresh mode. Alternatively, according to the determined partial refresh position, the display component pixel points located at the partial refresh position can be determined, so that the pixel point values in the partial refresh content can be output to the determined display component pixel points for refresh display.
[0464] The display component can refresh row by row or by pixel point. Specifically, a pixel-level drive can be set to facilitate positioning and refreshing the pixel points.
[0465] In addition, it should be noted that s103 can be executed after s102, and s103 can be executed when it is determined that the current display area needs to be refreshed locally. That is, during the process of local refresh display, s102 and s103 need to be executed to complete the local refresh display.
[0466] Four, overall refresh display.
[0467] In an optional embodiment, in addition to the partial refresh display explained in the above embodiment, the display end also has the need for overall refresh display, that is, the need for overall refresh display of the current display area.
[0468] On the one hand, it can be the demand for image content that needs to be displayed. The pixel point values at the same position of the front and rear two images are different, for example, the transition shot in the video, the front and rear two images are different scenes, and there may be no same position pixel point values that are the same, so that overall refresh display can be required.
[0469] On the other hand, according to the demand of the display end hardware, continuous partial refresh display can cause some pixel points to be not refreshed for a long time, which has the risk of device failure, such as reduction or damage of pixel point brightness, so that overall refresh display is required to refresh all pixel points in the current display area.
[0470] Of course, there can also be other needs for overall refresh display.
[0471] Therefore, the display end can also support overall refresh display.
[0472] Optionally, the method further includes the following steps: determining the overall refresh content based on the obtained display instruction, in a case that it is determined that the current display area as a whole needs to be refreshed and displayed; and refreshing and displaying the determined overall refresh content to the current display area as a whole, in a case that the current display area is not being refreshed and displayed.
[0473] The refreshing and displaying of the determined overall refresh content to the current display area as a whole should be performed in a case that it is determined that the current display area as a whole needs to be refreshed and displayed, so as to complete the overall refresh and display.
[0474] Since the current display area as a whole needs to be refreshed, the corresponding refresh position can be determined directly, and the current display area as a whole needs to be refreshed and displayed.
[0475] It should be noted that the embodiment does not limit the specific form of the current display area as a whole. Optionally, the current display area as a whole can be a full screen of the display terminal, or can be a partial screen of the display terminal, and the actual display of the display terminal can be determined.
[0476] For example, the display component of the display terminal can be a folding screen, which displays only half a screen when folded and displays a full screen when unfolded. Therefore, the current display area as a whole can be determined according to the actual display of the display component.
[0477] For ease of understanding, in a specific example, the display component of the display terminal can be a folding screen, which displays only half a screen when folded, and the image frame size currently displayed by the display terminal can be the size of half a screen. Then, the folding screen is unfolded, and according to the instruction for switching to full screen display, the current display area can be the full screen of the folding screen, and the display terminal can determine that the overall refresh content of the full screen size is obtained, so that the overall refresh content can be refreshed and displayed to the full screen of the folding screen.
[0478] The method does not limit the specific determination manner of the current display area. Optionally, the display terminal can directly determine the current display area. Specifically, the current display area can be determined according to the current display requirement or display condition of the display component.
[0479] For example, the folding screen has a requirement for full screen display, and the full screen can be determined as the current display area. The display screen can currently display a full screen, and the full screen can be determined as the current display area. The spliced screen can currently display a partial screen, and the partial screen can be determined as the current display area.
[0480] Correspondingly, when determining the overall refresh content, the current display area can also be determined. For example, the overall refresh content can be determined according to the size of the current display area.
[0481] The method flow is not limited to the case of needing to perform overall refresh display, and is not limited to the specific case of needing to perform overall refresh display for the current display area.
[0482] As an example, overall refresh display can be performed periodically, or can be performed according to an indication of an external device, or can be determined according to overall refresh content included in a display instruction.
[0483] Specifically, reference can be made to the case of needing to perform partial refresh display explained previously.
[0484] Optionally, the case of needing to perform overall refresh display for the current display area can include at least one of the following:
[0485] 1) The time length between the current time and the time of the last overall refresh display area is greater than a preset period time length.
[0486] 2) The number of pixel points in the display area that are detected to have not been refreshed for a preset detection time length is greater than a preset number.
[0487] 3) The display instruction obtained includes overall refresh content.
[0488] The above three cases are only used for illustrative purposes, and it can be understood that the case of needing to perform overall refresh can also include other cases, such as obtaining a display instruction, and the like.
[0489] Optionally, if overall refresh display needs to be performed periodically, the need to perform overall refresh display can be determined by monitoring the period.
[0490] It should be noted that, during the refresh display process, no other refresh display is performed again, so it is difficult to strictly perform overall refresh display at the time point indicated by the period.
[0491] Correspondingly, it can be determined whether the time length between the current time and the last overall refresh display is greater than the period time length.
[0492] For example, after obtaining the display instruction, it can be determined whether the time length between the current time and the last overall refresh display is greater than the period time length. If the period time length is exceeded, it can be determined that overall refresh display needs to be performed. If the period time length is not exceeded, it can be determined that partial refresh display needs to be performed.
[0493] Of course, the display terminal can also periodically initiate overall refresh display, which can specifically be that the display terminal periodically determines that overall refresh display needs to be performed, thereby obtaining a display instruction to perform overall refresh display.
[0494] The embodiment is not limited to the time length of the period, and is not limited to the specific value of the preset period time length. The preset period time length can be 2 seconds or 10 seconds, or the like.
[0495] Optionally, considering that the pixel point that is not refreshed for a long time may have a risk of failure, the pixel point that is not refreshed for a long time in the display area can be detected. If it is detected that there is a pixel point that is not refreshed for a preset detection time length in the display area, it can be determined that overall refresh display needs to be performed.
[0496] Of course, the specific judgment standard herein can be changed. Specifically, the number of pixel points that are not refreshed for a preset detection time length in the display area can be greater than a preset number.
[0497] The embodiment is not limited to the specific value of the preset detection time length, and is not limited to the specific value of the preset number. The preset detection time length can be 5 seconds or 10 seconds, or the like. The preset number can be 10 or 100. Of course, the number of pixel points that are not refreshed for a long time in the current display area can be determined according to the proportion of the number of pixel points that are not refreshed for a long time.
[0498] The number of pixel points that are not refreshed for a preset detection time length in the display area can account for more than a preset proportion of the total number of pixel points in the current display area.
[0499] The embodiment can reduce the risk of device failure of the display end.
[0500] Optionally, the display instruction can also be used for judgment. Specifically, if the display instruction includes overall refresh content, it can be determined that overall refresh display needs to be performed.
[0501] Of course, if the display instruction includes partial refresh content and a partial refresh position, it can also be determined that overall refresh display needs to be performed. Then, the overall refresh display can be performed by comprehensively considering the partial refresh content and the partial refresh position and the current displayed image frame.
[0502] Optionally, the case of partial refresh display can not be considered, and it can be determined that overall refresh display needs to be performed each time refresh display is performed.
[0503] Therefore, as long as the display instruction is obtained, it can be determined that overall refresh display needs to be performed.
[0504] The method flow is not limited to the specific way of determining whether overall refresh display needs to be performed. The specific way can be set according to the case in which it is determined that overall refresh display needs to be performed.
[0505] For example, if it is determined that overall refresh display needs to be performed each time refresh display is performed, it can be directly determined that overall refresh display needs to be performed without judgment.
[0506] For example, if the display instruction includes the whole refresh content, it can be determined that the whole refresh display is needed, and thus the display instruction is needed to be detected to determine whether the whole refresh content is included.
[0507] The specific detection method can be to compare the size or resolution of the current display area, or to detect the identification information representing the whole refresh in the display instruction.
[0508] For example, the display instruction can further include the indication information of the whole refresh display.
[0509] The method flow does not limit the judgment time of whether the whole refresh display is needed. Specifically, it can be set according to the corresponding determination of the need for whole refresh display.
[0510] Optionally, it can be determined in advance whether the whole refresh display is needed. Specifically, it can be determined before or during the acquisition of the display instruction. It can also be determined in real time after the display instruction is acquired.
[0511] The method flow does not limit the specific way of determining the whole refresh content based on the acquired display instruction.
[0512] Optionally, the whole refresh content in the display instruction can be directly acquired, or the whole refresh content can be obtained by combining the local refresh content and the local refresh position in the display instruction with the currently displayed image frame.
[0513] The embodiment does not limit the specific combination method. Specifically, the currently displayed image frame can be stored, and the image content of the local refresh position can be replaced by the local refresh content to obtain the whole refresh content.
[0514] Of course, the local refresh content can also be refreshed and displayed to the local refresh position in the current display area, and the display content other than the local refresh position in the current display area can be refreshed according to the currently displayed image frame. Specifically, the image content other than the local refresh position in the currently displayed image frame can be refreshed and displayed to the position other than the local refresh position in the current display area.
[0515] It can be understood that when the refresh display is specifically performed, the value of each pixel point in the image content can correspond to the position of each pixel point in the current display area.
[0516] In an optional embodiment, regarding the whole refresh display, after determining the whole refresh content, the determined whole refresh content can be displayed to the whole current display region without current refresh display.
[0517] According to the display characteristic of the display terminal, in order to reduce the conflict of refresh display, the whole refresh display can be performed without current refresh display of the display terminal.
[0518] If the display terminal is currently performing refresh display, the whole refresh display can be performed after waiting for the current refresh display to be completed.
[0519] Therefore, optionally, the above method flow can further include: in the case of current refresh display, waiting for the current refresh display to be completed, and then displaying the determined whole refresh content to the whole current display region.
[0520] The embodiment is not limited to a specific waiting manner. Optionally, a cyclic detection manner can be adopted to periodically detect whether the current refresh display is completed until it is detected that the current refresh display has been completed and the display terminal is not currently performing refresh display. Optionally, the display terminal can also update and maintain the state of refresh display, and in the case of refresh display of the display terminal, the busy state or the refresh display state can be marked; in the case of completion of refresh display of the display terminal and no refresh display, the idle state or the no-refresh display state can be marked, so as to facilitate subsequent judgment of whether the current refresh display is performed according to the state.
[0521] The method flow is not limited to the manner of determining whether the current refresh display is performed by the display terminal.
[0522] Optionally, the state of the display component of the display terminal can be updated and maintained to represent whether the current refresh display is performed.
[0523] For example, the display terminal can update and maintain the busy state or the idle state according to whether the current refresh display is performed by the display component, so as to facilitate the determination of whether the current refresh display is performed by the display region.
[0524] Of course, the display component of the display terminal can also feed back whether the current refresh display is performed.
[0525] For specific explanation of the whole refresh display, refer to the explanation of the partial refresh display.
[0526] Five, switching of refresh display manners.
[0527] The above embodiments explain the partial refresh display and the whole refresh display.
[0528] Different refresh display modes can adapt to different needs, and therefore, in order to flexibly adapt to more extensive needs, switching of multiple refresh display modes can be provided.
[0529] In an optional embodiment, the display end can support multiple refresh display modes, so that switching can be performed according to real-time needs.
[0530] For example, if the display end needs to be connected to an external device for display, but the processing capability of the external device is low, it is difficult to generate complete image content in real time, the display end can be switched to a partial refresh display mode, so that the external device can generate partial image content that needs to be updated for partial refresh display of the display end, thereby adapting to the external device with low processing capability. Of course, if the display end is to display locally generated images, the partial refresh display mode can be selected in the case of low local processing capability.
[0531] For example, the display end itself can also initiate a request to determine partial refresh display or overall refresh display according to its own needs. Specifically, in order to improve the refresh rate or display smoothness of the display end, the display end can initiate a partial refresh request to make the external device generate partial refresh content, improve the generation efficiency of image content, and improve the refresh rate. It can also be that the display end initiates an overall refresh display requirement in order to reduce the risk of device failure, in order to avoid long-time non-refresh of the pixel points in the display end.
[0532] Therefore, optionally, the display end can actively switch to a suitable refresh display mode according to actual needs to flexibly adapt to different needs.
[0533] Specifically, the display end itself needs to improve the refresh rate, adapt to the processing capability of the local or external device, reduce the risk of device failure, and the like, and switch to the adapted refresh display mode.
[0534] The specific needs and the corresponding relationship between the refresh display mode are not limited by the method flow.
[0535] Optionally, the need to improve the refresh rate can correspond to the partial refresh display method, the need to reduce the risk of device failure can correspond to the overall refresh display method, and the like.
[0536] In addition, the display end can also switch different refresh display modes according to the indication of the external device.
[0537] The external device can be a device or component for providing image content to the display end for display. The external device can belong to the same device as the display end. For example, the external device can form a mobile phone, a computer, a bracelet, or the like with the display end.
[0538] The external device can instruct the display end to switch different refresh display modes according to its own needs.
[0539] For example, the external device can instruct the display end to switch to a partial refresh display mode according to its own low processing capability, so as to improve the generation efficiency of partial refresh content.
[0540] For another example, the external device can instruct the display end to perform partial refresh display according to the image content generation of the external device, specifically, for a real-time notification pop-up window, the external device can directly use the content of the notification pop-up window as the partial refresh content without generating a complete image for refresh display.
[0541] Therefore, optionally, the external device can instruct the display end to switch to a suitable refresh display mode according to actual needs to flexibly adapt to different needs.
[0542] Specifically, the external device needs to improve the refresh rate, adapt to its own processing capability, reduce the risk of device failure, and the like.
[0543] The specific needs and the corresponding relationship between the refresh display mode are not limited by the method flow.
[0544] Optionally, the need to improve the refresh rate can correspond to the partial refresh display method, and the need to reduce the risk of device failure can correspond to the whole refresh display method, and the like.
[0545] It should be noted that in the case of switching the refresh display mode of the display end, the corresponding refresh display mode can be directly determined according to the switched refresh display mode, that is, it is determined whether the current display area needs to be refreshed locally or needs to be refreshed as a whole.
[0546] For example, if the display end currently switches to a partial refresh display mode, it can be directly determined that partial refresh display is needed. If the display end currently switches to a whole refresh display mode, it can be directly determined that whole refresh display is needed.
[0547] The method flow does not limit the specific switching mode and switching time of the display end switching the refresh display mode.
[0548] Optionally, the display end can switch the refresh display mode after completing the refresh display, thereby reducing the conflict risk of the refresh display.
[0549] And the specific switching mode can be that the display end adjusts the refresh display mode of the display component, and adjusts the display driving of the display component to support partial refresh display or whole refresh display.
[0550] In an alternative embodiment, the display terminal can need to perform periodic overall refresh display, and in addition to the overall refresh display, partial refresh display can be allowed.
[0551] Therefore, after triggering the overall refresh display periodically, the display terminal can switch to the partial refresh display mode, thereby performing partial refresh display for the obtained display instructions.
[0552] The embodiment does not limit the cycle length of the overall refresh display. Alternatively, the cycle length can be related to the current environmental factors of the display terminal, such as temperature, humidity, etc., which can affect the risk of device damage, thereby corresponding different cycle lengths can be set.
[0553] Six, frame filling under partial refresh display.
[0554] In an alternative embodiment, since partial refresh display is performed, the partial image content can be determined as the partial refresh content, thereby reducing the data amount of image generation.
[0555] In order to improve the display refresh rate or the degree of display process, the frame filling method is often used, which can be specifically interpolation processing for adjacent two image frames to obtain intermediate transition frames.
[0556] In the case of partial refresh display, the partial transition frame can be generated faster by interpolation processing, without generating the overall transition frame, thereby improving the efficiency of image generation and the efficiency of image display.
[0557] Therefore, alternatively, at least one partial frame content can be generated by using the frame filling method for the partial refresh content, so as to perform partial refresh display, improve the efficiency of image refresh display, reduce the data amount of image generation, improve the efficiency of image generation, and also facilitate to improve the image refresh rate.
[0558] For convenience of understanding, in a specific example, for a display area of 1000*1000 size, 10*10 partial refresh content can be determined for partial refresh display, and the refresh display is refreshed to the corresponding partial refresh position.
[0559] Further, the 10*10 image content of the image frame displayed by the current display area at the partial refresh position can be determined as the partial initial content as the starting point of the frame filling.
[0560] Afterwards, the frame filling processing can be performed on the local initial content and the local refresh content. The embodiment is not limited to the specific manner of frame filling. The interpolation processing can be adopted, or the machine learning model can be adopted for frame filling. Afterwards, the local intermediate transition content can be obtained, so that the local refresh display can be sequentially performed. Starting from the local initial content, the intermediate transition content is sequentially refreshed and displayed at the local refresh positions according to the preset frame filling sequence. Finally, the local refresh content is refreshed and displayed, so that the smoothness of display can be improved, the efficiency of image generation can be improved, and the refresh rate can be conveniently improved.
[0561] The method flow is not limited to the device that performs the local image content frame filling. The device can be executed by an external device or can be executed by the display end itself.
[0562] Optionally, the display end itself can obtain the local refresh content, and obtain a plurality of local image contents of intermediate transition through frame filling processing. Specifically, the display end can increase the local image content that can be used for transition refresh display by performing frame filling processing on the local refresh content according to the requirements of the display end, such as improving the smoothness of display or improving the refresh rate, and performing a plurality of local refresh displays.
[0563] In addition, optionally, the external device can also perform frame filling processing on the local refresh content according to requirements. Specifically, the frame filling processing can be performed on the local refresh content according to the content requirements, such as a plurality of intermediate frames, or in order to improve the smoothness of display or improve the refresh rate.
[0564] In an optional embodiment, the method flow described above can further include: storing the currently displayed image frame in advance.
[0565] Here, the currently displayed image frame can be stored for subsequent frame filling processing. The embodiment is not limited to the specific storage manner and storage timing. Optionally, the storage can be performed in advance in the case where it is determined that the frame filling processing is required, or the storage can be performed in the process of refresh display.
[0566] After determining the local refresh content and the local refresh position based on the obtained display instruction, the method flow described above can further include: performing frame filling processing on the local initial content of the local refresh position in the stored image frame and the determined local refresh content, to obtain at least one local frame filling content.
[0567] The determined local refresh content is refreshed and displayed in the current display area at the determined local refresh position. Specifically, the obtained local frame filling content and the determined local refresh content can be sequentially refreshed and displayed in the current display area at the determined local refresh position.
[0568] The sequential refreshing display here can be refreshing display in the order determined in the frame interpolation processing. The order here can be the order of refreshing display.
[0569] The embodiment does not limit the way of determining the order in the frame interpolation processing.
[0570] In a specific example, if the frame interpolation processing is performed on the partial starting content and the determined partial refreshing content, a partial frame interpolation content is obtained, and it can be determined that the order of refreshing display is to refresh the partial frame interpolation content first and then refresh the partial refreshing content. The same applies to other cases.
[0571] As for the frame interpolation processing, the embodiment does not limit the specific frame interpolation processing operation. Alternatively, it can be interpolation processing, or it can be frame interpolation using a machine learning model, or it can be motion frame interpolation.
[0572] Of course, it can be understood that the frame interpolation processing can also be performed for the overall refreshing display. For specific explanations, please refer to the explanations in the above.
[0573] Seven, the structure of the display end.
[0574] The method flow does not limit the specific structure in the display end.
[0575] Alternatively, the display end can include display components such as display screens, pixel arrays, etc.; it can also include modules for data processing, thereby facilitating the execution of data processing operations such as partial frame interpolation, determination of partial refreshing content, etc.
[0576] In an optional embodiment, since the display end can support partial refreshing display, compared with the original overall refreshing display and the display end line-by-line scanning refreshing mode, in the partial refreshing display, since the content of the partial refreshing can be more scattered, a refreshing mode with higher precision is needed, for example, refreshing in units of pixel points in the display component.
[0577] In order to facilitate partial refreshing display and improve the efficiency of partial refreshing display, the display end can be used to refresh the pixels in the display component, instead of necessarily scanning and refreshing line by line or column by column.
[0578] Specifically, the display end can include pixel-level driving, which can be used to locate the pixel points in the display component, so that refreshing is not needed line by line or column by column, thereby improving the efficiency of partial refreshing display.
[0579] Optionally, the display terminal can include pixel-level driving; the determined partial refresh content is refreshed and displayed in the current display area, and the determined partial refresh position can be that, based on the pixel-level driving, the determined partial refresh content is refreshed and displayed in the current display area at the pixel point located at the determined partial refresh position.
[0580] The embodiment is not limited to the specific form of pixel-level driving, and optionally, the pixel points in the pixel array can be controlled to refresh through two dimensions of horizontal and vertical directions.
[0581] In another optional embodiment, the display terminal can include a decoding module, which can be used to determine whether partial refresh display or overall refresh display is needed.
[0582] Specifically, the decoding module can be used to determine whether partial refresh display or overall refresh display is needed for the received display instruction. The decoding module can also be used to decode the received external data to obtain the display instruction and determine whether partial refresh display or overall refresh display is needed.
[0583] The method flow is not limited to the specific implementation of pixel-level refresh display.
[0584] In an optional embodiment, in order to realize pixel-level refresh display and facilitate positioning and determination of a single pixel in the display terminal, the structure of the display terminal can be adjusted.
[0585] The embodiment is not limited to the specific adjustment method.
[0586] Optionally, each pixel in the display terminal can correspond to a row switch signal and a column switch signal. Specifically, each pixel in the display terminal can be connected to two signal lines that respectively transmit the corresponding row switch signal and the corresponding column switch signal.
[0587] When the row switch signal and the column switch signal both represent opening, the corresponding pixel can receive a pixel refresh signal and can perform refresh display.
[0588] Otherwise, the corresponding pixel can not receive a pixel refresh signal and cannot perform refresh display. Specifically, this can be the case where the row switch signal represents closing and / or the column switch signal represents closing.
[0589] Therefore, the row switch signal and the column switch signal corresponding to each pixel in the pixel array can be controlled to realize pixel-level control, control the pixels in the pixel array that can perform refresh display, and facilitate pixel-level refresh display.
[0590] Specifically, for the pixel point needing refreshing, the corresponding row switch signal and column switch signal can be adjusted to signals representing opening, so that refreshing display can be performed.
[0591] The embodiment is not limited to the form of the row switch signal and column switch signal, and specifically can be a signal transmitted through a signal line, for example, a gate drive signal line.
[0592] The embodiment is also not limited to the form in which the row switch signal represents opening and closing. Specifically, the row switch signal can be distinguished by high and low levels, the high-level row switch signal represents opening, and the low-level row switch signal represents closing; or the high-level row switch signal represents closing, and the low-level row switch signal represents opening. The form of the column switch signal is the same.
[0593] The embodiment is not limited to the form of the pixel refreshing signal, and specifically can be a signal line transmitting pixel information, for example, a source drive signal line.
[0594] Therefore, optionally, the display region of the display end can include a plurality of pixel points; any pixel point can correspond to a row switch signal and a column switch signal; and in a case where the corresponding row switch signal and the corresponding column switch signal represent opening, the corresponding pixel point can be used for refreshing display.
[0595] The determined local refreshing content is refreshed and displayed in the current display region, and the determined local refreshing position can be that, in the current display region, for the pixel point located at the determined local refreshing position, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing opening; and the determined local refreshing content is refreshed and displayed in the current display region, at the pixel point located at the determined local refreshing position.
[0596] In a case where the corresponding row switch signal and / or the corresponding column switch signal represent closing, the corresponding pixel point can not be used for refreshing display. Specifically, the pixel refreshing signal cannot be received.
[0597] In a case where refreshing display is completed, for the pixel point in the display region, the corresponding row switch signal can be adjusted to a signal representing closing, and the corresponding column switch signal can be adjusted to a signal representing closing.
[0598] That is, in a case where refreshing display is not currently performed, the row switch signal and the column switch signal corresponding to the pixel point in the display region can represent closing.
[0599] In the process of refreshing display, the corresponding row switch signal and column switch signal can be adjusted for the pixel point needing refreshing.
[0600] Optionally, different pixel points can correspond to different row switch signals, and different pixel points can also correspond to different column switch signals, facilitating improvement of the accuracy of signal control. Correspondingly, the corresponding row switch signals and the corresponding column switch signals need to be provided for each pixel point in the display area.
[0601] Of course, optionally, for the row switch signals, the pixel points in the same pixel row can correspond to the same row switch signal. Different pixel rows can correspond to different row switch signals, so as to control the row switch signals of the pixel points in the corresponding pixel row through one row switch signal.
[0602] Therefore, in the display area, each pixel row can correspond to one row switch signal. If one row switch signal represents opening, it can be that the row switch signals corresponding to each pixel point in the corresponding pixel row all represent opening. If one row switch signal represents closing, it can be that the row switch signals corresponding to each pixel point in the corresponding pixel row all represent closing.
[0603] Similarly, optionally, for the column switch signals, the pixel points in the same pixel column can correspond to the same column switch signal. Different pixel columns can correspond to different column switch signals, so as to control the column switch signals of the pixel points in the corresponding pixel column through one column switch signal.
[0604] Therefore, in the display area, each pixel column can correspond to one column switch signal. If one column switch signal represents opening, it can be that the column switch signals corresponding to each pixel point in the corresponding pixel column all represent opening. If one column switch signal represents closing, it can be that the column switch signals corresponding to each pixel point in the corresponding pixel column all represent closing.
[0605] The embodiment is not limited to the specific process of performing local refresh display.
[0606] Optionally, line-by-line refresh can be performed. Specifically, the pixel row and the pixel column in which the pixel position to be refreshed is located can be determined according to the pixel position to be refreshed. Then, line-by-line refresh can be performed, the row switch signal of the determined single pixel row is adjusted to be opened, and then the column switch signal of the corresponding pixel column is adjusted to be opened according to the pixel column in which the pixel to be refreshed is located in the pixel row, so that the pixel to be refreshed in the pixel row can be further refreshed and displayed.
[0607] After the refresh and display of the pixel row are completed, the row switch signal of the pixel row can be adjusted to be closed, and the column switch signals of all pixel columns can be adjusted to be closed, so as to facilitate the refresh and display of other pixel rows.
[0608] In a specific timing design, the row switch signal of a single pixel row can be opened, and the column switch signal of the pixel column where the pixel to be refreshed is located can be opened according to the pixel to be refreshed in the pixel row, and then the display is refreshed and closed at the same time. The embodiment is not limited.
[0609] The same operation can be performed for the determined other pixel rows until the display is refreshed.
[0610] Of course, column-by-column refreshing can also be performed. The specific manner can refer to the row-by-row refreshing manner.
[0611] In addition, in the case where the corresponding row switch signal and the corresponding column switch signal are opened, the corresponding pixel point can be connected to the source drive signal line, so as to receive the corresponding pixel refresh signal and refresh the pixel data.
[0612] In a specific example, the pixel array can be deployed with column driving, and the column driving can be responsible for loading the pixel data to be refreshed to the corresponding output driving, so as to ensure that the pixel point to be refreshed can be loaded to the corresponding position.
[0613] The specific implementation manner is to control the data latching in the column driving according to the pixel coordinate information sent by the previous stage module when latching the data.
[0614] The control of the specific position of the pixel array is realized by the pixel-level independent driving TFT control circuit module, which converts the refresh pixel position coordinate information sent by the previous stage into corresponding X&Y direction switch control signals.
[0615] The X direction switch control signal can be an example of the row switch signal, and the Y direction switch control signal can be an example of the column switch signal.
[0616] The specific switch signal feature can be a variety of combinations, such as high level indicating gating or low level indicating gating, or through pulse signal combination, and finally the X&Y direction switch signal is transmitted to the pixel array.
[0617] In the pixel array, the X&Y direction switch signal sent by the front end can be received and connected to the two TFT switches in front of the pixel circuit, and through the series connection of the two TFT switches, it is ensured that when the X&Y direction switch signal selects the two TFT switches at the same time, the pixel unit can be connected to the source drive signal line of the front end, so as to ensure that the corresponding voltage can be loaded to the pixel to be refreshed.
[0618] Similarly, if any one of the X&Y direction switch signals is not selected, the pixel unit will not be connected to the source drive signal line of the front end, and data misfire or pixel leakage will not occur, and the brightness characteristics of the unrefreshed pixel can be maintained.
[0619] The core is to ensure that only the pixel TFT switch that needs to be refreshed is opened through the combination state of the two X&Y selection signals.
[0620] For easy understanding, as shown in FIG. 2, FIG. 2 is a structure diagram of a pixel in a display area according to an embodiment of the present application.
[0621] The pixel circuit, the source driving signal line, the X-direction switch selection and the Y-direction switch selection can be included.
[0622] The X-direction switch selection and the Y-direction switch selection can be connected to the two TFT switches in front of the pixel circuit. Through the series connection of the two TFT switches, when the X-direction switch selection and the Y-direction switch selection simultaneously select both of the two TFT switches, the pixel circuit can be connected to the source driving signal line, and can receive the pixel data sent by the source driving signal line for refreshing.
[0623] If either of the X-direction switch selection and / or the Y-direction switch selection does not select any TFT switch, the pixel circuit is not connected to the source driving signal line, and cannot receive the pixel data sent by the source driving signal line, so that refreshing is not performed.
[0624] It can be understood that other pixels in the display area can adopt the structure shown in FIG. 2, and each pixel in the display component of the display terminal can also adopt the structure shown in FIG. 2, so as to realize pixel-level refreshing.
[0625] In summary, the display terminal can support pixel-level refreshing, so as to conveniently improve the accuracy of local refreshing and the efficiency of refreshing.
[0626] Eight, adaptation of the display terminal.
[0627] In an optional embodiment, since the display terminal needs to support local refreshing, the local refreshing content and the local refreshing position need to be obtained.
[0628] If the display terminal obtains the display instruction from the local, the local of the display terminal can be improved to conveniently provide the local refreshing content and the local refreshing display.
[0629] If the display terminal obtains the display instruction from the external device, the external device can be improved to provide the local refreshing content and the local refreshing display, or the display terminal itself can further determine the local refreshing content and the local refreshing position according to the overall refreshing content provided by the external device.
[0630] And considering that the current external device usually directly transmits the whole frame image, in order to improve the adaptability of the display end, adapt to the current external device, so that the display end can determine the partial refresh content and the partial refresh position according to the whole refresh content provided by the external device, to support flexible switching between partial refresh display and whole refresh display.
[0631] Therefore, optionally, the obtained display instruction can include the whole refresh content. If the display end obtains the display instruction from the external device, the external device that can only provide the whole refresh content can be connected, improving the adaptability of the display end.
[0632] The above method flow can further include: pre-storing the currently displayed image frame.
[0633] Based on the obtained display instruction, the partial refresh content and the partial refresh position are determined, which can be: for the whole refresh content in the obtained display instruction, determining the difference part with the stored image frame; based on the determined difference part, determining the partial refresh content and the partial refresh position.
[0634] For specific explanations, please refer to the explanation of S102 above.
[0635] Optionally, if it is determined that the whole refresh content in the obtained display instruction has no difference with the stored image frame, no refresh display can be performed, and the currently displayed image frame can be maintained.
[0636] Correspondingly, since the display instruction to be obtained includes the whole refresh content, the display end can support whole refresh display and partial refresh display, so that it is necessary to facilitate switching between whole refresh display and partial refresh display.
[0637] Optionally, the case where partial refresh needs to be performed can include: obtaining the display instruction in the case where it is determined that the whole of the current display area does not need to be refreshed. That is, in addition to whole refresh display, the display instruction can be obtained for partial refresh display.
[0638] Correspondingly, in the case where it is determined that the whole of the current display area needs to be refreshed, it is determined that the whole refresh content contained in the obtained display instruction; in the case where no refresh display is currently performed, the determined whole refresh content is refreshed and displayed to the whole of the current display area.
[0639] For specific explanations, please refer to the explanations above.
[0640] Nine, about the control end.
[0641] In an alternative embodiment, the method further provides a control terminal which can be connected to the display terminal and used to send display instructions to the display terminal. The control terminal can be regarded as an external device as explained above.
[0642] Optionally, the control terminal can be used to control the display terminal, for example, to control the refresh display mode of the display terminal.
[0643] The method is not limited to the specific form of the control terminal. Optionally, the control terminal and the display terminal can be different devices in the same device or different components in the same device. For example, the control terminal and the display terminal can belong to the same computer, the control terminal can be the host, and the display terminal can be the display screen. The control terminal and the display terminal can be different devices connected by wired or wireless means. For example, the control terminal can be a mobile phone, and the display terminal can be a display device for screen projection.
[0644] Optionally, the display terminal can be connected to the control terminal. The display instructions can be obtained, for example, by obtaining the display instructions sent by the control terminal. The display instructions sent by the control terminal can include any of the following: 1) overall refresh content; 2) partial refresh content and partial refresh position.
[0645] The control terminal can generate overall refresh content or partial refresh content and partial refresh position.
[0646] For ease of understanding, the control terminal can generate a complete next frame image as overall refresh content and send it to the display terminal. The control terminal can also generate partial refresh content and partial refresh position and send it to the display terminal for partial refresh display.
[0647] The control terminal can generate partial refresh content and partial refresh position according to its own needs.
[0648] For example, the control terminal has low processing capability and is difficult to generate enough complete images, which makes it difficult to meet the refresh rate requirements of the display terminal. Therefore, the control terminal can generate partial refresh content and partial refresh position to meet the refresh rate requirements with less image content.
[0649] For another example, the content requirements of the control terminal require the generation of partial refresh content and partial refresh position. Specifically, temporary pop-up notifications can be generated, and the corresponding window content can be generated as partial refresh content.
[0650] For another example, the control terminal improves the refresh rate by partial refresh display to improve the efficiency of image content generation, etc.
[0651] The method is not limited to the timing of sending display instructions by the control terminal.
[0652] Optionally, the display instruction can be sent by the control terminal at any time, and the display terminal can store and refresh and display the image data one by one. Alternatively, the control terminal can determine the sending opportunity according to the refreshing and displaying of the display terminal.
[0653] For example, the control terminal can send the display instruction when it is determined that the refreshing and displaying of the display terminal is completed and the display terminal is not refreshing and displaying at present, so that the display terminal directly refreshes and displays.
[0654] Optionally, the control terminal can be configured to send the display instruction when it is determined that the display terminal is not refreshing and displaying at present.
[0655] By determining the refreshing and displaying of the display terminal, the display instruction can be sent when it is determined that the display terminal is not refreshing and displaying, so as to reduce the risk of refreshing and displaying conflict. In addition, the storage pressure of the display terminal can be reduced.
[0656] The embodiment is not limited to the specific condition of determining that the display terminal is not refreshing and displaying at present.
[0657] Optionally, the control terminal can actively request the refreshing and displaying state of the display terminal at present, or the display terminal can actively feed back the refreshing and displaying state to the control terminal, or the control terminal can determine the refreshing and displaying state by itself without interaction.
[0658] For example, the display terminal can actively send a signal to represent the refreshing and displaying state at present through the connection with the control terminal.
[0659] The display terminal can be connected to the control terminal through an additional wired connection and send the signal, or can send the signal through a wireless connection.
[0660] Optionally, the condition of determining that the display terminal is not refreshing and displaying at present can include at least one of the following:
[0661] 1) The control terminal determines that the display terminal has completed refreshing and displaying the image data sent last time at the present time based on the amount of the image data sent last time.
[0662] 2) The control terminal receives an idle signal sent by the display terminal.
[0663] The idle signal can be used to represent that the display terminal is not refreshing and displaying at present.
[0664] The embodiment is not limited to the specific way of determining that the display terminal has completed refreshing and displaying the image data sent last time at the present time.
[0665] Optionally, the control end can determine or acquire the refresh display speed of the display end in advance, which can be the time length for refreshing a single row of pixels, so that the time when the display end completes the refresh display can be calculated according to the amount of image data sent last time.
[0666] Specifically, the time length for completing the refresh display can be obtained by multiplying the number of pixel rows contained in the amount of image data sent last time by the time length for refreshing a single row of pixels, so that it can be determined whether the time length between the current time and the sending time is greater than the obtained completion time length.
[0667] Of course, considering the time consumption in the sending process, it can be further determined whether the time length between the current time and the sending time is greater than the sum of the obtained completion time length and the transmission time length.
[0668] In addition, since the overall refresh display is the maximum refresh amount, the time length for one overall refresh display is usually greater than the time length for one local refresh display. The control end can also determine or acquire the time length for one overall refresh display of the display end in advance, so that it can be determined whether the time length between the current time and the sending time is greater than the time length for one overall refresh display.
[0669] Of course, considering the error and other time consumption, the time length for multiple consecutive overall refresh displays can also be used as a judgment standard. For example, it can be determined whether the time length between the current time and the sending time is greater than the time length for two consecutive overall refresh displays.
[0670] As for the idle signal, the embodiment does not limit the specific form of the idle signal.
[0671] Optionally, the form of the idle signal can include any of the following: high level, low level, and pulse signal.
[0672] For example, between the display end and the control end, the display end can continuously send signals to represent the current refresh display situation of the display end.
[0673] Specifically, the display end can continuously maintain a high-level signal and send it to the display end to represent that the refresh display is being performed during the refresh display process. The display end can continuously maintain a low-level signal and send it to the display end to represent that the refresh display is not being performed during the refresh display completion process.
[0674] Of course, it can also be the other way around, that is, high level represents that the refresh display is not being performed, and low level represents that the refresh display is being performed.
[0675] In addition, it can also be represented by a pulse signal. For example, three consecutive pulse signals can represent that the refresh display is not being performed.
[0676] The method flow does not limit the specific manner and timing of the control end judging whether the display end is currently refreshing display.
[0677] Optionally, the control end can be configured to judge whether the display end is currently refreshing display in the case of needing to send the display instruction. In the case of determining that the display end is not currently refreshing display, the display instruction is sent. In the case of determining that the display end is currently refreshing display, the display instruction is sent after the display end completes refreshing display.
[0678] The control end can judge in the case of needing to send the display instruction.
[0679] The embodiment does not limit the specific case in which the control end needs to send the display instruction. Optionally, the display end can initiate a refreshing display requirement, for example, the display end needs to perform overall refreshing display. Alternatively, the control end can have a content display requirement, for example, the control end needs to display a video, thereby needing to perform frame-by-frame display according to the playing of the video, and the like.
[0680] The embodiment also does not limit the specific manner of waiting for the display end to complete refreshing display. Optionally, the manner can be continuously monitoring to judge, or the display end can actively send a signal indicating completion of refreshing display, and the like.
[0681] The embodiment also does not limit the specific case of determining that the display end is currently refreshing display.
[0682] Optionally, the case of determining that the display end is currently refreshing display includes at least one of the following:
[0683] 1) The control end determines that the display end has not completed refreshing display of the image sent last time at the current time based on the amount of image data sent last time.
[0684] 2) The control end receives a busy signal sent by the display end.
[0685] The busy signal can be used to represent that the display end is currently refreshing display.
[0686] The embodiment does not limit the specific manner of the control end determining that the display end has not completed refreshing display of the image sent last time at the current time.
[0687] Optionally, the control end can determine or acquire the refreshing display speed of the display end in advance, which can be the time length of refreshing display of a single row of pixels, thereby the control end can calculate the time at which the display end completes refreshing display according to the amount of image data sent last time.
[0688] Specifically, the time length between the current time and the sending time can be determined according to the number of pixel rows contained in the image data sent last time, multiplied by the time length for refreshing a single row of pixels, to obtain a complete refreshing time length, and then it can be determined whether the time length between the current time and the sending time is greater than the obtained complete refreshing time length. If not, it can be considered that the refreshing is not completed.
[0689] Of course, considering the time consumption in the sending process, it can be further determined whether the time length between the current time and the sending time is greater than the sum of the obtained complete refreshing time length and the transmission time length.
[0690] In addition, since the overall refreshing display is the maximum refreshing amount, the time length for one overall refreshing display is usually greater than the time length for one partial refreshing display. The control end can also determine or obtain the time length for one overall refreshing display of the display end, so as to determine whether the time length between the current time and the sending time is greater than the time length for one overall refreshing display.
[0691] Of course, considering the error and other time consumption, the time length for multiple consecutive overall refreshing displays can also be used as a judgment standard. For example, it can be determined whether the time length between the current time and the sending time is greater than the time length for two consecutive overall refreshing displays.
[0692] As for the busy signal, the embodiment does not limit the specific form of the busy signal.
[0693] Optionally, the form of the busy signal can include any of the following: high level, low level, and pulse signal. Specifically, the form of the busy signal needs to be different from that of the idle signal. For specific explanations, refer to the above explanation of the idle signal.
[0694] In an optional embodiment, the control end can be used to control the refreshing display mode of the display end.
[0695] Specifically, the control end can instruct the display end to perform a certain refreshing display mode through a display instruction.
[0696] The embodiment does not limit the specific control mode or indication form.
[0697] For example, the control end can send a display instruction containing partial refreshing content to make the display end determine that partial refreshing display is needed. The control end can also send a display instruction containing overall refreshing content to make the display end determine that overall refreshing display is needed.
[0698] For another example, the control end can send indication information for instructing partial refreshing display, or send indication information for instructing overall refreshing display.
[0699] Optionally, the case that needs to be locally refreshed can include that the obtained display instruction includes local refresh content and local refresh position.
[0700] Correspondingly, based on the obtained display instruction, the local refresh content and the local refresh position are determined, specifically, the local refresh content and the local refresh position contained in the obtained display instruction are determined.
[0701] Optionally, the method flow can further include: in a case that it is determined that the obtained display instruction includes the overall refresh content, determining the overall refresh content in the obtained display instruction; and in a case that the current display is not refreshed, refreshing and displaying the determined overall refresh content to the current display region as a whole.
[0702] Specific explanations can be referred to the explanations of the local refresh display and the overall refresh display above.
[0703] The embodiment is not limited by the basis on which the control end instructs the display end to refresh and display.
[0704] Optionally, the control end can control the refresh and display of the display end according to its own needs, or according to the needs of the display end, or randomly control the refresh and display of the display end. Specific examples can be referred to the above.
[0705] Specifically, the display end can actively initiate a request to the control end to request sending image content for refresh and display. Specifically, the request can be for local refresh and display, or for overall refresh and display.
[0706] Optionally, the method flow can further include that the display end sends an overall refresh trigger signal to the control end in a case that it is determined that the current display region as a whole needs to be refreshed.
[0707] Correspondingly, the display instruction is obtained, specifically, the display instruction containing overall refresh content sent by the control end based on the received overall refresh trigger signal is obtained.
[0708] Of course, the display end can also send a local refresh trigger signal to the control end in a case that it is determined that the current display region needs to be locally refreshed.
[0709] Correspondingly, the display instruction is obtained, specifically, the display instruction containing local refresh content and local refresh position sent by the control end based on the received local refresh trigger signal is obtained.
[0710] In the embodiment, the display end can actively request refresh and display, thereby improving the efficiency of refresh and display.
[0711] The embodiment does not limit the specific condition that the display end needs to refresh the whole current display area. Alternatively, the display end can determine the need for overall refresh display according to its own needs or device failure risk.
[0712] Therefore, the condition that the current display area needs to be refreshed as a whole includes at least one of the following:
[0713] 1) The time length between the current time and the time when the display area was last refreshed is greater than the preset period length.
[0714] 2) It is detected that there are pixel points in the display area that have not been refreshed for a preset detection time length.
[0715] Therefore, the display end can periodically determine the need for overall refresh display. The period length here is not limited and can change with the current environment factors of the display end.
[0716] The display end can also determine the need for overall refresh display according to its own device risk. Specifically, it can detect pixel points that have not been refreshed for a long time, which may have a risk of pixel point failure.
[0717] The method flow does not specifically limit the process of the control end sending a display instruction to the display end. Alternatively, data packets or other forms can be used for transmission and sending.
[0718] The method flow does not limit the specific format of the data packet.
[0719] In an alternative embodiment, if the control end sends a display instruction containing overall refresh content to the display end, the display instruction can be sent to the display end through a data packet, and the display end can analyze and refresh the display after unpacking. The display end can include a decoding module for analyzing the received data packet or display instruction.
[0720] Since the length of the data packet can be fixed, the display instruction can be split into multiple data packets and sent to the display end.
[0721] During the process of receiving and splitting multiple data packets, the display end can be in the state of refreshing the display.
[0722] Alternatively, the display end can receive all data packets sent by the control end, unpack and analyze to obtain the overall refresh content.
[0723] In another alternative embodiment, if the control end sends the display end a display instruction containing partial refresh content and partial refresh location, the display instruction can be sent to the display end through a data packet, and the display end analyzes and unpacks the display instruction to perform refresh display. Specifically, the display end needs to analyze and unpack the partial refresh content and the corresponding partial refresh location, so as to facilitate the display end to determine the partial refresh content to be refreshed and displayed to the corresponding partial refresh location.
[0724] Since the partial refresh content is not fixed in data amount, the data packet can be of indefinite length, and specifically, the maximum data amount of the data packet payload can be determined according to the maximum length of a single data packet received by the display end or the maximum data amount processed by the display end at a time.
[0725] In addition, the data packet can also contain partial refresh content and the corresponding partial refresh location. Specifically, the partial refresh location can be contained in the data packet header, and the corresponding partial refresh content can be contained in the data packet body.
[0726] In addition, the display instruction can be split into multiple data packets, and thus each data packet can contain partial refresh content and the corresponding partial refresh location.
[0727] Optionally, the control end can be configured to: determine the maximum length of a data packet received by the display end; determine a display instruction containing partial refresh content and partial refresh location; split the partial refresh content and the partial refresh location in the determined display instruction into at least one corresponding relationship between refresh content and refresh location, generate a data packet based on each corresponding relationship obtained by the splitting; the length of the generated data packet is not greater than the determined maximum length of the data packet; and send the generated data packet to the display end, so that the display end obtains the determined display instruction.
[0728] The manner of splitting the partial refresh content is not limited in the embodiment, as long as the length of the subsequently generated data packet is not greater than the maximum length of the data packet.
[0729] The embodiment also does not limit the manner of determining the maximum length of the data packet. Optionally, the maximum data amount received by the display end at a time can be obtained or determined to further determine the maximum length of the data packet, or the maximum data amount cached by the display end at a time can be determined to further determine the maximum length of the data packet, and the like.
[0730] Optionally, for multiple data packets, the control end can send the data packets to the display end in parallel, and the display end can unpack the data packets in parallel or serially.
[0731] The control end can also send the data packets to the display end serially, and the display end can unpack the data packets in parallel or serially.
[0732] In order to improve the efficiency of the partial refresh display, since the data packet contains the partial refresh content and the corresponding partial refresh position, the partial refresh display can be directly performed for each received data packet.
[0733] Optionally, the control end can send the data packets one by one, and the display end can perform the partial refresh display after receiving each data packet. During the refresh display, the control end can stop sending the data packets, and then send the next data packet after the current refresh display is completed.
[0734] Of course, the control end can continue to send the data packets during the refresh display, and the display end can cache the received data packets.
[0735] Optionally, the image content in the data packet can be compressed image content. Therefore, the data packet can also carry compressed parameter information to facilitate the display end to perform decompression.
[0736] The compressed parameter information can be, for example, a compression algorithm, a decompression method, a decompression parameter, and the like.
[0737] In addition, the data packet can also contain information of the refresh display method, which can indicate the partial refresh display or the overall refresh display.
[0738] Ten, bilateral method embodiment.
[0739] The embodiment of the application also provides another embodiment of a display refresh method.
[0740] As shown in FIG. 3, FIG. 3 is a flowchart of another display refresh method according to an embodiment of the application.
[0741] The display end can contain a display area displaying an image, and the display end can currently display an image frame, so that the partial content update can be performed based on the displayed image frame, and the partial refresh display is facilitated.
[0742] The embodiment of the application does not limit the specific form of the display end. Optionally, the display end can be a device or terminal with display function, or a device or terminal containing a display screen.
[0743] For example, the display end can be a display, which can be connected to other devices for display. The display end can also be a display component, which is assembled with other components into a device. Specifically, the display end can be a mobile device, a mobile phone, a smart bracelet, an AR device, a VR device, a computer, a tablet computer, and the like.
[0744] It should be noted that the display end in the method flow can be any product or component with display function, such as electronic paper, a mobile phone, a tablet computer, a television, a notebook computer, a digital photo frame, a navigation device, and the like.
[0745] The method can include the following steps.
[0746] S201: The control end sends a display instruction to the display end.
[0747] S202: The display end acquires the display instruction sent by the control end; in a case where it is determined that local refresh display is needed for the current display area, based on the acquired display instruction, the local refresh content and the local refresh position are determined; in a case where no refresh display is currently being performed, the determined local refresh content is refreshed and displayed in the current display area at the determined local refresh position.
[0748] The above method flow performs local refresh display by the display end, reduces the amount of data that needs to be refreshed and displayed, and can further improve the efficiency of refresh display.
[0749] Optionally, the above method flow further includes:
[0750] In a case where it is determined that overall refresh display is needed for the current display area, the display end determines overall refresh content based on the acquired display instruction; in a case where no refresh display is currently being performed, the determined overall refresh content is refreshed and displayed in the current display area as a whole.
[0751] Optionally, the case where overall refresh display is needed for the current display area includes at least one of the following:
[0752] 1) The time length between the current time and the time when the display area was last refreshed as a whole is greater than a preset period of time.
[0753] 2) The number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number.
[0754] 3) The acquired display instruction includes overall refresh content.
[0755] Optionally, the case where local refresh display is needed for the current display area includes at least one of the following:
[0756] 1) The acquired display instruction includes local refresh content and a local refresh position.
[0757] 2) The display instruction is acquired in a case where it is determined that the current display area as a whole does not need to be refreshed.
[0758] 3) The display instruction is acquired.
[0759] 4) The display instruction is acquired.Optionally, the method further comprises: in a case that the display is currently performing refresh display, waiting for completion of the current refresh display, and then refreshing the determined partial refresh content into the current display region at the determined partial refresh position.
[0760] Optionally, the method further comprises: the display pre-stores an image frame currently displayed; after determining the partial refresh content and the partial refresh position based on the obtained display instruction, the display performs frame interpolation processing on partial starting content at the partial refresh position in the stored image frame and the determined partial refresh content, to obtain at least one partial frame-interpolated content.
[0761] The refreshing of the determined partial refresh content into the current display region at the determined partial refresh position comprises: the display sequentially refreshes the obtained partial frame-interpolated content and the determined partial refresh content into the current display region at the determined partial refresh position.
[0762] Optionally, the display comprises pixel-level driving; the refreshing of the determined partial refresh content into the current display region at the determined partial refresh position comprises: based on the pixel-level driving, the determined partial refresh content is refreshed into the current display region at the pixel points at the determined partial refresh position.
[0763] Optionally, the display region comprises a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; in a case that the corresponding row switch signal and the corresponding column switch signal represent opening, the corresponding pixel point is used for refresh display.
[0764] The refreshing of the determined partial refresh content into the current display region at the determined partial refresh position comprises:
[0765] In the current display region, for the pixel points at the determined partial refresh position, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing opening.
[0766] The determined partial refresh content is refreshed into the current display region at the pixel points at the determined partial refresh position.
[0767] Optionally, the obtained display instruction comprises an overall refresh content; the method further comprises: the display pre-stores an image frame currently displayed; the determining of the partial refresh content and the partial refresh position based on the obtained display instruction comprises: the display determines a difference part for the overall refresh content in the obtained display instruction and the stored image frame; and the partial refresh content and the partial refresh position are determined based on the determined difference part.
[0768] Optionally, the case where the local refresh needs to be performed includes: obtaining the display instruction in a case where it is determined that the current display region as a whole does not need to be refreshed;
[0769] The method further includes: determining the overall refresh content included in the obtained display instruction in a case where it is determined that the current display region as a whole needs to be refreshed; and refreshing and displaying the determined overall refresh content to the current display region as a whole in a case where the current display region is not being refreshed.
[0770] Optionally, the display instruction sent by the control terminal includes any one of the following: 1) overall refresh content; and 2) local refresh content and a local refresh position.
[0771] Optionally, the control terminal sends the display instruction in a case where it is determined that the current display region is not being refreshed.
[0772] Optionally, the case where the current display region is not being refreshed includes at least one of the following:
[0773] 1) the control terminal determines, based on an amount of image data sent last time, that the current display region has completed refreshing and displaying the image data sent last time.
[0774] 2) the control terminal receives an idle signal sent by the display terminal; the idle signal is used to indicate that the current display region is not being refreshed.
[0775] Optionally, the idle signal is in any one of the following forms: a high level, a low level, and a pulse signal.
[0776] Optionally, the control terminal determines whether the current display region is being refreshed in a case where the display instruction needs to be sent; sends the display instruction in a case where it is determined that the current display region is not being refreshed; and waits for the display terminal to complete refreshing and displaying after determining that the current display region is being refreshed, and then sends the display instruction.
[0777] Optionally, the case where the current display region is being refreshed includes at least one of the following:
[0778] 1) the control terminal determines, based on an amount of image data sent last time, that the current display region has not completed refreshing and displaying the image data sent last time.
[0779] 2) the control terminal receives a busy signal sent by the display terminal; the busy signal is used to indicate that the current display region is being refreshed.
[0780] Optionally, the case where the local refresh needs to be performed includes: the obtained display instruction includes local refresh content and a local refresh position.
[0781] Based on the obtained display instruction, the partial refresh content and the partial refresh position are determined, including:
[0782] The display end determines the partial refresh content and the partial refresh position contained in the obtained display instruction.
[0783] Optionally, the method flow further includes:
[0784] In the case that the display end determines that the obtained display instruction includes the overall refresh content, the display end determines the overall refresh content in the obtained display instruction; and in the case that the current display is not refreshed, the determined overall refresh content is displayed to the overall current display region.
[0785] Optionally, in the case that the display end determines that the overall current display region needs to be refreshed, the display end sends an overall refresh trigger signal to the control end; and the display instruction is obtained, including that the display end obtains the display instruction containing the overall refresh content sent by the control end based on the received overall refresh trigger signal.
[0786] Optionally, the case that the overall current display region needs to be refreshed includes at least one of the following:
[0787] 1) the time length between the current time and the time of the last refresh of the overall display region is greater than a preset period length; and 2) it is detected that there is a pixel point in the display region that has not been refreshed for a preset detection time length.
[0788] Optionally, the control end determines the maximum length of a data packet received by the display end; determines the display instruction containing the partial refresh content and the partial refresh position; splits the partial refresh content and the partial refresh position in the determined display instruction into at least one corresponding relationship of refresh content and refresh position, respectively generates data packets based on each corresponding relationship obtained by the splitting; the length of the generated data packet is not greater than the determined maximum length of the data packet; and the generated data packet is sent to the display end, so that the display end obtains the determined display instruction.
[0789] The specific explanation of the method flow can be referred to the above.
[0790] In order to facilitate understanding, the application embodiments further provide a plurality of application embodiments.
[0791] In order to facilitate description, the control end can be specifically a system, and the display end can be specifically a display screen.
[0792] Application Embodiment One.
[0793] In the traditional display driving architecture, the system and the display screen always work at a fixed image frame rate, for example, always refresh the display content at a frequency of 60Hz, and maintain the same display mode.
[0794] In the new display driving architecture, when the system and the display screen work in different display modes, for example, only the local image content is updated, the display system needs to be switched in different display modes. During the switching process, it is necessary to ensure that the display screen has completed the image display driving to avoid data conflict or loss.
[0795] Under this application, the system needs to send a state feedback signal based on the working state of the display screen to complete the synchronization of different display states.
[0796] Three different state synchronization mechanisms are provided in this embodiment, including a mechanism for display driving time calculation and switching through clock counting based on the conventional display architecture; an additional single-ended level signal representing the state feedback signal of whether the display screen has completed display driving; and a superimposed pulse characteristic signal representing the difference between multiple display modes and matching different signal level characteristics.
[0797] The three different synchronization mechanism schemes are aimed at different types of applications and different control flexibility.
[0798] The effect of the above scheme is to ensure the driving timing control flexibility of the display screen through the synchronization feedback of the display state of the two ends, to more fully and effectively utilize the charging time based on the physical characteristics of the screen by the display screen host, and to feedback the state to the system at the first time after completing the display driving, so that the system judges to perform a new round of display driving or switch to a new display mode, realizing more flexible driving.
[0799] The present embodiment relates to a new type of intelligent partition display driving architecture, which is suitable for different display technologies such as LCD / OLED and is aimed at large data display driving products with high resolution and high refresh rate.
[0800] In the traditional display driving technology, the display screen is always driven in the complete image frame mode, i.e., fixed pixel resolution size and fixed frame rate. The communication interaction mechanism between the system and the display screen reads the basic parameter (such as EDID) information from the display screen after power-on, and configures the image rendering and interface transmission of the system according to this parameter information. After that, there is no state interaction between the two, and the display screen passively receives the front-end image data content and performs scanning driving.
[0801] In this driving architecture, the display screen end cannot feedback to the system end when the driving timing needs to be adjusted, and can only cache data at the display screen end, causing additional consumption of cost and power consumption; the system end is also unaware of the actual display driving state of the display screen, which may adjust the timing to increase the margin to ensure the completion of display driving, causing insufficient application of driving time.
[0802] The embodiment can realize feedback interaction of the state of the system and the display screen end through the state interaction mechanism between the system and the display screen. Any end can flexibly control through the feedback mechanism, solve the problem that the display screen passively receives data in the traditional driving mode, and the two ends cannot interact and cooperate.
[0803] The embodiment realizes the following through the data interaction mechanism between the system and the display screen.
[0804] 1) When the display screen end needs to flexibly control the display driving, the front end can be immediately fed back when scanning is completed, and the blanking time is fully utilized; when the scanning driving time needs to be prolonged in special cases, the output time of a new frame of image is delayed through the feedback system, so as to avoid data conflict.
[0805] 2) When the system end performs special control, such as different frame rates or sizes of generated images, whether to perform display update can be judged in combination with the refresh state of the display screen, and special applications such as variable frequency are more flexibly supported.
[0806] The specific scheme will be explained below.
[0807] 1, clock counting.
[0808] As shown in FIG. 4, FIG. 4 is a schematic diagram of an interaction mechanism between a display screen and a system according to an embodiment of the application.
[0809] After both ends are powered on, the system end generally initiates first, reads basic display parameter information (such as EDID) from the display screen end, including but not limited to information such as supported physical resolution, color depth, display frame rate and the like. The implementation mode of this control instruction channel is various, which can be register data reading through an independent IIC or SPI instruction channel, or parameter reading through an embedded AUX channel in, for example, a DP display interface protocol.
[0810] Generally, after the system obtains the above-mentioned display basic parameters, it will generate image content corresponding to the resolution and frame rate according to the parameter information, and transmit the image content to the display screen end through a display data interface, and continuously transmit and display drive. The display data interface also has many conventional interface technologies, such as MIPI, DP, HDMI and the like. However, in the conventional display interface, it is one-way transmission, that is, the system acts as the master to determine when and at what frequency to send data content to the display end, and the display screen passively receives the data from the system end.
[0811] Based on the above-mentioned two-end interaction mechanism, there is no state signal feedback from the display screen end to the front-end system. On the basis of this architecture, the following content can be added to indirectly realize the state feedback control of the two ends through the clock counting of the two ends. Specifically:
[0812] 1) Display screen basic parameter information, increase the display screen in special applications, for the parameter information of driving scan time, for example, in some environmental temperature conditions, the driving time of the scan needs to be extended to ensure the display quality effect, the display driving time in this mode can be defined; For example, when the display screen scans and drives different areas, the delay caused by the physical characteristics of the signal line leads to the charging time difference between the near end and the far end of the screen, and the driving time parameters in different physical position areas of the screen can be defined.
[0813] 2) Add a timing determination module in the system, based on the above-mentioned display screen driving capability information and the current display driving scene mode (such as environmental temperature, display area, etc.), match the corresponding timing signal and display mode.
[0814] As shown in Figure 5, Figure 5 is a schematic diagram of the interaction process between the display screen and the system according to an embodiment of the application.
[0815] After power-on, the system reads the basic parameter information of the display screen, and according to this information, the system controls the display mode and timing.
[0816] When the system enters the full-screen display mode, the full-screen image content is generated and sent to the display screen. When the screen can complete the display output of this part of the image, the basic parameter information is calculated. For example, the basic parameter defines the time T (or the scan frame rate F) supported by the display screen to complete a frame image refresh. The system side counts through the clock, and after T time, it is determined that the display screen has completed the scan update of the current image frame. After that, the system can switch to another display mode according to the application needs, transfer the content or perform other processing.
[0817] Extended application, when the system and the display screen interact and communicate, support only updating the scan local area, then the system side can read the display screen basic parameters, such as the minimum unit supported by the screen for independent scan driving, and the time T' required by the screen to complete the data update of this minimum unit. For example, the screen can support independent driving with N as the minimum unit, then the system will transfer this part of the image content to the screen, and at least N*T' time is required to complete the driving. The system side counts through the clock, and after this time, it is determined that the display screen has completed the content update, and the new area update or switching to other display mode can be performed.
[0818] According to the above-mentioned mode, the display screen and the system do not need additional synchronization signals, and through the definition of the basic parameters and the clock counting of both ends, in actual application, there may be a difference between the internal clocks of the two chips of both ends, or a cumulative error after a period of work. In this case, the clock synchronization can be performed through the clock characteristic signal embedded in the display data.
[0819] For example, in traditional image display interfaces such as MIPI or DP, due to the existence of H-blanking and V-blanking, this period is usually used to transmit configuration information or timing signals such as H-sync and V-sync. On the one hand, the two-end chip can be synchronized through the existing timing characteristic signal, or additional characteristic signals can be defined. When the display receives the characteristic signal, the clock count of both ends is reset, thereby achieving regular or irregular clock synchronization.
[0820] The advantage of the above-mentioned state synchronization mechanism is that no additional signal lines are required between the system and the display screen, and it is completely achieved through programs such as reading register parameters and clock counting.
[0821] 2. Add additional single-ended level signals.
[0822] An independent single-ended signal line can be added between the system end and the display screen end, which is controlled by the display screen. When the screen enters the scan drive or response wait state, it is distinguished by the high and low level states of the signal line, as shown in Figure 6, which is a schematic diagram of the principle of another interaction process between the display screen and the system according to an embodiment of the present invention.
[0823] In a specific application, as shown in FIG7 , FIG7 is a schematic diagram showing another principle of an interaction process between a display screen and a system according to an embodiment of the present invention.
[0824] The system only needs to match the image data content sent in different display states. For example, during full-image rendering and scanning, when a complete frame of image content is sent and the display screen receives and begins full-screen refresh, the state feedback signal level is pulled high to inform the system that the screen is currently being driven. When the full-image scan is complete, the state feedback signal is switched to a low level, indicating that the display screen has completed display driving and can start a new frame scan or enter another display mode.
[0825] Similarly, when the system only needs to update local content on the screen in a special application scenario, it only sends the local area content to the screen, and the display screen receives and performs corresponding screen driving. When completed, it changes the status feedback signal.
[0826] The independent single-ended level signal can represent the driving timing state of the display screen in real time. Specifically, when the screen receives a frame of image content, the traditional method is to fix the scanning time of a frame and display and drive each row. However, in some high-resolution, high-refresh-rate, special process conditions, and special application environments, different positions of the display screen need different display charging times to obtain the optimal display effect. Usually, in the chip of the display screen (such as a timing control chip), a compensation algorithm is used to adjust the timing within a frame of time, thereby improving the brightness uniformity of the display screen. The limitation of this method is that the image content sent by the front-end system is fixed in time per row and per frame. All the compensation methods based on timing adjustment need to be performed within this time unit, and additional data buffer needs to be added in the display screen to ensure the reception and buffering of data, and the adjustable range is limited. Through the state feedback mechanism in this scheme, even to each row, the display screen and the screen can feed back the timing state, and the timing can be matched more accurately from the source.
[0827] 3. Superimposed pulse characteristic signal.
[0828] On the basis of the single-ended signal, the high and low change combination of the level signal is additionally added to represent the special state requirement.
[0829] As shown in FIG. 8, FIG. 8 is a principle schematic diagram of another interaction process between a display screen and a system according to an embodiment of the present application.
[0830] On the basis of the single-ended signal, the front-end characteristic signal is superimposed to represent the need for special display driving based on the requirement of the display screen and the requirement for the system to match the corresponding image rendering.
[0831] The specific implementation mode can refer to the following mode. As shown in FIG. 9, FIG. 9 is a principle schematic diagram of a display screen characteristic signal according to an embodiment of the present application.
[0832] Since this signal is a single-ended signal with high and low level states, the control of the display screen end only needs to realize the actions of pulling high and pulling low of this signal. On this basis, combined with the clock of the chip itself, the time length of maintaining the specific pull high and pull low and the switching can be realized.
[0833] FIG. 9 is one of the relatively simple and intuitive implementation modes. When the display screen needs to refresh the pixel content of the whole image based on the screen characteristics, a special request signal is initiated to inform the system to render the whole image, and after receiving the image content sent by the system, the display screen enters the full-screen refresh stage.
[0834] Here, the display end forms 3 pulse signals on the single-ended signal line through three short-time pull-up and pull-down actions, which are defined as the request signal of full-screen refresh. In practical application, the display end can only initiate one pulse signal, but it is possible to cause misjudgment of the system end due to external signal interference, and therefore 3 identical pulse signals are defined as the minimum unit, and when the system end receives 2 or more pulse signals, it is determined that the current is a valid request signal, and a corresponding response is made.
[0835] In particular, since the system end and the display end can both use the internal clock, and combine the level state of the above-mentioned single-ended state feedback signal, the time maintained by the high and low levels represents more signal characteristics.
[0836] The following summarizes the embodiments.
[0837] 1) The display state synchronization mechanism of the system end and the display end under the driving of multiple display modes (multiple implementation modes). Based on the time difference in image update completion of the display screen under different display modes, the synchronization mechanism ensures timely feedback to the system end, thereby matching the consistency of the two ends under different working modes.
[0838] 2) The display system supporting multiple display mode switching includes the matching image rendering and transmission of the system end and the driving of the display end under different display modes. The above-mentioned mode switching is based on the display driving of the display screen to complete the current data, and then the display mode is switched, and the mechanism of the display state synchronization of the two ends during the switching is performed.
[0839] 3) The state synchronization method of calculating the driving time required by different display modes based on clock counting through the respective digital working clocks of the system and the display screen chip. The working time of the display screen under different display modes is read by the system end after power-on, and the reference of clock counting is obtained based on the calculation.
[0840] 4) The state feedback single-ended signal between the system and the display screen represents whether the display screen has completed the display driving state, which is fed back to the synchronization mechanism of the system end.
[0841] 5) Under the above-mentioned state of the display screen supporting more flexible pixel charging sequence based on the physical characteristics of different positions of screen refresh, the internal timing control chip of the display screen sets different charging sequences, and sends the display driving state synchronization signal to the system end after completion.
[0842] 6) On the basis of the above-mentioned single-ended signal, the high and low level pulse characteristics of the signal are superimposed to achieve the function of specifying the switching representation of different display states, and the state synchronization mechanism is initiated from the display screen end to proceed in both ends.
[0843] 7) On the basis of the above-mentioned superimposed pulse signal, the digital clock inside the system and the display screen is matched, the time of maintaining the high and low level of the pulse is adjusted, so as to achieve more state characteristic signals of signal combination, and realize more display state switching or request signals.
[0844] Application embodiment two.
[0845] In the traditional display driving technology, the system generates images, data transmission and display screen driving are all operated in a fixed full-screen pixel size and fixed refresh frequency mode. With the improvement of display demand, the limited hardware resources become the bottleneck of a large amount of data presentation.
[0846] In this embodiment, different display modes are matched through the physical characteristics of different devices and the needs of content update in application scenarios. At the same time, different display modes are supported in the system, display screen and data interaction interface, and a new interaction mechanism is defined to ensure smooth and seamless switching between different stages.
[0847] 1) Fixed frequency refresh mode, based on the physical characteristics of the display screen, such as pixel capacitance charge retention, liquid crystal polarity inversion, OLED device compensation and other specialities, the basic full-screen refresh is maintained at a fixed frequency.
[0848] 2) Instant refresh mode, in addition to the full-screen refresh in the above-mentioned mode, the local content of the display can be refreshed in time and high frequency based on the needs of content update in application scenarios, to meet the needs of efficient update of effective data content of the display.
[0849] During the work of different modes, the state switching master comes from different chips or terminals, so through the interaction mechanism of state switching, the transfer of master control right in different working modes is achieved. For example, the fixed frequency refresh mode is initiated by the display screen master, and the content update of the full screen is initiated at a fixed time interval according to the screen characteristics. The instant refresh mode is controlled by the system end based on the content update needs, and the state switching and synchronization between the two is achieved through various ways.
[0850] This embodiment formulates a plurality of different display modes according to the physical characteristics of the display screen and the content needs of the use scene, and realizes the linkage of the system and the display screen through the interaction mechanism, to achieve seamless and smooth switching between different display modes.
[0851] Through switching of different display modes, on one hand, the basic physical characteristics of the display screen can be ensured, and the full-screen display is stable, and on the other hand, the new, local and high-frequency instant refreshing can be switched according to the needs of the application scene, and the hardware resources are fully utilized to quickly respond to the contents that need to be instantaneously updated in the application.
[0852] The embodiment formulates a plurality of different display modes according to the physical characteristics of the display screen and the content needs of the use scene, and realizes linkage between the system and the display screen through the interactive mechanism, so that seamless and smooth switching between different display modes is achieved, and in the final application, the hardware resources can be more fully and effectively utilized to serve the content update needs of the application scene, while the mixed refreshing display mode of the physical characteristics of the display screen is also considered.
[0853] For example, in the fixed-frequency refreshing mode, based on the physical characteristics of the display screen, the full-screen pixel points are scanned and refreshed in a fixed time interval, so as to ensure that the charge of the pixel capacitor is maintained or the liquid crystal polarity in the LCD display technology is reversed.
[0854] In the instant refreshing mode, based on the content needs of the application scene, when only the local content in the picture is updated, the corresponding area can be quickly refreshed.
[0855] The real-time smooth switching of the above different display modes ensures that the hardware resources can be fully utilized in the case of limited hardware resources, and the display content is efficiently and instantaneously presented.
[0856] The technical scheme will be explained in detail below.
[0857] In the embodiment, first, different working modes of display screen content refreshing are defined according to different application needs, including but not limited to the following working modes:
[0858] 1) Fixed-frequency refreshing mode: the display screen performs line-by-line scanning update of all pixels in the full screen at a fixed frequency.
[0859] Here, the minimum frequency at which the screen needs to be refreshed in full screen is defined based on the physical characteristics of the display screen.
[0860] For example, if the screen supports 10Hz refreshing, the fixed-frequency refreshing mode needs to be refreshed in full screen at least at a frequency of 10Hz, so as to ensure that the charge of the screen pixel capacitor is maintained, and the original image content is maintained. In addition to the above fixed-frequency refreshing time interval, the system can be switched to other working modes according to the actual application.
[0861] As shown in FIG. 10, FIG. 10 is a principle schematic diagram of an interactive mechanism between a display screen and a system according to an embodiment of the present application.
[0862] T0 corresponds to the shortest time interval of the fixed frequency refresh of the display screen, for example, 10Hz, and the interval time is 100ms.
[0863] T1 time, which is agreed that the display screen needs to complete the charging of all pixel points in one full screen when performing fixed frequency refresh, and this time is directly related to the display driving charging speed, and at the same time, this time determines how much time is left in T0 time that can be used to switch to other display modes.
[0864] Before entering this mode, the system content generation has rendered the whole frame of image, and sends the whole frame of image content to the display screen when entering the fixed frequency refresh.
[0865] Further, the minimum frequency of the fixed frequency refresh mode supported by the display screen can also be defined according to the physical characteristics of multiple gears.
[0866] For example, in high temperature and other environments, because of the drift of the display device characteristics, the pixel capacitance charge maintenance characteristics may change, at this time, more frequent full screen pixel point update may be needed, at this time, external environment detection can be matched with the corresponding parameters of the fixed frequency refresh mode.
[0867] 2) Instant refresh mode: based on the content change needs of the application scene, the local content in the display picture is updated. In this mode, the system determines the image content and only renders the local content.
[0868] In this mode, the generation, transmission and display of display content may not be continuous, and the image content size may not be fixed, which is determined by the content difference in the application scene on the one hand, and by the minimum driving unit and driving speed that the display screen can support on the other hand.
[0869] As shown in FIG. 10, in the instant refresh stage, only the person related area in the whole picture is accompanied by task movement, and there is image content update. In this mode, the system only renders this area to generate multiple small picture contents and transmits them to the display screen in turn.
[0870] After receiving, the display screen completes the display update of the current small picture and receives the next small picture content. When there is no content change for a period of time, the display screen is in the instant refresh mode and waits for the front-end content. If there is no content input, it can enter a low-power standby state.
[0871] The above defines two working modes supported by the display screen, and in different modes, the content data volume of the display screen refresh and the working state will be different, so as to ensure the smooth switching of the display state, and a mechanism for assisting the state interaction of the two is needed.
[0872] Fig. 11 is a schematic diagram of another interaction mechanism between a display screen and a system according to an embodiment of the present application.
[0873] Fig. 11 describes the state interaction required by both when switching between different display states. Specifically:
[0874] 1) Fixed refresh request: due to the characteristics of the fixed refresh mode, which is determined based on the physical characteristics of the display screen, the display screen initiates a fixed refresh request to the system during the display process, so that the system generates the content of the full image in this mode.
[0875] The specific "request" sending mode can be achieved in various ways, such as a separate single-ended signal line representing the state, or through instruction transmission, or through a synchronous clock count.
[0876] 2) Full screen refresh in fixed refresh mode: after the system receives the fixed refresh request signal described above, it begins to render the full screen image content. After the content is generated, it enters the fixed refresh mode, and the system sends the full image content in the fixed mode to the display screen. In this mode, the image is a fixed size (the maximum resolution of the display screen) and continuous data content.
[0877] At the same time, the display screen receives the image content for line-by-line display scanning. When the full screen scanning is complete, the display screen sends a state signal to the system to inform the system that the full image scanning and refresh has been completed. After that, it marks the display screen switching from the fixed refresh mode to the instant refresh mode, waiting for the content update from the system.
[0878] 3) Local refresh in instant refresh mode: when the above state switches to instant refresh mode, the display screen waits for the content generation from the front-end system. In this state, the system is in control, and small images are generated based on the content scene rendering. The characteristics are small images, instant multiple frames of content, and the image generation time point is determined based on the content source, and the images are not continuous.
[0879] In this state, when the system generates a small image content, it is transmitted to the display screen. After the screen receives the small image content, it matches and updates the data content locally on the screen.
[0880] Furthermore, the locally updated content can be discrete in multiple locations. To avoid data conflicts caused by the system generating and transmitting new content while the previous small image content is not updated on the display screen, a state synchronization mechanism is required in this mode to ensure that the work of one end is completed. The specific implementation can be achieved through the above state switching mode.
[0881] When the display screen completes the instant content refresh, it enters the passive receiving state of instant response. In this state, it continuously waits for the front-end content rendering to generate and transmit new content. Further, some function modules can be turned off in this state to achieve power saving, leaving only the most basic data receiving detection modules.
[0882] 4) When the time interval enters the next time of fixed frequency refresh, the display screen initiates a fixed frequency refresh request signal again, enters the fixed frequency refresh, and the system generates full-screen content and the display screen refreshes the full screen. This cycle continues.
[0883] In the above different working modes, the data content transmitted by the system end is different. For example, in the fixed frequency refresh mode, the transmitted image content is full-screen size, and all pixels need to be updated row by row. In the instant refresh mode, the transmitted image size is variable, and the position information of the image on the screen needs to be transmitted synchronously. Therefore, in the data stream, the corresponding "display mode" of the image data content and the necessary key parameters (such as coordinate position, size, etc.) in the display process of different modes need to be transmitted synchronously.
[0884] The following extends three display working modes:
[0885] 1) In addition to the above two display modes, more display modes can be integrated based on the needs of display applications, such as interactive detection. After completing display scanning and updating, the external environment image is detected. At this time, the screen end integrates sensor working detection environment image, or temperature and humidity environment information, and sends it to the system end or operation end within a certain time. Through mixed switching of multiple modes, more functions can be integrated.
[0886] Specifically, it can be the display mode when the display screen interacts with the user.
[0887] 2) Further, local display content can be inserted into frame operation to enter the motion high refresh mode.
[0888] For example, in the instant refresh mode, local content is received, but its update frequency is low, and the driving refresh capability of the display screen is stronger. It can generate new content on the display screen end through frame insertion operation in the received two small images, so that smooth transition effect can be obtained in local content high-speed motion based on the basis of full-screen 60Hz refresh.
[0889] For example, in the movie end-credit rolling subtitles, the low refresh frequency causes tailing and lagging problems, but the letter area only occupies a small part of the full screen. At this time, motion high refresh is used to form intermediate transition frames through frame insertion to form a smoother transition effect.
[0890] 3) In practical applications, when using conventional system and data interface technology, the data can also be cached at the display screen end, and the data that needs to be updated can be extracted from it to continue the partial content update.
[0891] In such an architecture, the interaction with the system end in the above-mentioned scheme is not involved, and the functions of switching modes, judging, and transferring the function modules of partial data splitting are transferred to the chip in the display screen.
[0892] For example, the system end always renders the full-screen content (such as 4K) at a fixed frequency (such as 60Hz) and sends it to the display screen through a conventional data interface. At this time, the display screen caches the data and compares and analyzes it with the previous frame of content to determine the size of the content that needs to be updated.
[0893] Therefore, the judgment and processing can be performed by the display screen.
[0894] For static images: the contents of continuous multiple frames of images are the same, the display screen judges to discard the image content by itself, and performs image update at a defined minimum refresh frequency with fixed frequency refresh.
[0895] For partial content update: on the basis of the above, if the display screen judges that only partial changes in the image, after completing the fixed frequency refresh, only the partial image content is transmitted backward and displayed.
[0896] In this mode, the display screen can be considered to update the image at a fixed size and frequency, and conventional system and data interface can be used, which has stronger compatibility.
[0897] All display mode switching can be completed by the display screen itself, and the refresh time of the display content is completely separated from the image sending time of the front end. The entire frame of image content needs to be cached in the display screen, and all received pixel points need to be compared one by one in real time to determine the image difference.
[0898] The following summarizes the embodiments.
[0899] 1) Support multiple different display modes, and matching system, display screen working mode smooth switching mechanism, data and state interaction mechanism. Multi-mode mixed switching, including but not limited to fixed frequency full-screen refresh oriented to display device characteristics, device characteristic compensation driving; local content real-time refresh oriented to application scene characteristics, motion image frame interpolation high-frequency refresh; environment perception integrated detection mode oriented to multi-functional application integration, etc.
[0900] 2) Display supports multiple display modes, and can switch display modes in real time during display. Mixed driving mode of multiple different display mechanisms.
[0901] 3) Face to the physical characteristics of the display screen, the defined fixed frequency full screen refresh mode contains the lowest refresh frequency supported by the display screen, which solves the needs of LCD liquid crystal polarity flip, pixel capacitor charge retention, OLED device aging compensation, etc.
[0902] 4) Face to the application scenario content update, the defined instant refresh mode can update the local content on demand based on the change of the content and realize real-time and high-frequency local effective data content update. The local instant refresh capability parameters associated with the display screen in this mode include but are not limited to the minimum unit size and the highest refresh frequency.
[0903] 5) State feedback mechanism for switching between different display modes, and conversion of the master control end into different display modes (such as when the display screen master control enters the fixed frequency refresh mode, and when the system enters the instant refresh mode based on content).
[0904] 6) Identification instructions required to match the display image data content under different display mode conditions, including but not limited to display mode, image size, image coordinate position, and other necessary basic parameters under other display mode driving.
[0905] 7) The display screen performs multiple display mode judgment and driving switching in the case of compatible conventional system and data interface.
[0906] Application Example Three.
[0907] The conventional display image data interface always maintains the communication transmission in the fixed data stream length and fixed transmission frequency mode. With the improvement of display application data volume and flexibility, the bandwidth utilization rate of the fixed data transmission mode is not high.
[0908] In this embodiment, a new data transmission code stream mode is defined, which supports different display modes through the information embedded in the data packet header.
[0909] On the one hand, it is compatible with the conventional display transmission mode, which transmits data in a fixed row and frame length and frequency, and provides row data packet header auxiliary data counting to ensure the accuracy of received data; on the other hand, it supports variable length and variable frequency independent data packets, and cooperates with the state synchronization signal mechanism between the system and the display screen to ensure the transmission of effective data packet data during the response period of the display.
[0910] At the same time, combined with specific applications, necessary image data packet parameters are embedded in the packet header information, such as image data display coordinate range, display mode, compression mode, etc. The system reads the single continuous code stream length specification of the display screen after power-on, and splits the long code stream data to form multiple independent data packets for separate display transmission.
[0911] The embodiment can not only enhance the correctness detection of received data on the basis of the architecture of the existing image interface, but also support more flexible display data transmission modes and more effective utilization of data bandwidth resources.
[0912] The embodiment defines a new display image data code stream format, supports different display driving modes (such as full-screen driving and region driving), and supports variable-length and non-continuous effective data transmission modes, thereby more effectively utilizing data bandwidth and more flexibly displaying driving timing.
[0913] The embodiment defines a new display image data code stream format, can be compatible with the traditional display data interface and mode, that is, the fixed size and frequency transmission mode, can support the variable size block image data transmission mode, that is, contains display mode feature instructions, block data size, coordinates and the like, the effective data length is variable, the frequency is variable, and the transmission is non-continuous, can support different compression technologies in the front end, and the variable length display image code stream caused by data packet, that is, the display driving data length is different, and the data bandwidth is fully utilized.
[0914] The technical solutions are specifically explained as follows.
[0915] In the new display image data code stream, in order to match different display modes (such as compatible with the conventional fixed length and frequency transmission mode and support the new variable length and frequency non-continuous transmission), additional data packet header (Head) information needs to be added in the data code stream.
[0916] The packet header information needs to at least contain the current display mode and necessary parameters (such as data packet length, display image corresponding coordinate information, image data color format and the like) in different display modes.
[0917] The current display mode can be used to represent local refresh display or overall refresh display.
[0918] The implementation mode of the packet header can be in the form of channel coding + feature code word in the display data interface technology, which is different from the conventional display image data content, thereby avoiding misrecognition and the like. Another mode can be combined with the level state of the state synchronization signal between the system and the display screen, as shown in FIG. 12, which is a principle schematic diagram of interactive data packets between a display screen and a system according to the embodiment of the application.
[0919] When the display screen completes display driving, the state feedback signal is pulled low, and the first data packet sent by the system after that is the packet header information in this scheme.
[0920] As shown in FIG. 12, the display system works between different display modes, when the system and the display screen are in display driving and transmission of a complete image, which corresponds to the traditional display data transmission mode, i.e. the data transmission of the whole frame image is completed in the form of row by row, fixed length, and continuously. In this mode, if the display state synchronization feedback signal is matched, during the display driving, on the one hand, the system continuously sends data to the display screen, and on the other hand, the display screen receives data and performs display driving row by row, when the display driving of the last row is completed, the state synchronization signal is pulled from high to low, indicating that the display driving is completed. In this case, before the image data of the first row, the system needs to transmit the current display mode to the display screen, so that the display screen can completely and continuously receive the image data content, and such information is included in the header information before the image data, as shown in FIG. 13, which is a schematic diagram of data packet interaction according to an embodiment of the present application.
[0921] In this mode, until the whole frame display is completed, each row is always working in the same display mode, and theoretically, there is no need to repeatedly transmit the header information in the image data of each row.
[0922] In particular, this data mode is compatible with the traditional image data interface format, i.e. the H-blanking time of each row is consistent, and there is sufficient time for transmitting the feature instruction, and the header information embedded in each row can assist the display screen to accumulate and count to judge the integrity of the whole frame image data.
[0923] When the working mode between the system and the display screen is not the traditional whole frame display driving mode, it is possible to only update the image content of part of the area, and in this case, the data packet header should represent the new display driving mode and the necessary parameter information in the special mode.
[0924] As shown in FIG. 14, which is another schematic diagram of data packet interaction according to an embodiment of the present application.
[0925] In the special working mode, a segment of data code stream transmitted may correspond to the content of part of the pixels in the display screen, and the header information is added in front of the segment of data code stream, and the first header information received in the correct matching response state of the display screen can be matched by cooperating with the display driving state feedback signal, and a segment of data packet content is continuously received based on this.
[0926] Taking the application of refreshing the display screen area as an example, in this application, the segment of data packet transmitted above corresponds to the content of a block of the display screen driving, and in this mode, the header Head of the display data should at least include the feature information of the "smallest image unit", so that the segment of data packet corresponds to the coordinates X (starting pixel), Y (starting row number), w (pixel width in the same row), and H (number of rows of the display area).
[0927] In particular, the driving physical characteristics of the display screen, such as the maximum number of rows of images supported by a single drive, or the number of rows supported by the internal data buffer of the display screen, will affect the length of the data packet transmitted at a time.
[0928] In the display mode of the above-mentioned scheme, after the display system is powered on, the system reads the supported display mode and the basic display driving capability (such as the number of pixel rows supported by a single drive transmission, or the maximum length of the data packet) from the display screen. Based on the driving capability supported by the display screen, the image packet is divided into multiple and displayed in sequence.
[0929] In particular, in this case, although multiple image packets correspond to a continuous display area, each packet needs to have independent header information in this display mode, which is different from the continuous whole-frame image transmission mode described above.
[0930] Another extended application matches the special data stream in this scheme, such as high-multiplying image compression, or image data content transmitted through a USB or other serial non-display interface. The characteristics of such image data are illustrated by the example of image compression. In the case of pursuing high-multiplying compression, different compression coefficients in different regions within a frame or inter-frame prediction may be involved, which will result in different lengths of image data compression code streams corresponding to each row in a certain time range.
[0931] Through the image code stream format in different display modes in this scheme, the original compressed image code stream can be divided into multiple data packets based on the size of the image packet that the display screen can receive at a time, and then transmitted in sequence to obtain a continuous whole image. In this mode, the header information Head in the above-mentioned data code stream at least includes the display mode of data compression, the basic parameters of compression, the length of the data packet, and the range of the display area.
[0932] Similarly, in the USB or other serial data interface protocol, the transmitted content is sent in the form of a data packet, which is based on data characteristics rather than display characteristics for data division and packetization. In the data interface of this scheme, the serial data packet is divided based on the above-mentioned basic parameters of the display screen, such as the minimum unit of the screen independent drive, the maximum data packet length supported by the buffer, and other characteristics.
[0933] This embodiment breaks the traditional display data interface transmission characteristics of fixed length and fixed frequency, and can match different data packets based on the needs of application scenarios and the display unit capabilities that the display screen can support, and perform independent data transmission.
[0934] At the same time, the traditional whole frame image and the fixed frequency transmission mode are compatible, only through the data packet header information, different display modes and basic parameters are contained, and the display state feedback signal between the system and the display screen is matched to ensure that the data packet header can be normally decoded and recognized in the screen response stage.
[0935] The following is a summary of the embodiment.
[0936] 1) Support multiple display mode image data code streams, compatible with conventional display image data interface, and support variable length, non-continuous display content packet transmission mode, and the display driving state synchronization feedback signal between the system and the display screen.
[0937] 2) Display image data code stream plus header information transmission code stream mode, define the display driving mode corresponding to the data stream, and the necessary data parameters under each mode.
[0938] 3) Match the display state synchronization feedback signal, and the data packet header information received after the display driving is ended as valid data packet decoding.
[0939] 4) Variable length image data code stream, corresponding to local area display content transmission, and defining the starting coordinates, range and other basic parameters of the display area in the header.
[0940] 5) Match the display screen driving ability of long data code stream splitting, read the display screen basic parameter information after power on, based on single display driving, cache data packet length, and split long data code stream into multiple independent packet transmission.
[0941] 6) Compatible with conventional display image data transmission mode, fixed frame image size, frequency transmission mode, and packet header information auxiliary intra-frame line count verification data.
[0942] Application example four.
[0943] In the traditional display driving architecture, whole frame image is rendered, transmitted and displayed, and is updated at a fixed frame rate. When the display driving data volume demand increases, the user needs to receive high-frequency, real-time display of valid information, and the non-concerned or non-updated part occupies additional hardware resources and data bandwidth.
[0944] The embodiment mainly supports the display refresh of valid information based on application scenarios, content and other needs through a new display driving architecture. And the fine control can achieve pixel-level precise intelligent control.
[0945] The embodiment adopts a brand-new driving architecture scheme, is composed of a system image rendering and output module supporting the feature, a display screen supporting pixel-level intelligent driving, and an interactive interface between the two, and illustrates the special function modules that need to be added and improved in the internal parts compared with the traditional driving scheme. Meanwhile, in the architecture scheme, the working mode, interactive mode, and state synchronization mechanism between the system and the display screen are defined.
[0946] The embodiment realizes real-time and efficient display driving of new local content according to the application scenario content update requirement through the new display driving architecture scheme, the system image rendering and transmission mechanism, the special interface interactive mechanism between the system and the display screen, and the new driving mode of the display screen.
[0947] The embodiment improves all the modules of the whole display driving architecture, and all are directed to image rendering and driving in the case of local content update in the application scenario. The benefits mainly lie in the following aspects:
[0948] 1) The display screen also follows the content update requirement, and only the screen part of the pixel points is refreshed, so that the power consumption of the display screen in this application scenario is greatly reduced.
[0949] 2) Relying on the low-frequency driving feature of the display screen, the pixel point content that does not need to be updated is no longer refreshed, is maintained for a certain time, and the storage requirement of the built-in RAM of the display screen is reduced.
[0950] 3) The image transmission mode breaks the traditional image frame concept, that is, when only part of the image is updated in a frame of image, the local image content can be refreshed at a high speed, without waiting for the complete image frame time, so that the display driving time can be maximized, the fast response of effective image content update is improved, and the delay is reduced.
[0951] The technical scheme will be explained in detail as follows.
[0952] To realize the pixel-level intelligent driving architecture based on the content scenario, the following key parts are involved:
[0953] 1) The display screen supporting the pixel-level intelligent driving feature;
[0954] 2) The image rendering and output system module matching the pixel-level intelligent driving feature;
[0955] 3) The data and state interactive interface between the system and the display screen
[0956] As shown in FIG. 15, FIG. 15 is a structure schematic diagram of a pixel-level intelligent driving architecture according to an embodiment of the present application.
[0957] Specifically, the display screen defined in 1) above to support the pixel-level intelligent driving feature needs to have different display modes and can be switched between display modes at any time for mixed application. Different display modes include but are not limited to: ① a fixed frequency refresh mode "fixed frequency refresh" oriented to the basic characteristics of the display screen; and ② an "immediate refresh" oriented to the application scenario content update and performing rapid and high frequency refresh on the local content of the screen.
[0958] To support different display modes, the display screen has the following functional modules:
[0959] ① A basic parameter module for saving the basic characteristic parameters of the display screen, such as the minimum refresh frequency in the fixed frequency refresh mode described above, and the image unit size, data format, refresh frequency and other parameter information supported by the display screen for independent display driving in the immediate refresh mode. After power-on, this basic parameter module is read by the system end (or sent by the display screen) to inform the front end of the intelligent driving capability supported by the display screen, so as to match the image rendering mode and output interaction, etc.
[0960] ② A data stream decoding module, which needs to embed instruction information in the image data stream in the switching of different display modes. For example, embedding the display mode corresponding to the current transmission data, the image coordinates and the area size of the display screen corresponding to the transmission data in the immediate refresh mode, and other parameter information involved in real-time switching and adjustment in intelligent display driving. The above information is embedded in the image data stream, so the display screen needs a data stream decoding module to split the instruction data and the image data.
[0961] The length and position of the instruction information embedded in this embodiment are not fixed, and are not continuous data streams. Therefore, the data stream decoding module needs to correctly intercept the instruction and image data information in the data stream information sent by the front end.
[0962] ③ A timing control module, when the instruction and image data are split, based on the instruction information, the timing control module of the display screen matches the corresponding display driving timing, such as the X-direction switch selection and Y-direction switch selection of the display area corresponding to the image data, and the corresponding source driving chip control output image display voltage signal. To match the pixel-level intelligent driving, the pixel array needs to be controlled independently in X+Y two dimensions, and the corresponding image voltage is loaded to the pixel unit through the driving IC.
[0963] Therefore, the display screen architecture needs independent X+Y switch control circuits of different dimensions, which match the pixel TFT switch of the corresponding position of the pixel array of the display screen based on the module of the previous stage timing control.
[0964] On the other hand, in the timing control module, the current display image content needs to be judged in the display state of the display screen driving, and the system end is informed through the feedback channel, so as to achieve the synchronization of the working state of the two, for example, when the local content is sent, the display screen processes and opens the local switch to refresh, and when the refresh is completed, the system end is informed to send new content and open a new area for refreshing through the feedback mechanism.
[0965] The image rendering and output system module defined in the above 2) needs to judge and split the content (or local change content) that needs to be displayed on the screen in real time based on the application scene and display content of the user, and the size and position of the newly generated image content can be changed in this process. The local content generated by the system needs to be output to the display screen together with the coordinate information.
[0966] Generally, there are two caches at the system image output level, which are used for display output cache and content generation cache, respectively. The two caches are output in turn, and the output control module switches the data path of the two caches in turn according to the fixed frame rate. This module controls the output switching according to the completion of the image rendering of the display card and the display frame rate.
[0967] In this embodiment, the output control module needs to be synchronized with the display screen to ensure that when the local content is displayed and refreshed, the image content is updated on the display end, and then new image data is sent, so as to avoid data conflict.
[0968] At the same time, due to the physical characteristics of the display screen, it needs to be refreshed on the whole screen at a certain time (such as LCD display screen) or device characteristic compensation detection (such as OLED display screen), and the system end also needs to be synchronized with the display screen.
[0969] For example, when matching the LCD display screen, long-time update of local image content will cause the display brightness of the area to change due to the pixel leakage of other areas not updated, so it is necessary to refresh the image data to charge the pixel capacitance. In this case, it is necessary to refresh the whole screen at a fixed frequency (such as 10Hz, 30Hz, etc.).
[0970] The above-mentioned parameter characteristics are saved in the basic parameter module in the display screen characteristic module described in 1), and are read by the system end during the initialization stage of power-on, to determine the parameters of the full-screen fixed-frequency refresh of the display screen, and to control the image rendering based on the parameters.
[0971] The data and state interaction interface defined in the above 3) between the system and the display screen is mainly used to realize the data transmission, state synchronization and other information between the display screen and the system. The specific performance is as follows:
[0972] ① Data channel for reading basic parameters of display screen:
[0973] This part is used to read the basic parameter information of the display screen after the system is powered on, such as the size of the intelligent driving area supported by the display screen, the area accuracy, the supported display mode, the minimum frequency of the fixed frequency refresh, and other basic characteristic parameters. It can be realized by various methods:
[0974] a. Read parameters from the display screen through an independent data channel, such as IIC, SPI, etc.
[0975] b. Read parameters through the bidirectional instruction channel embedded in other display interfaces, such as eDP Aux Channel, etc.
[0976] c. Through the form of software SDK, preset in the system.
[0977] ② Display data communication interface and data stream format:
[0978] The data interface in this embodiment has the following characteristics:
[0979] a. The length of the transmitted data stream is different under the application of area refresh.
[0980] b. In the variable image data stream, the data packet characteristics need to be embedded, including but not limited to the display mode corresponding to the current display data (such as fixed frequency full screen refresh, area refresh, etc.), the pixel coordinates and display area of the area refresh image on the screen, the current transmission data format (such as RGB, YUV, whether to compress, compression parameters, etc.).
[0981] ③ Mechanism for state synchronization between display screen and system end:
[0982] This mechanism is to ensure that under various display driving timing conditions, the system end generates image time and the display screen refresh completion time are not synchronized, at this time, if the system end continuously sends the newly generated local content to the back end, it may cause the display end to complete the previous area content, causing image tearing, data loss, etc. The feasible implementation way is as follows:
[0983] a. Independent single-ended signal line between display screen and system end, represented by display state through high and low level state by display screen.
[0984] b. Through the data communication function embedded in the display data interface, the display screen sends instructions to the system end to represent the display state.
[0985] c. Both parties agree on the exact time of area refresh completion, this parameter can be saved in "basic parameters", and both work at the same time interval.
[0986] Specifically, refer to the above application example one.
[0987] In addition, the embodiment also provides two different architectures.
[0988] Architecture one.
[0989] When the system image is rendered as a regular full-image rendering update, the two buffers are switched in turn at a fixed frame rate, and the content of the complete image frame is output externally, in which case, the traditional display data interface (such as MIPI, DP, HDMI, etc.) is matched. In this working mode, the system end only reads the EDID information at power-on to confirm the basic display data parameters such as the resolution, frame rate, color depth, etc. of the display screen.
[0990] Under this architecture, if the same region image refresh feature is performed at the final display end, for example, only the image is updated, and the power consumption caused by repeated refreshing of the non-updated display region is reduced, then the whole frame image transmitted from the system end needs to be cached at the display screen end, and a data comparison and judgment module is added, from the difference between the front and rear two frames of images, according to the size of the region refresh region supported by the display screen, the region image content and the corresponding coordinate information that need to be refreshed by the screen are calculated and generated.
[0991] As shown in FIG. 16, FIG. 16 is a structure schematic diagram of another pixel-level intelligent driving architecture according to an embodiment of the present application.
[0992] In particular, the following modules are added at the display screen end:
[0993] ① Image difference calculation module, used to receive the whole frame image transmitted from the front-end system, and compare the image content with the previous frame image cached in the display screen in each pixel. At the same time, this module needs to obtain the characteristic parameters of the region refresh supported by the display screen (i.e. the basic parameters of the PSD), so as to convert the image size used for the matching of the region refresh of the display screen based on the compared image difference content, and transmit it to the next image processing module, and at the same time, store the image content of the region update in the N-1 frame data cache for the subsequent image difference comparison of the next frame.
[0994] ② Basic parameter module, same as in the original scheme, needs to save the basic parameter information of the region refresh characteristics that the current display screen can support, the difference is that these parameters are not used for transmission to the front-end system, but only used as parameters for image splitting and processing in the display screen.
[0995] ③N-1 frame data buffer, used to cache the image content of the previous frame when the above-mentioned ① module is working, the size of which should be able to save an entire frame of image, and the minimum unit supporting independent read-write operation thereof should match the data size of the minimum region refresh defined in the above-mentioned ② module, so as to realize the replacement of the minimum data refresh unit after the calculation of the image difference, without replacing the entire frame content.
[0996] In addition to the above-mentioned special modules, the functions of the remaining modules in the display screen are the same as in FIG. 15, that is, the image and the matching timing need to be controlled separately, and the local refresh of the pixel array of the display screen can be controlled.
[0997] The architecture can be used to adapt to a system that only outputs complete image frames.
[0998] Architecture two.
[0999] In the application of eDP display interface, there is a PSR (Panel Self Refresh) function, that is, the system side judges whether the image content before and after the frame changes, when the content is the same, the system side image rendering and data interface are closed, and the entire frame data cached in the display screen chip is refreshed by the display screen according to the fixed frame rate.
[1000] Based on the functions and applications of such a system, the driving architecture can be optimized in combination with the driving architecture of the embodiment, the image difference operation is performed by the system side, the changed region content is transmitted in the PSR function, the display region of the PSR is converted into the coordinate information required by the display region driving of the display screen, and is transmitted backward.
[1001] On this basis, further, still using the above-mentioned architecture, the image content transmitted by the PSR (for example, 1 / 4 frame image content) is still analyzed in the display screen, more accurate region content is extracted therefrom, and is converted into the pixel-level driving smaller image content and coordinates supported by the display screen, so as to realize more accurate display control compared with the PSR function, and at the same time, the traditional display system and data interface architecture are compatible.
[1002] Since the frame rate of the system and data transmission is still the update frequency of the complete image frame, for example, fixed 60 frames, even in the application of the PSR function, the update of the local content (for example, 1 / 4 frame) is also updated at the frequency of 60 frames, and the remaining time is not fully utilized.
[1003] Therefore, on the basis of the above-mentioned architecture scheme, the frame insertion processing of the region update content can be added in the module of the display screen.
[1004] For example, the interval time between 60 frames is 16.6 ms, that is, the system will send new image content with an interval of 16.6 ms, that is, only part of the content is updated, in this case, if the display screen is intelligently driven at the pixel level, only the region is displayed and updated, for example, the updated content is only 1 / 10 of the full screen, then only 1.6 ms is needed to complete the image refresh, and the remaining time is idle time, and the system end has no new content.
[1005] In this case, the display screen has a previous frame image and a current frame image, and can generate another 9 frames of partial content by interpolation operation, for example, in the manner described above, so as to fully utilize the driving hardware resources within 16.6 ms, and to make the transition of the moving image frames smoother and more continuous.
[1006] As shown in FIG. 17, FIG. 17 is a structural schematic diagram of another pixel-level intelligent driving architecture according to an embodiment of the present application.
[1007] The content sent by the system still enters the image difference operation module in the display screen, extracts more fine image change content, and controls the previous frame content extracted from the N-1 frame data buffer to enter the newly added “region image interpolation frame” operation module, calculates the number of intermediate frames to be generated according to the image size, and obtains n frames of content by interpolation, matches the corresponding display screen image coordinates, and is sequentially transmitted to the back end, so as to realize the display output effect of the system sending a small amount of content and high frequency and continuous display on the display screen.
[1008] The following is a summary of the present embodiment.
[1009] 1) The pixel-level intelligent driving architecture scheme includes a system image rendering and output control mechanism, a display screen supporting pixel-level intelligent driving, and a new interactive interface between the two, to realize pixel-level intelligent driving based on the application scene and the content needs from the content generation, data transmission, and display presentation.
[1010] 2) The display screen supporting the pixel-level intelligent driving feature has new features, including but not limited to the “pixel-level intelligent driving PSD basic parameter” module, the “data code stream decoding” module, the “display screen X+Y double-dimension accurate control circuit” module, and the “timing control and state synchronization feedback” module.
[1011] 3) The system image rendering and output control are rendered according to the application scene needs, and new image content is generated; the output control module controls the switching of the output ping-pang buffer, and receives the state feedback of the display screen to control the output of the matching image content.
[1012] 4) The interaction interface between the system and the display screen, including "data channel for display screen basic parameter reading", "display data communication interface and data stream format", "mechanism for status synchronization between the display screen and the system end", and the working mechanism of each link.
[1013] 5) For the physical characteristics of the display screen, different display driving modes are compatible, such as "full-screen fixed frequency refresh" mode and "pixel-level real-time refresh" mode, to solve the problem of charge leakage of the display screen during long-time data retention, compensation processing of OLED devices and other special application requirements; and the display screen and the system end can be switched through the interactive interface according to the working mode.
[1014] 6) Basic parameters of pixel-level intelligent control of the display screen, representing the ability of the display screen to support local display driving, parameterization, and transmission to the front-end image rendering module in the application for generating image size, frequency, etc. during local refresh.
[1015] 7) Display image data stream of indefinite length, containing display image data, and matching display area coordinate information, display working mode, etc., used to represent the current data packet usage scenario and parameters; its characteristics include indefinite length and discontinuous effective data.
[1016] 8) Clock state feedback mechanism, used to avoid conflicts between the working state of the display screen and the front-end image transmission under the characteristics of indefinite length and discontinuous image data, and can be used to represent the clock state and display working state of different chips in the front-end and back-end.
[1017] 9) Architecture scheme for regional content display driving under the application scenario of conventional image processing and data transmission interface, including "image difference operation" module and "previous frame data cache" module, which retrieves PSD basic parameters, extracts image update content of the previous and next frames at the display screen end, matches the corresponding coordinate information, and performs local display.
[1018] 10) Compatible with eDPPSR and similar functions, under the architecture of block image transmission and fixed frequency output by the system end, the "fine image difference operation" module of the driving architecture of the display screen end further extracts image update content based on the PSR transmission content and the display screen PSD driving capability.
[1019] 11) Compatible with PSR driving architecture, under the condition of fixed frequency output of block image by the system end, the driving architecture of the display screen end realizes frame interpolation operation on small block content, realizes local high-frequency refresh, and obtains smooth motion transition effect.
[1020] Various technical features in the above embodiments can be combined in any manner, as long as the combination of features does not conflict or contradict, but the above embodiments are not described one by one due to the limited space, and therefore any combination of various technical features in the above embodiments also belongs to the scope disclosed by the present application.
[1021] Corresponding to the above method embodiments, the present embodiment also provides a device embodiment.
[1022] As shown in FIG. 18, FIG. 18 is a structural schematic diagram of a display refreshing device according to an embodiment of the present application.
[1023] The device can be applied to a display end containing a display area in which an image is displayed; the device comprises:
[1024] An acquisition unit 301 is configured to acquire a display instruction.
[1025] A local unit 302 is configured to, in a case where it is determined that local refreshing display is required for a current display area, determine local refreshing content and a local refreshing position based on the acquired display instruction; and in a case where no refreshing display is currently performed, refresh and display the determined local refreshing content to the current display area at the determined local refreshing position.
[1026] Optionally, the device further comprises:
[1027] An overall unit 303 is configured to, in a case where it is determined that overall refreshing display is required for the current display area, determine overall refreshing content based on the acquired display instruction; and in a case where no refreshing display is currently performed, refresh and display the determined overall refreshing content to the overall current display area.
[1028] Optionally, the case where overall refreshing display is required for the current display area comprises at least one of the following:
[1029] A time length between a current time and a time when the overall display area was last refreshed is greater than a preset time length;
[1030] It is detected that a number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number;
[1031] The acquired display instruction comprises the overall refreshing content.
[1032] Optionally, the case where local refreshing display is required for the current display area comprises at least one of the following:
[1033] The acquired display instruction comprises the local refreshing content and the local refreshing position.
[1034] In a case where it is determined that the current display region as a whole does not need to be refreshed, the display instruction is acquired;
[1035] The display instruction is acquired.
[1036] Optionally, the local unit 302 is further configured to:
[1037] In a case where the current display is being refreshed, after waiting for the current refresh display to be completed, the determined local refresh content is refreshed and displayed in the current display region at the determined local refresh position.
[1038] Optionally, the apparatus further comprises a frame supplement unit 304 configured to: pre-store an image frame currently being displayed; after determining the local refresh content and the local refresh position based on the acquired display instruction, perform frame supplement processing on the determined local refresh content based on a local starting content of the local refresh position in the stored image frame, to obtain at least one local frame supplement content; and refresh and display the obtained local frame supplement content and the determined local refresh content in the current display region at the determined local refresh position.
[1039] Optionally, the display end comprises pixel-level driving; and the local unit 302 is configured to:
[1040] Based on the pixel-level driving, the determined local refresh content is refreshed and displayed in the current display region at the pixel points at the determined local refresh position.
[1041] Optionally, the display region comprises a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; and in a case where the corresponding row switch signal and the corresponding column switch signal represent being turned on, the corresponding pixel point is configured to refresh and display;
[1042] The local unit 302 is configured to:
[1043] In the current display region, for the pixel points at the determined local refresh position, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing being turned on;
[1044] The determined local refresh content is refreshed and displayed in the current display region at the pixel points at the determined local refresh position.
[1045] Optionally, the acquired display instruction comprises an overall refresh content; and the local unit 302 is further configured to: pre-store an image frame currently being displayed; determine a difference part for the overall refresh content in the acquired display instruction and the stored image frame; and determine the local refresh content and the local refresh position based on the determined difference part.
[1046] Optionally, the case that the local refresh needs to be performed includes: obtaining the display instruction in a case that it is determined that the current display region as a whole does not need to be refreshed;
[1047] The apparatus further includes a whole unit 303 configured to: determine the whole refresh content contained in the obtained display instruction in a case that it is determined that the current display region as a whole needs to be refreshed; and refresh and display the determined whole refresh content to the current display region as a whole in a case that the current display region as a whole is not being refreshed.
[1048] Optionally, the display end is connected with a control end.
[1049] The obtaining unit 301 is configured to: obtain the display instruction sent by the control end.
[1050] The display instruction sent by the control end includes any one of the following:
[1051] The whole refresh content;
[1052] The local refresh content and the local refresh position.
[1053] Optionally, the control end is configured to: send the display instruction in a case that it is determined that the current display region as a whole is not being refreshed.
[1054] Optionally, the case that the current display region as a whole is not being refreshed includes at least one of the following:
[1055] The control end determines that the current display end has completed the refresh display of the image data sent last time based on the amount of the image data sent last time.
[1056] The control end receives an idle signal sent by the display end; the idle signal is used to represent that the current display end is not being refreshed.
[1057] Optionally, the form of the idle signal includes any one of the following: high level, low level, and pulse signal.
[1058] Optionally, the control end is configured to:
[1059] In a case that the display instruction needs to be sent, it is determined whether the current display end is being refreshed;
[1060] In a case that it is determined that the current display end is not being refreshed, the display instruction is sent.
[1061] In a case that it is determined that the current display end is being refreshed, the display instruction is sent after the display end completes the refresh display.
[1062] Optionally, the case that the current display end is being refreshed includes at least one of the following:
[1063] The control end determines that the display end has not completed refreshing and displaying the image data at the current time based on the amount of image data sent last time.
[1064] The control end receives the busy signal sent by the display end, and the busy signal is used to represent that the display end is currently refreshing and displaying.
[1065] Optionally, the case that local refreshing needs to be performed includes that the obtained display instruction includes local refreshing content and a local refreshing position.
[1066] The local unit 302 is configured to:
[1067] Determine the local refreshing content and the local refreshing position included in the obtained display instruction.
[1068] Optionally, the apparatus further includes an overall unit 303 configured to:
[1069] In a case that the obtained display instruction includes overall refreshing content, determine the overall refreshing content in the obtained display instruction.
[1070] In a case that refreshing and displaying is not currently performed, refresh and display the determined overall refreshing content to the overall display area.
[1071] Optionally, the overall unit 303 is further configured to: in a case that it is determined that the overall display area needs to be refreshed, send an overall refreshing trigger signal to the control end.
[1072] The obtaining unit 301 is configured to:
[1073] Obtain a display instruction including overall refreshing content sent by the control end based on the received overall refreshing trigger signal.
[1074] Optionally, the case that the overall display area needs to be refreshed includes at least one of the following:
[1075] A time length between the current time and a time at which the overall display area was last refreshed is greater than a preset time length.
[1076] It is detected that there is a pixel point in the display area that has not been refreshed for a preset detection time length.
[1077] Optionally, the control end is configured to:
[1078] Determine a maximum length of a data packet received by the display end.
[1079] Determine a display instruction including local refreshing content and a local refreshing position.
[1080] Split the local refresh content and the local refresh position in the determined display instruction into at least one corresponding relationship of refresh content and refresh position, respectively generate data packets based on each corresponding relationship obtained by the splitting, and the length of the generated data packet is not greater than the determined maximum length of the data packet;
[1081] Send the generated data packet to the display end, so that the display end obtains the determined display instruction.
[1082] For specific explanations, refer to the above method embodiments.
[1083] Corresponding to the above method embodiments, the embodiments of the present application also provide a system embodiment.
[1084] As shown in FIG. 19, FIG. 19 is a structural schematic diagram of a display refresh system according to an embodiment of the present application.
[1085] The system can include a display end and a control end, and the display end includes a display area in which an image is displayed.
[1086] The control end is configured to send a display instruction to the display end.
[1087] The display end is configured to obtain the display instruction sent by the control end, determine local refresh content and a local refresh position based on the obtained display instruction in a case where it is determined that local refresh display is needed for the current display area, and refresh the determined local refresh content to the current display area and the determined local refresh position in a case where no refresh display is currently performed.
[1088] Optionally, the display end is configured to:
[1089] In a case where it is determined that overall refresh display is needed for the current display area, determine overall refresh content based on the obtained display instruction.
[1090] In a case where no refresh display is currently performed, refresh the determined overall refresh content to the entire current display area.
[1091] Optionally, the case where overall refresh display is needed for the current display area includes at least one of the following:
[1092] The time length between the current time and the time when the overall display area was last refreshed is greater than a preset period of time.
[1093] The number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number.
[1094] The obtained display instruction includes overall refresh content.
[1095] Optionally, the case that the display needs to be refreshed locally for the current display area includes at least one of the following:
[1096] The obtained display instruction includes local refresh content and a local refresh position.
[1097] In a case where it is determined that the current display area as a whole does not need to be refreshed, the display instruction is obtained.
[1098] The display instruction is obtained.
[1099] Optionally, the display end is configured to:
[1100] In a case where the display is currently being refreshed, after waiting for the current refresh to be completed, the determined local refresh content is displayed in the current display area at the determined local refresh position.
[1101] Optionally, the display end is configured to: pre-store an image frame currently being displayed.
[1102] After determining the local refresh content and the local refresh position based on the obtained display instruction, the determined local refresh content is subjected to frame interpolation processing based on local start content of the local refresh position in the stored image frame, to obtain at least one local frame-interpolated content.
[1103] The obtained local frame-interpolated content and the determined local refresh content are sequentially displayed in the current display area at the determined local refresh position.
[1104] Optionally, the display end includes pixel-level driving; and the display end is configured to:
[1105] Based on the pixel-level driving, the determined local refresh content is displayed in the current display area at the pixel points in the determined local refresh position.
[1106] Optionally, the display area includes a plurality of pixel points; any pixel point corresponds to a row switch signal and a column switch signal; and in a case where the corresponding row switch signal and the corresponding column switch signal represent being turned on, the corresponding pixel point is configured to display.
[1107] The display end is configured to:
[1108] In the current display area, for the pixel points in the determined local refresh position, the corresponding row switch signal and the corresponding column switch signal are adjusted to signals representing being turned on.
[1109] The determined local refresh content is displayed in the current display area at the pixel points in the determined local refresh position.
[1110] Optionally, the acquired display instruction includes overall refresh content; the display terminal is further configured to: pre-store the currently displayed image frame;
[1111] The difference between the overall refresh content in the acquired display instruction and the stored image frame is determined; and the local refresh content and the local refresh position are determined based on the determined difference.
[1112] Optionally, the situation where a partial refresh is required includes: obtaining a display instruction when it is determined that the entire current display area does not need to be refreshed;
[1113] The display end is also used to: when it is determined that the entire current display area needs to be refreshed, determine the overall refresh content contained in the obtained display instruction; when refresh display is not currently being performed, refresh and display the determined overall refresh content to the entire current display area.
[1114] Optionally, the display terminal is connected to a control terminal;
[1115] The display terminal is used to: obtain the display instructions sent by the control terminal;
[1116] The display command sent by the control terminal includes any of the following:
[1117] Refresh the content overall;
[1118] Partial refresh content and partial refresh location.
[1119] Optionally, the control end is configured to: send a display instruction when it is determined that the display end is not currently refreshing the display.
[1120] Optionally, determining that the display terminal is not currently refreshing the display includes at least one of the following:
[1121] The control end determines, based on the amount of image data sent last time, that the display end has completed refreshing and displaying the image sent last time at the current moment;
[1122] The control end receives an idle signal sent by the display end; the idle signal is used to indicate that the display end is not currently refreshing the display.
[1123] Optionally, the idle signal may be in any of the following forms: a high level, a low level, and a pulse signal.
[1124] Optionally, the control terminal is used to:
[1125] When a display instruction needs to be sent, determine whether the display terminal is currently refreshing the display;
[1126] When it is determined that the display terminal is not currently refreshing the display, sending a display instruction;
[1127] In a case where it is determined that the display terminal is currently performing refresh display, the display instruction is sent after the display terminal completes the refresh display.
[1128] Optionally, the determination of the case where the display terminal is currently performing refresh display comprises at least one of the following:
[1129] The control terminal determines that the display terminal has not completed refresh display of the image data sent last time based on the amount of image data sent last time.
[1130] The control terminal receives a busy signal sent by the display terminal, and the busy signal is used to represent that the display terminal is currently performing refresh display.
[1131] Optionally, the case where partial refresh is required comprises that the display instruction obtained comprises partial refresh content and a partial refresh position.
[1132] The display terminal is configured to:
[1133] The display terminal determines the partial refresh content and the partial refresh position comprised in the display instruction obtained.
[1134] Optionally, the display terminal is further configured to:
[1135] In a case where it is determined that the display instruction obtained comprises overall refresh content, the display terminal determines the overall refresh content comprised in the display instruction obtained.
[1136] In a case where the display terminal is not currently performing refresh display, the display terminal refreshes the overall refresh content to the overall current display area.
[1137] Optionally, the display terminal is further configured to: in a case where it is determined that the overall current display area needs to be refreshed, send an overall refresh trigger signal to the control terminal.
[1138] The display terminal obtains the display instruction comprising overall refresh content sent by the control terminal based on the overall refresh trigger signal received.
[1139] Optionally, the case where the overall current display area needs to be refreshed comprises at least one of the following:
[1140] A time length between the current time and a time when the overall display area was last refreshed is greater than a preset time length.
[1141] It is detected that there are pixel points in the display area that have not been refreshed for a preset detection time length.
[1142] Optionally, the control terminal is configured to:
[1143] The control terminal determines a maximum length of a data packet received by the display terminal.
[1144] The control terminal determines the display instruction comprising the partial refresh content and the partial refresh position.
[1145] Split the local refresh content and the local refresh position in the determined display instruction into at least one set of corresponding relations of refresh content and refresh position, respectively generate data packets based on each corresponding relation obtained by the splitting, and the length of the generated data packet is not greater than the determined maximum length of the data packet.
[1146] Send the generated data packet to the display end, so that the display end obtains the determined display instruction.
[1147] Specific explanations can be referred to the above method embodiments.
[1148] The embodiment of the present application further provides a computer device, which at least includes a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above method embodiments when executing the program.
[1149] The embodiment of the present application further provides an electronic device, which includes at least one processor and a memory in communication connection with the at least one processor, wherein the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute any of the above method embodiments.
[1150] FIG. 20 is a schematic diagram of a computer device hardware structure configured by the method according to the embodiment of the present application, which can include a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040 and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030 and the communication interface 1040 are in communication connection with each other within the device through the bus 1050.
[1151] The processor 1010 can be implemented in the form of a general CPU (Central Processing Unit, central processor), a microprocessor, an ASIC (Application Specific Integrated Circuit, application specific integrated circuit) or one or more integrated circuits, etc., for executing related programs to implement the technical solutions provided by the embodiment of the present application.
[1152] The memory 1020 can be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 1020 can store an operating system and other application programs, and when the technical solutions provided by the embodiments of the present application are implemented by software or firmware, the related program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[1153] The input / output interface 1030 is configured to connect an input / output module to realize information input and output. The input / output module can be configured in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. The input device can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device can include a display, a speaker, a vibrator, an indicator light, etc.
[1154] The communication interface 1040 is configured to connect a communication module (not shown in the figure) to realize the communication interaction between the device and other devices. The communication module can realize communication through a wired manner (such as a USB, a network cable, etc.) or a wireless manner (such as a mobile network, WIFI, Bluetooth, etc.).
[1155] The bus 1050 includes a channel to transmit information between various components (such as the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040) of the device.
[1156] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in the specific implementation process, the device can also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device can also only include the components necessary to implement the embodiments of the present application, and does not necessarily include all the components shown in the figure.
[1157] The embodiments of the present application also provide a computer readable storage medium having a computer program stored thereon, and the program is executed by a processor to implement any of the above method embodiments.
[1158] The embodiments of the present application also provide a computer readable storage medium having a computer program stored thereon, and the program is executed by a processor to implement any of the above method embodiments.
[1159] Computer-readable media includes permanent and non-permanent, movable and non-movable media, which can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device. According to the definition herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carriers.
[1160] The embodiments of the present application also provide a computer program product comprising computer programs / instructions, which, when executed by a processor, implement any of the above method embodiments.
[1161] From the above description of the embodiments, those skilled in the art can clearly understand that the embodiments of the present application can be implemented by means of software plus necessary universal hardware platforms. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in the various embodiments or some parts of the embodiments of the present application.
[1162] The system, device, module or unit illustrated in the above embodiments can be specifically implemented by a computer chip or entity, or by a product with certain functions. A typical implementation device is a computer, and the specific form of the computer can be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[1163] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described above is merely illustrative, wherein the modules described as separate components may or may not be physically separated, and when implementing the embodiment of the present invention, the functions of each module can be implemented in the same one or more software and / or hardware. It is also possible to select some or all of the modules according to actual needs to achieve the purpose of the embodiment. A person of ordinary skill in the art can understand and implement it without paying any creative work.
[1164] The above description is only a specific implementation of the embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the embodiment of the present invention. These improvements and modifications should also be regarded as protection for the embodiment of the present invention.
[1165] In the present invention, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The term "plurality" refers to two or more, unless otherwise clearly defined.
[1166] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the disclosure herein. The present invention is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.
[1167] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A display refresh method, characterized by, The method is applied to a display end, the display end comprising a display area in which an image is displayed, and the method comprises: obtaining a display instruction; in a case where it is determined that local refresh display is required for the current display area, determining local refresh content and a local refresh position based on the obtained display instruction; in a case where no refresh display is currently being performed, refreshing and displaying the determined local refresh content to the current display area at the determined local refresh position.
2. The method of claim 1, wherein, Further comprising: in a case where it is determined that overall refresh display is required for the current display area, determining overall refresh content based on the obtained display instruction; in a case where no refresh display is currently being performed, refreshing and displaying the determined overall refresh content to the entire current display area.
3. The method of claim 2, wherein, The case where overall refresh display is required for the current display area comprises at least one of the following: a time length between a current time and a time at which the last refresh display area was performed is greater than a preset time length; a number of pixel points in the display area that have not been refreshed for a preset detection time length is greater than a preset number; the obtained display instruction comprises the overall refresh content.
4. The method of claim 1, wherein, The case where local refresh display is required for the current display area comprises at least one of the following: the obtained display instruction comprises the local refresh content and the local refresh position; in a case where it is determined that the current display area does not need to be refreshed, obtaining a display instruction; obtaining a display instruction.
5. The method of claim 1, wherein, Further comprising: pre-storing a currently displayed image frame; after determining the local refresh content and the local refresh position based on the obtained display instruction, the method further comprises performing frame interpolation processing on a local starting content at the local refresh position in the stored image frame and the determined local refresh content to obtain at least one local frame interpolation content; the refreshing and displaying of the determined local refresh content to the current display area at the determined local refresh position comprises: refreshing and displaying the obtained local frame interpolation content and the determined local refresh content to the current display area at the determined local refresh position in sequence.
6. The method of claim 1, wherein, The display end comprises pixel-level driving, and the refreshing and displaying of the determined local refresh content to the current display area at the determined local refresh position comprises: refreshing and displaying the determined local refresh content to the current display area at the pixel points at the determined local refresh position based on the pixel-level driving.
7. The method of claim 1, wherein, The display area comprises a plurality of pixel points, and each pixel point is associated with a row switch signal and a column switch signal; in a case where the corresponding row switch signal and the corresponding column switch signal are indicative of being turned on, the corresponding pixel point is used for refresh display; the refreshing and displaying of the determined local refresh content to the current display area at the determined local refresh position comprises: in the current display area, adjusting the corresponding row switch signal and the corresponding column switch signal to signals indicative of being turned on for the pixel points at the determined local refresh position; refreshing and displaying the determined local refresh content to the current display area at the pixel points at the determined local refresh position.
8. The method of claim 1, wherein, The obtained display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; 9. The method of claim 1, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame; The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
10. The method of claim 9, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
11. The method of claim 10, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
12. The method of claim 9, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
13. The method of claim 9, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
14. The method of claim 13, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
15. The method of claim 9, wherein, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame.
16. A display refresh method, characterized by, The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display instruction includes an overall refresh content; the method further includes: pre-storing a currently displayed image frame. The display terminal acquires the display instruction sent by the control terminal; in the case that it is determined that local refresh display is needed for the current display area, based on the acquired display instruction, the local refresh content and the local refresh position are determined; in the case that no refresh display is currently performed, the determined local refresh content is refreshed and displayed into the current display area, and the determined local refresh position.
Citation Information
Patent Citations
Refresh control method and apparatus for display equipment
CN105788542A
Display method of display device, display device and readable storage medium
CN109637406A
Page refreshing method and device, display equipment, storage medium and program product
CN116504167A
Display control system, electronic device and display method
CN116741121A
Screen driving circuit, screen refreshing method and electronic equipment
CN117174009A