Image processing methods, apparatuses, electronic devices, and readable storage media

By determining that the starting write position of the second region image is earlier than the starting write position of the first region image during partial refresh and writing it into the display cache, the problem of screen tearing under high-frequency refresh driven by TE signal is solved, and the display quality is improved.

CN119364080BActive Publication Date: 2026-01-30VIVO MOBILE COMM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411446025.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-16
Publication Date
2026-01-30
Estimated Expiration
2044-10-16

AI Technical Summary

Technical Problem

In a high-frequency refresh environment driven by TE signals, existing technologies cannot solve the problem of screen tearing, resulting in abnormal display content.

Method used

During partial refresh, the first region image corresponding to the partial refresh is determined, and when the position of the synchronization signal is consistent with the position of the high-frequency TE signal, the second region image containing the first region image is determined. The starting write position of the second region image is earlier than the starting write position of the first region image. The second region image is written to the display buffer to avoid conflicts between image reading and writing.

Benefits of technology

It effectively avoids screen tearing, improves the quality of displayed content, and maintains the display effect of a high refresh rate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119364080B_ABST
    Figure CN119364080B_ABST
Patent Text Reader

Abstract

This application discloses an image processing method, apparatus, electronic device, and readable storage medium, belonging to the field of image processing. The method includes: in the case of partial refresh, determining a first region image corresponding to the partial refresh; when the position of the synchronization signal during partial refresh coincides with the position of the high-frequency TE signal, determining a second region image based on the first region image; the second region image includes the first region image, and the starting write position of the second region image precedes the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing flow; and writing the second region image into a display buffer.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of image processing, and specifically relates to an image processing method, apparatus, electronic device, and readable storage medium. Background Technology

[0002] Currently, high-quality display is a crucial component of user experience. However, screen tearing is a common problem in practical applications, leading to a poor visual experience for users. If the image data writing speed is inconsistent with the image data reading speed, a situation will occur where one part of the screen displays the content of the previous frame, while another part displays the content of the current frame, resulting in a screen tearing visual effect.

[0003] When using a high-frequency Timing Enable (TE) signal to control the displayed content, existing partial refresh solutions cannot solve the screen tearing problem due to the high screen refresh rate. This is because even when only a local area is updated, the TE signal continuously reads image data from the display cache for refresh, leading to read and write conflicts.

[0004] Therefore, in the current high-frequency refresh environment driven by TE signals, there is a problem of abnormal display content. Summary of the Invention

[0005] The purpose of this application is to provide an image processing method, apparatus, electronic device, and readable storage medium that can solve the problem of abnormal display content in the current high-frequency refresh environment driven by TE signal in the prior art.

[0006] In a first aspect, embodiments of this application provide an image processing method, the method comprising:

[0007] In the case of partial refresh, determine the first region of the image corresponding to the partial refresh;

[0008] When the position of the synchronization signal during the partial refresh coincides with the position of the high-frequency TE signal, a second region image is determined based on the first region image; the second region image includes the first region image, and the starting write position of the second region image precedes the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing process.

[0009] Write the image of the second region into the display cache.

[0010] Secondly, embodiments of this application provide an image processing apparatus, the method comprising:

[0011] The first determining module is used to determine the first region image corresponding to the partial refresh in the case of partial refresh;

[0012] The second determining module is used to determine a second region image based on the first region image when the position of the synchronization signal during the partial refresh is consistent with the position of the high-frequency TE signal; the second region image includes the first region image, and the starting write position of the second region image is earlier than the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing process.

[0013] The writing module is used to write the image of the second region into the display cache.

[0014] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0015] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0016] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0017] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0018] In the embodiments of this application, in the case of partial refresh, a first area image corresponding to the partial refresh is determined. When the position of the synchronization signal during partial refresh is consistent with the position of the high-frequency TE signal, it indicates that there is a risk of screen tearing. Based on the first area image, a second area image containing the first area image is determined. The starting write position of the second area image is earlier than the starting write position of the first area image, that is, the write time of the second area image is earlier than the write time of the first area image. This is equivalent to writing the second area image into the display cache in advance, which can avoid the conflict between image reading and image writing. Thus, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, and the display quality of the screen content can be improved. Attached Figure Description

[0019] Figure 1This is a schematic diagram of a display process provided in an embodiment of this application;

[0020] Figure 2 This is a schematic diagram of a high-frequency refresh environment driven by a TE signal, provided in an embodiment of this application.

[0021] Figure 3 This is a flowchart of an image processing method provided in an embodiment of this application;

[0022] Figure 4 This is a schematic diagram illustrating a partial display of content provided in an embodiment of this application;

[0023] Figure 5 This is a schematic diagram of a first region image provided in an embodiment of this application;

[0024] Figure 6 This is a schematic diagram of a second region image provided in an embodiment of this application;

[0025] Figure 7 This is a structural diagram of an image processing apparatus provided in an embodiment of this application;

[0026] Figure 8 This is one of the hardware structure diagrams of the electronic device according to an embodiment of this application;

[0027] Figure 9 This is the second schematic diagram of the hardware structure of the electronic device according to an embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0029] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0030] To better explain the embodiments of this application, the following is combined with... Figure 1 The working process of the screen display is explained as follows:

[0031] like Figure 1 As shown, the system-on-chip (SOC) is responsible for processing image data. The SOC transfers the processed image data to the memory on the screen via the MIPIDSI interface.

[0032] The screen internally includes a high-frequency TE oscillator and RAM memory. The high-frequency TE oscillator generates a synchronization signal called TE (Timing Enable), which triggers the screen driver circuit to start working. The RAM memory stores image data and periodically reads the image data and then sends the data to the screen driver circuit.

[0033] The screen driver circuit generates electrical signals to drive the screen based on the image data read from RAM and the received TE synchronization signal. These electrical signals are then transmitted to the display module, causing the screen to display the image.

[0034] Therefore, the SOC is responsible for processing the image, transmitting the image data to the screen RAM via the MIPIDSI interface. Then, the high-frequency TE oscillator inside the screen generates a synchronization signal. The drive circuit, based on the image data in the RAM and the synchronization signal, sends the correct electrical signal to the screen panel, ultimately displaying the image on the screen.

[0035] In the past, the frame rate of electronic devices was equal to the screen TE frequency. For example, the TE frequency was also 120Hz when the frame rate was 120Hz. As electronic devices gradually developed, high-frequency TE was widely used. Under the same frame rate, increasing the TE frequency can improve the image response speed, for example, 240Hz.

[0036] The image processing method provided in this application embodiment can be applied to at least the following application scenarios, in conjunction with the following... Figure 2 Please provide an explanation.

[0037] When the system frame rate is 120Hz, the traditional TE is 120Hz. In a high-frequency TE system, the TE frequency is 120*N Hz, which is explained here as 240Hz (N=2). High-frequency TE and partial refresh are mutually exclusive in principle. When high-frequency TE is enabled, the traditional partial refresh scheme will have display abnormality problems.

[0038] When the rising edge of the TE signal arrives, it indicates that a new display frame has begun to be processed. At this time, the SOC will write the image data of the current frame line by line into the RAM inside the screen through the MIPIDSI interface. The driver IC inside the screen will monitor the status of the TE signal and start reading the image data line by line from the RAM when the falling edge of the TE signal arrives. The driver IC will then display the image on the screen panel according to the read image data.

[0039] like Figure 2 As shown in position ①, after the rising edge of TE is triggered, the SOC can write the image line by line into the on-screen RAM via MIPIDSI, as follows. Figure 2 As shown in position ②, after the falling edge of TE is triggered, the on-screen IC will read data from RAM line by line and update it on the display module.

[0040] In the traditional TE mode, since the SOC write time (① position) is earlier than the screen IC read (② position) and the write speed is greater than the read speed, there will be no situation where the write data row position and the read data row position are on the same row.

[0041] However, in high-frequency TE mode (taking 240Hz as an example), compared to traditional TE, there is an additional TE signal in the middle of each TE. To distinguish them, in a high-frequency TE system, the TEs at the beginning and end of the refresh cycle are called TE1. The TEs in the middle are called TE2, such as... Figure 2 As shown in ③. Taking the time axis as an example, TE1 is generated between every two TE2 signals, for example: TE1-TE2-TE1-TE2-TE1-TE2. Here, TE1 exists as the main signal between each pair of TE2 signals.

[0042] The master signal is the signal that plays a dominant or critical role in high-frequency TE mode. It is responsible for starting or ending a cycle, or for transmitting critical information within the system. The presence of the master signal ensures stable system operation and proper time management.

[0043] TE2 is a signal inserted between each TE1. TE2 is used to ensure that the various components in the system can work synchronously, and can also be used to transmit additional data or control information to support the system's functions.

[0044] like Figure 2As shown in position ④, when triggered by the rising edge of TE, if the SOC has no image to send, MIPIDSI does not need to transmit data. The screen IC will still read the previous frame's image data stored in RAM line by line, as shown in Repeat Frame A. At position ⑤, the screen reads approximately line 800. Local image changes can occur at any position on the screen. If the starting position of the local image is also line 800, the screen RAM write and read will be on the same line, causing a tearing effect and resulting in abnormal display. Therefore, partial refresh cannot be used when high-frequency TE is enabled.

[0045] Writing to and reading from the screen's RAM typically occurs on the same line, which can lead to screen tearing. Screen tearing refers to the simultaneous display of fragments of the previous and current frames on the screen, resulting in abnormal display quality. Because the screen's high-frequency TE synchronization signal is constantly operating, the drive circuit continuously reads data from the RAM to refresh the display in rhythm with the TE signal. Therefore, when the SOC is writing new image data to the RAM, the screen drive circuit may be reading old image data from the same line for display.

[0046] Therefore, when the high-frequency TE synchronization signal is enabled, partial refresh cannot be used because it will cause screen tearing.

[0047] In response to the problems in related technologies, embodiments of this application provide an image processing method, apparatus, electronic device, and storage medium, which can solve the problem of abnormal display content in the current high-frequency refresh environment driven by TE signal.

[0048] The image processing method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0049] Figure 3 This is a flowchart of an image processing method provided in an embodiment of this application.

[0050] like Figure 3 As shown, the image processing method may include steps 310-330, and the method is applied to an image processing device, as detailed below:

[0051] Step 310: In the case of partial refresh, determine the first region image corresponding to the partial refresh;

[0052] Partial refresh refers to updating only a specific area of ​​the display screen on an electronic device, without refreshing the entire display screen.

[0053] The first region of the image is the region where a local refresh occurs, and it is also the smallest image region that needs to be updated. For example... Figure 4 As shown, this is a clock display interface. The part of the clock display interface that is updated is the time display content, while the rest of the display content remains unchanged.

[0054] like Figure 5 As shown, only the region image B corresponding to the time display content changes, while the region images A and C corresponding to the local display content are not updated. Therefore, it is only necessary to determine the first region image B of the local display content.

[0055] Step 320: If the position of the synchronization signal during the partial refresh is consistent with the position of the high-frequency TE signal, determine the second region image based on the first region image; the second region image includes the first region image, and the starting write position of the second region image precedes the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing process.

[0056] High-frequency TE mode refers to a signal transmission method where, under high refresh rate conditions, the electric field vector is perpendicular to the propagation direction when electromagnetic waves propagate through a medium. By optimizing signal transmission and refresh frequency, high-frequency TE mode improves display quality and ensures visual smoothness and clarity under high refresh rate conditions.

[0057] High-frequency TE signal is Figure 2 The TE2 signal in the display buffer can cause screen tearing if the synchronization signal position coincides with the high-frequency TE signal position during partial refresh. The second region image includes the first region image; that is, the second region image is a slightly larger area than the first region. The starting write position of the second region image must precede the starting write position of the first region image to ensure that screen tearing does not occur when new image data is written to the display buffer.

[0058] The electronic equipment system can detect the position of the TE (Tearing Effect) signal in real time, and the TE signal can inform the display controller of the current refresh status of the display panel.

[0059] When the synchronization signal position during partial refresh is at the TE1 position, the refresh position of the display panel and the write position of the display controller are synchronized, and there will be no screen tearing. Therefore, no special processing is required, and the partial image can be updated directly.

[0060] When the synchronization signal position during partial refresh is at the TE2 position, for example, if the current reading position of the display panel is near Line 800, if the partial image is updated directly, screen tearing may occur near Line 800.

[0061] To avoid the risk of image tearing, the update area needs to be expanded to include a slightly larger region, namely the second region image. The starting write position of the second region image must be earlier than the starting write position of the first region image. For example... Figure 6 As shown, a second region image is determined based on the first region image B of the partially displayed content. The second region image can be B1 or B2, where B1 contains B and B2 also contains B, meaning the second region image contains the first region image. The starting write position of B1 precedes the starting write position of B, and the starting write position of B2 precedes the starting write position of B, meaning the starting write position of the second region image precedes the starting write position of the first region image.

[0062] In one possible embodiment, step 320 includes:

[0063] The starting write position of the second region image is determined based on the starting write position of the first region image;

[0064] The second region image is determined based on the starting write position of the second region image.

[0065] The first region image is the smallest region that needs to be updated. To avoid screen tearing, the update range needs to be expanded to the second region image. The starting position of the second region image should be before the starting position of the first region image. This ensures that the entire second region image can be updated smoothly when the TE signal appears.

[0066] The size of the second region image is determined based on the starting write position of the second region image. The second region image should contain the first region image to ensure that the entire region can be updated when the TE signal appears.

[0067] Specifically, the appropriate size of the second area image can be estimated by analyzing the current TE signal position and the refresh rate of the display panel. For example, if the starting write position of the first area image is row 800, then the starting write position of the second area image should be some position before row 800.

[0068] Therefore, when the position of the synchronization signal during the partial refresh coincides with the position of the high-frequency TE signal, the starting position of the second region image is determined based on the starting position of the first region image; and the second region image containing the first region image is determined based on the starting position of the second region image, thus avoiding screen tearing.

[0069] The process of determining the second region image based on its starting write position includes:

[0070] Determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image;

[0071] The starting write position of the second region image is determined based on the transmission speed, the reading speed, the position range of the first region image, and the starting write position of the first region image.

[0072] MIPIDSI Transmission Speed: MIPIDSI is a common display interface standard in mobile devices. It can support very high data transmission rates. Typical MIPIDSI transmission speeds can reach 1-4Gbps or higher, depending on the device's hardware configuration. The transmission speed directly affects the image resolution and refresh rate that can be transmitted.

[0073] Screen chip read speed: The screen chip (i.e., the panel control chip) is responsible for transmitting image data from the memory to the actual display panel. The read speed needs to match the MIPIDSI transfer speed. Typically, high-end display panels can achieve read speeds comparable to MIPIDSI transfer speeds.

[0074] The first region image refers to the smallest image region that is locally updated. The location range of the first region image depends on the specific application scenario, such as whether the update is performed in the upper left corner of the screen or at a certain position in the middle. For example, from row 800 to row 1000.

[0075] The transmission speed, the reading speed, and the location range of the first region image are crucial for achieving high-quality local image updates. Therefore, the starting writing position of the second region image can be determined by comprehensively considering the transmission speed, the reading speed, the location range of the first region image, and the starting writing position of the first region image.

[0076] The determination of the starting write position of the second region image based on the transmission speed, the reading speed, the position range of the first region image, and the starting write position of the first region image includes:

[0077] The write position parameters are determined based on the starting write position of the second region image to be solved, the transmission speed, and the position range of the first region image;

[0078] The read position parameters are determined based on the starting write position of the first region image and the read speed.

[0079] Based on the write position parameter and the read position parameter, a positional relationship is established, which is used to indicate that the parameter value of the write position parameter is less than the parameter value of the read position parameter.

[0080] Solving the positional relationship formula yields the starting writing position of the second region image.

[0081] The write position parameter refers to the position where the image data is written to the display buffer; the read position parameter refers to the position where it is read from the display buffer. Since image data is sent line by line, tearing will occur if the line position written to the display buffer and the line position read from the display buffer are the same. To ensure that no tearing occurs during the line-by-line writing of the second region image B2, it is necessary to ensure that the line position written to the display buffer does not exceed the line position read from the display buffer. Therefore, the following positional relationship is established:

[0082] Line w +V w *t <Line r +V r *t

[0083] Among them, Line w +V w *t is used to represent the write position parameter;

[0084] Line r +V r *t is used to indicate the read position parameter;

[0085] Line_w is the starting write position of the second region image to be solved;

[0086] V w Indicates transmission speed, set by the SOC, in milliseconds (line counts).

[0087] Time t represents the transmission time, which is the ratio of the location range of the first region image to the transmission speed;

[0088] Line r , which is the starting position for writing the first region image, i.e., line 800 in the example above.

[0089] V r , represents the read speed, and is a fixed value;

[0090] Based on the above positional relationship, the minimum starting write position of the second region image can be calculated. For example, Line 600 indicates that the starting write position of the region image needs to be expanded to 600 lines. Figure 6 Position B2 in the diagram.

[0091] Therefore, based on the write position parameter and the read position parameter, a positional relationship is established to indicate that the parameter value of the write position parameter is less than the parameter value of the read position parameter. Solving the positional relationship can quickly and accurately obtain the starting write position of the second region image.

[0092] In one possible embodiment, the positional range between the starting write position of the first region image and the starting write position of the second region image is less than a preset positional range difference.

[0093] When the locations for writing to and reading from the display cache overlap, a tearing effect occurs, requiring the first region image to be expanded into the second region image.

[0094] For example, the position range of the first region image is Line 800 to Line 1000. The processing of the first region image includes: writing to the display buffer line by line starting from line 800, and reading from the display buffer line by line starting from line 800. The writing process and the reading process overlap, which causes tearing problems.

[0095] A second region image is determined based on the first region image; the second region image includes the first region image, and the starting write position of the second region image precedes the starting write position of the first region image.

[0096] For example, the first region image B (Line 800 to Line 1000) is adjusted to the second region image B1 (Line 700 to Line 1000). The processing of the first region image includes: writing to the display buffer line by line starting from line 700, and reading from the display buffer line by line starting from line 800. The writing and reading processes do not overlap, which can avoid tearing problems.

[0097] To reduce the processing resources consumed during the writing process, the positional range between the starting writing position of the first region image and the starting writing position of the second region image can be controlled to be less than a preset positional range difference.

[0098] If the starting write position of the second region image obtained by solving the positional relationship formula is inconsistent with the starting write position of the second region image obtained based on the difference of the preset position range, the smaller starting write position of the second region image shall be taken.

[0099] Step 330: Write the second region image into the display cache.

[0100] The updated second-region image data is written to the display cache so that the display can be updated at the appropriate time. When the next TE signal arrives, the image can be displayed on the screen based on the second-region image data in memory, ensuring that the display content is not torn. This effectively avoids screen tearing problems that occur at specific TE signal locations, improving display quality.

[0101] In one possible embodiment, the image transmission process is resumed in the case of non-partial refresh, or in the case where the position of the synchronization signal during partial refresh is inconsistent with the position of the high-frequency TE signal.

[0102] In the case of a non-partial refresh, that is, a global refresh is being performed, the image transmission process can be resumed. In other words, the SOC will continue to write the image corresponding to the global refresh line by line into the RAM inside the screen through the MIPIDSI interface.

[0103] If the position of the synchronization signal during partial refresh is inconsistent with the position of the high-frequency TE signal, it indicates that there is no risk of screen tearing and the image transmission process can be resumed. That is, the SOC will continue to write the first area image corresponding to the partial refresh line by line into the RAM inside the screen through the MIPIDSI interface.

[0104] Therefore, in the case of non-partial refresh, or in the case of the synchronization signal position and the high-frequency TE signal position being inconsistent during partial refresh, there will be no screen tearing problem. Thus, the image transmission process is restored and the first area image is written to the display buffer.

[0105] In the embodiments of this application, in the case of partial refresh, a first area image corresponding to the partial refresh is determined. When the position of the synchronization signal during partial refresh is consistent with the position of the high-frequency TE signal, it indicates that there is a risk of screen tearing. Based on the first area image, a second area image containing the first area image is determined. The starting write position of the second area image is earlier than the starting write position of the first area image, that is, the write time of the second area image is earlier than the write time of the first area image. This is equivalent to writing the second area image into the display cache in advance, which can avoid the conflict between image reading and image writing. Thus, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, and the display quality of the screen content can be improved.

[0106] The image processing method provided in this application can be executed by an image processing device. This application uses an image processing device executing the image processing method as an example to illustrate the image processing device provided in this application.

[0107] Figure 7 This is a block diagram of an image processing apparatus provided in an embodiment of this application. The apparatus 400 includes:

[0108] The first determining module 710 is used to determine the first region image corresponding to the partial refresh in the case of partial refresh;

[0109] The second determining module 720 is used to determine a second region image based on the first region image when the position of the synchronization signal during the partial refresh is consistent with the position of the high-frequency TE signal; the second region image includes the first region image, and the starting write position of the second region image is earlier than the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing process.

[0110] The writing module 730 is used to write the image of the second region into the display cache.

[0111] In one possible embodiment, the second determining module is specifically used for:

[0112] The starting write position of the second region image is determined based on the starting write position of the first region image;

[0113] The second region image is determined based on the starting write position of the second region image.

[0114] In one possible embodiment, the second determining module is specifically used for:

[0115] Determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image;

[0116] The starting write position of the second region image is determined based on the transmission speed, the reading speed, the position range of the first region image, and the starting write position of the first region image.

[0117] In one possible embodiment, the second determining module is specifically used for:

[0118] The write position parameters are determined based on the starting write position of the second region image to be solved, the transmission speed, and the position range of the first region image;

[0119] The read position parameters are determined based on the starting write position of the first region image and the read speed.

[0120] Based on the write position parameter and the read position parameter, a positional relationship is established, which is used to indicate that the parameter value of the write position parameter is less than the parameter value of the read position parameter.

[0121] Solving the positional relationship formula yields the starting writing position of the second region image.

[0122] In one possible embodiment, the positional range between the starting write position of the first region image and the starting write position of the second region image is less than a preset positional range difference.

[0123] In one possible embodiment, the writing module 730 is further configured to:

[0124] In the case of non-partial refresh, or in the case where the position of the synchronization signal and the position of the high-frequency TE signal are inconsistent during partial refresh, the image transmission process is restored.

[0125] In the embodiments of this application, in the case of partial refresh, a first area image corresponding to the partial refresh is determined. When the position of the synchronization signal during partial refresh is consistent with the position of the high-frequency TE signal, it indicates that there is a risk of screen tearing. Based on the first area image, a second area image containing the first area image is determined. The starting write position of the second area image is earlier than the starting write position of the first area image, that is, the write time of the second area image is earlier than the write time of the first area image. This is equivalent to writing the second area image into the display cache in advance, which can avoid the conflict between image reading and image writing. Thus, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, and the display quality of the screen content can be improved.

[0126] The image processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.

[0127] The image processing apparatus in this application embodiment can be a device with a motion system. This motion system can be an Android motion system, an iOS motion system, or other possible motion systems; this application embodiment does not specifically limit it.

[0128] The image processing apparatus provided in this application embodiment can implement the various processes implemented in the above method embodiments, and will not be described again here to avoid repetition.

[0129] Optionally, such as Figure 8 As shown, this application embodiment also provides an electronic device 510, including a processor 511, a memory 512, and a program or instructions stored in the memory 512 and executable on the processor 511. When the program or instructions are executed by the processor 511, they implement the various steps of any of the above-described image processing method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0130] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0131] Figure 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0132] The electronic device 600 includes, but is not limited to, components such as: radio frequency unit 601, network module 602, audio output unit 603, input unit 604, sensor 605, display unit 606, user input unit 607, interface unit 608, memory 609, and processor 610.

[0133] Those skilled in the art will understand that the electronic device 600 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 610 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0134] The processor 610 is used to determine the first region image corresponding to the partial refresh in the case of partial refresh.

[0135] The processor 610 is further configured to, when the position of the synchronization signal during the partial refresh coincides with the position of the high-frequency TE signal, determine a second region image based on the first region image; the second region image includes the first region image, and the starting write position of the second region image precedes the starting write position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing flow.

[0136] The processor 610 is also used to write the second region image to the display cache.

[0137] Optionally, the processor 610 is further configured to determine the starting write position of the second region image based on the starting write position of the first region image;

[0138] The processor 610 is also configured to determine the second region image based on the starting write position of the second region image.

[0139] Optionally, the processor 610 is also used to determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image.

[0140] The processor 610 is further configured to determine the starting write position of the second region image based on the transmission speed, the reading speed, the position range of the first region image, and the starting write position of the first region image.

[0141] Optionally, the processor 610 is further configured to determine the write position parameter based on the starting write position of the second region image to be solved, the transmission speed, and the position range of the first region image;

[0142] The processor 610 is further configured to determine a read position parameter based on the starting write position of the first region image and the read speed;

[0143] The processor 610 is further configured to establish a positional relationship based on the write position parameter and the read position parameter, wherein the positional relationship is used to indicate that the parameter value of the write position parameter is less than the parameter value of the read position parameter;

[0144] The processor 610 is also used to solve the positional relationship to obtain the starting write position of the second region image.

[0145] Optionally, the position range between the starting write position of the first region image and the starting write position of the second region image is less than a preset position range difference.

[0146] Optionally, the processor 610 is also configured to restore the image transmission process in the case of non-partial refresh, or in the case where the position of the synchronization signal and the position of the high-frequency TE signal are inconsistent during partial refresh.

[0147] In the embodiments of this application, in the case of partial refresh, a first area image corresponding to the partial refresh is determined. When the position of the synchronization signal during partial refresh is consistent with the position of the high-frequency TE signal, it indicates that there is a risk of screen tearing. Based on the first area image, a second area image containing the first area image is determined. The starting write position of the second area image is earlier than the starting write position of the first area image, that is, the write time of the second area image is earlier than the write time of the first area image. This is equivalent to writing the second area image into the display cache in advance, which can avoid the conflict between image reading and image writing. Thus, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, and the display quality of the screen content can be improved.

[0148] It should be understood that, in this embodiment, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042. The GPU 6041 processes image data of still images or video images obtained by an image capture device (such as a camera) in video image capture mode or image capture mode. The display unit 606 may include a display panel 6061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 607 includes at least one of a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here. The memory 609 can be used to store software programs and various data, including but not limited to applications and motion systems. Processor 610 can integrate an application processor and a modem processor. The application processor mainly handles the action system, user page, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into processor 610.

[0149] The memory 609 can be used to store software programs and various data. The memory 609 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 609 may include volatile memory or non-volatile memory, or it may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 609 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0150] Processor 610 may include one or more processing units; optionally, processor 610 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 610.

[0151] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described image processing method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0152] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0153] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described image processing method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0154] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0155] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the image processing method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0156] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0157] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0158] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image processing method, characterized by, The method comprises: In the case of local refresh, determining a first region image corresponding to the local refresh; In the case that the synchronization signal position is consistent with the high-frequency TE signal position during the local refresh, determining a second region image according to the first region image; the second region image contains the first region image, and the starting writing position of the second region image is prior to the starting writing position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing flow; Writing the second region image into the display buffer.

2. The method of claim 1, wherein, The determining of the second region image according to the first region image comprises: Determining the starting writing position of the second region image according to the starting writing position of the first region image; Determining the second region image according to the starting writing position of the second region image.

3. The method of claim 2, wherein, The determining of the second region image according to the starting writing position of the second region image comprises: Determining the transmission speed of the mobile industry processor interface display serial interface (MIPIDSI), the reading speed of the screen chip and the position range of the first region image; Determining the starting writing position of the second region image according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image.

4. The method of claim 3, wherein, The determining of the starting writing position of the second region image according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image comprises: Determining a writing position parameter according to the starting writing position of the second region image to be solved, the transmission speed and the position range of the first region image; Determining a reading position parameter according to the starting writing position of the first region image and the reading speed; Establishing a position relationship formula according to the writing position parameter and the reading position parameter, the position relationship formula being used to indicate that the parameter value of the writing position parameter is less than the parameter value of the reading position parameter; Solving the position relationship formula to obtain the starting writing position of the second region image.

5. The method according to any one of claims 1 to 4, characterized in that, The position range between the starting writing position of the first region image and the starting writing position of the second region image is less than a preset position range difference value.

6. The method of claim 1, wherein, The method further comprises: In the case of non-local refresh or in the case that the synchronization signal position is inconsistent with the high-frequency TE signal position during the local refresh, restoring the image transmission flow.

7. An image processing apparatus characterized by comprising: The device comprises: A first determining module, configured to determine a first region image corresponding to local refresh in the case of local refresh; A second determining module, configured to determine a second region image according to the first region image in the case that the synchronization signal position is consistent with the high-frequency TE signal position during the local refresh; the second region image contains the first region image, and the starting writing position of the second region image is prior to the starting writing position of the first region image; the synchronization signal position is the time sequence position of the synchronization signal in the system timing flow; A writing module, configured to write the second region image into the display buffer.

8. The apparatus of claim 7, wherein, The second determining module is specifically configured to: determining a start writing position of the second region image according to the start writing position of the first region image; determining a second region image according to the start writing position of the second region image.

9. An electronic device, comprising: A device comprising a processor and a memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implement the steps of the method of any one of claims 1-6.

10. A readable storage medium, characterized by, A readable storage medium storing a program or instructions, the program or instructions, when executed by a processor, implement the steps of the method of any one of claims 1-6.

Citation Information

Patent Citations

  • Dynamic frame rate control method and device

    CN116027930A

  • Method and device for adjusting tearing effect TE signal

    CN118646908A