Image processing method and device, electronic equipment and readable storage medium
By the high -frequency refresh environment driven by the TE signal, it is determined that the second -area image containing the first area image is determined and the display cache is written in advance, which solves the problem of tearing of the screen, and improves the display quality and refresh rate.
Patent Information
- Application Number
- CN202411446025.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2025-01-24
- Estimated Expiration
- 2044-10-16
Smart Images

Figure CN119364080A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of image processing, and specifically relates to an image processing method, device, electronic device and readable storage medium. Background Art
[0002] At present, high-quality display effects are an important part of user experience. However, in actual applications, screen tearing often occurs, which brings a bad visual experience to users. If the writing speed of image data is inconsistent with the reading speed of image data, part of the screen will display the display content of the previous frame, and the other part of the screen will display the display content of the current frame, resulting in a visual effect of screen tearing.
[0003] When using high-frequency synchronization signals (Timing Enable, TE) to control display content, the existing local refresh solution cannot solve the problem of screen tearing due to the high refresh frequency of the screen. This is because even if only a local area is updated, the image data is still continuously read from the display cache for refresh under the drive of the TE signal, resulting in conflicts between reading and writing.
[0004] Therefore, currently in the high-frequency refresh environment driven by the TE signal, there is a problem of abnormal display content. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an image processing method, device, electronic device and readable storage medium, which can solve the problem of abnormal display content in the prior art under the high-frequency refresh environment driven by TE signals.
[0006] In a first aspect, an embodiment of the present application provides an image processing method, the method comprising:
[0007] In case of partial refresh, determining a first area image corresponding to the partial refresh;
[0008] In the case where the synchronization signal position during the partial refresh is consistent with the high-frequency TE signal position, a second region image is determined according to the first region image; the second region image includes the first region image, and the start writing position of the second region image is prior to the start writing position of the first region image; the synchronization signal position is the time series position of the synchronization signal in the system timing process;
[0009] The second region image is written into the display buffer.
[0010] In a second aspect, an embodiment of the present application provides an image processing device, the method comprising:
[0011] A first determination module, used for determining a first area image corresponding to the local refresh in the case of a local refresh;
[0012] A second determination module is used to determine a second regional image according to the first regional image when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position; the second regional image includes the first regional image, and the start writing position of the second regional image is prior to the start writing position of the first regional image; the synchronization signal position is the time series position of the synchronization signal in the system timing process;
[0013] A writing module is used to write the second area image into a display buffer.
[0014] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0016] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0018] In an embodiment of the present application, by determining the first area image corresponding to the local refresh in the case of local refresh, when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position, it indicates that there is a risk of screen tearing. According to the first area image, the second area image containing the first area image is determined, and the starting writing position of the second area image is earlier than the starting writing position of the first area image, that is, the writing time of the second area image is earlier than the writing time of the first area image, which is equivalent to writing the second area image to the display cache in advance, and can avoid the conflict between image reading and image writing. Therefore, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, thereby improving the display quality of the screen display content. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1is a schematic diagram of a display process provided by an embodiment of the present application;
[0020] Figure 2 is a schematic diagram of a high-frequency refresh environment driven by a TE signal provided in an embodiment of the present application;
[0021] Figure 3 is a flow chart of an image processing method provided by an embodiment of the present application;
[0022] Figure 4 is a schematic diagram of a partial display content provided by an embodiment of the present application;
[0023] Figure 5 is a schematic diagram of a first region image provided in an embodiment of the present application;
[0024] Figure 6 is a schematic diagram of a second region image provided in an embodiment of the present application;
[0025] Figure 7 is a structural diagram of an image processing device provided in an embodiment of the present application;
[0026] Figure 8 It is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;
[0027] Fig. 9 This is the second schematic diagram of the hardware structure of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION
[0028] The following will be combined with the drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present application belong to the scope of protection of this application.
[0029] The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0030] In order to better explain the embodiments of the present application, Figure 1 The following is an explanation of the working process of the screen display:
[0031] like Figure 1 As shown in FIG. 1 , the system on chip (SOC) is responsible for processing image data. The SOC transmits the processed image data to the memory on the screen through the MIPIDSI interface.
[0032] The screen includes: a high-frequency TE oscillator and RAM memory; the high-frequency TE oscillator is used to generate a synchronization signal called TE (Timing Enable), which triggers the screen drive circuit to start working. The RAM memory is used to store image data. The RAM reads the image data at regular intervals and then sends the data to the screen drive circuit.
[0033] The screen drive circuit generates electrical signals that can drive the screen based on the image data read from the RAM and the received TE synchronization signal. These electrical signals are transmitted to the display module to make the screen display the image.
[0034] Therefore, SOC is responsible for processing the image and transferring the image data to the screen RAM through the MIPIDSI interface. Then the high-frequency TE oscillator inside the screen generates a synchronization signal, and the drive circuit sends the correct electrical signal to the screen panel according to the image data and synchronization signal in the RAM, and finally displays the image on the screen.
[0035] The frame rate of early electronic devices was equal to the frequency of screen TE. For example, in the case of 120HZ, the TE frequency was also 120HZ. With the gradual development of electronic devices, high-frequency TE has been widely used. Under the same frame rate, increasing the TE frequency can increase the image response speed, for example, 240HZ.
[0036] The image processing method provided in the embodiment of the present application can be applied to at least the following application scenarios: Figure 2 Provide explanation.
[0037] When the system frame rate is 120HZ, the traditional TE is 120HZ. In the high-frequency TE system, the TE frequency is 120*N HZ. Here, 240HZ (N=2) is used for illustration. In principle, high-frequency TE and local refresh are mutually exclusive. When high-frequency TE is turned on, the traditional local refresh solution will have display abnormalities.
[0038] When the rising edge of the TE signal arrives, it means that a new display frame has begun to be processed. At this time, the SOC will write the image data of the current frame line by line into the RAM inside the screen through the MIPIDSI interface. The driver IC inside the screen will monitor the status of the TE signal. When the falling edge of the TE signal arrives, it will start to read the image data line by line from the RAM. The driver IC displays the image on the screen panel based on the read image data.
[0039] like Figure 2 As shown in the ① position in the figure, after the rising edge of TE is triggered, the SOC can write the image line by line into the on-screen RAM through MIPIDSI, as shown in the figure. Figure 2 As shown in position ② in the figure, after the falling edge of TE is triggered, the on-screen IC will read data line by line from the RAM and update it to the display module.
[0040] In the traditional TE mode, since the SOC write time point (① position) is earlier than the screen IC read time (② position), and the write speed is greater than the read speed, the write data row position and the read data row position will not be in the same row.
[0041] However, in high-frequency TE mode (taking 240HZ as an example), there is an extra TE signal in the middle of each TE compared to traditional TE. To distinguish, in high-frequency TE system, the TE at the beginning and end of the refresh cycle is called TE1. The TE in the middle is called TE2. Figure 2 As shown in ③. Taking the time axis as an example, TE1 is generated between every two TE2 signals, for example: TE1-TE2-TE1-TE2-TE1-TE2, where TE1 exists as the main signal between each pair of TE2 signals.
[0042] The main signal refers to the signal that plays a leading or key role in the high-frequency TE mode. The main signal is responsible for starting or ending a cycle, or transmitting key information in the system. The existence of the main signal ensures the stable operation and correct time management of the system.
[0043] TE2, which is a signal inserted between each TE1. TE2 is used to ensure that the various components in the system can work synchronously, and can also be used to transmit additional data or control information to support the functions of the system.
[0044] like Figure 2As shown in the ④ position in the figure, when the TE rising edge is triggered, if the SOC has no image to send, then MIPIDSI does not need to transmit data, and the screen IC will still read the last frame of image data stored in the RAM line by line, as shown in Repeat Frame A. At the ⑤ position, the screen reads about 800 lines, and local image changes may occur at any position on the screen. If the starting position of the local image is also 800 lines, the screen RAM write and read are in the same line, and the tearing effect problem will occur, resulting in abnormal display. Therefore, when the high-frequency TE is turned on, local refresh cannot be used.
[0045] The writing and reading of the screen RAM are usually performed on the same line, which will cause the problem of tearing effect. The tearing effect refers to the fact that fragments of the previous frame and the current frame will appear on the screen at the same time, causing abnormal display effect. Since the high-frequency TE synchronization signal of the screen is always running, the driving circuit will continuously read data from the RAM to refresh the display according to the rhythm of the TE signal. Therefore, when the SOC is writing new image data to the RAM, the screen driving circuit may be reading old image data from the same line for display.
[0046] Therefore, when the high-frequency TE synchronization signal is turned on, the local refresh method cannot be used because this will cause screen tearing problems.
[0047] In response to the problems arising in the related art, the embodiments of the present application provide an image processing method, device, electronic device and storage medium, which can solve the problem of abnormal display content in the related art under the high-frequency refresh environment driven by TE signals.
[0048] The image processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0049] Figure 3 A flowchart of an image processing method provided in an embodiment of the present application.
[0050] like Figure 3 As shown, the image processing method may include steps 310 to 330, and the method is applied to an image processing device, as shown below:
[0051] Step 310, in the case of partial refresh, determining a first area image corresponding to the partial refresh;
[0052] Partial refresh means that on an electronic device having a display screen, only the content of a specific area on the display screen is updated, without refreshing the content of the entire display screen.
[0053] The first area image is the area image where the local refresh occurs, and is also the smallest image area that needs to be updated. Figure 4 As shown, it is a clock display interface. The local display content of the clock display interface that is updated is the time display content, and the rest of the display content remains unchanged.
[0054] like Figure 5 As shown, only the area image B corresponding to the time display content has changed, and the area image A corresponding to the local display content and the area image C corresponding to the local display content have not been updated, so only the first area image B of the local display content needs to be determined.
[0055] Step 320, when the synchronization signal position during the partial refresh is consistent with the high-frequency TE signal position, determine a second region image according to the first region image; the second region image includes the first region image, and the start writing position of the second region image is prior to the start writing position of the first region image; the synchronization signal position is the time series position of the synchronization signal in the system timing process;
[0056] High-frequency TE mode refers to the signal transmission mode in which the electric field vector is perpendicular to the propagation direction when electromagnetic waves propagate in the medium under high refresh rate conditions. High-frequency TE mode improves the display effect by optimizing signal transmission and update frequency, ensuring visual smoothness and clarity under high refresh conditions.
[0057] The high frequency TE signal is Figure 2 When the TE2 signal in the local refresh is consistent with the high-frequency TE signal position, the screen will tear. The second area image contains the first area image, that is, the second area image is a slightly larger area than the first area. The start writing position of the second area image is earlier than the start writing position of the first area image to ensure that there will be no screen tearing when writing new image data to the display cache.
[0058] The electronic device system can detect the position of the TE (Tearing Effect) signal in real time, and the TE signal can inform the display controller of the current refresh status of the display panel.
[0059] When the synchronization signal position during partial refresh is at the TE1 position, the refresh position of the display panel is synchronized with the write position of the display controller, and screen tearing will not occur. Therefore, no special processing is required, and the partial image can be directly updated.
[0060] When the synchronization signal position during partial refresh is at the TE2 position, for example, the current reading position of the display panel is near Line 800. If the partial image is updated directly, screen tearing may occur near Line 800.
[0061] To avoid the risk of tearing, the update area needs to be expanded to a slightly larger area that includes the first area, that is, the second area image. The start writing position of the second area image should be earlier than the start writing position of the first area image. Figure 6 As shown, according to the first area image B of the local display content, the second area image is determined. The second area image can be B1 or B2. B1 contains B, and B2 also contains B, that is, the second area image contains the first area image. The starting writing position of B1 is earlier than the starting writing position of B, and the starting writing position of B2 is earlier than the starting writing position of B, that is, the starting writing position of the second area image is earlier than the starting writing position of the first area image.
[0062] In a possible embodiment, step 320 includes:
[0063] Determining a starting writing position of the second region image according to a starting writing position of the first region image;
[0064] The second region image is determined according to the start writing position of the second region image.
[0065] The first area image is the smallest area that needs to be updated. In order to avoid screen tearing, the update range needs to be expanded to the second area image. The starting writing position of the second area image should be before the starting position of the first area image. This ensures that when the TE signal appears, the update of the entire second area image can be completed smoothly.
[0066] The size of the second region image is determined according to the start writing position of the second region image. The second region image should include the first region image to ensure that the update of the entire region can be completed when the TE signal appears.
[0067] Specifically, the appropriate size of the second region image can be estimated by analyzing the current TE signal position and the refresh frequency of the display panel. For example, if the start writing position of the first region image is the 800th row, then the start writing position of the second region image should be a position before the 800th row.
[0068] Therefore, when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position, the starting writing position of the second area image is determined according to the starting writing position of the first area image; and the second area image containing the first area image is determined according to the starting writing position of the second area image, thereby avoiding the problem of screen tearing.
[0069] Wherein, determining the second region image according to the start writing position of the second region image includes:
[0070] Determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image;
[0071] The starting writing position of the second region image is determined according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image.
[0072] MIPIDSI transmission speed: MIPIDSI is a common display interface standard in mobile devices. It can support very high data transmission rates. Typical MIPIDSI transmission speeds can reach 1-4Gbps or higher, depending on the hardware configuration of the device. The transmission speed directly affects the image resolution and refresh rate that can be transmitted.
[0073] Screen chip reading speed: The screen chip (i.e., panel control chip) is responsible for transferring image data from the memory to the actual display panel. The reading speed needs to match the transmission speed of MIPIDSI. Generally, the reading speed of high-end display panels can reach a level comparable to the MIPIDSI transmission speed.
[0074] The first region image refers to the smallest image region of the local update, and the position range of the first region image depends on the specific application scenario, such as whether to update in the upper left corner of the screen or in a certain position in the middle, for example, from the 800th row to the 1000th row.
[0075] The transmission speed, the reading speed, and the position range of the first area image are crucial to achieving high-quality local image updates. Therefore, the starting writing position of the second area image can be determined by comprehensively considering the transmission speed, the reading speed, the position range of the first area image, and the starting writing position of the first area image.
[0076] Wherein, determining the starting writing position of the second region image according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image comprises:
[0077] Determine a writing position parameter according to the starting writing position of the second area image to be solved, the transmission speed and the position range of the first area image;
[0078] Determining a reading position parameter according to the starting writing position of the first area image and the reading speed;
[0079] Establishing a position relationship equation according to the write position parameter and the read position parameter, wherein the position relationship equation is used to indicate that a parameter value of the write position parameter is smaller than a parameter value of the read position parameter;
[0080] The position relationship equation is solved to obtain the starting writing position of the second region image.
[0081] The write position parameter is the position where the display buffer is written; the read position parameter is the position where the display buffer is read. Since the image data is sent line by line, a tearing effect will occur when the line position where the display buffer is written is the same as the line position where the display buffer is read. In order to ensure that no tearing effect occurs during the line-by-line writing of the second area image B2, it is necessary to ensure that the line position where the display buffer is written does not exceed the line position where the display buffer is read. Therefore, the following position relationship is established:
[0082] Line w +V w *t <Line r +V r *t
[0083] Among them, Line w +V w *t, used to indicate the write position parameter;
[0084] Line r +V r *t, used to indicate the reading position parameter;
[0085] Line_w is the starting writing position of the second region image to be solved;
[0086] V w Indicates the transmission speed, which is set by SOC, unit: lines / millisecond;
[0087] The time t represents the transmission time, which is the quotient of the position range of the first area image and the transmission speed;
[0088] Line r , is the starting writing position of the first region image, that is, the 800th row in the above example.
[0089] V r , is the reading speed, which is a fixed value;
[0090] According to the above position relationship formula, the minimum value of the starting writing position of the second region image can be calculated, for example, Line 600, which means that the starting writing position of the region image needs to be expanded to 600 lines, such as Figure 6 The B2 position in .
[0091] Therefore, according to the write position parameter and the read position parameter, a position relationship equation is established to indicate that the parameter value of the write position parameter is less than the parameter value of the read position parameter, and the starting write position of the second area image can be obtained quickly and accurately by solving the position relationship equation.
[0092] In a possible embodiment, a position range between a start writing position of the first region image and a start writing position of the second region image is smaller than a preset position range difference.
[0093] In the case where the position where the display buffer is written and the position where the display buffer is read overlap, a tearing effect may occur, and the first region image needs to be expanded to the second region image.
[0094] For example, the position range of the first area image is Line 800 to Line 1000. The processing process of the first area image includes: writing to the display cache line by line starting from line 800, and reading from the display cache line by line starting from line 800. The writing process and the reading process overlap, and there is a tearing problem at this time.
[0095] A second region image is determined according to the first region image; the second region image includes the first region image, and a start writing position of the second region image is earlier than a start writing position of the first region image.
[0096] For example, the first area image B (Line 800 to Line 1000) is adjusted to the second area image B1 (Line 700 to Line 1000). The processing process of the first area image includes: writing to the display cache line by line starting from line 700, and reading from the display cache line by line starting from line 800. There is no overlap between the writing process and the reading process, which can avoid the tearing problem.
[0097] In order to reduce the processing resources occupied by the writing process, the position range between the starting writing position of the first region image and the starting writing position of the second region image may be controlled to be smaller than a preset position range difference.
[0098] If the starting writing position of the second region image obtained by solving the position relationship equation is inconsistent with the starting writing position of the second region image obtained based on the preset position range difference, the smaller starting writing position of the second region image is used.
[0099] Step 330: Write the second region image into a display buffer.
[0100] The updated second area image data is written into the display buffer so that the display can be updated at an appropriate time. When the next TE signal arrives, the image can be displayed on the screen according to the second area image data in the memory to ensure that the displayed content will not be torn. In this way, the screen tearing problem at a specific TE signal position can be effectively avoided, and the display quality can be improved.
[0101] In a possible embodiment, in the case of non-local refresh, or in the case that the position of the synchronization signal during local refresh is inconsistent with the position of the high-frequency TE signal, the image transmission process is restored.
[0102] In the case of non-local refresh, that is, global refresh is performed at this time, the image transmission process can be restored, that is, the SOC will continue to write the image corresponding to the global refresh into the RAM inside the screen line by line through the MIPIDSI interface.
[0103] When the synchronization signal position during local refresh is inconsistent with the high-frequency TE signal position, it means that there is no risk of screen tearing at present, and the image transmission process can be restored, that is, the SOC will continue to write the first area image corresponding to the local refresh into the RAM inside the screen line by line through the MIPIDSI interface.
[0104] Therefore, in the case of non-local refresh, or when the synchronization signal position during local refresh is inconsistent with the high-frequency TE signal position, there will be no screen tearing problem. Therefore, the image transmission process is restored and the first area image is written into the display cache.
[0105] In an embodiment of the present application, by determining the first area image corresponding to the local refresh in the case of local refresh, when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position, it indicates that there is a risk of screen tearing. According to the first area image, the second area image containing the first area image is determined, and the starting writing position of the second area image is earlier than the starting writing position of the first area image, that is, the writing time of the second area image is earlier than the writing time of the first area image, which is equivalent to writing the second area image to the display cache in advance, and can avoid the conflict between image reading and image writing. Therefore, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, thereby improving the display quality of the screen display content.
[0106] The image processing method provided in the embodiment of the present application can be executed by an image processing device. In the embodiment of the present application, an image processing device executing the image processing method is taken as an example to illustrate the image processing device provided in the embodiment of the present application.
[0107] Figure 7 400 is a block diagram of an image processing device provided in an embodiment of the present application, and the device 400 includes:
[0108] A first determination module 710 is used to determine a first area image corresponding to the local refresh in the case of a local refresh;
[0109] A second determination module 720 is used to determine a second regional image according to the first regional image when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position; the second regional image includes the first regional image, and the start writing position of the second regional image is earlier than the start writing position of the first regional image; the synchronization signal position is the time series position of the synchronization signal in the system timing process;
[0110] The writing module 730 is used to write the second region image into the display buffer.
[0111] In a possible embodiment, the second determining module is specifically configured to:
[0112] Determining a starting writing position of the second region image according to a starting writing position of the first region image;
[0113] The second region image is determined according to the start writing position of the second region image.
[0114] In a possible embodiment, the second determining module is specifically configured to:
[0115] Determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image;
[0116] The starting writing position of the second region image is determined according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image.
[0117] In a possible embodiment, the second determining module is specifically configured to:
[0118] Determine a writing position parameter according to the starting writing position of the second area image to be solved, the transmission speed and the position range of the first area image;
[0119] Determining a reading position parameter according to the starting writing position of the first area image and the reading speed;
[0120] Establishing a position relationship equation according to the write position parameter and the read position parameter, wherein the position relationship equation is used to indicate that a parameter value of the write position parameter is smaller than a parameter value of the read position parameter;
[0121] The position relationship equation is solved to obtain the starting writing position of the second region image.
[0122] In a possible embodiment, a position range between a start writing position of the first region image and a start writing position of the second region image is smaller than a preset position range difference.
[0123] In a possible embodiment, the writing module 730 is further used for:
[0124] In the case of non-local refresh, or when the position of the synchronization signal during local refresh is inconsistent with the position of the high-frequency TE signal, the image transmission process is restored.
[0125] In an embodiment of the present application, by determining the first area image corresponding to the local refresh in the case of local refresh, when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position, it indicates that there is a risk of screen tearing. According to the first area image, the second area image containing the first area image is determined, and the starting writing position of the second area image is earlier than the starting writing position of the first area image, that is, the writing time of the second area image is earlier than the writing time of the first area image, which is equivalent to writing the second area image to the display cache in advance, and can avoid the conflict between image reading and image writing. Therefore, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, thereby improving the display quality of the screen display content.
[0126] The image processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0127] The image processing device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.
[0128] The image processing device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.
[0129] Alternatively, if Figure 8 As shown, an embodiment of the present application also provides an electronic device 510, including a processor 511, a memory 512, and a program or instruction stored in the memory 512 and executable on the processor 511. When the program or instruction is executed by the processor 511, each step of any of the above-mentioned image processing method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0130] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
[0131] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0132] The electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610.
[0133] Those skilled in the art will appreciate that the electronic device 600 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0134] The processor 610 is used to determine the first area image corresponding to the local refresh in the case of local refresh;
[0135] The processor 610 is further configured to determine, according to the first regional image, a second regional image when the synchronization signal position during the partial refresh is consistent with the high-frequency TE signal position; the second regional image includes the first regional image, and the start writing position of the second regional image is prior to the start writing position of the first regional image; the synchronization signal position is the time series position of the synchronization signal in the system timing process;
[0136] The processor 610 is further configured to write the second region image into a display cache.
[0137] Optionally, the processor 610 is further configured to determine a starting writing position of the second region image according to a starting writing position of the first region image;
[0138] The processor 610 is further configured to determine the second region image according to a start writing position of the second region image.
[0139] Optionally, the processor 610 is further used to determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image;
[0140] The processor 610 is further configured to determine a start writing position of the second region image according to the transmission speed, the reading speed, the position range of the first region image and the start writing position of the first region image.
[0141] Optionally, the processor 610 is further configured to determine a writing position parameter according to a starting writing position of the second region image to be solved, the transmission speed, and a position range of the first region image;
[0142] The processor 610 is further configured to determine a reading position parameter according to the start writing position of the first area image and the reading speed;
[0143] The processor 610 is further configured to establish a position relationship equation according to the write position parameter and the read position parameter, wherein the position relationship equation is used to indicate that a parameter value of the write position parameter is less than a parameter value of the read position parameter;
[0144] The processor 610 is further configured to solve the position relationship equation to obtain a start writing position of the second region image.
[0145] Optionally, a position range between a start writing position of the first region image and a start writing position of the second region image is smaller than a preset position range difference.
[0146] Optionally, the processor 610 is further configured to restore the image transmission process in the case of non-local refresh, or in the case where the position of the synchronization signal during local refresh is inconsistent with the position of the high-frequency TE signal.
[0147] In an embodiment of the present application, by determining the first area image corresponding to the local refresh in the case of local refresh, when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position, it indicates that there is a risk of screen tearing. According to the first area image, the second area image containing the first area image is determined, and the starting writing position of the second area image is earlier than the starting writing position of the first area image, that is, the writing time of the second area image is earlier than the writing time of the first area image, which is equivalent to writing the second area image to the display cache in advance, and can avoid the conflict between image reading and image writing. Therefore, while maintaining a high refresh rate, the problem of screen tearing can be effectively avoided, thereby improving the display quality of the screen display content.
[0148] It should be understood that in the embodiment of the present application, the input unit 604 may include a graphics processor (Graphics Processing Unit, GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes the image data of the static picture or video image obtained by the image capture device (such as a camera) in the video image capture mode or the image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes at least one of a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and an action rod, which will not be repeated here. The memory 609 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 610.
[0149] The memory 609 can be used to store software programs and various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 609 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0150] The processor 610 may include one or more processing units; optionally, the processor 610 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 610.
[0151] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0152] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0153] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0154] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0155] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0156] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0157] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0158] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An image processing method, characterized in that: The method comprises: In case of partial refresh, determining a first area image corresponding to the partial refresh; In the case where the synchronization signal position during the partial refresh is consistent with the high-frequency TE signal position, a second region image is determined according to the first region image; the second region image includes the first region image, and the start writing position of the second region image is prior to the start writing position of the first region image; the synchronization signal position is the time series position of the synchronization signal in the system timing process; The second region image is written into the display buffer.
2. The method according to claim 1, characterized in that The step of determining the second region image according to the first region image includes: Determining a starting writing position of the second region image according to a starting writing position of the first region image; The second region image is determined according to the start writing position of the second region image.
3. The method according to claim 2, characterized in that The step of determining the second region image according to the start writing position of the second region image comprises: Determine the transmission speed of the mobile industry processor interface display serial interface MIPIDSI, the reading speed of the screen chip, and the position range of the first area image; The starting writing position of the second region image is determined according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image.
4. The method according to claim 3, characterized in that The step of determining the starting writing position of the second region image according to the transmission speed, the reading speed, the position range of the first region image and the starting writing position of the first region image comprises: Determine a writing position parameter according to the starting writing position of the second area image to be solved, the transmission speed and the position range of the first area image; Determining a reading position parameter according to the starting writing position of the first area image and the reading speed; Establishing a position relationship equation according to the write position parameter and the read position parameter, wherein the position relationship equation is used to indicate that a parameter value of the write position parameter is smaller than a parameter value of the read position parameter; The position relationship equation is solved to obtain the starting writing position of the second region image.
5. The method according to any one of claims 1 to 4, characterized in that: A position range between a start writing position of the first region image and a start writing position of the second region image is smaller than a preset position range difference.
6. The method according to claim 1, characterized in that The method further comprises: In the case of non-local refresh, or when the position of the synchronization signal during local refresh is inconsistent with the position of the high-frequency TE signal, the image transmission process is restored.
7. An image processing device, characterized in that: The device comprises: A first determination module, used for determining a first area image corresponding to the local refresh in the case of a local refresh; A second determination module is used to determine a second regional image according to the first regional image when the synchronization signal position during the local refresh is consistent with the high-frequency TE signal position; the second regional image includes the first regional image, and the start writing position of the second regional image is prior to the start writing position of the first regional image; the synchronization signal position is the time series position of the synchronization signal in the system timing process; A writing module is used to write the second area image into a display buffer.
8. The device according to claim 7, characterized in that The second determining module is specifically used to: Determining a starting writing position of the second region image according to a starting writing position of the first region image; The second region image is determined according to the start writing position of the second region image.
9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Dynamic frame rate control method and device
CN116027930A
Image display control method and device, electronic equipment and readable storage medium
CN117095655A
Method and device for adjusting tearing effect TE signal
CN118646908A
Image refreshing method and associated image processing apparatus
US20130050179A1