Electronic device and image display method

Abstract

The present application discloses an electronic device and an image display method, including: a camera module having a first output mode and a second output mode. When the camera module is in the first output mode, it outputs a first image signal with a first frame rate. When the camera module is in the second output mode, it outputs a second image signal with a second frame rate, and the first frame rate is less than the second frame rate; a graphics card module that receives the first image signal or the second image signal. When the camera module outputs the first image signal in the first output mode, the graphics card module adjusts the first image signal into a third image signal with a third frame rate, and the third frame rate is greater than the first frame rate; a display panel connected to the graphics card module, receiving and displaying the third image signal output by the graphics card module.

Description

Technical Field

[0001] This application belongs to the technical field of terminal devices, and particularly relates to an electronic device and an image display method. Background Art

[0002] With the continuous increase in the functional requirements of users for the image quality of cameras, such as the picture quality, beauty effect, and smoothness of images. In terms of hardware, the number of cameras increases, and the pixel and output frame rate of the cameras increase.

[0003] Although the increase in the pixel and output frame rate of the camera greatly improves the imaging picture quality output by the camera, it will increase the burden on the camera, resulting in a significant increase in the power consumption of the camera, causing the camera to heat up rapidly, and in severe cases, it will lead to abnormal operation of the image sensor, and the working stability of the camera is poor. Summary of the Invention

[0004] The purpose of the embodiments of this application is to provide an electronic device and an image display method to solve the problem of poor working stability of the camera.

[0005] In a first aspect, the embodiments of this application provide an electronic device, which includes:

[0006] A camera module, which has a first output mode and a second output mode. When the camera module is in the first output mode, it outputs a first image signal, and the first image signal has a first frame rate. When the camera module is in the second output mode, it outputs a second image signal, and the second image signal has a second frame rate, and the first frame rate is less than the second frame rate; a graphics card module, which receives the first image signal or the second image signal. When the camera module outputs the first image signal in the first output mode, the graphics card module adjusts the first image signal to a third image signal, and the third image signal has a third frame rate, and the third frame rate is greater than the first frame rate; a display panel, which is connected to the graphics card module and receives and displays the third image signal output by the graphics card module.

[0007] In a second aspect, the embodiments of this application provide an image display method, which includes:

[0008] When the imaging module is in the first output mode, a first image signal is output through the imaging module. The first image signal has a first frame rate. When the imaging module is in the second output mode, a second image signal is output through the imaging module. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate. When the imaging module outputs the first image signal in the first output mode, the graphics card module adjusts the first image signal to a third image signal. The third image signal has a third frame rate, and the third frame rate is greater than the first frame rate. The third image signal is displayed through the display panel.

[0009] The technical solution provided by the embodiments of the present application includes: an imaging module having a first output mode and a second output mode. When the imaging module is in the first output mode, a first image signal is output. The first image signal has a first frame rate. When the imaging module is in the second output mode, a second image signal is output. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate. A graphics card module receives the first image signal or the second image signal. When the imaging module outputs the first image signal in the first output mode, the graphics card module adjusts the first image signal to a third image signal. The third image signal has a third frame rate, and the third frame rate is greater than the first frame rate. A display panel is connected to the graphics card module and receives and displays the third image signal output by the graphics card module. The output frame rate of the first output mode of the imaging module is a low frame rate, which reduces the burden on the imaging module, lowers the power consumption of the imaging module, and improves the stability of the imaging module. Description of the Drawings

[0010] Figure 1 Shows a first structural schematic diagram of the electronic device provided by the embodiments of the present application;

[0011] Figure 2 Shows a second structural schematic diagram of the electronic device provided by the embodiments of the present application;

[0012] Figure 3 Shows a third structural schematic diagram of the electronic device provided by the embodiments of the present application;

[0013] Figure 4 Shows a fourth structural schematic diagram of the electronic device provided by the embodiments of the present application;

[0014] Figure 5 Shows a first flowchart of the image display method provided by the embodiments of the present application;

[0015] Figure 6 Shows a second flowchart of the image display method provided by the embodiments of the present application;

[0016] Figure 7 The third process schematic diagram showing the image display method provided by the embodiments of the present application Detailed implementation manners

[0017] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0018] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same category, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the associated objects before and after.

[0019] Next, in conjunction with the accompanying drawings, the electronic device and the image display method provided by the embodiments of the present application will be described in detail through specific embodiments and their application scenarios.

[0020] Figure 1 A schematic structural diagram of an electronic device disclosed in the embodiments of the present application is shown. The electronic device 100 includes: a camera module 101, a graphics card module 102, and a display panel 103.

[0021] Among them, the camera module 101 has a first output mode and a second output mode. When the camera module 101 is in the first output mode, it outputs a first image signal, and the first image signal has a first frame rate. When the camera module 101 is in the second output mode, it outputs a second image signal, and the second image signal has a second frame rate, and the first frame rate is less than the second frame rate.

[0022] The graphics card module 102 receives the first image signal or the second image signal. When the camera module 101 outputs the first image signal in the first output mode, the graphics card module 102 adjusts the first image signal to a third image signal, and the third image signal has a third frame rate, and the third frame rate is greater than the first frame rate.

[0023] The display panel 103 is connected to the graphics card module 102 and receives and displays the third image signal output by the graphics card module 102.

[0024] Specifically, the imaging module 101 can be the camera of the terminal device, the graphics card module 102 can be an independent display chip, and the display panel 103 can be a liquid crystal module (LCM). Among them, for the imaging module 101, it is divided into a camera preview mode, a camera recording mode, and a pre-flash / main flash mode of the camera. The imaging module 101 can receive a pre-written control instruction sent by the system-on-chip (SoC) of the terminal device to the imaging module 101. After receiving the control instruction, the imaging module 101 selects to enter the first output mode or the second output mode according to the indication of the control instruction. When the control instruction is to control the imaging module 101 to perform frame rate reduction output, the imaging module 101 is controlled to enter the first output mode, thereby reducing the output frame rate of the imaging module 101. The output frame rate after reduction of the imaging module 101 is the first frame rate. The output frame rate of the first output mode of the imaging module 101 is a low frame rate, which reduces the burden on the imaging module 101, reduces the power consumption of the imaging module 101, and improves the stability of the imaging module 101. When the control instruction is to control the imaging mode 101 to output at the default frame rate, the imaging module 101 is controlled to enter the second output mode, so that the imaging module 101 outputs at the default output frame rate, and the default output frame rate is the second frame rate. Among them, the first output mode is the frame rate reduction mode, and the second output mode is the normal output mode.

[0025] For example, the default output frame rate of the imaging module 101 in the second output mode is 30 frames per second (FPS). After the SoC sends a control instruction for frame rate reduction output to the imaging module 101, the imaging module 101 is controlled to output in the first output mode. The output frame rate of the first output mode is adjusted to 15 FPS, and the first image signal currently captured by the imaging module 101 is output at 15 FPS.

[0026] The camera module 101 outputs a first image signal in a first output mode and sends it to the graphics card module 102. The graphics card module 102 adjusts the first image signal to a third image signal. Specifically, the graphics card module 102 adjusts the first image signal to a third image signal by frame interpolation. After frame interpolation of the first image signal, the third frame rate of the obtained third image signal is greater than the first frame rate of the first image. Alternatively, the camera module 101 outputs a second image signal in a second output mode and sends it to the graphics card module 102. The graphics card module 102 adjusts the second image signal to a third image signal. Specifically, the graphics card module 102 adjusts the second image signal to a third image signal by frame interpolation. After frame interpolation of the second image signal, the third frame rate of the obtained third image signal is greater than the second frame rate of the second image. Among them, the first frame rate can take any value between 0 FPS and 30 FPS. For example, when the first frame rate is between 10 FPS and 30 FPS, the third frame rate is between 60 FPS and 120 FPS.

[0027] For the third frame rate, the third frame rate is the same as the display frame rate of the display panel 103. To ensure smooth display of the display panel 103, frame interpolation can be performed on the first image signal according to the display frame rate of the display panel 103, that is, the third frame rate obtained by frame interpolation is kept consistent with the display frame rate of the display panel 103. For example, when the display frame rate of the display panel 103 is 60 FPS and the first frame rate is 15 FPS, after frame interpolation processing of the first image signal, the first image signal with a frame rate of 15 FPS is interpolated into a third image signal with a frame rate of 60 FPS, thereby ensuring the stability and smoothness of the image signal displayed on the display panel 103.

[0028] Furthermore, for the graphics card module 102, the graphics card module 102 adjusts the first image signal according to the frame rate of the second flag signal sent by the display panel 103, so that the third frame rate of the third image signal is the same as the display frame rate of the display panel 103. The frame rate of the second flag signal corresponds to the display frame rate. Specifically, the display panel 103 sends a second flag signal (such as a TE signal) to the graphics card module 102. The frame rate corresponding to the second flag signal is the same as the display frame rate of the display panel 103, that is, they correspond to each other. For example, when the display frame rate of the display panel 103 is 60 FPS, the frame rate of the second flag signal is also 60 FPS. The graphics card module 102 adjusts the first image signal according to the frame rate of the second flag signal, and the third frame rate of the obtained third image signal is the same as the display frame rate of the display panel 103. In this way, the synchronization of the image frame rate and the display frame rate displayed on the display panel 103 is ensured, and the smoothness of the image display is ensured.

[0029] Further, while performing frame interpolation on the first image signal or the second image signal, the graphics card module 102 evaluates whether the first image signal or the second image signal needs to be processed. The image processing includes at least one of noise reduction, brightening, and color enhancement. Specifically, while performing frame interpolation on the first image signal or the second image signal, the graphics card module 102 evaluates whether the image quality of the first image signal or the second image signal meets the requirements. If there is a problem with low image quality, the graphics card module 102 needs to perform image processing on the first image signal or the second image signal, which can further improve the image quality of the first image signal and the second image signal. In addition, while performing frame interpolation on the first image signal or the second image signal, the graphics card module 102 evaluates whether the first image signal or the second image signal needs to be processed. By simultaneously performing frame interpolation and evaluating the image quality, the overall time for the graphics card module 102 to perform frame interpolation and image processing on the first image signal or the second image signal can be shortened, thereby improving the processing efficiency of the graphics card module 102.

[0030] Through an electronic device disclosed in an embodiment of the present application, the camera module can be controlled to output a first image signal in a first output mode. The first frame rate of the first image signal is less than the second frame rate of the second image signal output by the camera module in a second output mode. Reducing the output frame rate of the first image signal of the camera module reduces the burden on the camera module, reduces the power consumption of the camera module, improves the temperature rise problem of the camera module, extends the battery life of the terminal device, and improves the stability of the camera module.

[0031] In a possible implementation, as Figure 2 shown, on the basis of the electronic device shown in Figure 1 the electronic device 100 further includes a fill light module 104. The fill light module 104 includes a fill light. The graphics card module 102 is electrically connected to the fill light module 104, and the graphics card module 102 controls the fill light to turn on or off.

[0032] Specifically, after the graphics card module 102 receives the first image signal or the second image signal with the first frame rate transmitted by the camera module 101, if the first image signal or the second image signal does not meet the preset requirements, the fill light of the fill light module 104 can be controlled by the independent display module 102 to turn on and perform fill light. After performing fill light on the first image signal or the second image signal, image processing can be performed on the first image signal or the second image signal again. Specifically, after the camera module 101 pre-flashes, the camera module 101 captures the first image signal or the second image signal and outputs the first image signal with the first frame rate to the graphics card module 102 in the first output mode or outputs the second image signal with the second frame rate to the graphics card module 102 in the second output mode.

[0033] The graphics card module 102 performs frame interpolation on the first image signal with the first frame rate to obtain a third image signal with the third frame rate. Alternatively, the graphics card module 102 performs frame interpolation on the second image signal with the second frame rate to obtain a third image signal with the third frame rate. While performing frame interpolation, the graphics card module 102 determines whether the first image signal or the second image signal needs to be processed. If not, it sends the third image signal with the third frame rate to the display module. If so, the graphics card module 102 adjusts the fill light of the fill light module 104 to perform fill light. After performing fill light, it processes the first image signal or the second image signal, and sends the fourth image signal that has undergone fill light and image processing to the display panel 103. The display panel 103 displays the fourth image signal at the display frame rate. Among them, the third frame rate of the fourth image signal is the same as the display frame rate of the display panel 103.

[0034] Through the technical solution disclosed in the embodiments of the present application, the output frame rate of the first image signal of the camera module is reduced, the burden on the camera module is alleviated, the power consumption of the camera module is reduced, the temperature rise problem of the camera module is improved, the battery life of the terminal device is extended, and the stability of the camera module is improved. In addition, the graphics card module directly controls the fill light module, which can shorten the delay of image processing and fill light, and while improving the imaging quality, it can also ensure high smoothness of the image.

[0035] In a possible implementation manner, as Figure 3 shown, on the basis of the Figure 1 shown electronic device, the electronic device 100 further includes a processor 105. The processor 105 is respectively connected to the camera module 101 and the graphics card module 102, and is used to control the camera module 101 to output the first image signal in the first output mode, and control the graphics card module 102 to enter the first frame adjustment mode of adjusting the first image signal to the third image signal.

[0036] Specifically, the processor 105 can be a system-on-chip (SoC) of the terminal device. The SoC of the terminal device sends a pre-written first control instruction to the camera module 101. After receiving the first control instruction, the camera module 101 enters the first output mode, and controls the camera module 101 to reduce the output frame rate. Among them, the reduced output frame rate is the first frame rate. The SoC of the terminal device sends a pre-written second control instruction to the graphics card module 102. After receiving the second control instruction, the graphics card module 102 enters the first frame adjustment mode. In the first frame adjustment mode, it controls the graphics card module 102 to perform frame interpolation on the first image signal. Among them, the first image signal with the first frame rate is interpolated into the third image signal with the third frame rate.

[0037] The whole implementation process of the camera module 101 downgrading the output and the graphics card module 102 performing frame insertion processing is specifically as follows: the camera module 101 outputs a first image signal of a first frame rate to the processor 105 in a first output mode, the processor 105 receives the first image signal of the first frame rate, and after receiving the first image signal, the processor 105 sends the first image signal to the graphics card module 102, the graphics card module 102 adjusts the first image signal to a third image signal, the third frame rate of the third image signal is greater than the first frame rate of the first image signal, and then the graphics card module 102 sends the third image signal to the display panel 103, the display panel 103 displays the third image signal, wherein the display frame rate of the display panel 103 is the same as the third frame rate of the third image signal.

[0038] In one possible implementation, the graphics card module 102 enters the first frame adjustment mode and then feeds back a first flag signal to the processor 105. The processor 105 receives the first image signal output by the camera module 101. The processor 105 outputs the first image signal to the graphics card module 102 at a frame rate corresponding to the first flag signal. The graphics card module 102 adjusts the first image signal to a third image signal by interpolating frames. The frame rate corresponding to the first flag signal corresponds to the first frame rate.

[0039] Specifically, the first flag signal can be a TE signal, and the frame rate corresponding to the first flag signal can be the signal frequency of the TE signal. After the graphics card module 102 enters the first frame adjustment mode, it sends a TE signal to the processor 105. The signal frequency of the TE signal can be set to a predetermined value. When the camera module 101 is in the first output mode, the predetermined value can correspond to the first frame rate, thereby maintaining frame synchronization. If the first frame rate is 15FPS, the predetermined value can be a 15HZ camera module 101.

[0040] The processor 105 sends the first image signal to the graphics card module 102 according to the signal frequency of the TE signal. For example, the first frame rate is 15FPS, and the signal frequency of the TE signal is 15HZ. The camera module 101 outputs the first image signal of 15FPS to the SoC, and the SoC transmits the first image signal to the graphics card module 102 according to the signal frequency of the TE signal 15HZ. In this way, the processor 105 outputs the first image signal to the graphics card module 102 at the frame rate corresponding to the first flag signal, and the first frame rate of the first image signal corresponds to the frame rate corresponding to the first flag signal, thereby ensuring frame synchronization and improving the smoothness of the picture. Further, the processor 105 can also use the frame rate corresponding to the first frame rate to transmit data to the graphics card module 102, which reduces the power consumption of the processor 105 in transmitting data, further increases the battery life of the terminal device, and ensures the stability of the processor 105 and maintains the high smoothness of the picture.

[0041] In a possible implementation, the processor 105 controls the imaging module 101 to output a second image signal in a second output mode, and controls the graphics card module 102 to enter a second frame adjustment mode for adjusting the second image signal into a third image signal. After the graphics card module 102 enters the second frame adjustment mode, it feeds back a third flag signal to the processor 105. The processor 105 receives the second image signal output by the imaging module 101, and the processor 105 outputs the second image signal to the graphics card module 102 at the frame rate corresponding to the third flag signal. The frame rate corresponding to the third flag signal corresponds to the second frame rate. The graphics card module 102 adjusts the second image signal into the third image signal through frame interpolation.

[0042] Specifically, when the imaging module 101 outputs a second image signal in the second output mode, the SoC of the terminal device sends a pre-written fourth control instruction to the graphics card module 102. After receiving the fourth control instruction, the graphics card module 102 enters the second frame adjustment mode. In the second frame adjustment mode, the graphics card module 102 performs frame interpolation on the second image signal. Among them, the second image signal with the second frame rate is interpolated into a third image signal with the third frame rate.

[0043] Furthermore, the third flag signal can be a TE signal, and the frame rate corresponding to the third flag signal can be the signal frequency of the TE signal. After the graphics card module 102 enters the second frame adjustment mode, it sends a TE signal to the processor 105. The signal frequency of the TE signal can be set to a predetermined value. Among them, when the imaging module 101 is in the second output mode, the predetermined value can correspond to the second frame rate, so as to maintain frame synchronization. For example, if the second frame rate is 30 FPS, the predetermined value can be 30 HZ.

[0044] The processor 105 sends the second image signal to the graphics card module 102 according to the signal frequency of the TE signal. For example, if the second frame rate is 30 FPS, the signal frequency of the TE signal is 30 HZ. The imaging module 101 outputs a second image signal of 30 FPS to the SoC, and the SoC transmits the second image signal to the graphics card module 102 according to the signal frequency of the TE signal of 30 HZ. In this way, the processor 105 outputs the second image signal to the graphics card module 102 at the frame rate corresponding to the third flag signal. The second frame rate of the second image signal corresponds to the frame rate corresponding to the third flag signal, so as to ensure frame synchronization, and further improve the smoothness of the picture. Furthermore, the processor 105 can also transmit data to the graphics card module 102 at a frame rate corresponding to the second frame rate, reducing the power consumption of the processor 105 for transmitting data, further increasing the battery life of the terminal device, and ensuring the stability of the processor 105's operation and maintaining the high smoothness of the picture.

[0045] Furthermore, the following combines Figure 4 to further illustrate the specific structure of the electronic device.Figure 4 The figure shows a schematic diagram of the specific internal implementation structure of an electronic device, which includes a camera module 101, a graphics card module 102, a display panel 103, a fill light module 104, and a processor 105.

[0046] Specifically, the CSI-Tx0 interface of the camera module 101 is connected to the CSI-Rx0 of the processor 105. The camera module 101 outputs a first image signal at a first frame rate or a second image signal at a second frame rate through the CSI-Tx0 interface. The processor 105 receives the first image signal at the first frame rate or the second image signal at the second frame rate through the CSI-Rx0 interface. Data transmission between the CSI-Tx0 interface of the camera module 101 and the CSI-Rx0 of the processor 105 is carried out through the Mobile Industry Processor Interface (mipi) protocol.

[0047] The DSI 0 interface of the processor 105 is connected to the DSI Rx0 interface of the graphics card module 102, the DSI 1 interface of the processor 105 is connected to the DSI Rx1 interface of the graphics card module 102, and the CSI 1 interface of the processor 105 is connected to the CSI Tx1 interface of the independent display chip. Among them, the DSI0 interface and the DSI 1 interface of the processor 105 are used to send a first image signal at a first frame rate to the graphics card module 102 at a frame rate corresponding to the TE signal (the first flag signal) (for example, in the first output mode, the frame rate is 15HZ) or to send a second image signal at a second frame rate to the graphics card module 102 at a frame rate corresponding to the third flag signal (for example, in the first output mode, the frame rate is 30HZ). The DSI Rx0 interface of the graphics card module 102 is used to receive the first image signal at the first frame rate or the second image signal at the second frame rate transmitted by the DSI 0 interface. The DSI Rx1 interface of the graphics card module 102 is used to receive the first image signal at the first frame rate or the second image signal at the second frame rate transmitted by the DSI 1 interface. The CSI 1 interface of the processor 105 is used to receive the image signal after at least one of frame interpolation processing, image processing, and fill light processing by the graphics card module 102. The CSI Tx1 interface of the graphics card module 102 is used to output the image signal after at least one of frame interpolation processing, image processing, and fill light processing.

[0048] The DSI Tx 1 interface of the graphics card module 102 is connected to the display panel 103. The DSI TX 1 interface of the graphics card module 102 is used to output a third image signal at a third frame rate to the display panel 103 at a frame rate corresponding to the second flag signal of the display panel 103 (such as 60FPS). Data transmission between the DSI Tx 1 interface of the graphics card module 102 and the display panel 103 is carried out through the mipi protocol.

[0049] The processing module inside the graphics card module 102 has functions such as frame interpolation, super-resolution, noise reduction, color enhancement, and image overlay. The graphics card module 102 is electrically connected to the fill light module 104 and conducts data communication through the I2C (Inter-Integrated Circuit) bus.

[0050] Based on the electronic device mentioned in the above embodiments, the embodiments of the present application provide an image display method based on the above electronic device to Figure 5 show a schematic flowchart of an image display method provided by the embodiments of the present application. This method can be executed by a terminal device. In other words, the method can be executed by software or hardware installed in the terminal device. Hereinafter, taking the shooting mode of the camera module as the preview or video recording mode as an example, the image display method will be described. As Figure 5 shown, the method may include the following steps.

[0051] Step S501: When the camera module is in the first output mode, output a first image signal through the camera module. The first image signal has a first frame rate. When the camera module is in the second output mode, output a second image signal through the camera module. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate.

[0052] Specifically, the SoC may send a first control instruction to the camera module to control the camera module to enter the first output mode. When the camera module is in the first output mode, output a first image signal through the camera module. The first image signal has a first frame rate. Send a third control instruction to the camera module to control the camera module to enter the second output mode, and output a second image signal through the camera module in the second output mode.

[0053] Among them, the SoC may send a pre-written control instruction to the camera module. After receiving the control instruction, the camera module outputs an image signal in the output mode indicated by the control instruction. Among them, the first output mode may be a frame rate reduction mode. The frame rate reduction mode is to lower the output frame rate of the camera module from the default frame rate. For example, the default output frame rate of the camera module is 30 FPS. After the camera module enters the first output mode, the output frame rate of the camera module drops to 15 FPS.

[0054] Step S502: Send a second control instruction to the graphics card module to control the graphics card module to enter the first frame adjustment mode. After controlling the graphics card module to enter the first frame adjustment mode, receive the first flag signal fed back by the graphics card module, and control the camera module to send the first image signal to the graphics card module at the frame rate of the first flag signal.

[0055] Specifically, the first frame rate adjustment mode can be the frame interpolation mode. The frame interpolation mode is to increase the output frame rate in the first output mode of the camera module. For example, the output frame rate of the camera module is adjusted from 15 FPS to 60 FPS. When the camera module outputs the first image signal to the SoC, the camera module can output the first image signal corresponding to the frame rate of the first flag signal to the SoC at the first frame rate. Then, the SoC sends the first image signal to the graphics card module through the DSI 0 interface and the DSI 1 interface according to the frame rate of the first flag signal, so as to maintain frame synchronization and ensure the smoothness of image signal transmission. Among them, the first flag signal can be the TE signal, and the value of the frame rate of the TE signal can be the same as the first frame rate of the first image signal. For example, if the first frame rate is 15 FPS, the frame rate of the first flag signal can be 15 HZ. The camera module outputs the first image signal corresponding to the frame rate of the first flag signal to the SoC at the first frame rate, which can be that the camera module outputs the 15 FPS image signal to the SoC at the 15 HZ frame rate, so as to maintain frame synchronization and improve the smoothness of image signal transmission.

[0056] Further, in the case where the camera module outputs the second image signal in the second output mode, a fourth control instruction is sent to the graphics card module to control the graphics card module to enter the second frame rate adjustment mode. The SoC receives the third flag signal fed back by the graphics card module and controls the camera module to send the second image signal to the graphics card module at the frame rate of the third flag signal. The second image signal is adjusted to the third image signal by the graphics card module, and the third image signal has a third frame rate, and the third frame rate is greater than the second frame rate.

[0057] The second frame rate adjustment mode can be the frame interpolation mode. The frame interpolation mode is to increase the output frame rate in the second output mode of the camera module. For example, the output frame rate of the camera module is adjusted from 30 FPS to 90 FPS. When the camera module outputs the second image signal to the SoC, the camera module can output the second image signal corresponding to the frame rate of the third flag signal to the SoC at the second frame rate. Then, the SoC sends the second image signal to the graphics card module through the DSI0 interface and the DSI1 interface according to the frame rate of the third flag signal, so as to maintain frame synchronization and ensure the smoothness of image signal transmission. Among them, the third flag signal can be the TE signal, and the value of the frame rate of the TE signal can be the same as the second frame rate of the second image signal. For example, if the second frame rate is 30 FPS, the frame rate of the third flag signal can be 30 HZ. The camera module outputs the second image signal corresponding to the frame rate of the third flag signal to the SoC at the second frame rate, which can be that the camera module outputs the 30 FPS image signal to the SoC at the 30 HZ frame rate, so as to maintain frame synchronization and improve the smoothness of image signal transmission.

[0058] Step S503: After the graphics card module receives the first image signal, the first image signal is adjusted by the graphics card module into a third image signal, and the third image signal has a third frame rate, and the third frame rate is greater than the first frame rate.

[0059] Specifically, the second flag signal sent by the display panel is received by the graphics card module, and the first image signal is adjusted by the graphics card module according to the frame rate of the second flag signal, so that the third frame rate of the third image signal is the same as the display frame rate of the display panel, and the frame rate of the second flag signal corresponds to the display frame rate. Among them, the first image signal can be interpolated by the graphics card module to adjust the first image signal into a third image signal.

[0060] The second flag signal can be a TE signal. The first image signal is interpolated according to the frame rate of the TE signal to obtain a third image signal with a third frame rate. The third frame rate of the third image signal is the same as the frame rate of the second flag signal, and the frame rate of the second flag signal is the same as the display frame rate. For example, if the frame rate of the second flag signal is 60HZ and the first frame rate is 15FPS, after the first image signal is interpolated, a third frame rate of 60FPS is obtained.

[0061] Step S504: The third image signal is displayed through the display panel.

[0062] Specifically, the graphics card module can be controlled to send the third image signal to the display panel according to the frame rate of the second flag signal, and the third image signal is displayed by the display panel at the display frame rate. For example, the graphics card module sends a third image signal of 60FPS to the display panel with the TE signal being 60HZ, and the display panel displays the third image signal at the display frame rate of 60FPS, so as to ensure the frame synchronization of the signal transmission between the graphics card module and the display panel and ensure the smoothness of the image signal displayed on the display panel.

[0063] It should be noted that if the shooting mode of the shooting module is the preview mode or the video recording mode, the graphics card module also needs to send the third image signal back to the SoC for the SoC to save and back up.

[0064] Through the technical solution disclosed in the embodiments of the present application, the shooting module has two output modes. Compared with the second output mode, the shooting module can output the first image signal at the reduced first frame rate in the first output mode, and then the graphics card module interpolates the first image signal to obtain a third image signal that meets the display frame rate of the display panel. By reducing the output frame rate of the shooting module, the burden on the shooting module is reduced, the power consumption of the shooting module is reduced, and the stability of the shooting module is improved.

[0065] Based on the electronic device mentioned in the above embodiments, the embodiments of the present application provide another image display method based on the above electronic device to Figure 6The flowchart shows a method for image display provided by an embodiment of the present application. This method can be executed by a terminal device. In other words, the method can be executed by software or hardware installed in the terminal device. Hereinafter, taking the camera mode of the camera module as the preview or video recording mode as an example, the image display method will be described. As Figure 6 shown, the method may include the following steps:

[0066] Step S601: When the camera module is in the first output mode, output a first image signal through the camera module. The first image signal has a first frame rate. When the camera module is in the second output mode, output a second image signal through the camera module. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate.

[0067] Step S602: Send a second control instruction to the graphics card module to control the graphics card module to enter the first frame adjustment mode. After controlling the graphics card module to enter the first frame adjustment mode, receive the first flag signal fed back by the graphics card module, and control the camera module to send the first image signal to the graphics card module at the frame rate of the first flag signal.

[0068] Step S603: After the graphics card module receives the first image signal, perform frame interpolation on the first image signal through the graphics card module to adjust the first image signal to a third image signal. While performing frame interpolation on the first image signal through the graphics card module, evaluate whether the first image signal needs image processing. If the first image signal needs image processing, then after performing frame interpolation on the first image by the graphics card module, obtain a third image signal, and then perform image processing on the third image signal to obtain a fourth image signal.

[0069] Specifically, when the image quality of the first image signal does not meet the requirements, frame interpolation can be performed on the first image signal, and then image processing is performed on the obtained third image signal. The image processing includes at least one of noise reduction, brightening, and color enhancement. The third image signal has a third frame rate, and the third frame rate is greater than the first frame rate. When adjusting the first image signal, the graphics card module can receive a second flag signal sent by the display panel, and adjust the first image signal according to the frame rate of the second flag signal through the graphics card module, so that the third frame rate of the third image signal is the same as the display frame rate of the display panel, and the frame rate of the second flag signal corresponds to the display frame rate.

[0070] Furthermore, when the camera module outputs the second image signal in the second output mode, while performing frame interpolation on the second image signal through the graphics card module, evaluate whether the second image signal needs image processing. If the second image signal needs image processing, then after performing frame interpolation on the second image by the graphics card module, obtain a third image signal, and then perform image processing on the third image signal to obtain a fourth image signal.

[0071] Step S604: Display the fourth image signal via the display panel.

[0072] Specifically, the graphics card module can be controlled to send the fourth image signal to the display panel according to the frame rate of the second flag signal, and the fourth image signal is displayed via the display panel at the display frame rate. For example, the graphics card module sends the fourth image signal with 60 FPS to the display panel with a TE signal of 60HZ, and the display panel displays the fourth image signal at a display frame rate of 60 FPS, thereby ensuring frame synchronization of the signal transmission between the graphics card module and the display panel and ensuring the smoothness of the image signal display on the display panel.

[0073] It should be noted that Step S601 and Step S602 have the same or similar implementation manners as the above-mentioned Step S501 and Step S502, and they can be referred to each other. The embodiments of the present application do not make any limitations here.

[0074] Through the embodiments disclosed in the embodiments of the present application, the imaging module has two output modes. When the imaging module is in the first output mode, compared with the second output mode, it can output the first image signal at a reduced first frame rate, and then the graphics card module interpolates the first image signal to obtain the third image signal that meets the display frame rate of the display panel. By reducing the output frame rate of the imaging module, the burden on the imaging module is reduced, the power consumption of the imaging module is reduced, and the stability of the imaging module is improved. In addition, if there is a problem of low image quality, the graphics card module needs to perform image processing on the first image signal, which can further improve the image quality of the image signal. In addition, while the graphics card module interpolates the first image signal, it evaluates whether the first image signal needs to be processed. By simultaneously interpolating and evaluating the image quality, the overall time for the graphics card module to interpolate and process the first image signal can be shortened, thereby improving the processing efficiency of the graphics card module.

[0075] Based on the electronic device mentioned in the above embodiments, the embodiments of the present application provide another image display method based on the above electronic device to Figure 7 show a schematic flowchart of an image display method provided by the embodiments of the present application. This method can be executed by a terminal device. In other words, the method can be executed by software or hardware installed in the terminal device. Hereinafter, the imaging mode of the imaging module is taken as the shooting mode as an example to illustrate the image display method. As Figure 7 shown, the method may include the following steps:

[0076] Step S701: When the imaging module is in the first output mode, output the first image signal via the imaging module. The first image signal has a first frame rate. When the imaging module is in the second output mode, output the second image signal via the imaging module. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate.

[0077] Step S702: Send a second control instruction to the graphics card module to control the graphics card module to enter the first frame adjustment mode. After controlling the graphics card module to enter the first frame adjustment mode, receive the first flag signal fed back by the graphics card module, and control the camera module to send the first image signal to the graphics card module at the frame rate of the first flag signal.

[0078] Step S703: After the graphics card module receives the first image signal, perform frame interpolation on the first image signal through the graphics card module to adjust the first image signal to a third image signal. While performing frame interpolation on the first image signal through the graphics card module, evaluate whether the first image signal requires image processing. In response to the user's camera operation, determine the camera mode of the camera module. In the case where the camera mode is the photo-taking mode, if image fill light processing is required, control the fill light in the fill light module to turn on or adjust the brightness of the fill light through the graphics card module, and then control the camera module and the fill light module to cooperate to take a photo again.

[0079] Specifically, if the user selects the photo-taking mode, generally, after the user clicks to take a photo, the image within the camera view of the camera module is directly taken without fill light. In this application, after the user clicks to take a photo, if the brightness of the image within the camera view of the camera module is too dark, pre-flash can be performed first, that is, image fill light processing is performed. After controlling the fill light in the fill light module to turn on to complete the fill light, main flash is then performed to complete the photo-taking, improving the brightness and image quality of the taken photo.

[0080] Furthermore, if the first image signal requires image processing, after the graphics card module performs frame interpolation on the first image, a third image signal is obtained, and then image processing is performed on the third image signal to obtain a fourth image signal. The image processing includes at least one of noise reduction, brightening, and color enhancement. Then, image fill light processing is performed on the fourth image signal to obtain a fifth image signal. The fifth image signal has a third frame rate, and the third frame rate is greater than the first frame rate.

[0081] Step S704: Display the fifth image signal through the display panel.

[0082] Specifically, the graphics card module can be controlled to send the fifth image signal to the display panel according to the frame rate of the second flag signal, and the display panel displays the fifth image signal at the display frame rate. For example, the graphics card module sends a fifth image signal of 60 FPS to the display panel with a TE signal of 60HZ, and the display panel displays the fifth image signal at a display frame rate of 60 FPS, thereby ensuring frame synchronization of the signal transmission between the graphics card module and the display panel and ensuring the smoothness of the display of the image signal on the display panel.

[0083] It should be noted that if the shooting mode of the shooting module is the photo-taking mode, the graphics card module is also required to send the fifth image signal back to the SoC for the SoC to save and back up.

[0084] Through the technical solution disclosed in the embodiment of the present application, the shooting module has two output modes. When the shooting module outputs the first image signal in the first output mode, compared with the second output mode, it can output the first image signal at a reduced first frame rate, and then the graphics card module performs frame interpolation on the first image signal to obtain a third image signal that meets the display frame rate of the display panel. By reducing the output frame rate of the shooting module, the burden on the shooting module is reduced, the power consumption of the shooting module is reduced, and the stability of the shooting module is improved.

[0085] In addition, if there is a problem that the image brightness is too low, the fill light of the fill light module can be controlled to turn on for fill light to improve the image brightness. If there is a problem of low image quality, the graphics card module needs to perform image processing on the first image signal, which can further improve the image quality of the image signal. In addition, while the graphics card module performs frame interpolation on the first image signal, it evaluates whether the first image signal needs to be processed. By simultaneously performing frame interpolation and evaluating the image quality, the overall time for the graphics card module to perform frame interpolation and image processing on the first image signal can be shortened, thereby improving the processing efficiency of the graphics card module.

[0086] It should be noted that the same parts in the embodiments of the above electronic device and the embodiments of the image display method can be referred to each other, and the same content in the embodiments of the present application will not be repeated. It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-on-chip, system chip, chip system, or system-on-chip.

[0087] It should be noted that in this article, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including that element. In addition, it should be pointed out that the methods and devices in the embodiments of the present application are not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.

[0088] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to enable a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of various embodiments of the present application.

[0089] The embodiments of the present application have been described above with reference to the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

Claims

1. An electronic device, characterized in that, The electronic device includes: A camera module having a first output mode and a second output mode. The camera module selects to enter the first output mode or the second output mode according to a received control instruction. When the camera module is in the first output mode, it outputs a first image signal with a first frame rate. When the camera module is in the second output mode, it outputs a second image signal with a second frame rate. The first frame rate is less than the second frame rate. The first output mode is a frame-dropping mode, and the second output mode is a normal output mode; A graphics card module that receives the first image signal or the second image signal. When the camera module outputs the first image signal in the first output mode, the graphics card module adjusts the first image signal to a third image signal with a third frame rate, and the third frame rate is greater than the first frame rate; A display panel connected to the graphics card module, receiving and displaying the third image signal output by the graphics card module; A processor that controls the camera module to output a first image signal in the first output mode and controls the graphics card module to enter a first frame adjustment mode for adjusting the first image signal to the third image signal; After the graphics card module enters the first frame adjustment mode, it feeds back a first flag signal to the processor; The processor receives the first image signal output by the camera module and outputs the first image signal to the graphics card module at the frame rate corresponding to the first flag signal. The graphics card module adjusts the first image signal to the third image signal by frame interpolation, and the frame rate corresponding to the first flag signal corresponds to the first frame rate; The processor is further configured to transmit data to the graphics card module at a frame rate corresponding to the first frame rate.

2. The electronic device according to claim 1, characterized in that, The third frame rate is the same as the display frame rate of the display panel.

3. The electronic device according to claim 1, characterized in that, The third frame rate is greater than the second frame rate.

4. The electronic device according to claim 1, characterized in that, When the camera module outputs the second image signal in the second output mode, the graphics card module adjusts the second image signal to the third image signal.

5. The electronic device according to claim 4, characterized in that, The graphics card module adjusts the first image signal or the second image signal to the third image signal by frame interpolation. While performing frame interpolation on the first image signal or the second image signal, the graphics card module evaluates whether the first image signal or the second image signal requires image processing, and the image processing includes at least one of noise reduction, brightening, and color enhancement.

6. The electronic device according to claim 1, characterized in that, The first frame rate is between 10 FPS and 30 FPS, and the third frame rate is between 60 FPS and 120 FPS.

7. The electronic device according to claim 1, characterized in that, It further includes a fill light module. The fill light module includes a fill light. The graphics card module is electrically connected to the fill light module, and the graphics card module controls the fill light to turn on or off.

8. The electronic device according to claim 1, characterized in that, The graphics card module adjusts the first image signal according to the frame rate corresponding to the second flag signal sent by the display panel, so that the third frame rate of the third image signal is the same as the display frame rate of the display panel, and the frame rate of the second flag signal corresponds to the display frame rate.

9. The electronic device according to claim 1, characterized in that, The processor controls the imaging module to output a second image signal in a second output mode, and controls the graphics card module to enter a second frame adjustment mode for adjusting the second image signal into the third image signal; After the graphics card module enters the second frame adjustment mode, it feeds back a third flag signal to the processor. The processor receives the second image signal output by the imaging module, and the processor outputs the second image signal to the graphics card module at the frame rate corresponding to the third flag signal. The frame rate corresponding to the third flag signal corresponds to the second frame rate. The graphics card module adjusts the second image signal into the third image signal by frame interpolation.

10. An image display method, characterized in that, Applied to the electronic device according to any one of claims 1-9, the image display method includes: When the imaging module is in a first output mode, output a first image signal through the imaging module. The first image signal has a first frame rate. When the imaging module is in a second output mode, output a second image signal through the imaging module. The second image signal has a second frame rate, and the first frame rate is less than the second frame rate; When the imaging module outputs the first image signal in the first output mode, adjust the first image signal into a third image signal through the graphics card module. The third image signal has a third frame rate, and the third frame rate is greater than the first frame rate; Display the third image signal through the display panel.

11. The image display method according to claim 10, characterized in that, The outputting the first image signal through the imaging module includes: Send a first control instruction to the imaging module, control the imaging module to enter the first output mode, and output the first image signal through the imaging module in the first output mode; Before adjusting the first image signal into the third image signal through the graphics card module, the method further includes: Send a second control instruction to the graphics card module, control the graphics card module to enter a first frame adjustment mode, receive a first flag signal fed back by the graphics card module, and control the imaging module to send the first image signal to the graphics card module at the frame rate of the first flag signal.

12. The image display method according to claim 10, characterized in that, The adjusting the first image signal into the third image signal through the graphics card module includes: Receive a second flag signal sent by the display panel through the graphics card module, and adjust the first image signal according to the frame rate of the second flag signal through the graphics card module, so that the third frame rate of the third image signal is the same as the display frame rate of the display panel. The frame rate of the second flag signal corresponds to the display frame rate; The displaying the third image signal through the display panel includes: Control the graphics card module to send the third image signal to the display panel according to the frame rate of the second flag signal, and display the third image signal through the display panel at the display frame rate.

13. The image display method according to claim 10, wherein, The outputting the second image signal through the imaging module includes: Send a third control instruction to the imaging module, control the imaging module to enter the second output mode, and output the second image signal through the imaging module in the second output mode; When the imaging module outputs a second image signal in the second output mode, a fourth control instruction is sent to the graphics card module to control the graphics card module to enter the second frame adjustment mode. The third flag signal fed back by the graphics card module is received, and the imaging module is controlled to send the second image signal to the graphics card module at the frame rate of the third flag signal. The second image signal is adjusted to a third image signal by the graphics card module, and the third image signal has a third frame rate, and the third frame rate is greater than the second frame rate.

14. The image display method according to claim 10, wherein, The adjustment of the first image signal to the third image signal by the graphics card module includes: Performing frame interpolation on the first image signal by the graphics card module to adjust the first image signal to the third image signal; While performing frame interpolation on the first image signal by the graphics card module, evaluating whether the first image signal requires image processing, and the image processing includes at least one of noise reduction, brightening, and color enhancement.

15. The image display method according to claim 14, wherein, After evaluating whether the first image signal requires image processing while performing frame interpolation on the first image signal by the graphics card module, the method further includes: In response to a user's imaging operation, determining the imaging mode of the imaging module. When the imaging mode is the photo-taking mode, if image fill light processing is required, after controlling the fill light in the fill light module to turn on or adjusting the brightness of the fill light by the graphics card module, the imaging module and the fill light module are controlled to cooperate to take a photo again.

Images