Image display method, apparatus, device, and medium

Abstract

The application discloses an image display method, device, equipment and medium, and relates to the technical field of image processing. The method is applied to an electronic device and includes the following steps: acquiring a first sending time at which a display screen of the electronic device sends a first hardware vertical synchronization signal; determining, according to the first sending time, a second sending time at which a signal generator in a camera of the electronic device sends a second vertical synchronization signal; instructing the signal generator to send the second vertical synchronization signal at the second sending time; in the case that a photosensitive array generates a partial Bayer array formed by a preset number of pixels each time, instructing a digital signal processor to perform image processing on the latest generated partial Bayer array to obtain a partial to-be-displayed image; and in the case that the first sending time arrives, sending the partial to-be-displayed image to the display screen in response to the first hardware vertical synchronization signal. The method can reduce the display delay of the electronic device, thereby meeting the low-latency requirement of the electronic device such as XR (e.g., AR).

Description

Technical Field

[0001] This application relates to the field of image processing technology, and more specifically, to an image display method, apparatus, device, and medium. Background Technology

[0002] Currently, the typical display process for images captured by a camera in a display device is as follows: light reflected from the object is projected onto the camera's CMOS sensor array through the camera's lens; the CMOS sensor array senses light line by line and outputs Bayer RGB format images to the ISP line by line; after the complete Bayer RGB format image is generated, the ISP performs Demosaic interpolation and noise reduction on each pixel in the Bayer RGB format image, and then outputs the processed complete frame image to the system memory (DDR); after the display screen sends a Display Vsync signal, the processed complete frame image in DDR is sent to the display screen for display. This display process results in a large display latency problem, thus failing to meet the low latency requirements of display devices such as AR and XR. Summary of the Invention

[0003] One objective of this application is to provide a new technical solution for image display.

[0004] According to a first aspect of this application, an image display method is provided, applied to an electronic device, comprising:

[0005] Obtain the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device;

[0006] Based on the first transmission time, a second transmission time is determined for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal. The second transmission time is earlier than the first transmission time. The second vertical synchronization signal is used to notify the photosensitive array of the camera to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal.

[0007] The signal generator is instructed to send the second vertical synchronization signal at the second transmission time;

[0008] When the photosensitive array generates a partial Bayer array consisting of a preset number of pixels, the digital signal processor is instructed to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed.

[0009] Upon arrival of the first transmission time, in response to the first hardware vertical synchronization signal, the portion of the image to be displayed is transmitted to the display screen.

[0010] Optionally, sending the portion of the image to be displayed to the display screen includes:

[0011] The portion of the image to be displayed, obtained by the latest image processing performed by the digital signal processor, is sent to the display screen.

[0012] Optionally, the preset number of pixels is the number of pixels included in a row of pixels in the Bayer array.

[0013] Optionally, determining the second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal based on the first transmission time includes:

[0014] The time before the first transmission time is taken as the second transmission time when the signal generator in the camera of the electronic device transmits the second vertical synchronization signal;

[0015] The preset duration is the time it takes for the photosensitive array to generate the partial Bayer array and the time it takes for the digital signal processor to perform image processing on the partial Bayer array to obtain the partial image to be displayed.

[0016] Optionally, obtaining the first transmission time of the first hardware vertical synchronization signal transmitted by the display screen of the electronic device includes:

[0017] When the target application is currently running in the foreground of the electronic device, the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device is obtained.

[0018] According to a second aspect of this application, an image display device is provided, applied to an electronic device, comprising:

[0019] The acquisition module is used to acquire the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device;

[0020] The determining module is configured to determine, based on the first transmission time, a second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal, wherein the second transmission time is earlier than the first transmission time, and the second vertical synchronization signal is used to notify the photosensitive array of the camera to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal.

[0021] The first indication module is used to instruct the signal generator to send the second vertical synchronization signal at the second transmission time;

[0022] The second instruction module is used to instruct the digital signal processor to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed, when the photosensitive array generates a partial Bayer array formed by pixels of a preset number of pixels.

[0023] The sending module is configured to send the portion of the image to be displayed to the display screen in response to the first hardware vertical synchronization signal when the first sending time arrives.

[0024] Optionally, the sending module is specifically used to send the portion of the image to be displayed obtained by the digital signal processor in the latest image processing to the display screen.

[0025] Optionally, the preset number of pixels is the number of pixels included in a row of pixels in the Bayer array.

[0026] According to a third aspect of this application, an electronic device is provided, the electronic device comprising an image display device as described in any one of the second aspects; or,

[0027] The electronic device includes a memory and a processor, the memory being used to store computer instructions, and the processor being used to retrieve the computer instructions from the memory to perform the image display method as described in any one of the first aspects.

[0028] According to a fourth aspect of this application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the image display method according to any one of the first aspects.

[0029] Other features and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0030] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the present application and, together with their description, serve to explain the principles of the present application.

[0031] Figure 1 This is a hardware configuration outline of an electronic device for implementing an image display method according to an embodiment of this application. Figure 1 ;

[0032] Figure 2 This is a flowchart illustrating an image display method according to an embodiment of this application. Figure 1 ;

[0033] Figure 3 This is a schematic diagram of the structure of a Bayer array according to this application;

[0034] Figure 4 This is a flowchart illustrating an image display method according to an embodiment of this application. Figure 2 ;

[0035] Figure 5 This is a flowchart illustrating an image display method according to an embodiment of this application. Figure 3 ;

[0036] Figure 6 This is a schematic diagram of a structure for implementing an image display device according to an embodiment of this application;

[0037] Figure 7 This is a hardware configuration outline of an electronic device for implementing an image display method according to an embodiment of this application. Figure 2 . Detailed Implementation

[0038] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0039] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0040] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0041] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0042] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0043] Figure 1 This is a hardware configuration outline of an electronic device for implementing an image display method according to an embodiment of this application. Figure 1 .

[0044] Electronic device 1000 can be a terminal or a server. Furthermore, the terminal can be a head-mounted device (such as an AR device, MR device, or VR device), a portable computer, a tablet computer, a PDA, etc. The server can be a cloud server, etc.

[0045] Electronic device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and a camera 1900, etc. The processor 1100 may be a central processing unit (CPU), a microprocessor (MCU), etc. The memory 1200 may include, for example, ROM (Read-Only Memory), RAM (Random Access Memory), or non-volatile memory such as a hard disk. The interface device 1300 may include, for example, a USB interface, a headphone jack, etc. The communication device 1400 may be capable of wired or wireless communication. The display device 1500 may be, for example, an LCD screen, a touch screen, etc. The input device 1600 may include, for example, a touch screen, a keyboard, etc. Users can input / output voice information through the speaker 1700 and the microphone 1800.

[0046] Despite Figure 1 The electronic device 1000 shows multiple devices, but this application may only involve some of them. For example, the electronic device 1000 may only involve the memory 1200, the processor 1100 and the camera 1900.

[0047] In the embodiments applied in this application, the memory 1200 of the electronic device 1000 is used to store instructions for controlling the processor 1100 to execute the image display method provided in the embodiments of this application.

[0048] In the above description, those skilled in the art can design instructions based on the scheme disclosed in this application. How the instructions control the processor to operate is well known in the art, and therefore will not be described in detail here.

[0049] This application provides an image display method, which is applied to electronic devices, such as... Figure 2 As shown, the process includes steps S2100 to S2500.

[0050] Step S2100: Obtain the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device.

[0051] In this embodiment, the first hardware vertical synchronization signal is specifically a hardware Vsync signal, sent by the display screen. Any hardware vertical synchronization signal sent by the display screen is denoted as the first hardware vertical synchronization signal. The time of transmission of the first hardware vertical synchronization signal is denoted as the first transmission time.

[0052] It should be noted that the first transmission time can be obtained using traditional techniques, and this application does not limit the method of obtaining the first transmission time.

[0053] Step S2200: Determine the second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal based on the first transmission time.

[0054] The second transmission time is earlier than the first transmission time, and the second vertical synchronization signal is used to notify the camera's photosensitive array to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal.

[0055] In this embodiment, the time preceding the first transmission time is designated as the second transmission time.

[0056] The photosensitive array is typically a CMOS image sensor.

[0057] The second vertical synchronization signal is specifically Camera Vsync, used to notify the camera's image sensor array to begin generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal. The second vertical synchronization signal is sent by a signal generator, typically a CSI (Computer Integrated Signal Processor). Upon receiving the second vertical synchronization signal, the camera's image sensor array begins generating the Bayer array.

[0058] Specifically, the frame image corresponding to the first hardware vertical synchronization signal refers to a frame image that needs to be displayed on the screen after the first hardware vertical synchronization signal is sent, i.e., after the first sending time.

[0059] Step S2300: Instruct the signal generator to send a second vertical synchronization signal at the second transmission time.

[0060] Based on step S2300 above, at the second transmission moment, the signal generator sends a second vertical synchronization signal. At this time, the photosensitive array senses the analog light signal entering through the camera lens line by line, generating a Bayer pattern array composed of rows of Bayer RGB. The Bayer pattern is also known as a Bayer RGB format image.

[0061] In one example, the Bayer array can be as follows: Figure 3 As shown. A single row of Bayer RBG consists of multiple pixels, with each pixel containing only one of the three channels: R, G, and B.

[0062] In step S2400, when the photosensitive array generates a partial Bayer array consisting of a preset number of pixels, the digital signal processor is instructed to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed.

[0063] In this embodiment, the digital signal processor is typically a DSP.

[0064] Image processing includes demosaic processing, lens distortion correction, and color distortion correction. Specifically, demosaic processing refers to recovering the two missing color components for each pixel in the Bayer array, ensuring each pixel has data in the r, g, and b channels. Figure 3 Taking the first pixel of the Bayer array as an example, by demosaic processing, the R and B channel data can be retrieved for the first pixel. In this way, the first pixel has both R and B channel data in addition to the G channel data.

[0065] The preset number of pixels can be set empirically. In one example, the preset number of pixels is the number of pixels included in one row of pixels in a Bayer array.

[0066] In this embodiment, when the photosensitive array generates a partial Bayer array consisting of a preset number of pixels, for example in Figure 3 When a partial Bayer array corresponding to a row of pixels is generated based on the given information, the digital signal processor (DSP) is instructed to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed. This approach offers several advantages. First, compared to conventional techniques where image processing is performed on the entire Bayer array after its generation, image processing of the already generated partial Bayer array can be performed during the Bayer array generation process. Second, unlike conventional techniques that process each pixel individually within the Bayer array, the DSP possesses vector processing capabilities, allowing for synchronous processing of pixels within a partial Bayer array. Therefore, based on the above steps, the image display method provided in this application can simultaneously generate and process the Bayer array, and perform batch processing of pixels within the Bayer array, thereby improving the generation efficiency of the image to be displayed. This reduces the display latency of electronic devices, thus meeting the low-latency requirements of electronic devices such as AR and XR devices.

[0067] It should be noted that in the specific implementation process, such as Figure 4 As shown, when the photosensitive array generates a partial Bayer array consisting of a preset number of pixels, the photosensitive array first stores the partial Bayer array in memory, such as DDR memory. Furthermore, for any partial Bayer array, the digital signal processor first reads the partial Bayer array from memory, then performs image processing on the read partial Bayer array to obtain a partial image to be displayed; after obtaining the partial image to be displayed, the digital signal processor stores that partial image in memory.

[0068] In step S2500, when the first transmission time arrives, in response to the first vertical synchronization signal, a portion of the image to be displayed is transmitted to the display screen.

[0069] It should be noted that in the specific implementation process, such as Figure 4 As shown, some of the images to be displayed are stored in memory, and the display screen reads the images to be displayed from memory for on-screen display.

[0070] In this embodiment, upon arrival of the first transmission time, a first vertical synchronization signal sent by the display screen is received. At this time, in response to the hardware vertical synchronization signal sent by the display screen, a portion of the image to be displayed is transmitted to the display screen.

[0071] In one embodiment of this application, sending a portion of the image to be displayed to the display screen in step S2500 can specifically be: when the digital signal processor generates a portion of the image to be displayed corresponding to each part of the Bayer array that makes up the Bayer array, that is, when the digital signal processor generates a complete frame of the image to be displayed composed of the partial Bayer array, the entire frame of the image to be displayed is sent to the display screen.

[0072] In another embodiment of this application, sending a portion of the image to be displayed to the display screen in step S2500 can be specifically implemented as follows: for each portion of the image to be displayed generated by the digital signal processor, the newly generated portion of the image to be displayed is sent to the display screen. Based on this, sending a portion of the image to be displayed to the display screen in step S2500 is specifically implemented through the following step S2510.

[0073] Step S2510: Send the portion of the image to be displayed obtained from the latest image processing by the digital signal processor to the display screen.

[0074] Based on the above step S2510, it is possible to send a portion of the image to be displayed to the display screen while the digital signal processor is generating the portion of the image to be displayed. Compared with the traditional technology, which sends the image to be displayed to the display screen after the complete frame is generated, this enables the display screen to display the image in advance, thereby further reducing the display latency of electronic devices and meeting the low latency requirements of electronic devices such as AR and XR.

[0075] This application provides an image display method applied to an electronic device, comprising: acquiring a first transmission time at which the display screen of the electronic device transmits a first hardware vertical synchronization signal; determining a second transmission time, based on the first transmission time, a second transmission time, whereby a signal generator in the camera of the electronic device transmits a second vertical synchronization signal, the second transmission time being earlier than the first transmission time, the second vertical synchronization signal being used to notify the photosensitive array of the camera to begin generating a Bayer array of the frame image corresponding to the first hardware vertical synchronization signal; instructing the signal generator to transmit the second vertical synchronization signal at the second transmission time; instructing the digital signal processor to perform image processing on the newly generated partial Bayer array to obtain the partial image to be displayed, provided that each time the photosensitive array generates a partial Bayer array formed by a preset number of pixels; and, upon arrival of the first transmission time, transmitting the partial image to be displayed to the display screen in response to the first hardware vertical synchronization signal. In this embodiment, compared to the conventional technique of performing image processing on the entire Bayer array after the photosensitive array has generated it, image processing can be performed on the already generated partial Bayer array during the generation of the Bayer array. On the other hand, compared to processing each pixel in the Bayer array one by one in traditional technologies, digital signal processors (DSPs) have vector processing capabilities. Therefore, DSPs can be used to perform synchronous processing of some pixels in the Bayer array. Thus, the image display method provided in this application can generate and process the Bayer array simultaneously, and process the pixels in the Bayer array in batches, thereby improving the generation efficiency of the image to be displayed. Based on this, the display latency of electronic devices can be reduced, thereby meeting the low-latency requirements of electronic devices such as AR and XR devices.

[0076] In one embodiment of this application, the above step S2200 can be specifically implemented by the following step S2210.

[0077] Step S2210: The time before the preset duration of the first transmission time is used as the second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal.

[0078] The preset duration is the time it takes for the photosensitive array to generate a portion of the Bayer array and the time it takes for the digital signal processor to perform image processing on a portion of the Bayer array to obtain a portion of the image to be displayed.

[0079] In this embodiment, since the number of pixels in each part of the Bayer array is a preset number, the time taken for the digital signal processor to perform image processing on each part of the Bayer array to obtain a partial image to be displayed is the same. Based on this, with the preset time being the time it takes for the photosensitive array to generate a partial Bayer array and the time taken for the digital signal processor to perform image processing on that part of the Bayer array to obtain a partial image to be displayed, the first partial image to be displayed can be sent to the display screen immediately after generation. This allows for stable transmission of partial images to the display screen.

[0080] Based on the above, in one example, where the preset pixel count is the number of pixels included in one row of pixels in a Bayer array, such as... Figure 5 As shown, the image display method provided in this application can achieve the following: an instruction signal generator sends a second vertical synchronization signal at a second transmission time; at the second transmission time, the signal generator sends the second vertical synchronization signal, and the photosensitive array begins to generate a partial Bayer array Cam Line1 consisting of a row of pixels; after the partial Bayer array Cam Line1 is generated, the digital signal processor performs image processing on the Cam Line1 to obtain the partial image to be displayed, Display Line1, corresponding to Cam Line1; the moment when the digital signal processor obtains the partial image to be displayed, Display Line1, is the first transmission time, at which time the first vertical synchronization signal is received, and the partial image to be displayed, Display Line1, is sent to the display screen; this process can be repeated to generate each partial Bayer array and process it before displaying it on the screen.

[0081] It should be noted that, Figure 5 The middle part of the Bayer array consists of Cam Line 1, Cam Line 2, and Cam Line 3 in sequence, and the part of the image to be displayed consists of Display Line 1, Display Line 2, and Display Line 3 in sequence, as shown in the example.

[0082] In one embodiment of this application, step S2100 can be specifically implemented by step S2110.

[0083] Step S2110: When the target application is running in the foreground of the electronic device, obtain the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device.

[0084] In this embodiment, the target application is an application that requires low display latency, which can be manually specified by the user in advance. Based on this, the image display method provided in this application further includes: providing an input interface for the user to input an application identifier of the target application; and, in response to input through the input interface, determining the application corresponding to the application identifier input through the input interface as the target application.

[0085] For example, the target application may be a game application.

[0086] In this embodiment, when the target application is running in the foreground of the electronic device, the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device is obtained, and then the above steps S2200 to S2500 are executed to complete the image display method provided in this application, thereby enabling the electronic device to display the image of the target application under the requirement of low display latency.

[0087] like Figure 6 As shown, this application also provides an image display device 600, applied to an electronic device, comprising:

[0088] The acquisition module 610 is used to acquire the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device;

[0089] The determining module 620 is used to determine, based on the first transmission time, a second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal, wherein the second transmission time is earlier than the first transmission time, and the second vertical synchronization signal is used to notify the photosensitive array of the camera to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal.

[0090] The first indication module 630 is used to instruct the signal generator to send the second vertical synchronization signal at the second transmission time;

[0091] The second instruction module 640 is used to instruct the digital signal processor to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed, when the photosensitive array generates a partial Bayer array formed by pixels of a preset number of pixels.

[0092] The transmitting module 650 is configured to transmit the portion of the image to be displayed to the display screen in response to the first hardware vertical synchronization signal when the first transmitting time arrives.

[0093] In one embodiment of this application, the sending module 650 is specifically used to send the portion of the image to be displayed obtained by the digital signal processor in the latest execution of the image processing to the display screen.

[0094] In one embodiment of this application, the preset number of pixels is the number of pixels included in a row of pixels in the Bayer array.

[0095] In one embodiment of this application, the determining module 620 is specifically used to take the time before the first transmission time, which is a preset duration before the first transmission time, as the second transmission time when the signal generator in the camera of the electronic device transmits the second vertical synchronization signal.

[0096] The preset duration is the time it takes for the photosensitive array to generate the partial Bayer array and the time it takes for the digital signal processor to perform image processing on the partial Bayer array to obtain the partial image to be displayed.

[0097] In one embodiment of this application, the acquisition module 610 is specifically used to acquire the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device when the target application is currently running in the foreground of the electronic device.

[0098] This application also provides an electronic device 700, which includes the image display device 600 as described in any of the above-described embodiments of the image display device; or...

[0099] like Figure 7 As shown, the electronic device 700 includes a memory 710 and a processor 720. The memory 710 is used to store computer instructions, and the processor 720 is used to call the computer instructions from the memory 710 to execute the image display method as described in any of the above method embodiments.

[0100] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the image display method according to any one of the above method embodiments.

[0101] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0102] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0103] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0104] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0105] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0106] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0107] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0108] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0109] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. An image display method, characterized in that, Applied to electronic devices, including: Obtain the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device; Based on the first transmission time, a second transmission time is determined for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal. The second transmission time is earlier than the first transmission time. The second vertical synchronization signal is used to notify the photosensitive array of the camera to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal. The signal generator is instructed to send the second vertical synchronization signal at the second transmission time; When the photosensitive array generates a partial Bayer array consisting of a preset number of pixels, the digital signal processor is instructed to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed. When the first transmission time arrives, in response to the first hardware vertical synchronization signal, the portion of the image to be displayed is transmitted to the display screen; Wherein, determining the second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal based on the first transmission time includes: The time before the first transmission time is taken as the second transmission time when the signal generator in the camera of the electronic device transmits the second vertical synchronization signal; The preset duration is the time it takes for the photosensitive array to generate the partial Bayer array and the time it takes for the digital signal processor to perform image processing on the partial Bayer array to obtain the partial image to be displayed.

2. The method according to claim 1, characterized in that, Sending the portion of the image to be displayed to the display screen includes: The portion of the image to be displayed, obtained by the latest image processing performed by the digital signal processor, is sent to the display screen.

3. The method according to claim 1, characterized in that, The preset number of pixels is the number of pixels included in one row of pixels in the Bayer array.

4. The method according to claim 1, characterized in that, The first transmission time of obtaining the first hardware vertical synchronization signal sent by the display screen of the electronic device includes: When the target application is currently running in the foreground of the electronic device, the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device is obtained.

5. An image display device, characterized in that, Applied to electronic devices, including: The acquisition module is used to acquire the first transmission time of the first hardware vertical synchronization signal sent by the display screen of the electronic device; The determining module is configured to determine, based on the first transmission time, a second transmission time for the signal generator in the camera of the electronic device to transmit the second vertical synchronization signal, wherein the second transmission time is earlier than the first transmission time, and the second vertical synchronization signal is used to notify the photosensitive array of the camera to start generating the Bayer array of the frame image corresponding to the first hardware vertical synchronization signal. The first indication module is used to instruct the signal generator to send the second vertical synchronization signal at the second transmission time; The second instruction module is used to instruct the digital signal processor to perform image processing on the newly generated partial Bayer array to obtain a partial image to be displayed, when the photosensitive array generates a partial Bayer array formed by pixels of a preset number of pixels. The sending module is configured to send the portion of the image to be displayed to the display screen in response to the first hardware vertical synchronization signal when the first sending time arrives; Specifically, the determining module is used to take the time before the first transmission time, which is a preset duration before the first transmission time, as the second transmission time when the signal generator in the camera of the electronic device transmits the second vertical synchronization signal. The preset duration is the time it takes for the photosensitive array to generate the partial Bayer array and the time it takes for the digital signal processor to perform image processing on the partial Bayer array to obtain the partial image to be displayed.

6. The apparatus according to claim 5, characterized in that, The sending module is specifically used to send the portion of the image to be displayed obtained by the digital signal processor in the latest image processing to the display screen.

7. The apparatus according to claim 5, characterized in that, The preset number of pixels is the number of pixels included in one row of pixels in the Bayer array.

8. An electronic device, characterized in that, The electronic device includes the image display device as described in any one of claims 5 to 7; or... The electronic device includes a memory and a processor, the memory being used to store computer instructions, and the processor being used to retrieve the computer instructions from the memory to execute the image display method as described in any one of claims 1-4.

9. A computer-readable storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the image display method according to any one of claims 1-4.

Images