Image shooting and displaying method and device

By using time-sharing multiplexed image signal processors, alternate shooting and display of front and rear cameras is realized, which solves the problem of being unable to be used simultaneously in video call scenarios, reduces equipment cost and power consumption, and is suitable for miniaturized devices.

CN119031247APending Publication Date: 2024-11-26杭州溪棠感芯科技有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410998593.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The prior art cannot use the front and rear cameras at the same time for shooting and displaying in different directions in video call scenarios, and two image signal processors are required to be configured to achieve synchronous display, resulting in high cost and high power consumption.

Method used

By using time-sharing multiplexed image signal processor, the same image signal processor controls the alternate shooting of the front and rear cameras, and stores and outputs images in sequence in the storage area, realizing the same opening and opening of the front and rear cameras. show.

Benefits of technology

It reduces equipment cost and power consumption, realizes the simultaneous use and display functions of front and rear cameras, and is suitable for miniaturized devices such as children's phone watches.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031247A_ABST
    Figure CN119031247A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an image shooting and displaying method and device, and the method comprises the steps: responding to the starting of a target function, and distributing a storage region for the target function; alternately controlling a front camera and a rear camera to shoot images based on a specified frequency, and storing forward images shot by the corresponding front camera in each shooting period and backward images shot by the corresponding rear camera in each shooting period into a storage area; when the number of the forward images and / or the backward images in the storage area meets the display requirement, the forward images in the storage area are controlled to be sequentially output to a first display area of the screen based on the storage sequence, and meanwhile, controlling the backward images in the storage area to be sequentially output to a second display area of the screen based on the storage sequence. According to the method disclosed by the invention, the effects of simultaneously starting the front camera and the rear camera and synchronously displaying the acquired images can be realized with low cost and low power consumption.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of image capturing and displaying, and in particular to a method and device for capturing and displaying an image. Background Art

[0002] With the development of technology and in order to meet the shooting needs of users, many electronic devices are now equipped with front cameras and rear cameras. Users can switch the front camera and the rear camera according to their own needs to achieve shooting in different directions.

[0003] However, in some usage scenarios, such as video call scenarios, only one camera can be used, and the front and rear cameras cannot be used simultaneously to shoot and display in different directions. In order to enable the front and rear cameras to be used simultaneously in such usage scenarios, the existing solution is to configure an image signal processor for the front camera and an image signal processor for the rear camera, so that the shooting of the front and rear cameras is controlled by different image signal processors respectively, ensuring that the images shot by the two cameras can be displayed synchronously, but this solution involves high costs and high power consumption. Summary of the invention

[0004] In order to solve the above technical problems, an embodiment of the present invention provides a method for capturing and displaying an image, comprising:

[0005] In response to the activation of a target function, a storage area is allocated for the target function, wherein the target function is a function of simultaneously activating a front camera and a rear camera to shoot and display the shot images;

[0006] Alternately controlling the front camera and the rear camera to capture images based on a specified frequency, and storing the obtained forward images captured by the corresponding front camera in each capturing cycle and the obtained backward images captured by the corresponding rear camera in each capturing cycle in the storage area, wherein the front camera and the rear camera are both controlled by the same image signal processor to complete the capturing of the corresponding images;

[0007] When the number of forward images and / or backward images in the storage area meets the display requirements, the forward images in the storage area are controlled to be output sequentially to the first display area of ​​the screen based on the storage order, and the backward images in the storage area are controlled to be output sequentially to the second display area of ​​the screen based on the storage order.

[0008] In some embodiments, the method further comprises:

[0009] Determining a first frame rate of the front camera and a first adjustment duration of a shooting parameter of the front camera by an image signal processor in a device;

[0010] Determining a second frame rate of the rear camera and a second adjustment duration of the image signal processor on the shooting parameters of the rear camera;

[0011] The designated frequency is determined by calculation based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration.

[0012] In some embodiments, the calculating and determining the specified frequency based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration includes:

[0013] Based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration, a range of the number of forward images allowed to be taken by the front camera during each shooting session and a range of the number of backward images allowed to be taken by the rear camera during each shooting session are calculated and determined, and the range of the number of forward images is the same as or different from the range of the number of backward images.

[0014] In some embodiments, the alternately controlling the front camera and the rear camera to capture images based on a specified frequency includes:

[0015] Controlling the front camera to start shooting a front image, and when the number of the shot front images is within the range of the number of front images, controlling the front camera to stop shooting;

[0016] Controlling the rear camera to start shooting rearward images, and when the number of the rearward images shot is within the rearward image number range, controlling the rear camera to stop shooting;

[0017] The above steps are repeated until the number of forward images and / or backward images in the storage area meets the requirement.

[0018] In some embodiments, allocating a storage area for the target function includes:

[0019] Allocating a first storage area and a second storage area for the target function in a device memory, wherein the first storage area is used to store a forward image and the second storage area is used to store a backward image; or

[0020] A whole continuous storage area is allocated for the target function in the device memory, and both the forward image and the backward image are stored in the storage area.

[0021] In some embodiments, storing the obtained forward image obtained during each shooting period of the corresponding front camera and the obtained backward image obtained during each shooting period of the corresponding rear camera in the storage area includes:

[0022] storing the obtained forward image in the first storage area, and numbering the stored forward image;

[0023] storing the obtained backward image in the second storage area, and numbering the stored backward image; or

[0024] The obtained forward image is stored in the storage area, and the stored forward image is numbered according to a first numbering strategy;

[0025] storing the obtained backward image in the storage area, and numbering the stored backward image according to a second numbering strategy, wherein the first numbering strategy is different from the second numbering strategy, and the corresponding numbering results are different;

[0026] The numbers of the forward images are used to represent the storage order of the forward images, and the numbers of the backward images are used to represent the storage order of the backward images.

[0027] In some embodiments, the forward image and the backward image are both stored based on the same transmission line;

[0028] The number of the forward images and / or backward images in the storage area meets the display requirements, including:

[0029] If the rear camera is started first, then when the storage amount of the forward images in the storage area is not less than the number of shots taken by the front camera in a shooting cycle, it is determined that the display requirement is met; or

[0030] If the front camera is started first, then when the storage amount of the backward images in the storage area is not less than the number of shots taken by the rear camera in two shooting cycles, it is determined that the display requirement is met; or

[0031] When the storage amount of the forward image and the backward image in the storage area is not less than the sum of the number of shots taken by the front camera and the rear camera in two shooting cycles, it is determined that the display requirement is met;

[0032] The display requirement represents that the storage amount of the forward image and the backward image can support the screen to continuously display the forward image and the backward image simultaneously.

[0033] In some embodiments, the method further comprises:

[0034] Controlling the screen to be in a split-screen display mode, so as to divide a display area of ​​the screen into a first display area and a second display area based on the split-screen display mode; or

[0035] Controlling generation of a first display window and a second display window on the screen, wherein the first display window forms the first display area, and the second display window forms a second display area; or

[0036] Controlling generation of a third display window on the screen;

[0037] The third display window is divided into regions to form the first display region and the second display region respectively.

[0038] In some embodiments, the method further comprises:

[0039] When receiving a start instruction of a target function, determining whether the application scenario currently in which the device is located is the target application scenario, and if so, responding to the start of the target function; or

[0040] When the device starts a target application or starts a specified function of the target application, controlling the start of the target function;

[0041] The target application includes a communication application, and the designated function includes a video call function.

[0042] Another embodiment of the present invention also provides an image capturing and displaying device, including:

[0043] a response module, configured to allocate a storage area for a target function in response to the activation of the target function, wherein the target function is a function of simultaneously activating a front camera and a rear camera to shoot and display the shot image;

[0044] A first control module is used to alternately control the front camera and the rear camera to capture images according to a specified frequency, and store the front image captured by the corresponding front camera in each capture cycle and the rear image captured by the corresponding rear camera in each capture cycle in the storage area, wherein the front camera and the rear camera are controlled by the same image signal processor to complete the capture of the corresponding images;

[0045] A second control module is used to control the forward images in the storage area to output the forward images in sequence to the first display area of ​​the screen based on the storage order when the number of forward images and / or backward images in the storage area meets the display requirements, and to control the backward images in the storage area to output the backward images in sequence to the second display area of ​​the screen based on the storage order.

[0046] Based on the disclosure of the above embodiments, it can be known that the beneficial effects of the embodiments of the present invention include the ability to realize the function of simultaneously opening and displaying the front camera and the rear camera based on one image signal processor by time-division multiplexing of the image signal processor. The overall solution has low cost. At the same time, since the number of image signal processors set is reduced, the device size can be effectively reduced and the device power consumption can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 Schematic diagram of the process of capturing and displaying an image in an embodiment of the present invention.

[0049] Figure 2 FIG. 4 is a flow chart of a method for capturing and displaying an image in another embodiment of the present invention.

[0050] Figure 3 4 is a structural block diagram of an image capturing and displaying device in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The specific embodiments of the present invention are described in detail below with reference to the accompanying drawings, but are not intended to limit the present invention.

[0052] It should be understood that various modifications may be made to the embodiments disclosed herein. Therefore, the following description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope of the present disclosure will occur to those skilled in the art.

[0053] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the general description of the present disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the present disclosure.

[0054] These and other characteristics of the invention will become apparent from the following description of a preferred form of embodiment given as a non-limiting example, with reference to the accompanying drawings.

[0055] It should also be understood that, although the invention has been described with reference to some specific examples, those skilled in the art will be able to realize many other equivalent forms of the invention that have the characteristics recited in the claims and are therefore within the scope of protection defined thereby.

[0056] The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0057] Specific embodiments of the present disclosure are described hereinafter with reference to the accompanying drawings; however, it should be understood that the disclosed embodiments are merely examples of the present disclosure, which may be implemented in a variety of ways. Well-known and / or repeated functions and structures are not described in detail to avoid obscuring the present disclosure with unnecessary or redundant details. Therefore, the specific structural and functional details disclosed herein are not intended to be limiting, but merely serve as a basis and representative basis for the claims to teach those skilled in the art to use the present disclosure in a variety of ways with substantially any suitable detailed structure.

[0058] This specification may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," all of which may refer to one or more of the same or different embodiments according to the present disclosure.

[0059] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0060] like Figure 1 As shown, an embodiment of the present invention provides a method for capturing and displaying an image, comprising:

[0061] S1: In response to starting a target function, allocating a storage area for the target function, wherein the target function is a function of simultaneously starting a front camera and a rear camera to shoot and display the shot images;

[0062] S2: Alternately controlling the front camera and the rear camera to capture images based on a specified frequency, and storing the forward image captured by the corresponding front camera in each capture cycle and the backward image captured by the corresponding rear camera in each capture cycle in the storage area, wherein the front camera and the rear camera are controlled by the same image signal processor to complete the capture of the corresponding images;

[0063] S3: When the number of forward images and / or backward images in the storage area meets the display requirements, the forward images in the storage area are controlled to be output sequentially to the first display area of ​​the screen based on the storage order, and the backward images in the storage area are controlled to be output sequentially to the second display area of ​​the screen based on the storage order.

[0064] The scheme of the above embodiment can be applied to mobile phones, phone watches, including children's phone watches and other devices with video shooting requirements and small size, and can also be applied to other devices with front cameras and rear cameras, without limitation. In this embodiment, the device is a children's phone watch as an example for explanation. The children's phone watch in this embodiment is internally provided with a chip, such as but not limited to a system chip (SOC chip), and an image signal processor (image si gnal processor, ISP chip) is integrated on the SOC chip to form a hardware module on the SOC chip. The main function of the image signal processing chip is to process the signal output by the image sensor at the front end of the device to improve the quality of the digital image and make it as close as possible to the effect of the human eye seeing the real scene. Its specific processing flow includes the lens in the camera module transmitting the collected light signal to the image sensor, the image signal processor obtaining the original image through the image sensor, and performing algorithm processing on the original image to form an image in the RGB space domain, and transmitting the image in the RGB space domain to the video acquisition unit at the back end, and the back end hardware modules such as the video acquisition unit cooperate to complete the image processing. At the same time, the image signal processor is also used to control the hardware in the camera module, such as the lens and image sensor, to realize functions such as automatic aperture, automatic exposure, and automatic white balance during shooting.

[0065] Based on the contents of the above embodiments, it can be known that the solution proposed in this embodiment is to realize the function of simultaneous camera opening and simultaneous display of the front camera and the rear camera based on only one image signal processor by time-division multiplexing of the image signal processor, that is, to realize the effect of simultaneously starting the front camera and the rear camera to complete the collection of the forward and rear environmental information relative to the device, and displaying it at the same time, thereby effectively replacing the existing solution in which only different image signal processors can be set one-to-one to realize the collection and synchronous display of the forward and rear environmental images. Since the number of image signal processors set is reduced, the implementation cost of the solution is low, the power consumption of the device is reduced, and the assembly space in the device is saved. Because the installation of the image signal processor requires the configuration of multiple related accessories, and each accessory requires corresponding assembly space, for miniaturized devices, such as children's phone watches, this design cannot be supported. The solution of this embodiment can effectively realize that the miniaturized device has the target function, and can achieve the technical effect of simultaneous opening and display of the front and rear cameras.

[0066] In one embodiment, the method further comprises:

[0067] S4: Determine a first frame rate of the front camera and a first adjustment duration of a shooting parameter of the front camera by an image signal processor in the device;

[0068] S5: Determine a second frame rate of the rear camera and a second adjustment duration of the image signal processor on the shooting parameters of the rear camera;

[0069] S6: Calculate and determine the designated frequency based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration.

[0070] In this embodiment, the system determines the first frame rate of the front camera, that is, the shooting rate of the front camera, and the second frame rate of the rear camera, that is, the shooting rate of the rear camera, and the image signal processor adjusts the shooting parameters of the front camera and the rear camera during shooting, such as adjusting AWB (automatic white balance), AE (automatic exposure), and AF (automatic focus) to converge, so that the lens focus position, shutter, aperture, sensitivity, and perceived ambient color temperature are appropriate during shooting, ensuring that the brightness, color tone, and realism of the captured image meet the standards. The system then comprehensively determines the specified frequency based on each frame rate and adjustment duration.

[0071] Specifically, the calculating and determining the designated frequency based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration includes:

[0072] S7: Based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration, a range of the number of forward images allowed to be taken by the front camera and a range of the number of backward images allowed to be taken by the rear camera are calculated and determined, and the range of the number of forward images is the same as or different from the range of the number of backward images.

[0073] That is, in this embodiment, the frame rate and the adjustment duration are calculated to determine how many frames of images the front camera and the rear camera need to shoot in order for the image signal processor to complete the adjustment of the shooting parameters of the camera currently in the shooting state, and at the same time, the occupancy of the storage area and the simultaneous display of the forward image and the backward image can be minimized, that is, the activation duration of the target function is controlled at the minimum value of the allowable range, and the response time is shortened. In this embodiment, the first frame rate and the second frame rate are the same, and the first adjustment duration is the same as the second adjustment duration, so the specified frequency is a fixed value, which can be applied to both the front camera and the rear camera, such as the specified frequency is to shoot 3 frames of forward images, or 3 frames of backward images in a shooting cycle, or to shoot 4 frames, 5 frames, 6 frames, etc. of forward images or backward images in a shooting cycle. Of course, for two cameras with different frame rates or different adjustment times, the system can combine the characteristics of the two cameras to calculate a unified frequency that can adapt to the two cameras at the same time, or it can calculate the two frequencies separately to adapt to the front camera and the rear camera respectively, such as limiting the same shooting cycle to 4 frames for the front camera and 5 frames for the rear camera, etc. The specific implementation form is not unique.

[0074] Further, such as Figure 2 As shown, the method of alternately controlling the front camera and the rear camera to capture images based on a specified frequency includes:

[0075] S8: controlling the front camera to start shooting the front images, and when the number of the shot front images is within the range of the number of the front images, controlling the front camera to stop shooting;

[0076] S9: controlling the rear camera to start shooting rearward images, and when the number of the captured rearward images is within the rearward image number range, controlling the rear camera to stop shooting;

[0077] S10: Repeat the above steps until the number of forward images and / or backward images in the storage area meets the display requirement.

[0078] Exemplarily, taking the shooting cycles of the front camera and the rear camera as the same, and the designated frequency as 3-5 frames of images in each shooting cycle, when the system controls the front camera to start shooting the forward image, when the number of forward images shot by the front camera is recorded as 3 frames (it can also be 4 frames, 5 frames, etc.), it is determined that the number of shots is within the range of the number of forward images and meets the requirements, the front camera is controlled to stop shooting, and the rear camera is started to start shooting the rearward image. When it also shoots 3 frames of rearward images, it is determined that the number of shots is within the range of the number of rearward images and meets the requirements, the rear camera is controlled to stop shooting, and the front camera is controlled to start shooting at the same time. The above steps are repeated until the forward and rear images stored in the storage area meet the display requirements.

[0079] In this embodiment, the device has a camera control system, which includes modules such as ISP, CPU, DSP, etc. that specifically send instructions to the camera, which are mainly used to realize light metering, calculation, exposure, flash control, shooting logic control and image compression processing. The control system of the digital camera is mainly realized by the microprocessor CPU, and the unified coordination and control of various operations can be completed by the microprocessor. Based on this, when controlling the front camera or the rear camera to stop shooting, this embodiment is realized by sending a software interrupt to the front camera or the rear camera through the camera control system, specifically controlling the front camera or the rear camera to sleep, retreat to the background operation, and give the foreground to the camera that needs to be in the shooting state. When switching cameras, it is only necessary to wake up the dormant camera through the camera control system. Of course, the camera can also be controlled to shut down and then controlled to start. In this embodiment, it is preferred to control the camera to sleep, which can save more energy consumption and have a higher operation failure rate.

[0080] Optionally, when waking up or starting the camera corresponding to the next shooting cycle, this embodiment controls the shooting time of one or two frames in advance to implement the wake-up or start-up. For example, the number of frames collected and stored by the front and rear cameras during each shooting is N frames. Then, when the current camera shoots the N-2th frame image, the camera control system can be controlled to send a sleep wake-up instruction to the sleeping camera. In this way, when the non-sleeping camera completes the shooting and storage of N frames of images, the sleeping camera completes the wake-up, and can perform image acquisition and transmission in time to achieve seamless connection. The specific duration in advance needs to meet the following points. The first is to ensure that the camera in the current shooting state completes the storage of the required number of images. The second is to achieve seamless connection as much as possible. The third is to ensure the stability of the overall system of the device.

[0081] When the camera is started for the first time, the front camera can be automatically turned on after a delay of nms when the target function is turned on and the allocation of the storage area is completed; n can be set to, but not limited to, 10, that is, the front camera is turned on after a delay of 10ms after the storage area is opened. If the rear camera is turned on first, the principle is the same.

[0082] In another embodiment, allocating a storage area for the target function includes:

[0083] S11: Allocating a first storage area and a second storage area for the target function in a device memory, wherein the first storage area is used to store a forward image, and the second storage area is used to store a backward image; or

[0084] A whole continuous storage area is allocated for the target function in the device memory, and both the forward image and the backward image are stored in the storage area.

[0085] That is, the system may apply for two independent storage areas for the target function, or may apply for a whole continuous storage area. In this embodiment, applying for two independent storage areas is preferably used as an example for description.

[0086] The step of storing the obtained forward image obtained during each shooting period of the corresponding front camera and the obtained backward image obtained during each shooting period of the corresponding rear camera in the storage area comprises:

[0087] S12: storing the obtained forward image in the first storage area, and numbering the stored forward image;

[0088] S13: storing the obtained backward image in the second storage area, and numbering the stored backward image; or

[0089] S14: storing the obtained forward image in the storage area, and numbering the stored forward image according to a first numbering strategy;

[0090] S15: storing the obtained backward image in the storage area, and numbering the stored backward image according to a second numbering strategy, wherein the first numbering strategy is different from the second numbering strategy, and the corresponding numbering results are different;

[0091] The numbers of the forward images are used to represent the storage order of the forward images, and the numbers of the backward images are used to represent the storage order of the backward images.

[0092] For example, the first storage area is buffer 1, and the second storage area is buffer 2. The system will automatically store the current frame data of the front camera in buffer 1, and mark the frame number of the stored frame through the software flag bit method to ensure that each frame has a corresponding different frame number, that is, numbering. In this embodiment, it is preferred to record the frame number of the initial first frame as 1, the frame number of the second frame as 2, and the Nth frame as n. The subsequent transmission of the current frame data of the rear camera to buffer 2 is the same. When the target function is exited, the corresponding memory data is released, and the next time it is entered, it is counted again, which is equivalent to restarting the frame number marking of the collected new frame data every time the target function is started. When the storage area applied for is an area, the system can number the frame data stored in the front camera and the rear camera based on different numbering strategies, so that the numbering results are different, and the forward image and the backward image can be accurately distinguished. For example, the forward image and the backward image are numbered f1 f2 f3...fn and b1 b2 b3...bn, etc. The number can reflect the storage order of the image, that is, the shooting order, so that when the subsequent system controls the transmission of the stored image to the corresponding display area for display, the storage order of the image can be identified based on the number, and then the image can be output in sequence based on the order, thereby realizing the display of video data that meets the timing and ensuring correct transmission and display.

[0093] Furthermore, in this embodiment, the embodiment of time-division multiplexing is mainly embodied in that the forward image and the backward image are both transmitted to the image signal processor based on the same transmission line, and the image is transmitted to the screen based on two different transmission lines, so it is necessary to use time-division multiplexing transmission lines to transmit image data to the image signal processor. In addition, when the target function in this embodiment is actually started, that is, when the forward and backward images are synchronously displayed, the shooting, storage, and transmission are carried out simultaneously, that is, shooting, storage, and output are performed at the same time.

[0094] The number of the forward images and / or backward images in the storage area meets the display requirements, including:

[0095] S16: If the rear camera is started first, then when the storage amount of the forward images in the storage area is not less than the number of shots taken by the front camera in a shooting cycle, it is determined that the display requirement is met; or

[0096] If the front camera is started first, then when the storage amount of the backward images in the storage area is not less than the number of shots taken by the rear camera in two shooting cycles, it is determined that the display requirement is met; or

[0097] When the storage amount of the forward image and the backward image in the storage area is not less than the sum of the number of shots taken by the front camera and the rear camera in two shooting cycles, it is determined that the display requirement is met;

[0098] The display requirement represents that the storage amount of the forward image and the backward image can support the screen to continuously display the forward image and the backward image simultaneously.

[0099] Specifically, in this embodiment, it means that a certain amount of forward images and backward images need to be stored in the storage area before the display can begin, that is, the activation of the target function is completed, and the activation includes the process from triggering the target function to completing the synchronous display of the first frame of the forward image and the backward image. The startup duration is the duration involved in the process. However, since the storage area can only choose to receive either the forward image or the backward image when receiving image data, because the ISP hardware in this embodiment realizes the transmission of image data in a single channel, and the forward and backward images need to be displayed simultaneously when displaying, in order to achieve the purpose of simultaneous display, a certain amount of data needs to be stored in buffer1 and buffer2 first.

[0100] Since the number of images stored in each shooting cycle is N frames, when the number of images obtained by the subsequent shooting is an integer multiple of N, the number of images obtained by the previous shooting or the shooting cycle can only be more than that of the subsequent shooting. Therefore, when realizing synchronous display, the two cameras have shooting data of the same time period, which can support the effect of realizing synchronous display. Similarly, for the embodiment of counting the total number of images, it is sufficient to ensure that the two cameras have image data of the same number of shooting cycles. However, in order to take into account the activation of the target function and the completion of the shooting of the corresponding number of shooting cycles by both cameras, the number of forward images or backward images involved in the storage should be at least 2N, that is, the amount of two shooting cycles. Of course, it can also be 3N or 4N, which is not specific and can be determined according to the actual situation of the device. In addition, the image storage capacity also needs to consider the input speed and output speed of the storage area, the input rate and output rate of the image signal processor. In this embodiment, the storage area is a memory, and its input rate is approximately equal to twice the output rate, so it provides a relatively sufficient processing time for the image signal processor. Therefore, when the number of the two images is at least 2N, the smoothness of the synchronous display can be ensured.

[0101] In another embodiment, the method further comprises:

[0102] S17: controlling the screen to be in a split-screen display mode, so as to divide a display area of ​​the screen into a first display area and a second display area based on the split-screen display mode; or

[0103] Controlling generation of a first display window and a second display window on the screen, wherein the first display window forms the first display area, and the second display window forms a second display area; or

[0104] Controlling generation of a third display window on the screen;

[0105] The third display window is divided into regions to form the first display region and the second display region respectively.

[0106] In actual application, any of the above methods can be implemented to achieve the construction of two different display areas. The user can customize the display positions, relative positions, etc. of the two display areas.

[0107] Optionally, the method further comprises:

[0108] S18: upon receiving a start instruction of a target function, determining whether the current application scenario of the device is the target application scenario, and if so, responding to the start of the target function; or

[0109] When the device starts a target application or starts a specified function of the target application, controlling the start of the target function;

[0110] The target application includes a communication application, and the designated function includes a video call function.

[0111] For example, the target application is a call application, and the designated function is a video call function. If the user starts the call application of the phone watch and then starts the target function, the system responds to the start of the target function and implements image acquisition, etc. Or the user starts the call application and starts the video call function. At this time, the system automatically starts the target function, that is, after determining the application scenario of the current device and determining that it meets the requirements, it automatically starts the target function. Of course, it is not limited to this, and it can also be other application scenarios, or there can be no application scenario, that is, no application is started, and only the target function is started.

[0112] When the user triggers the shutdown of the target function, the system stops capturing, storing and displaying images and releases the storage area.

[0113] like Figure 3 As shown, another embodiment of the present invention also provides an image capturing and displaying device 100, including:

[0114] a response module, configured to allocate a storage area for a target function in response to the activation of the target function, wherein the target function is a function of simultaneously activating a front camera and a rear camera to shoot and display the shot image;

[0115] A first control module is used to alternately control the front camera and the rear camera to capture images according to a specified frequency, and store the front image captured by the corresponding front camera in each capture cycle and the rear image captured by the corresponding rear camera in each capture cycle in the storage area, wherein the front camera and the rear camera are controlled by the same image signal processor to complete the capture of the corresponding images;

[0116] A second control module is used to control the forward images in the storage area to output the forward images in sequence to the first display area of ​​the screen based on the storage order when the number of forward images and / or backward images in the storage area meets the display requirements, and to control the backward images in the storage area to output the backward images in sequence to the second display area of ​​the screen based on the storage order.

[0117] In some embodiments, the apparatus further comprises:

[0118] A first determination module, used to determine a first frame rate of the front camera and a first adjustment duration of the image signal processor in the device on the shooting parameters of the front camera;

[0119] A second determination module, configured to determine a second frame rate of the rear camera and a second adjustment duration of the image signal processor on the shooting parameters of the rear camera;

[0120] The third determination module is used to calculate and determine the specified frequency according to the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration.

[0121] In some embodiments, the calculating and determining the specified frequency based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration includes:

[0122] Based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration, a range of the number of forward images allowed to be taken by the front camera during each shooting session and a range of the number of backward images allowed to be taken by the rear camera during each shooting session are calculated and determined, and the range of the number of forward images is the same as or different from the range of the number of backward images.

[0123] In some embodiments, the alternately controlling the front camera and the rear camera to capture images based on a specified frequency includes:

[0124] Controlling the front camera to start shooting a front image, and when the number of the shot front images is within the range of the number of front images, controlling the front camera to stop shooting;

[0125] Controlling the rear camera to start shooting rearward images, and when the number of the rearward images shot is within the rearward image number range, controlling the rear camera to stop shooting;

[0126] The above steps are repeated until the number of forward images and / or backward images in the storage area meets the requirement.

[0127] In some embodiments, allocating a storage area for the target function includes:

[0128] Allocating a first storage area and a second storage area for the target function in a device memory, wherein the first storage area is used to store a forward image and the second storage area is used to store a backward image; or

[0129] A whole continuous storage area is allocated for the target function in the device memory, and both the forward image and the backward image are stored in the storage area.

[0130] In some embodiments, storing the obtained forward image obtained during each shooting period of the corresponding front camera and the obtained backward image obtained during each shooting period of the corresponding rear camera in the storage area includes:

[0131] storing the obtained forward image in the first storage area, and numbering the stored forward image;

[0132] storing the obtained backward image in the second storage area, and numbering the stored backward image; or

[0133] The obtained forward image is stored in the storage area, and the stored forward image is numbered according to a first numbering strategy;

[0134] storing the obtained backward image in the storage area, and numbering the stored backward image according to a second numbering strategy, wherein the first numbering strategy is different from the second numbering strategy, and the corresponding numbering results are different;

[0135] The numbers of the forward images are used to represent the storage order of the forward images, and the numbers of the backward images are used to represent the storage order of the backward images.

[0136] In some embodiments, the forward image and the backward image are both stored based on the same transmission line;

[0137] The number of the forward images and / or backward images in the storage area meets the display requirements, including:

[0138] When the storage amount of the forward images in the storage area is not less than the number of shots taken by the front camera in three shooting cycles, it is determined that the display requirement is met;

[0139] When the storage amount of the backward images in the storage area is not less than the number of shots taken by the rear camera in two shooting cycles, it is determined that the display requirement is met;

[0140] When the storage amount of the forward image and the backward image in the storage area is not less than the sum of the number of shots taken by the front camera and the rear camera in two shooting cycles, it is determined that the display requirement is met;

[0141] The display requirement represents that the storage amount of the forward image and the backward image can support the screen to continuously display the forward image and the backward image simultaneously.

[0142] In some embodiments, the apparatus further comprises:

[0143] a third control module, configured to control the screen to be in a split-screen display mode, so as to divide a display area of ​​the screen into a first display area and a second display area based on the split-screen display mode; or

[0144] Controlling generation of a first display window and a second display window on the screen, wherein the first display window forms the first display area, and the second display window forms a second display area; or

[0145] Controlling generation of a third display window on the screen;

[0146] The third display window is divided into regions to form the first display region and the second display region respectively.

[0147] In some embodiments, the apparatus further comprises:

[0148] A fourth determination module is used to determine whether the application scenario currently in which the device is located is the target application scenario when receiving the start instruction of the target function, and if so, respond to the start of the target function; or

[0149] A fourth control module, used for controlling the start of the target function when the device starts the target application or starts a specified function of the target application;

[0150] The target application includes a communication application, and the designated function includes a video call function.

[0151] Another embodiment of the present invention further provides an electronic device, including:

[0152] at least one processor; and,

[0153] a memory communicatively connected to the at least one processor; wherein,

[0154] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to implement the image capturing and displaying method as described in any one of the embodiments above.

[0155] Another embodiment of the present invention further provides a storage medium, which includes a stored program, wherein when the program is executed, a device including the storage medium is controlled to execute the method for capturing and displaying an image as described in any one of the above embodiments.

[0156] The embodiment of the present invention further provides a computer program product, which is tangibly stored on a computer-readable medium and includes computer-readable instructions, and when the computer-executable instructions are executed, at least one processor executes the image capturing and displaying method in the above-described embodiment. It should be understood that each solution in this embodiment has the corresponding technical effect in the above-described method embodiment, which will not be described in detail here.

[0157] It should be noted that the computer storage medium of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access storage medium (RAM), a read-only storage medium (ROM), an erasable programmable read-only storage medium (EPROM or flash memory), an optical fiber, a portable compact disk read-only storage medium (CD-ROM), an optical storage medium, a magnetic storage medium, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program configured to be used by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, antenna, optical cable, RF, etc., or any suitable combination of the above.

[0158] The above embodiments are only exemplary embodiments of the present invention and are not intended to limit the present invention. The protection scope of the present invention is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present invention within the essence and protection scope of the present invention, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present invention.

Claims

1. A method for capturing and displaying an image, characterized in that: include: In response to the activation of a target function, a storage area is allocated for the target function, wherein the target function is a function of simultaneously activating a front camera and a rear camera to shoot and display the shot images; Alternately controlling the front camera and the rear camera to capture images based on a specified frequency, and storing the obtained forward images captured by the corresponding front camera in each capturing cycle and the obtained backward images captured by the corresponding rear camera in each capturing cycle in the storage area, wherein the front camera and the rear camera are both controlled by the same image signal processor to complete the capturing of the corresponding images; When the number of forward images and / or backward images in the storage area meets the display requirements, the forward images in the storage area are controlled to be output sequentially to the first display area of ​​the screen based on the storage order, and the backward images in the storage area are controlled to be output sequentially to the second display area of ​​the screen based on the storage order.

2. The method for capturing and displaying an image according to claim 1, wherein: The method further comprises: Determining a first frame rate of the front camera and a first adjustment duration of the image signal processor on the shooting parameters of the front camera; Determining a second frame rate of the rear camera and a second adjustment duration of the image signal processor on the shooting parameters of the rear camera; The designated frequency is determined by calculation based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration.

3. The method for capturing and displaying an image according to claim 2, wherein: The calculating and determining the specified frequency based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration includes: Based on the first frame rate, the first adjustment duration, the second frame rate, and the second adjustment duration, a range of the number of forward images allowed to be taken by the front camera during each shooting session and a range of the number of backward images allowed to be taken by the rear camera during each shooting session are calculated and determined, and the range of the number of forward images is the same as or different from the range of the number of backward images.

4. The method for capturing and displaying an image according to claim 3, wherein: The method of alternately controlling the front camera and the rear camera to capture images based on a specified frequency includes: Controlling the front camera to start shooting a front image, and when the number of the shot front images is within the range of the number of front images, controlling the front camera to stop shooting; Controlling the rear camera to start shooting rearward images, and when the number of the rearward images shot is within the rearward image number range, controlling the rear camera to stop shooting; The above steps are repeated until the number of the forward images and / or backward images in the storage area meets the display requirement.

5. The method for capturing and displaying an image according to claim 1, wherein: The allocating a storage area for the target function comprises: Allocating a first storage area and a second storage area for the target function in a device memory, wherein the first storage area is used to store a forward image and the second storage area is used to store a backward image; or A whole continuous storage area is allocated for the target function in the device memory, and both the forward image and the backward image are stored in the storage area.

6. The method for capturing and displaying an image according to claim 5, characterized in that: The step of storing the obtained forward image obtained during each shooting period of the corresponding front camera and the obtained backward image obtained during each shooting period of the corresponding rear camera in the storage area comprises: storing the obtained forward image in the first storage area, and numbering the stored forward image; storing the obtained backward image in the second storage area, and numbering the stored backward image; or The obtained forward image is stored in the storage area, and the stored forward image is numbered according to a first numbering strategy; storing the obtained backward image in the storage area, and numbering the stored backward image according to a second numbering strategy, wherein the first numbering strategy is different from the second numbering strategy, and the corresponding numbering results are different; The numbers of the forward images are used to represent the storage order of the forward images, and the numbers of the backward images are used to represent the storage order of the backward images.

7. The method for capturing and displaying an image according to claim 1, wherein: The forward image and the backward image are both stored based on the same transmission line; The number of the forward images and / or backward images in the storage area meets the display requirements, including: If the rear camera is started first, then when the storage amount of the forward images in the storage area is not less than the number of shots taken by the front camera in a shooting cycle, it is determined that the display requirement is met; or If the front camera is started first, then when the storage amount of the backward images in the storage area is not less than the number of shots taken by the rear camera in two shooting cycles, it is determined that the display requirement is met; or When the storage amount of the forward image and the backward image in the storage area is not less than the sum of the number of shots taken by the front camera and the rear camera in two shooting cycles, it is determined that the display requirement is met; The display requirement represents that the storage amount of the forward image and the backward image can support the screen to continuously display the forward image and the backward image simultaneously.

8. The method for capturing and displaying an image according to claim 1, wherein: The method further comprises: Controlling the screen to be in a split-screen display mode, so as to divide a display area of ​​the screen into a first display area and a second display area based on the split-screen display mode; or Controlling generation of a first display window and a second display window on the screen, wherein the first display window forms the first display area, and the second display window forms a second display area; or Controlling generation of a third display window on the screen; The third display window is divided into regions to form the first display region and the second display region respectively.

9. The method for capturing and displaying an image according to claim 1, wherein: The method further comprises: When receiving a start instruction of a target function, determining whether the application scenario currently in which the device is located is the target application scenario, and if so, responding to the start of the target function; or When the device starts a target application or starts a specified function of the target application, controlling the start of the target function; The target application includes a communication application, and the designated function includes a video call function.

10. An image shooting and display device, characterized in that: include: a response module, configured to allocate a storage area for a target function in response to the activation of the target function, wherein the target function is a function of simultaneously activating a front camera and a rear camera to shoot and display the shot image; A first control module is used to alternately control the front camera and the rear camera to capture images according to a specified frequency, and store the front image captured by the corresponding front camera in each capture cycle and the rear image captured by the corresponding rear camera in each capture cycle in the storage area, wherein the front camera and the rear camera are controlled by the same image signal processor to complete the capture of the corresponding images; A second control module is used to control the forward images in the storage area to output the forward images in sequence to the first display area of ​​the screen based on the storage order when the number of forward images and / or backward images in the storage area meets the display requirements, and to control the backward images in the storage area to output the backward images in sequence to the second display area of ​​the screen based on the storage order.