Multi-camera shooting display method and device

Abstract

The invention relates to a multi-camera shooting display method and device, and the method comprises the steps: obtaining pictures shot by a plurality of cameras arranged at different positions, enabling the setting position of a first camera in two adjacent cameras to be located in the shooting picture of a second camera, and enabling the setting position of the second camera to be located in the shooting picture of the second camera; the optical axis extension line of the first camera passes through the optical center of the second camera or has a first preset distance with the optical center of the second camera; and when the target area of the picture shot by the second camera and displayed on the display screen meets a preset condition, displaying a picture which is shot by the first camera and corresponds to the target area on the display screen. By adopting the method disclosed by the invention, the display area expected by the user can be switched into a high-definition display effect according to the display requirement of the user, so that the visual experience of the user is improved.

Description

Technical Field

[0001] The present invention relates to the field of video surveillance, and in particular to a method and device for displaying images shot by multiple cameras. Background Art

[0002] With the rapid development of video surveillance technology, surveillance cameras are increasingly used in all walks of life. The monitoring capabilities of a single surveillance camera are limited. In order to meet the needs of monitoring a larger area, multiple cameras need to be installed at multiple locations in the monitoring area.

[0003] During the display process, how to use multiple cameras to meet users' needs for multiple wide-angle images and high-definition images has become an urgent problem to be solved. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a display method and device for multi-camera shooting.

[0005] According to a first aspect of an embodiment of the present disclosure, a method for displaying images shot by multiple cameras is provided, wherein the multiple cameras include at least two cameras arranged at different positions, and the method includes:

[0006] Acquire pictures taken by a plurality of cameras set at different positions, wherein the setting position of a first camera of two cameras with adjacent setting positions is located within the shooting picture of a second camera, and an extended line of the optical axis of the first camera passes through the optical center of the second camera or has a first preset distance from the optical center of the second camera;

[0007] When a target area of ​​the picture taken by the second camera displayed on the display screen meets a preset condition, displaying the picture taken by the first camera and corresponding to the target area on the display screen;

[0008] The target area is a partial area or the entire area of ​​a preset area, and the preset area is an area where the picture taken by the first camera and the picture taken by the second camera overlap with each other.

[0009] In some exemplary embodiments of the present disclosure, when a target area of ​​the picture captured by the second camera displayed on the display screen meets a preset condition, displaying the picture captured by the first camera and corresponding to the target area on the display screen includes:

[0010] When the proportion of the target area occupied by the display screen is greater than or equal to a first preset threshold, the picture corresponding to the target area captured by the first camera is displayed on the display screen.

[0011] In some exemplary embodiments of the present disclosure, when a target area of ​​the picture captured by the second camera displayed on the display screen meets a preset condition, displaying the picture captured by the first camera and corresponding to the target area on the display screen includes:

[0012] Based on the received image selection instruction acting on the display screen, determining whether the area selected by the image selection instruction is located in the preset area;

[0013] If the area selected by the image selection instruction is located in the preset area, the area selected by the image selection instruction is determined to be the target area.

[0014] In some exemplary embodiments of the present disclosure, the method for displaying images shot by multiple cameras further includes:

[0015] When the target area is enlarged to a proportion of the display screen that is greater than or equal to a second preset threshold, a picture corresponding to the target area captured by the first camera is displayed on the display screen.

[0016] In some exemplary embodiments of the present disclosure, the method for displaying images shot by multiple cameras further includes:

[0017] If the area selected by the image selection instruction is not located in or is partially located in the preset area, the area selected by the image selection instruction is enlarged to a ratio of occupying the display screen that is a third preset threshold.

[0018] In some exemplary embodiments of the present disclosure, after the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes:

[0019] When the picture corresponding to the target area shot by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to a fourth preset threshold, the picture shot by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture currently displayed on the display screen;

[0020] The fourth preset threshold is smaller than the first preset threshold.

[0021] In some exemplary embodiments of the present disclosure, after the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes:

[0022] When the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen.

[0023] In some exemplary embodiments of the present disclosure, the images captured by the at least two cameras disposed at different locations are synchronized in time.

[0024] In some exemplary embodiments of the present disclosure, the camera includes camera modules with different focal lengths.

[0025] According to a second aspect of an embodiment of the present disclosure, a display device for multi-camera shooting is provided, comprising:

[0026] an acquisition unit configured to acquire images captured by a plurality of cameras arranged at different positions, wherein the setting position of a first camera of two cameras arranged at adjacent positions is located within the shooting image of a second camera, and an optical axis extension line of the first camera passes through an optical center of the second camera or has a first preset distance from the optical center of the second camera;

[0027] A display unit configured to display, on the display screen, a picture taken by the first camera corresponding to the target area when the target area of ​​the picture taken by the second camera displayed on the display screen meets a preset condition;

[0028] The target area is a partial area or the entire area of ​​a preset area, and the preset area is an area where the picture taken by the first camera and the picture taken by the second camera overlap with each other.

[0029] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0030] The display method of multi-camera shooting provided by the present disclosure reasonably arranges the position relationship of the cameras, so that the picture shot by the second camera includes part or all of the picture shot by the first camera, so that when the operator mainly views the picture shot by the second camera, and the area where the picture shot by the first camera overlaps with the picture shot by the second camera, the corresponding picture shot by the first camera is displayed on the display screen, and the switching process is fast and smooth, and the picture of the display screen before and after the switching is basically consistent, so that the picture clarity of the monitoring area being viewed by the operator is higher, thereby improving the operator's monitoring experience. At the same time, by setting up multi-camera distribution in multiple locations, a more flexible and scalable monitoring network structure is formed, which is suitable for various complex monitoring scenarios.

[0031] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0033] Figure 1 The present invention is a flow chart of a method for displaying multi-camera images according to an exemplary embodiment.

[0034] Figure 2 The figure is a schematic diagram showing the positional relationship of adjacent cameras according to an exemplary embodiment.

[0035] Figure 3a The figure is a schematic diagram showing the position relationship of multiple cameras according to an exemplary embodiment.

[0036] Figure 3b The figure is a schematic diagram showing the position relationship of multiple cameras according to an exemplary embodiment.

[0037] Figure 3c The figure is a schematic diagram showing the position relationship of multiple cameras according to an exemplary embodiment.

[0038] Figure 4a The diagram is a schematic diagram showing the relative position relationship between a shooting picture of a first camera and a shooting picture of a second camera according to an exemplary embodiment.

[0039] Figure 4b The diagram is a schematic diagram showing the relative position relationship between a shooting picture of a first camera and a shooting picture of a second camera according to an exemplary embodiment.

[0040] Figure 5 The present invention is a flow chart of a method for displaying multi-camera images according to an exemplary embodiment.

[0041] Figure 6 The present invention is a flow chart of a method for displaying multi-camera images according to an exemplary embodiment.

[0042] Figure 7 The present invention is a flow chart of a method for displaying multi-camera images according to an exemplary embodiment.

[0043] Figure 8 The invention is a block diagram of a display device for multi-camera shooting according to an exemplary embodiment. DETAILED DESCRIPTION

[0044] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0045] With the rapid development of video surveillance technology, surveillance cameras are increasingly used in all walks of life. The monitoring capabilities of a single surveillance camera are limited. Although the monitoring range can be expanded after being equipped with a pan / tilt and zoom lens, the area monitored by a single camera is still limited due to factors such as camera sensor resolution, focal range, and cost. In order to meet the needs of monitoring a larger area, multiple cameras need to be installed at multiple locations in the monitoring area. However, when operators view the monitoring screen, they need to switch between the images captured by cameras at multiple locations. The general processing method is to directly switch from the current camera screen to the target camera screen. Due to the different positions and shooting angles of different cameras, and the fact that the current camera screen may be displayed after being enlarged, reduced, or translated, after switching from the current camera screen to the target camera screen, the target camera screen is likely to be quite different from the camera screen before the switch. This switching method gives the monitoring operator a more abrupt feeling. After each camera screen switch, the operator needs to understand the spatial correspondence between the two camera screens before and after the switch, which affects the operator's monitoring experience. This switching method ignores the correlation between the fields of view between cameras, which is not conducive to operator viewing.

[0046] In order to solve the above problems, the present disclosure provides a display method and device for multi-camera shooting. The multi-camera includes at least two cameras set at different positions, and the display method for multi-camera shooting includes obtaining pictures shot by multiple cameras set at different positions, the setting position of the first camera of two cameras with adjacent setting positions is located in the shooting picture of the second camera, and the optical axis extension line of the first camera passes through the optical center of the second camera or has a first preset distance from the optical center of the second camera, when the target area of ​​the picture shot by the second camera displayed on the display screen meets the preset condition, the picture shot by the first camera corresponding to the target area is displayed on the display screen, wherein the target area is a part of the preset area or the whole area, and the preset area is the area where the picture shot by the first camera and the picture shot by the second camera overlap with each other. The display method of multi-camera shooting provided by the present disclosure reasonably arranges the position relationship of the cameras, so that the picture shot by the second camera includes part or all of the picture shot by the first camera, so that when the operator mainly views the picture shot by the second camera, and the area where the picture shot by the first camera overlaps with the picture shot by the second camera, the corresponding picture shot by the first camera is displayed on the display screen, and the switching process is fast and smooth, and the picture of the display screen before and after the switching is basically consistent, so that the picture clarity of the monitoring area being viewed by the operator is higher, thereby improving the operator's monitoring experience. At the same time, by setting up multi-camera distribution in multiple locations, a more flexible and scalable monitoring network structure is formed, which is suitable for various complex monitoring scenarios.

[0047] The exemplary embodiment of the present disclosure provides a method for displaying multi-camera shooting, wherein the multi-camera includes at least two cameras arranged at different positions. The method for displaying multi-camera shooting of the present disclosure is suitable for video line patrol work in long fences, roads, railways and other occasions. The camera involved in the method for displaying multi-camera shooting of the present disclosure can be a single focal length camera or a multi-focal length camera, and the multi-focal length camera can capture images at different focal lengths, such as a long focal length picture, a medium focal length picture and a short focal length picture. Next, the method for switching between pictures captured by a single focal length camera is first described.

[0048] like Figure 1 As shown, the display method of multi-camera shooting provided in this embodiment includes:

[0049] S100, obtaining images captured by multiple cameras set at different positions, wherein the setting position of a first camera of two cameras with adjacent setting positions is located within the shooting image of a second camera, and an extended line of the optical axis of the first camera passes through the optical center of the second camera or has a first preset distance from the optical center of the second camera.

[0050] S200: When the target area of ​​the picture taken by the second camera displayed on the display screen meets the preset condition, the picture taken by the first camera corresponding to the target area is displayed on the display screen, wherein the target area is a part or all of the preset area, and the preset area is the area where the picture taken by the first camera and the picture taken by the second camera overlap with each other.

[0051] In step S100, Figure 2 As shown, the positional relationship of multiple cameras set at different positions is: the setting position of the first camera F of two cameras with adjacent setting positions is located within the shooting picture B of the second camera S, and the extension line of the optical axis FZ of the first camera F passes through the optical center O of the second camera S or has a first preset distance from the optical center O of the second camera S.

[0052] The optical center of the camera, which is also the projection center of the camera, is located in the lens part of the camera and can be approximately regarded as the center of a convex lens. The first preset distance can be determined according to actual needs or empirical values, and this embodiment does not limit this.

[0053] refer to Figure 3a , Figure 3b and Figure 3c Based on the position relationship of the multiple cameras defined in this embodiment, the position distribution of the multiple cameras set at different positions may include the following situations:

[0054] Chain distribution, such as Figure 3a As shown, multiple camera images are nested in sequence; star-shaped distribution, such as Figure 3b As shown, multiple secondary camera images are nested at different positions within a single camera image; the ring distribution, such as Figure 3c As shown, multiple camera images are nested in sequence and connected end to end. The above-mentioned distribution methods of cameras can also be combined with each other to form a hybrid network structure, forming a more flexible and scalable monitoring network structure, which is suitable for various complex monitoring scenarios.

[0055] Referring to the above positional relationship of the cameras, in this embodiment, the images captured by two cameras with adjacent settings are taken as an example, and the setting position of the first camera is located within the shooting image of the second camera. The shooting image of the first camera and the shooting image of the second camera are obtained, and the shooting image of the first camera and the shooting image of the second camera are both played on the display screen for the monitoring operator to view. Among them, the shooting image of the second camera is the video image currently played on the display screen.

[0056] In step S200, since the first camera is located within the shooting picture of the second camera, the picture shot by the second camera includes part or all of the picture range shot by the first camera. The area where the picture shot by the first camera overlaps with the picture shot by the second camera is defined as a preset area, and the preset area is a partial area within the picture shot by the second camera.

[0057] refer to Figure 4a and Figure 4b , the picture taken by the first camera is picture A, and the picture taken by the second camera is picture B. The preset area in the picture taken by the second camera is divided into two cases:

[0058] First, the picture B taken by the second camera includes the picture A taken by the first camera, that is, the picture A taken by the first camera is all taken by the second camera. Figure 4a The schematic diagram schematically shows the relative position relationship between the picture A shot by the first camera and the picture B shot by the second camera. At this time, the preset area completely corresponds to the picture A shot by the first camera.

[0059] Secondly, the picture B taken by the second camera includes part of the picture A taken by the first camera, that is, part of the picture C in the picture A taken by the first camera is taken by the second camera. Figure 4b The schematic diagram schematically shows the relative position relationship between the shooting picture A of the first camera and the shooting picture B of the second camera. At this time, the preset area corresponds to the partial area C in the picture A shot by the first camera.

[0060] The monitoring system marks the position and size of the preset area in the picture taken by the second camera to monitor the triggering conditions for switching from the current video picture to the picture taken by the first camera. The marking of the preset area by the monitoring system can be displayed in the video picture or not. The marking process can be performed by image processing methods, such as automatically matching the area in the second camera picture that overlaps with the first camera picture through an image template matching algorithm, or it can be determined by manual comparison.

[0061] The target area is a part or all of a preset area. The monitoring screen of the monitoring system disclosed in the present invention can be operated by, for example, mouse selection, wheel zooming, joystick control, or touch screen control to facilitate operator viewing. During the above operations on the picture taken by the second camera, the target area of ​​the picture taken by the second camera displayed on the display screen has a chance to meet the preset conditions to switch from the current video picture to the picture taken by the first camera. In order to ensure the visual effect, the switching between the pictures taken by multiple cameras disclosed in the present invention is fast. For example, the previous frame of the picture displayed on the display screen is the picture taken by the second camera, and the next frame of the picture switches to the picture taken by the first camera.

[0062] The display method of multi-camera shooting provided by the present disclosure reasonably arranges the position relationship of the cameras, so that the picture shot by the second camera includes part or all of the picture shot by the first camera, so that when the operator mainly views the picture shot by the second camera, and the area where the picture shot by the first camera overlaps with the picture shot by the second camera, the corresponding picture shot by the first camera is displayed on the display screen, and the switching process is fast and smooth, and the picture of the display screen before and after the switching is basically consistent, so that the picture clarity of the monitoring area being viewed by the operator is higher, thereby improving the operator's monitoring experience. At the same time, by setting up multi-camera distribution in multiple locations, a more flexible and scalable monitoring network structure is formed, which is suitable for various complex monitoring scenarios.

[0063] According to an exemplary embodiment, in step S200, when the target area of ​​the picture taken by the second camera displayed on the display screen meets the preset condition, the picture taken by the first camera corresponding to the target area is displayed on the display screen, including:

[0064] When the proportion of the target area occupied by the display screen is greater than or equal to a first preset threshold, a picture corresponding to the target area captured by the first camera is displayed on the display screen.

[0065] When the proportion of the target area in the picture taken by the second camera displayed on the display screen is greater than or equal to the first preset threshold, the picture taken by the second camera is switched to the picture taken by the first camera. After the switching, the display screen displays the picture taken by the first camera that is the same as the target area. The first preset threshold can be determined according to demand or according to an empirical value. This embodiment does not limit this. The first preset threshold can be, for example, 85%, 90%, 95%, 100%, etc.

[0066] In this embodiment, there are two cases where the proportion of the target area occupying the display screen is greater than or equal to the first preset threshold:

[0067] First, the target area is the entire area of ​​the preset area, the target area is entirely displayed on the display screen, and the proportion of the preset area occupying the display screen is greater than or equal to a first preset threshold;

[0068] Second, the target area is a partial area in the preset area. At this time, the picture taken by the second camera is in an enlarged state, and the proportion of the enlarged target area occupying the display screen is greater than or equal to the first preset threshold.

[0069] When the monitoring operator wants to view a local area in the picture taken by the second camera, the picture taken by the second camera can be enlarged and viewed by digital zooming. However, when it is enlarged to a certain extent, the picture taken by the second camera may become unclear due to being enlarged. The display method for multi-camera shooting provided in this embodiment is set to switch the picture taken by the second camera to the picture taken by the first camera when the proportion of the target area occupying the display screen is greater than or equal to the first preset threshold, so as to improve the clarity of the current monitoring screen, so that the operator can clearly view the target area in the monitoring screen. At the same time, in order to ensure that the switching of the camera screen will not bring an abrupt feeling to the monitoring operator, when the screen is switched, the display screen is set to display the same picture taken by the first camera as the target area, so that the screen before and after the switch is basically consistent, thereby improving the monitoring experience of the operator.

[0070] According to an exemplary embodiment, Figure 5 As shown, in step S200, when the target area of ​​the picture taken by the second camera displayed on the display screen meets the preset condition, the picture taken by the first camera and corresponding to the target area is displayed on the display screen, including:

[0071] S510, based on the received image selection instruction acting on the display screen, determine whether the area selected by the image selection instruction is located in a preset area, if so, execute S520, if not, execute S550.

[0072] The image selection instruction can be applied to the picture displayed on the display screen by using the touch screen function or mouse frame selection and other operations. When the image selection instruction acting on the display screen is received, it is determined whether the area selected by the image selection instruction is located in the area where the picture taken by the first camera and the picture taken by the second camera overlap with each other, that is, it is determined whether it is located in the preset area.

[0073] S520: Determine that the area selected by the image selection instruction is the target area.

[0074] If the area selected by the image selection instruction is within the preset area, that is, the area selected by the image selection instruction is part of or all of the preset area, then the area selected by the image selection instruction is the target area. Of course, the probability that the area selected by the image selection instruction is the entire area of ​​the preset area is very small.

[0075] S530: When the target area is enlarged to a proportion of the display screen that is greater than or equal to a second preset threshold, execute S540.

[0076] S540: Display the picture corresponding to the target area captured by the first camera on the display screen.

[0077] If the area selected by the image selection instruction is the target area, the target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold for viewing, and at the same time, the current screen of the display screen is switched to a screen shot by the first camera that is the same as the target area. The second preset threshold can be determined according to demand or based on an empirical value, which is not limited in this embodiment, and the second preset threshold can be, for example, 80%, 90%, 100%, etc.

[0078] S550: Enlarge the area selected by the image selection instruction until the proportion of the area occupying the display screen reaches a third preset threshold.

[0079] If the area selected by the image selection instruction is not located within or partially located within the preset area, the area selected by the image selection instruction is enlarged to a proportion of the display screen that is a third preset threshold for viewing. The third preset threshold may be the same as the second preset threshold or may be different. The third preset threshold may be determined based on demand or based on an empirical value, and this embodiment does not limit this. The third preset threshold may be, for example, 80%, 90%, 100%, etc.

[0080] In this embodiment, the area selected by the image selection instruction is enlarged. Taking the mouse to draw a rectangular area as an example, the size and position of the selected rectangular image are determined, the center point of the rectangular area is used as the center point of the enlarged area, and the center point is moved to the center of the display screen, and the entire graphic is enlarged to an appropriate proportion, for example, the area selected by the image selection instruction is enlarged to a proportion of the display screen that is a third preset threshold.

[0081] When the monitoring operator wants to view a local area in the picture taken by the second camera, the picture taken by the second camera can be digitally enlarged by selecting a partial area using an image selection instruction. However, when the enlargement ratio reaches a certain level, the picture taken by the second camera may become unclear due to the enlargement. In the display method for multi-camera shooting provided in this embodiment, if it is determined that the area selected by the image selection instruction is located in the preset area, the picture taken by the second camera is switched to the picture taken by the first camera to improve the clarity of the current monitoring picture, so that the operator can clearly view the target area in the monitoring picture. At the same time, in order to ensure that the switching of the camera screen will not give the monitoring operator a sudden feeling, when the screen is switched, the display screen is set to display the same picture taken by the first camera as the target area, so that the screen of the display screen before and after the switch is basically consistent, which improves the monitoring experience of the operator and meets the viewing needs and viewing efficiency of the monitoring operator.

[0082] According to an exemplary embodiment, after the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes:

[0083] When the image corresponding to the target area shot by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to a fourth preset threshold, the image corresponding to the current area shot by the second camera is displayed on the display screen, and the current area is the image currently displayed on the display screen. The fourth preset threshold is less than the first preset threshold.

[0084] After the display screen displays the picture corresponding to the target area taken by the first camera, if the picture taken by the first camera is zoomed out, when the picture corresponding to the target area taken by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to the fourth preset threshold, the picture taken by the first camera is switched to the picture taken by the second camera. After the switching, the display screen displays the picture taken by the second camera corresponding to the current area, and the current area is the picture being displayed on the display screen. The pictures on the display screen are basically consistent before and after the switching, so that the operator can view the monitoring area with a wider viewing angle. The fourth preset threshold can be determined according to demand or based on an empirical value. This embodiment does not limit this. The fourth preset threshold is less than the first preset threshold. The fourth preset threshold can be, for example, 85%, 90%, 95%, 98%, etc.

[0085] According to an exemplary embodiment, after the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes:

[0086] When the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen.

[0087] After the display screen displays the picture corresponding to the target area taken by the first camera, the monitoring picture viewed by the operator is the picture taken by the first camera. If the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the first camera is switched to the picture taken by the second camera. After the switch, the display screen displays the picture taken by the second camera corresponding to the current area, and the current area is the picture being displayed on the display screen. The picture of the display screen remains basically consistent before and after the switch, so that the operator can view the monitoring area with a wider viewing angle. The second preset distance can be determined according to demand or based on an empirical value. This embodiment does not limit this. The second preset distance can be, for example, 100 pixels, 200 pixels, or 1 cm, 2 cm, or a preset ratio of the length or width of the display screen.

[0088] In the display method of multi-camera shooting provided in this embodiment, if the edge of the picture shot by the first camera is moved to a second preset distance from the edge of the display screen, it means that the monitoring area with a wider viewing angle outside the boundary cannot be viewed in the picture shot by the current camera. At this time, the picture shot by the first camera is switched to the picture shot by the second camera. After the switching, the display screen displays the picture shot by the second camera corresponding to the current area. The current area is the picture being displayed before the display screen is switched, and the pictures on the display screen before and after the switching are basically consistent. After the display screen is switched to the picture shot by the second camera, the operator can view the monitoring area outside the above-mentioned boundary, which meets the viewing needs and viewing efficiency of the monitoring operator and improves the operator's monitoring experience.

[0089] In all embodiments of the present disclosure, all cameras capture images of the monitored area at the same time, so that the images captured by all cameras are synchronized in time to ensure the continuity of the monitoring video images during the image switching process of different cameras.

[0090] The monitoring system disclosed in the present invention can be designed with corresponding monitoring system software, which can improve the monitoring experience of operators by executing the functions of the display method of the above-mentioned multi-camera shooting. The monitoring system software supports multiple operation modes, such as manual control, preset path cruising, etc., and can be personalized according to user needs.

[0091] For ease of understanding, a specific example is given below to describe the practical application of the multi-camera shooting display method disclosed in the present invention. The following example is only for ease of understanding and does not constitute a limitation on the disclosed embodiment.

[0092] In the example scenario, the first camera is set to be within the shooting screen of the second camera, and all the pictures shot by the first camera are captured by the second camera. The pictures shot by the two cameras are synchronized in time. The first preset threshold is set to 100%, the second preset threshold is equal to the third preset threshold, both are set to 100%, the fourth preset threshold is 90%, and the second preset distance is 200 pixels. The surveillance video screen currently displayed on the display is the shooting screen of the second camera.

[0093] Example 1

[0094] When the monitoring operator views the monitoring screen, he or she can zoom in, zoom out or pan the screen according to the viewing requirements. When the entire area or part of the area in the preset area is adjusted to occupy 100% of the display screen, the screen shot by the second camera is switched to the screen shot by the first camera, and the area in the preset area that occupies 100% of the display screen during the switching is defined as the target area. After the switching, the display screen displays the screen shot by the first camera corresponding to the target area, providing a higher definition screen for the target area.

[0095] Regarding how to obtain the position of the picture corresponding to the target area in the picture taken by the first camera, a calculation method is given in this example. Of course, other calculation methods can also be used, and this disclosure does not limit it. The calculation method in other switching processes between the picture taken by the first camera and the picture taken by the second camera can refer to the following calculation method, and other calculation methods can also be used, and this disclosure does not limit it.

[0096] A plane rectangular coordinate system is established with the coordinates of the point in the upper left corner of the picture taken by the second camera as the origin (0,0), the horizontal direction of the picture taken by the second camera as the x-axis, and the vertical direction of the picture taken by the second camera as the y-axis. Among them, the horizontal direction and the vertical direction of the picture taken by the second camera are both relative to the display of the display screen. The horizontal length and the vertical length of the picture taken by the second camera are normalized. The normalized coordinates are used to represent the coordinate ratio of the target area relative to the preset area, that is, the coordinate ratio of the picture corresponding to the target area in the picture taken by the first camera relative to the picture taken by the first camera.

[0097] The system obtains the coordinates of the upper left point a and the lower right point b of the preset area in the above coordinate system as a(x1, y1) and b(x2, y2), that is, the relative position of the preset area in the picture taken by the second camera. Among them, the value ranges of x1, y1, x2, and y2 are all between 0 and 1. The system obtains the coordinates of the upper left point a' and the lower right point b' of the target area in the above coordinate system at the switching moment as a'(x1', y1') and b'(x2', y2'), that is, the relative position of the picture area being displayed on the display screen in the picture taken by the second camera. Among them, the value ranges of x1', y1', x2', and y2' are all between 0 and 1.

[0098] In this example, at the switching moment, the target area is adjusted to occupy 100% of the display screen. After the monitoring screen is switched to the screen shot by the first camera, a plane rectangular coordinate system is established with the coordinates of the point in the upper left corner of the screen shot by the first camera as the origin (0,0), the horizontal direction of the screen shot by the first camera as the x-axis, and the vertical direction of the screen shot by the first camera as the y-axis. Among them, the horizontal direction and the vertical direction of the screen shot by the first camera are both relative to the display screen. The horizontal length and the vertical length of the screen shot by the first camera are normalized. The normalized coordinates are used to represent the coordinate ratio of the screen corresponding to the target area in the screen shot by the first camera relative to the screen shot by the first camera.

[0099] Assume that the coordinates of the upper left corner point c and the lower right corner point d of the image captured by the first camera corresponding to the target area are c(x3',y3') and d(x4',y4'), respectively. Then,

[0100] x3'=(x1'-x1) / (x2-x1)

[0101] y3'=(y1'-y1) / (y2-y1)

[0102] x4'=(x2'-x1) / (x2-x1)

[0103] y4'=(y2'-y1) / (y2-y1)

[0104] The coordinate ratio of the image corresponding to the target area in the image taken by the first camera to the image taken by the first camera can be obtained. That is, when switching to the image taken by the first camera, the relative position of the area displayed on the display screen in the image taken by the first camera.

[0105] Example 2

[0106] The monitoring operator uses the mouse to draw a rectangular area in the picture taken by the second camera. If the rectangular area is within the preset area, the selected area is defined as the target area. The target area is enlarged to full screen display, and the picture taken by the first camera corresponding to the target area is displayed on the display screen at the same time, providing a higher definition picture for the target area.

[0107] Example 3

[0108] The monitoring operator uses the mouse to draw a rectangular area in the picture taken by the second camera. If the rectangular area is not within the preset area, the target area is directly enlarged to full screen display.

[0109] Example 4

[0110] After the display screen switches to the image taken by the first camera, the operator views the image taken by the first camera. When the operator drags the monitoring screen for translation, if the edge of the image taken by the first camera is moved to 200 pixels away from the edge of the display screen, the image taken by the second camera corresponding to the current area is displayed on the display screen. The current area is the image being displayed before the display screen is switched.

[0111] The exemplary embodiments of the present disclosure provide a display method for multi-camera shooting, in which the camera may include multiple camera modules, and the multiple camera modules are camera modules with different focal lengths, that is, each camera module can capture images with different focal lengths. Among them, the short-focal-length camera module is suitable for shooting close-up scenes, and the range of the captured images is wider, and the long-focal-length camera module is suitable for shooting relatively long-distance scenes, and the range of the captured images is relatively narrow. The following is an explanation of the switching method when the camera is a multi-camera module and one camera can capture multiple images with different focal lengths.

[0112] The multi-camera in the present disclosure can be a combination of a second camera being a multi-focus camera and a first camera being a multi-focus camera; or a combination of a second camera being a multi-focus camera and a first camera being a single-focus camera; or a combination of a second camera being a single-focus camera and a first camera being a multi-focus camera. The position of the first camera is located within the shooting screen of the second camera. The position of the first camera can be relatively far relative to the position of the second camera, so that the scene captured by the short-focus camera module of the first camera is farther than the scene captured by the long-focus camera module of the second camera. The position of the first camera can also be relatively close to the position of the second camera, so that the scene captured by the long-focus camera module of the second camera is farther than the scene captured by the short-focus camera module of the first camera. The position of the camera can be flexibly set, and the present disclosure does not limit it.

[0113] In this embodiment, the second camera is a camera with a long focal length and a short focal length camera module, the first camera is a single-focus camera, and the position of the first camera is farther away from the position of the second camera, so that the scene captured by the first camera is farther than the scene captured by the long focal length camera module of the second camera.

[0114] The relative positions of the first camera and the second camera are arranged in the same manner as in the above embodiments. Figure 4a and Figure 4b , in this embodiment, the picture taken by the second camera may include all the pictures taken by the first camera, or may only include part of the pictures taken by the first camera, wherein the picture taken by the second camera includes the picture taken by the short-focus camera module and the picture taken by the long-focus camera module. The picture taken by the short-focus camera module of the second camera includes the picture taken by the long-focus camera module of the second camera. Therefore, a first preset area and a second preset area can be set in the picture taken by the short-focus camera module of the second camera, wherein the first preset area is the area where the picture taken by the long-focus camera module of the second camera and the picture taken by the short-focus camera module of the second camera overlap with each other, and the second preset area is the area where the picture taken by the first camera and the picture taken by the short-focus camera module of the second camera overlap with each other, and the first preset area and the second preset area overlap at least partially. A third preset area can be set in the picture taken by the long-focus camera module of the second camera, wherein the third preset area is the area where the picture taken by the first camera and the picture taken by the long-focus camera module of the second camera overlap with each other.

[0115] like Figure 6 As shown, the display method of multi-camera shooting provided in this embodiment includes:

[0116] S600, acquiring images captured by a plurality of cameras arranged at different positions, including: acquiring images captured by a long focal length camera module and a short focal length camera module of a second camera, and images captured by the first camera.

[0117] S610: When the proportion of the first target area in the picture captured by the short-focus camera module of the second camera displayed on the display screen is greater than or equal to a fifth preset threshold, execute S620.

[0118] Among them, the first target area is a part of the area or the whole area of ​​the first preset area. The first preset area is the area where the picture taken by the long focal length camera module of the second camera overlaps with the picture taken by the short focal length camera module of the second camera. The fifth preset threshold value can be determined according to demand or according to an empirical value. This embodiment does not limit this. The fifth preset threshold value can be, for example, 85%, 90%, 95%, 100%, etc.

[0119] S620, displaying the picture corresponding to the first target area photographed by the long focal length camera module of the second camera on the display screen, and executing S650.

[0120] S630: When the proportion of the second target area in the picture captured by the short-focal-length camera module of the second camera displayed on the display screen is greater than or equal to a first preset threshold, execute S640.

[0121] The second target area is a partial area or the entire area of ​​the second preset area. The second preset area is an area where the picture taken by the first camera and the picture taken by the short focal length camera module of the second camera overlap with each other.

[0122] S640: Displaying the picture corresponding to the second target area photographed by the first camera on the display screen.

[0123] S650: When the proportion of the third target area in the picture captured by the telephoto camera module of the second camera displayed on the display screen is greater than or equal to a first preset threshold, execute S660.

[0124] The third target area is a partial area or the entire area of ​​the third preset area. The third preset area is an area where the picture taken by the first camera and the picture taken by the telephoto camera module of the second camera overlap with each other.

[0125] S660: Displaying the picture corresponding to the third target area photographed by the first camera on the display screen.

[0126] When the monitoring operator wants to view the local area in the picture taken by the short-focus camera module of the second camera, the picture taken by the short-focus camera module of the second camera can be enlarged and viewed by digital zooming, but when it is enlarged to a certain extent, the picture taken by the short-focus camera module of the second camera may become unclear due to being enlarged. The display method of multi-camera shooting provided in this embodiment is provided by setting the picture taken by the short-focus camera module of the second camera to switch to the picture taken by the long-focus camera module of the second camera, or switch to the picture taken by the first camera; and setting the picture taken by the long-focus camera module of the second camera to switch to the picture taken by the first camera, so as to improve the clarity of the current monitoring picture, so that the operator can clearly view the local area in the monitoring picture. At the same time, in order to ensure that the switching of the camera picture will not bring an abrupt feeling to the monitoring operator, when the picture is switched, the display screen is set to display the picture corresponding to the first target area, the second target area or the third target area, so that the picture of the display screen before and after the switch is basically consistent, thereby improving the monitoring experience of the operator.

[0127] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0128] When the picture displayed on the display screen is a picture taken by the short-focal-length camera module of the second camera, based on the image selection instruction received and acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the first preset area. If the area selected by the image selection instruction is located in the first preset area, it is determined whether the area selected by the image selection instruction is located in the second preset area. If the area selected by the image selection instruction is not located in the second preset area, it is determined that the area selected by the image selection instruction is the first target area. When the first target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold, the picture taken by the long-focal-length camera module of the second camera and corresponding to the first target area is displayed on the display screen.

[0129] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0130] When the picture displayed on the display screen is a picture taken by the short focal length camera module of the second camera, based on the received image selection instruction acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the first preset area. If the area selected by the image selection instruction is located in the first preset area, it is determined whether the area selected by the image selection instruction is located in the second preset area. If the area selected by the image selection instruction is located in the second preset area, that is, the area selected by the image selection instruction is in the area where the first preset area and the second preset area overlap, then the clarity of the picture taken by the long focal length camera module of the second camera corresponding to the first preset area is compared with the clarity of the picture taken by the first camera corresponding to the second preset area. If the clarity of the picture taken by the long focal length camera module of the second camera corresponding to the first preset area is higher than the clarity of the picture taken by the first camera corresponding to the second preset area, it is determined that the area selected by the image selection instruction is the first target area, and when the first target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold, the picture taken by the long focal length camera module of the second camera corresponding to the first target area is displayed on the display screen.

[0131] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0132] When the picture displayed on the display screen is a picture taken by the short focal length camera module of the second camera, based on the received image selection instruction acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the first preset area. If the area selected by the image selection instruction is located in the first preset area, it is determined whether the area selected by the image selection instruction is located in the second preset area. If the area selected by the image selection instruction is located in the second preset area, that is, the area selected by the image selection instruction is in the area where the first preset area and the second preset area overlap, then the clarity of the picture taken by the long focal length camera module of the second camera corresponding to the first preset area is compared with the clarity of the picture taken by the first camera corresponding to the second preset area. If the clarity of the picture taken by the long focal length camera module of the second camera corresponding to the first preset area is lower than the clarity of the picture taken by the first camera corresponding to the second preset area, it is determined that the area selected by the image selection instruction is the second target area, and when the second target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold, the picture taken by the first camera corresponding to the second target area is displayed on the display screen.

[0133] In this embodiment, since the position of the first camera is set farther from the position of the second camera, the scene captured by the first camera is farther than the scene captured by the telephoto camera module of the second camera. Therefore, when the partial picture selected by the image selection instruction is enlarged, the clarity of the picture shot by the first camera is higher than the clarity of the picture shot by the telephoto camera module of the second camera. The picture corresponding to the second target area captured by the first camera with higher clarity is switched to the display screen for display, providing the operator with a higher-definition monitoring picture and improving the operator's monitoring experience.

[0134] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0135] When the picture displayed on the display screen is a picture taken by the short-focal-length camera module of the second camera, based on the image selection instruction received and acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the first preset area; if the area selected by the image selection instruction is not located in the first preset area, it is determined whether the area selected by the image selection instruction is located in the second preset area; if the area selected by the image selection instruction is located in the second preset area, it is determined that the area selected by the image selection instruction is the second target area; when the second target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold, the picture taken by the first camera and corresponding to the second target area is displayed on the display screen.

[0136] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0137] When the picture displayed on the display screen is a picture taken by the short-focal-length camera module of the second camera, based on the image selection instruction received and acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the first preset area; if the area selected by the image selection instruction is not located in the first preset area, it is determined whether the area selected by the image selection instruction is located in the second preset area; if the area selected by the image selection instruction is not located in the second preset area, the area selected by the image selection instruction is enlarged until the proportion of the area occupying the display screen is equal to the third preset threshold.

[0138] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0139] When the picture displayed on the display screen is a picture taken by the telephoto camera module of the second camera, based on the received image selection instruction acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the third preset area. If the area selected by the image selection instruction is located in the third preset area, the area selected by the image selection instruction is determined to be the third target area, and when the third target area is enlarged to a proportion of the display screen that is greater than or equal to the second preset threshold, the picture taken by the first camera and corresponding to the third target area is displayed on the display screen.

[0140] In some embodiments, the display method for multi-camera shooting provided in this embodiment further includes:

[0141] When the picture displayed on the display screen is a picture taken by the telephoto camera module of the second camera, based on the received image selection instruction acting on the display screen, it is determined whether the area selected by the image selection instruction is located in the third preset area. If the area selected by the image selection instruction is not located in the third preset area, the area selected by the image selection instruction is enlarged until the proportion of the area occupying the display screen is equal to the third preset threshold.

[0142] When the monitoring operator wants to view a local area in the picture taken by the short-focus camera module of the second camera, the picture taken by the short-focus camera module of the second camera can be digitally enlarged by selecting a partial area using an image selection instruction. However, when the enlargement ratio reaches a certain degree, the picture taken by the short-focus camera module of the second camera may become unclear due to being enlarged. The display method of multi-camera shooting provided in this embodiment determines whether the area selected by the image selection instruction is located in the first preset area or the second preset area, and switches the picture taken by the short-focus camera module of the second camera to the picture taken by the long-focus camera module of the second camera, or switches to the picture taken by the first camera, so as to improve the clarity of the current monitoring picture, so that the operator can clearly view the local area in the monitoring picture. At the same time, in order to ensure that switching the camera screen will not bring an abrupt feeling to the monitoring operator, when the screen is switched, the display screen is set to display the screen shot by the long-focus camera module of the second camera that is the same as the first target area, or to display the screen shot by the first camera that is the same as the second target area, so that the screen image before and after the switch remains basically consistent, thereby improving the operator's monitoring experience and meeting the monitoring operator's viewing needs and viewing efficiency.

[0143] In some embodiments, step S620, after the display screen displays the picture corresponding to the first target area photographed by the telephoto camera module of the second camera, further includes:

[0144] When the picture corresponding to the first target area shot by the long focal length camera module of the second camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to the sixth preset threshold, the picture shot by the short focal length camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen. Among them, the sixth preset threshold is less than the first preset threshold. The sixth preset threshold can be determined according to demand or according to an empirical value. This embodiment does not limit this. The sixth preset threshold can be, for example, 85%, 90%, 95%, 98%, etc.

[0145] In some embodiments, step S640, after the display screen displays the picture corresponding to the second target area captured by the first camera, further includes:

[0146] When the image corresponding to the second target area captured by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to the fourth preset threshold, the image captured by the short-focal-length camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the image being displayed on the display screen. Among them, the fourth preset threshold is less than the first preset threshold, and the fourth preset threshold can be determined according to demand or according to an empirical value. This embodiment does not limit this, and the fourth preset threshold can be, for example, 85%, 90%, 95%, 98%, etc.

[0147] In some embodiments, step S660, after the display screen displays the picture corresponding to the third target area captured by the first camera, further includes:

[0148] When the picture taken by the first camera corresponding to the third target area displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to the fourth preset threshold, the picture taken by the long-focal-length camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture currently displayed on the display screen.

[0149] In some embodiments, step S620, after the display screen displays the picture corresponding to the first target area photographed by the telephoto camera module of the second camera, further includes:

[0150] When the edge of the picture taken by the long focal length camera module of the second camera is moved to the third preset distance from the edge of the display screen, the picture taken by the short focal length camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen. The third preset distance can be determined according to demand or based on empirical values, and this embodiment does not limit this. The third preset distance can be, for example, 100 pixels, 200 pixels, or 1 cm, 2 cm, or a preset ratio value of the length or width of the display screen, etc.

[0151] In some embodiments, step S640, after the display screen displays the picture corresponding to the second target area captured by the first camera, further includes:

[0152] When the edge of the image captured by the first camera is moved to a second preset distance from the edge of the display screen, the image captured by the short focal length camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the image being displayed on the display screen. The second preset distance can be determined according to demand or based on empirical values, and this embodiment does not limit this. The second preset distance can be, for example, 100 pixels, 200 pixels, or 1 cm, 2 cm, or a preset ratio value of the length or width of the display screen.

[0153] In some embodiments, step S660, after the display screen displays the picture corresponding to the third target area captured by the first camera, further includes:

[0154] When the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the telephoto camera module of the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture currently displayed on the display screen.

[0155] In the display method of multi-camera shooting provided in this embodiment, if the edge of the current picture is moved to a relatively close distance from the edge of the display screen, the monitoring area with a wider viewing angle outside the boundary cannot be viewed in the current picture. At this time, the current picture is switched to a picture taken by a camera or camera module that shoots a wider range. After the switch, the display screen displays the picture corresponding to the current area. The current area is the picture being displayed before the display screen is switched, and the pictures on the display screen before and after the switch are basically consistent. After the display screen is switched, the operator can view the monitoring area outside the above-mentioned boundary, which meets the viewing needs and viewing efficiency of the monitoring operator and improves the operator's monitoring experience.

[0156] It can be understood that when the second camera is a camera with more different focal length camera modules such as long focal length, medium focal length and short focal length, the switching method between the pictures taken by the camera modules of different focal lengths of the second camera and the switching method between the pictures taken by the first camera are similar to the display method of multi-camera shooting in the above-mentioned embodiment, and will not be repeated here.

[0157] It can be understood that the switching method between the pictures in the combination of the second camera being a multi-focus camera and the first camera being a multi-focus camera, and the switching method between the pictures in the combination of the second camera being a single-focus camera and the first camera being a multi-focus camera, are similar to the switching method between the pictures in the above-mentioned embodiments, that is, different "preset areas" are respectively set in different pictures taken according to the nested relationship between different pictures, and the display method of multi-camera shooting in the above-mentioned embodiments is used for switching, which will not be repeated here.

[0158] The camera in this embodiment includes a multi-focal length camera module, which increases the shooting scenes of different focal lengths of the same camera. Combining different distribution modes of multiple cameras can form a more flexible network structure, which is suitable for more complex monitoring scenes.

[0159] like Figure 7 As shown, for ease of understanding, a specific embodiment is given below to describe the display method of multi-camera shooting disclosed in the present invention.

[0160] S710: Acquire images captured by multiple cameras installed at different locations.

[0161] S720: When the proportion of the target area occupying the display screen is greater than or equal to a first preset threshold, execute S780.

[0162] S730: When an image selection instruction acting on the display screen is received, execute S740.

[0163] S740, determining whether the area selected by the image selection instruction is located in a preset area, if so, executing S760; if not, executing S750.

[0164] S750: Enlarge the area selected by the image selection instruction until the proportion of the area occupying the display screen reaches a third preset threshold.

[0165] S760: Determine that the area selected by the image selection instruction is the target area.

[0166] S770. When the target area is enlarged to a proportion of the display screen that is greater than or equal to a second preset threshold, execute S780.

[0167] S780: Display the image corresponding to the target area captured by the first camera on the display screen.

[0168] S790. When the picture corresponding to the target area taken by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to a fourth preset threshold, or when the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, execute S800.

[0169] S800: Displaying a picture shot by a second camera corresponding to a current area on a display screen, where the current area is the picture being displayed on the display screen.

[0170] The display method of multi-camera shooting provided by the present disclosure arranges the position relationship of the cameras reasonably, so that the picture shot by the second camera includes part or all of the picture shot by the first camera, so that when the operator mainly views the area where the picture shot by the first camera and the picture shot by the second camera overlap in the picture shot by the second camera, the corresponding picture shot by the first camera is displayed on the display screen, and the switching process is fast and smooth, and the picture of the display screen before and after the switching is basically consistent, so that the picture clarity of the monitoring area being viewed by the operator is higher, thereby improving the operator's monitoring experience. At the same time, by setting up multi-camera distribution in multiple locations, a more flexible and scalable monitoring network structure is formed, which is suitable for various complex monitoring scenarios. Time synchronization technology is used to ensure the continuity of the monitoring video picture during the picture switching process of different cameras.

[0171] The exemplary embodiment of the present disclosure provides a display device for multi-camera shooting, such as Figure 8 As shown, the present disclosure shows a block diagram of a display device for multi-camera shooting.

[0172] The block diagram includes an acquisition unit 801 and a display unit 802. The acquisition unit 801 is configured to acquire images captured by multiple cameras set at different positions. The setting position of the first camera of two cameras with adjacent setting positions is located within the shooting picture of the second camera, and the optical axis extension line of the first camera passes through the optical center of the second camera or has a first preset distance from the optical center of the second camera. The display unit 802 is configured to display the picture corresponding to the target area captured by the first camera on the display screen when the target area of ​​the picture captured by the second camera displayed on the display screen meets the preset conditions. The target area is a partial area or the entire area of ​​the preset area, and the preset area is the area where the picture captured by the first camera and the picture captured by the second camera overlap with each other.

[0173] In some embodiments, the display unit 802 is further configured to:

[0174] When the proportion of the target area occupied by the display screen is greater than or equal to a first preset threshold, a picture corresponding to the target area captured by the first camera is displayed on the display screen.

[0175] In some embodiments, the display unit 802 is further configured to:

[0176] Based on the received image selection instruction acting on the display screen, determining whether the area selected by the image selection instruction is located in a preset area;

[0177] If the area selected by the image selection instruction is located in the preset area, the area selected by the image selection instruction is determined to be the target area.

[0178] In some embodiments, the display unit 802 is further configured to:

[0179] When the target area is enlarged to a proportion of the display screen that is greater than or equal to a second preset threshold, a picture corresponding to the target area shot by the first camera is displayed on the display screen.

[0180] In some embodiments, the display unit 802 is further configured to:

[0181] If the area selected by the image selection instruction is not located in or is partially located in the preset area, the area selected by the image selection instruction is enlarged to a ratio of occupying the display screen that is a third preset threshold.

[0182] In some embodiments, the display unit 802 is further configured to:

[0183] When the picture corresponding to the target area shot by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to a fourth preset threshold, the picture corresponding to the current area shot by the second camera is displayed on the display screen, and the current area is the picture currently displayed on the display screen;

[0184] The fourth preset threshold is smaller than the first preset threshold.

[0185] In some embodiments, the display unit 802 is further configured to:

[0186] When the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen.

[0187] In some embodiments, the images captured by at least two cameras disposed at different locations are synchronized in time.

[0188] In some embodiments, the camera includes camera modules with different focal lengths.

[0189] Each module in the display device for multi-camera shooting can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0190] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0191] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for displaying images shot by multiple cameras, characterized in that: The multi-camera comprises at least two cameras arranged at different positions, and the method comprises: Acquire pictures taken by a plurality of cameras set at different positions, wherein the setting position of a first camera of two cameras with adjacent setting positions is located within the shooting picture of a second camera, and an extended line of the optical axis of the first camera passes through the optical center of the second camera or has a first preset distance from the optical center of the second camera; When a target area of ​​the picture taken by the second camera displayed on the display screen meets a preset condition, displaying the picture taken by the first camera and corresponding to the target area on the display screen; The target area is a partial area or the entire area of ​​a preset area, and the preset area is an area where the picture taken by the first camera and the picture taken by the second camera overlap with each other.

2. The method for displaying multi-camera shooting according to claim 1, characterized in that: When the target area of ​​the picture taken by the second camera displayed on the display screen meets the preset condition, the picture taken by the first camera and corresponding to the target area is displayed on the display screen, including: When the proportion of the target area occupied by the display screen is greater than or equal to a first preset threshold, the picture corresponding to the target area captured by the first camera is displayed on the display screen.

3. The display method of multi-camera shooting according to claim 1, characterized in that: When the target area of ​​the picture taken by the second camera displayed on the display screen meets the preset condition, the picture taken by the first camera and corresponding to the target area is displayed on the display screen, including: Based on the received image selection instruction acting on the display screen, determining whether the area selected by the image selection instruction is located in the preset area; If the area selected by the image selection instruction is located in the preset area, the area selected by the image selection instruction is determined to be the target area.

4. The method for displaying multi-camera shooting according to claim 3, characterized in that: The method for displaying multi-camera shooting also includes: When the target area is enlarged to a proportion of the display screen that is greater than or equal to a second preset threshold, a picture corresponding to the target area captured by the first camera is displayed on the display screen.

5. The display method of multi-camera shooting according to claim 3, characterized in that: The method for displaying multi-camera shooting also includes: If the area selected by the image selection instruction is not located in or is partially located in the preset area, the area selected by the image selection instruction is enlarged to a ratio of occupying the display screen that is a third preset threshold.

6. The method for displaying multi-camera shooting according to claim 2, characterized in that: After the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes: When the picture corresponding to the target area shot by the first camera displayed on the display screen is reduced to a proportion of the display screen that is less than or equal to a fourth preset threshold, the picture shot by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture currently displayed on the display screen; The fourth preset threshold is smaller than the first preset threshold.

7. The method for displaying multi-camera shooting according to any one of claims 1 to 5, characterized in that: After the display screen displays the picture corresponding to the target area taken by the first camera, the method further includes: When the edge of the picture taken by the first camera is moved to a second preset distance from the edge of the display screen, the picture taken by the second camera corresponding to the current area is displayed on the display screen, and the current area is the picture being displayed on the display screen.

8. The method for displaying multi-camera shooting according to claim 1, characterized in that: The pictures taken by the at least two cameras arranged at different positions are synchronized in time.

9. The method for displaying multi-camera shooting according to claim 1, characterized in that: The camera includes camera modules with different focal lengths.

10. A display device for multi-camera shooting, characterized in that: include: an acquisition unit configured to acquire images captured by a plurality of cameras arranged at different positions, wherein the setting position of a first camera of two cameras arranged at adjacent positions is located within the shooting image of a second camera, and an optical axis extension line of the first camera passes through an optical center of the second camera or has a first preset distance from the optical center of the second camera; A display unit configured to display, on the display screen, a picture taken by the first camera corresponding to the target area when the target area of ​​the picture taken by the second camera displayed on the display screen meets a preset condition; The target area is a partial area or the entire area of ​​a preset area, and the preset area is an area where the picture taken by the first camera and the picture taken by the second camera overlap with each other.

Images