Camera device, control method and medium of image processing device, and camera system
By detecting and generating the video data layout, maintaining the consistent positional relationship between the camera units, the problem of multiple camera units shooting video segmentation display is solved, and the continuous display of videos in the same area is realized on the viewer.
Patent Information
- Application Number
- CN202110148919.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-02-06
- Filing Date
- 2021-02-03
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2041-02-03
AI Technical Summary
The prior art cannot effectively solve the problem of segmented display of videos captured by multiple camera units on the viewer display screen, especially when the camera units combine to capture continuous areas.
By detecting the positions of each camera unit and generating a video data layout based on the detection results, the video data position relationship between the camera units is set to maintain consistency, ensuring that videos in continuous areas on the viewer are not displayed separately.
It effectively solves the problem of multiple camera units shooting videos on the viewer to split the display, ensuring that videos in almost the same area are shot to maintain continuity on the display screen.
Smart Images

Figure CN113225487B_ABST
Abstract
Description
Technical Field
[0001] The present invention broadly relates to a camera device, a control method and medium of an image processing device, and a camera system, and in particular to the control of a plurality of camera devices. Background Art
[0002] In recent years, a surveillance camera including a plurality of camera units has been proposed, each of which is configured to be movable in a surveillance device. In this type of surveillance device, the plurality of camera units can be configured to capture separate surveillance areas. In addition, the plurality of camera units can be configured to combine and capture a continuous area.
[0003] A technology for optimizing the distribution of shooting information according to the shooting conditions of multiple cameras is also proposed. For example, Japanese Patent Laid-Open No. 2019-54369 discloses a technology for changing the distribution order of videos obtained by each camera when there is an overlapping area between images captured by multiple fixed cameras with a fixed shooting range and images captured by a PTZ camera with a variable shooting range.
[0004] Generally, a plurality of videos shot by a plurality of camera units are displayed in a pre-specified layout on a display screen of a viewer. In the case where a plurality of camera units are combined and shoot a continuous area, a problem occurs in which a single area is divided and displayed. The technology disclosed in the above patent document is to change the distribution order of videos shot by a plurality of cameras, but it cannot solve the above problem. Summary of the invention
[0005] According to one aspect of the present invention, a camera device includes: a plurality of movable camera units; a detection unit configured to detect the position of each camera unit; and a generation unit configured to generate video data of videos obtained by the camera units based on the detection results of the detection unit, wherein the generation unit sets the positional relationship in the video data between at least two videos obtained by at least two of the camera units so as to be consistent with the positional relationship between the at least two camera units.
[0006] According to another aspect of the present invention, a control method for an image processing device that processes videos obtained by multiple movable camera units includes: detecting the position of each camera unit; and generating video data of the videos obtained by the camera units based on the detection results in the detection step, wherein in the generation step, the positional relationship in the video data between at least two videos obtained by at least two of the camera units is set so as to be consistent with the positional relationship between the at least two camera units.
[0007] According to another aspect of the present invention, a non-temporary computer-readable recording medium stores a program for causing a computer to execute a control method for an image processing device that processes videos obtained by multiple movable camera units, the method comprising: detecting the position of each camera unit; and generating video data of the videos obtained by the camera units by laying out the detection results in the detection step, wherein in the generation step, the positional relationship in the video data between at least two videos obtained by at least two of the camera units is set so as to be consistent with the positional relationship between the at least two camera units.
[0008] According to another aspect of the present invention, a camera system comprises: a plurality of movable camera devices; and a server device configured to generate video data based on videos obtained by the camera devices and distribute the video data, wherein the server device comprises: a detection unit configured to detect the position of each camera device; and a generation unit configured to generate video data of the videos obtained by the camera devices by laying out the detection results of the detection unit, and the generation unit sets the positional relationship in the video data between at least two videos obtained by at least two of the camera units so as to be consistent with the positional relationship between the at least two camera units.
[0009] The present invention can better display multiple videos shot by multiple camera units.
[0010] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description of the embodiments, serve to explain the principles of the present disclosure.
[0012] Figure 1 is a block diagram illustrating a functional configuration of an image pickup apparatus including three cameras.
[0013] Figure 2A and 2B is a view for explaining three types of rotation operations for defining a shooting range.
[0014] Figure 3 This is a flowchart for explaining control of display positions of two videos of two cameras.
[0015] Figures 4A to 4C is a view for explaining three types of angles of two cameras.
[0016] Figure 5 This is a view for explaining the display position of the video of camera B relative to the video of camera A.
[0017] Figure 6 is a view illustrating an example displayed on the display screen of the viewer.
[0018] Fig. 7A and 7B It is a view for explaining a state in which two cameras photograph almost the same area.
[0019] Figure 8 This is a view for explaining the display position of the video of camera B relative to the video of camera A.
[0020] Figures 9A to 9C is a view illustrating an example of display of four videos of four cameras. DETAILED DESCRIPTION
[0021] Each embodiment will be described in detail below with reference to the accompanying drawings. It should be noted that these embodiments are by no means intended to limit the scope of the present invention. Many features are described in these embodiments, but no invention needs to include the limitation of all these features, and these features can be combined arbitrarily. Further, in the accompanying drawings, the same or similar configurations will be given the same reference numerals, and repeated descriptions will be omitted.
[0022] (First embodiment)
[0023] An image pickup apparatus including three cameras will be exemplified below as a first embodiment of an image pickup apparatus according to the present invention.
[0024] <Device Configuration>
[0025] Figure 1 1 is a block diagram illustrating a functional configuration of an imaging device including three cameras. Please note that such a configuration is only an example, and the present invention is not limited to Figure 1 The configuration shown in . Figure 2A and 2B is a view for explaining three types of rotation operations for defining a shooting range.
[0026] The camera device 1000 includes cameras 1100, 1200, 1300, a processing unit 1400 and a distribution unit 1500. Figure 2A and 2B As shown in FIG. 1 , three cameras (cameras 1100, 1200, and 1300) are stored in a housing of the imaging device 1000 and are configured to perform rotation operations, i.e., translation (P), tilt (T), and rotation (R). In the following description, it is assumed that the cameras 1200 and 1300 have the same configuration as the camera 1100, and thus attention will be paid to the camera 1100.
[0027] Figure 2A The state where the camera 1000 is viewed from the lateral direction (horizontal direction) is illustrated. Figure 2B The state in which the camera 1000 is viewed from the top in the vertical direction is illustrated. Figure 2A and 2B As shown in , the shooting direction of the camera 1100 can be changed by changing the pan angle, tilt angle and rotation angle. The pan angle, tilt angle and rotation angle are changed by rotating around the axes P, T, R.
[0028] The panning angle can be changed by changing the angle of the adjacent camera. For example, when cameras 1100, 1200 and 1300 are Figure 2B With the arrangement shown, the pan angle of camera 1100 can be changed within the rotation range (arrow) from camera 1200 to camera 1300 about axis P. For cameras 1200 and 1300, the pan angle, tilt angle, and rotation angle of each camera can be changed similarly to camera 1100.
[0029] The camera 1100 includes an imaging unit 1101 and a detection unit 1102. The imaging unit 1101 is formed of a lens and an image sensor such as a CCD or CMOS sensor, and is configured to output an electrical signal obtained by imaging to the processing unit 1400. The detection unit 1102 is formed of a rotary encoder, a photo interrupter, an angular velocity sensor, etc., and is configured to output information on a pan angle, a tilt angle, and a rotation angle of the camera 1100 to the processing unit 1400.
[0030] The processing unit 1400 receives the electrical signals output from the camera unit 1101, the camera unit 1201, and the camera unit 1301, performs predetermined image processing and compression encoding processing, and generates video data. The generated video data is, for example, a single video stream in which the videos from the three cameras are arranged at predetermined positions. The arrangement of the videos from the three cameras will be described later. The processing unit 1400 outputs the generated video data to the distribution unit 1500.
[0031] The processing unit 1400 sends the setting values of the shooting conditions to the camera units 1101, 1201 and 1301, and changes the driving state of each camera unit. The shooting conditions include gain conditions, gamma conditions, dynamic range conditions, exposure conditions, focus conditions, etc.
[0032] In addition, the processing unit 1400 receives the angle information of each camera output from the detection unit 1102, the detection unit 1202, and the detection unit 1302, and detects the shooting range of each camera.
[0033] The distribution unit 1500 is connected to the network 2000, and distributes the video data output by the processing unit 1400 to the network 2000. The user can watch the videos of the three cameras via a viewer (not shown) connected to the network 2000. The distribution unit 1500 transmits information (various setting information, etc.) received via the network 2000 to the processing unit 1400.
[0034] <Device Operation>
[0035] The following will describe layout control of videos from three cameras when the processing unit 1400 generates video data.
[0036] Here, it is assumed that the CPU included in the processing unit 1400 executes a predetermined control program to implement Figure 3 It is assumed that a control program is stored in a nonvolatile memory or the like included in the processing unit 1400. The processing unit 1400 may be formed of hardware such as an application-specific integrated circuit (ASIC) or the like. It is assumed that various angle values (e.g., Xh, Xv, Xr, Yh, Yv, Mh1, Mh2, and Nv to be described later) to be described later are stored in a nonvolatile memory (not shown) or the like in advance. It is assumed that these angle values are automatically or manually set according to the installation state of the camera and the photographed object.
[0037] Figure 3 1 is a flowchart for explaining the control of the display position (layout) of two videos of two cameras. In this sequence, operations are performed on any two cameras among the cameras 1100, 1200, and 1300. More specifically, the control of the display position (layout) is performed by determining whether the two cameras shoot almost the same area (one continuous area) or shoot areas independent of each other. Two cameras selected from the cameras 1100, 1200, and 1300 will be described as cameras A and B, respectively.
[0038] First, a sequence excluding a specific case (steps S109 to S114 ) which will be described later will be explained.
[0039] In step S100, the processing unit 1400 obtains the translation angle, tilt angle, and rotation angle of cameras A and B. The translation angle, tilt angle, and rotation angle of camera A are referred to as Ah, Av, and Ar, respectively. The translation angle, tilt angle, and rotation angle of camera B are referred to as Bh, Bv, and Br, respectively.
[0040] In step S101 , the processing unit 1400 calculates the differences between the translation angles, tilt angles, and rotation angles of cameras A and B. The differences are referred to as ΔABh, ΔABv, and ΔABr.
[0041] Figures 4A to 4Cis a view used to explain the three types of angles and differences of two cameras. Figure 4A Horizontal cross sections are illustrated and the relationship between Ah, Bh and ΔABh is illustrated. Figure 4B The vertical cross section is illustrated and the relationship between Av, Bv and ΔABv is illustrated. Figure 2A In the camera configuration shown in , the straight line passing through cameras A and B and defining angles Av and Bv does not necessarily pass through the origin O. Figure 4C The cross section perpendicular to the optical axis is illustrated and the relationship between Ar, Br and ΔABr is illustrated. Note that the differences ΔABh, ΔABv and ΔABr are calculated by equations (1) to (3):
[0042] ΔABh=Ah-Bh...(1)
[0043] ΔABv=Av-Bv...(2)
[0044] ΔABr=Ar-Br...(3)
[0045] In step S102, the processing unit 1400 compares the absolute value |ΔABh| of ΔABh with the preset angle Xh. In the case of |ΔABh|≤Xh, it is determined that the cameras A and B are close in the translation direction, in other words, the angle in the translation direction is small, and the process proceeds to step S103. In the case of |ΔABh|>Xh, the process proceeds to step S109.
[0046] In step S103, the processing unit 1400 compares the absolute value |ΔABv| of ΔABv with the preset angle Xv. In the case of |ΔABv|≤Xv, it is determined that cameras A and B are close in the tilt direction, in other words, the angle in the tilt direction is small, and the process proceeds to step S104. In the case of |ΔABv|>Xv, it is determined that cameras A and B shoot independent shooting ranges, and the process ends.
[0047] In step S104, the processing unit 1400 compares the absolute value |ΔABr| of ΔABr with the preset angle Xr. In the case of |ΔABr|≤Xr, it is determined that the cameras A and B are close in the rotation direction, in other words, the angle in the rotation direction is small, and the process proceeds to step S105. In the case of |ΔABr|>Xr, it is determined that the cameras A and B shoot independent shooting ranges, and the process ends. That is, when it is determined in steps S102 to S104 that the shooting ranges of the cameras A and B fall within the predetermined angle range, the process proceeds to step S105.
[0048] In step S105, the processing unit 1400 determines the display position relationship between cameras A and B, that is, the position relationship between the shooting ranges of cameras A and B.
[0049] Figure 5 It is a view for explaining the display position of the video of camera B with respect to the video of camera A. Figure 5 Illustrates the display positions (display positions 1 to 4) of the video of camera B with respect to the display position 3001 of the video of camera A. Based on the following conditions (i) to (v), one of the four display positions corresponding to the video of camera B is determined:
[0050] (i) Conditions for determining the display position of the video of camera B as display position 1:
[0051] 0 ≤ ΔABh ≤ Xh and -Yv < ΔABv < Yv...(4)
[0052] (ii) Conditions for determining the display position of the video of camera B as display position 2:
[0053] -Xh ≤ ΔABh < 0 and -Yv < ΔABv < Yv...(5)
[0054] (iii) Conditions for determining the display position of the video of camera B as display position 3:
[0055] -Yh < ΔABh < Yh and 0 ≤ ΔABv ≤ Xv...(6)
[0056] (iv) Conditions for determining the display position of the video of camera B as display position 4:
[0057] -Yh < ΔABh < Yh and Xv ≤ ΔABv < 0...(7)
[0058] (v) In the case where none of the above conditions are satisfied, the display position setting is not changed.
[0059] Please note that the above display position candidates and condition settings are only examples and can also be changed according to the number of cameras and the display form.
[0060] In step S106, the processing unit 1400 determines whether one of the conditions (the above conditions (i) to (iv)) predetermined in step S105 is satisfied. In the case where one of the predetermined conditions is satisfied, the process proceeds to step S107. In the case where none of the predetermined conditions are satisfied, the process ends.
[0061] In step S107, the processing unit 1400 determines whether the current relationship between the display positions of cameras A and B (the positional relationship between the videos of cameras A and B in the video data generated by the processing unit 1400) is consistent with the relationship of the display positions determined in step S105. In the case where these relationships are consistent with each other, there is no need to change the settings and the processing ends. In the case where these relationships are inconsistent with each other, the processing proceeds to step S108.
[0062] In step S108, the processing unit 1400 sets the display positions of the cameras A and B so as to have the positional relationship (detection result) determined in step S105. That is, the processing unit 1400 sets the positional relationship between the videos of the cameras A and B in the video data generated thereby so as to coincide with the positional relationship between the shooting ranges of the cameras A and B. The set video data is transmitted to the external device via the network. Thereafter, the processing ends.
[0063] Figure 6 6000 is a diagram illustrating an example of display on the display screen 6000 of the viewer. As an example of display, the following case will be considered: Figure 6 Videos from cameras A and B are displayed in two of the three preset display frames shown in FIG.
[0064] Based on the display position of the video of camera A, it is assumed that the display position of the video of camera B is determined to be "display position 1". In this case, the relationship between the display positions of the videos of cameras A and B is Figure 6 3001 and the display position 3002 in step S105. Although the case where three display frames are set in advance has been described, similar settings can be applied even to the case where there are more than three display frames. More specifically, the display positions are set so as to maintain the positional relationship between the videos of cameras A and B determined in step S105.
[0065] Next, the case where the processing enters step S109 will be described. That is, the case where |ΔABh|>Xh is determined in step S102 will be explained. In this case, it is necessary to consider that the two cameras have Fig. 7A and 7B The shooting range (shooting direction) shown.
[0066] Fig. 7A and 7B This is a view for explaining a state where two cameras shoot almost the same area. This is equivalent to a situation where two cameras shoot almost the same area (a continuous area) at different pan angles.
[0067] exist Fig. 7A and 7BAmong them, the optical axis of the shot by camera A is axis a, and the optical axis of the shot by camera B is axis b. Cameras A and B shoot almost the same area with different translation angles. The angle defined by plane Ov and axis a is regarded as angle Av, and the angle defined by plane Ov and axis b is regarded as angle Bv.
[0068] In step S109, regarding the translation angle, the processing unit 1400 compares the absolute value |ΔABh| of ΔABh with the preset angles Mh1 and Mh2 (Mh1 < Mh2):
[0069] Mh1 ≤ |ΔABh| ≤ Mh2...(8)
[0070] When the inequality (8) is satisfied, the process proceeds to step S110; otherwise, the process ends.
[0071] In step S110, regarding the tilt angle, the processing unit 1400 determines whether the inequality (9) is satisfied:
[0072] 0 < Av < 180° and 0 < Bv < 180° and |ΔABh| ≤ Nv...(9)
[0073] Among them, |ΔABh| is the absolute value of ΔABh. When the inequality (9) is satisfied, it is determined that the angles of cameras A and B are close in the tilt direction, and the process proceeds to step S111; otherwise, the process ends.
[0074] In step S111, regarding the rotation angle, the processing unit 1400 compares the absolute value |ΔABr| of ΔABr with the preset angle Xr:
[0075] -Xr ≤ |Ar| - |Br| ≤ Xr...(10)
[0076] When the inequality (10) is satisfied, the process proceeds to step S112; otherwise, the process ends.
[0077] In step S112, the processing unit 1400 determines the display relationship of camera B relative to camera A. That is, the processing unit 1400 determines the positional relationship between the shooting ranges of cameras A and B.
[0078] Figure 8 It is a view for explaining the display position of the video of camera B relative to the video of camera A. Figure 8 Illustrates one display position of the video of camera B relative to the display position of the video of camera A. Based on the following conditions (vi) and (vii), it is determined whether to rotate the video of camera B by 180° at this display position. This is because Figure 7BIn the two-camera arrangement shown, the video from the cameras can be rotated 180°.
[0079] (vi) Conditions for displaying the video from camera B without rotation (0° rotation):
[0080] 0°≤ΔABr≤180°...(11)
[0081] (vii) The video from camera B is rotated 180° and displayed under the following conditions:
[0082] -180°≤ΔABr<0°...(12)
[0083] In step S113, the processing unit 1400 determines whether the current relationship between the display positions of cameras A and B (the positional relationship between the videos of cameras A and B in the video data generated by the processing unit 1400) is consistent with the relationship of the display positions determined in step 112. In the case where these relationships are consistent with each other, there is no need to change the settings and the processing ends. In the case where these relationships are inconsistent with each other, the processing proceeds to step S114.
[0084] In step S114, the processing unit 1400 sets the display positions of the cameras A and B so as to have the positional relationship determined in step S112. That is, the processing unit 1400 sets the positional relationship between the videos of the cameras A and B in the video data generated thereby so as to coincide with the positional relationship between the shooting ranges of the cameras A and B. The set video data is transmitted to the external device via the network. Thereafter, the processing ends.
[0085] The above sequence is sequentially performed for two of the three cameras, and video data in which the relationship of the display positions becomes appropriate on the viewer display screen 6000 can be generated. Although two cameras are described above, the determination and setting of the positional relationship can be performed for more cameras.
[0086] As described above, according to the first embodiment, the positional relationship between the shooting ranges of the cameras is determined. Then, the videos of the two cameras shooting almost the same area (one continuous area) are set to have the same positional relationship in the video data generated by the processing unit 1400. This configuration can prevent the videos of the two cameras shooting almost the same area from being split and displayed on the display screen of the viewer.
[0087] An example of the camera apparatus 1000 having a function of generating and distributing video data including a plurality of camera videos is described above. However, a camera system may be configured in which this function is configured in a server device (not shown) separate from the camera apparatus 1000. More specifically, in Figure 1In the embodiment, the cameras 1100 to 1300, the processing unit 1400 and the distribution unit 1500 may be distributed and arranged on a network.
[0088] (Variation Example)
[0089] The first embodiment describes an example in which, in a video recording device including three cameras, videos of two cameras are adjacent to each other in shooting almost the same area. However, in the case where the video recording device includes more cameras, there may be multiple pairs of cameras having a positional relationship in which videos are adjacent to each other. In this case, the display position is determined so that the videos of the paired cameras are adjacent to each other in the video data.
[0090] Although the first embodiment describes a camera capable of changing the pan angle, tilt angle, and rotation angle, it is also possible to use a camera that can only change the pan angle. In this case, it is determined whether the two cameras are close in the pan direction. That is, Figure 3 In the processing, no processing on the tilt angle and rotation angle is performed.
[0091] Likewise, it is possible to use a camera that can change the pan angle and tilt angle. In this case, it is determined whether the two cameras are close in the pan direction and close in the tilt direction. Figure 3 In the processing, no processing related to the rotation angle is performed.
[0092] Alternatively, it is possible to use a camera that can only change the tilt angle. In this case, it is determined whether the two cameras are close in the tilt direction. Figure 3 In the processing, no processing of translation angle and rotation angle is performed.
[0093] Figures 9A to 9C is a view illustrating an example of display of four videos of four cameras. Fig.9A The state of viewing the imaging device including four cameras from the top in the vertical direction is illustrated. Here, cameras A and D capture one continuous area (capturing area X). Cameras B and C capture another continuous area (capturing area Y).
[0094] Fig. 9B This illustrates an initial layout setting of four cameras in the video data generated by the processing unit 1400. When the video data is generated under this initial layout setting, the videos corresponding to the shooting axes X and Y are divided and displayed on the display screen of the viewer.
[0095] Fig. 9C The layout setting of the four camera videos that have been changed is illustrated. More specifically, the video of camera D is determined to be in Figure 5Therefore, the videos of cameras D and A corresponding to the shooting axis X are arranged in the video data to be laterally adjacent to each other. In addition, the video of camera C is determined to be at the "display position 2" in relation to the video of camera B. Figure 5 Therefore, the videos of cameras B and C corresponding to the shooting axis Y are arranged in the video data to be laterally adjacent to each other. The videos of the two cameras shooting the shooting area X and the videos of the two cameras shooting the shooting area Y are not divided and displayed on the display screen of the viewer.
[0096] Other embodiments
[0097] Some embodiments may also be implemented by reading out and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more completely referred to as a "non-transitory computer-readable storage medium") to perform the functions of one or more of the above-mentioned (one or more) embodiments and / or a system or device including one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing the functions of one or more of the above-mentioned (one or more) embodiments, and by a method performed by a computer of the system or device, for example, by reading out and executing computer executable instructions from a storage medium to perform the functions of one or more of the above-mentioned (one or more) embodiments and / or controlling one or more circuits to perform the functions of one or more of the above-mentioned (one or more) embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read out and execute computer executable instructions. Computer executable instructions may be provided to the computer, for example, from a network or a storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage device of a distributed computing system, an optical disk (such as a compact disk (CD), a digital versatile disk (DVD), or a Blu-ray disk (BD)) TM ), one or more of flash memory devices, memory cards, etc.
[0098] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.
[0099] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Claims
1. A camera device, comprising: A first camera unit is configured to be movable and to acquire a first image; a second camera unit configured to be movable and to acquire a second image; a third camera unit configured to be movable and to acquire a third image; a detection unit, configured to detect positions of the first camera unit, the second camera unit, and the third camera unit; as well as a generating unit configured to generate image data for laying out the first image, the second image, and the third image based on the detection result of the detecting unit, wherein, in a case where the first camera unit and the second camera unit are arranged to image a continuous area and the third camera unit is arranged to image an independent area that is discontinuous with the imaging areas of the first camera unit and the second camera unit, the generating unit generates image data in which a first image acquired by the first camera unit and a second image acquired by the second camera unit are arranged in a first row so as to be adjacent to each other and a third image acquired by the third camera unit is arranged in a second row different from the first row, and The generating unit sets the arrangement of the first image and the second image in the image data so as to be consistent with the positional relationship between the first imaging unit and the second imaging unit.
2. The device according to claim 1, wherein: The first camera unit, the second camera unit and the third camera unit are configured to change positions by controlling a translation angle, a tilt angle and a rotation angle of each camera unit; and The detection unit detects the position of each camera unit by obtaining the translation angle, tilt angle and rotation angle of each camera unit.
3. The apparatus according to claim 1, further comprising: The distribution unit is configured to distribute the image data generated by the generation unit via a network.
4. The apparatus according to claim 1, further comprising: a fourth camera unit configured to be movable and to acquire a fourth image; wherein, when the first camera unit and the second camera unit are arranged to image a first continuous area and the third camera unit and the fourth camera unit are arranged to image a second continuous area different from the first continuous area, the generation unit generates image data in which a first image acquired by the first camera unit and a second image acquired by the second camera unit are arranged in a first row so as to be adjacent to each other and a third image acquired by the third camera unit and a fourth image acquired by the fourth camera unit are arranged in a second row different from the first row so as to be adjacent to each other, The generating unit sets the arrangement of the third image and the fourth image in the image data so as to be consistent with the positional relationship between the third imaging unit and the fourth imaging unit.
5. The device according to claim 1, wherein: The detection unit determines that the first camera unit and the second camera unit are arranged to image the continuous area by detecting that the positions of the first camera unit and the second camera unit fall within a predetermined angle range.
6. The device according to claim 1, wherein: When the positions of the first imaging unit and the second imaging unit satisfy a predetermined positional relationship, the generating unit generates image data in which at least one of the at least two images is rotated by 180° in layout.
7. A control method for an image processing device for processing images acquired by a first camera unit, a second camera unit, and a third camera unit, wherein: A first camera unit is configured to be movable and to acquire a first image; a second camera unit configured to be movable and to acquire a second image; as well as a third camera unit configured to be movable and to acquire a third image; The method comprises: a detection step, detecting positions of the first camera unit, the second camera unit and the third camera unit; and a generating step of generating image data of laying out the first image, the second image and the third image based on the detection result in the detecting step, Wherein, in a case where the first camera unit and the second camera unit are arranged to image a continuous area and the third camera unit is arranged to image an independent area that is discontinuous with the imaging areas of the first camera unit and the second camera unit, the generating step generates image data in which a first image acquired by the first camera unit and a second image acquired by the second camera unit are arranged in a first row so as to be adjacent to each other and a third image acquired by the third camera unit is arranged in a second row different from the first row, and Here, in the generating step, the arrangement of the first image and the second image in the image data is set so as to be consistent with the positional relationship between the first imaging unit and the second imaging unit.
8. A non-transitory computer-readable recording medium storing a program for causing a computer to execute a control method of an image processing device for processing images acquired by a first camera unit, a second camera unit, and a third camera unit, wherein: A first camera unit is configured to be movable and to acquire a first image; a second camera unit configured to be movable and to acquire a second image; as well as a third camera unit configured to be movable and to acquire a third image; The method comprises: a detection step, detecting positions of the first camera unit, the second camera unit, and the third camera unit; and a generating step of generating image data of laying out the first image, the second image and the third image based on the detection result in the detecting step, Wherein, in a case where the first camera unit and the second camera unit are arranged to image a continuous area and the third camera unit is arranged to image an independent area that is discontinuous with the imaging areas of the first camera unit and the second camera unit, the generating step generates image data in which a first image acquired by the first camera unit and a second image acquired by the second camera unit are arranged in a first row so as to be adjacent to each other and a third image acquired by the third camera unit is arranged in a second row different from the first row, and Here, in the generating step, the arrangement of the first image and the second image in the image data is set so as to be consistent with the positional relationship between the first imaging unit and the second imaging unit.
9. A camera system, comprising: A first camera device is configured to be movable and to acquire a first image; a second camera device configured to be movable and to acquire a second image; a third camera device configured to be movable and to acquire a third image; as well as a server device configured to generate image data based on images acquired by the first camera device, the second camera device, and the third camera device and to distribute the image data, Wherein, the server device comprises: a detection unit configured to detect positions of the first camera device, the second camera device, and the third camera device; and a generating unit configured to generate image data for laying out the first image, the second image, and the third image based on the detection result of the detecting unit, wherein, in a case where the first camera device and the second camera device are arranged to image a continuous area and the third camera device is arranged to image an independent area that is discontinuous with the imaging areas of the first camera device and the second camera device, the generating unit generates image data in which a first image acquired by the first camera device and a second image acquired by the second camera device are arranged in a first row so as to be adjacent to each other and a third image acquired by the third camera device is arranged in a second row different from the first row, and The generation unit sets the arrangement of the first image and the second image in the image data so as to be consistent with the positional relationship between the first imaging device and the second imaging device.
Citation Information
Patent Citations
Imaging device, control method of imaging device, and program
JP2019054369A
Video display system and video display method
JP2005268972A
Image processing apparatus, image processing system and image processing method
JP2012010186A
Image processing device, image processing method, image processing system, and program
JP2016040883A