Imaging device, control method, and program

Abstract

To realize, when displaying an image captured by another user terminal on one's own user terminal, a technology that allows a user to select and display the image of a desired photography position and a photography direction.SOLUTION: An imaging device includes: imaging means that captures a subject; display control means that performs control such that an image of the subject is displayed on a screen; acquisition means that acquires first information regarding a photography position and a photography direction of another imaging device; and determination means that determines whether an area that includes the subject can be captured by the other imaging device. When the area that includes the subject can be captured by the other imaging device, the display control means performs control on the basis of the first information such that an indicator that indicates the photography direction is displayed at a location on the image of the subject that corresponds to the photography position.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a system for photographing a subject from a plurality of viewpoints.

Background Art

[0002] Patent Document 1 describes a method of simultaneously photographing the same subject with a plurality of cameras. In recent years, the method of Patent Document 1 has been realized using user terminals such as smartphones, and it is possible to transmit the live view images being photographed by each user terminal to the other user terminals. Further, Patent Document 2 describes a method in which, in a multi-viewpoint image in which the positions for each viewpoint of the photographed image are associated, the viewpoint position can be changed in an arbitrary direction, and an image after moving the viewpoint position from the current viewpoint position to a viewpoint position in an arbitrary direction is displayed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] As described above, when trying to display an image captured by another user terminal on one's own user terminal, the user needs to select which user terminal's image to display. However, whether the image of the user terminal being selected is an image captured at the shooting position and shooting direction desired by the user cannot be known without switching to the images of other user terminals. Further, in Patent Document 2, even when the viewpoint position is moved in an arbitrary direction, if there are a plurality of user terminals in the moved direction, in order to search for an image captured at a desired shooting position and shooting direction, it is necessary to switch to the images of other user terminals many times.

[0005] This invention has been made in view of the above problems, and its purpose is to realize a technology that allows a user to select and display an image taken at a desired shooting position and direction on their own user terminal without having to repeatedly switch between images taken on other user terminals when displaying images taken on other user terminals on their own user terminal. [Means for solving the problem]

[0006] To solve the above problems, the present invention provides an imaging device comprising: imaging means for imaging a subject; display control means for controlling the display of the image of the subject on a screen; acquisition means for acquiring first information relating to the shooting position and shooting direction of another imaging device; and determination means for determining whether the range including the subject can be imaged by the other imaging device. A transmitting means for transmitting an image of the subject captured by the imaging means to the other imaging device, and a receiving means for receiving information indicating that the other imaging device is displaying the image of the subject transmitted by the transmitting means. The display control means has, when the other imaging device is capable of imaging a range including the subject, the display control means, based on the first information, on the image of the subject Other imaging devices The shooting location and the corresponding location The other imaging device Control the display to show an indicator indicating the shooting direction. In addition, the system controls the display of information that allows the other imaging device to recognize that it is displaying the image of the subject transmitted by the transmission means. . [Effects of the Invention]

[0007] According to the present invention, when displaying images taken by another user's terminal on one's own user's terminal, the user can select and display an image from a desired shooting position and direction without having to repeatedly switch between images on the other user's terminal. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram illustrating the device configuration of this embodiment. [Figure 2] System configuration diagram of this embodiment. [Figure 3] A diagram illustrating the shooting state of this embodiment. [Figure 4] Figure 3 shows an example of the screen during the shooting state. [Figure 5](a) is a flowchart showing the procedure for taking a picture, and (b) is a flowchart showing the procedure for transmitting the image and the captured information. [Figure 6] (a) is a flowchart showing the operation procedure when displaying shooting information, and (b) is a flowchart showing the operation procedure when switching live view images. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention to the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] [Embodiment 1] The following describes an embodiment in which the imaging device of the present invention is applied to a user terminal such as a smartphone that has a camera function.

[0011] Furthermore, the user terminal is not limited to smartphones, which are a type of mobile phone; it may also include personal computers (PCs) with camera functions, tablet devices, eyeglasses, smartwatches, digital cameras with communication functions, and other similar devices.

[0012] First, with reference to Figure 1, the configuration and functions of the user terminal in this embodiment will be described.

[0013] Figure 1 is a block diagram showing the configuration of the user terminal 100 in this embodiment.

[0014] In this embodiment, the user terminal 100 has the following components built into the main body case that constitutes the housing.

[0015] The imaging unit 101 includes an image sensor that converts an optical image into an electrical signal, and an A / D converter that converts the analog electrical signal generated by the image sensor into a digital signal. There may be a plurality of imaging units 101. In this case, when there are a plurality of imaging units, they can be configured to be switchable, for example, as an out-camera that directs the plurality of imaging units in different directions to photograph a subject, and as an in-camera that photographs a photographer.

[0016] The image processing unit 102 performs predetermined resizing processing, trimming processing, color conversion processing, and distortion correction processing on the image data (including the live view image) generated by the imaging unit 101, and outputs it to the image output unit 105. Also, in the image processing unit 102, a face of a person as a subject in the image is recognized and notified to the system control unit 117.

[0017] The codec 103 encodes the image data processed by the image processing unit 102 in a video compression format such as MPEG2 or H.264 and records it as a video file on a recording medium, or decodes the video file read from the recording medium 108 and outputs it to the image output unit 105.

[0018] The OSD drawing unit 104 renders items such as character strings and icons representing the state and settings of the user terminal 100, guides or indexes (pointers) such as an AF frame, a marker, and a vector display (to be described later) according to control instructions from the system control unit 117 to be described later. After rendering, the OSD drawing unit 104 outputs it to the image output unit 105 as OSD (On Screen Display) data.

[0019] The image output unit 105 superimposes the image data processed by the image processing unit 102, the image data decoded by the codec 103, and the OSD data output from the OSD drawing unit 104 to generate a display image signal, and outputs it to the display unit 106.

[0020] The display unit 106 is a display device such as a liquid crystal panel or an organic EL panel that displays the image signal acquired from the image output unit 105. Multiple display units 106 may be provided, and they may also be external devices connected to the user terminal 100.

[0021] The touch detection unit 107 is a touch panel integrated with the display unit 106. The touch detection unit 107 can detect user touch operations on the surface (touch detection surface) of the display unit 106 and notifies the system control unit 117 of operation instructions corresponding to the detected touch operation.

[0022] The recording medium 108 is a storage device capable of writing image data encoded by the codec 103 and reading recorded encoded image data and associated data. The recording medium 108 may be a memory card or hard disk that can be attached to or removed from the user terminal, or a flash memory or hard disk built into the user terminal.

[0023] The operation unit 109 consists of operating components such as push buttons and slide switches, and inputs various operation instructions to the system control unit 117 in response to user operations. The operation unit 109 includes, for example, a home button, a power button, and volume buttons.

[0024] The posture detection unit 110 detects the horizontal or vertical tilt (the direction in which the subject is photographed) of the user terminal 100 and notifies the system control unit 117 of the detected tilt information. The position detection unit 111 detects the current position of the user terminal 100 (the position in which the subject is photographed) and notifies the system control unit 117 of the detected position information.

[0025] The communication unit 112 enables the user terminal 100 to communicate with external devices such as other user terminals. The communication unit 112 functions as an image transmission unit 113, an information transmission unit 114, an image reception unit 115, and an information reception unit 116. The communication method can be, for example, mobile communication such as 4G or 5G, wireless communication such as Wi-Fi, or network communication such as peer-to-peer.

[0026] The image transmission unit 113 transmits the image data generated by the imaging unit 101 and processed by the image processing unit 102 to other user terminals.

[0027] The information transmission unit 114 transmits the image data capture information to other user terminals. The capture information includes, for example, the shooting position and shooting direction calculated from the tilt information of the user terminal 100 detected by the posture detection unit 110 and the information indicating the current position of the user terminal 100 detected by the position detection unit 111 at the time of shooting. The capture information also includes, for example, the image resolution (4K or 2K) information related to the resizing process in the image processing unit 102, information indicating the operating status such as recording or standby, and information indicating error status such as recording not possible. Furthermore, the capture information includes, for example, information indicating that an image from another user terminal is being displayed, the number of other user terminals that are displaying the image from user terminal 100, and subject information such as a specific person recognized by user terminal 100.

[0028] The image receiving unit 115 receives image data transmitted from other user terminals. The system control unit 117 switches the image data output from the image processing unit 102 to the image data received by the image receiving unit 115 in accordance with the operation instructions notified from the operation unit 109. The information receiving unit 116 receives shooting information transmitted from other user terminals.

[0029] The system control unit 117 controls all components of the user terminal 100. The system control unit 117 includes an arithmetic processing unit consisting of at least one processor or circuit, non-volatile memory such as ROM, volatile memory such as RAM, etc. The system control unit 117 controls each component of the user terminal 100 by reading and executing a program stored in ROM. The program includes a program for executing the flowchart described later in Figures 5 and 6. The system control unit 117 collects the image data capture information and other data mentioned above and outputs it to the information transmission unit 114.

[0030] Furthermore, the system control unit 117, based on the image capture information of other user terminals received by the information receiving unit 116, renders guides or indices representing the image capture direction and shooting status of the other user terminals using the OSD drawing unit 104. After rendering, the OSD drawing unit 104 outputs the data as OSD data to the image output unit 105. The image output unit 105 superimposes the indicators drawn by the OSD drawing unit 104 with the image data processed by the image processing unit 102 to generate an image signal for display, and outputs it to the display unit 106.

[0031] Furthermore, when the display position of the indicator showing the imaging direction and shooting status of another user terminal, which is displayed on the display unit 106, is touched, the system control unit 117 is notified that a touch operation has been detected by the touch detection unit 107. When the system control unit 117 is notified by the touch detection unit 107 that the display position of the indicator showing the shooting position and imaging direction of another user terminal has been touched, it stops the output of image data from the image processing unit 102 to the image output unit 105 and controls the image receiving unit 115 to output image data to the image output unit 105.

[0032] Figure 2(a) illustrates a system configuration in which multiple user terminals are connected to communicate using a first communication method, and the same subject can be photographed simultaneously by multiple user terminals.

[0033] In the following, the multiple user terminals 100a, 100b, 100c, and 100d will be described as the first to fourth cameras capable of simultaneously photographing the same subject.

[0034] The first camera 100a is directly connected to the second camera 100b, the third camera 100c, and the fourth camera 100d via the first communication method, enabling bidirectional communication with the second to fourth cameras 100b to 100d. Similarly, the second camera 100b, the third camera 100c, and the fourth camera 100d are directly connected to the other cameras via the first communication method, enabling bidirectional communication with the other cameras. The first communication method is, for example, a method of connecting as a client to an access point formed by a user terminal (WiFi Direct).

[0035] Figure 2(b) shows an example of a system configuration in which multiple user terminals are connected to communicate using a second communication method, and the same subject can be photographed simultaneously by multiple user terminals.

[0036] The first camera 100a, the second camera 100b, the third camera 100c, and the fourth camera 100d are connected to each other via a predetermined network 200, enabling bidirectional communication. The predetermined network 200 is, for example, mobile communication such as 4G or 5G, wireless communication such as Wi-Fi, or peer-to-peer network communication.

[0037] Figure 3 illustrates an example in this embodiment where multiple user terminals are connected to each other for communication and simultaneously capture the same subject. The first camera 100a, the second camera 100b, the third camera 100c, and the fourth camera 100d surround the subject 300, and each user terminal simultaneously captures the same subject. The images captured by the first to fourth cameras 100a to 100d can be transmitted to other cameras that are connected for communication. Whether the same subject has been captured can be determined by performing pattern matching or subject recognition processing on the subject in the images captured by each of the first to fourth cameras 100a to 100d and checking if the subjects match. Alternatively, AI-based video analysis processing may be performed to determine whether the subjects match. Alternatively, the imaging range of each of the second to fourth cameras 100b to 100d may be determined from their respective shooting positions and shooting directions, and it may be determined that the same subject is being photographed if this range overlaps with the imaging range determined from the shooting position and shooting direction of the first camera 100a.

[0038] Figures 4(a) to 4(g) show examples of the screen display unit 106 of the first camera 100a in the shooting state shown in Figure 3.

[0039] In the screen 400 of Figure 4(a), second to fourth guides 400b to 400d are displayed superimposed on the live view image captured by the first camera 100a around the subject 300, indicating the shooting positions and shooting directions of the second camera 100b, third camera 100c, and fourth camera 100d, respectively. In this embodiment, the first guide 400b is a display of an arrow (vector) representing the shooting position and shooting direction of the second camera 100b. The second guide 400c is a display of an arrow (vector) representing the shooting position and shooting direction of the third camera 100c. The third guide 400d is a display of an arrow (vector) representing the shooting position and shooting direction of the fourth camera 100d. Information representing the shooting position and shooting direction of the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d.

[0040] On screen 401 in Figure 4(b), arrows corresponding to the second to fourth guides 401b to 401d, which indicate the shooting direction, are displayed in different forms around the subject 300, superimposed on the live view image captured by the first camera 100a, at locations corresponding to the shooting positions of the second to fourth cameras 100b to 100d. The arrow sizes of the second to fourth guides 401b to 401d differ from those of the second to fourth guides 400b to 400d in Figure 4(a). The arrow sizes of the second to third guides 401b to 401d are changed according to the resolution of the images captured by each camera, which are received from the second to fourth cameras 100b to 100d. Specifically, the arrow sizes of the second to fourth guides 401b to 401d are changed so that the larger the resolution of the image captured by each camera, the larger the arrow size. Information representing the resolution of images captured by the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d.

[0041] Furthermore, the size (length) of the second to fourth guides 401b to 401d may be displayed in a way that varies depending on the distance from the second to fourth cameras 100b to 100d to the subject (the further the distance from the second to fourth cameras 100b to 100d to the subject, the longer the guide).

[0042] In the screen 402 of Figure 4(c), arrows corresponding to the second to fourth guides 402b to 402d, which indicate the shooting direction, are displayed in a dark area (surround area) 403 formed around the live view image captured by the first camera 100a, at locations corresponding to the shooting positions of the second to fourth cameras 100b to 100d. This allows the user to confirm the shooting positions and shooting directions of the second to fourth cameras 100b to 100d while maintaining the visibility of the live view image. In this case, similar to the second to fourth guides 401b to 401d in Figure 4(b), the arrows (length and thickness) corresponding to the second to fourth guides 402b to 402d may be displayed in different forms to distinguish them according to the resolution of the image captured by each camera. Information representing the shooting position and shooting direction of the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d.

[0043] Furthermore, the display position of the second to fourth guides 402b to 402d may be set by user operation. In this case, the user can set whether to display the second to fourth guides 402b to 402d superimposed on the image or in the dark area.

[0044] In Figure 4(d), screen 404 shows arrows corresponding to the second to fourth guides 400b to 400d, which indicate the shooting direction and corresponding to the shooting positions of the second to fourth cameras 100b to 100d, superimposed on the live view image captured by the first camera 100a. These arrows are combined with partial images 404b to 404c of the second to fourth images captured by each camera. The information representing the shooting positions and shooting directions of the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d. The images captured by the second to fourth cameras 100b to 100d are received by the image receiving unit 115 of the first camera 100a from the second to fourth cameras 100b to 100d. In this case, similar to the second to fourth guides 401b to 401d in Figure 4(b), arrows corresponding to the second to fourth guides 400b to 400d may be displayed in different forms to allow identification according to the resolution of the images captured by each camera.

[0045] Images 404b to 404d (second to fourth images) may be either front-camera images taken towards the user (photographer) of each camera, or rear-camera images taken away from the user. Front-camera images make it easier for the photographer to identify each camera. Rear-camera images make it easier to check the images being captured by each camera.

[0046] In Figure 4(e), screen 405 displays arrows corresponding to the second to fourth guides 400b to 400d, which indicate the shooting direction, superimposed on the live view image captured by the first camera 100a around the subject 300, at locations corresponding to the shooting positions of the second to fourth cameras 100b to 100d. Furthermore, information 405a is displayed at the top of screen 405, indicating the number of other cameras among the second to fourth cameras 100b to 100d that are displaying the live view image captured by the first camera 100a. The information indicating that the second to fourth cameras 100b to 100d are displaying the live view image captured by the first camera 100a is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d.

[0047] Alternatively, instead of displaying information indicating the number of other cameras, information such as the field of view, the number of people in the image, or a specific person in the image may be displayed.

[0048] On screen 406 in Figure 4(f), arrows corresponding to the second to fourth guides 406b to 406d, which indicate the shooting direction, are displayed in different forms around the subject 300, superimposed on the live view image captured by the first camera 100a, at locations corresponding to the shooting positions of the second to fourth cameras 100b to 100d. The arrows of the second to fourth guides 406b to 406d are different in color from the arrows of the second to fourth guides 400b to 400d in Figure 4(a). The arrow colors of the second to fourth guides 406b to 406d are changed according to the operating status of each camera, as received from the second to fourth cameras 100b to 100d. Specifically, the display of the second to fourth guides 406b to 406d changes to a dark color if each camera is recording, an intermediate color between dark and light if it is in standby mode, and a light color if it is in an error state for any reason. Information indicating the operating status of the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d.

[0049] On screen 407 in Figure 4(g), a faint arrow indicating an error state is displayed around the subject 300, superimposed on the live view image captured by the first camera 100a, as a fourth guide 407d indicating the operating status of the fourth camera 100d. Dark and medium-colored arrows representing the second and third guides 406b to 406c of the second and third cameras 100b to 100c, which are not in an error state, are not displayed. Information indicating the operating status of the second to fourth cameras 100b to 100d is received by the information receiving unit 116 of the first camera 100a from the second to fourth cameras 100b to 100d. This allows the user of the first camera 100a to check which of the second to fourth cameras 100b to 100d is in an error state.

[0050] [Control Processing] Next, the control processing of the cameras constituting the system of this embodiment will be described with reference to Figures 5 and 6.

[0051] The following describes the operation procedure when the first camera 100a communicates with the second to fourth cameras 100b to 100d, based on the explanations in Figures 3 and 4, but the same operation is possible for any of the second to fourth cameras 100b to 100d.

[0052] The processes shown in Figures 5 and 6 are realized when the system control unit 117 of the camera 100 loads the program stored in the recording medium 108 into memory and executes it, thereby controlling each component of the first camera 100a.

[0053] First, we will explain the procedure for taking photos using Figure 5(a).

[0054] In S500, the system control unit 117 controls each component of the first camera 100a to acquire an image by performing imaging processing of the subject.

[0055] In S501, the system control unit 117 collects captured information from each component of the first camera 100a, and the information transmission unit 114 transmits the captured information to the second to fourth cameras 100b to 100d, and the process proceeds to S502.

[0056] In S502, the system control unit 117 determines the type and display format of the guide to be displayed based on the shooting information acquired from the second to fourth cameras 100b to 100d by the information receiving unit 116, performs the process of displaying the guide on the display unit 106, and proceeds to S503.

[0057] In S503, the system control unit 117 performs a process to switch the live view image displayed on the display unit 106 in response to the touch operation detected by the touch detection unit 107, and then terminates the process.

[0058] Next, we will explain the operation procedure for transmitting images and capture information using Figure 5(b).

[0059] In S504, the system control unit 117 transmits the current position of the first camera 100a (the position where the subject is being photographed), which was detected by the position detection unit 111, to the second to fourth cameras 100b to 100d via the information transmission unit 114, and then proceeds to S505.

[0060] In S505, the system control unit 117 determines the shooting direction based on the tilt information of the first camera 100a detected by the attitude detection unit 110, and transmits this information to the second to fourth cameras 100b to 100d via the information transmission unit 114, then proceeds to S506.

[0061] In S506, the system control unit 117 transmits the resolution information of the image used for resizing in the image processing unit 102 to the second to fourth cameras 100b to 100d via the information transmission unit 114, and then proceeds to S506.

[0062] In S507, the system control unit 117 controls the image data processed by the image processing unit 102 to be transmitted by the image transmission unit 113 to the second to fourth cameras 100b to 100d, and proceeds to S508.

[0063] In S508, the system control unit 117 transmits information indicating the operating status (recording or standby) to the second to fourth cameras 100b to 100d via the information transmission unit 114, and then proceeds to S509.

[0064] In S509, the system control unit 117 transmits information indicating an error state to the second to fourth cameras 100b to 100d via the information transmission unit 114, and then terminates the process.

[0065] Figure 6(a) illustrates the operation procedure when displaying shooting information.

[0066] In S510, the system control unit 117 determines whether or not it has received information from the information receiving unit 116 indicating the shooting position and shooting direction of the second to fourth cameras 100b to 100d. If the system control unit 117 determines that it has received the information, it proceeds to S511; if it determines that it has not received the information, it proceeds to S520.

[0067] In S511, the system control unit 117 determines the display position and orientation of the guide based on the information received by the information receiving unit 116 indicating the shooting position and shooting direction of the second to fourth cameras 100b to 100d, and proceeds to processing in S512. The system control unit 117 also determines whether each of the second to fourth cameras 100b to 100d is capturing an area that includes the same subject as the first camera 100a (whether it is possible to image that area). Then, for the cameras among the second to fourth cameras 100b to 100d that are capturing an area that includes the same subject (i.e., capable of image-capturing that area), the system control unit 117 determines the display position and orientation of the guide based on the information indicating its shooting position and shooting direction.

[0068] Furthermore, by controlling the image acquired in S500 to be displayed as a live view image, and by controlling the OSD drawing unit 104 using the display position and orientation of the guide determined in S511, the display shown in screen 400 of Figure 4(a) can be executed. Also, while screen 400 is displayed, the system control unit 117 may, in response to receiving a predetermined operation such as a tap operation on the live view image area, switch to the surround area display shown in screen 402 of Figure 4(c).

[0069] In S512, the system control unit 117 determines whether or not it has received resolution information for the images from the second to fourth cameras 100b to 100d via the information receiving unit 116. If the system control unit 117 determines that it has received the information, it proceeds to S513; if it determines that it has not received the information, it proceeds to S514.

[0070] In S513, the system control unit 117 determines the size of the guide according to the resolution information of the images from the second to fourth cameras 100b to 100d received by the information receiving unit 116, and proceeds to processing in S514. In addition, by controlling the image acquired in S500 to be displayed as a live view image, and by controlling the OSD drawing unit 104 using the display position and orientation of the guide determined in S511 and the size determined in S513, the display shown on screen 401 in Figure 4(b) can be executed.

[0071] In S514, the system control unit 117 determines whether or not it has received images from the second to fourth cameras 100b to 100d via the image receiving unit 115. If the system control unit 117 determines that images have been received, it proceeds to S515; if it determines that images have not been received, it proceeds to S516.

[0072] In S515, the system control unit 117 determines the image to be displayed simultaneously with the guide from the images of the second to fourth cameras 100b to 100d received by the image receiving unit 115, and proceeds to processing in S516. In addition, by controlling the image acquired in S500 to be displayed as a live view image, and by controlling the OSD drawing unit 104 using the display position and orientation of the guide determined in S511 and the image determined in S515, the display shown on screen 404 in Figure 4(d) can be executed.

[0073] In S516, the system control unit 117 determines whether or not it has received imaging information from the second to fourth cameras 100b to 100d via the information receiving unit 116. If the system control unit 117 determines that information has been received, it proceeds to S517; otherwise, it proceeds to S518.

[0074] In S517, the system control unit 117 determines the information to be displayed simultaneously with the guide based on the shooting information from the second to fourth cameras 100b to 100d received by the information receiving unit 116, and proceeds to processing in S519.

[0075] In S518, the system control unit 117 determines whether or not it has received information indicating the operating status of the second to fourth cameras 100b to 100d from the information receiving unit 116. If the system control unit 117 determines that it has received the information, it proceeds to S519; if it determines that it has not received the information, it proceeds to S520.

[0076] In S519, the system control unit 117 determines the color or brightness of the guide based on the information indicating the operating status of the second to fourth cameras 100b to 100d received by the information receiving unit 116, and proceeds to S520. In addition, the system controls the image acquired in S500 to be displayed as a live view image, and controls the OSD drawing unit 104 using the display position and orientation of the guide determined in S511 and the color or brightness of the guide determined in S519, thereby enabling the display shown on screen 406 in Figure 4(f).

[0077] In S520, the system control unit 117 determines whether or not it has received information indicating the error status of the second to fourth cameras 100b to 100d from the information receiving unit 116. If the system control unit 117 determines that it has received the information, it proceeds to S521; if it determines that it has not received the information, it proceeds to S523.

[0078] In S521, the system control unit 117 determines from the information indicating the error status received by the information receiving unit 116 whether or not the camera experiencing the error is located near the first camera 100a. If the system control unit 117 determines that the camera experiencing the error is located near the first camera 100a, it proceeds to S522; otherwise, it proceeds to S523.

[0079] In S522, the system control unit 117 determines the display position and orientation of the guide based on the error status, shooting position, and shooting direction information of the second to fourth cameras 100b to 100d received by the information receiving unit 116, and proceeds to processing in S523. In addition, the system controls the image acquired in S500 to be displayed as a live view image, and by controlling the OSD drawing unit 104 using the display position and orientation of the guide determined in S522, the display shown on screen 407 in Figure 4(g) can be executed.

[0080] In S523, the system control unit 117 controls the OSD drawing unit 104 to draw the guide based on the display position and orientation of the guide determined in S511, the size of the guide determined in S513, the image to be displayed simultaneously with the guide determined in S515, the shooting information to be displayed simultaneously with the guide determined in S517, and the display position and orientation of the guide determined in S522, and proceeds to S524.

[0081] In S524, the system control unit 117 determines whether it has received information from the information receiving unit 116 indicating whether the second to fourth cameras 100b to 100d are displaying an image from the first camera 100a. If the system control unit 117 determines that it has received information indicating whether the second to fourth cameras 100b to 100d are displaying an image from the first camera 100a, it proceeds to S525; otherwise, it terminates the process.

[0082] In S525, the system control unit 117 controls the OSD drawing unit 104 to draw an OSD showing the number of cameras 100b to 100d that are displaying the image of the first camera 100a, based on the information received by the information receiving unit 116 indicating whether the second to fourth cameras 100b to 100d are displaying the image of the first camera 100a, and then executes the display shown on screen 405 in Figure 4(e) to terminate this process.

[0083] Next, we will explain the operation procedure when switching live view images using Figure 6(b).

[0084] In S526, the system control unit 117 receives a notification from the touch detection unit 107 that a touch operation has been detected, and proceeds to S527.

[0085] In S527, the system control unit 117 determines whether the touch operation received in S526 is an operation on guides 400b to 400d shown in Figure 4(a). If the system control unit 117 determines that it is an operation on guides 400b to 400d, it proceeds to S528; otherwise, it proceeds to S530.

[0086] In S528, the system control unit 117 outputs an image from one of the second to fourth cameras 100b to 100d, received by the image receiving unit 115, corresponding to the guide that was touched in S527, to the image output unit 105, and then proceeds to S529.

[0087] In S529, the system control unit 117 transmits information via the information transmission unit 114 indicating that an image from one of the second to fourth cameras 100b to 100d corresponding to the guide touched in S527 is being displayed, and then proceeds to S530.

[0088] In S530, the system control unit 117 determines whether or not an operation to return to the image from the first camera 100a has been performed. If the system control unit 117 determines that an operation to return to the image has been performed, it proceeds to S531; if it determines that an operation to return to the image has not been performed, it terminates the process. An operation to return to the image can be, for example, pressing the cancel button or home button included in the operation unit 109, or touch operations such as flicking or tapping.

[0089] In S531, the system control unit 117 outputs the image processed by the image processing unit 102 to the image output unit 105, and then terminates the process.

[0090] As described above, according to this embodiment, when displaying images taken by other cameras on the local camera in the case of images of the same subject taken simultaneously by multiple cameras, the local camera displays selectable guides on the image indicating the shooting position and direction of the images taken by the other cameras. This allows the user to select and display an image with the desired shooting position and direction without having to repeatedly switch between images from other cameras.

[0091] [Other embodiments] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0092] The invention is not limited to this embodiment, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to make the scope of the invention public. [Explanation of symbols]

[0093] 100...User terminal (camera), 101...Imaging unit, 102...Image processing unit, 104...OSD drawing unit, 110...Attitude detection unit, 111...Position detection unit, 112...Communication unit

Claims

1. An imaging means for capturing images of a subject, A display control means for controlling the display of the image of the subject on the screen, An acquisition means for acquiring first information regarding the shooting position and shooting direction of another imaging device, A determination means for determining whether the area including the subject can be imaged by the other imaging device, A transmission means for transmitting the image of the subject captured by the imaging means to the other imaging device, The system includes a receiving means for receiving information indicating that the other imaging device is displaying the image of the subject transmitted by the transmitting means, The imaging device is characterized in that, when the other imaging device is capable of imaging a range including the subject, the display control means controls the display of an indicator indicating the shooting direction of the other imaging device at a location on the image of the subject corresponding to the shooting position of the other imaging device, based on the first information, and also controls the display of information that allows the user to understand that the other imaging device is displaying the image of the subject transmitted by the transmission means.

2. The receiving means receives an image captured by the imaging means of the other imaging device, The imaging device according to claim 1, wherein the determination means performs pattern matching processing or subject recognition processing on the image of the subject and the received image, and if a subject matching the subject is included, it determines that the range including the subject can be imaged by the other imaging device.

3. The imaging device according to claim 1, characterized in that the determination means determines, based on the first information, whether the range including the subject can be imaged by the other imaging device.

4. It further has a means for receiving predetermined operations, The imaging apparatus according to any one of claims 1 to 3, characterized in that the display control means controls the display of the indicator in an area surrounding the image of the subject in response to receiving the predetermined operation.

5. The system further includes a selection means for receiving an operation to select the aforementioned indicator, The imaging apparatus according to any one of claims 1 to 4, characterized in that the display control means controls the switching from the image of the subject to an image of another imaging device corresponding to the selected index and displays it on the screen.

6. An attitude detection means for detecting the tilt of the imaging device, It includes a position detection means for detecting the position of the imaging device, The imaging device according to any one of claims 1 to 5, characterized in that the transmitting means transmits the shooting position and shooting direction of the imaging device based on the tilt and position information to the other imaging device.

7. The imaging apparatus according to any one of claims 1 to 6, characterized in that the index is a vector representation indicating the shooting direction based on the first information.

8. The imaging device according to claim 7, characterized in that the size of the vector display varies depending on the distance from the other imaging device to the subject.

9. The acquisition means further acquires second information relating to the resolution of the image captured by the imaging means of the other imaging device, The imaging apparatus according to any one of claims 1 to 8, characterized in that the display control means controls the display to make the resolution identifiable and to display the indicator.

10. The acquisition means further acquires third information relating to the operating state of the other imaging device, The imaging apparatus according to any one of claims 1 to 9, characterized in that the display control means controls the display to make the operating state identifiable and to display the indicator.

11. The imaging device according to claim 10, characterized in that the aforementioned operating states include recording while an image is being recorded, standby while no image is being recorded, and an error state where no image can be recorded.

12. The imaging device according to claim 11, characterized in that the display control means controls to display only the indicator corresponding to the other imaging device that has entered the error state.

13. The device further includes a second receiving means for receiving a second image of the photographer captured by the other imaging device, The imaging apparatus according to any one of claims 1 to 12, characterized in that it controls the display of a second image on the image of the subject, together with the aforementioned indicator.

14. The device further includes a third receiving means for receiving a third image being captured by the other imaging device, The imaging apparatus according to any one of claims 1 to 12, characterized in that it controls the display of a part of the third image on the image of the subject, together with the index.

15. A control method performed by an imaging device, The steps of capturing an image of the subject, The steps include controlling the display of the image of the subject on the screen, A step of acquiring first information regarding the shooting position and shooting direction of another imaging device, A step of determining whether the area including the subject can be imaged by the other imaging device, The steps include transmitting the image of the subject to the other imaging device, The step includes receiving information indicating that the other imaging device is displaying the transmitted image of the subject, The control step is characterized by the following: when the other imaging device is capable of imaging a range including the subject, the control is performed to display an indicator indicating the shooting direction of the other imaging device at a location on the image of the subject that corresponds to the shooting position of the other imaging device, based on the first information, and to display information that allows the user to understand that the other imaging device is displaying the transmitted image of the subject.

16. A computer-readable program for causing a computer to execute the control method described in claim 15.

Images