Imaging system, display device, and computer program

Abstract

This system provides a shooting system that makes it easy to visually understand the shooting position and direction. [Solution] The shooting system includes a shooting means, a moving means for moving the shooting means, a position detection means for detecting the position of the shooting means as it changes due to the moving means, a direction detection means for detecting the shooting direction of the shooting means, a field of view detection means for detecting the field of view of the shooting means, and a display means for displaying the image being captured by the shooting means, the position detection result from the position detection means, the direction detection result from the direction detection means, and the field of view detection result from the field of view detection means.

Description

Technical Field

[0006] , , , , , , ,

[0005] ,

[0007] ,

[0001] The present invention relates to a photographing system, a display device, a computer program, and the like.

Background Art

[0002] As a technology that enables remote visits to animals and the like exhibited in zoos, aquariums, etc., a remote photographing system using an autonomous vehicle described in Patent Document 1 is known. In this system, an autonomous vehicle equipped with an imaging unit can be remotely operated by a user.

[0003] Further, this autonomous vehicle can move on a predetermined travel route set in advance, for example, to circle an animal exhibition area, according to an operation by a user. The imaging unit can start and end still image shooting and video shooting, and swing in the vertical and horizontal directions, according to a remote operation by a user.

[0004] Further, the user can perform these remote operations using a terminal device such as a smartphone, and at that time, the video of the imaging unit is displayed on the terminal device.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, in the configuration of Patent Document 1, the user cannot visually grasp the current position of the autonomous vehicle being operated by the user on a predetermined travel route and the direction in which the imaging unit is facing with respect to an observation range such as an animal exhibition area.

[0007] <00000�4>Therefore, one of the objectives of the present invention is to provide a shooting system that makes it easy to visually grasp the shooting position and shooting direction. [Means for solving the problem]

[0008] To achieve the above objective, the imaging system according to the present invention is Photography methods, A moving means for moving the aforementioned shooting means, A position detection means for detecting the position of the shooting means which changes as a moving means, Direction detection means for detecting the shooting direction of the aforementioned shooting means, An angle of view detection means for detecting the angle of view of the aforementioned shooting means, The system includes a display means that displays the image captured by the shooting means, the position detection result by the position detection means, the direction detection result by the direction detection means, and the field of view detection result by the field of view detection means. It is characterized by the following: [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a shooting system that makes it easy to visually understand the shooting position and shooting direction. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram showing an example configuration of the imaging system according to Embodiment 1. [Figure 2] This figure shows an example of a display screen according to Embodiment 1. [Figure 3] (A) and (B) are diagrams illustrating the change in field of view on the display screen according to Embodiment 1. [Figure 4] This figure shows an example of a display screen according to a modified example of Embodiment 1. [Figure 5] This figure shows an example configuration of the imaging system according to Embodiment 2. [Figure 6] (A) and (B) are diagrams illustrating examples of display screens according to Embodiment 2. [Figure 7](A) and (B) are diagrams for explaining an example of a display screen according to a modification of Embodiment 2. [Figure 8] It is a diagram showing a configuration example of a photographing system according to Embodiment 3. [Figure 9] It is a diagram showing an example of a display screen according to Embodiment 3. [Figure 10] It is a diagram showing an example of a display screen according to Embodiment 4. [Figure 11] (A) and (B) are diagrams showing an example of a method for displaying a tilt direction detection result.

Mode for Carrying Out the Invention

[0011] [[ID=XX]]Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments. In each figure, the same members or elements are given the same reference numerals, and redundant explanations are omitted or simplified.

[0012] <Embodiment 1> FIG. 1 is a diagram showing a configuration example of a photographing system IS according to the present embodiment. Note that some of the functional blocks shown in FIG. 1 are realized by causing a CPU or the like as a computer included in the imaging system and not shown to execute a computer program stored in a memory as a storage medium not shown.

[0013] However, some or all of them may be realized by hardware. As the hardware, a dedicated circuit (ASIC), a processor (reconfigurable processor, DSP), or the like can be used.

[0014] Also, each of the functional blocks shown in FIG. 1 does not have to be built in the same housing, and may be constituted by separate devices connected to each other via signal paths. Note that the above description regarding FIG. 1 also applies to FIGS. 5 and 8 in the same manner.

[0015] It should be noted that in the translation, for the sentence "Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments. In each figure, the same members or elements are given the same reference numerals, and redundant explanations are omitted or simplified.", since there is no specific tag in the original text for this part, I added a tag "[[ID=XX]]" for the purpose of translation integrity and to follow the format requirements. You can adjust it according to the actual situation.The imaging system IS includes a camera unit (camera device) CU having a holder (holding device) HA and an imaging device IA, and a transparent pipe (tubular member) TM into which the camera unit CU is inserted. The camera unit CU is movable within the transparent pipe. Note that not all of the pipe needs to be transparent. If the positions and directions where the camera unit can perform imaging are restricted in advance, it is sufficient if the restricted locations are transparent.

[0016] The imaging system IS further includes a drive device (moving device) DRA provided within the pipe TM, a server (server device, server means) SA, and a display (display device) DIA as display means for displaying the image captured by the imaging device IA. The imaging system IS further includes a sensor (detection device) DEA and a control device CA as control means.

[0017] The holder HA is configured to be able to hold the imaging device IA so that it can move within the pipe TM and be detachable, and functions as holding means.

[0018] The imaging device IA includes an imaging optical system and an imaging element for imaging the outside of the pipe TM, and functions as imaging means. The imaging device IA may be composed of a camera body as an imaging device housing and a lens that is detachable from the camera body, or may have a configuration in which the camera body and the lens are integrated.

[0019] The drive device DRA is configured to be able to move the camera unit CU within the pipe TM and rotate the camera unit CU around the moving direction within the pipe TM as a rotation axis.

[0020] That is, the camera unit CU moves within the pipe TM along its shape (predetermined path) by the drive device DRA. Here, the drive device DRA functions as moving means for moving the imaging means, the moving means moves the imaging means along a predetermined path, and the display means displays the predetermined path.

[0021] Server SA is capable of receiving images captured by imaging device IA, and can receive signals from operating devices OA, such as controllers located near the display DIA of smartphones or tablets, and transmit these signals to imaging device IA and drive device DRA.

[0022] With this configuration, for example, a user of the IS imaging system, whether at a zoo or at home, can operate the imaging device IA and drive unit DRA via the control device OA, allowing the user to photograph animals or other subjects under their desired conditions. The imaging device IA and drive unit DRA and the server SA may be connected via a wired or wireless connection.

[0023] When the imaging device IA and the server SA are connected wirelessly, the imaging device IA may be equipped with a communication control component (communication chip) for communicating with the server SA. Alternatively, the communication control component may be provided inside the holder HA, and this communication control component and the imaging device IA may be connected via a wired connection inside the holder HA.

[0024] Battery BA is a power supply device that provides power to the drive unit DRA and other components. In this embodiment, the imaging device IA is powered by an internal power supply, but the imaging device IA is also configured to receive power from battery BA.

[0025] Sensor DEA is connected to the imaging device IA and the drive unit DRA, and is configured to detect the position, shooting direction, and field of view of the imaging device IA within the pipe TM. Here, sensor DEA functions as a position detection means to detect the position of the imaging device which changes with the movement means, a direction detection means to detect the shooting direction of the imaging device, and a field of view detection means to detect the field of view of the imaging device.

[0026] In this embodiment, the sensor DEA combines the functions of position detection, direction detection, and field of view detection, but it is sufficient for the shooting system IS to have these position detection, direction detection, and field of view detection functions.

[0027] Therefore, for example, the imaging device IA may have a field of view detection function, and the sensor DEA may have a position detection function and a direction detection function based on the drive information of the drive device DRA. Furthermore, the sensor DEA may include a GPS sensor.

[0028] Furthermore, the control unit CA has a built-in CPU and other components, functioning as a control means to control the operation of each part of the imaging system IS based on computer programs stored in the memory, which serves as the storage medium. Furthermore, the control unit CA may be integrated with the server SA, or they may be separate units. In addition, the control unit CA and server SA may be installed in a physically relatively close range to the other components of the imaging system IS (for example, within a facility such as a zoo), or in a relatively distant range (domestic or international).

[0029] Next, the information displayed on the display DIA in this embodiment will be described. Figure 2 is a diagram showing an example of a display screen according to Embodiment 1, and shows an example of the display screen DS of the display DIA.

[0030] The display screen DS shows the image being captured by the imaging device IA, specifically the cheetah (the main subject MS) and the grass (the background image BG). The image in this context is, for example, a live view image (video). The display screen DS also shows the header HP, zoom range ZR, operation buttons OB, reference information TI, and map MI.

[0031] The header of the website displays the name of the zoo as the shooting location and the name of the main subject as the cheetah view. In addition to this information, the header may also display information such as the shooting date and the remaining time available for shooting (operating and experiencing this system).

[0032] The zoom range ZR is an image that visually indicates the zoomable range and current zoom position of the imaging device IA. More specifically, the zoom range ZR has a mark ZR1 that signifies the telephoto end, a mark ZR2 that signifies the wide-angle end, a bar ZR3 that indicates the zoomable range, and a bar ZR4 that is superimposed on bar ZR3 and indicates the current zoom position.

[0033] In other words, the display means of this embodiment can display an image showing the zoom range and current zoom position of the shooting means.

[0034] The operation button OB has multiple buttons for sending operation instructions to the imaging device IA. More specifically, the operation button OB has a shutter button OB1, a zoom button OB2 for the telephoto side, and a zoom button OB3 for the wide-angle side. In other words, the display means can display various operation buttons for operating the shooting means.

[0035] If the display DIA is a touch-enabled display, touching each of the buttons OB1 to OB3 will send the corresponding instruction to the imaging device IA.

[0036] If the display DIA is a display without touch functionality, the controller OA (operating device) may have multiple physical buttons corresponding to buttons OB1 to OB3. When a user presses one of these physical buttons, the button corresponding to the pressed physical button among buttons OB1 to OB3 may be highlighted.

[0037] Reference Information TI displays information that assists in photography. Specifically, the display means displays information that assists in photography by the photography means and information about the main subject. In this embodiment, the word "Hint" indicating that it is information that assists in photography, an exclamation mark to attract attention, and the words "When the animal starts moving, it's a photo opportunity!!" which are specific assistive information are displayed. In other words, the information that assists in photography by the photography means includes information indicating the timing of the shot.

[0038] Reference Information TI may not only contain information that assists in photography, but may also display information about the main subject, such as the name and ecology of the organism, if the main subject MS is a living organism. In other words, information about the main subject includes information about the organism's ecology.

[0039] Furthermore, both information that assists in photography and information about the main subject may be displayed. Information about the main subject may be displayed not only as a simple statement, but also in a quiz format (question format).

[0040] Map MI displays information such as the movement path and current position of the imaging device IA, the shooting direction, and the field of view. More specifically, Map MI includes MI1, which is an image showing the movement path (predetermined path) of the imaging device IA; Mark MI2, which indicates the start position of the movement path MI1; and Mark MI3, which indicates the end position.

[0041] Map MI further includes a mark MI4 indicating the current position of the imaging device IA, a mark MI5 indicating the imaging direction and field of view of the imaging device IA, and an image MI7 indicating other areas. The movement path MI1 of the imaging device IA is the same as the installation path of the pipe TM.

[0042] When a user participates in a shooting experience tour using the IS shooting system, Mark MI2 corresponds to the initial position of the camera unit CU in that experience tour. The user sends instructions to the drive unit DRA using the control device OA.

[0043] Based on this instruction, the control unit CA controls the drive unit DRA to move the camera unit CU within the pipe TM. In addition, the control unit CA controls the display DIA so that marks MI4 and MI5 also move on the map MI in accordance with the movement of the camera unit CU.

[0044] The camera unit CU's position detection may be performed by the sensor DEA, or it may be performed by the drive unit DRA itself or the control device CA calculating the camera unit CU's position from information such as the drive amount of the drive unit DRA.

[0045] The user stops moving the camera unit CU and prepares to take a picture, sending an instruction to the imaging device IA using the control device OA to adjust the field of view of the imaging device IA. Based on this instruction, the control device CA controls the imaging device IA to adjust the field of view, and the control device CA controls the display DIA so that the mark MI5 also changes in accordance with the adjustment of the field of view.

[0046] Figures 3(A) and 3(B) illustrate how the field of view changes in the display screen according to Embodiment 1. As shown in Figures 3(A) and 3(B), the field of view is adjusted and displayed as, for example, an isosceles triangle. Furthermore, the control device CA controls the display DIA so that the length of the base of mark MI5 changes.

[0047] Figure 3(A) shows an example of the mark MI5 in the telephoto end state, and Figure 3(B) shows an example of the mark MI5 in the wide-angle end state. In this embodiment, the display means displays marks indicating the direction detection result and the field of view detection result. Furthermore, the display means displays the marks so that their orientation changes according to the direction detection result.

[0048] The shape change of the mark MI5 may be a change while maintaining its area, that is, both the height and base may change, or the height may remain fixed while only the base changes. In other words, the display means may display the mark while maintaining its area, such that the length of some sides or arcs changes according to the field of view detection result. The Mark MI5 is not limited to a triangle; it can also be a sector or other shape.

[0049] If the mark MI5 is sector-shaped, the bisector of the sector indicates the shooting direction, and the arc length corresponds to the size of the field of view. Thus, the marks used to indicate the direction detection result and the field of view detection result have a triangular or sector shape. Furthermore, the display means displays the mark such that the length of a part of its side or arc changes according to the field of view detection result.

[0050] The detection of the shooting direction of the camera unit CU (imaging device IA) may be performed by the sensor DEA, or it may be performed by the control device CA calculating the shooting direction of the camera unit CU from information such as the drive amount of the drive device DRA and the shape of the pipe TM.

[0051] The shooting direction refers to the direction in which the imaging device IA (more specifically, the lens) is facing, i.e., the optical axis direction. However, it is also possible to detect directions other than the optical axis direction. For example, it is possible to detect the amount of tilt (the direction of movement of the camera unit CU, i.e., rotation with the extension direction of the pipe TM as the axis of rotation) and to detect the tilt direction in which the camera unit CU is facing within the tilt drive range.

[0052] Furthermore, while the camera unit CU of this embodiment is tiltable, it may also be capable of panning (rotation around a rotation axis perpendicular to the optical axis and the direction of movement of the camera unit CU). The amount of panning can also be detected, and the panning direction that the camera unit CU is facing within the panning range can be detected.

[0053] Similarly, the system may also be capable of roll driving (rotation with the optical axis as the axis of rotation). Furthermore, the amount of roll drive may be detected, allowing the camera unit CU to detect the roll direction it is facing within the roll drive range.

[0054] The angle of view of the camera unit CU (imaging device IA) may be detected by the sensor DEA, or, for example, the imaging device IA may transmit information about its current angle of view to the control device CA, and the control device CA may detect the angle of view based on that information.

[0055] The user may be notified via voice or text, etc., that the above-mentioned experience tour will end when the mark MI4, which indicates the position of imaging device IA, overlaps with the mark MI3.

[0056] As described above, the imaging system IS of this embodiment has a display DIA which is a display means for displaying the image being captured by the imaging device IA and the position detection result, direction detection result, and field of view detection result of the camera unit CU (imaging device IA). Therefore, the shooting position and shooting direction can be visually grasped more easily than in conventional systems.

[0057] In Figures 2 and 3(A)(B), the height of the mark MI5 indicates the shooting direction of the imaging device IA. In other words, in this embodiment, the mark MI5 indicates both the shooting direction of the imaging device IA and the field of view of the imaging device IA.

[0058] Figure 4 shows an example of a display screen according to a modified embodiment of Embodiment 1. As shown in the modified embodiment of Figure 4, a linear mark MI6, which is an arrow indicating the shooting direction of the imaging device IA, may be displayed separately from the mark MI5. The shape of the mark MI6 may be an arrow or a straight line (solid line, dashed line, etc.). In other words, the display means may display a linear mark indicating the direction detection result.

[0059] <Embodiment 2> Figure 5 shows an example configuration of the imaging system IS according to Embodiment 2. The difference between Embodiment 1 and this embodiment is that, in addition to the first imaging device (first imaging means) IA1 included in the camera unit CU inside the pipe TM, there is a second imaging device (second imaging means) IA2.

[0060] In other words, Embodiment 2 further includes a first shooting means as a shooting means, and a second shooting means provided at a different position from the first shooting means and capable of shooting a wider area than the first shooting means. Furthermore, the display means displays information regarding the position of the main subject based on the image obtained by the second shooting means.

[0061] The imaging device IA2 has a wider field of view than the imaging device IA1 and is a surveillance camera for monitoring a predetermined range. More specifically, when the pipe TM is arranged to form a closed space as shown in Figure 2, the imaging device IA2 is configured to capture almost the entire area (for example, 70% or more) within the closed space.

[0062] Furthermore, there is no need to be only one imaging device IA2; the entire enclosed space can be captured by summing the imaging ranges of multiple imaging devices IA2. If the pipe TM is, for example, a single straight pipe, one or more imaging devices IA2 can each capture a necessary and sufficient range (preferably with some overlap) along the length of the pipe TM.

[0063] In this embodiment, the imaging device IA2 is a surveillance camera that captures the entire habitat (exhibition area) of the animal, which is the main subject MS, and is installed at a position higher than the ground surface by a member such as a cylinder. That is, the imaging device IA2 has a wider field of view than the imaging device IA1 and is capable of capturing the range in which the main subject may move. In other words, the imaging device IA2 can capture the same main subject even if the main subject is not within the shooting range of the imaging device IA1.

[0064] Figures 6(A) and 6(B) are diagrams illustrating an example of a display screen according to Embodiment 2, and show an example of a map MI in Embodiment 2. In this embodiment, the main subject is detected by image recognition of an image captured by the imaging device IA2, and the position information of the main subject MS (animal, etc.) can be obtained. Therefore, as shown in Figure 6(A), a mark MI8 indicating the area where the main subject MS is presumed to be located is displayed on the map MI. That is, the display means displays the range where the main subject is presumed to be located as information regarding the position of the main subject.

[0065] This allows the user to move the camera unit CU towards the mark MI8 and capture the main subject MS with the imaging device IA1 more easily than in Embodiment 1.

[0066] In Figure 6(B), multiple marks MI81, MI82, and MI83, which indicate the area where the main subject MS is presumed to be located, are displayed on the map MI. That is, the display means displays a first range and a second range as the area where the main subject is presumed to be located.

[0067] It is possible that multiple animals may inhabit the observation area as the primary subject of microscopy (MS), or that a single animal may move between multiple habitats. In such cases, as shown in Figure 6(B), multiple markers may be displayed to indicate the area where the primary subject MS is presumed to be located.

[0068] Furthermore, information indicating the probability that the main subject MS is present may also be displayed inside each mark MI81, MI82, and MI83 (for example, the text "15%", "20%", and "50%" in Figure 6(B)).

[0069] In other words, the display means may display information regarding the probability that the main subject is located within the area where the main subject is presumed to be located. As shown in Figure 6(B), the intensity (transparency) of the colors of each mark MI81, MI82, and MI83 may be changed in accordance with the above probabilities.

[0070] Furthermore, the trajectory MI84, which shows the movement path of a specific main subject MS (a specific individual, animal, etc.), may also be displayed. In this way, users can experience the enjoyment of photographing the main subject MS along the entire predetermined movement path MI1. Also, for example, for users who want to photograph a specific main subject MS, the trajectory MI84 of that individual increases the likelihood of being able to photograph that individual, and they can also experience the enjoyment of photography.

[0071] Figures 7(A) and 7(B) illustrate an example of a display screen according to a modified embodiment of the second embodiment. As shown in Figure 7, instead of the marks indicating the area where the main subject MS is presumed to be located, marks MI91, MI92, and MI93 indicating the current position information of the main subject MS may be displayed.

[0072] In other words, the display means may display the location of the main subject as information regarding the position of the main subject, and may display a first position mark indicating the location of a first main subject and a second position mark indicating the location of a second main subject.

[0073] When multiple markers are displayed to indicate the current location of the main subject MS, it is acceptable to display only the marker corresponding to the type of individual. Marks MI91, MI92, and MI93 have commonalities (as seen in Figures 7(A) and (B), they are all the same species, lions) while also showing individual differences (as seen in Figures 7(A) and (B), differences in the appearance of their heads).

[0074] If a user has photographed an individual whose location information is indicated by Mark MI92 and another individual whose location information is indicated by Mark MI93, the shapes of Mark MI92 and Mark MI93 may be changed to indicate that they have been photographed, as shown in Figure 7(B).

[0075] In other words, when the first main subject is photographed by the photographic means, the display means may display a first completion mark instead of a first position mark. In other words, the information that assists the photographic means in taking photographs may include information about main subjects that the photographic means can photograph but have not yet photographed.

[0076] By displaying these changes, users can more easily visually identify the individual whose location information is indicated by Mark MI91 as the individual that has not yet been photographed. Furthermore, in conjunction with the shape changes of Mark MI92 and Mark MI93 shown in Figure 7(B), text such as "Only one lion left to be photographed!!" is displayed in the reference information TI.

[0077] Therefore, by incorporating game-like and mission-based elements into the experiential tours using this shooting system, the enjoyment of taking photos can be further enhanced.

[0078] Alternatively, the system could be designed to allow users to identify a desired individual before starting a hands-on tour with the system. For example, if the identified individual is the one whose location is indicated by the mark MI91 in Figure 7(A), the mark MI91 could be highlighted with a different size, color, etc., than the marks MI92 and MI93. Such features can further enhance the enjoyment of photography.

[0079] Furthermore, instead of detecting the main subjects by image recognition of images captured by the imaging device IA2 as a means of acquiring the positional information of multiple main subjects MS, GPS markers or the like may be used.

[0080] Alternatively, the image captured by the imaging device IA2 may be used for image recognition to obtain positional information of multiple primary subjects MS, and the imaging device IA1 may be automatically moved so that it can capture the primary subject MS that is closest to its current position. Alternatively, the field of view of the imaging device IA1 may be automatically changed so that it can capture the primary subject MS that is closest to its current position.

[0081] <Embodiment 3> Figure 8 shows an example of the configuration of the imaging system according to Embodiment 3. The difference between Embodiment 2 and Embodiment 3 is that Embodiment 3 includes multiple camera units CU1 and CU2. Multiple holders HA1 and HA2 each have the same configuration, and multiple imaging devices IA1 and IA3 each have the same configuration.

[0082] In other words, Embodiment 3 further comprises a first shooting means and a second shooting means as shooting means, and a moving means moves the first shooting means and the second shooting means. Furthermore, a display means displays at least one of the first captured image captured by the first shooting means and the second captured image captured by the second shooting means.

[0083] Furthermore, the first position detection result of the first shooting means by the position detection means and the second position detection result of the second shooting means by the position detection means are displayed. Furthermore, the first direction detection result of the first shooting means by the direction detection means and the second direction detection result of the second shooting means by the direction detection means are displayed. Furthermore, the first field of view detection result of the first shooting means by the field of view detection means and the second field of view detection result of the second shooting means by the field of view detection means are displayed.

[0084] Figure 9 shows an example of a display screen according to Embodiment 3, illustrating an example of Map MI in Embodiment 3. In this embodiment, since there are multiple camera units CU1 and CU2, the Map MI also displays a mark MI41 indicating the position of camera unit CU1 and a mark MI42 indicating the position of camera unit CU2.

[0085] Furthermore, marks MI51 (MI61) indicating the shooting direction and field of view of camera unit CU1, and marks MI52 (MI62) indicating the shooting direction and field of view of camera unit CU2 are displayed. Other displays are the same as in the example shown in Figure 7(A).

[0086] Thus, in this embodiment, the moving means moves the first and second shooting means along a predetermined path, and the display means displays the predetermined path, so that the desired individual can be photographed without moving the camera unit a great distance. That is, for example, if the user wants to photograph an individual whose location information is indicated by the mark MI93, then the image currently being captured by the camera unit CU1 is displayed on the display DIA.

[0087] If the camera unit consists only of CU1, it would be necessary to move camera unit CU1 from the position indicated by Mark MI41 in Figure 9 to the position where Mark MI93 can be photographed, which would take extra time.

[0088] However, in this embodiment, by switching between camera unit CU1 and camera unit CU2, it is possible to switch which camera unit's image is displayed on the display DIA. That is, the display means can transition from a state in which the first captured image is displayed to a state in which the second captured image is displayed.

[0089] Therefore, if a user wants to photograph an individual whose location is indicated by Mark MI93, they should not move camera unit CU1, but rather switch to camera unit CU2, which is already at the location indicated by Mark MI42.

[0090] As shown in Figure 9, camera unit CU2 is already near the individual whose location information is indicated by mark MI93, so the user can quickly photograph the desired individual simply by switching from camera unit CU1 to camera unit CU2. This kind of functionality further enhances the enjoyment of photography.

[0091] <Embodiment 4> Figure 10 shows an example of a display screen according to Embodiment 4, and shows an example of the display screen DS in Embodiment 4. The configuration of the shooting system IS in this embodiment is the same as the configuration in Embodiment 2. Note that in Figure 10, the header HP, zoom range ZR, and operation button OB can be the same as in the display in Embodiment 2, so they are omitted for the sake of simplicity in the explanation.

[0092] In the state shown in Figure 10, the camera unit CU is unable to capture the main subject MS, and only the background image BG is visible. In this state where the main subject MS is not visible, the imaging device IA2 searches for the main subject MS closest to the current position of the camera unit CU, and displays that main subject MS on the map MI.

[0093] In Figure 10, the individual whose location information is indicated by the mark MI94 corresponds to this. Furthermore, an auxiliary arrow GA is displayed on the display screen DS so that it is visually clear which direction to move the camera unit CU to capture the individual whose location information is indicated by the mark MI94 within the shooting range.

[0094] A similar arrow is displayed on the map MI as an auxiliary arrow MI10. That is, it displays information indicating the direction in which the main subject is located. Furthermore, the reference information TI displays text information prompting the camera unit CU to move and information regarding the direction of movement (in Figure 10, this corresponds to the text "There's an animal in the direction of the arrow!!").

[0095] These features allow users to photograph their main subject, MS, with fewer operations, enabling them to experience the joy of photography in a shorter amount of time.

[0096] Furthermore, if widening the field of view without moving the camera unit CU allows for capturing the individual whose location information is indicated by Mark MI94, text information prompting the user to adjust the field of view to the wide-angle side may be displayed in the reference information TI.

[0097] [Other embodiments] In the embodiments described above, the display DIA and the operating device OA are separate components, but they may be integrated. That is, the display device (display DIA) and the operating device OA may be integrated, as in a smartphone or tablet, and in that case, the display screen shown in each embodiment may be displayed on the smartphone or tablet.

[0098] Alternatively, these smartphones or tablets may be used as display devices (display DIAs) with touch functionality that allows for operation equivalent to that of the operating device OA, and the display screens shown in each embodiment may be displayed on the smartphones or tablets. In this case, the smartphones or tablets shall have communication means capable of communicating with the imaging device IA and sensor DEA, and software for displaying the display screens and operation screens shown in the above embodiments installed.

[0099] Specifically, the communication means of the display device communicates with a shooting means that is moved by a moving means, a position detection means that detects the position of the shooting means as it changes with the moving means, a direction detection means that detects the shooting direction of the shooting means, and a field of view detection means that detects the field of view of the shooting means. Furthermore, the above communication step is executed by a computer program for controlling the above display device by a computer.

[0100] The display device then displays the image captured by the shooting means, the position detection result from the position detection means, the direction detection result from the direction detection means, and the field of view detection result from the field of view detection means using the display means. Furthermore, the above display step is executed by the above computer program.

[0101] Furthermore, in the above embodiment, the camera unit's movement was enabled by moving through a closed space, such as a transparent pipe, to allow movement along a predetermined path. However, movement is not limited to within a pipe; it may also be enabled to move through an open space. That is, the camera unit may be made movable along a predetermined path, such as a road or rail.

[0102] Figures 11(A) and (B) show examples of how the tilt direction detection results are displayed. As shown in Figures 11(A) and (B), the tilt direction detection results may be displayed in addition to the field of view detection results and the shooting direction detection results in the approximately horizontal direction. Figure 11(A) shows an example of tilting towards the front of the page, and in addition to the mark MI5, the mark MI11 indicating the tilt direction is also displayed.

[0103] Furthermore, Mark MI5 also indicates a tilted state by displaying a portion of the triangular image with a white dashed line. Figure 11(B) shows an example of tilting in the depth direction of the paper, and the shape of Mark MI11 is different from that in Figure 11(A). The tilt direction detection result may be displayed as text information such as "up tilt" or "down tilt" instead of image information like Mark MI11.

[0104] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to the above embodiments, and various modifications and combinations of the above embodiments are possible in accordance with the spirit of the present invention, and these are not excluded from the scope of the present invention.

[0105] Furthermore, the present invention includes, for example, a system that realizes the functions of the above embodiment using at least one processor such as a CPU, memory, and circuitry (e.g., an ASIC). Alternatively, multiple processors may be used for distributed processing.

[0106] Furthermore, in order to realize some or all of the control in the above embodiment, a computer program that realizes the functions of the above embodiment may be supplied to the shooting system, etc., via a network or various storage media. The computer (or CPU, MPU, etc.) in the shooting system, etc., may then read and execute the program. In that case, the program and the storage medium storing the program constitute the present invention. Furthermore, the present invention includes the following combinations.

[0107] (Configuration 1) A shooting system characterized by comprising: a shooting means; a moving means for moving the shooting means; a position detection means for detecting the position of the shooting means as it changes due to the moving means; a direction detection means for detecting the shooting direction of the shooting means; a field of view detection means for detecting the field of view of the shooting means; and a display means for displaying the image being captured by the shooting means, the position detection result from the position detection means, the direction detection result from the direction detection means, and the field of view detection result from the field of view detection means.

[0108] (Configuration 2) The shooting system according to Configuration 1, characterized in that the moving means moves the shooting means along a predetermined path, and the display means displays the predetermined path.

[0109] (Configuration 3) The shooting system according to Configuration 1 or 2, characterized in that the display means displays marks indicating the direction detection result and the field of view detection result.

[0110] (Configuration 4) The shooting system according to Configuration 3, characterized in that the mark has a triangular or fan-shaped form.

[0111] (Configuration 5) The shooting system according to Configuration 4, characterized in that the display means displays the mark so that its orientation changes according to the direction detection result.

[0112] (Configuration 6) The shooting system according to Configuration 4 or 5, characterized in that the display means displays the mark such that the length of a part of the side or arc changes according to the field of view detection result.

[0113] (Configuration 7) The shooting system according to Configuration 6, characterized in that the display means displays the mark while maintaining its area, and the length of the side or arc changes according to the field of view detection result.

[0114] (Configuration 8) The shooting system according to any one of Configurations 1 to 7, characterized in that the display means displays a linear mark indicating the direction detection result.

[0115] (Configuration 9) A shooting system according to any one of Configurations 1 to 8, further comprising a first shooting means as the shooting means, and a second shooting means provided at a different position from the first shooting means and capable of shooting a wider area than the first shooting means, wherein the display means displays information regarding the position of the main subject based on the image obtained by the second shooting means.

[0116] (Configuration 10) The shooting system according to Configuration 9, characterized in that the display means displays, as information relating to the position of the main subject, an area in which the main subject is presumed to exist.

[0117] (Configuration 11) The shooting system according to Configuration 10, characterized in that the display means displays a first range and a second range as the range in which the main subject is presumed to exist.

[0118] (Configuration 12) The shooting system according to Configuration 10 or 11, characterized in that the display means displays information regarding the probability that the main subject is located within the range in which the main subject is presumed to be located.

[0119] (Configuration 13) The shooting system according to Configuration 9, characterized in that the display means displays the location where the main subject is located as information relating to the location of the main subject.

[0120] (Configuration 14) The shooting system according to Configuration 13, characterized in that the display means displays a first position mark indicating the location of a first main subject and a second position mark indicating the location of a second main subject.

[0121] (Configuration 15) The shooting system according to Configuration 14, characterized in that when the first main subject is photographed by the shooting means, the display means displays a first completion mark instead of the first position mark.

[0122] (Configuration 16) A shooting system according to any one of Configurations 1 to 15, further comprising a first shooting means and a second shooting means as the shooting means, the moving means moves the first shooting means and the second shooting means, and the display means displays at least one of the first captured image captured by the first shooting means and the second captured image captured by the second shooting means, the first position detection result of the first shooting means by the position detection means, the second position detection result of the second shooting means by the position detection means, the first direction detection result of the first shooting means by the direction detection means, the second direction detection result of the second shooting means by the direction detection means, the first field of view detection result of the first shooting means by the field of view detection means, and the second field of view detection result of the second shooting means by the field of view detection means.

[0123] (Configuration 17) The shooting system according to Configuration 16, characterized in that the moving means moves the first shooting means and the second shooting means along a predetermined path, and the display means displays the predetermined path.

[0124] (Configuration 18) The shooting system according to configuration 16 or 17, characterized in that the display means is capable of transitioning from a state in which the first captured image is displayed to a state in which the second captured image is displayed.

[0125] (Configuration 19) The shooting system according to any one of Configurations 1 to 18, characterized in that the display means displays an image indicating the zoom range and current zoom position of the shooting means.

[0126] (Configuration 20) The shooting system according to any one of Configurations 1 to 19, characterized in that the display means displays operation buttons for operating the shooting means.

[0127] (Configuration 21) The shooting system according to any one of Configurations 1 to 20, characterized in that the display means displays information that assists in shooting by the shooting means and information related to the main subject.

[0128] (Configuration 22) The shooting system according to Configuration 21, characterized in that the information assisting the shooting of the shooting means is information indicating the timing of the shooting or information indicating the direction in which the main subject is located.

[0129] (Configuration 23) The imaging system according to Configuration 21 or 22, characterized in that the information relating to the main subject is information relating to the ecology of the main subject.

[0130] (Configuration 24) The shooting system according to any one of Configurations 21 to 23, characterized in that the information assisting the shooting means in shooting is information relating to a main subject that the shooting means can photograph but has not yet photographed.

[0131] (Configuration 25) A display device comprising: a shooting means that moves by a moving means; a position detection means that detects the position of the shooting means that changes by the moving means; a direction detection means that detects the shooting direction of the shooting means; a communication means that can communicate with a field of view detection means that detects the field of view of the shooting means; and a display means that displays an image being captured by the shooting means, the position detection result from the position detection means, the direction detection result from the direction detection means, and the field of view detection result from the field of view detection means.

[0132] A computer program characterized by comprising: a shooting means that moves by a moving means; a position detection means that detects the position of the shooting means as it changes by the moving means; a direction detection means that detects the shooting direction of the shooting means; a field of view detection means that detects the field of view of the shooting means; and a display step that displays an image being captured by the shooting means, the position detection result from the position detection means, the direction detection result from the direction detection means, and the field of view detection result from the field of view detection means. [Explanation of Symbols]

[0133] IA: Imaging device (shooting means) TM: Pipe (tubular member) DRA: Drive system (means of transport) DEA: Sensor (position detection means, direction detection means, field of view detection means) DIA: Display (means of display) IS: Imaging System

Claims

1. Photography methods, A moving means for moving the aforementioned shooting means, A position detection means for detecting the position of the shooting means which changes as a moving means, Direction detection means for detecting the shooting direction of the aforementioned shooting means, An angle of view detection means for detecting the angle of view of the aforementioned shooting means, The system includes a display means that displays the image captured by the shooting means, the position detection result by the position detection means, the direction detection result by the direction detection means, and the field of view detection result by the field of view detection means. A photographic system characterized by the following features.

2. The moving means moves the photographing means along a predetermined path. The display means displays the predetermined route. The shooting system according to feature 1.

3. The display means displays marks indicating the direction detection result and the field of view detection result. The shooting system according to feature 1.

4. The aforementioned mark has a triangular or fan-shaped form. The imaging system according to feature 3.

5. The display means displays the mark so that its orientation changes according to the direction detection result. The shooting system described in feature 4.

6. The display means displays the mark such that the length of a part of the side or arc changes according to the field of view detection result. The shooting system described in feature 4.

7. The display means displays the mark while maintaining its area, such that the length of the side or arc changes according to the field of view detection result. The shooting system described in Feature 6.

8. The display means displays a linear mark indicating the direction detection result. The shooting system according to feature 1.

9. The first photographic means is the aforementioned photographic means, The system further comprises a second shooting means provided at a different location from the first shooting means and capable of shooting a wider area than the first shooting means, The display means displays information regarding the position of the main subject based on the image obtained by the second shooting means. The shooting system according to feature 1.

10. The display means displays, as information relating to the position of the main subject, the range in which the main subject is presumed to exist. The imaging system according to feature 9.

11. The display means displays a first range and a second range as the range in which the main subject is presumed to exist. The shooting system described in feature 10.

12. The display means displays information regarding the probability that the main subject is located within the range in which it is presumed to be located. The shooting system described in feature 10.

13. The display means displays the location where the main subject is located as information relating to the location of the main subject. The imaging system according to feature 9.

14. The display means displays a first position mark indicating the location of the first main subject and a second position mark indicating the location of the second main subject. The imaging system according to feature 13.

15. When the first main subject is photographed by the photographing means, the display means displays a first completion mark instead of the first position mark. The imaging system described in feature 14.

16. The aforementioned photographic means further comprises a first photographic means and a second photographic means, The moving means moves the first shooting means and the second shooting means, The aforementioned display means is At least one of the first captured image taken by the first shooting means and the second captured image taken by the second shooting means, The first position detection result of the first shooting means by the position detection means, and the second position detection result of the second shooting means by the position detection means, The first direction detection result of the first shooting means by the direction detection means, and the second direction detection result of the second shooting means by the direction detection means, The field of view detection means displays the first field of view detection result of the first shooting means and the second field of view detection result of the second shooting means. The shooting system according to feature 1.

17. The moving means moves the first shooting means and the second shooting means along a predetermined path. The display means displays the predetermined route. The imaging system described in Feature 16.

18. The display means is capable of transitioning from a state in which the first captured image is displayed to a state in which the second captured image is displayed. The imaging system described in Feature 16.

19. The display means displays an image showing the zoom range and current zoom position of the shooting means. The shooting system according to feature 1.

20. The display means displays operation buttons for operating the shooting means. The shooting system according to feature 1.

21. The display means displays information that assists the shooting of the shooting means, and information related to the main subject. The shooting system according to feature 1.

22. The information that assists the shooting of the aforementioned shooting means is information indicating the timing of the shooting or information indicating the direction in which the main subject is located. The imaging system according to feature 21.

23. The information relating to the main subject is information relating to the ecology of the main subject. The imaging system according to feature 21.

24. The information that assists the shooting means in taking photographs is information about a main subject that the shooting means can photograph but has not yet photographed. The imaging system according to feature 21.

25. A communication means capable of communicating with a shooting means that moves by a means of transport, a position detection means that detects the position of the shooting means as it changes by the means of transport, a direction detection means that detects the shooting direction of the shooting means, and a field of view detection means that detects the field of view of the shooting means. The system includes a display means that displays the image captured by the shooting means, the position detection result by the position detection means, the direction detection result by the direction detection means, and the field of view detection result by the field of view detection means. A display device characterized by the following features.

26. A communication step that communicates with a shooting means that moves by a means of transport, a position detection means that detects the position of the shooting means that changes as a result of the means of transport, a direction detection means that detects the shooting direction of the shooting means, and a field of view detection means that detects the field of view of the shooting means. The system includes a display step that displays the image captured by the shooting means, the position detection result by the position detection means, the direction detection result by the direction detection means, and the field of view detection result by the field of view detection means. A computer program characterized by the following features.

Images