Imaging device, imaging system, method, and program

Abstract

To provide an imaging apparatus that can be controlled in an imaging direction intended by a user even if auto-flip of a video image occurs when the imaging direction of the imaging apparatus is being changed on the basis of user operation.SOLUTION: The imaging apparatus is for imaging a subject. The imaging apparatus outputs a first output image and a second output image on the basis of a result of imaging of the subject. The imaging apparatus outputs the first output image and the second output image on the basis of the result of imaging of the subject by imaging means. The imaging apparatus outputs the first image of the subject captured by the imaging means as the first output image and the second image of the subject rotated from the first image as the second output image when the imaging direction satisfies a predetermined condition including being within a predetermined range.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging device, an imaging system, a method, and a program.

Background Art

[0002] A PTZ camera (hereinafter, referred to as an imaging device) capable of changing pan, tilt, and zoom is used at a video production site. An external control device (hereinafter, referred to as a controller) is connected to the imaging device by a cable. The user can remotely operate the PTZ of the imaging device by operating the stick of the controller. Thereby, the user can image a subject while changing the imaging direction of the imaging device. For example, the imaging device may be installed on the ceiling. Here, when the imaging device images a subject in a predetermined tilt direction away from the vertical direction, the subject in the imaged video appears in a state where it is rotated 180° (upside down). Therefore, the imaging device rotates the imaged video by 180° and outputs it. The above output processing performed by the imaging device is called an "auto flip function".

[0003] For example, when the user operates the stick of the controller downward, the imaging device tilts downward. Next, when the imaging device images from a predetermined tilt direction away from the vertical direction, the imaged video is rotated by 180° without changing the PT coordinate system. Then, although the user is operating the stick downward, the user recognizes that the imaging range in the video moves upward. That is, the direction in which the user operates the stick (downward) and the direction in which the imaging range in the video moves (upward) are opposite. Therefore, the user feels that it is difficult to control the imaging device in the imaging direction intended by the user.

[0004] In view of the above problems, Patent Document 1 prevents the imaging device from facing an imaging direction unintended by the user by rotating the video by 180° and inverting the PT coordinate system. Patent Document 2 notifies the user that the video has been rotated by using an intermediate video in which the rotation angle of the video is 0° or more and less than 180° when the video is rotated by 180°. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Patent No. 6165376 [Patent Document 2] Patent No. 5235910 [Overview of the project] [Problems that the invention aims to solve]

[0006] However, Patent Document 1 auto-flips the captured image when the imaging device has stopped changing the imaging direction, and controls the imaging device's PT (Photon Shift) so that it is in the same direction as the user's stick operation. In Patent Document 1, if the PT coordinate system is inverted when the imaging device's PT control is based on the user's stick operation, the imaging device PTs in the opposite direction to the stick operation, so the user cannot control the imaging device to the intended imaging direction. In Patent Document 2, the user can recognize the inversion of the image, but because the direction of stick operation and the direction in which the imaging range moves are opposite, the user finds it difficult to operate the stick.

[0007] Therefore, the present invention aims to provide an imaging device that can control the imaging direction to the user's intended direction even when an auto-flip of the image occurs while the imaging direction of the imaging device is being changed based on user operation. [Means for solving the problem]

[0008] To achieve the object of the present invention, an imaging device according to one embodiment of the present invention has the following configuration. That is, it comprises an imaging means for imaging a subject, and an output means for outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, wherein the output means outputs the first image obtained by the imaging means of the subject as the first output image, and the second image obtained by rotating the first image as the second output image, respectively, when predetermined conditions are met, including that the imaging direction of the imaging means is within a predetermined range. [Effects of the Invention]

[0009] According to the present invention, even if an auto-flip of the image occurs while the imaging direction of the imaging device is being changed based on user operation, it is possible to provide an imaging device that can be controlled to the imaging direction intended by the user. [Brief explanation of the drawing]

[0010] [Figure 1] A schematic diagram of the imaging system according to the first embodiment. [Figure 2] A diagram illustrating the imaging direction of the imaging device according to the first embodiment. [Figure 3] A block diagram illustrating the functions of the imaging device according to the first embodiment. [Figure 4] A diagram illustrating the auto-flip function performed by the imaging device. [Figure 5] A flowchart explaining the auto-flip function performed by the imaging device. [Figure 6] A diagram showing the auto-flip settings for video distribution according to the first embodiment. [Figure 7] A flowchart illustrating the OSD display process according to the first embodiment. [Figure 8] A flowchart illustrating the auto-flip according to the first embodiment. [Figure 9] A diagram showing the control communication sequence according to the first embodiment. [Figure 10] A diagram showing the packet structure used for control communication according to the first embodiment. [Figure 11] A diagram showing a command list used for control communication according to the first embodiment. [Figure 12] A diagram for explaining the hardware configuration of an imaging device according to the first embodiment.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0012] (First Embodiment) The imaging device captures a subject and outputs a first output image and a second output image based on the imaging result of the subject by the imaging means. When the imaging device satisfies a predetermined condition including that the imaging direction of the imaging means is within a predetermined range, the imaging device outputs the first image captured by the imaging means as the first output image and the second image obtained by rotating the first image as the second output image.

[0013] FIG. 1 is a schematic diagram of an imaging system according to the first embodiment.

[0014] The imaging system 10 is a system that captures a subject. The imaging system 10 includes an imaging device 100, a display device 200, a controller 300, a network 400, and an information processing device 500.

[0015] The imaging device 100 is a device that captures a subject, for example, a PTZ camera. The imaging device 100 includes a first output terminal 101, a second output terminal 102, a control communication terminal 103, and an I / F 104. <x

[0016] The first output terminal 101 and the second output terminal 102 are terminals for outputting the video imaged by the imaging device 100. The first output terminal 101 and the second output terminal 102 are terminals compliant with, for example, the SDI (Serial Digital Interface) and HDMI (registered trademark) standards. Also, the first output terminal 101 and the second output terminal 102 may be Ethernet (registered trademark) terminals that output video by packetizing the video with IP (Internet Protocol).

[0017] The control communication terminal 103 is a communication terminal that receives control signals and control commands from the controller 300 and transmits response signals to the controller 300. The control communication terminal 103 is, for example, a contact terminal that transmits High / Low signals. The control communication terminal 103 is a terminal compliant with a serial communication standard such as RS-232C or a communication standard of Ethernet (registered trademark).

[0018] I / F 104 is a terminal for communicating with the information processing device 500 via the network 400. I / F 104 is, for example, an Ethernet (registered trademark) terminal and a transmission / reception module for Wi-Fi (registered trademark).

[0019] The display device 200 is a device that displays video, and is, for example, a liquid crystal display and an organic EL display. The display device 200 displays the video from the imaging device 100 on the screen.

[0020] The controller 300 (corresponding to the reception means) is a device that controls the pan / tilt / zoom (PTZ) of the imaging device 100 based on the user's operation input. The controller 300 includes a stick 301 and control buttons 302.

[0021] Stick 301 is a device that controls the PTZ of the imaging device 100. When Stick 301 is tilted to the left, Controller 300 sends an instruction (control command) to pan to the left to the imaging device 100 via Control Communication Terminal 103. When Stick 301 is tilted upward, Controller 300 sends an instruction (control command) to tilt upward to the imaging device 100 via Control Communication Terminal 103. Controller 300 also sends the pan and tilt speeds corresponding to the tilt angle of Stick 301 simultaneously with the above control commands.

[0022] Furthermore, the user can change the zoom of the imaging device 100 by rotating the stick 301. For example, when the stick 301 is rotated clockwise, the controller 300 sends a zoom-in instruction (control command) to the imaging device 100. Conversely, when the stick 301 is rotated counterclockwise, the controller 300 sends a zoom-out instruction (control command) to the imaging device 100.

[0023] The control button 302 has buttons for registering the PTZ value of the imaging device 100 and for controlling the imaging device 100 based on the registered PTZ value. When the imaging device 100 receives an instruction to register a PTZ value, it stores a preset that associates the PTZ value with an identification number (e.g., 1, 2). When the user presses the control button 302, the controller 300 sends an instruction to the imaging device 100 to register the PTZ value or to drive based on the registered PTZ value.

[0024] For example, if the user long-presses the "button number 1" of control button 302, a control command is sent to the imaging device 100 to register the current PTZ value of the imaging device 100 as "preset number 1". If the user short-presses the "preset number 1" button of control button 302, a control command is sent to the imaging device 100 to drive based on the PTZ value already registered as "preset number 1". Note that control button 302 may also perform controls other than registering the PTZ value of the imaging device 100 and driving the imaging device 100 based on the registered PTZ value.

[0025] Network 400 includes, for example, multiple routers, switches, and cables that comply with communication standards such as Ethernet®. The imaging device 100 and the information processing device 500 are interconnected via Network 400. Network 400 may be the Internet, or a wired or wireless LAN (Local Area Network).

[0026] The information processing device 500 is, for example, a client device such as a personal computer (PC) equipped with a display unit (screen). The information processing device 500 displays video and UI (User Interface) from the imaging device 100 on its screen via the network 400. The information processing device 500 also transmits various control commands to the imaging device 100 based on user operations received via the UI.

[0027] Figure 2 is a diagram illustrating the imaging direction of the imaging device according to the first embodiment. Figure 2(a) is a top view of the imaging device when it is installed on the ground. Figure 2(b) is a left side view of the imaging device when it is installed on the ground. Figure 2(c) is a bottom view of the imaging device when it is installed on the ceiling. Figure 2(d) is a left side view of the imaging device when it is installed on the ceiling.

[0028] The imaging direction of the imaging device 100 is defined by the pan value, tilt value, and zoom value (i.e., PTZ value). Here, the pan value and tilt value are expressed in an upright coordinate system and an inverted coordinate system.

[0029] The upright coordinate system (first coordinate system) is the coordinate system used when the imaging device 100 is mounted on the ground or ceiling and pans or tilts clockwise, as shown in Figures 2(a) to (d). Ground mounting refers to, for example, mounting the imaging device 100 on a table or tripod. Ceiling mounting refers to, for example, mounting the imaging device 100 on the ceiling. The inverted coordinate system (second coordinate system) is the coordinate system used when the imaging device 100 is mounted on the ground or ceiling and pans or tilts counterclockwise, as shown in Figures 2(a) to (d). The imaging device 100 can dynamically switch between the upright and inverted coordinate systems. Switching coordinate systems refers to the control that matches the user's stick operation direction with the PT direction of the imaging device 100. An example of switching coordinate systems is matching the user's stick operation direction (downward) with the tilt direction (downward) of the imaging device 100.

[0030] In Figure 2(a), the pan value takes positive values ​​(angles) in the range of 0° to +180° clockwise when viewing the imaging device 100 from above. On the other hand, the pan value takes negative values ​​(angles) in the range of 0° to -180° counterclockwise when viewing the imaging device 100 from above. The pan direction 109 is the direction in which the imaging device 100 can be panned.

[0031] In Figure 2(b), the tilt value takes positive values ​​(angles) in the range of 0° to +220° clockwise when viewing the imaging device 100 from the left side (the view of the imaging device 100 from the -90° direction in Figure 2(a)). On the other hand, the tilt value takes negative values ​​(angles) in the range of 0° to -40° counterclockwise when viewing the imaging device 100 from the left side. The tilt direction 110 is the direction in which the imaging device 100 can be tilted.

[0032] In Figure 2(c), the pan value takes negative values ​​(angles) in the range of 0° to -180° clockwise when viewing the imaging device 100 from below. On the other hand, the pan value takes positive values ​​(angles) in the range of 0° to +180° counterclockwise when viewing the imaging device 100 from below. The pan direction 109 is the direction in which the imaging device 100 can be panned.

[0033] In Figure 2(d), the tilt value takes positive values ​​(angles) in the range of 0° to +40° clockwise when viewing the imaging device 100 from the left side (the view of the imaging device 100 from the +90° direction in Figure 2(c)). On the other hand, the tilt value takes negative values ​​(angles) in the range of 0° to -220° counterclockwise when viewing the imaging device 100 from the left side. The tilt direction 110 is the direction in which the imaging device 100 can be tilted.

[0034] The zoom value of the imaging device 100 is calculated from the focal length of the lens 105.

[0035] Figure 12 shows the hardware configuration of the imaging device according to the first embodiment.

[0036] The imaging device 100 includes a CPU 210, RAM 211, ROM 212, and storage unit 213.

[0037] The CPU 210 is a central processing unit that controls each part of the imaging device 100.

[0038] RAM211 is memory used to temporarily store computer programs executed by CPU210, and is a volatile memory such as SRAM and DRAM.

[0039] ROM212 is a memory that stores programs for the CPU210 to control various parts of the imaging device 100, and is, for example, a non-volatile memory such as EPROM.

[0040] The storage unit 213 is a device for storing programs and video data, and includes, for example, an HDD (Hard Disk Drive) and an SSD (Solid State Drive).

[0041] Figure 3 is a block diagram illustrating the functions of the imaging device according to the first embodiment. The functions of the imaging device 100 in Figure 3 (excluding the hardware configuration block) are realized by the CPU 210 executing the program in the ROM 212.

[0042] The imaging device 100 includes an image processing unit 112, a system control unit 113, a PTZ control unit 114, an output unit 116, a control communication unit 117, and a network communication unit 118. The imaging device 100 also has a hardware configuration consisting of a lens 105, a lens drive unit 106, a pan drive unit 107, a tilt drive unit 108, an imaging unit 111, and a storage unit 213.

[0043] The direction toward the subject on the optical axis of lens 105 is the imaging direction of the imaging device 100. The light beam that passes through lens 105 is imaged onto the image sensor of the imaging unit 111 of the imaging device 100.

[0044] The lens drive unit 106 consists of elements that drive the lens 105 and changes the focal length of the lens 105. The lens drive unit 106 is also controlled by the PTZ control unit 114.

[0045] The pan drive unit 107 consists of a mechanical drive unit (e.g., gears) and a drive source (e.g., a motor). The pan drive unit 107 drives the imaging direction of the imaging device 100 in the pan direction 109 shown in Figure 2(a) or Figure 2(c). The pan drive unit 107 is also controlled by the PTZ control unit 114.

[0046] The tilt drive unit 108 consists of a mechanical drive unit (e.g., gears) and a drive source (e.g., a motor). The tilt drive unit 108 drives the imaging direction of the imaging device 100 to the tilt direction 110 shown in Figure 2(b) or Figure 2(d). The tilt drive unit 108 is also controlled by the PTZ control unit 114.

[0047] The imaging unit 111 is equipped with an image sensor such as a CCD (charge coupled device) sensor and a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 generates an electrical signal by photoelectric conversion of the subject image formed through the lens 105.

[0048] The image processing unit 112 generates image data by performing image processing such as converting electrical signals from the imaging unit 111 into digital signals and compression encoding. The image processing unit 112 also performs a process to rotate the still images (hereinafter referred to as "images") constituting the video by 180° (i.e., auto-flip) based on instructions from the system control unit 113. In this embodiment, the image processing unit 112 rotates the image by 180°, but depending on the imaging conditions of the subject, it may also rotate the image by any angle, such as 90° or 270°. The image processing unit 112 also performs OSD (On-Screen Display) processing to superimpose text information onto the image.

[0049] The system control unit 113 controls each part of the imaging device 100. The system control unit 113 analyzes control commands for the imaging device 100 from the controller 300 or the information processing device 500. The system control unit 113 also transmits control commands including PTZ values ​​to the PTZ control unit 114. The system control unit 113 transmits instructions to the image processing unit 112 for image quality adjustment when generating image data, 180° rotation of the image, and processing to superimpose text information onto the image.

[0050] The PTZ control unit 114 controls the PTZ of the imaging device 100 by controlling the pan drive unit 107, the tilt drive unit 108, and the lens drive unit 106 based on instructions from the system control unit 113.

[0051] The memory unit 213 stores (retains) information such as image quality setting parameters, PTZ values, and the installation status of the imaging device 100. The installation status of the imaging device 100 includes both ground-mounted and ceiling-mounted states.

[0052] The output unit 116 outputs a signal obtained by converting the video from the image processing unit 112 into a predetermined video format to the display device 200 and the destination device via the first output terminal 101 and the second output terminal 102. In this embodiment, the output unit 116 transmits video from the first output terminal 101 to the destination device and video from the second output terminal 102 to the display device 200, but is not limited to this. For example, the output unit 116 may transmit the operation video 700 and the distribution video 800 to the display device 200 from the first output terminal 101. This allows the user to see both the operation video 700 and the distribution video 800 on the display device 200 screen, making it easier to recognize when an auto-flip occurs.

[0053] The control communication unit 117 transmits various instructions from the controller 300 to the system control unit 113 via the control communication terminal 103.

[0054] The network communication unit 118 communicates with the information processing device 500 via the I / F 104. For example, the network communication unit 118 transmits images captured by the imaging device 100 to the information processing device 500 via the network 400. The network communication unit 118 also transmits control commands for the imaging device 100 received from the information processing device 500 to the system control unit 113.

[0055] Figure 4 illustrates the auto-flip function performed by the imaging device. When mounted on the ceiling, the imaging device 100 captures images of the subject while changing the tilt value within the range of 0° to -220°. When the imaging direction is within a predetermined tilt value range, the imaging device 100 performs an auto-flip of the operation video 700 and the distribution video 800. The following describes the direction in which the user operates the stick 301 and the changes in each video.

[0056] Figure 4 shows the operation of the imaging device 100, the operation video 700, and the distribution video 800 in the following stages: (a) during normal operation, (b) immediately before auto-flip, (c) immediately after auto-flip, (d) stopped, and (e) restarted operation.

[0057] The operation video 700 is an image displayed on the display device 200 via the second output terminal 102. The user operates the stick 301 while checking the operation video 700 on the display device 200. The identification display 701 and warning display 702 are superimposed on the operation video 700 as OSD information. The identification display 701 indicates that it is the operation video 700, and "Operation Video" is displayed on the operation video 700. The warning display 702 refers to a text message displayed on the operation video 700. The black arrow in the lower right of the operation video 700 indicates the direction in which the imaging range is moving. For example, the downward-pointing black arrow in the lower right of the operation video 700 in Figure 4(a) indicates that the imaging range is moving downwards.

[0058] The video signal 800 is a video signal that is transmitted to an external device (not shown) via the first output terminal 101. The black arrow in the lower right of the video signal 800 indicates the direction in which the imaging range moves. For example, the downward-pointing black arrow in the lower right of the video signal 800 in Figure 4(a) indicates that the imaging range is moving downwards.

[0059] In Figure 4(a), the user is tilting the stick 301 downwards, so the imaging device 100 tilts in the direction of arrow 710. Here, the image processing unit 112 does not perform an auto-flip (180° rotation) on the video signal 800. If the tilt value (angle) of the imaging device 100 is θt, then the tilt value of the imaging device 100 in Figure 4(a) takes a value in the range of -80°≦θt≦0°.

[0060] In Figure 4(b), the user continues to push the stick 301 downwards, causing the imaging device 100 to tilt vertically (tilt value θt = -90°). At this point, the image processing unit 112 superimposes a warning message, "The video for distribution will soon be reversed," as a warning display 702 onto the operation video 700. The output unit 116 then outputs the operation video 700 with the warning display 702 superimposed to the display device 200. Note that the tilt value of the imaging device 100 in Figure 4(b) is in the range of -100° < θt < -80°.

[0061] In Figure 4(c), the user continues to push the stick 301 downwards, causing the imaging device 100 to tilt further in the direction of the arrow 710. Here, when the tilt value (angle) reaches a predetermined value, the image processing unit 112 performs an auto-flip (180° rotation) on the video for distribution 800. As a result, the video for distribution 800 is rotated by 180°, but the video for operation 700 is not. Note that the tilt value of the imaging device 100 in Figure 4(c) is in the range of θt ≤ -100°.

[0062] Furthermore, the image processing unit 112 superimposes the message "The video for distribution is inverted." as a warning display 702 onto the operation video 700. The output unit 116 then outputs the operation video 700 with the warning display 702 superimposed to the display device 200. Here, since the black arrow in the lower right of the video for distribution 800 is pointing upwards, the direction in which the user operates the stick 301 (downward) and the direction in which the imaging range moves (upward) are opposite. Therefore, the user needs to be aware that the direction of operation of the stick 301 and the direction in which the imaging range moves are opposite when operating the stick 301. For example, if the user checks the video for distribution 800 instead of the operation video 700 and operates the stick 301, they may find it difficult to operate the stick 301 intuitively.

[0063] On the other hand, since the black arrow in the lower right corner of the control video 700 points downwards, the direction in which the user operates the stick 301 (downwards) is the same as the direction in which the imaging range moves (downwards). Therefore, the user can intuitively operate the stick 301 while checking the control video 700, even without being aware of the direction in which the imaging range moves.

[0064] In Figure 4(d), the user returns the stick 301 to the home position (neutral state), and the imaging device 100 stops tilting. The image processing unit 112 performs an auto-flip (180° rotation) on the operation video 700. As a result, the subject 600 in the operation video 700 and the distribution video 800 have the same composition. The image processing unit 112 also controls the display of the warning display 702 superimposed on the operation video 700. As a result, the warning display 702 is not displayed on the operation video 700. Furthermore, the system control unit 113 controls the switch from the inverted coordinate system to the upright coordinate system. Note that the tilt value of the imaging device 100 in Figure 4(d) takes a value in the range of θt ≤ -100°.

[0065] In Figure 4(e), the user again pushes the stick 301 downwards, causing the imaging device 100 to tilt in the direction of arrow 710. Since the black arrow in the lower right of the control video 700 is pointing downwards, the direction in which the user operates the stick 301 (downwards) is the same as the direction in which the imaging range moves (downwards). Therefore, the user can intuitively operate the stick 301 while checking the control video 700, even without recognizing the direction in which the imaging range moves. Note that the tilt value of the imaging device 100 in Figure 4(e) takes values ​​in the range of θt≦80°, where the horizontal tilt value θt=0° is set to 0° on the subject 600 side.

[0066] Figure 5 is a flowchart illustrating the auto-flip performed by the imaging device. "PT" in each step of Figure 5 refers to pan and tilt. For the sake of clarity, the auto-flip based on the tilt direction and tilt speed of the imaging device 100 will be described below. Note that the auto-flip based on the pan direction and pan speed is the same as the tilt case, so its explanation will be omitted.

[0067] In S501, the system control unit 113 receives a control command specifying the tilt direction and tilt speed from the controller 300 or the information processing device 500.

[0068] In S502, the system control unit 113 starts controlling the tilt drive unit 108 based on a control command specifying the tilt direction and tilt speed. Here, we will describe the tilt control of the imaging device 100 when the user operates the stick 301 of the controller 300 downwards. As shown in Figure 4(a), the direction of operation of the stick 301 (downwards) is the same as the direction of the black arrow in the lower right of the operation video 700 and the distribution video 800 (downwards).

[0069] In S503, the system control unit 113 determines whether or not it has received a control command specifying the tilt direction and tilt speed. If the system control unit 113 determines that it has received a control command specifying the tilt direction and tilt speed (Yes in S503), the process proceeds to S504. On the other hand, if the system control unit 113 determines that it has not received a control command specifying the tilt direction and tilt speed (No in S503), the process proceeds to S505.

[0070] In S504, the system control unit 113 performs control to change the tilt direction and tilt speed based on a control command that specifies the tilt direction and tilt speed.

[0071] In step S505, the image processing unit 112 performs a 180° rotation on the video for distribution 800. The rotation process for the video for distribution 800 will be described later using Figure 6.

[0072] In S506, the image processing unit 112 performs the process of superimposing the warning display 702 onto the operation video 700. The process of superimposing the warning display 702 onto the operation video 700 will be described later with reference to Figure 7.

[0073] In S507, the system control unit 113 determines whether or not it has received a tilt stop control command. The tilt stop control command is transmitted from the controller 300 or the information processing device 500, similar to the control command that specifies the tilt direction and tilt speed. If the system control unit 113 determines that it has received a tilt stop control command (Yes in S507), the process proceeds to S508. On the other hand, if the system control unit 113 determines that it has not received a tilt stop control command (No in S507), the process returns to S503.

[0074] In S508, the system control unit 113 performs control to stop the tilt of the imaging device 100.

[0075] In S509, the system control unit 113 determines whether or not one second has elapsed since the imaging device 100 stopped tilting. If the system control unit 113 determines that one second has elapsed since the imaging device 100 stopped tilting (Yes in S509), the process proceeds to S511. If the system control unit 113 determines that one second has not elapsed since the imaging device 100 stopped tilting (No in S509), the process proceeds to S510.

[0076] In S510, the system control unit 113 determines whether or not it has received a control command to tilt the imaging device 100. If the system control unit 113 determines that it has received a control command to tilt the imaging device 100 (Yes in S510), the process returns to S502. If the system control unit 113 determines that it has not received a control command to tilt the imaging device 100 (No in S510), the process returns to S509.

[0077] The reason for performing the processing in S509 to S510 is explained below. Immediately after the tilt of the imaging device 100 stops, the user may operate the stick 301 to correct the tilt of the imaging device 100. If the PT coordinate system is inverted immediately after the tilt of the imaging device 100 stops, the user will be operating the stick 301 while viewing the operation video 700 rotated 180°. The PT coordinate system refers to the upright and inverted coordinate systems of the imaging device 100 as explained in Figure 2. Furthermore, since the direction of the user's operation of the stick 301 and the direction of movement of the imaging range of the operation video 700 are opposite, the user will find it difficult to tilt the imaging device 100 to the intended imaging direction. For the reasons described above, instead of performing an auto-flip of the operation video 700 immediately after the tilt of the imaging device 100 stops, the operation video 700 is auto-flipped one second after the tilt stops. This improves the usability when controlling the tilt of the imaging device 100. The waiting time from the stopping of the tilt of the imaging device 100 until the auto-flip of the control image 700 is performed is 1 second, but this waiting time may be any length.

[0078] In S511, the system control unit 113 determines whether the setting for 180° rotation processing for the video to be distributed 800 is OFF (the setting is to not perform 180° rotation processing). If the system control unit 113 determines that the setting for 180° rotation processing for the video to be distributed 800 is OFF (Yes in S511), the process proceeds to S512. On the other hand, if the system control unit 113 determines that the setting for 180° rotation processing for the video to be distributed 800 is not OFF (the setting is to perform 180° rotation processing) (No in S511), the process proceeds to S514.

[0079] In S512, the system control unit 113 sets the PT coordinate system to an upright coordinate system.

[0080] In S513, the system control unit 113 turns OFF the setting for 180° rotation processing for the operation video 700 (i.e., sets it so that 180° rotation processing is not performed).

[0081] In S514, the system control unit 113 sets the PT coordinate system to an inverted coordinate system.

[0082] In S515, the system control unit 113 turns ON the setting for 180° rotation processing for the operation video 700 (i.e., sets it to perform 180° rotation processing).

[0083] In S516, the system control unit 113 controls the display of the warning display 702 superimposed on the operation video 700. The updating of the warning display 702 will be described later using Figure 7.

[0084] Figure 6 shows the auto-flip settings for the video to be distributed according to the first embodiment.

[0085] First, we will explain the settings for when the ground-mounted imaging device 100 performs a 180° rotation (auto-flip) of the video signal 800 for distribution.

[0086] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the upright coordinate system is 80° ≤ θt. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800.

[0087] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the upright coordinate system is in the range of 80° < θt < 100°. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800. Note that if the tilt control of the imaging device 100 is performed based on the tilt value (threshold) defined as the condition for performing auto-flip, a "hunting phenomenon" will occur. The hunting phenomenon refers to the phenomenon in which 180° rotation (auto-flip) of the video for distribution 800 occurs frequently near the threshold. Therefore, the hunting phenomenon can be avoided by the system control unit 113 determining whether or not to perform 180° rotation processing of the video for distribution 800 based on the above range of tilt value θt.

[0088] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON if the tilt value θt in the upright coordinate system is 100° ≤ θt. In this case, the image processing unit 112 performs 180° rotation processing on the video for distribution 800.

[0089] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON if the tilt value θt in the inverted coordinate system is -100° ≤ θt. In this case, the image processing unit 112 performs 180° rotation processing on the video for distribution 800.

[0090] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON if the tilt value θt in the inverted coordinate system is in the range of -100° < θt < -80°. In this case, the image processing unit 112 performs 180° rotation processing on the video for distribution 800. By the system control unit 113 determining whether or not to perform 180° rotation processing on the video for distribution 800 based on the above range of tilt value θt, the hunting phenomenon can be avoided.

[0091] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the inverted coordinate system is -80° ≤ θt. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800.

[0092] Next, we will explain the settings for when the imaging device 100, when installed on the ceiling, performs a 180° rotation (auto-flip) of the video signal 800 for distribution.

[0093] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON if the tilt value θt in the upright coordinate system is θt ≤ 80°. In this case, the image processing unit 112 performs 180° rotation processing on the video for distribution 800.

[0094] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON if the tilt value θt in the upright coordinate system is in the range of 80° < θt < 100°. In this case, the image processing unit 112 performs 180° rotation processing on the video for distribution 800. By the system control unit 113 determining whether or not to perform 180° rotation processing on the video for distribution 800 based on the above range of tilt value θt, the hunting phenomenon can be avoided.

[0095] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the upright coordinate system is 100° ≤ θt. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800.

[0096] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the inverted coordinate system is -100° ≤ 0°. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800.

[0097] The system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is OFF if the tilt value θt in the inverted coordinate system is in the range of -100° < θt < -80°. In this case, the image processing unit 112 does not perform 180° rotation processing on the video for distribution 800. By having the system control unit 113 determine whether or not to perform 180° rotation processing on the video for distribution 800 based on the above range of tilt value θt, the hunting phenomenon can be avoided.

[0098] The system control unit 113 determines that the rotation processing setting for the video to be streamed 800 is ON if the tilt value θt in the inverted coordinate system is -80° ≤ θt. In this case, the image processing unit 112 performs a 180° rotation on the video to be streamed 800.

[0099] Figure 7 is a flowchart illustrating the OSD display process according to the first embodiment.

[0100] In S701, the system control unit 113 determines whether the acquired video is the operation video 700. If the system control unit 113 determines that the acquired video is the operation video 700 (Yes in S701), the process proceeds to S702. If the system control unit 113 determines that the acquired video is not the operation video 700 (No in S701), the process ends.

[0101] In S702, the system control unit 113 determines whether the setting for 180° rotation processing of the video for distribution 800 is ON (the setting to perform 180° rotation processing). If the system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is ON (Yes in S702), the process proceeds to S703. If the system control unit 113 determines that the setting for 180° rotation processing of the video for distribution 800 is NOT ON (No in S702), the process proceeds to S704.

[0102] In S703, the system control unit 113 determines whether the setting for 180° rotation processing of the operation video 700 is OFF (the setting is to not perform 180° rotation processing). If the system control unit 113 determines that the setting for 180° rotation processing of the operation video 700 is OFF (Yes in S703), the process proceeds to S706. If the system control unit 113 determines that the setting for 180° rotation processing of the operation video 700 is not OFF (No in S703), the process proceeds to S705.

[0103] In S704, the system control unit 113 determines whether the setting for 180° rotation processing of the operation video 700 is ON. If the system control unit 113 determines that the setting for 180° rotation processing of the operation video 700 is ON (Yes in S703), the process proceeds to S706. If the system control unit 113 determines that the setting for 180° rotation processing of the operation video 700 is NOT ON (No in S703), the process proceeds to S705.

[0104] In S705, the system control unit 113 determines whether the difference between the current tilt value θt and a predetermined tilt value (the tilt value used when performing auto-flip) is less than or equal to a predetermined threshold. If the system control unit 113 determines that the difference is less than or equal to the predetermined threshold (Yes in S705), the process proceeds to S707. If the system control unit 113 determines that the difference is not less than or equal to the predetermined threshold (No in S705), the process proceeds to S708.

[0105] Here, the predetermined threshold is 10°. For example, in the imaging device 100 when installed on the ground, the predetermined tilt value in the upright coordinate system is 100°. Therefore, the system control unit 113 determines that if the current tilt value θt is between 90° and 100°, the difference (0° to 10°) is less than or equal to the predetermined threshold (10°). In this way, the system control unit 113 determines the degree of proximity of the current tilt value θt to the predetermined tilt value, but other determination methods may also be used.

[0106] In S706, the system control unit 113 performs the process of superimposing the message "The video for distribution is inverted." as a warning display 702 onto the operation video 700.

[0107] In S707, the system control unit 113 performs the process of superimposing the message "The video for distribution will soon be reversed" as a warning display 702 onto the operation video 700.

[0108] In S708, the system control unit 113 does not perform the process of superimposing the warning display 702 onto the operation video 700.

[0109] Figure 8 is a flowchart illustrating the auto-flip according to the first embodiment. In each step of Figure 8, "PT" refers to pan and tilt. For the sake of clarity, the auto-flip based on the tilt direction and tilt speed of the imaging device 100 will be described below. Note that the auto-flip based on the pan direction and pan speed is the same as the case of tilt, so the explanation will be omitted.

[0110] The imaging device 100 can be driven not only based on a control command specifying the tilt direction and tilt speed, but also based on a control command specifying a target tilt value. The target tilt value corresponds to the target direction.

[0111] For example, the target tilt value of the imaging device 100 may be specified directly via the UI on the screen of the information processing device 500. This method is equivalent to driving the imaging device 100 to the target tilt value by recalling a preset registered in the imaging device 100.

[0112] In the method described above, since the imaging device 100 is not tilt-controlled via the stick 301, usability does not decrease even if the operation video 700 is reversed (rotated 180°) midway through. Therefore, the operation video 700 and the distribution video 800 are auto-flip (rotated 180°) at the same time. In addition, the process of superimposing the warning display 702 onto the operation video 700 is unnecessary. The following describes a method for tilt-controlling the imaging device 100 without using the stick 301.

[0113] In S801, the system control unit 113 receives a control command specifying the tilt value. This control command, like the control commands specifying the tilt direction and tilt speed, is transmitted from the controller 300 or the information processing device 500. Furthermore, if the system control unit 113 receives a preset recall command, it is converted into a control command specifying the tilt value within the imaging device 100.

[0114] In S802, the system control unit 113 controls the tilt drive unit 108 based on the target tilt value of the received control command.

[0115] In S803, the system control unit 113 determines whether or not it has received a control command specifying a tilt value. If the system control unit 113 determines that it has received a control command specifying a tilt value (Yes in S803), the process proceeds to S804. If the system control unit 113 determines that it has not received a control command specifying a tilt value (No in S803), the process proceeds to S805.

[0116] In S804, the system control unit 113 updates the target tilt value based on the received control command, and changes the tilt direction and tilt speed as necessary.

[0117] In S805, the system control unit 113 switches the setting (ON / OFF) for 180° rotation processing for the operation video 700 and the distribution video 800 based on whether the current tilt value exceeds a predetermined tilt value. In this case, if the imaging device 100 is driven based on a pre-specified target tilt value, the tilt of the imaging device 100 will not be changed frequently. Here, the predetermined tilt value (angle) is, for example, 100° in the upright coordinate system when installed on the ground, and -100° in the inverted coordinate system.

[0118] In S806, the system control unit 113 determines whether the current tilt value is the same as the target tilt value, or whether a tilt stop command has been received. If the system control unit 113 determines that the current tilt value is not the same as the target tilt value and that a tilt stop command has not been received (No in S806), the process proceeds to S803. If the system control unit 113 determines that the current tilt value is the same as the target tilt value or that a tilt stop command has been received (Yes in S806), the process proceeds to S807.

[0119] In S808, the system control unit 113 determines whether the setting for 180° rotation processing for the video to be distributed 800 is OFF. If the system control unit 113 determines that the setting for 180° rotation processing for the video to be distributed 800 is OFF (Yes in S808), the process proceeds to S809. If the system control unit 113 determines that the setting for 180° rotation processing for the video to be distributed 800 is not OFF (No in S808), the process proceeds to S810.

[0120] In S809, the system control unit 113 sets the PT coordinate system to an upright coordinate system, and the process ends.

[0121] In S810, the system control unit 113 sets the PT coordinate system to an inverted coordinate system, and the process ends.

[0122] Referring to Figures 9 to 11, the control communication mechanism when the controller 300 controls the PT of the imaging device 100 will be explained. The control communication commands are a command system defined by the VISCA (registered trademark) protocol, but are not limited to this.

[0123] Figure 9 shows the control communication sequence according to the first embodiment.

[0124] In S901, the user tilts the stick 301 of the controller 300 downwards. The controller 300 sends a control command to the imaging device 100 specifying the tilt direction (downward). The control command specifying the tilt direction includes the tilt direction (up or down) and a parameter for the tilt speed corresponding to the inclination angle of the stick 301. If the stick 301 is tilted diagonally, the controller 300 sends a control command specifying the pan direction to the imaging device 100 along with the control command specifying the tilt direction.

[0125] In S902, the imaging device 100 starts tilting based on the received control command. The controller 300 also sends a control command to the imaging device 100 at regular intervals specifying the tilt direction if the tilt angle of the stick 301 does not change. However, even if the imaging device 100 receives further control commands, it has already started tilting, so the additional control commands do not affect the tilt of the imaging device 100.

[0126] If the tilt angle of the stick 301 changes in S903, the controller 300 sends a control command to the imaging device 100 that specifies the tilt speed corresponding to the tilt angle of the stick 301.

[0127] In S904, the imaging device 100 changes from the current tilt speed to the tilt speed specified by the received control command, and continues tilting.

[0128] In S905, the user tilts the stick 301 upwards. The controller 300 sends a control command to the imaging device 100 specifying the tilt direction (upwards) and tilt speed.

[0129] In S906, the imaging device 100 tilts upward based on the received control command.

[0130] In S907, the user returns the stick 301 to the home position (neutral position). The controller 300 sends a tilt stop command to the imaging device 100.

[0131] In S908, the imaging device 100 stops tilting based on the received tilt stop command.

[0132] In S909, the user presses any preset button from the control buttons 302 of the controller 300. The controller 300 sends a preset recall command to the imaging device 100. The preset recall command includes parameters for the tilt direction and tilt speed associated with the preset number.

[0133] In S910, the imaging device 100 starts tilting to a target tilt value corresponding to the preset number, based on the received preset recall command.

[0134] In S911, if the imaging device 100 determines that the current tilt value is the same as the target tilt value, it terminates the tilt.

[0135] Figure 10 shows the packet structure used for control communication according to the first embodiment.

[0136] The packet structure consists of a header, a command, and parameters.

[0137] The header contains data representing the address of the device sending the packet, the address of the device receiving the packet, and the size of the packet (in bytes).

[0138] The command represents a function of the imaging device 100 controlled by a packet.

[0139] Parameters represent the detailed control settings of a command.

[0140] Figure 11 shows a list of commands used for control communication according to the first embodiment.

[0141] Parameter 1 of the control command specifying the pan direction specifies the pan direction (left or right) of the imaging device 100. Parameter 2 of the control command specifying the pan direction specifies the pan speed of the imaging device 100.

[0142] Parameter 1 of the control command specifying the tilt direction specifies the tilt direction (up or down) of the imaging device 100. Parameter 2 of the control command specifying the tilt direction specifies the tilt speed of the imaging device 100.

[0143] Parameter 1 of the control command specifying the PT value specifies the pan value of the imaging device 100. Parameter 2 of the control command specifying the PT value specifies the tilt value of the imaging device 100.

[0144] In the PT stop command, parameters 1 and 2 are not specified.

[0145] Parameter 1 of the preset registration command specifies the preset number to be used when registering PTZ values.

[0146] Parameter 1 of the preset recall command specifies the preset number to be recalled.

[0147] As described above, according to the first embodiment, even if an auto-flip occurs during imaging in a predetermined imaging direction, the usability of controlling the imaging direction of the imaging device can be improved by outputting the operation video and the distribution video, respectively. This allows the imaging device to be controlled in the imaging direction intended by the user.

[0148] (Other examples) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0149] The disclosures herein include the following imaging control devices, imaging devices, imaging control methods, and programs. (Item 1) An imaging means for capturing images of a subject, The system includes output means that outputs a first output image and a second output image based on the imaging result of the subject by the imaging means, The output means outputs, when certain conditions are met, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject as the first output image, and the second image obtained by rotating the first image as the second output image. Imaging device. (Item 2) The output means outputs the second image as the first output image after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range. The imaging device described in item 1. (Item 3) The output means outputs the second image as the first output image after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range, and after a predetermined time has elapsed. The imaging device described in item 1. (Item 4) The system includes a control means for changing the imaging direction based on a user operation that changes the imaging direction according to any coordinate system, The control means, after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range, changes the coordinate system of the user operation. The imaging device described in item 2. (Item 5) The output means outputs an image as the first output image, which is an image in which a first display indicating that the second image will be output as the second output image is superimposed on the first image when the first image is output as the first output image and the imaging direction is close to the predetermined range. An imaging device described in any one of items 1 through 4. (Item 6) The output means outputs an image as the first output image when the first image is output as the first output image and the second image is output as the second output image, by superimposing a second indication on the first image that the second image is output as the second output image. The imaging device described in item 5. (Item 7) The system includes a receiving means for receiving the direction in which the imaging direction is changed, or the target direction of the imaging direction, The control means changes the imaging direction based on the received direction or the target direction. The imaging device described in item 4. (Item 8) The output means outputs the second image as the first output image and the second output image, respectively, when a predetermined condition is met, including that the imaging direction is within the predetermined range when the imaging direction is changed to the target direction. The imaging device described in item 7. (Item 9) The output means outputs the first image as the first output image and the second image as the second output image, respectively, when a predetermined condition is met, including that the imaging direction when the imaging direction is changed to the direction is within the predetermined range. The imaging device described in item 8. (Item 10) The receiving means further receives the speed at which the imaging direction is changed. The imaging device described in item 7. (Item 11) The system includes a storage means for storing the aforementioned imaging direction, The control means changes the imaging direction to the stored imaging direction. The imaging device described in item 4. (Item 12) The output means outputs the first output image and the second output image to the first external device and the second external device, respectively. An imaging device described in any one of items 1 through 11. (Item 13) A controller that controls the imaging direction based on user operation, A display device that displays the first output image, or the first output image and the second output image, The imaging device comprises one of the items 1 to 12, Imaging system. (Item 14) A method performed by an imaging device, The imaging means of the imaging device includes an imaging step of capturing an image of a subject, The output means of the imaging device includes an output step of outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, In the output step, if the output means of the imaging device satisfies predetermined conditions, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject is output as the first output image, and the second image obtained by rotating the first image is output as the second output image. method. (Item 15) A program that causes a computer to perform the actions that an imaging device would perform, The aforementioned method, The imaging means of the imaging device includes an imaging step of capturing an image of a subject, The output means of the imaging device includes an output step of outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, In the output step, if the output means of the imaging device satisfies predetermined conditions, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject is output as the first output image, and the second image obtained by rotating the first image is output as the second output image. program.

[0150] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0151] 10: Imaging System 100: Imaging device 200:Display device 300: Controller 400: Network 500: Information Processing Device 600: Subject 700: Operational video 800: Video for distribution

Claims

1. An imaging means for capturing images of a subject, The system includes output means for outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, The output means outputs, when certain conditions are met, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject as the first output image, and the second image obtained by rotating the first image as the second output image. Imaging device.

2. The output means outputs the second image as the first output image after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range. The imaging apparatus according to claim 1.

3. The output means outputs the second image as the first output image after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range, and after a predetermined time has elapsed. The imaging apparatus according to claim 1.

4. The system includes a control means for changing the imaging direction based on a user operation that changes the imaging direction according to any coordinate system, The control means, after receiving an instruction to stop changing the imaging direction while the imaging direction is within the predetermined range, changes the coordinate system of the user operation. The imaging apparatus according to claim 2.

5. The output means outputs an image as the first output image, which is an image obtained by superimposing a first display on the first image that indicates that the second image will be output as the second output image when the first image is output as the first output image and the imaging direction is close to the predetermined range. The imaging apparatus according to claim 1.

6. The output means outputs an image as the first output image when the first image is output as the first output image and the second image is output as the second output image, by superimposing a second indication on the first image that the second image is output as the second output image. The imaging apparatus according to claim 5.

7. The system includes a receiving means for receiving the direction in which the imaging direction is changed, or the target direction of the imaging direction, The control means changes the imaging direction based on the received direction or the target direction. The imaging apparatus according to claim 4.

8. The output means outputs the second image as the first output image and the second output image, respectively, when a predetermined condition is met, including that the imaging direction is within the predetermined range when the imaging direction is changed to the target direction. The imaging apparatus according to claim 7.

9. The output means outputs the first image as the first output image and the second image as the second output image, respectively, when a predetermined condition is met, including that the imaging direction when the imaging direction is changed to the direction is within the predetermined range. The imaging apparatus according to claim 8.

10. The receiving means further receives the speed at which the imaging direction is changed. The imaging apparatus according to claim 7.

11. The system includes a storage means for storing the aforementioned imaging direction, The control means changes the imaging direction to the stored imaging direction. The imaging apparatus according to claim 4.

12. The output means outputs the first output image and the second output image to the first external device and the second external device, respectively. The imaging apparatus according to claim 1.

13. A controller that controls the imaging direction based on user operation, A display device that displays the first output image, or the first output image and the second output image, The imaging device comprises the imaging device according to any one of claims 1 to 12, Imaging system.

14. A method performed by an imaging device, The imaging means of the imaging device includes an imaging step of capturing an image of a subject, The output means of the imaging device includes an output step of outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, In the output step, if the output means of the imaging device satisfies predetermined conditions, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject is output as the first output image, and the second image obtained by rotating the first image is output as the second output image. method.

15. A program that causes a computer to perform the actions that an imaging device would perform, The aforementioned method, The imaging means of the imaging device includes an imaging step of capturing an image of a subject, The output means of the imaging device includes an output step of outputting a first output image and a second output image based on the imaging result of the subject by the imaging means, In the output step, if the output means of the imaging device satisfies predetermined conditions, including that the imaging direction of the imaging means is within a predetermined range, the first image captured by the imaging means of the subject is output as the first output image, and the second image obtained by rotating the first image is output as the second output image. program.

16. A controller that controls the imaging direction based on user operation, A system including an imaging device for imaging a subject, The aforementioned system, The system includes output means for outputting a first output image and a second output image based on the imaging results of the subject by the imaging device, When the output means satisfies predetermined conditions, including that the imaging direction of the imaging device is within a predetermined range, it outputs the first image captured by the imaging device of the subject as the first output image, and the second image obtained by rotating the first image as the second output image. system.

Images