Information processing apparatus, imaging system, information processing method, and program

Abstract

To provide an information processing apparatus, an imaging system, an information processing method, and a program that can reduce the occurrence of an unintended shift in the angle of view in changing the angle of view, even if an imaging apparatus is in an inclined state.SOLUTION: An information processing apparatus comprises: detection means that detects the inclination angle of the posture of an imaging apparatus that picks up an image of a subject; receiving means that receives an instruction to change the photographing angle of view of the imaging apparatus; and correction means that executes correction processing of correcting the instruction to change the photographing angle of view on the basis of the detected inclination angle.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an imaging system, an information processing method, and a program.

Background Art

[0002] In the field of video production, for example, an imaging device that changes the imaging angle in the pan direction or the tilt direction in response to an instruction from a controller such as a joystick may be used.

[0003] In addition, due to the recent expansion of the field of personal distribution, it has become increasingly common to borrow a shooting (distribution) studio for a short period of time to perform shooting. As a method of installing an imaging device at this time, a method of fixing the imaging device to a tripod that is easy to move the shooting location may be used. When using a tripod, it is necessary to perform leveling precisely. If leveling is not performed precisely, for example, when changing the imaging angle in the pan direction, a problem may occur in that although the user intends to operate in the horizontal direction, the imaging angle shifts in the diagonal horizontal direction.

[0004] On the other hand, in order to increase the time spent on shooting as much as possible during the time of borrowing the studio, shortening the time for installation and removal work of the imaging system including the imaging device is required. For shortening the time, it is necessary to improve workability that enables easy installation and removal, and the user desires to shorten the time required for leveling the tripod as much as possible. Therefore, it is preferable to provide the user with a method that does not cause an unintended shift in the imaging angle during imaging angle change even without performing precise leveling.

[0005] As a related technique, Patent Document 1 proposes a method for correcting a shift in the vertical direction of the imaging angle.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] However, Patent Document 1 does not mention the angle-of-view correction when the imaging device itself is tilted. Therefore, an object of the present invention is to provide an information processing apparatus, an imaging system, an information processing method, and a program that can reduce the occurrence of unintended angle-of-view deviation when changing the angle of view even when the imaging device is tilted.

Means for Solving the Problems

[0008] To solve this problem, for example, the information processing apparatus of the present invention has the following configuration. That is, detection means for detecting the tilt angle of the posture of an imaging device that images a subject; reception means for receiving an instruction to change the shooting angle of view of the imaging device; correction means for executing a correction process for correcting the instruction to change the shooting angle of view based on the detected tilt angle; and is provided with.

Effects of the Invention

[0009] According to the present invention, it is possible to provide an information processing apparatus, an imaging system, an information processing method, and a program that can reduce the occurrence of unintended angle-of-view deviation when changing the angle of view even when the imaging device is tilted.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Best Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] <First Embodiment> (System Configuration) FIG. 1 is a diagram showing an example of the configuration of an imaging system including the imaging device according to the present embodiment. The imaging system 100 includes one or more imaging devices 101, a server device 102, an input device 103, a display device 104, a network 105, a plurality of client devices 106a, 106b, 106c ···, a display device 107, an input device 108, a switch 109, and an input device 110. When it is not necessary to distinguish each of the client devices 106a, 106b, 106c ···, they are described as client device 106.

[0013] The imaging device 101 is, for example, a digital camera. The imaging device 101 captures a subject and generates image data. The term "image" may be used to include still images, moving images, videos, and their data. One or more imaging devices 101 are connected to the server device 102 via the switch 109. The imaging device 101 transmits the captured image to the server device 102 via the switch 109. The connection method of the imaging device 101, the switch 109, and the server device 102 assumes a wired LAN using a LAN (Local Area Network) cable, but other connection methods may also be used. For example, the connection method may be any of SDI (Serial Digital Interface), HDMI (registered trademark: High-Definition Multimedia Interface), wireless LAN, and UVC (Universal Serial Bus Video Class). In the case of a LAN cable, up to about 100 imaging devices 101 may be connected to the server device 102.

[0014] The server device 102 is, for example, a computer and is connected to the input device 103 and the display device 104. The input device 103 is an interface capable of operating the imaging device 101, such as a keyboard and a multi-directional input stick controller. The user operates the imaging device 101 by operating the input device 103. The display device 104 is, for example, a device that displays images, such as a liquid crystal display and an organic EL (Electro Luminescence) display. The display device 104 acquires and displays the image captured by the imaging device 101 from the server device 102. The server device 102 is connected to be able to transmit data, etc., to the client device 106 via the network 105.

[0015] The network 105 is connected to the server device 102 and the client device 106. The network 105 enables the client device 106 to view the video distributed from the server device 102.

[0016] For example, three client devices 106a, 106b, and 106c are connected to the network 105 as the client device 106. Note that the number of client devices 106 is not limited to three and may be changed as appropriate. The client device 106 is connected to a display device 107 that displays images and an input device 108 through which a user inputs data, commands, etc. The input device 108 is, for example, a keyboard, a mouse, a touch panel, or the like. The user operates the client device 106 by inputting commands and information to the client device 106 using the input device 108. The client device 106 can send a video distribution request to the server device 102 via the network 105. The client device 106 displays the received video on the display device 107 in response to the video distribution request.

[0017] The switch 109 is assumed to be a network hub if the connection method is LAN, or a device such as a splitter if it is HDMI.

[0018] The input device 110 is an interface capable of operating the imaging device 101, such as a keyboard and a multi-directional input stick controller, similar to the input device 103. The user can operate the imaging device 101 via the input device 110.

[0019] In this embodiment, the client device 106, the display device 107, and the input device 108 are separate entities, but a configuration in which the client device 106, the display device 107, and the input device 108 are integrated, such as a notebook PC having a touch panel display, may also be used. The server device 102, the input device 103, and the display device 104 are separate entities, but a configuration in which the server device 102, the input device 103, and the display device 104 are integrated, such as a controller with an integrated panel, may also be used.

[0020] (Internal Configuration of Imaging Device) FIG. 2 is a diagram showing an example of the configuration of the imaging device according to the present embodiment. The imaging device 101 has, for example, a computer. The imaging device 101 includes an imaging unit 201, an encoder unit 202, a network I / F 203, a CPU 204, a RAM 205, a ROM 206, a drive unit 207, and a sensor unit 208. An imaging optical system 200 is detachably provided to the imaging device 101. The CPU 204, the RAM 205, and the ROM 206 are an example of an information processing device.

[0021] The imaging optical system 200 is one or more lenses that condense light from a subject onto the imaging surface of an imaging element 201a described later. The imaging optical system 200 has, for example, a zoom lens, a focus lens, an anti-shake lens, and the like.

[0022] In the present embodiment, the imaging optical system 200 is detachably provided as a separate body from the imaging device 101, but is not limited to this configuration. For example, the imaging device 101 may have the imaging optical system 200 like an integrated lens imaging device.

[0023] The imaging unit 201 captures an image of a subject by the imaging optical system 200 and generates an image. The imaging unit 201 includes an imaging element 201a, an amplifier 201b, and an image processing unit 201c. The imaging unit 201 can set and change exposure parameters for each pixel group composed of a plurality of pixels (for example, 128×128 pixels) on the imaging surface. The exposure parameters are parameters related to exposure and include exposure time, analog gain, exposure value, and the like.

[0024] The imaging device 201a converts the light from the subject condensed on the imaging surface by the imaging optical system 200 into an electrical signal for each pixel and outputs it. The imaging device 201a captures an image of the subject with an exposure time for each pixel group according to the set exposure parameters. The imaging device 201a is, for example, an IC chip in which pixels composed of photoelectric conversion elements such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor are arranged in a matrix. The imaging device 201a mainly has high sensitivity to visible light and has high sensitivity to any one of red (R), green (G), and blue (B) for each pixel, but also has a certain degree of sensitivity to infrared light. Therefore, the imaging device 201a can clearly capture a bright subject with infrared light, such as in a time zone where sunlight exists and in a place illuminated by infrared light illumination.

[0025] The amplifier 201b amplifies and outputs the electrical signal output from the imaging device 201a. The amplifier 201b is provided for each pixel or pixel group. The signal amplification factor (analog gain) of the amplifier 201b is set according to the exposure parameters for each pixel group.

[0026] The image processing unit 201c performs A / D conversion on the electrical signal, which is an analog signal output from the amplifier 201b, into a digital signal, and performs image processing including demosaicking processing, white balance processing, gamma processing, etc. to generate a digital image. The image processing unit 201c corrects the brightness of the image by amplifying and attenuating the digital value of the image signal output from each pixel or pixel group for each pixel or pixel group. In addition, the image processing unit 201c performs electronic image stabilization based on the attitude information from the sensor unit 208. Electronic image stabilization can correct image blur and perform shift correction in the pan / tilt directions and angle correction in the roll direction, etc.

[0027] The encoder unit 202 performs encoding processing on the image data output from the image processing unit 201c of the imaging unit 201 into a predetermined file format such as Motion Jpeg and H264, H265.

[0028] The network I / F 203 is an interface for realizing communication by being connected to the switch 109. The network I / F 203 transmits the image data that has been encoded by the encoder unit 202 to the client device 106 via the switch 109, the network 105, etc. Incidentally, the encoded image data may be stored in an internal storage device such as the RAM 205 and the ROM 206 described later, or a detachable storage medium such as an SD card (not shown). Further, the storage of these image data may be performed after being output by the image processing unit 201c. In that case, the RAW data before encoding is stored as the image data.

[0029] The CPU 204 is an abbreviation for Central Processing Unit. The CPU 204 is a central processing unit that overall controls the imaging device 101. The imaging device 101 may have other processors such as an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and a QPU (Quantum Processing Unit) instead of or in addition to the CPU 204.

[0030] The RAM 205 is an abbreviation for Random Access Memory. The RAM 205 temporarily stores the computer program executed by the CPU 204. Further, the RAM 205 provides a work area used when the CPU 204 executes processing. The RAM 205 functions as a frame memory and a buffer memory.

[0031] The ROM 206 is an abbreviation for Read Only Memory. The ROM 206 stores data such as a program for the CPU 204 to control the imaging device 101 and parameters necessary for the execution of the program. The imaging device 101 may have a non-volatile storage device such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive) instead of or in addition to the ROM 206.

[0032] The drive unit 207 changes the shooting angle of view of the imaging device 101 based on an instruction from the CPU 204 or the like. The drive unit 207 has one or more motors such as a stepping motor, a DC (Direct Current) motor, a brushed motor, and a brushless motor. The drive unit 207 has at least one or more motors with respect to the rotation axes of the pan and tilt.

[0033] The sensor unit 208 has a sensor that detects the inclination angle of the imaging device 101 by vector detection or the like. The inclination angle of the imaging device 101 may be, for example, an angle with respect to the gravity vector. The sensor unit 208 may be, for example, a sensor that detects the attitude of the three axes of XYZ, or a six-axis gyro sensor that also calculates an angle vector in addition to the three axes of XYZ.

[0034] (Internal configuration of the client device) FIG. 3 is a diagram showing an example of the configuration of a client device connected to the imaging device according to the present embodiment via the Internet. The client device 106 is, for example, a computer. The client device 106 has a CPU 301, a RAM 302, a ROM 303, an input I / F 304, an output I / F 305, and a network I / F 306.

[0035] The CPU 301 is a central processing unit that overall controls the client device 106. The client device 106 may have other processors such as an MPU, a GPU, and a QPU instead of or in addition to the CPU 301.

[0036] The RAM 302 has a work area that temporarily stores programs and the like for the CPU 301 to control the client device 106.

[0037] The ROM 303 stores a program for the CPU 301 to control the client device 106, data such as parameters necessary for the execution of the program, and the like. The client device 106 may have a non-volatile storage device such as an HDD and an SSD instead of or in addition to the ROM 303.

[0038] The input I / F 304 is an interface connected to the input device 108. The input I / F 304 receives an operation on the client device 106 input from the user via the input device 108.

[0039] The output I / F 305 is an interface connected to the display device 107. The output I / F 305 outputs and displays the image output from the imaging device 101 on the display device 107.

[0040] The network I / F 306 is an interface connected to the network 105 and realizing communication with the imaging device 101 via the network 105. The network I / F 306 transmits operation information for the imaging device 101 and receives the image output from the imaging device 101.

[0041] (Internal Configuration of Server Device) FIG. 4 is a diagram showing an example of the configuration of a server device 102 connected to the imaging device according to the present embodiment. The server device 102 is an information processing device having a CPU 401, a RAM 402, a ROM 403, a video input I / F 404, an input I / F 405, an output I / F 406, and a network I / F 407.

[0042] The CPU 401 is a central processing unit that comprehensively controls the server device 102. The server device 102 may have other processors such as an MPU, a GPU, and a QPU instead of or in addition to the CPU 401.

[0043] The RAM 402 has a work area for temporarily storing programs for the CPU 401 to control the server device 102 and images input from the imaging device 101 and the like.

[0044] The ROM 403 stores programs for the CPU 401 to control the server device 102, images input from the imaging device 101, and data such as parameters necessary for program execution. The server device 102 may have a non-volatile storage device such as an HDD and an SSD instead of or in addition to the ROM 403.

[0045] The video input I / F 404 is an interface connected to the imaging device 101 so as to be able to receive images such as video. The video input I / F 404 is connected to the imaging device 101 via the switch 109 by any one of a LAN cable, an HDMI cable, an SDI cable, a wireless LAN, and a USB cable. The video input I / F 404 receives the image captured by the imaging device 101.

[0046] The input I / F 405 is an interface connected to the input device 103. The input I / F 405 receives operations on the server device 102 input from the server administrator via the input device 103.

[0047] The output I / F 406 is an interface connected to the display device 104. The output I / F 406 outputs the image output from the imaging device 101 to the display device 104 for display.

[0048] The network I / F 407 is an interface for connecting a LAN cable or the like to the network 105. An image captured by the imaging device 101 and input to the server device 102 via the network I / F 407 is video-distributed to the client device 106 via the network 105. Also, the network I / F 407 is an interface for receiving a video distribution request from the client device 106 and distributing video.

[0049] (Functional Configuration) FIG. 5 is a functional block diagram showing an example of the functional configuration of the imaging device 101 according to the present embodiment. The imaging device 101 includes an attitude detection unit 501, a drive vector reception unit 502, and a drive vector correction unit 503. Among the functional blocks shown in FIG. 5, the functions realized by software are realized by a processor such as the CPU 204 reading a program stored in a memory such as the ROM 206 and expanding and executing it in the RAM 205. The functions realized by hardware are realized by the FPGA reading a program stored in a memory such as the ROM 206 and generating a circuit. FPGA is an abbreviation for Field Programmable Gate Array. The function may be realized as hardware by forming a gate array circuit in the same manner as the FPGA. Further, the function may be realized by an ASIC (Application Specific Integrated Circuit). Note that the configuration of the functional blocks shown in FIG. 5 is an example, and a plurality of functional blocks may be configured as one functional block, or any one functional block may be divided into blocks that perform a plurality of functions.

[0050] The attitude detection unit 501 detects the tilt angle of the imaging device 101 by the sensor unit 208 included in the imaging device 101. Specifically, the attitude detection unit 501 calculates and detects the tilt angle of the imaging device 101 based on data acquired from the sensor unit 208 having a gyro sensor for calculating the three axes of XYZ or the six axes for calculating the angle vector.

[0051] The drive vector reception unit 502 receives an instruction to change the shooting angle of view of the imaging device 101 from any one of the input device 110, the input device 103, and the input device 108. For example, the drive vector reception unit 502 receives and acquires an instruction to change in either the pan direction or the tilt direction. Note that, in the case where there is no correction of the change instruction by the drive vector correction unit 503 described later, the drive vector reception unit 502 may control the drive unit 207 in response to the change instruction to change the direction of the imaging device 101.

[0052] The drive vector correction unit 503 corrects the instruction to change the shooting angle of view (or shooting range) in the drive vector receiving unit 502 based on the information of the attitude detection unit 501. For example, the drive vector correction unit 503 recalculates the instruction to change the shooting angle of view of the user based on the gravity vector based on the tilt angle of the imaging device 101 detected by the attitude detection unit 501 and the drive vector received by the drive vector receiving unit 502, and corrects the instruction to change the shooting angle of view. The drive vector correction unit 503 controls the drive unit 207 based on the corrected change instruction to change the direction of the imaging device 101, thereby changing the shooting angle of view (or shooting range).

[0053] FIG. 6 is a diagram for recalculating the change instruction of the user by the drive vector by the drive vector correction unit 503 based on the gravity vector reference.

[0054] FIG. 6(a) shows that the imaging device 101 is installed on a tilted tripod and is tilted. FIG. 6(a) shows the gravity vector detected when tilted and the angle of tilt of the imaging device 101 to be obtained. FIG. 6(a) shows, as an example, the angle of tilt of the imaging device 101 when the gravity vector is tilted with respect to the tilt direction.

[0055] FIG. 6(b) shows that an instruction to change the shooting angle of view of the imaging device 101 is given by, for example, a joystick provided in the input device 110. FIG. 6(b) shows a state in which an instruction to change the shooting angle of view is given in the pan direction.

[0056] FIG. 6(c) is a diagram showing the correction of the instruction to change the shooting angle of view. Specifically, FIG. 6(c) shows the drive vector of the imaging device 101 when driving in at least one of the pan direction and the tilt direction after correcting the instruction to change the shooting angle of view in FIG. 6(b) using the angle of tilt of the gravity vector with respect to the tilt direction obtained in FIG. 6(a). More specifically, the drive vector of the imaging device 101 is corrected by shifting the vector by the angle obtained in FIG. 6(a) with respect to the change instruction from the input device 110.

[0057] (Operation Explanation) FIG. 7 is a flowchart showing an example of the operation of the imaging system according to the present embodiment. This operation is started when the CPU 204 reads a program stored in a storage medium such as the ROM 206 in the imaging device 101 and expands and executes the program using a memory such as the RAM 205 as a work area. Details of the operation will be described hereinafter.

[0058] In step S701, the attitude detection unit 501 detects the attitude of the imaging device 101. For example, when the imaging device 101 is fixed to a tripod or the like and installed at the shooting location and the power of the imaging device 101 is turned on, the drive vector reception unit 502 detects the tilt angle of the attitude of the imaging device 101. It is assumed that the attitude detection is performed, for example, every imaging frame period after the power is turned on, but it may be detected only when a specific operation is performed, such as when a video distribution request from the server device 102 is made to the imaging device 101.

[0059] In step S702, the drive vector reception unit 502 determines whether or not a pan / tilt operation instruction from the user is received via the input device 110 or the like. If the drive vector reception unit 502 determines that an operation instruction has been received, it proceeds to step S703, and if it determines that no operation instruction has been received, it proceeds to step S701.

[0060] In step S703, the drive vector correction unit 503 calculates the tilt angle of the imaging device 101 from the attitude information acquired in step S701, and corrects the vector of the pan / tilt operation instruction acquired in step S702 by that angle.

[0061] Thereafter, it proceeds to step S704, and the drive vector correction unit 503 pan / tilt drives the drive unit 207 based on the corrected pan / tilt operation instruction to change the shooting angle of view of the imaging device 101. Here, the drive vector correction unit 503 uses the attitude information only for vector correction of the pan / tilt operation instruction, but it may be used in combination for roll correction of the image.

[0062] (Effect) FIG. 8 is a diagram for explaining the effect of the operation of the imaging system according to the present embodiment.

[0063] FIG. 8(a) is a diagram in which two subjects 81 and 82 exist on the stage, the imaging device 101 is installed in an inclined state, and only the lower right subject 81 is included in the angle of view. At the lower right of FIG. 8(a), an operator 83 who operates the imaging device 101 using the input device 110 is shown. In order to include the subject 82 in the left back, which is outside the imaging range 84, in the imaging range 84, the operator 83 changes the imaging angle to the subject 82 in the left back from this state. At this time, the subject 82 in the left back is not within the imaging device 101, and the direction of the instruction to change the imaging angle is determined by the operator's visual observation. In such a scene, it is explained how the imaging angle behaves when the present proposal is applied and when it is not applied.

[0064] FIG. 8(b) shows the change in the imaging angle when the present proposal is not applied. Since the imaging device 101 is inclined, it shows that the imaging range 84 has moved to a position shifted by the amount of the angular deviation of the imaging device 101, which is different from the operator's intention.

[0065] FIG. 8(c) shows the change in the imaging angle when the present proposal is applied. Since the operator corrects the instruction to change the imaging angle by the amount of the inclination angle of the imaging device 101, it shows that the imaging range 84 is changed as intended by the operator 83.

[0066] As described above, by performing the control in the first embodiment, the imaging system 100 can reduce the occurrence of an unintended imaging angle deviation of the operator when changing the imaging angle even in a state where the imaging device 101 is inclined and the imaging device 101 is not strictly leveled. Thereby, the first embodiment can realize the change to the imaging angle intended by the operator with high accuracy.

[0067] In the first embodiment, since the angle with respect to the easily detectable gravity vector is detected as the inclination angle of the imaging device 101, the inclination angle can be detected with higher accuracy.

[0068] <Second Embodiment> Since the imaging system including the imaging device according to this embodiment and the device configuration of the imaging device according to this embodiment are the same as those of the first embodiment, the description thereof will be omitted.

[0069] (Functional Configuration) FIG. 9 is a functional block diagram showing an example of the functional configuration of the imaging device 101 according to this embodiment. It is a configuration in which a correction selection unit 901 is added as compared with FIG. 5. The correction selection unit 901 selects whether to perform the correction process in the first embodiment. Note that the mode in which the correction process is executed is an example of the first mode, and the mode in which the correction process is not executed is an example of the second mode. The selection of whether or not to perform the correction process is made according to a selection instruction of the user via any one of the input device 110, the input device 103, and the input device 108. It is assumed that the correction selection unit 901 determines whether or not the correction process has been selected by the user based on a selection instruction depending on whether or not a specific selection button provided in the input device has been pressed by the user.

[0070] (Operation Explanation) FIG. 10 is a flowchart showing an example of the operation of the imaging system according to this embodiment. This operation is started by the CPU 204 reading a program stored in a storage medium such as the ROM 206 in the imaging device 101 and reading and executing the program using a memory such as the RAM 205 as a work area. The description of the same processing as in FIG. 7 will be omitted.

[0071] In step S1001, the correction selection unit 901 calculates the tilt angle of the imaging device 101 from the attitude information acquired in step S701, and selects whether to execute a process of correcting the vector of the pan / tilt operation instruction acquired in step S702 by that angle. This selection is made according to an instruction of the user, and the correction selection unit 901 determines based on, for example, the pressing state of a specific button of the input device 110.

[0072] (Validity of Correction Enable / Disable Selection) FIG. 11 is a diagram for explaining the effect of the operation of the imaging system according to the present embodiment. FIG. 11(a) shows a state where two subjects 111 and 112 exist on the stage, the imaging device 101 is installed in an inclined state, and only the subject 112 in the left back is within the imaging range 114. Also shown in the lower right of FIG. 11(a) is an operator 113 who operates the imaging device 101 using the input device 110. From this state, the operator 113 changes the imaging angle so that the subject 112 in the left back is centered in the imaging angle of view. At this time, the subject 112 in the left back is within the imaging range 114, and the operator 113 determines the direction of the instruction to change the imaging angle while looking at the video displayed on the monitor. In such a scene, it is explained how the imaging angle behaves when the present proposal is applied and when it is not applied.

[0073] FIG. 11(b) shows the change in the imaging angle when the present proposal is not applied. Although the imaging device 101 is inclined, since the operator 113 gives an instruction to change the imaging angle while looking at the video of the inclined imaging device 101, it shows that the imaging range 114 moves to the position as the operator 113 intends. In addition, when the imaging range 114 is inclined with respect to the horizontal direction and the vertical direction due to the movement, the angle of view may be corrected so as to correct the inclination. FIG. 11(c) shows the change in the imaging angle when the present proposal is applied. Although the change instruction of the imaging angle indicated by the operator 113 is corrected by the inclination angle of the imaging device 101, since the operator 113 gives a change instruction based on the video with the inclined angle of view, correction is applied to a place where correction is not necessary, indicating that the imaging range 114 is changed to a position different from the operator's intention.

[0074] From the above, by performing the control in the second embodiment, the user can select whether to correct the change instruction of the imaging angle. As a result, in the second embodiment, it is possible to apply the correction of the change instruction of the imaging angle according to the user's selection. Therefore, the second embodiment can avoid unnecessary correction and realize a more appropriate change of the angle of view.

[0075] <Other Embodiments> In the above-described first and second embodiments, the imaging device 101 has been described as performing correction control. However, the server device 102 may perform the correction control. In that case, it is realized by the CPU 401 of the server device 102 reading a program stored in a storage medium such as the ROM 403 in the server device 102 and expanding and executing the program in a memory such as the RAM 402. Further, the imaging device 101 shall be transmitted to the server device 102 as metadata or the like on the video data.

[0076] Also, in the case of a four-lens imaging device, the user interface for panning operation peculiar to four lenses may be made inoperable.

[0077] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and by one or more processors in the computer of the system or device reading and executing the program. Further, it can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0078] The disclosure of this specification includes the following information processing apparatus, imaging system, information processing method, and program. (Item 1) Detection means for detecting the tilt angle of the posture of an imaging device that images a subject, Receiving means for receiving an instruction to change the shooting angle of view of the imaging device, Correction means for executing a correction process for correcting the instruction to change the shooting angle of view based on the detected tilt angle, An information processing apparatus comprising the above. (Item 2) Selection means for selecting either a first mode in which the correction process is executed and a second mode in which the correction process is not executed The information processing apparatus according to Item 1, comprising the above. (Item 3) The selection means selects either the first mode or the second mode based on a selection instruction from a user The information processing apparatus according to item 2, characterized in that... (Item 4) The selection means selects according to the selection instruction of the user input by pressing a selection button provided on the input device. The information processing apparatus according to item 3, characterized in that... (Item 5) The detection means detects the angle with respect to the direction of the gravity vector as the tilt angle of the imaging device. The information processing apparatus according to any one of items 1 to 4, characterized in that... (Item 6) The imaging device, The information processing apparatus according to item 1, An imaging system characterized by comprising... (Item 7) A detection step of detecting the tilt angle of the posture of the imaging device that images a subject, A reception step of receiving an instruction to change the shooting angle of view of the imaging device, A correction step of executing a correction process for correcting the instruction to change the shooting angle of view based on the detected tilt angle, An information processing method characterized by comprising... (Item 8) A program for causing a computer to function as each means of the information processing apparatus according to any one of items 1 to 5.

[0079] The invention is not limited to the above embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, claims are attached to disclose the scope of the invention.

Explanation of Signs

[0080] 100... Imaging system, 101... Imaging device, 201... Imaging unit, 501... Posture detection unit, 502... Drive vector reception unit, 503... Drive vector correction unit, 901... Correction selection unit.

Claims

1. Detection means for detecting the tilt angle of the posture of an imaging device that images a subject; Receiving means for receiving an instruction to change the shooting angle of view of the imaging device; Correction means for executing a correction process for correcting the instruction to change the shooting angle of view based on the detected tilt angle; An information processing apparatus, characterized by comprising the above.

2. Selection means for selecting either a first mode in which the correction process is executed or a second mode in which the correction process is not executed The information processing apparatus according to claim 1, characterized by comprising the above.

3. The selection means selects either the first mode or the second mode based on a selection instruction from the user The information processing apparatus according to claim 2, characterized by the above.

4. The selection means selects based on the selection instruction of the user input by pressing a selection button provided on an input device The information processing apparatus according to claim 3, characterized by the above.

5. The detection means detects the angle with respect to the direction of the gravity vector as the tilt angle of the imaging device The information processing apparatus according to claim 1, characterized by the above.

6. The imaging device; The information processing apparatus according to claim 1; An imaging system, characterized by comprising the above.

7. A detection step of detecting the tilt angle of the posture of an imaging device that images a subject; A receiving step of receiving an instruction to change the shooting angle of view of the imaging device; A correction step of executing a correction process for correcting the instruction to change the shooting angle of view based on the detected tilt angle; An information processing method, characterized by comprising the above.

8. A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 5.

Images