Information processing device, information processing method, and program

JP7631166B2Active Publication Date: 2025-02-18CANON KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021169109
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-10-14
Publication Date
2025-02-18
Estimated Expiration
2041-10-14

Smart Images

  • Figure 0007631166000001
    Figure 0007631166000001
  • Figure 0007631166000002
    Figure 0007631166000002
  • Figure 0007631166000003
    Figure 0007631166000003
Patent Text Reader

Abstract

To provide a technology for enabling a user to grasp an imaging range that can actually move within a designated moving time.SOLUTION: An information processing device acquires information of a moving time for controlling a current imaging range from the imaging range of an imaging device on the basis of user operation, and displays a first window including information indicating a movable range being a range calculated according to the moving time based on the acquired information and a moving speed being a changeable speed in the case of changing the imaging range of the imaging device and being a range in which the imaging range can arrive within the moving time in display means.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is a technique for changing an imaging range of an imaging device that captures an image by controlling at least one of panning and tilting of the imaging device.

[0003] There is also a shot function as a function for controlling the imaging device. The shot function is a function in which a moving time to a target imaging range, which is an imaging range to be reached, is specified, and the imaging range of the imaging device is controlled from the current imaging range to the specified target imaging range, and the target imaging range is reached within the specified moving time. Furthermore, some imaging devices are capable of holding multiple target imaging ranges.

[0004] Patent Document 1 discloses a method for controlling the pan and tilt of an imaging device so that the imaging device reaches a destination position from a current position within a time designated by a user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2007-282069 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, in Patent Document 1, the user does not know the imaging range that can actually be moved by pan and tilt in the specified movement time, and it may not be possible to control the imaging range to a target imaging range specified by the user in the movement time specified by the user.

[0007] Therefore, an object of the present invention is to provide a technique that enables a user to grasp an imaging range that can actually be moved within a specified movement time. [Means for solving the problem]

[0008] In order to solve the above problems, the information processing device of the present invention has the following configuration. That is, the imaging range is changed by controlling at least one of panning and tilting. Move to the target imaging area 1 is an information processing apparatus that displays information about an imaging device that can be used for an image capturing apparatus on a display means, the information processing apparatus comprising: When moving to the target imaging range, the distance from the imaging range to the target imaging range The imaging device has an acquisition means for acquiring information specifying a movement time, and a display control means for causing a display means to display a first window including information indicating a movable range, which is a range calculated according to the movement time based on the information acquired by the acquisition means and a movable speed, which is a changeable speed when changing the imaging range of the imaging device, and is a range that the imaging range can reach within the movement time. Effect of the Invention

[0009] According to the present invention, the user can grasp the imaging range that can actually be moved within the designated movement time. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 illustrates an example of a system configuration. [Diagram 2] FIG. 1 is a diagram illustrating an example of the appearance of an imaging device. [Diagram 3] FIG. 2 is a diagram illustrating an example of functional blocks of an imaging device and an information processing device. [Figure 4] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Diagram 5] 13 is a flowchart showing a process for displaying information about a movable range. [Figure 6] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 7] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 8] 13 is a flowchart showing a process for displaying information about a movable range. [Figure 9] FIG. 2 illustrates an example of a hardware configuration of each device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples and are not limited to the configurations shown in the drawings.

[0012] (Embodiment 1) 1 is a diagram showing the system configuration of this embodiment. The system of this embodiment includes an image capturing device 100, an information processing device 200, a display 210, and a network 300.

[0013] The imaging device 100 and the information processing device 200 are connected to each other via a network 300. The network 300 is realized by a plurality of routers, switches, cables, etc., that comply with a communication standard such as ETHERNET (registered trademark).

[0014] The network 300 may be realized by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like.

[0015] The imaging device 100 is a device for capturing an image, and functions as an imaging unit capable of changing the imaging range by controlling at least one of pan, tilt, and zoom. The imaging device 100 transmits image data of the captured image, information on the imaging date and time when the image was captured, identification information for identifying the imaging device 100, and information on the imaging range of the imaging device 100 to an external device such as an information processing device 200 via a network 300. The information processing device 200 is, for example, a client device such as a personal computer in which a program for realizing the function of the processing described later is installed. Note that, in the system according to the present embodiment, the imaging device 100 is one, but may be multiple. That is, multiple imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 determines which of the multiple imaging devices 100 captured the transmitted image, for example, by using identification information associated with the transmitted image.

[0016] The display 210 is configured with an LCD (Liquid Crystal Display) or the like, and displays images captured by the imaging device 100. The display 210 is connected to the information processing device 200 via a display cable that complies with a communication standard such as HDMI (High Definition Multimedia Interface) (registered trademark). The display 210 and the information processing device 200 may be provided in a single housing.

[0017] Next, the imaging device 100 according to the present embodiment will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is an example of an external view of the imaging device 100 according to the present embodiment. Fig. 3 is an example of a functional block of the imaging device 100 and the information processing device 200 according to the present embodiment. Among the functional blocks of the imaging device 100 shown in Fig. 3, the functions of the image processing unit 112, the system control unit 113, the pan-tilt-zoom control unit 114, the storage unit 115, the communication unit 116, etc. are realized as follows. That is, the functions are realized by a CPU (Central Processing Unit) 900 of the imaging device 100 executing a computer program stored in a ROM (Read Only Memory) 920 of the imaging device 100, which will be described later with reference to Fig. 9.

[0018] The direction in which the optical axis of the lens 101 faces is the imaging direction of the imaging device 100, and a light beam that passes through the lens 101 forms an image on an imaging element of an imaging section 111 of the imaging device 100. In addition, the lens driving section 102 is configured with a drive system that drives the lens 101, and changes the focal length of the lens 101. The lens driving section 102 is controlled by a pan-tilt-zoom control section 114.

[0019] The pan driving unit 103 is composed of a mechanical driving system that performs panning and a motor that is a driving source, and drives to perform control to perform rotational driving for rotating the imaging direction of the imaging device 100 in a pan direction 105. The pan driving unit 103 is also controlled by a pan-tilt-zoom control unit 114.

[0020] The tilt driving unit 104 is composed of a mechanism driving the tilt operation and a motor of a driving source, and drives to control rotation driving for rotating the imaging direction of the imaging device 100 in a tilt direction 106. The tilt driving unit 104 is controlled by a pan-tilt-zoom control unit 114.

[0021] The imaging unit 111 is composed of an imaging element (not shown) such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 photoelectrically converts the subject image formed through the lens 101 to generate an electric signal. The image processing unit 112 performs image processing such as a process of converting the electric signal photoelectrically converted in the imaging unit 111 into a digital signal and a compression encoding process, and generates image data that is data of the captured image.

[0022] The pan-tilt-zoom control unit 114 controls the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 based on an instruction transmitted from the system control unit 113, thereby controlling the pan, tilt, and zoom of the imaging device 100. The storage unit 115 stores (holds) information indicating an imaging range, for example. It also stores information on a target imaging range in the shot function.

[0023] The communication unit 116 communicates with the information processing device 200 via an I / F 940, which will be described later with reference to Fig. 9. For example, the communication unit 116 transmits image data of an image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 also transmits information indicating the current imaging range of the imaging device 100. The communication unit 116 also receives a control command, which is a command for controlling the imaging device 100, transmitted from the information processing device 200, and transfers the control command to the system control unit 113.

[0024] The system control unit 113 controls the entire imaging device 100 according to processing executed by the CPU 900, which will be described later with reference to Fig. 9, and performs, for example, the following processing. That is, the system control unit 113 analyzes a control command for controlling the imaging device 100 transmitted from the information processing device 200, and performs processing according to the control command. The system control unit 113 also instructs the pan-tilt-zoom control unit 114 to perform a pan-tilt-zoom operation. When transmitting image data generated by the image processing unit 112 to the information processing device 200, the system control unit 113 also adds information on the imaging time when the image data was captured and information on the imaging range to the image data.

[0025] The imaging range in this embodiment is determined by the pan value, tilt value, and zoom value of the imaging device 100. The pan value is the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging device 100 when, for example, one of the driving ends of the pan driving unit 103 is set to 0°. The tilt value is the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging device 100 when, for example, one of the driving ends of the tilt driving unit 104 is set to 0°. The zoom value of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.

[0026] Next, information processing of the information processing device 200 according to this embodiment will be described with reference to the functional blocks of the information processing device 200 shown in Fig. 3. Note that each function of the information processing device 200 is realized as follows using a ROM 920 and a CPU 900, which will be described later with reference to Fig. 9. That is, each function shown in Fig. 3 is realized by the CPU 900 of the information processing device 200 executing a computer program stored in the ROM 920 of the information processing device 900.

[0027] The display control unit 201 causes the display 210 to display an image captured by the imaging device 100 and a GUI (Graphical User Interface) for settings related to a shot function. The operation reception unit 202 receives information on operations by a user via an input device (not shown) such as a keyboard, a mouse, or a touch panel. The input unit assumes a button, a mouse, a joystick, or the like, and receives various operations by the user. Here, for example, the display control unit 201 causes the display 210 to display a GUI for making settings related to the shot function, and the operation reception unit 202 receives information on user operations on the GUI displayed on the display 210. The system control unit 203 transmits a control command to the remote camera via the communication unit 204 in response to the user's operation.

[0028] The communication unit 204 transmits various setting commands and control commands for the imaging device 100 transmitted from the system control unit 203 to the imaging device 100 via an I / F 940 described later with reference to Fig. 9. The communication unit 204 also receives image data transmitted from the imaging device 100 and responses from the imaging device 100 to commands transmitted from the information processing device 200 to the imaging device 100, and transmits them to the system control unit 203. The storage unit 205 also stores information related to the shot function, image data of images acquired by the communication unit 204, and the like.

[0029] The system control unit 203 generates various setting commands and control commands based on the user operation accepted by the operation acceptance unit 202 , and transmits them to the imaging device 100 via the communication unit 204 .

[0030] A GUI for setting the shot function displayed on the display 210 by the display control unit 201 in this embodiment will now be described with reference to Fig. 4. The GUI 400 shown in Fig. 4 is a GUI that presents information on a movable range, which is a range that the imaging range can reach in a specified movement time, and allows settings related to the shot function.

[0031] As shown in FIG. 4, the GUI 400 displayed on the display 210 by the display control unit 201 includes a window 401 (second window) for displaying an image based on image data transmitted from the imaging device 100. Note that the image based on the image data is an image obtained by decoding the image data, for example, when an image captured by the imaging device 100 is subjected to an encoding process to generate image data and transmitted to the information processing device 200. Here, for example, the system control unit 203 may execute a process of decoding the image data to obtain an image based on the image data. Note that the image displayed in the window 401 may be a still image captured by the imaging device 100, or a video consisting of a series of captured images. In this embodiment, it is assumed that a video captured by the imaging device 100 is distributed to the information processing device 200 in real time, and the video is displayed in the window 401 in real time.

[0032] A window 402 (first window) in the GUI 400 displays a predetermined image corresponding to a reachable range (hereinafter, drive limit range) when each of the pan, tilt, and zoom of the imaging device 100 is controlled to the drive limit. As the predetermined image, for example, an image filled with a predetermined color indicating a driveable range of the imaging range may be used, or a panoramic image consisting of a plurality of images captured while changing the pan and tilt by a predetermined amount may be used. Note that a known technique is used for generating the panoramic image. Also, a frame 406 indicating the current imaging range of the imaging device 100 in the drive limit range is displayed in the window 402. That is, the frame 406 corresponds to the position and size of the current imaging range in the drive limit range. At this time, an image obtained by capturing the imaging range of the frame 406 is displayed in the window 401. Also, information indicating a movable range, which is a range calculated according to a moving time designated by the user in the input field 413 and a movable speed, which is a speed at which the imaging range of the imaging device 100 can be changed, is displayed in the window 402. In other words, the movable range indicates a range that the imaging range can reach with the current imaging range as a starting position in a specified moving time. In the example shown in FIG. 4, the display control unit 201 displays a figure 403 indicating the movable range as information indicating the movable range on a predetermined image (for example, a panoramic image) corresponding to the driving limit range by superimposing it. In the example shown in FIG. 4, the figure 403 is filled with gray, but it may be filled with another predetermined color or may be semi-transparent. An arbitrary position on the outer boundary 404 of the figure 403 corresponding to the movable range is assumed to be the center of gravity of the reachable imaging range when the imaging range is changed from the current imaging range in an arbitrary fixed direction at the highest speed in a specified moving time. An arbitrary position on the inner boundary 405 of the figure 403 corresponding to the movable range is assumed to be the center of gravity of the reachable imaging range when the imaging range is changed from the current imaging range in an arbitrary fixed direction at the lowest speed in a specified moving time. That is, in the example shown in FIG. 4, as long as the center of gravity of the target imaging range is included in the doughnut-shaped figure 403 corresponding to the movable range, it is possible to reach the target imaging range from the current imaging range within the specified movement time.That is, when the center of gravity of the target imaging range is included in the graphic 403, the target imaging range can be reached from the current imaging range in the specified travel time. The calculated movable range is not limited to the range of the center of gravity of the imaging range that can be reached from the current imaging range in the specified travel time, but may be, for example, a range that includes the entire imaging range that can be reached from the current imaging range in the specified travel time. In addition, if the travel time is changed while the graphic 403 corresponding to the movable range is displayed, the movable range is also dynamically changed, and the size of the graphic 403 corresponding to the movable range is also changed accordingly.

[0033] Here, the process of calculating the movable range will be described. The system control unit 203 in this embodiment calculates the movable range according to the movable speed, which is the changeable speed when changing the imaging range, and the moving time specified by the user. Note that the movable speed includes a pan speed range, which is the speed range when the imaging direction is controlled in the pan direction 105 of the pan driving unit 103, and a tilt speed range, which is the speed range when the imaging direction is controlled in the tilt direction 106 of the tilt driving unit 104. The calculation process of the movable range will be described below.

[0034] First, the system control unit 203 calculates a range that can be moved from the current imaging range to the pan direction 105 in the movement time based on the pan speed range, which is a speed range when the imaging direction is controlled in the pan direction 105 of the pan driving unit 103, and the movement time specified by the user. The range that can be moved in the pan direction 105 is set as a pan movement range. Note that information on the pan speed range determined by the upper and lower limit values ​​of the speed when the imaging device 100 controls the imaging direction in the pan direction 105 is held in advance by the system control unit 203, but may be transmitted from the imaging device 100. Here, it is assumed that the lower limit value of the pan speed range is 1 [degree / second], the upper limit value is 20 [degree / second], and the movement time specified by the user is 5 [seconds]. In this case, the system control unit 203 calculates 5 [degrees], which is the absolute value of the lower limit of the pan movement range, by multiplying the movement time by the lower limit value of the pan speed range. Similarly, the system control unit 203 multiplies the movement time by the upper limit of the pan speed range to derive 100[degrees], which is the absolute value of the upper limit of the pan movement range. Then, for example, the pan movement range α when the pan value of the center of gravity position of the current imaging range is set as the origin is calculated as -100<α<-5, 5<α<100. Note that a positive sign is assigned to one displacement direction with respect to the origin, and a negative sign is assigned to the other displacement direction.

[0035] Then, the system control unit 203 executes the following process. That is, based on the tilt speed range, which is the speed range when the imaging direction is controlled in the tilt direction 106 of the tilt driving unit 104, and the movement time specified by the user, the system control unit 203 calculates the range in which the imaging direction can be moved from the current imaging range to the tilt direction 106 in the movement time. Note that the information on the tilt speed range determined by the upper and lower limit values ​​of the speed when the imaging device 100 controls the imaging direction in the tilt direction 106 is held in advance by the system control unit 203, but may be transmitted from the imaging device 100. Here, it is assumed that the lower limit value of the tilt speed range is 1 [degree / second], the upper limit value is 10 [degree / second], and the movement time specified by the user is 5 [seconds]. In this case, the system control unit 203 calculates 5 [degrees], which is the absolute value of the lower limit of the tilt movement range, by multiplying the movement time by the lower limit value of the tilt speed range. Similarly, the system control unit 203 multiplies the movement time by the upper limit of the tilt speed range to derive 50[degrees], which is the absolute value of the upper limit of the tilt movement range. Then, for example, the tilt movement range β when the tilt value of the center of gravity position of the current imaging range is set as the origin is calculated as -50<β<-5, 5<α<50. Note that a positive sign is assigned to one displacement direction with respect to the origin, and a negative sign is assigned to the other displacement direction.

[0036] The system control unit calculates the movable range by using the calculated pan movable range α and tilt movable range β as described above. That is, a rectangular range consisting of the pan movable range α in the horizontal direction (pan direction 105) and the tilt movable range β in the vertical direction (tilt direction 106) when the origin of the current imaging range is set to 0 degrees is calculated as the movable range. In the example shown in FIG. 4, the horizontal range on the graphic 403 corresponding to the movable range corresponds to the pan movable range α, and the vertical range on the graphic 403 corresponds to the tilt movable range β. Note that, in this embodiment, the zoom speed range, which is the range of the speed for changing the zoom value, is larger than the pan speed range and the tilt speed range. That is, if the reachable range is for panning and tilting, it is also assumed that the reachable range is also for zooming. Therefore, in the example shown in FIG. 4, if the graphic 403 corresponding to the movable range includes the center of gravity position of the target imaging range, it is assumed that the target imaging range can be reached from the current imaging range in the specified movement time regardless of the zoom value of the target imaging range. Note that the movable range may be calculated taking into account the zoom speed range.

[0037] As shown in FIG. 4, a frame indicating the position and size of each of one or more target imaging ranges set in advance by the user is superimposed on the window 402. In the example shown in FIG. 4, frames 407-409 indicating the position and size of each of three target imaging ranges are superimposed on a predetermined image (panoramic image). At this time, the display control unit 201 may change the display mode of the frames 407-409 corresponding to each of the three target imaging ranges depending on whether or not they can be reached from the current imaging range in a specified moving time (in other words, depending on whether or not they are included in a movable range). Specifically, the display control unit 201 displays the frame 408 included in the figure 403 corresponding to the movable range in a first display mode. At this time, since the frame 407 is included in the figure 403, it indicates that the target imaging range corresponding to the frame 407 can be reached from the current imaging range in the specified moving time. Furthermore, since the frame 407 and the frame 409 are not included in the figure 403 corresponding to the movable range, the display control unit 201 indicates that the target imaging ranges corresponding to the frames 407 and 409 cannot be reached from the current imaging range in the designated movement time. As a result, the display control unit 201 displays the frames 407 and 409 in a second display mode different from the first display mode. Note that the display control unit 201 may change the display mode of the frames 407 and 409 corresponding to the target imaging ranges that cannot be reached in the currently designated movement time depending on whether the pan or tilt cannot be reached in the movement time. For example, the display mode of the frames may be changed between a case where the pan cannot be reached in time in the movement time and a case where the tilt cannot be reached in time in the movement time.

[0038] Note that in this embodiment, when the movable range includes the center of gravity of the target imaging range (when the center of gravity of the frame of the target imaging range is included in graphic 403), the system control unit 203 determines that the frame of the target imaging range is included in graphic 403 and that the target imaging range is reachable. On the other hand, when the movable range does not include the center of gravity of the target imaging range (when the center of gravity of the frame of the target imaging range is not included in graphic 403), the system control unit 203 determines that the frame of the target imaging range is not included in graphic 403 and that the target imaging range is not reachable.

[0039] 4, the display control unit 201 displays list information 410 in the GUI 400. The list information 410 includes, for each of one or more target imaging ranges set by the user, movable information 411 indicating whether the target imaging range is reachable in the currently specified movement time, and an ID 412 specifying the target imaging range. The movable information 411 of the list information 410 shown in FIG. 4 indicates that the target imaging range of frame 407 with ID 412 "1" and the target imaging range of frame 409 with ID 412 "2" cannot be moved. On the other hand, the movable information 411 indicates that the target imaging range of frame 408 with ID 412 "3" is movable.

[0040] Next, a process of displaying information on a movable range in this embodiment will be described with reference to the flow shown in Fig. 5. Note that the process of the flow shown in Fig. 5 is executed by the functional blocks of the information processing device 200 shown in Fig. 4, which are realized by the CPU 900 of the information processing device 200 executing a computer program stored in the ROM 920 of the information processing device 200, for example.

[0041] First, in S501, the system control unit 203 determines whether the user has specified a travel time in the input field 413, and if it is determined that the travel time has been specified (Yes in S501), the system control unit 203 transitions to S502. On the other hand, if it is determined that the travel time has not been specified (No in S501), the system control unit 203 repeats the determination process of S501.

[0042] Next, in S502, the system control unit 203 calculates the pan movement range based on the pan speed range and the designated movement time. Here, it is assumed that the lower limit value of the pan speed range is 1 [degree / second], the upper limit value is 20 [degree / second], and the movement time designated by the user is 5 [seconds]. In this case, the system control unit 203 calculates 5 [degrees], which is the absolute value of the lower limit of the pan movement range, by multiplying the movement time by the lower limit value of the pan speed range. Similarly, the system control unit 203 derives 100 [degrees], which is the absolute value of the upper limit of the pan movement range, by multiplying the movement time by the upper limit value of the pan speed range. Then, for example, the pan movement range α when the pan value of the center of gravity position of the current imaging range is set as the origin is calculated as -100<α<-5, 5<α<100.

[0043] Next, in S503, the system control unit 203 calculates the tilt movement range based on the tilt speed range and the designated movement time. Here, it is assumed that the lower limit value of the tilt speed range is 1 [degree / second], the upper limit value is 10 [degree / second], and the movement time designated by the user is 5 [seconds]. In this case, the system control unit 203 calculates 5 [degrees], which is the absolute value of the lower limit of the tilt movement range, by multiplying the movement time by the lower limit value of the tilt speed range. Similarly, the system control unit 203 derives 50 [degrees], which is the absolute value of the upper limit of the tilt movement range, by multiplying the movement time by the upper limit value of the tilt speed range. Then, for example, the tilt movement range α when the tilt value of the center of gravity position of the current imaging range is set as the origin is calculated as -50<α<-5, 5<α<50.

[0044] Next, in S504, the system control unit 203 calculates a movable range in accordance with the calculated pan movable range and tilt movable range.

[0045] Next, the process from S505 to S509 is executed for the number of target imaging ranges designated in advance by the user after initializing i to 0. First, in S506, the system control unit 203 judges whether the center of gravity position of the target imaging range i is included in the movable range. If it is judged that the center of gravity position of the target imaging range i is included (Yes in S506), the process proceeds to S507 and the target imaging range i is added to the movable list. On the other hand, if it is judged that the center of gravity position of the target imaging range i is not included (No in S506), the process proceeds to S508 and the system control unit 203 adds the target imaging range i to the non-movable list. Then, the process proceeds to S509, where the system control unit 203 increments i and returns to S505. When the process is completed for all the target imaging ranges, the process proceeds to S510. In S510, the display control unit 201 causes the display 210 to display the GUI 400 shown in FIG. 4 including the calculated movable range and a frame corresponding to the designated target imaging range.

[0046] As described above, the information processing device 200 in this embodiment calculates a movable range from the current imaging range according to the movable speed, which is a changeable speed when changing the imaging range, and the movement time designated by the user. Then, the information processing device 200 displays information on the movable range on the display 210. In this way, the user can grasp the imaging range that can actually be moved within the designated movement time.

[0047] In the example shown in FIG. 4, a figure 403 corresponding to the movable range calculated taking into consideration the lower limit of the pan speed range and the lower limit of the tilt speed range is displayed. For example, assume that the pan speed range is 1 to 20 [deg / sec] and the movement time is 5 [sec]. In this case, the absolute value of the lower limit of the pan movable range is 5 [deg], which is the product of the lower limit of the pan speed range, 1 [deg / sec], and the movement time, 5 [sec]. In the example shown in FIG. 4, the center of gravity of the current imaging range is set to 0 degrees, and the range up to 5 degrees left and right in the horizontal direction is treated as a range that cannot be moved in the specified movement time of 5 seconds. However, this is not limited to this. In other words, even if the lower limit of the pan speed range is 1 [deg / sec] and the movement time is 5 [sec], if the pan is controlled with pauses in between, it is possible to reach the target imaging range within the range of 5 degrees left and right in the horizontal direction from the current imaging range within that movement time.

[0048] Therefore, without being limited to the example shown in Fig. 4, the system control unit 203 in this embodiment may calculate the movable range according to the upper limit value of each of the pan speed range and the tilt speed range and the designated movement time without considering the lower limit value of each of the pan speed range and the tilt speed range. In the window 602 (first window) of the GUI 600 shown in Fig. 6, a figure 603 corresponding to the movable range calculated in this manner is superimposed.

[0049] (Embodiment 2) In this embodiment, the display mode of the movable range is changed in consideration of the speed (pan speed) at which the imaging direction is changed in pan direction 105 by the pan driving unit 103 and the speed (tilt speed) at which the imaging direction is changed in tilt direction 106 by the tilt driving unit 104. Note that in this embodiment, differences from the first embodiment will be mainly described, and components and processes that are the same as or equivalent to those in the first embodiment will be given the same reference numerals, and duplicated descriptions will be omitted.

[0050] 7 is displayed on the display 210 by the display control unit 201, and a predetermined image (such as a panoramic image) corresponding to the driving limit range is displayed in a window 701 (first window). Also, in the window 701, a frame 702 corresponding to the current imaging range and frames 703 to 705 corresponding to each of a plurality of target imaging ranges are displayed in a superimposed manner.

[0051] Here, the change speed of the imaging range when the shot function is executed varies depending on the specified time, the current imaging range, and the specified target imaging range. For example, at a certain specified time, the change speed from the current imaging range to a target imaging range at a farther position is faster than the change speed from the current imaging range to a target imaging range at a closer position. If the change speed of the imaging range is faster when the shot function is executed, the subject in the captured image may be blurred, and the quality of the image may also be reduced. Therefore, in this embodiment, the display mode of the figure indicating the movable range displayed in the window 701 is made different depending on the change speed when the shot function is executed with the current imaging range as the starting point at the currently specified specified time. In the example shown in FIG. 7, the change speed when the shot function is executed becomes faster as the frame 702 corresponding to the current imaging range is the starting point, even if it is within the reachable movable range in the currently specified moving time of "5" seconds. Here, a first threshold value and a second threshold value larger than the first threshold value are set in advance. The display manner of the movable range is different depending on the range in which the change speed when the shot function is executed is less than the first threshold (low speed range 706), the range in which it is equal to or greater than the first threshold and less than the second threshold (optimum speed range 705), and the range in which it is equal to or greater than the second threshold (high speed range 707).

[0052] In this way, it is possible to present to the user not only information about the range that can be reached within the specified time, but also information about a range that is appropriate from the viewpoint of the quality of the captured image.

[0053] (Embodiment 3) In the first embodiment, the calculation of the movable range and the process of determining whether the target imaging range is included in the movable range are executed by the information processing device 200, but in this embodiment, these processes are executed by the imaging device 100. Note that in this embodiment, the differences from the first embodiment will be mainly described, and the same reference numerals will be used to denote the same or equivalent components and processes as those in the first embodiment, and duplicated descriptions will be omitted.

[0054] Here, a process of displaying information on a movable range in this embodiment will be described with reference to the flow shown in Fig. 8. Note that the process of the flow shown in Fig. 8 is executed by the functional blocks of the information processing device 200 shown in Fig. 3, which is realized by the CPU 900 of the information processing device 200 executing a computer program stored in the ROM 920 of the imaging device 100, for example.

[0055] First, in S801, the system control unit 113 of the imaging device 100 acquires, from the information processing device 200, information on the movement time designated by the user in the information processing device 200.

[0056] Next, in S802, the system control unit 113 calculates a pan movement range based on the pan speed range and the designated movement time. Next, in S803, the system control unit 203 calculates a tilt movement range based on the tilt speed range and the designated movement time. Next, in S804, the system control unit 113 calculates a movable range according to the calculated pan movement range and tilt movement range. Next, the processing from S805 to S809 is executed as many times as the number of target imaging ranges designated in advance by the user after initializing i=0. First, in S806, the system control unit 113 determines whether the center of gravity position of the target imaging range i is included in the movable range. If it is determined that the center of gravity position of the target imaging range i is included (Yes in S806), the system control unit 113 transitions to S807 and adds the target imaging range i to the movable list. On the other hand, if it is determined that the center of gravity position of the target imaging range i is not included (No in S806), the system control unit 113 transitions to S808 and adds the target imaging range i to the non-movable list. Then, the process proceeds to S809, where the system control unit 113 increments i, and returns to S805. When the process is completed for all target imaging ranges, the process proceeds to S810. In S810, the system control unit 113 generates the GUI 400 shown in FIG. 4 including the calculated movable range and a frame corresponding to the specified target imaging range. Then, the system control unit 113 transmits information of the generated GUI 400 to the information processing device 200, thereby causing the generated GUI 400 to be displayed on the display 210 via the information processing device 200.

[0057] As described above, the imaging device 100 in this embodiment calculates a movable range from the current imaging range in accordance with the movable speed, which is a speed at which the imaging range can be changed, and the movement time designated by the user. Then, the imaging device 100 displays information on the movable range on the display 210. In this way, the user can grasp the imaging range that can actually be moved within the designated movement time.

[0058] (Other embodiments) Next, a hardware configuration of the information processing device 200 for realizing each function of the above-mentioned embodiment will be described with reference to Fig. 9. In the following description, the hardware configuration of the information processing device 200 will be described, but the imaging device 100 will also be realized by a similar hardware configuration.

[0059] The information processing device 200 in this embodiment includes a CPU 900, a RAM 910, a ROM 920, a HDD 930, and an I / F 940.

[0060] The CPU 900 is a central processing unit that controls the information processing device 200. The RAM 910 temporarily stores computer programs executed by the CPU 900. The RAM 910 also provides a work area used when the CPU 900 executes processing. The RAM 910 also functions as, for example, a frame memory or a buffer memory.

[0061] The ROM 920 stores programs and the like for the CPU 900 to control the information processing device 200. The HDD 930 is a storage device that records image data and the like.

[0062] The I / F 910 communicates with external devices via the network 300 in accordance with TCP / IP, HTTP, or the like.

[0063] In the above-described embodiments, an example is described in which the CPU 900 executes the processing, but at least a part of the processing of the CPU 900 may be executed by dedicated hardware. For example, the processing of displaying a GUI (GRAPHICAL USER INTERFACE) or image data on the display 210 may be executed by a GPU (GRAPHICS PROCESSING UNIT). Furthermore, the processing of reading program code from the ROM 920 and loading it in the RAM 910 may be executed by a DMA (DIRECT MEMORY ACCESS) that functions as a transfer device.

[0064] The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-mentioned embodiments. The program may be supplied to a system or device having a processor via a network or a storage medium. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions of the above-mentioned embodiments. Each unit of the information processing device 200 may be realized by hardware shown in FIG. 9, or by software. One or more functions of the information processing device 200 according to the above-mentioned embodiment may be provided by another device.

[0065] Although the present invention has been described above with reference to the embodiments, the above embodiments are merely examples of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these. In other words, the present invention can be embodied in various forms without departing from the technical concept or main features of the present invention. For example, combinations of the respective embodiments are also included in the disclosure of this specification. [Explanation of symbols]

[0066] 100 Imaging device 200 Information processing device 210 Display 201 Display control unit 203 System Control Unit

Claims

1. An information processing device that displays, on a display means, information about an imaging device that can move an imaging range to a target imaging range by controlling at least one of panning and tilting, an acquisition unit that acquires information designating a movement time from the imaging range to the target imaging range when moving to the target imaging range based on a user operation; a display control means for causing a display means to display a first window including information indicating a movable range, which is a range calculated according to the movement time based on the information acquired by the acquisition means and a movable speed which is a changeable speed when changing an imaging range of the imaging device, and is a range which the imaging range can reach within the movement time; 13. An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, further comprising a calculation means for calculating the movable range based on the moving time and the movable speed.

3. the movable speed corresponds to a pan speed range that is a speed range when controlling the pan and a tilt speed range that is a speed range when controlling the tilt, 3. The information processing apparatus according to claim 2, wherein the calculation means calculates the movable range in accordance with an upper limit of the pan speed range, an upper limit of the tilt speed range, and the movement time.

4. 4. The information processing apparatus according to claim 3, wherein the calculation means further calculates the movable range in accordance with a lower limit of the pan speed range and a lower limit of the tilt speed range.

5. An information processing device according to any one of claims 1 to 4, characterized in that when the information indicating the movable range is displayed in the first window, the information indicating the movable range displayed in the first window is also changed in accordance with the movement time being changed by the user.

6. 6. The information processing device according to claim 1, wherein the display control means displays, in the first window, frames corresponding to one or more target imaging ranges set by a user as target imaging ranges to be reached from a current imaging range.

7. The information processing device according to claim 6, characterized in that the display control means changes the display mode between a frame included in the movable range and a frame not included in the movable range, among the frames corresponding to each of the one or more target imaging ranges.

8. 8. The information processing apparatus according to claim 6, wherein the display means displays list information including, for each of the one or more target imaging ranges, identification information for identifying the target imaging range and information indicating whether the target imaging range is included in the movable range.

9. 9. The information processing apparatus according to claim 1, wherein the display control means controls the display means to display the first window and a second window in which an image captured by the imaging device is displayed side by side.

10. 7. The information processing apparatus according to claim 6, wherein the display control means causes a frame corresponding to the current imaging range to be displayed in the first window.

11. 1. An information processing method for displaying, on a display means, information about an imaging device capable of moving an imaging range to a target imaging range by controlling at least one of panning and tilting, comprising: an acquisition step of acquiring information designating a movement time from the imaging range to the target imaging range when moving to the target imaging range based on a user operation; a display control step of displaying, on a display means, a first window including information indicating a movable range, which is a range calculated according to the movement time based on the information acquired by the acquisition step and a movable speed which is a changeable speed when changing the imaging range of the imaging device, and is a range which the imaging range can reach within the movement time; 13. An information processing method comprising:

12. A computer program for causing a computer to function as each of the means of the information processing device according to at least one of claims 1 to 10.

Citation Information

Patent Citations

  • Universal head system

    JP2007282069A

  • Information processing system, presentation method, and program

    JP2015204525A

  • Image processing device and method thereof, and image processing system

    JP2016178534A