Control unit, control method, and program

JP2023073130A5Active Publication Date: 2024-11-12CANON KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021185977
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-11-15
Publication Date
2024-11-12
Estimated Expiration
2041-11-15

AI Technical Summary

Technical Problem

The existing methods for controlling the imaging range of an imaging device using optical PTZ require time-consuming adjustments to return to the starting position after trying various parameter patterns for shot functions, especially when higher resolution is desired.

Method used

A control method that includes a first control process for electronic PTZ to simulate the shot function and a second control process for optical PTZ to execute the desired parameters based on user adjustments, allowing for efficient execution of shot functions without prolonged processing times.

Benefits of technology

This method reduces the time required for processing shot functions by allowing immediate execution of optical PTZ based on user-set parameters, optimizing the imaging range adjustments.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

To prevent an increase in time required for processing related to trial of a shot function.SOLUTION: An information processing apparatus executes, for a predetermined image, a shot function in first control processing of sequentially changing the position or the size of a sub region to be cut out, based on first parameter information used in the shot function in the first control processing, sets second parameter information in a shot function in second control processing of driving at least one of panning, tilting, and zooming of imaging means, and executes the shot function in the second control processing according to the set second parameter information.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a method for controlling an imaging device. [Background technology]

[0002] Conventional technologies for controlling the imaging range of an imaging device that captures an image include optical PTZ and electronic PTZ. Optical PTZ is a technology that changes the imaging range of the imaging device by driving at least one of the mechanical mechanisms of the imaging device, which are pan, tilt, and zoom. Electronic PTZ is a technology that cuts out and outputs a partial area from an image captured by the imaging device, and virtually controls the imaging range by sequentially changing the position or size of the partial area corresponding to the imaging range.

[0003] There is also a shot function as a function for controlling the imaging device. The shot function specifies the time required for movement to an end imaging range, which is a target imaging range, and controls the imaging range of the imaging device from the start imaging range corresponding to the start position to the specified end imaging range, so that the imaging device reaches the end imaging range within the specified movement time.

[0004] Patent Document 1 discloses a method for controlling the pan and tilt of an imaging device so that the imaging device reaches a destination position from a current position within a time designated by a user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-282069 Summary of the Invention [Problem to be solved by the invention]

[0006] Generally, when using the shot function, it is sometimes desirable to use an optical PTZ camera, which has a higher resolution than an electronic PTZ camera. Prior to executing the shot function during this operation, there are use cases in which the user wants to try out the shot function in various patterns while adjusting parameters such as the final capture range and movement time as appropriate, and then determine the optimal parameters to capture the image the user desires.

[0007] Now, let's consider a case where the execution of a shot function using the optical PTZ is attempted with various parameter patterns. In this case, after the shot function using the optical PTZ is completed with a certain parameter pattern from a certain starting imaging range, it is necessary to control the pan, tilt, and zoom again to return the imaging range to the certain starting imaging range. In other words, every time a certain pattern of shot function is attempted with the optical PTZ from a certain starting imaging range, it is necessary to control the pan, tilt, and zoom to return to the certain starting imaging range. As a result, it may take a long time to try out the shot function with various parameter patterns.

[0008] Therefore, an object of the present invention is to suppress an increase in the time required for processing related to the trial of the shot function. [Means for solving the problem]

[0009] In order to solve the above problems, a control device of the present invention has the following configuration: a first control means for executing a shot function in a first control process that sequentially changes the position or size of a partial region to be cut out for a predetermined image, a setting means for setting second parameter information in a shot function in a second control process that drives at least one of pan, tilt, and zoom of an imaging means based on first parameter information used in the shot function in the first control process, and a second control means for executing the shot function in the second control process in accordance with the second parameter information set by the setting means. [Effects of the Invention]

[0010] According to the present invention, it is possible to suppress an increase in the time required for processing related to the trial of the shot function. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 illustrates an example of a system configuration. [Figure 2] FIG. 1 is a diagram illustrating an example of the appearance of an imaging device. [Figure 3] FIG. 2 is a diagram illustrating an example of functional blocks of an imaging device and an information processing device. [Figure 4] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 5] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 6] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 7] FIG. 10 is a diagram illustrating a process for generating a simulated video. [Figure 8] FIG. 10 is a diagram for explaining a process for setting second parameter information. [Figure 9] 10 is a flowchart showing the flow of information processing related to a shot function. [Figure 10] FIG. 2 is a diagram for explaining a GUI displayed on a display 210. [Figure 11] 10 is a flowchart showing the flow of information processing related to a shot function. [Figure 12] FIG. 2 illustrates an example of a hardware configuration of each device. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples and are not limited to the configurations shown in the drawings.

[0013] (Embodiment 1) 1 is a diagram showing the system configuration of this embodiment. The system of this embodiment includes an imaging device 100, an information processing device 200, a display 210, and a network 300.

[0014] The imaging device 100 and the information processing device 200 are connected to each other via a network 300. The network 300 is realized by a plurality of routers, switches, cables, etc. that comply with a communication standard such as ETHERNET (registered trademark).

[0015] The network 300 may be realized by the Internet, a wired local area network (LAN), a wireless LAN, a wide area network (WAN), or the like.

[0016] The imaging device 100 is a device that captures images and functions as an imaging unit capable of changing the imaging range by driving at least one of pan, tilt, and zoom. The imaging device 100 transmits image data of the captured image, information on the date and time the image was captured, identification information for identifying the imaging device 100, and information on the imaging range of the imaging device 100 to an external device such as an information processing device 200 via a network 300. The information processing device 200 is, for example, a client device such as a personal computer on which a program for implementing the processing functions described below is installed. Note that although the system according to this embodiment uses one imaging device 100, multiple imaging devices 100 may also be used. That is, multiple imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 determines which of the multiple imaging devices 100 captured the transmitted image, for example, using identification information associated with the transmitted image.

[0017] The display 210 is configured with an LCD (Liquid Crystal Display) or the like, and displays images captured by the imaging device 100. The display 210 is connected to the information processing device 200 via a display cable that complies with a communication standard such as HDMI (High Definition Multimedia Interface) (registered trademark). The display 210 and the information processing device 200 may be provided in a single housing.

[0018] Next, an imaging device 100 according to this embodiment will be described with reference to FIGS. 2 and 3. FIG. 2 is an example of an external view of the imaging device 100 according to this embodiment. FIG. 3 is an example of functional blocks of the imaging device 100 and an information processing device 200 according to this embodiment. Among the functional blocks of the imaging device 100 shown in FIG. 3, the functions of the image processing unit 112, the system control unit 113, the pan / tilt / zoom control unit 114, the storage unit 115, the communication unit 116, and the like are realized as follows. That is, the functions are realized by a CPU (Central Processing Unit) 1200 of the imaging device 100 executing a computer program stored in a ROM (Read Only Memory) 1220 of the imaging device 100, which will be described later with reference to FIG. 12.

[0019] The direction in which the optical axis of the lens 101 faces is the imaging direction of the imaging device 100, and a light beam that passes through the lens 101 forms an image on an imaging element of an imaging unit 111 of the imaging device 100. In addition, the lens driving unit 102 is configured with a drive system that drives the lens 101 and changes the focal length of the lens 101. The lens driving unit 102 is controlled by a pan / tilt / zoom control unit 114.

[0020] The pan driving unit 103 is composed of a mechanical driving system that performs panning operations and a motor that is a driving source, and drives to control rotational driving for rotating the imaging direction of the imaging device 100 in a pan direction 105. The pan driving unit 103 is also controlled by a pan / tilt / zoom control unit 114.

[0021] The tilt driving unit 104 is composed of a mechanism driving a tilt operation and a motor as a driving source, and drives to control rotational driving for rotating the imaging direction of the imaging device 100 in a tilt direction 106. The tilt driving unit 104 is controlled by a pan / tilt / zoom control unit 114.

[0022] The imaging unit 111 is composed of an imaging element (not shown), such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 photoelectrically converts the subject image formed through the lens 101 to generate an electrical signal. The image processing unit 112 performs image processing such as converting the electrical signal photoelectrically converted by the imaging unit 111 into a digital signal and compression encoding, and generates image data that is data of the captured image.

[0023] The pan / tilt / zoom control unit 114 controls the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 by optical PTZ based on instructions transmitted from the system control unit 113, thereby controlling the pan, tilt, and zoom of the imaging device 100. The storage unit 115 stores (holds), for example, information indicating the imaging range.

[0024] The communication unit 116 communicates with the information processing device 200 via an I / F 1240, which will be described later with reference to Fig. 12. For example, the communication unit 116 transmits image data of an image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 also transmits information indicating the current imaging range of the imaging device 100. The communication unit 116 also receives control commands, which are commands for controlling the imaging device 100, transmitted from the information processing device 200, and transmits the control commands to the system control unit 113.

[0025] The system control unit 113 controls the entire imaging device 100 in accordance with processing executed by the CPU 1200, which will be described later with reference to Fig. 12, and performs the following processing, for example. That is, the system control unit 113 analyzes a control command for controlling the imaging device 100 transmitted from the information processing device 200, and performs processing according to the control command. The system control unit 113 also instructs the pan-tilt-zoom control unit 114 to perform a pan-tilt-zoom operation. When transmitting image data generated by the image processing unit 112 to the information processing device 200, the system control unit 113 also adds information about the imaging time when the image data was captured and information about the imaging range to the image data.

[0026] It should be noted that the imaging range based on the optical PTZ in this embodiment is determined by the PTZ values ​​(P value, T value, Z value) of the imaging device 100. The P value (Pan value) of the PTZ values ​​is the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging device 100 when, for example, one of the drive ends of the pan drive unit 103 is set to 0°. The T value (Tilt value) is the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging device 100 when, for example, one of the drive ends of the tilt drive unit 104 is set to 0°. The Z value (Zoom value) of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.

[0027] Next, information processing of the information processing device 200 according to this embodiment will be described with reference to the functional blocks of the information processing device 200 shown in Fig. 3. Note that each function of the information processing device 200 is realized as follows using a ROM 1220 and a CPU 1200, which will be described later with reference to Fig. 12. That is, each function shown in Fig. 3 is realized by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 900.

[0028] The communication unit 201 communicates with the imaging device 100, and receives, for example, image data of an image captured by the imaging device 100 from the imaging device 100. The communication unit 201 also transmits, to the imaging device 100, control commands for controlling the imaging range of the imaging device 100, and the like.

[0029] The operation receiving unit 202 receives operations by a user via an input device (not shown) such as a mouse or keyboard connected to the information processing device 200 so as to be able to communicate with the information processing device 200.

[0030] The display control unit 203 causes the display 210 to display, for example, an image based on image data transmitted from the imaging device 100 and captured by the imaging device 100. Note that the image based on image data here refers to an image obtained by decoding the image data by the information processing device 200, for example, when the image data has been generated by compressing and encoding an image captured by the imaging device 100.

[0031] The display control unit 203 also causes the display 210 to display a GUI (Graphical User Interface) for setting a shot function in the electronic PTZ or optical PTZ.

[0032] The setting unit 204 sets parameters relating to the electronic PTZ and optical PTZ based on a user operation performed on a GUI (setting screen) displayed on the display 210.

[0033] The first control unit 205 executes a shot function using a first control process (electronic PTZ) that sequentially changes the position or size of a partial region to be cut out. That is, the first control unit 205 controls the execution of the shot function in the electronic PTZ.

[0034] The second control unit 206 executes a shot function by a second control process (optical PTZ) that drives at least one of the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 of the imaging device 100. In other words, the second control unit 206 controls the execution of the shot function in the optical PTZ.

[0035] 4(a) and 4(b), a description will be given of a GUI for setting the shot function, which is displayed on the display 210 by the display control unit 201 in this embodiment. The GUI 400 shown in Fig. 4(a) is a GUI that presents information about the movable range, which is the range that the imaging range can reach in a specified movement time, and also allows settings related to the shot function.

[0036] The GUI 400 includes an image display area 401 (first display area), and in the example shown in FIG. 4(a), a panoramic image based on images captured by the imaging device 100 is displayed as the predetermined image in the image display area 401. The panoramic image is an image generated in advance by the imaging device 100, and is obtained by combining multiple images captured by the imaging device 100 while sequentially changing the imaging range using an optical PTZ, and is generated using a known technology for generating panoramic images. In the example shown in FIG. 4(a), a panoramic image is displayed as the predetermined image in the image display area 401, but this is not limiting, and for example, an image captured by the imaging device 100 may be displayed as the predetermined image. In this case, it is desirable that the captured image displayed as the predetermined image is an image obtained by capturing a wide-angle range when the zoom is set to the WIDE end.

[0037] The user can specify, by dragging the mouse or the like, a start partial area corresponding to the start position of a path in the shot function of the first control process and an end partial area corresponding to the end position of the path for the panoramic image displayed in the image display area 401. In the example shown in Fig. 4(a), a start partial area 402 and an end partial area 403 are specified on the panoramic image in the image display area 401, and the frames of each area are superimposed and displayed.

[0038] At this time, the aspect ratios of partial regions cut out from the panoramic image in the first control process, such as the start partial region 402, the end partial region 403, and partial regions on the path between them, are limited to the aspect ratio of the image captured by the imaging device 100. Furthermore, the range of sizes of partial regions cut out from the panoramic image is limited to the range from the telephoto end angle of view to the wide end angle of view of the optical PTZ of the imaging device 100.

[0039] As shown in FIG. 4A, the GUI 400 also includes a movement parameter designation area 404 (second display area). The user can select either time designation or speed designation by pressing a selection button 405 in the movement parameter designation area 404 with a mouse. When the time designation is selected, the electronic PTZ shot function sequentially changes the cut-out partial area over the designated movement time from the start partial area to the end partial area. When the optical PTZ shot function controls the image capture range over the designated movement time from the start imaging range corresponding to the start partial area to the end imaging range corresponding to the end partial area. When the speed designation is selected, the electronic PTZ shot function sequentially changes the cut-out partial area according to the designated movement speed from the start partial area to the end partial area. When the speed designation is selected, the optical PTZ shot function controls the image capture range over the designated movement speed from the start imaging range corresponding to the start partial area to the end imaging range corresponding to the end partial area. The example shown in FIG. 4A shows a case where the time designation is selected, and the button display is different from that of the speed designation, which is not selected. As shown in FIG. 4(a), when time specification is selected, the movement parameter specification area 404 includes a slider 406 and increase / decrease buttons 407 for changing the movement time, and also includes information on a current value 408 indicating the currently specified movement time. The user can adjust the movement time as needed by operating the slider 406 or pressing the increase / decrease buttons 407. Note that FIG. 4(b) differs from the GUI 400 shown in FIG. 4(a) in that it shows a case where speed specification is selected. In this case, the user can adjust the movement speed as needed by operating the slider 406 or pressing the increase / decrease buttons 407 in the movement parameter specification area 404, and information on the current value 408 of the currently specified movement speed is displayed.

[0040] Returning to the explanation of FIG. 4(a), the GUI 400 further includes a simulation start button 410 for instructing the start of the shot function of the first control process. When the user presses the simulation start button 410, the first control unit 205 executes the shot function of the first control process based on the currently selected parameters. Here, the transition of the display of the GUI 400 when the simulation start button 410 is selected will be described with reference to FIGS. 5(a) to 5(c). FIG. 5(a) shows the GUI 400 at the time when the user operates the mouse 501 to press the simulation start button 410. At this time, the display control unit 203 changes the display mode of the frame of the start partial region 402, which is the start position of the partial region to be cropped from the panoramic image, so that the frame is highlighted. FIG. 5(b) shows the GUI 400 when the shot function of the first control process is being executed, and the display control unit 203 displays a message 502 indicating that a simulated video, which is a video obtained by the shot function of the first control process, is being generated. At this time, while the shot function of the first control process is being executed, a frame 503 of the partial region currently being cut out is displayed superimposed on the panoramic image. This allows the user to understand which portion is currently being selected as the region to be cut out. FIG. 5(c) shows the GUI 400 when the shot function of the first control process has ended, and the display control unit 203 displays a message 504 indicating that the shot function of the first control process has ended, and a button 505 for displaying the generated simulated video. At this time, the display mode is different so that the frame of the end partial region 403, which is the end position of the partial region to be cut out, is highlighted.

[0041] As described above, when the user presses the simulation start button 410, the first control unit 205 executes the shot function of the first control process based on the currently selected first parameter information. Specifically, the first control unit 205 executes the shot function of the first control process based on the position information of the start partial region and the end partial region currently selected in the image display area 401 and the movement parameter information specified in the movement parameter specification area 404. That is, the first parameter information includes the position information of the start partial region and the end partial region and the movement parameter information. By executing the shot function of the first control process, a simulated video can be generated. In the example shown in FIG. 4(a), the first control unit 205 sequentially changes the cut-out partial region from the start partial region 402 to the end partial region 403 over the specified movement time of 7 seconds. The first control unit 205 then acquires cut-out images of the partial regions at each sequentially changed position and generates a group of acquired cut-out images as a simulated video.

[0042] The simulation video generation process will now be described with reference to FIG. 7. The first control unit 205 acquires position information of the start partial region 702, position information of the end partial region, information on the movement time (or movement speed) specified in the movement parameter specification area 404, and information on the frame rate. The position information of a partial region cut out from a predetermined image (such as a panoramic image) is determined by the XY coordinates of the upper left vertex and the XY coordinates of the lower right vertex of the partial region, with the upper left vertex of the predetermined image as the origin. The first control unit 205 sequentially changes the cut-out partial region from the start partial region to the end partial region in accordance with the specified movement time (or movement speed) while ensuring that the aspect ratio of the cut-out partial region is the same as the aspect ratio of the image captured by the imaging device 100. For example, if the specified movement time is t [seconds] and the frame rate is 30 [f / s], the partial regions are cut out 30t times at equal intervals during the process of sequentially changing the partial regions on the path 704, and a group of cut-out images is acquired. Furthermore, if the specified speed is v [pixel / s], the length of the path 704 is L [pixels], and the frame rate is 30 [f / s], partial regions are cropped 30*(L / v) times as the partial regions are sequentially changed on the path 704, and a group of cropped images is obtained. The first control unit 205 obtains the group of cropped images obtained at each position in this manner as the simulation video 705. Note that the frame rate information used to generate the simulation video may be preset or may be changed as appropriate by the user.

[0043] Here, upon pressing button 505 shown in FIG. 5(c), the display control unit 203 causes the display 210 to display the simulation video generated by the first control unit 205. After checking the simulation video, the user can adjust the first parameter information (position information of the start and end partial regions, movement parameter information) related to the shot function of the first control process on the GUI 400 as needed. After adjustment, the user can press the simulation start button 410 again to generate a simulation video using the shot function of the first control process based on the new parameters. If the user determines that the shot function of the first control process using the current first parameters is desirable, the user presses the operation start button 411. Upon pressing the operation start button 411, the second control unit 206 executes the shot function of the second control process (optical PTZ) in accordance with the second parameter information set in the setting unit 204 based on the currently specified first parameter information. The process of setting the second parameter information based on the first parameter information by the setting unit 204 will be described later.

[0044] Here, the transition of the display of the GUI 400 when the operation start button 411 is pressed will be described with reference to FIGS. 6(a) to 6(c). FIG. 6(a) shows the GUI 400 when the operation start button 411 is pressed with the mouse 601 and the imaging device 100 is controlled to face the start imaging range of the shot function by the second control process in accordance with the second parameter information. At this time, an image obtained by capturing the start imaging range is transmitted from the imaging device 100 to the information processing device 200, and the image is displayed in the image display area 401. Next, FIG. 6(b) shows the GUI 400 when the shot function by the second control process is being executed, and a message 602 indicating that the shot function by the second control process is being executed is displayed. At this time, an image captured at the current time while the shot function by the second control process is being executed is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401. 6(c) shows the GUI 400 when the shot function by the second control process has ended, and a message 603 indicating that the shot function by the second control process has ended is displayed. At this time, an image obtained by capturing an image of the end imaging range of the shot function by the second control process is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401.

[0045] Next, a setting process for setting second parameter information used in the shot function by the second control process (optical PTZ) based on the first parameter information used in the shot function by the first control process (electronic PTZ) will be described with reference to FIG. 8.

[0046] An image 801 shown in Fig. 8 is a predetermined image from which a partial region is cut out, and is an image captured by the imaging device 100. The following description will explain a process of converting the XY coordinates of an upper left vertex 803 and the XY coordinates of a lower right vertex 804 of an end partial region 802, with the upper left vertex of the image 803 as the origin, into PTZ coordinates using the PTZ value of the imaging device 100 when the image 801 was captured. Here, if the PTZ value of the imaging device 100 when the image 801 was captured is (P0, T0, Z0), and the XY coordinates of an image center 805, with the upper left vertex of the image as the origin, are (x0, y0), the PT coordinates corresponding to the coordinates (x0, y0) are (P0, T0). Furthermore, the XY coordinates of the upper left vertex 803 of the end partial region are (x1, y1), and the XY coordinates of the upper right vertex 804 of the end partial region are (x2, y2). The setting unit 204 also stores a correspondence table that associates, for a certain Z value of the imaging device, the amount of pan movement required to move the center of the angle of view 805 by an image width 806 and the amount of tilt movement required to move it by an image height 807. Here, the setting unit 204 refers to the correspondence table and performs proportional calculations to calculate the amount of pan movement Δp1 required to move it by an image horizontal distance 808 and the amount of tilt movement Δt1 required to move it by an image vertical distance 809. The setting unit 204 then derives P1 by adding Δp1 to P0 of the PT coordinate (P0, T0) of the center of the angle of view, and derives T1 by adding ΔT1 to T0. In this way, the setting unit 204 derives the PT coordinate (P1, T1) corresponding to the XY coordinate (x1, y1) of the upper left vertex 803 of the end partial area. By performing similar processing, the setting unit 204 also derives the PT coordinate (P2, T2) corresponding to the XY coordinate (x2, y2) of the lower right vertex 804 of the end partial region. The setting unit 204 further calculates the PT coordinate of the center position of the end partial region as (P1+P2 / 2, T1+T2 / 2), and derives the Z value of the end partial region as Z(|P1-P2|) corresponding to the Pan operation amount |P1-P2| from the correspondence table. In this way, the setting unit 204 derives the PTZ value of the end imaging range included in the second parameter information from the position information (XY coordinates on the image) of the end partial region included in the first parameter information. Similarly, the setting unit 204 derives the PTZ value of the start imaging range included in the second parameter information from the position information of the start partial region included in the first parameter information.Also, assume that the movement time included in the first parameter information is t. In this case, the second control unit 206 generates a control command for performing control such that the PTZ value of the start imaging range included in the second parameter information is moved from the PTZ value of the end imaging range included in the second parameter information within the specified movement time t. Then, the second control unit 206 transmits the generated control command to the imaging device 100, thereby realizing the shot function of the second control process in accordance with the second parameter information.

[0047] Here, the information processing of the information processing device 200 in this embodiment will be described with reference to the processing flow shown in Fig. 9. The processing flow shown in Fig. 9 is executed by the functional blocks of the information processing device 200 shown in Fig. 3, which are realized by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 200, for example.

[0048] First, in S901, the display control unit 203 acquires a predetermined image from which partial regions are to be cut out. At this time, the predetermined image may be an image captured by the imaging device 100 or a panoramic image. Next, in S902, the display control unit 203 displays a GUI related to setting the first control process and the second control process on the display 210. At this time, the display control unit 203 displays, for example, the GUI 400 shown in FIG. 4(a) on the display 210. Next, in S903, the first control unit 205 acquires position information of the start partial region and the end partial region currently specified by the user in the image display area 401 of the GUI 400. Next, in S904, information on the movement parameters currently specified by the user in the movement parameter specification area 404 of the GUI 400 is acquired. Next, in S905, it is determined whether the simulation start button 410 has been pressed on the GUI 400. If it is determined that the button has been pressed (Yes in S905), the process proceeds to S906. If it is determined that the button has not been pressed (No in S905), the process proceeds to S907. In S906, the first control unit 205 executes the shot function of the first control process in accordance with the current first parameter information (position information of the start partial region and the end partial region, information of the movement parameters) to generate a simulated video. Next, in S907, the display control unit 203 determines whether the operation start button 411 has been pressed. If it is determined that the button has been pressed (Yes in S907), the process proceeds to S908. If it is determined that the button has not been pressed (No in S907), the process returns to S903. In S908, the setting unit 203 sets second parameter information to be used in the shot function of the second control process based on the first parameter information. Next, in S909, the second control unit 206 executes the shot function of the second control process in accordance with the set second parameter information.

[0049] As described above, the information processing device 200 in this embodiment executes the following process. That is, it executes the shot function of the first control process (electronic PTZ) using first parameter information, and sets second parameter information used in the shot function of the second control process (optical PTZ) based on the first parameter information. Then, the information processing device 200 executes the shot function of the second control process (optical PTZ) in accordance with the second parameter information. In this way, by executing the first control process (electronic PTZ) in the trial phase, even immediately after executing the shot function from a certain start position in accordance with certain parameters, it is possible to immediately execute the shot function from the certain start position in accordance with different parameters. Then, in the operation phase, it executes the shot function of the second control process (optical PTZ) in accordance with second parameter information set based on the first parameter information used in the trial phase. In this way, it is possible to execute the shot function of the second control process (optical PTZ) reflecting the desired parameters set by the user in the trial phase. As described above, the information processing device 200 in this embodiment can suppress an increase in the time required for processing related to the trial of the shot function.

[0050] (Embodiment 2) In the second embodiment, a plurality of pieces of first parameter information are stored, and a shot function of a first control process according to the first parameter information selected in response to a user operation, and a shot function of a second control process according to second parameter information set based on the first parameter information, can be executed. Note that the following mainly describes the parts that differ from the above-described embodiments, and components and processes that are the same as or equivalent to those in the above-described embodiments are given the same reference numerals, and redundant explanations will be omitted.

[0051] 10(a)-(b), a description will be given of GUIs displayed by the information processing device 200 according to this embodiment. The GUI 1000 shown in FIG. 10(a) is a setting screen displayed on the display 210 by the display control unit 203, and includes a tab 1001 for managing setting pages in addition to the functions of the GUI 400 shown in FIG. 4(a). In the GUI 1000 shown in FIG. 10(a), the display mode of the tab "1" of the tab 1001 is displayed in white, indicating that the setting page "1" is currently displayed in the GUI 1000. In addition, the setting page "1" is associated with and holds first parameter information (position information of the start and end partial regions, movement parameters, etc.) currently set in FIG. 10(a). Here, when the operation receiving unit 202 receives a user operation to press the "+" tab of the tab 1001, the display of the GUI 1000 transitions to FIG. 10(b). At this time, a new setting page "2" is added to the GUI 1000 shown in FIG. 10(a), and the setting screen for the setting page "2" is displayed in the GUI 1000 shown in FIG. 10(b). The GUI 1000 shown in FIG. 10(c) displays the setting page "2" after the movement parameters have been adjusted in the movement parameter specification area 404 of the GUI 1000 shown in FIG. 10(b). The setting page "2" shown in the GUI 1000 shown in FIG. 10(c) is associated with and holds the first parameter information currently set in the GUI 1000 shown in FIG. 10(c). At this time, the displayed setting page can be switched by pressing various tabs in the tab 1001. Assume that, for example, the simulation start button 410 is pressed while a certain setting page (e.g., setting page "2") is currently displayed in the GUI 1000. At this time, the first control unit 205 executes the shot function of the first control process to generate a simulated video in accordance with the first parameter information associated with the certain setting page. Also, assume that, for example, the operation start button 411 is pressed while the certain setting page is displayed on the GUI 1000. At this time, the second control unit 205 executes the shot function of the second control process in accordance with the second parameter information set in the setting unit 204 based on the first parameter information associated with the certain setting page.

[0052] In this way, the information processing device 200 in this embodiment can associate and store the first parameter information separately for each of the multiple setting pages. Then, the information processing device 200 in this embodiment can select the first parameter information to be used in the shot function of the first control process or the shot function of the second control process from the multiple pieces of first parameter information in response to an operation by the user.

[0053] Here, the information processing of the information processing device 200 in this embodiment will be described with reference to the processing flow shown in Fig. 11. The processing flow shown in Fig. 11 is executed by the functional blocks of the information processing device 200 shown in Fig. 3, which are realized by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 200, for example.

[0054] First, in S1101, the display control unit 203 acquires a predetermined image from which a partial region is to be cut out. At this time, the predetermined image may be an image captured by the imaging device 100 or a panoramic image. Next, in S1102, the display control unit 203 displays a GUI related to the settings of the first control process and the second control process on the display 210. At this time, the display control unit 203 displays, for example, the GUI 1000 shown in FIG. 10A on the display 210. Next, in S1103, the display control unit 203 acquires tab information of the currently specified setting page. If the GUI 1000 of FIG. 10A is displayed, the display control unit 203 acquires "1" as tab information of the currently specified setting page. Next, in S1104, the display control unit 203 determines whether the displayed setting page has been changed by operating the tab. If it is determined that the setting page has been changed (Yes in S1104), the process proceeds to S1105. If it is determined that the setting page has not been changed (No in S1104), the process proceeds to S1106. In S1105, the display control unit 203 displays a GUI that reflects the first parameter information stored in association with the currently displayed setting page. Next, in S1106, the first control unit 205 acquires position information of the start partial region and the end partial region currently specified by the user on the image display area 401 of the GUI 400. Next, in S1107, information on the movement parameters currently specified by the user in the movement parameter specification area 404 of the GUI 1000 is acquired. Next, in S1108, the display control unit 203 determines whether the simulation start button 410 has been pressed on the GUI 1000, and if it is determined that it has been pressed (Yes in S1108), the process proceeds to S1109, and if it is determined that it has not been pressed (No in S1108), the process proceeds to S1110. In S1109, the first control unit 205 executes the shot function of the first control process in accordance with the first parameter information (position information of the start and end partial areas, information on movement parameters) recorded in association with the currently displayed setting page, and generates a simulated image.Next, in S1110, the display control unit 203 determines whether the operation start button 411 has been pressed, and if it is determined that it has been pressed (Yes in S1110), the process proceeds to S1111, and if it is determined that it has not been pressed (No in S1110), the process returns to S1103. In S1111, the setting unit 203 sets second parameter information to be used in the shot function of the second control process based on the first parameter information associated with the currently displayed setting page. Next, in S1112, the second control unit 206 executes the shot function of the second control process in accordance with the set second parameter information.

[0055] As described above, the information processing device 200 in this embodiment can associate and store first parameter information separately for each of a plurality of setting pages. The information processing device 200 in this embodiment can select the first parameter information to be used in the shot function of the first control process or the shot function of the second control process in response to a user operation. This can improve the convenience of the setting screen while suppressing an increase in the time required to try out the shot function.

[0056] (Other embodiments) Next, the hardware configuration of the information processing device 200 for realizing each function of the above-described embodiment will be described with reference to Fig. 12. Note that, although the hardware configuration of the information processing device 200 will be described in the following explanation, it is assumed that the imaging device 100 is also realized by a similar hardware configuration.

[0057] The information processing device 200 in this embodiment includes a CPU 1200 , a RAM 1210 , a ROM 1220 , an HDD 1230 , and an I / F 1240 .

[0058] The CPU 1200 is a central processing unit that controls the information processing device 200. The RAM 1210 temporarily stores computer programs executed by the CPU 1200. The RAM 1210 also provides a work area used by the CPU 1200 when executing processing. The RAM 1210 also functions as, for example, a frame memory or a buffer memory.

[0059] The ROM 1220 stores programs and the like that are used by the CPU 1200 to control the information processing device 200. The HDD 1230 is a storage device that records image data and the like.

[0060] The I / F 1210 communicates with external devices via the network 300 in accordance with TCP / IP, HTTP, or the like.

[0061] Although the above-described embodiments have been described with reference to examples in which the CPU 1200 executes the processing, at least a portion of the processing by the CPU 1200 may be performed by dedicated hardware. For example, the processing of displaying a GUI (Graphical User Interface) or image data on the display 210 may be performed by a GPU (Graphics Processing Unit). Furthermore, the processing of reading program code from the ROM 1220 and loading it into the RAM 1210 may be performed by a DMA (Direct Memory Access) that functions as a transfer device.

[0062] The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-described embodiments. The program may be supplied to a system or device having a processor via a network or a storage medium. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions of the above-described embodiments. Each unit of the information processing device 200 may be realized by hardware shown in FIG. 12 or by software. One or more functions of the information processing device 200 according to the above-described embodiment may be implemented by another device.

[0063] Although the present invention has been described above with reference to the embodiments, the above embodiments merely illustrate specific examples of how the present invention can be implemented, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from the technical concept or main features of the present invention. For example, combinations of the embodiments are also included in the disclosure of this specification. [Explanation of symbols]

[0064] 100 Imaging device 200 Information processing device 210 Display 201 Communications Department 202 Operation reception section 203 Display control unit 204 Settings 205 First Control Section 206 Second Control Section

Claims

1. a first control means for executing a shot function by a first control process for changing a position of a partial region cut out from a predetermined image from a predetermined start position to an end position; a setting means for setting second parameter information used in a shot function of a second control process for driving at least one of pan, tilt, and zoom of an imaging means, based on first parameter information used in a shot function of the first control process, the first parameter information including information on the start position and information on the end position; a second control means for executing a shot function by the second control process by changing an imaging direction of the imaging means from a predetermined start position to an end position in accordance with the second parameter information set by the setting means; 13. An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, further comprising display control means for displaying a setting screen for setting the first parameter information on a display means.

3. 3. The information processing apparatus according to claim 2, wherein the setting screen includes a first display area for displaying the predetermined image.

4. The information processing device according to claim 3, characterized in that in the first display area, an area corresponding to the start position in the shot function of the first control process and an area corresponding to the end position in the shot function of the first control process can be set.

5. 5. The information processing apparatus according to claim 4, wherein a frame corresponding to the start position and a frame corresponding to the end position are displayed superimposed on the predetermined image.

6. 6. The information processing apparatus according to claim 2, wherein the setting screen includes a second display area for designating a movement parameter that determines a movement time or a movement speed in the shot function of the first control process.

7. 7. The information processing device according to claim 2, wherein when a shot function of the second control process is being executed, information indicating that the shot function of the second control process is being executed is displayed on the setting screen.

8. The information processing device according to any one of claims 1 to 7, characterized in that the first control means executes a shot function of the first control process in accordance with first parameter information selected in response to a user operation from among a plurality of first parameter information including the retained first parameter information.

9. An information processing device according to any one of claims 1 to 8, characterized in that the first parameter information includes position information corresponding to the start position in the shot function of the first control processing, position information corresponding to the end position in the shot function of the first control processing, and information on a movement parameter that determines a movement time or movement speed in the shot function of the first control processing.

10. The setting means derives a coordinate value of a PTZ corresponding to the start position according to position information corresponding to the start position, and derives a coordinate value of a PTZ corresponding to the end position according to position information corresponding to the end position; 10. The information processing apparatus according to claim 9, wherein the second parameter information includes at least a PTZ coordinate value corresponding to the start position and a PTZ coordinate value corresponding to the end position.

11. 11. The information processing apparatus according to claim 1, wherein the predetermined image is an image captured by an imaging unit, or a panoramic image based on an image captured by the imaging unit.

12. a first control step of executing a shot function by a first control process that changes a position of a partial region cut out from a predetermined image from a predetermined start position to an end position; a setting step of setting second parameter information used in a shot function of a second control process for driving at least one of pan, tilt, and zoom of an imaging means, based on first parameter information used in a shot function of the first control process, the first parameter information including information on the start position and information on the end position; a second control step of executing a shot function by the second control process by changing an imaging direction of the imaging means from a predetermined start position to an end position in accordance with the second parameter information set in the setting step; 13. An information processing method comprising:

13. A computer program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 11.