Control device, control method, and program

Abstract

To prevent an increase in time required for processing related to trial of a shot function.SOLUTION: An information processing apparatus executes, for a predetermined image, a shot function in first control processing of sequentially changing the position or the size of a sub region to be cut out, based on first parameter information used in the shot function in the first control processing, sets second parameter information in a shot function in second control processing of driving at least one of panning, tilting, and zooming of imaging means, and executes the shot function in the second control processing according to the set second parameter information.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a method for controlling an imaging device.

Background Art

[0002] Conventionally, as technologies for controlling the imaging range of an imaging device for capturing images, there are optical PTZ and electronic PTZ. In optical PTZ, there is a technology for changing the imaging range of the imaging device by driving at least one of the mechanical mechanisms of pan, tilt, and zoom of the imaging device. Also, electronic PTZ is a technology for cutting out and outputting a partial region in the captured image captured by the imaging device, and virtually controlling the imaging range by sequentially changing the position or size of the partial region corresponding to the imaging range.

[0003] Also, there is a shot function as a function for controlling the imaging device. The shot function is a function in which the movement time to the end imaging range, which is the target imaging range to be reached, is specified, the imaging range of the imaging device is controlled from the start imaging range corresponding to the start position to the specified end imaging range, and the end imaging range is reached in the specified movement time.

[0004] In Patent Document 1, a method for controlling the pan and tilt of an imaging device so as to reach a target position from the current position in a specified time specified by the user is disclosed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Generally, during the operational phase of a shot function, it is sometimes desirable to use optical PTZ, which offers higher resolution than electronic PTZ, to execute the shot function. Furthermore, prior to executing the shot function during this operational phase, there are use cases where the user wants to test the shot function in various patterns, adjusting parameters such as the end imaging range and movement time as appropriate, in order to determine the optimal parameters that will produce the desired image.

[0007] Here, we consider a scenario where we attempt to execute the shot function using optical PTZ with various parameter patterns. In this case, after executing the shot function using optical PTZ from a certain starting imaging range with a certain parameter pattern, it is necessary to control the pan, tilt, and zoom again to return the imaging range to that starting imaging range. In other words, each time we attempt to execute the shot function with a certain pattern using optical PTZ from a certain starting imaging range, we need to control the pan, tilt, and zoom to return to that starting imaging range. As a result, it can take time to attempt the shot function with various parameter patterns.

[0008] Therefore, the present invention aims to suppress the increase in the time required for processing related to the trial of the shot function. [Means for solving the problem]

[0009] To solve the above problems, the control device of the present invention has the following configuration: a first control means that causes a shot function by a first control process that changes the position of a partial region to be cut out from a predetermined image from a predetermined start position to an end position; a setting means that sets a second parameter information used in a shot function by a second control process that drives at least one of pan, tilt, and zoom of the imaging means based on the first parameter information used in the shot function of the first control process, which includes the information of the start position and the information of the end position; and a second control means that causes the shot function by the second control process to be executed by changing the imaging direction of the imaging means from a predetermined start position to an end position according to the second parameter information set by the setting means. The system includes a display control means for displaying a setting screen for setting the first parameter information, the setting screen including a first button for executing a shot function by the first control process and a second button for executing a shot function by the second control process, wherein when the first button is pressed by the user, the first control means executes the shot function by the first control process, and when the second button is pressed by the user, the second control means executes the shot function by the second control process. [Effects of the Invention]

[0010] According to the present invention, it is possible to suppress the increase in the time required for processing related to the trial of the shot function. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an example of a system configuration. [Figure 2] This figure shows an example of the external appearance of an imaging device. [Figure 3] This figure shows an example of a functional block for an imaging device and an information processing device. [Figure 4] This is a diagram illustrating the GUI displayed on display 210. [Figure 5] This is a diagram illustrating the GUI displayed on display 210. [Figure 6] This is a diagram illustrating the GUI displayed on display 210. [Figure 7] This is a diagram illustrating the process of generating simulated video. [Figure 8] This is a diagram illustrating the process of setting the second parameter information. [Figure 9]It is a flowchart showing the flow of information processing related to the shot function. [Figure 10] It is a diagram for explaining the GUI displayed on the display 210. [Figure 11] It is a flowchart showing the flow of information processing related to the shot function. [Figure 12] It is a diagram showing an example of the hardware configuration of each device.

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples and are not limited to the illustrated configurations.

[0013] (Embodiment 1) FIG. 1 is a diagram showing the system configuration in the present embodiment. The system in the present embodiment includes an imaging device 100, an information processing device 200, a display 210, and a network 300.

[0014] The imaging device 100 and the information processing device 200 are connected to each other via the network 300. The network 300 is realized from a plurality of routers, switches, cables, etc. conforming to a communication standard such as ETHERNET (registered trademark).

[0015] Note that the network 300 may be realized by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless Lan), a WAN (Wide Area Network), or the like.

[0016] The imaging device 100 is a device that captures images and functions as imaging means capable of changing the imaging range by driving at least one of pan, tilt, and zoom. The imaging device 100 transmits the image data of the captured image, the information of the imaging date and time when the image was captured, the identification information for identifying the imaging device 100, and the information of the imaging range of the imaging device 100 to an external device such as the information processing device 200 via the network 300. The information processing device 200 is, for example, a client device such as a personal computer in which a program for realizing the functions of the processes described later is installed. In the system according to the present embodiment, the number of imaging devices 100 is one, but it may be plural. That is, a plurality of imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 determines, for example, which imaging device 100 among the plurality of imaging devices 100 captured the transmitted image by using the identification information associated with the transmitted image.

[0017] The display 210 is composed of an LCD (Liquid Crystal Display) or the like and displays an image captured by the imaging device 100 or the like. The display 210 is connected to the information processing device 200 via a display cable compliant with a communication standard such as HDMI (Registered Trademark) (High Definition Multimedia Interface). Note that the display 210 and the information processing device 200 may be provided in a single housing.

[0018] Next, the imaging device 100 according to this embodiment will be described with reference to Figures 2 and 3. Figure 2 is an example of an external view of the imaging device 100 according to this embodiment. Figure 3 is an example of a functional block of the imaging device 100 and information processing device 200 according to this embodiment. Of the functional blocks of the imaging device 100 shown in Figure 3, the functions of the image processing unit 112, system control unit 113, pan-tilt-zoom control unit 114, storage unit 115, communication unit 116, etc., are realized as follows. That is, they are realized by the CPU (Central Processing Unit) 1200 of the imaging device 100 executing a computer program stored in the ROM (Read Only Memory) 1220 of the imaging device 100, which will be described later with reference to Figure 12.

[0019] The optical axis of lens 101 points in the same direction as the imaging direction of the imaging device 100, and the light beam passing through lens 101 forms an image on the image sensor of the imaging unit 111 of the imaging device 100. The lens drive unit 102 is composed of a drive system that drives lens 101 and changes the focal length of lens 101. The lens drive unit 102 is controlled by the pan-tilt-zoom control unit 114.

[0020] The pan drive unit 103 consists of a mechanical drive system and a motor that acts as a drive source for panning, and controls the rotational drive to rotate the imaging device 100 in the pan direction 105. The pan drive unit 103 is controlled by the pan-tilt-zoom control unit 114.

[0021] The tilt drive unit 104 consists of a mechanical drive and a motor that acts as a drive source for the tilt operation, and controls the rotational drive to rotate the imaging device 100 in the tilt direction 106. The tilt drive unit 104 is controlled by the pan-tilt-zoom control unit 114.

[0022] The imaging unit 111 is composed of an image sensor (not shown), such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 then converts the image of the subject formed through the lens 101 into an electrical signal using photoelectric conversion. The image processing unit 112 performs image processing, such as converting the electrical signal converted into a digital signal by the imaging unit 111 into a digital signal and compression encoding, to generate image data, which is the data of the captured image.

[0023] The pan-tilt-zoom control unit 114 controls the pan, tilt, and zoom of the imaging device 100 by controlling the pan drive unit 103, tilt drive unit 104, and lens drive unit 102 via optical PTZ based on instructions transmitted from the system control unit 113. The storage unit 115 stores (holds) information indicating the imaging range, for example.

[0024] The communication unit 116 communicates with the information processing device 200 via the I / F 1240, which will be described later with reference to Figure 12. For example, the communication unit 116 transmits image data of the image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 also transmits information indicating the current imaging range of the imaging device 100. Furthermore, the communication unit 116 receives control commands, which are commands for controlling the imaging device 100, transmitted from the information processing device 200, and transmits them to the system control unit 113.

[0025] The system control unit 113 controls the entire imaging device 100 according to the processing performed by the CPU 1200, as described later with reference to Figure 12, and performs the following processing, for example: The system control unit 113 analyzes the control commands for controlling the imaging device 100 transmitted from the information processing device 200 and performs processing according to the control commands. The system control unit 113 also instructs the pan-tilt-zoom control unit 114 to perform pan-tilt-zoom operations. Furthermore, when the system control unit 113 transmits the image data generated by the image processing unit 112 to the information processing device 200, it also adds information about the time of imaging and the imaging range to the image data.

[0026] In this embodiment, the imaging range based on optical PTZ is determined by the PTZ values ​​(P, T, and Z values) of the imaging device 100. The P value (Pan value) of the PTZ is, for example, the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging device 100, when one of the drive ends of the pan drive unit 103 is set to 0°. The T value (Tilt value) is, for example, the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging device 100, when one of the drive ends of the tilt drive unit 104 is set to 0°. The Z value (Zoom value) of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.

[0027] Next, the information processing of the information processing device 200 according to this embodiment will be described with reference to the functional blocks of the information processing device 200 shown in Figure 3. Each function of the information processing device 200 is implemented as follows, using the ROM 1220 and CPU 1200, which will be described later with reference to Figure 12. That is, each function shown in Figure 3 is implemented by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 900.

[0028] The communication unit 201 communicates with the imaging device 100 and, for example, receives image data of images captured by the imaging device 100. The communication unit 201 also transmits control commands to the imaging device 100 to control the imaging range of the imaging device 100.

[0029] The operation reception unit 202 receives user operations via an input device (not shown) such as a mouse or keyboard that is communicatively connected to the information processing device 200.

[0030] The display control unit 203 causes the display 210 to display, for example, an image based on image data transmitted from the imaging device 100, which is an image captured by the imaging device 100. Here, an image based on image data refers to an image obtained by decoding the image data by the information processing device 200, for example, when the image data was generated by compressing and encoding the image captured by the imaging device 100.

[0031] The display control unit 203 also displays a GUI (Graphical User Interface) on the display 210 for setting the shot function in electronic PTZ and optical PTZ.

[0032] The setting unit 204 sets parameters related to electronic PTZ and optical PTZ based on user operations performed on the GUI (settings screen) displayed on the display 210.

[0033] The first control unit 205 executes a shot function using a first control process (electronic PTZ) that sequentially changes the position or size of the portion region to be cut out. In other words, the first control unit 205 controls the execution of the shot function in electronic PTZ.

[0034] The second control unit 206 executes a shot function by a second control process (optical PTZ) that drives at least one of the pan drive unit 103, tilt drive unit 104, and lens drive unit 102 of the imaging device 100. In other words, the second control unit 206 controls the execution of the shot function in optical PTZ.

[0035] Referring now to Figures 4(a) and 4(b), the GUI for setting the shot function, which is displayed on the display 210 by the display control unit 201 in this embodiment, will be described. The GUI 400 shown in Figure 4(a) is a GUI that presents information on the movable range, which is the range that the imaging range can reach in a specified movement time, and also allows settings related to the shot function.

[0036] The GUI 400 includes an image display area 401 (first display area). In the example shown in Figure 4(a), the image display area 401 displays a panoramic image based on an image captured by the imaging device 100 as a predetermined image. The panoramic image is an image pre-generated by the imaging device 100, obtained by combining multiple images captured by the imaging device 100 while sequentially changing the imaging range using optical PTZ, and is generated using known techniques for generating panoramic images. In the example shown in Figure 4(a), the image display area 401 displays a panoramic image as a predetermined image, but is not limited to this. For example, an image captured by the imaging device 100 may be displayed as the predetermined image. In this case, it is desirable that the captured image displayed as the predetermined image is an image obtained by capturing a wide-angle range when the zoom is set to the WIDE end.

[0037] For the panoramic image displayed in the image display area 401, the user can specify a starting area corresponding to the starting position of the path in the shot function of the first control process, and an ending area corresponding to the ending position of the path, by dragging with the mouse or the like. In the example shown in Figure 4(a), the starting area 402 and the ending area 403 have been specified on the panoramic image in the image display area 401, and the frames of each area are displayed superimposed.

[0038] Furthermore, at this time, the aspect ratio of the partial regions extracted from the panoramic image in the first control process, such as the starting partial region 402, the ending partial region 403, and the partial regions in the path between them, is limited to the aspect ratio of the image captured by the imaging device 100. In addition, the range of the size of the partial regions extracted from the panoramic image is limited to the range from the field of view at the telephoto end to the field of view at the wide-angle end of the optical PTZ of the imaging device 100.

[0039] As shown in Figure 4(a), the GUI 400 includes a movement parameter specification area 404 (second display area), and the user can select either time specification or speed specification by pressing the selection button 405 in the movement parameter specification area 404 with the mouse. When time specification is selected, the portion area to be extracted is sequentially changed from the start portion area to the end portion area at the specified movement time in the electronic PTZ shot function. In the optical PTZ shot function, the imaging range is controlled by the specified movement time from the start imaging range corresponding to the start portion area to the end imaging range corresponding to the end portion area. When speed specification is selected, the portion area to be extracted is sequentially changed according to the specified movement speed from the start portion area to the end portion area in the electronic PTZ shot function. In the optical PTZ shot function, the imaging range is controlled by the specified movement speed from the start imaging range corresponding to the start portion area to the end imaging range corresponding to the end portion area. Note that the example shown in Figure 4(a) shows the case where time specification is selected, and the button display is different from that of speed specification, which is not selected. As shown in Figure 4(a), when time specification is selected, the movement parameter specification area 404 includes a slider bar 406 and increment / decrement buttons 407 for changing the movement time, and also includes information on the current value 408 indicating the currently specified movement time. The user can adjust the movement time as appropriate by operating the slider bar 406 or pressing the increment / decrement buttons 407. Figure 4(b) shows the case where speed specification is selected, which differs from the GUI 400 shown in Figure 4(a). In this case, the user can adjust the movement speed as appropriate by operating the slider bar 406 or pressing the increment / decrement buttons 407 in the movement parameter specification area 404, and the information on the current value 408 of the currently specified movement speed is displayed.

[0040] Returning to the explanation of Figure 4(a), the GUI 400 further includes a simulate start button 410 for instructing the start of the shot function of the first control process. When the simulate start button 410 is pressed by the user, the first control unit 205 executes the shot function of the first control process based on the currently selected parameters. The changes in the display of the GUI 400 when the simulate start button 410 is selected will now be explained with reference to Figures 5(a) to (c). Figure 5(a) shows the state of the GUI 400 when the user presses the simulate start button 410 by operating the mouse 501. At this time, the display control unit 203 changes the display pattern of the frame of the starting partial region 402, which is the starting position of the partial region to be cut out on the panoramic image, so that the frame is highlighted. Figure 5(b) shows the GUI 400 when the shot function of the first control process is being executed, and the display control unit 203 displays a message 502 indicating that it is generating a simulated image, which is the image obtained by the shot function of the first control process. Furthermore, while the shot function of the first control process is being executed, the frame 503 of the currently extracted portion area is superimposed on the panoramic image. This allows the user to understand which portion is currently being extracted. Figure 5(c) shows the GUI 400 when the shot function of the first control process is completed, and the display control unit 203 displays a message 504 indicating that the shot function of the first control process is completed, and a button 505 for displaying the generated simulated image. At this time, the display mode is different so that the frame of the end portion area 403, which is the end position of the extracted portion area, is highlighted.

[0041] As described above, when the user presses the simulation start button 410, the first control unit 205 executes a shot function of the first control process based on the currently selected first parameter information. Specifically, the first control unit 205 executes a shot function of the first control process based on the position information of the currently selected start and end portion regions in the image display area 401, and the information of the movement parameters specified in the movement parameter specification area 404. That is, the first parameter information includes the position information of the start and end portion regions, and the information of the movement parameters. By executing the shot function of the first control process, a simulated video can be generated. In the example shown in Figure 4(a), the first control unit 205 sequentially changes the portion region to be cut out from the start portion region 402 to the end portion region 403 over a specified movement time of 7 seconds. The first control unit 205 then acquires cut-out images of the portion region at each sequentially changed position and generates a simulated video from the acquired group of cut-out images.

[0042] The simulation image generation process will now be explained with reference to Figure 7. The first control unit 205 acquires the position information of the starting partial region 702, the position information of the ending partial region, the information of the movement time (or specified movement speed) specified in the movement parameter specification region 404, and the frame rate information. The position information of the partial region extracted from a predetermined image (panoramic image, etc.) is determined by the XY coordinates of the upper left vertex and the lower right vertex of the partial region, with the upper left vertex of the predetermined image as the origin. The first control unit 205 sequentially changes the partial region to be extracted from the starting partial region to the ending partial region according to the specified movement time (or movement speed), while ensuring that the aspect ratio of the extracted partial region is the same as the aspect ratio of the image of the imaging device 100. For example, if the specified movement time is t [seconds] and the frame rate is 30 [f / s], the first control unit 205 extracts 30t [times] of partial regions at equal intervals during the process in which the partial region is sequentially changed along the path 704, and acquires a group of extracted images. Furthermore, if the specified speed is v [pixels / s], the length of the path 704 is L [pixels], and the frame rate is 30 [f / s], the partial region is successively modified along the path 704, and 30 * (L / v) [times] of the partial region is extracted, acquiring a group of extracted images. The first control unit 205 acquires the group of extracted images acquired at each position in this way as the simulation video 705. The frame rate information used to generate the simulation video may be a pre-set one, or it may be changed as appropriate by the user.

[0043] Here, upon pressing the button 505 shown in Figure 5(c), the display control unit 203 displays the simulation image generated by the first control unit 205 on the display 210. After reviewing the simulation image, the user can adjust the first parameter information (position information of the start and end regions, and movement parameter information) related to the shot function of the first control process (start and end region information) on the GUI 400 as needed. After adjustment, the user can press the simulation start button 410 again to generate a simulation image using the shot function of the first control process based on the new parameters. If the user determines that the shot function of the first control process with the current first parameters is desirable, they press the operation start button 411. Upon pressing the operation start button 411, the second control unit 206 executes the shot function by the second control process (optical PTZ) according to the second parameter information set in the setting unit 204 based on the currently specified first parameter information. The process of setting the second parameter information based on the first parameter information by the setting unit 204 will be described later.

[0044] Here, the changes in the display of the GUI 400 when the operation start button 411 is pressed will be explained with reference to Figures 6(a) to (c). Figure 6(a) shows the GUI 400 when the operation start button 411 is pressed by the mouse 601 and the imaging device 100 is controlled to face the starting imaging range of the shot function by the second control process according to the second parameter information. At this time, the image obtained by imaging the starting imaging range is transmitted from the imaging device 100 to the information processing device 200, and the image is displayed in the image display area 401. Next, Figure 6(b) shows the GUI 400 when the shot function by the second control process is being executed, and a message 602 indicating that the shot function by the second control process is being executed is displayed. At this time, the image captured at the moment the shot function by the second control process is being executed is transmitted from the imaging device 100 to the information processing device 200 and is displayed in the image display area 401. Figure 6(c) shows the GUI 400 when the shot function by the second control process has finished, and a message 603 indicating that the shot function by the second control process has finished is displayed. At this time, an image obtained by capturing the imaging range at the end of the shot function by the second control process is transmitted from the imaging device 100 to the information processing device 200 and displayed in the image display area 401.

[0045] Next, we will explain the setting process for setting the second parameter information used in the shot function by the second control process (optical PTZ) based on the first parameter information used in the shot function by the first control process (electronic PTZ), with reference to Figure 8.

[0046] The image 801 shown in Figure 8 is a predetermined image from which a partial region is extracted, and is an image captured by the imaging device 100. In the following explanation, we will describe the process of converting the XY coordinates of the upper left vertex 803 and the lower right vertex 804 of the termination partial region 802, with the upper left vertex of the image 803 as the origin, into PTZ coordinates, using the PTZ value of the imaging device 100 when image 801 was captured. Here, if the PTZ value of the imaging device 100 when image 801 was captured is (P0, T0, Z0), and the XY coordinates of the image center 805 with the upper left vertex of the image as the origin are (x0, y0), then the PT coordinates corresponding to coordinates (x0, y0) are (P0, T0). Also, let the XY coordinates of the upper left vertex 803 of the termination partial region be (x1, y1), and the XY coordinates of the upper right vertex 804 of the termination partial region be (x2, y2). Furthermore, the setting unit 204 maintains a correspondence table that associates a certain Z value of the imaging device with the amount of Pan movement required to move the center of the field of view 805 by the image width 806 and the amount of Tilt movement required to move it by the image height 807. Here, the setting unit 204 refers to the correspondence table and calculates the amount of Pan movement Δp1 required to move the image horizontally by 808 and the amount of Tilt movement Δt1 required to move the image vertically by 809 by proportional calculation. Then, the setting unit 204 derives P1 by adding Δp1 to P0 of the PT coordinates (P0, T0) of the center of the field of view, and T1 by adding ΔT1 to T0. In this way, the setting unit 204 derives the PT coordinates (P1, T1) corresponding to the XY coordinates (x1, y1) of the upper left vertex 803 of the end portion region. Performing a similar process, the PT coordinates (P2, T2) corresponding to the XY coordinates (x2, y2) of the lower right vertex 804 of the termination region are also derived. The setting unit 204 further calculates the PT coordinates of the center position of the termination region as (P1 + P2 / 2, T1 + T2 / 2), and derives the Z(|P1-P2|) corresponding to the Pan movement amount |P1-P2| of the said termination region from the correspondence table. In this way, the setting unit 204 derives the PTZ value of the termination imaging range included in the second parameter information from the position information (XY coordinates on the image) of the termination region included in the first parameter information. Similarly, the setting unit 204 derives the PTZ value of the start imaging range included in the second parameter information from the position information of the start region included in the first parameter information.Let's assume that the movement time included in the first parameter information is t. In this case, the second control unit 206 generates a control command that controls the system to reach the PTZ value of the end imaging range included in the second parameter information from the PTZ value of the start imaging range included in the second parameter information within the specified movement time t. The second control unit 206 then transmits the generated control command to the imaging device 100, thereby realizing the shot function of the second control processing according to the second parameter information.

[0047] Here, the information processing of the information processing device 200 in this embodiment will be described with reference to the flow processing shown in Figure 9. The flow processing shown in Figure 9 is executed by the functional blocks of the information processing device 200 shown in Figure 3, which are realized by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 200.

[0048] First, in S901, the display control unit 203 acquires a predetermined image from which a partial region is extracted. At this time, the predetermined image may be an image captured by the imaging device 100, or it may be a panoramic image. Next, in S902, the display control unit 203 displays a GUI related to the settings of the first control process and the second control process on the display 210. At this time, the display control unit 203 displays, for example, the GUI 400 shown in Figure 4(a) on the display 210. Next, in S903, the first control unit 205 acquires the position information of the start and end partial regions currently specified by the user on the image display area 401 of the GUI 400. Next, in S904, the first control unit 205 acquires the information of the movement parameters currently specified by the user in the movement parameter specification area 404 of the GUI 400. Next, in S905, the GUI400 determines whether the simulation start button 410 has been pressed. If it is determined to have been pressed (Yes in S905), the system proceeds to S906. If it is determined not to have been pressed (No in S905), the system proceeds to S907. In S906, the first control unit 205 executes the shot function of the first control process according to the current first parameter information (position information of the start and end regions, and movement parameter information) to generate a simulated image. Next, in S907, the display control unit 203 determines whether the operation start button 411 has been pressed. If it is determined to have been pressed (Yes in S907), the system proceeds to S908. If it is determined not to have been pressed (No in S907), the system returns to S903. In S908, the setting unit 203 sets the second parameter information to be used in the shot function of the second control process based on the first parameter information. Next, in S909, the second control unit 206 executes the shot function of the second control process according to the set second parameter information.

[0049] As described above, the information processing device 200 in this embodiment performs the following processing. That is, it executes the shot function of the first control processing (electronic PTZ) using the first parameter information, and sets the second parameter information used in the shot function of the second control processing (optical PTZ) based on the first parameter information. Then, the information processing device 200 executes the shot function of the second control processing (optical PTZ) according to the second parameter information. In this way, in the trial phase, by executing the first control processing (electronic PTZ), even immediately after executing the shot function from a certain starting position according to certain parameters, it is possible to execute the shot function from a certain starting position according to different parameters. Then, in the operation phase, the shot function of the second control processing (optical PTZ) is executed according to the second parameter information set based on the first parameter information used in the trial phase. In this way, the shot function of the second control processing (optical PTZ) can be performed reflecting the desired parameters set by the user in the trial phase. Therefore, according to the information processing device 200 in this embodiment, it is possible to suppress the increase in the processing time required for the trial of the shot function.

[0050] (Embodiment 2) Embodiment 2 holds multiple first parameter information and can execute a first control process shot function according to the first parameter information selected in response to user operation, and a second control process shot function according to the second parameter information set based on the first parameter information. In this description, we will mainly explain the parts that differ from the embodiments described above, and the same or equivalent components and processes as in the embodiments described above will be denoted by the same reference numerals, and redundant explanations will be omitted.

[0051] Here, with reference to Figures 10(a) and 10(b), the GUI displayed by the information processing device 200 in this embodiment will be described. The GUI 1000 shown in Figure 10(a) is a setting screen displayed on the display 210 by the display control unit 203, and has tabs 1001 for managing setting pages in addition to the functions of the GUI 400 shown in Figure 4(a). In the GUI 1000 of Figure 10(a), the display mode of the "1" tab of tab 1001 is shown in white, indicating that setting page "1" is currently displayed in GUI 1000. In addition, the first parameter information (position information of the start and end parts of the region, movement parameters, etc.) currently set in Figure 10(a) is associated with and stored in setting page "1". When the operation reception unit 202 receives a user operation by pressing the "+" tab of tab 1001, the display of GUI 1000 transitions to Figure 10(b). At this time, a new setting page "2" is added to the GUI 1000 shown in Figure 10(a), and the setting screen for setting page "2" is displayed in the GUI 1000 shown in Figure 10(b). Here, the GUI 1000 shown in Figure 10(c) displays setting page "2" after the movement parameters have been adjusted in the movement parameter specification area 404 of the GUI 1000 in Figure 10(b). In addition, the setting page "2" shown in the GUI 1000 in Figure 10(c) is associated with and holds the first parameter information currently set in the GUI 1000 of Figure 10(c). At this time, the displayed setting page can be switched by pressing the various tabs of tab 1001. Now, let's assume that a certain setting page (for example, setting page "2") is currently displayed in the GUI 1000, and for example, the simulation start button 410 is pressed. At this time, according to the first parameter information associated with that setting page, the first control unit 205 executes the shot function of the first control process and generates a simulated image. Furthermore, let's assume that while a certain setting page is displayed in the GUI 1000, for example, the operation start button 411 is pressed. At this time, the second control unit 205 executes the shot function of the second control process according to the second parameter information set in the setting unit 204 based on the first parameter information associated with the certain setting page.

[0052] Thus, the information processing device 200 in this embodiment can separately associate and store first parameter information for each of the multiple setting pages. Furthermore, the information processing device 200 in this embodiment can select from multiple first parameter information to be used in the shot function of the first control process or the shot function of the second control process, in response to user operation.

[0053] Here, the information processing of the information processing device 200 in this embodiment will be described with reference to the flow shown in Figure 11. The flow shown in Figure 11 is executed by a functional block of the information processing device 200 shown in Figure 3, which is realized by the CPU 1200 of the information processing device 200 executing a computer program stored in the ROM 1220 of the information processing device 200.

[0054] First, in S1101, the display control unit 203 acquires a predetermined image from which a partial region is extracted. At this time, the predetermined image may be an image captured by the imaging device 100, or it may be a panoramic image. Next, in S1102, the display control unit 203 displays a GUI related to the settings of the first control process and the second control process on the display 210. At this time, the display control unit 203 displays, for example, the GUI 1000 shown in Figure 10(a) on the display 210. Next, in S1103, the display control unit 203 acquires information about the tab of the currently specified setting page. If the GUI 1000 in Figure 10(a) is displayed, the display control unit 203 acquires "1" as the information about the tab of the currently specified setting page. Next, in S1104, the display control unit 203 determines whether the displayed setting page has been changed by manipulating the tab. If it is determined that it has been changed (Yes in S1104), it proceeds to S1105, and if it is determined that it has not been changed (No in S1104), it proceeds to S1106. In S1105, the display control unit 203 displays a GUI that reflects the first parameter information held in association with the currently displayed settings page. Next, in S1106, the first control unit 205 obtains the position information of the start and end regions currently specified by the user on the image display area 401 of the GUI 400. Next, in S1107, it obtains the information of the movement parameters currently specified by the user in the movement parameter specification area 404 of the GUI 1000. Next, in S1108, the display control unit 203 determines whether the simulation start button 410 in the GUI 1000 has been pressed. If it is determined that it has been pressed (Yes in S1108), it proceeds to S1109. If it is determined that it has not been pressed (No in S1108), it proceeds to S1110. In S1109, the first control unit 205 executes the shot function of the first control process and generates a simulated image according to the first parameter information (position information of the start and end regions, and movement parameter information) recorded in association with the currently displayed setting page.Next, in S1110, the display control unit 203 determines whether the operation start button 411 has been pressed. If it is determined that it has been pressed (Yes in S1110), it proceeds to S1111. If it is determined that it has not been pressed (No in S1110), it returns to S1103. In S1111, the setting unit 203 sets the second parameter information to be used in the shot function of the second control process based on the first parameter information associated with the currently displayed setting page. Next, in S1112, the second control unit 206 executes the shot function of the second control process according to the set second parameter information.

[0055] As described above, the information processing device 200 in this embodiment can separately associate and store first parameter information for each of the multiple setting pages. Furthermore, the information processing device 200 in this embodiment can select the first parameter information to be used in the shot function of the first control process or the shot function of the second control process in response to user operation. In this way, it is possible to improve the usability of the setting screen while suppressing the increase in the time required to try the shot function.

[0056] (Other embodiments) Next, with reference to Figure 12, the hardware configuration of the information processing device 200 for realizing each of the functions of the above-described embodiment will be explained. In the following explanation, the hardware configuration of the information processing device 200 will be described, but the imaging device 100 will also be realized with a similar hardware configuration.

[0057] The information processing device 200 in this embodiment includes a CPU 1200, RAM 1210, ROM 1220, HDD 1230, and I / F 1240.

[0058] The CPU 1200 is a central processing unit that provides overall control over the information processing unit 200. The RAM 1210 temporarily stores the computer programs executed by the CPU 1200. The RAM 1210 also provides a work area used by the CPU 1200 when executing processing. Furthermore, the RAM 1210 can function, for example, as frame memory or buffer memory.

[0059] ROM1220 stores programs and other information that the CPU1200 uses to control the information processing unit 200. HDD1230 is a storage device that records image data and other data.

[0060] I / F1210 communicates with external devices via network 300, following protocols such as TCP / IP and HTTP.

[0061] In the above-described embodiments, examples are given in which the CPU 1200 performs processing. However, at least a portion of the CPU 1200's processing may be performed by dedicated hardware. For example, the process of displaying a GUI (Graphical User Interface) or image data on the display 210 may be performed by a GPU (Graphics Processing Unit). Also, the process of reading program code from the ROM 1220 and loading it into the RAM 1210 may be performed by a DMA (Direct Memory Access) functioning as a data transfer device.

[0062] Furthermore, the present invention can also be realized by a process in which one or more processors read and execute a program that implements one or more of the functions of the above-described embodiments. The program may be supplied to a system or device having a processor via a network or storage medium. The present invention can also be realized by a circuit (e.g., an ASIC) that implements one or more of the functions of the above-described embodiments. Furthermore, each part of the information processing device 200 may be implemented by the hardware shown in Figure 12, or by software. Furthermore, one or more of the functions of the information processing device 200 according to the above-described embodiments may be implemented by other devices.

[0063] Although the present invention has been described above along with its embodiments, these embodiments are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features. For example, combinations of the embodiments are also included in the disclosure of this specification. [Explanation of Symbols]

[0064] 100 Imaging device 200 Information Processing Devices 210 displays 201 Communications Department 202 Operation Reception Section 203 Display Control Unit 204 Settings Section 205 First Control Unit 206 Second Control Unit

Claims

1. A first control means that executes a shot function by a first control process that changes the position of a partial region to be cut out from a predetermined image from a predetermined start position to a predetermined end position, Setting means for setting second parameter information used in a shot function by a second control process that drives at least one of pan, tilt, and zoom of the imaging means based on first parameter information used in the shot function of the first control process, which includes the information of the start position and the information of the end position, A second control means that executes the shot function by the second control process by changing the imaging direction of the imaging means from a predetermined start position to an end position according to the second parameter information set by the setting means, The system includes a display control means that causes a setting screen for setting the first parameter information to be displayed on a display means, The settings screen includes a first button for executing the shot function according to the first control process, and a second button for executing the shot function according to the second control process. When the first button is pressed by the user, the first control means executes the shot function according to the first control process, and when the second button is pressed by the user, the second control means executes the shot function according to the second control process. An information processing device characterized by the following:

2. The information processing apparatus according to claim 1, characterized in that the settings screen includes a first display area for displaying the predetermined image.

3. The information processing apparatus according to claim 2, characterized in that, in the first display area, an area corresponding to the start position in the shot function of the first control processing and an area corresponding to the end position in the shot function of the first control processing can be set.

4. The information processing apparatus according to claim 3, characterized in that a frame corresponding to the starting position and a frame corresponding to the ending position are superimposed and displayed on the predetermined image.

5. The information processing apparatus according to any one of claims 1 to 4, characterized in that the setting screen includes a second display area for specifying movement parameters that determine the movement time or movement speed in the shot function of the first control process.

6. The information processing apparatus according to any one of claims 1 to 5, characterized in that when the shot function of the second control process is being executed, information indicating that the shot function of the second control process is being executed is displayed on the settings screen.

7. The information processing apparatus according to any one of claims 1 to 6, characterized in that the first control means executes a shot function of the first control process according to the first parameter information selected in response to user operation from among a plurality of first parameter information including the held first parameter information.

8. The information processing apparatus according to any one of claims 1 to 7, characterized in that the first parameter information includes position information corresponding to the start position in the shot function of the first control process, position information corresponding to the end position in the shot function of the first control process, and information on movement parameters that determine the movement time or movement speed in the shot function of the first control process.

9. The setting means derives the coordinate value of PTZ corresponding to the starting position according to the position information corresponding to the starting position, and derives the coordinate value of PTZ corresponding to the ending position according to the position information corresponding to the ending position, The information processing apparatus according to claim 8, characterized in that the second parameter information includes at least the coordinate value of PTZ corresponding to the start position and the coordinate value of PTZ corresponding to the end position.

10. The information processing apparatus according to any one of claims 1 to 9, characterized in that the predetermined image is an image captured by an imaging means, or a panoramic image based on an image captured by the imaging means.

11. The information processing apparatus according to any one of claims 1 to 10, further comprising acquisition means for acquiring the first parameter information specified by the user.

12. The information processing apparatus according to claim 11, characterized in that the acquisition means acquires a new first parameter when the first button is pressed by the user after the first control means has executed the shot function by the first control process.

13. A first control step involves executing a shot function by a first control process that changes the position of a portion of an image to be cut out from a predetermined image, from a predetermined start position to a predetermined end position. A setting step for setting second parameter information used in a shot function by a second control process that drives at least one of the pan, tilt, and zoom of the imaging means based on first parameter information, which includes the information of the start position and the information of the end position, the parameter information used in the shot function of the first control process, A second control step, which executes the shot function by the second control process, by changing the imaging direction of the imaging means from a predetermined start position to an end position according to the second parameter information set in the setting step, The process includes a display control step of displaying a setting screen for setting the first parameter information on a display means, The settings screen includes a first button for executing the shot function according to the first control process, and a second button for executing the shot function according to the second control process. When the first button is pressed by the user, the shot function according to the first control process is executed, and when the second button is pressed by the user, the shot function according to the second control process is executed. An information processing method characterized by the following:

14. A computer program for causing a computer to function as one of the means of an information processing apparatus described in any one of claims 1 to 12.

Images