Information processing device, information processing method, and program

Abstract

This allows for prior confirmation of the imaging area after controlling the imaging direction and magnification of the imaging device. [Solution] The information processing device acquires an image from an imaging device whose imaging direction and imaging magnification can be changed, and accepts a user operation to change at least one of the imaging direction and imaging magnification of the imaging device. The information processing device also displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the range in which the first region and the imaging direction and imaging magnification of the imaging device can be changed according to the user operation. In this case, if the first region and the second region coincide, the information processing device displays the first frame superimposed on the image, and if the first region and the second region do not coincide, it displays the first frame and the second frame superimposed on the image.

Description

Technical Field

[0001] The present invention relates to an information processing technology for controlling image display.

Background Art

[0002] In recent years, in video production, the use of a system for controlling an imaging device connected to a network from a remote location has been increasing. Also, in this system, when a user designates an arbitrary area on the captured image displayed on the terminal device, a function for controlling the imaging direction (pan direction and tilt direction) and imaging magnification (zoom) of the imaging device so that the captured image corresponding to the designated area is displayed is known. In the following description, this function is referred to as area zoom. In area zoom, when a user designates an area outside the control range of the imaging direction and imaging magnification of the imaging device, the designated area does not match the captured image after area zoom execution, and an area unintended by the user will be captured. In contrast, Patent Document 1 proposes a technique for performing a warning display indicating that the designated area is not within the movable range and visible range of the camera in area zoom. Also, Patent Document 2 discloses a technique for notifying by changing the color of a frame or displaying an icon or message when the designated area is not within the movable range and visible range of the camera in area zoom.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, with the conventional technology described above, there is a problem in that if the area specified by the user is outside the control range of the imaging device, and the specified area does not match the area captured after area zoom is performed, the imaging area after the imaging direction and imaging magnification of the imaging device cannot be confirmed in advance.

[0005] Therefore, the present invention aims to enable prior confirmation of the imaging area after controlling the imaging direction and imaging magnification of the imaging device. [Means for solving the problem]

[0006] The information processing apparatus of the present invention includes: acquisition means for acquiring an image captured from an imaging device capable of changing the imaging direction and imaging magnification; reception means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device; display control means for displaying at least one of a first frame corresponding to a first region set according to the user operation and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed; wherein the display control means displays the first frame superimposed on the image captured when the first region and the second region coincide, and displays the first frame and the second frame superimposed on the image captured when the first region and the second region do not coincide. [Effects of the Invention]

[0007] According to the present invention, the imaging area after controlling the imaging direction and imaging magnification of the imaging device can be confirmed in advance. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the system configuration of the embodiment. [Figure 2] This figure shows an example of an image and UI according to the first embodiment. [Figure 3] This is a flowchart of the processing on the client device side in the first embodiment. [Figure 4]This is a flowchart of the server device processing in the first embodiment. [Figure 5] This is a flowchart of the server device processing in the second embodiment. [Figure 6] This is a flowchart of the processing on the client device side in the second embodiment. [Figure 7] This is a screen diagram showing an example of an image and UI according to the second embodiment. [Figure 8] This is a flowchart of the processing on the client device side in the third embodiment. [Figure 9] This is a screen diagram showing an example of an image and UI according to the third embodiment. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings. The embodiments described below are not limiting to the present invention, and not all of the features described in these embodiments are essential to the solution of the present invention; these features may be combined arbitrarily. The configuration of the embodiments may be modified or changed as appropriate depending on the specifications of the device to which the present invention is applied and various conditions (usage conditions, usage environment, etc.). Furthermore, some of the embodiments described later may be combined as appropriate.

[0010] <First Embodiment> Figure 1 shows an example of a system configuration according to the first embodiment. In the system of this embodiment, the server device 101 and the client device 102 are connected via a network 103. The server device 101 is configured to include an imaging unit 104, a drive unit 105, a control unit 106, a calculation unit 107, and a communication control unit 108. The processing related to each of the functional units of the server device 101, namely the control unit 106, the calculation unit 107, and the communication control unit 108, may be implemented by a general-purpose CPU (Central Processing Unit). Alternatively, the processing related to each of these functional units may be implemented by a GPU (Graphics Processing Unit) or the like.

[0011] The client device 102 is an example of an information processing device and is configured to include a reception unit 109, a frame setting unit 110, a determination unit 111, a communication control unit 112, a display control unit 113, and a display unit 114. In this embodiment, the client device 102 is assumed to be a general-purpose PC (Personal Computer), but is not limited to this. For example, a dedicated client terminal may be used, or similar functions may be realized in a portable information processing device such as a tablet terminal or smartphone. The processing related to each of the functional units in the client device 102, namely the reception unit 109, frame setting unit 110, determination unit 111, communication control unit 112, and display control unit 113, may be realized by a general-purpose CPU or GPU.

[0012] Network 103 is assumed to be configured by, for example, Ethernet®, but is not limited to this. For example, network 103 can be configured by the Internet, a wired LAN (Local Area Network), a wireless LAN, or a WAN (Wide Area Network). Multiple server devices 101 or multiple client devices 102 may be connected to network 103.

[0013] In this embodiment, the server device 101 implements a function to control the imaging direction and imaging magnification of the imaging unit 104 so that when a user specifies an arbitrary area on an image displayed on the client device 102, an image corresponding to that specified area is displayed. In this embodiment, the imaging direction of the imaging unit 104 is changeable, and this change is achieved by driving the imaging unit 104 in the pan or tilt direction. In this embodiment, the imaging magnification of the imaging unit 104 is also changeable, and this change is achieved by driving the zoom lens provided in the imaging unit 104. In the following description, changing the imaging magnification of the imaging unit 104 will be referred to as changing the zoom. In this embodiment as well, the function to control the imaging direction and imaging magnification of the imaging unit 104 so that an image corresponding to an area specified by the user is displayed is called area zoom.

[0014] The details of the configuration of the server device 101 will be described. The imaging unit 104 is an imaging device (camera) that captures a subject and acquires an image. The imaging unit 104 in the present embodiment converts the image acquired by imaging into digital image data that can be distributed over a network such as JPEG, and outputs the converted image data to a communication control unit 108 described later. Further, the imaging unit 104 also has a function of changing the zoom ratio under the control of a control unit 106 described later. However, it is assumed that the imaging unit 104 is limited in the range in which the imaging magnification (zoom ratio) can be changed (hereinafter referred to as the zoom driveable range).

[0015] The drive unit 105 changes the imaging direction of the imaging unit 104 by driving the imaging unit 104 in the pan direction or the tilt direction (hereinafter referred to as the pan / tilt direction) under the control of a control unit 106 described later. However, the drive unit 105 is limited in the range in which it can drive the imaging unit 104 in the pan / tilt direction. Hereinafter, the range in which the imaging unit 104 can be driven in the pan direction is referred to as the pan driveable range, the range in which it can be driven in the tilt direction is referred to as the tilt driveable range, and when the pan direction and the tilt direction are not distinguished, it is referred to as the pan / tilt driveable range.

[0016] The control unit 106 changes the zoom ratio of the imaging unit 104 and the pan / tilt direction of the drive unit 105 according to the coordinates in the zoom of the imaging unit 104 and the pan / tilt direction of the drive unit 105 (hereinafter referred to as PTZ coordinates) calculated by an arithmetic unit 107 described later. Further, the control unit 106 holds the PTZ coordinate information in the pan direction and the tilt direction of the zoom of the imaging unit 104 and the drive unit 105, and also holds the information on the zoom driveable range of the imaging unit 104 and the information on the pan / tilt driveable range of the drive unit 105.

[0017] The calculation unit 107 receives the coordinates on the UI of a specified area (hereinafter referred to as UI coordinates) from the user via the user interface (hereinafter referred to as UI) described later, via the reception unit 109 of the client device 102, and converts them to PTZ coordinates via the communication control unit 108. The calculation unit 107 also performs area determination processing to determine the imaging area to be imaged by area zoom. As part of the area determination processing, the calculation unit 107 calculates the PTZ coordinates of the imaging area to be imaged by area zoom based on the PTZ coordinates of the specified area converted from UI coordinates and information on the zoom driveable range of the imaging unit 104 and the pan / tilt driveable range of the drive unit 105. Furthermore, the calculation unit 107 also calculates the UI coordinates used when the display control unit 113 of the client device 102 displays a frame representing the imaging area to be imaged by area zoom (hereinafter referred to as the imaging area frame), as described later.

[0018] For example, the calculation unit 107 sets the coordinates closest to the specified area within the driveable range for parameters that are outside the driveable range among the parameters that set the zoom of the imaging unit 104 and the pan / tilt direction of the drive unit 105. On the other hand, the calculation unit 107 sets the user-specified coordinates for parameters that are within the driveable range among the parameters that set the zoom of the imaging unit 104 and the pan / tilt direction of the drive unit 105. Then, the calculation unit 107 calculates the PTZ coordinates and UI coordinates of the area determined by the coordinates set as described above, and uses them as the PTZ coordinates and UI coordinates of the imaging area to be imaged by area zoom.

[0019] The communication control unit 108 transmits the image data acquired by the imaging unit 104 and the calculation results of the calculation unit 107 to the client device 102 via the network 103. The calculation results of the calculation unit 107 include, for example, the UI coordinates of the imaging area frame determined by area zoom. The communication control unit 108 also receives the UI coordinates and control information calculated by the frame setting unit 110 of the client device 102, which will be described later, via the network 103.

[0020] Next, we will describe the details of the configuration of the client device 102. The reception unit 109 receives user operations via pointing devices such as keyboards, mice, and touch panels provided by the client device 102. In this embodiment, the reception unit 109 receives instructions to change the zoom of the imaging unit 104 and the pan / tilt direction of the drive unit 105 (i.e., imaging magnification and imaging direction) based on user operations on the graphical user interface (GUI). The reception unit 109 also accepts the specification of the area to be imaged by area zoom.

[0021] The communication control unit 112 receives image data acquired by the imaging unit 104 of the server device 101 and transmitted from the communication control unit 108 via the network 103, and outputs the image data to the display control unit 113. The communication control unit 112 also receives the calculation results from the calculation unit 107 of the server device 101 via the network 103. The calculation results from the calculation unit 107 of the server device 101 include the UI coordinates of the imaging area frame calculated by the area zoom as described above. The communication control unit 112 also transmits the UI coordinates of the specified area frame calculated by the frame setting unit 110 to the server device 101 via the network 103.

[0022] The frame setting unit 110 performs the necessary settings for the display control unit 113 to display the display unit 114 a display frame (hereinafter referred to as the specified area frame) corresponding to the specified area received from the user by the reception unit 109. These settings include, for example, calculating the UI coordinates of the position where the specified area frame will be displayed on the display unit 114. The determination unit 111 determines whether the UI coordinates of the designated area frame calculated by the frame setting unit 110 match the UI coordinates of the imaging area frame obtained by area zoom, which are transmitted from the server device 101 and received by the communication control unit 112. In other words, the determination unit 111 determines whether the designated area specified by the user matches the imaging area obtained by area zoom captured by the imaging unit 104 of the server device 101.

[0023] The display control unit 113 acquires the captured image captured and transmitted by the imaging unit 104 of the server device 101 via the communication control unit 112 and controls it to display on the display unit 114. The display control unit 113 also controls the display on the display unit 114 as described later, based on the results of user operation detection by the reception unit 109. For example, the display control unit 113 generates a GUI using the captured image obtained via the communication control unit 112, and generates the GUI using the calculation results of the frame setting by the frame setting unit 110 and the calculation results of the calculation unit 107 of the server device 101 acquired via the determination unit 111. The display control unit 113 controls the display on the display unit 114 to display the generated GUI.

[0024] In this embodiment, the display control unit 113 displays on the display unit 114 at least one of the following: a designated area frame corresponding to a user-specified area, and an imaging area frame corresponding to the imaging area calculated by the area zoom calculated by the server device 101's calculation unit 107. For example, if the determination unit 111 determines that the designated area frame and the imaging area frame match, the display control unit 113 superimposes the designated area frame onto the captured image and displays it on the display unit 114. Alternatively, if the determination unit 111 determines that the designated area frame and the imaging area frame do not match, the display control unit 113 superimposes both the designated area frame and the imaging area frame onto the captured image and displays them on the display unit 114.

[0025] The display unit 114 is a display device that displays captured images acquired by the imaging unit 104 and GUIs generated by the display control unit 113 under the control of the display control unit 113. In this embodiment, an example is given in which the client device 102 has a built-in display unit 114, but it is not limited to this. The display unit 114 may be provided outside the client device 102 and connected to the client device 102 to display captured images and GUIs under the control of the display control unit 113 of the client device 102.

[0026] In Figure 1, the configuration is shown as an example in which the server device 101 includes an imaging unit 104 and a drive unit 105, but the configuration is not limited to this. For example, an external drive unit having a drive unit 105 may be connected to the server device 101, and the control unit 106 of the server device 101 may control the drive unit to change the imaging direction of the imaging unit 104. Alternatively, for example, an external imaging device having an imaging unit 104 may be connected to the server device 101, and the control unit 106 of the server device 101 may control the zoom of the imaging unit 104 of the imaging device.

[0027] Figure 2 shows an example of the UI according to the first embodiment, and is a diagram showing an example of the screen displayed on the display unit 114 of the client device 102. As will be described in detail later, Figure 2(a) shows an example of the UI used to explain when the area specified by the user is, for example, outside the zoom driveable range of the imaging unit 104. Similarly, as will be described in detail later, Figure 2(b) shows an example of the UI used to explain when the area specified by the user is, for example, outside the pan-tilt driveable range of the drive unit 105. The UI shown in Figure 2 is a GUI used when the user performs various operations, and is generated by the display control unit 113 and displayed on the display unit 114. The display area 201 shown in Figure 2 is the display area on the display unit 114 of the client device 102, and the captured image display area 202 is the display area of ​​the captured image received from the server device 101.

[0028] In Figures 2(a) and 2(b), the designated area frame 203a and designated area frame 203b are display frames that represent the range specified by the user on the UI as the area to be imaged by area zoom. The user specifies the range of designated area frame 203a and designated area frame 203b, for example, by dragging and dropping with the mouse. The starting point coordinate 204a is the UI coordinate of the starting point when specifying the range of designated area frame 203a, and the ending point coordinate 205a is the UI coordinate of the ending point of designated area frame 203a. Similarly, the starting point coordinate 204b is the UI coordinate of the starting point when specifying the range of designated area frame 203b, and the ending point coordinate 205b is the UI coordinate of the ending point of designated area frame 203b. The imaging area frame 206a and imaging area frame 206b show the imaging area frame of the area zoom calculated by the calculation unit 107 of the server device 101.

[0029] The process flow until the area zoom imaging area frame 206a is displayed will be explained using the flowcharts of this embodiment shown in Figures 3 and 4. Figure 3 is a flowchart of the process performed on the client device side of the first embodiment, and Figure 4 is a flowchart of the process performed on the server device side of the first embodiment. In the following flowcharts, the symbol S represents a processing step (processing step).

[0030] First, as part of the S301 process, the reception unit 109 of the client device 102 detects the operation of a pointing device such as a mouse operated by the user and accepts the range specification of the area to be imaged by area zoom. For example, when the reception unit 109 detects the start coordinates 204a and end coordinates 205a specified on the image display area 202 by a mouse drag-drop operation, it notifies the frame setting unit 110 of these start coordinates 204a and end coordinates 205a. The frame setting unit 110 acquires the range of the rectangle indicated by the start coordinates 204a and end coordinates 205a as the specified area specified by the user and performs the necessary settings to display the specified area frame 203a and specified area frame 203b corresponding to that specified area.

[0031] The method by which the user designates a portion of the captured image displayed in the captured image display area 202 as a designated area is not limited to the above example. For example, the user may designate a region corresponding to a predetermined shape by dragging that shape onto the captured image display area 202. Alternatively, the user may designate a designated area by tracing over the captured image display area 202 with a mouse pointer or finger. In this embodiment, an example has been described in which a region is designated within the range of the captured image currently being captured by the imaging unit 104, but this is not the only example. For example, when the imaging direction and zoom of the imaging unit 104 are changed, the user may designate a designated area on an image showing the range that can be captured by the imaging unit 104.

[0032] Next, in the S302 process, the frame setting unit 110 calculates the UI coordinates of the position where the designated area frame will be displayed on the screen of the display unit 114, based on the designated area received from the user by the reception unit 109 as described above. Then, the display control unit 113 starts control to display the designated area frame on the screen of the display unit 114 based on the UI coordinates calculated by the frame setting unit 110. In the example of Figure 2(a), the frame setting unit 110 calculates the UI coordinates of the designated area frame 203a based on the designated area input by the user, and the display control unit 113 starts control to display the designated area frame 203a on the screen of the display unit 114 based on those UI coordinates. In the example of Figure 2(b), the frame setting unit 110 calculates the UI coordinates of the designated area frame 203b based on the designated area input by the user, and the display control unit 113 starts control to display the designated area frame 203b on the screen of the display unit 114 based on those UI coordinates.

[0033] Next, in the S303 process, the communication control unit 112 transmits the UI coordinates of the designated area frame calculated by the frame setting unit 110 to the server device 101 via the network 103. In the example of Figure 2(a), the communication control unit 112 transmits the UI coordinates of the designated area frame 203a to the server device 101 via the network 103. In the example of Figure 2(b), the communication control unit 112 transmits the UI coordinates of the designated area frame 203b to the server device 101 via the network 103.

[0034] The server device 101 performs the processes shown in the flowchart in Figure 4. First, as part of the S401 process, the communication control unit 108 of the server device 101 obtains the UI coordinates of the designated area frame from the client device 102 via the network 103. In the example in Figure 2(a), the communication control unit 108 obtains the UI coordinates of the designated area frame 203a from the client device 102. In the example in Figure 2(b), the communication control unit 108 obtains the UI coordinates of the designated area frame 203b from the client device 102.

[0035] Next, in the process of S402, the calculation unit 107 receives the UI coordinates of the designated area frame from the communication control unit 108. Also in S402, the calculation unit 107 obtains zoom driveable range information, which is the driveable range information of the imaging unit 104, and pan / tilt driveable range information, which is the driveable range information of the drive unit 105, via the control unit 106. Then, based on the UI coordinates of the designated area frame, the zoom driveable range information, and the pan / tilt driveable range information, the calculation unit 107 calculates the PTZ coordinates corresponding to the imaging area to be imaged by area zoom, and further converts these PTZ coordinates into UI coordinates to calculate the UI coordinates of the imaging area frame. In the example of Figure 2(a), the calculation unit 107 receives the UI coordinates of the designated area frame 203a, calculates the PTZ coordinates, and then obtains the UI coordinates of the imaging area frame 206a converted to UI coordinates. In the example shown in Figure 2(b), the calculation unit 107 receives the UI coordinates of the specified region frame 203b, calculates the PTZ coordinates, and then obtains the UI coordinates of the imaging region frame 206b, which have been converted to UI coordinates.

[0036] If the UI coordinates of the specified area frame sent from the client device 102 are outside the driveable range of the imaging unit 104 or the drive unit 105, the calculation unit 107 sets the parameters for driving the imaging unit 104 and the drive unit 105 as follows.

[0037] For example, if the UI coordinates of the specified area frame are outside the zoom driveable range, the calculation unit 107 sets the zoom parameters for the PTZ coordinates that are outside the zoom driveable range to the coordinates closest to the specified area within the zoom driveable range. On the other hand, for the PTZ coordinates that are within the zoom driveable range, the calculation unit 107 sets the coordinates of the area corresponding to the user's specified area. The calculation unit 107 then calculates the PTZ coordinates and UI coordinates of the area determined by these set coordinates as the PTZ coordinates and UI coordinates of the imaging area to be imaged by area zoom.

[0038] For example, if the UI coordinates of the specified area frame are outside the pan-tilt driveable range, the calculation unit 107 sets the pan-tilt direction parameter of the PTZ coordinates outside the pan-tilt driveable range to the coordinates closest to the specified area within the pan-tilt driveable range. On the other hand, for the pan-tilt direction parameter of the PTZ coordinates within the pan-tilt driveable range, the calculation unit 107 sets the coordinates of the area corresponding to the user's specified area. Then, the calculation unit 107 calculates the PTZ coordinates and UI coordinates of the area determined by these set coordinates as the PTZ coordinates and UI coordinates of the imaging area to be imaged by area zoom.

[0039] The example in Figure 2(a) above shows an example of the UI of the display unit 114 when the designated area indicated by the designated area frame 203a is outside the zoom driveable range in the zoom-in control of the imaging unit 104, but is within the pan-tilt driveable range in the pan-tilt control of the drive unit 105. In the example in Figure 2(a), the calculation unit 107 sets the maximum value in the zoom-in control of the imaging unit 104 as the zoom parameter for the PTZ coordinates and calculates the PTZ coordinates and UI coordinates of the imaging area frame 206a. On the other hand, the calculation unit 107 sets the coordinate values ​​of the designated area frame 203a as the pan-tilt direction parameter for the PTZ coordinates.

[0040] Figure 2(b) shows an example of the UI of the display unit 114 when the designated area indicated by the designated area frame 203b falls outside the pan driveable range in the leftward direction along the pan direction, for example, when the drive unit 105 controls the pan direction. In the example of Figure 2(b), the calculation unit 107 sets the maximum value for leftward pan control by the drive unit 105's pan direction control as the pan direction parameter and calculates the PTZ coordinates and UI coordinates of the imaging area frame 206b. On the other hand, the calculation unit 107 sets the values ​​of the designated area frame 203b for the zoom and tilt direction parameters of the PTZ coordinates.

[0041] Next, in the S403 process, the communication control unit 108 of the server device 101 transmits the UI coordinates of the imaging area frame calculated by the area zoom by the calculation unit 107 to the client device 102 via the network 103. In the example of Figure 2(a), the communication control unit 108 transmits the UI coordinates of the imaging area frame 206a to the client device 102. In the example of Figure 2(b), the communication control unit 108 transmits the UI coordinates of the imaging area frame 206b to the client device 102.

[0042] As part of the process at S304 in Figure 3, the communication control unit 112 of the client device 102 acquires the UI coordinates of the imaging area frame transmitted from the server device 101 via the network 103. In the example of Figure 2(a), the communication control unit 112 acquires the UI coordinates of the imaging area frame 206a, and in the example of Figure 2(b), the communication control unit 112 acquires the UI coordinates of the imaging area frame 206b.

[0043] Next, in the S305 process, the determination unit 111 performs a determination process to determine whether the UI coordinates of the designated area frame calculated by the frame setting unit 110 match the UI coordinates of the imaging area frame received by the communication control unit 112. In the example in Figure 2(a), the determination unit 111 determines whether the UI coordinates of the designated area frame 203a match the UI coordinates of the imaging area frame 206a. In the example in Figure 2(b), the determination unit 111 determines whether the UI coordinates of the designated area frame 203b match the UI coordinates of the imaging area frame 206b. If the UI coordinates of the designated area frame and the UI coordinates of the imaging area frame do not match, the client device 102 proceeds to S306. On the other hand, if the UI coordinates of the designated area frame and the UI coordinates of the imaging area frame match, the client device 102 proceeds to S307. In both the examples in Figure 2(a) and Figure 2(b), the UI coordinates of the designated area frame and the UI coordinates of the imaging area frame do not match, so the processing of the client device 102 will proceed to S306.

[0044] When the process transitions to S306, the display control unit 113 controls the display unit 114 to superimpose the imaging region frame onto the image display area, along with the designated region frame displayed in S302, based on the UI coordinates of the imaging region frame acquired via the determination unit 111. In the example of Figure 2(a), the display control unit 113 controls the display unit 114 to superimpose the imaging region frame 206a onto the image display area 202 along with the designated region frame 203a. In the example of Figure 2(b), the display control unit 113 controls the display unit 114 to superimpose the imaging region frame 206b onto the image display area 202 along with the designated region frame 203b. After that, the processing of the client device 102 transitions to S307. Furthermore, if the UI coordinates of the designated area frame and the UI coordinates of the imaging area frame coincide, only the designated area frame 203a and designated area frame 203b displayed in S302 will be superimposed on the imaging image display area 202.

[0045] Upon transitioning to S307, the reception unit 109 determines whether the user-specified area has been confirmed. For example, if the user inputs an instruction to complete the range specification of the area to be imaged using area zoom, the reception unit 109 determines that the user-specified area has been confirmed. If the user-specified area has been confirmed, the processing of the client device 102 transitions to S308. In the examples of Figure 2(a) and Figure 2(b), when the reception unit 109 detects the end of the area specification operation from the user, the processing of the client device 102 transitions to S308. On the other hand, if the user-specified area has not been confirmed, the processing of the client device 102 returns to S302.

[0046] If the system transitions to S308, the display control unit 113 controls the display unit 114 to terminate the display of the designated area frame and the imaging area frame. In the example shown in Figure 2(a), the display control unit 113 controls the display unit 114 to terminate the display of the designated area frame 203a and the imaging area frame 206a. In the example shown in Figure 2(b), the display control unit 113 controls the display unit 114 to terminate the display of the designated area frame 203b and the imaging area frame 206b.

[0047] In the system according to the first embodiment, the imaging area frame is displayed based on the user-specified area, the zoom driveable range, and the pan / tilt driveable range. As a result, according to this embodiment, even if the specified area is outside the control range of the imaging device and the specified area does not coincide with the area captured after area zoom is performed, the user can check in advance the imaging area after the imaging direction and imaging magnification of the imaging device have been controlled.

[0048] It should be noted that this embodiment is not limited to the example described above. In the example of Figure 2(a), the imaging area frame is represented by a frame shape, but for example, when the zoom is controlled to a wide angle, the image to be displayed may be displayed within the frame of the imaging area frame 206a and superimposed on the image on the image display area 202. Alternatively, for example, when the zoom is controlled to a telephoto angle, the image displayed in the image display area 202 may be displayed directly within the imaging area frame 206a and superimposed on the image displayed in the image display area 202.

[0049] <Second Embodiment> In the second embodiment, an example will be described in which the control end of the pan-tilt driveable range of the drive unit 105 is displayed on the display unit 114. In the second embodiment, the same configurations and processing steps (processing steps) as described in the first embodiment will be denoted by the same reference numerals used in the first embodiment, and their descriptions will be omitted.

[0050] Figure 5 is a flowchart showing the processing flow performed by the server device 101 according to the second embodiment. Figure 6 is a flowchart showing the processing flow performed by the client device 102 according to the second embodiment. Note that the processing steps S301-S303, S305-S308, S401, and S402 are the same processing steps as those described in the first embodiment.

[0051] Figure 7 shows an example of a UI displayed on the display unit 114 of the client device 102 according to the second embodiment. The display area 701 and the captured image display area 702 correspond to the display area 201 and the captured image display area 202 shown in Figure 2 of the first embodiment, respectively. The designated area frame 703 is a frame representing the designated area specified by the user on the UI as the area to be captured by area zoom, similar to the first embodiment described above. The starting point coordinates 704 are the UI coordinates of the starting point when the designated area frame 703 is specified by user operation via a mouse or the like, similar to the example of the first embodiment. Similarly, the ending point coordinates 705 are the UI coordinates of the ending point when the designated area frame 703 is specified by user operation via a mouse or the like. The imaging area frame 706 is a frame indicating the range of the imaging area of ​​the imaging unit 104 after area zoom, similar to the first embodiment.

[0052] In the second embodiment, the display control unit 113 displays dashed lines on the UI representing the control ends of the pan-tilt driveable range of the drive unit 105. In the example in Figure 7, the dashed line representing the UI coordinates of the control end of the pan driveable range is displayed as the pan control end 707, and the dashed line representing the UI coordinates of the control end of the tilt driveable range is displayed as the tilt control end 708.

[0053] The process according to the second embodiment will be explained below with reference to the flowcharts in Figures 5 and 6, and using the actual screen example in Figure 7. In the second embodiment, after S401 and S402, the processing of the server device 101 transitions to S501. When the process transitions to S501, the calculation unit 107 calculates the UI coordinates corresponding to the PTZ coordinates of each control end of the pan-tilt driveable range of the drive unit 105, based on the PTZ coordinates corresponding to the current imaging area obtained in S401 and the information on the pan-tilt driveable range obtained in S402. In the example shown in Figure 7, the calculation unit 107 calculates the UI coordinates of the pan control end 707 corresponding to the PTZ coordinates of the control end of the pan driveable range, and the UI coordinates of the tilt control end 708 corresponding to the PTZ coordinates of the control end of the tilt driveable range.

[0054] Next, in the S502 process, the communication control unit 108 transmits the UI coordinates of the imaging area frame calculated by the calculation unit 107 and the UI coordinates of each control end within the pan-tilt driveable range of the drive unit 105 to the client device via the network 103. In the example shown in Figure 7, the communication control unit 108 transmits the UI coordinates of the imaging area frame 706, the UI coordinates of the pan control end 707, and the UI coordinates of the tilt control end 708.

[0055] In the second embodiment, the client device 102 proceeds to process S601 after steps S301 to S303 described above. Upon proceeding to S601, the communication control unit 112 of the client device 102 acquires the UI coordinates of the imaging area frame and the UI coordinates of each control end of the pan-tilt driveable range of the drive unit 105, which have been transmitted from the server device 101. After S601, the client device 102 proceeds to process S305.

[0056] Furthermore, in the client device 102 of the second embodiment, after S306, the process transitions to S602. Upon transitioning to S602, the determination unit 111 of the client device 102 performs coordinate determination processing to determine whether the UI coordinates of each control end of the pan-tilt driveable range of the drive unit 105, calculated by the calculation unit 107, are coordinates on the captured image (on the captured image display area). In the example of Figure 7, the determination unit 111 determines whether the UI coordinates of the pan control end 707 and the tilt control end 708 are coordinates on the captured image display area 702. If the determination unit 111 determines that the UI coordinates of each control end of the pan-tilt driveable range of the drive unit 105 are not coordinates on the captured image display area, the client device 102 transitions to S307. On the other hand, if the determination unit 111 determines that the UI coordinates of the control ends of the pan-tilt driveable range of the drive unit 105 are coordinates on the captured image display area, the client device 102 transitions to S603.

[0057] When the system transitions to S603, the display control unit 113 controls the display unit 114 to display the control ends of the pan-tilt driveable range on the captured image display area, based on the UI coordinates of the control ends of the pan-tilt driveable range obtained from the determination unit 111. In the example shown in Figure 7, the display control unit 113 controls the display unit 114 to display the pan control end 707 and the tilt control end 708 on the captured image display area 702, based on the UI coordinates of the control ends of the pan-tilt driveable range of the drive unit 105.

[0058] According to the system of the second embodiment, by superimposing lines indicating the control ends of the pan-tilt driveable range of the drive unit 105 onto the captured image display area, the area outside the pan-tilt driveable range can be shown to the user. In this embodiment, the pan control end 707 and the tilt control end 708, respectively, are shown as dashed lines in the UI coordinate display of the control ends of the pan-tilt driveable range of the drive unit 105, but the system is not limited to this example. For example, the pan control end 707 and the tilt control end 708 may be displayed using solid lines instead of dashed lines. Alternatively, instead of displaying lines indicating the control ends of the pan-tilt driveable range, a method of changing the display color of the area outside the pan-tilt driveable range may be used.

[0059] <Third Embodiment> In the third embodiment, an example will be described in which the UI coordinates of the imaging area frame indicating the imaging area by area zoom exceed the imaging image display area. In the third embodiment, the same configurations and processing steps as described in the first embodiment will be denoted by the same reference numerals used in the first embodiment, and their descriptions will be omitted.

[0060] Figure 8 is a flowchart of the processing performed in the client device 102 according to the third embodiment. Note that each processing step S301 to S308 is the same as the processing steps S301 to S308 described in the first embodiment. Figure 9 shows an example of the UI displayed on the display unit 114 of the client device 102 according to the third embodiment. The display area 901 and the captured image display area 902 correspond to the display area 201 and the captured image display area 202 in the UI of Figure 2 of the first embodiment, respectively.

[0061] In Figures 9(a) and 9(b), the designated area frame 903a and designated area frame 903b are display frames that represent the range specified by the user on the UI as the area to be imaged by area zoom, similar to the first embodiment described above. Also, similar to the first embodiment, the user specifies the range of the designated area frame 903a and designated area frame 903b by mouse operation or the like. The starting point coordinate 904a is the UI coordinate of the starting point when specifying the range of the designated area frame 903a, and the ending point coordinate 905a is the UI coordinate of the ending point of the designated area frame 903a. Similarly, the starting point coordinate 904b is the UI coordinate of the starting point when specifying the range of the designated area frame 903b, and the ending point coordinate 905b is the UI coordinate of the ending point of the designated area frame 903b. Furthermore, the imaging area frame 906a and imaging area frame 906b are frame displays that indicate the range in the UI of the imaging area of ​​the imaging unit 104 after area zoom.

[0062] The following describes the process according to the third embodiment, using the flowchart in Figure 8 and an example of the actual screen in Figure 9. In the third embodiment, if the client device 102 determines in S305 that there is no match, it proceeds to the process in S801. Upon proceeding to S801, the determination unit 111 determines whether the UI coordinates of the imaging area frame obtained via the communication control unit 112 include an area outside the captured image display area, that is, whether it includes an area outside the captured image. For example, if the determination unit 111 determines that the UI coordinates of the imaging area frame do not include an area outside the captured image display area (outside the captured image), the client device 102 proceeds to S306. On the other hand, if the determination unit 111 determines that the UI coordinates of the imaging area frame include an area outside the captured image display area (outside the captured image), the client device 102 proceeds to S802. In the example of Figure 9(a), the UI coordinates of the imaging area frame 906a include the area to the left of the captured image display area 902, which is outside the captured image. Therefore, the determination unit 111 determines that the imaging area frame includes an area outside the captured image display area (outside the captured image).

[0063] When the system transitions to S802, the display control unit 113 changes the display method of the imaging area frame corresponding to the area outside the captured image of the imaging unit 104. For example, if the imaging area frame includes the area outside the captured image display area, the display control unit 113 does not display the portion of the imaging area frame that is outside the captured image display area as part of the GUI. That is, the display control unit 113 controls the display unit 114 to display only the portion of the imaging area frame that is displayed on the captured image display area, i.e., the portion that corresponds to the area within the captured image. In addition, the display control unit 113 indicates that the imaging area frame includes the area outside the captured image display area by displaying, for example, a dashed line, to indicate the displayable end of the imaging area frame. In the example of Figure 9(a), the display control unit 113 does not display the portion of the imaging area frame 906a indicated by the figure 907, which corresponds to the area outside the captured image display area 902. The display control unit 113 then controls the display unit 114 to display only the portion of the imaging area frame 906a that corresponds to the area within the captured image display area 902. Furthermore, the display control unit 113 indicates that the imaging area frame 906a includes the area outside the captured image display area 902 by displaying the area between the upper left vertex 908 and the lower left vertex 909, which indicate the displayable edge of the imaging area frame 906a, as a predetermined line (a dashed line in this example) called side 910.

[0064] Alternatively, in S802, the display control unit 113 may display the portion of the imaging area frame that corresponds to the area outside the image captured by the imaging unit 104 as a GUI when the imaging area frame includes an area outside the image capture display area. For example, the display control unit 113 may display the portion of the imaging area frame 906b that is outside the image capture display area on the display area 901, as shown in the UI example in Figure 9(b).

[0065] According to the system of the third embodiment, by displaying an indication that the imaging area frame includes an area outside the captured image display area, the user can confirm that the imaging area captured by performing area zoom includes an area not displayed in the captured image display area. In this embodiment, an example was given in which a part of the imaging area frame is displayed with a dashed line, but the invention is not limited to this, and for example, the color of the frame may be changed or the frame may be made to blink. Furthermore, in the third embodiment, as described in the second embodiment above, the area outside the pan-tilt driveable range may be shown to the user by superimposing a line indicating the control end of the pan-tilt driveable range of the drive unit 105 onto the captured image display area.

[0066] <Fourth Embodiment> In the first to third embodiments described above, examples were given in which the server device 101 is connected to the client device 102 via the network 103, but the invention is not limited to these examples. For example, an external imaging device having an imaging unit 104, a drive unit 105, a control unit 106, and a communication control unit 108 may be connected via a network 103 to an information processing device equipped with a calculation unit 107 of a server device 101 and the functional units of a client device 102. In other words, it may be a system in which the information processing device remotely controls an external imaging device (camera device) connected to the network 103.

[0067] The client device of the fourth embodiment includes the configuration from the reception unit 109 to the display control unit 113 (a display unit 114 may also be included) and the calculation unit 107 described above. The calculation unit 107 of the client device of the fourth embodiment acquires information on the current imaging direction and zoom magnification of an external imaging device having an imaging unit 104, a drive unit 105, a control unit 106, and a communication control unit 108. The calculation unit 107 of the client device also acquires information on the driveable range of the imaging unit 104 and the pan-tilt driveable range of the drive unit 105. Furthermore, the calculation unit 107 of the client device converts the UI coordinates of the specified area to PTZ coordinates, similar to the embodiments described above. Then, based on the PTZ coordinates of the specified area and the zoom driveable range and pan-tilt driveable range information of the external imaging device, the calculation unit 107 of the client device calculates the PTZ coordinates of the imaging area to be imaged by area zoom. Furthermore, the calculation unit 107 also calculates the UI coordinates used by the display control unit 113 when displaying the imaging area frame of the imaging area captured by area zoom. In the calculation unit 107 of the client device, as described above, for parameters that determine the zoom and pan / tilt directions, the calculation unit 107 sets the coordinates closest to the specified area within the driveable range for parameters that are outside the zoom driveable range or the pan / tilt driveable range. In addition, for parameters that determine the zoom and pan / tilt directions, the calculation unit 107 sets user-specified coordinates for parameters that are outside the zoom driveable range or within the pan / tilt driveable range. In the fourth embodiment as well, it is possible to display the control end of the drivable range in the same way as in the second embodiment described above, and to display the same way as in the third embodiment.

[0068] Furthermore, the imaging area of ​​the imaging device exemplified in the first to fourth embodiments described above is not limited to a rectangle; for example, it may be a circular imaging area, such as that captured by a fisheye lens. Also, the aspect ratio of the imaging area is not limited to a specific ratio; it may be any aspect ratio depending on the imaging device, such as 16:9 or 1:1.

[0069] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more of the functions. The embodiments described above are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features.

[0070] This embodiment includes the following configurations, methods, and programs. (Composition 1) An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of the following: a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed; It has, The display control means is If the first region and the second region coincide, the first frame is superimposed on the captured image and displayed. An information processing device characterized in that, if the first region and the second region do not coincide, the first frame and the second frame are superimposed on the captured image and displayed. (Configuration 2) The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to configuration 1, characterized in that the display control means changes the display method of the second frame when the determination means determines that the second region includes a region outside the captured image. (Composition 3) The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to Configuration 1, characterized in that, when the determination means determines that the second region includes a region outside the captured image, the display control means also uses the display region including the region outside the captured image to display the second frame corresponding to the second region. (Composition 4) The system further includes a coordinate determination means for determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device. The information processing apparatus according to any one of configurations 1 to 3, characterized in that, when the coordinate determination means determines that the coordinates indicating the control end of the imaging device are an image on the captured image, the display control means displays the display indicating the control end superimposed on the captured image. (Composition 5) An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the user operation and the range in which the imaging direction and imaging magnification of the imaging device can be changed, A coordinate determination means for determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device, It has, The display control means is characterized in that, when the coordinate determination means determines that the coordinates indicating the control end of the imaging device are an image on the imaging image, it displays a display indicating the control end superimposed on the imaging image. (Composition 6) The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to configuration 5, characterized in that the display control means changes the display method of the second frame when the determination means determines that the second region includes a region outside the captured image. (Composition 7) The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to configuration 5, characterized in that, when the determination means determines that the second region includes a region outside the captured image, the display control means also uses the display region including the region outside the captured image to display the second frame corresponding to the second region. (Composition 8) The information processing apparatus according to configuration 2 or 6, characterized in that, when the determination means determines that the second region includes an area outside the captured image, the display control means does not display the second frame of the portion outside the captured image, but displays the second frame of the portion corresponding to the area inside the captured image. (Composition 9) The information processing apparatus according to configuration 8, characterized in that the display control means displays the displayable edge of the captured image included in the second region with a predetermined line. (Composition 10) The information processing apparatus according to any one of configurations 1 to 9, further comprising a region determination means for determining a second region based on a first region set according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed. (Composition 11) The aforementioned region determination means is If the first region is outside the range in which the imaging direction and imaging magnification of the imaging device can be changed, then, among the parameters for setting the imaging direction and imaging magnification of the imaging device, the parameter outside the changeable range shall be set to the coordinate closest to the first region within the changeable range. If the first region is within a range in which the imaging direction and imaging magnification of the imaging device can be changed, the parameters for setting the imaging direction and imaging magnification of the imaging device are set to coordinates corresponding to the first region. The information processing device according to configuration 10, characterized in that it determines the second region based on the coordinates set above. (Method 1) An acquisition process in which an image is acquired from an imaging device that can change the imaging direction and imaging magnification, A receiving step for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control step that displays at least one of the following: a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed; It has, In the display control step, If the first region and the second region coincide, the first frame is superimposed on the captured image and displayed. An information processing method characterized by superimposing the first frame and the second frame onto the captured image if the first region and the second region do not coincide. (Method 2) An acquisition process in which an image is acquired from an imaging device that can change the imaging direction and imaging magnification, A receiving step for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control step that displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the user operation and the range in which the imaging direction and imaging magnification of the imaging device can be changed. A coordinate determination step of determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device, It has, The information processing method is characterized in that, in the display control step, if the coordinate determination step determines that the coordinates indicating the control end of the imaging device are an image on the captured image, the display indicating the control end is superimposed on the captured image. (Program 1) A program that causes a computer to function as an information processing device described in any one of configurations 1 through 11. [Explanation of symbols]

[0071] 101: Server device, 103: Network, 104: Imaging unit, 105: Drive unit, 106: Control unit, 107: Calculation unit, 108: Communication control unit, 102: Client device, 109: Reception unit, 110: Frame setting unit, 111: Judgment unit, 112: Communication control unit, 113: Display control unit, 114: Display unit

Claims

1. An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of the following: a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed. It has, The display control means is If the first region and the second region coincide, the first frame is superimposed on the captured image and displayed. An information processing device characterized in that, if the first region and the second region do not coincide, the first frame and the second frame are superimposed on the captured image and displayed.

2. The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to claim 1, characterized in that the display control means changes the display method of the second frame when the determination means determines that the second region includes a region outside the captured image.

3. The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to claim 1, characterized in that, when the determination means determines that the second region includes a region outside the captured image, the display control means also uses the display region including the region outside the captured image to display the second frame corresponding to the second region.

4. The system further includes a coordinate determination means for determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device. The information processing apparatus according to any one of claims 1 to 3, characterized in that, when the coordinate determination means determines that the coordinates indicating the control end of the imaging device are an image on the captured image, the display control means displays the display indicating the control end superimposed on the captured image.

5. An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the user operation and the range in which the imaging direction and imaging magnification of the imaging device can be changed, A coordinate determination means for determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device, It has, The display control means is characterized in that, when the coordinate determination means determines that the coordinates indicating the control end of the imaging device are an image on the imaging image, it displays a display indicating the control end superimposed on the imaging image.

6. The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to claim 5, characterized in that the display control means changes the display method of the second frame when the determination means determines that the second region includes a region outside the captured image.

7. The system further includes determination means for determining whether the second region includes a region outside the image captured by the imaging device. The information processing apparatus according to claim 5, characterized in that, when the determination means determines that the second region includes a region outside the captured image, the display control means also uses the display region including the region outside the captured image to display the second frame corresponding to the second region.

8. The information processing apparatus according to claim 2 or 6, characterized in that, when the determination means determines that the second region includes an area outside the captured image, the display control means does not display the second frame of the portion outside the captured image, but displays the second frame of the portion corresponding to the area inside the captured image.

9. The information processing apparatus according to claim 8, characterized in that the display control means displays the displayable edge of the captured image included in the second region with a predetermined line.

10. The information processing apparatus according to claim 1 or 5, further comprising a region determination means for determining a second region based on a first region set in accordance with the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed.

11. The aforementioned region determination means is If the first region is outside the range in which the imaging direction and imaging magnification of the imaging device can be changed, then, among the parameters for setting the imaging direction and imaging magnification of the imaging device, the parameter outside the changeable range shall be set to the coordinate closest to the first region within the changeable range. If the first region is within a range in which the imaging direction and imaging magnification of the imaging device can be changed, the parameters for setting the imaging direction and imaging magnification of the imaging device are set to coordinates corresponding to the first region. The information processing apparatus according to claim 10, characterized in that the second region is determined based on the coordinates set above.

12. An acquisition process in which an image is acquired from an imaging device that can change the imaging direction and imaging magnification, A receiving step for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control step that displays at least one of the following: a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed. It has, In the display control step, If the first region and the second region coincide, the first frame is superimposed on the captured image and displayed. An information processing method characterized by superimposing the first frame and the second frame onto the captured image if the first region and the second region do not coincide.

13. An acquisition process in which an image is acquired from an imaging device that can change the imaging direction and imaging magnification, A receiving step for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control step that displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the user operation and the range in which the imaging direction and imaging magnification of the imaging device can be changed. A coordinate determination step of determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device, It has, The information processing method is characterized in that, in the display control step, if the coordinate determination step determines that the coordinates indicating the control end of the imaging device are an image on the captured image, the display indicating the control end is superimposed on the captured image.

14. Computers, An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of the following: a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the first region according to the user operation and a range in which the imaging direction and imaging magnification of the imaging device can be changed. It has, The display control means is If the first region and the second region coincide, the first frame is superimposed on the captured image and displayed. A program that functions as an information processing device that, if the first region and the second region do not coincide, superimposes the first frame and the second frame onto the captured image and displays them.

15. Computers, An acquisition means for acquiring an image from an imaging device that can change the imaging direction and imaging magnification, A receiving means for receiving a user operation to change at least one of the imaging direction and imaging magnification of the imaging device, A display control means that displays at least one of a first frame corresponding to a first region set according to the user operation, and a second frame corresponding to a second region based on the user operation and the range in which the imaging direction and imaging magnification of the imaging device can be changed, A coordinate determination means for determining whether the coordinates indicating the control end of the imaging device with respect to the imaging direction are coordinates on the image captured by the imaging device, It has, The display control means is a program that causes the display to function as an information processing device that, when the coordinate determination means determines that the coordinates indicating the control end of the imaging device are an image on the captured image, superimposes and displays the display indicating the control end onto the captured image.

Images