Information processing system, method for controlling the same, and program

Abstract

To provide an information processing system for efficiently performing adjustment of drive control of an imaging apparatus so that it can photograph a desired subject, a method for controlling the same, and a program.SOLUTION: In an information processing system in which a client terminal 100, a server 101, and a plurality of imaging apparatuses 102 are communicably connected via a network 110, the plurality of imaging apparatuses 102 are installed at various places regardless of the inside and outside a facility as monitoring cameras, and acquire videos and transmit the videos to the server 101. The server 101 has video management software and map software pre-installed therein. The video management software records, manages, and browses the videos acquired from the imaging apparatuses 102, and the map software browses a map of the entire country, displays a current location by using a GPS, and searches for an address. The server 101 performs control to display the videos and the map in association with each other on the client terminal 100 by cooperating the video management software and the map software.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system for controlling an image capture device, and a control method and program thereof. [Background technology]

[0002] Conventionally, there is known a technique for displaying photographic information on a map from a photographed image. Patent Document 1 discloses a technique for displaying, on a map, the photographed position, the photographed position, and the photographed direction from the position, based on an image stored in a memory and the photographed position and direction recorded together with the image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-183217 A DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0004] Many outdoor imaging devices are installed to capture a wide range with one unit. With such imaging devices, the administrator must adjust the camera's PTZ (pan-tilt-zoom) so that the subject to be captured is included in the field of view, but because the capture range is wide, it is difficult to find the subject to be captured while adjusting the PTZ.

[0005] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, an object of the present invention is to provide a mechanism for efficiently adjusting the drive control of an imaging device so as to capture an image of a desired subject. [Means for solving the problem]

[0006] a first receiving means for receiving a designation of a landmark on a map; A second reception means for receiving a setting of a shooting range of the imaging device; a display control means for controlling the display of an image captured by the imaging device; a record control means for controlling the recording of the target position received by the first receiving means and the setting information received by the second receiving means in association with each other; Equipped with The display control means is characterized in that, when accepting the setting of the shooting range by the second acceptance means, it controls so as to display a guide indicating the position in which the target accepted by the first acceptance means should be placed in the image captured by the imaging device. Effect of the Invention

[0007] According to the present invention, it is possible to easily set adjustments for drive control of an imaging device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a configuration of an information processing system. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of various devices. [Diagram 3] 13 is a flowchart showing an outline of processing by the client terminal 100. [Figure 4] FIG. 13 is a diagram showing an example of a screen for accepting selection of an imaging device. [Diagram 5] FIG. 13 is a diagram showing an example of a screen for accepting settings of the imaging device. [Figure 6] FIG. 13 is a diagram showing an example of a screen for accepting designation of an already-installed imaging device. [Figure 7] FIG. 13 is a diagram showing an example of a screen for accepting settings of the position of a subject. [Figure 8] FIG. 13 is a diagram showing an example of a screen for accepting adjustment settings of the PTZ of the imaging device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] First, an example of the configuration of an information processing system according to an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 shows a system configuration for displaying map information and an image captured by an imaging device on a client terminal 100 and adjusting the PTZ of the imaging device.

[0011] The information processing system of the present invention is configured by connecting a client terminal 100, a server 101, and an image capture device 102 via a network 110 so as to be able to communicate with each other.

[0012] A plurality of imaging devices 102 are installed as surveillance cameras in various places inside and outside a facility, and capture images and transmit them to a server 101. The imaging devices 102 are devices that can be connected to a network 110.

[0013] The server 101 is pre-installed with video management software and map software. The video management software can record, manage, and view the video acquired from the imaging device 102. The map software can view maps of the entire country, and can display the current location and search for addresses using a GPS, for example. The server 101 controls the video management software and map software to be linked together and displayed on the client terminal 100. Note that the display destination is not limited to the client terminal 100, and may be multiple displays such as a multi-display.

[0014] The client terminal 100 is an information processing device such as a personal computer or a smartphone, and is communicably connected to the server 101 via a network 110. Software for controlling images and maps is installed on the client terminal 100. The client terminal 100 can operate images and maps transmitted from the server 101, and can, for example, select the position of the imaging device 102 or set the PTZ of the imaging device 102. Although an example in which software is installed has been described, the images and maps may be controllable using a Web application.

[0015] Next, referring to FIG. 2, an example of the configuration of a client terminal 100 as an example of an apparatus to which the present invention can be applied is shown.

[0016] 2, a CPU 201, a memory 202, a non-volatile memory 203, an image processing unit 204, a display 205, an operation unit 206, a recording medium I / F 207, an external I / F 209, and a communication I / F 210 are connected to an internal bus 250. The units connected to the internal bus 250 are configured to be able to exchange data with each other via the internal bus 250.

[0017] The memory 202 is, for example, a RAM (a volatile memory using a semiconductor element, etc.). The CPU 201 uses the memory 202 as a work memory in accordance with a program stored in, for example, the non-volatile memory 203 to control each part of the client terminal 100. The non-volatile memory 203 stores image data, audio data, other data, various programs for the operation of the CPU 201, etc. The non-volatile memory 203 is, for example, a hard disk (HD) or a ROM.

[0018] The image processing unit 204 performs various image processing on image data stored in the non-volatile memory 203 or the recording medium 208, a video signal acquired via the external I / F 209, image data acquired via the communication I / F 210, captured images, etc., based on the control of the CPU 201. The image processing performed by the image processing unit 204 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, color conversion processing, etc. The image processing unit 204 may be configured with a circuit block dedicated to performing specific image processing. Depending on the type of image processing, the CPU 201 can also perform image processing according to a program without using the image processing unit 204. The processing of recognizing an object to be recognized from an image is performed by the CPU 201 in cooperation with the image processing unit 204.

[0019] The display 205 displays images, GUI screens constituting a GUI (Graphical User Interface), and the like under the control of the CPU 201. The CPU 201 generates a display control signal according to a program, and controls each unit of the client terminal 100 to generate a video signal for display on the display 205 and output it to the display 205. The display 205 displays video based on the output video signal. Note that the configuration of the client terminal 100 itself is limited to an interface for outputting a video signal for display on the display 205, and the display 205 may be configured as an external monitor (such as a television).

[0020] The operation unit 206 is an input device for receiving user operations, including a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, etc. The touch panel is an input device that is configured to be planar and overlaid on the display 205, and outputs coordinate information according to the touched position.

[0021] The recording medium I / F 207 allows a recording medium 208 such as a memory card, CD, or DVD to be mounted, and reads data from the mounted recording medium 208 and writes data to the recording medium 208 under the control of the CPU 201. The external I / F 209 is an interface for connecting to an external device via a wired cable or wirelessly, and inputting and outputting video signals and audio signals. The communication I / F 210 is an interface for communicating with an external device, the Internet 211, etc., and transmitting and receiving various data such as files and commands.

[0022] The camera unit 212 is a camera unit including an image sensor (image sensor) including a CCD or CMOS element that converts an optical image into an electrical signal.

[0023] Next, basic processing of the client terminal 100 in the embodiment of the present invention will be described with reference to Fig. 3. Note that the processing of each step is realized by the CPU 201 of the client terminal 100 expanding a program recorded in the non-volatile memory 203 into the memory 202 and executing it. When the user starts the software in the client terminal 100 and performs an operation to accept the settings of the imaging device 102, the processing of Fig. 3 starts.

[0024] In S301, the CPU 201 displays a selection screen for the image capture device 102 and a PTZ initial setting screen on the display 205, and accepts operations by the user.

[0025] An example of the selection screen for the imaging device 102 is shown in Fig. 4. In Fig. 4, the imaging device 102 for which PTZ settings are to be accepted from a pull-down list 401 is selected from a plurality of imaging devices 102 stored in the server 101. Various settings 402 such as angle range, installation information, and protocol information are accepted for the selected imaging device 102. Note that the dotted frames shown in Figs. 4 to 8 are auxiliary lines for illustrating the areas and are not displayed. When the next button 403 is pressed, the screen transitions to Fig. 5. Note that the display destination when displaying in the steps described below is the display 205 unless otherwise specified.

[0026] Fig. 5 shows a screen showing an example of the initial setting of the PTZ of the imaging device 102. In Fig. 5, when pressing of an acquire button 501 is accepted, definition information related to movements in the pan direction and tilt direction is acquired from the server 101. Also, when pressing of an acquire button 502 is accepted, definition information related to the initial values ​​of the PTZ is acquired from the server 101. Note that, other than the method of acquiring from the server, the initial values ​​may be determined by manual input. When pressing of a next button 503 is accepted, a transition to Fig. 6 is made.

[0027] In S302, the CPU 201 accepts, from the map, the selection of the imaging device 102 for which various settings have been made in step S301.

[0028] FIG. 6 shows an example of a screen for accepting the designation of an installed imaging device 102. The map displayed in the map display area 601 displays an arbitrary point on the initial screen. The map display area 601 accepts operations by the user, and can, for example, enlarge, reduce, or move the map. When an address is entered in the search window 603 and a search button 604 is pressed, candidate addresses are displayed in the search result display area 605. When a selection of an address displayed in the search result display area 605 is accepted, a map of the surrounding area of ​​the selected address is displayed in the map display area 601. A guide 602 for indicating the center point of the displayed map is displayed in the map display area 601. When an imaging device 102 is selected, the guide 602 moves to the position of the imaging device, and the latitude and longitude indicated by the guide 602 are obtained as position information of the imaging device 102, and displayed in the position information display area 606. It is possible to input values ​​for the latitude and longitude in the position information display area 606, and by inputting any value and accepting the press of the move button 607, the guide 602 can be moved to the point indicated by the latitude and longitude.

[0029] In S303, the CPU 201 determines whether or not it has accepted pressing of the next button 608. If it has been accepted, the process proceeds to S304, and if not, the process returns to S302 and accepts the setting of the position of the imaging device 102.

[0030] In S304, the CPU 201 displays a map of the surrounding area of ​​the imaging device 102 specified in S302 in the map display area 601, and displays an image captured by the imaging device 102 (705).

[0031] In S305, the CPU 201 accepts a designation of the position of a landmark (target object) from the map display area 601.

[0032] The processes in steps S304 and S305 will be described with reference to Fig. 7. Fig. 7 shows an example of a screen displayed in step S304.

[0033] As shown in FIG. 7, a map of the surrounding area of ​​the imaging device 102 specified in step S302 is displayed in a map display area 601 (the position of the imaging device 102 is assumed to be identified from the latitude and longitude information acquired in S302), and an image captured by the imaging device 102 is displayed in an image display area 705.

[0034] In addition, the map display area 601 displays a camera icon 704 indicating the imaging device 102 selected in S302 and a landmark selection area 701 (area shown in light black) specified from the position of the imaging device 102. The landmark selection area 701 is an area indicating an appropriate range as the position of a landmark (target object) used for PTZ adjustment described later. If a landmark that is too close or too far from the imaging device 102 is selected, appropriate PTZ adjustment becomes difficult, so an appropriate area is presented to the user. The landmark selection area 701 is set to a range of a predetermined distance (for example, a range of 5 km or more and 10 km or less from the imaging device) centered on the imaging device 102. In addition, a guide such as "Please select a subject from within this range" may be displayed at any point around the map display area 601. This reduces the risk of selecting a subject that is too far from the imaging device 102 to be photographed when accepting the designation of the subject position in S305.

[0035] Also, although not shown, buildings that could be landmarks (for example, buildings of a certain height such as Tokyo Tower or the Tokyo Metropolitan Government Building, or famous buildings such as the National Diet Building, that are easy to find from images captured by an imaging device) on the displayed map (particularly in the landmark selection area) may be displayed on the map as icons, etc. This allows the user to recognize buildings that are suitable as landmarks, making it possible to streamline the task of specifying landmarks.

[0036] Furthermore, a landmark can be specified by clicking or tapping on the landmark's position or icon. A guide 602 is displayed at the specified position, and latitude and longitude information relating to the position is acquired. That is, position information of the specified landmark is acquired (S305). Note that the latitude and longitude information may also be directly input into the subject position information display area 702 to accept the specification. At this time, the values ​​that can be input may be restricted to be within the range of the landmark selection region 701.

[0037] An image captured by the imaging device 102 specified in S302 is displayed in an image display area 705. Information related to the PTZ of the image currently being displayed is displayed in a PTZ information display area 706. The PTZ of the imaging device 102 can be adjusted by operating an operation button 707.

[0038] In step S306, it is determined whether the Next button (710) has been pressed. If it has been pressed, the process proceeds to step S307, and if it has not been pressed, the process proceeds to step S305.

[0039] In step S307, the screen shown in FIG. 8 is displayed, and the PTZ of the image capture device 102 is adjusted according to an instruction from the user via the screen.

[0040] Specifically, the user operates the operation button 707 to adjust the PTZ of the imaging device 102 so that the angle of view is such that the landmark specified in the map display area 601 in Fig. 7 can be photographed. When adjusting the angle of view to such that the landmark can be photographed, a guide 709 may be displayed to encourage the user to place the landmark within the area indicated by the guide 709 so that the landmark is photographed at an appropriate position and size.

[0041] The method of displaying the guide 709 may be any method that allows the position of the subject to be easily determined from the image, such as displaying a frame line, vertical line, or horizontal line to guide the subject to fit within the frame, or displaying a mark such as a cross to guide the subject to be located at the center. Also, when the subject enters the frame or is located at the center of the mark, a guide may be displayed to make it clear. This makes it easier to find the subject from the image in the image display area 801, making PTZ adjustment easier.

[0042] Also, in order to make it easier to find the landmark specified in S305 from the video when adjusting the PTZ, an image of the landmark obtained from the Internet or the like may be displayed near the video display area 801. This allows the user to search for the landmark specified in S305 by comparing it with the image, making the search more efficient, even if the landmark is difficult to find.

[0043] In step S308, it is determined whether the user has pressed the save button 803. If it has been pressed, the process proceeds to step S309, and if it has not been pressed, the process proceeds to step S307.

[0044] In step S309, the position information of the landmark acquired in S305 and the PTZ information (the result of adjustment in S307) that provides an angle of view at which the landmark can be photographed are registered in association with each other.

[0045] In S310, the CPU 201 accepts an operation by the user as to whether or not setting of another camera is necessary. If it is necessary, the process returns to S301, and if not, the process of FIG.

[0046] According to this embodiment, a mechanism is provided that allows easy setting of adjustments to the drive control of the imaging device.

[0047] The present invention can be embodied, for example, as a system, an apparatus, a method, a program, or a recording medium, etc. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

[0048] The various controls described above as being performed by CPU201 and CPU111 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0049] In addition, although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0050] In addition, the above-mentioned embodiment has been described by taking as an example a case where the client terminal 100 is applied to a personal computer or a mobile phone terminal (smartphone), but this is not limited to this example, and the client terminal 100 can be applied to any device that can display a map and an image captured by an imaging device. In other words, the client terminal 100 can be applied to a multi-display, a PDA, a portable image viewer, a tablet terminal, a game machine, an electronic book reader, a head-mounted display, and the like. (Other embodiments)

[0051] The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-mentioned embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage medium storing the program constitute the present invention. [Explanation of symbols]

[0052] 100 client terminals 101 Server 102 Imaging device 110 Network

Claims

1. a first receiving means for receiving a designation of a landmark on a map; a second receiving means for receiving a setting of a photographing range of the imaging device; a display control means for controlling the display of an image captured by the imaging device; a control means for controlling the imaging device to photograph a newly designated target object based on the target object position accepted by the first accepting means and setting information related to a photographing range specified by an operation accepted by the second accepting means; and Equipped with When the second accepting means accepts the setting of the photographing range, the display control means controls to display a guide for a user to determine the position in the image photographed by the imaging device of the target accepted by the first accepting means on the image. An information processing system characterized by:

2. The guide includes at least one of information indicating a frame line, a vertical line, a horizontal line, and a center position.

2. The information processing system according to claim 1, wherein:

3. The display control means controls to display a second guide indicating a position where the target object should be placed in the image.

2. The information processing system according to claim 1, wherein:

4. The display control means controls the guide to be displayed in an identifiable manner when the target is located at the center of the image.

2. The information processing system according to claim 1, wherein:

5. The second receiving means receives adjustment operations for pan, tilt, and zoom of the imaging device.

5. The information processing system according to claim 1, wherein:

6. The display control means controls the display of a map and an image captured by an imaging device on one screen.

5. The information processing system according to claim 1, wherein:

7. A control method for an information processing system, comprising: a first receiving step in which a first receiving means of the information processing system receives designation of a landmark on a map; a second receiving step in which a second receiving means of the information processing system receives setting of a shooting range of an imaging device; a display control step in which a display control means of the information processing system controls the display of an image captured by the imaging device; a control step in which a control means of the information processing system controls the imaging device to photograph a newly designated target object based on the position of the target object received in the first reception step and setting information related to a photographing range specified by the operation received in the second reception step; Equipped with The display control step controls, when accepting the setting of the photographing range in the second accepting step, to display a guide for a user to determine the position in the image of the target accepted in the first accepting step, photographed by the imaging device, on the image. A method for controlling an information processing system, comprising:

8. 5. A program for causing at least one computer to function as each of the means of the information processing system according to claim 1.

Images