Information processing systems, information processing devices, information processing methods, programs

The information processing system addresses the challenge of selecting and viewing network camera footage by mapping icons on a map, allowing intuitive video selection and display, thereby simplifying operations.

JP7846397B2Active Publication Date: 2026-04-15CANON MARKETING JAPAN INC
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-03-27
Publication Date
2026-04-15

AI Technical Summary

Technical Problem

Existing systems lack an intuitive mechanism for selecting and viewing video footage from a large number of network cameras with simpler operations.

Method used

An information processing system comprising a map display means, identification means, and image display means to intuitively select and view video footage from network cameras by mapping camera icons on a map and displaying corresponding images.

Benefits of technology

Enables simpler operation for selecting and viewing desired video footage from network cameras, enhancing user experience and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007846397000001
    Figure 0007846397000001
  • Figure 0007846397000002
    Figure 0007846397000002
  • Figure 0007846397000003
    Figure 0007846397000003
Patent Text Reader

Abstract

To provide an information processing system, an information processing device, an information processing method, and a program that enables a desired network camera to be selected by simpler operation and facilitates confirmation of a desired video.SOLUTION: The method includes displaying a map on which a camera icon is mapped, identifying a network camera pertaining to the camera icon mapped on the displayed map, and displaying a video captured by the identified network camera. Table information including a camera ID, which is identification information, latitude and longitude of an installation location, and information on a photographing direction for a plurality of network cameras can be stored in a storage medium.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0008] , , , , , , ,

[0007] ,

[0001] The present invention relates to an information processing system, an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In recent years, network cameras have been installed on the streets, rooftops of buildings, commercial facilities, etc. for various purposes such as crime prevention, monitoring of road congestion, monitoring of river water levels, and monitoring of weather conditions.

[0003] In addition, regarding the videos captured by these network cameras, a mechanism is adopted to transmit them to a management company or a security company so that the person in charge can check them in real time.

[0004] As described above, in order to manage a large number of network cameras installed on the streets, etc., it is necessary to grasp where the network cameras are set and which network camera captured the video.

[0005] Therefore, in Patent Document 1, a mechanism is disclosed that enables the recognition of the camera arrangement by displaying camera icons on a map.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Disclosure of the Invention

Problems to be Solved by the Invention

[0007] ] As described above, since the uses and purposes of network cameras are diverse, the number of installed network cameras has become extremely large. Therefore, a mechanism is required that can intuitively select the network camera that captured the video to be confirmed with a simpler operation.

[0008] Therefore, the present invention aims to provide a mechanism that allows users to select a desired network camera with simpler operation and makes it easier to view the desired video footage. [Means for solving the problem]

[0009] The information processing system of the present invention is characterized by comprising: a map display means for displaying a map on which camera icons are mapped; an identification means for identifying a network camera related to a camera icon mapped on the map displayed by the display means; and an image display means for displaying an image captured by the network camera identified by the identification means. [Effects of the Invention]

[0010] According to the present invention, it becomes possible to select a desired network camera with simpler operation and to easily view the desired video footage. [Brief explanation of the drawing]

[0011] [Figure 1] A diagram showing an example of an information processing system. [Figure 2] A diagram showing an example of a hardware configuration. [Figure 3] A flowchart illustrating an example of camera image display processing. [Figure 4] Data table containing information about network cameras [Figure 5] A diagram showing an example of a map display screen. [Figure 6] A diagram showing an example of a map display screen. [Figure 7] An example of a screen displaying video captured by a network camera. [Modes for carrying out the invention]

[0012] Embodiments of the present invention will be described in detail below with reference to the drawings.

[0013] FIG. 1 is a diagram showing an example of the configuration of an information processing system according to the present invention.

[0014] As shown in FIG. 1, a camera video display device 101, a map display device 102, a network camera 103, a video management device 104, and a map information distribution device 105 are connected so as to be communicable.

[0015] The camera video display device 101 is a device that displays the video captured by the network camera 103, and for example, is a device that displays the screen shown in FIG. 7.

[0016] The map display device 102 is a device that displays the map managed by the map information distribution device 105, and for example, is a device that displays the screens of FIGS. 5 and 6. In the present embodiment, the camera video display device 101 and the map display device 102 are described as separate devices, but a configuration in which the same device displays the video captured by the network camera 103 and the map may be used.

[0017] The network camera 103 is a camera installed on the street, inside a store, on the rooftop of a building, etc., and the captured video is transmitted to the video management device 104.

[0018] The video management device 104 is a device that receives and manages the video transmitted from the network camera 103, and also has a function of distributing the video to the camera video display device 101.

[0019] The map information distribution device 105 is a device that manages map information.

[0020] FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing apparatus of the present invention.

[0021] As shown in Figure 2, the information processing device is connected via a system bus 200 to a CPU (Central Processing Unit) 201, ROM (Read Only Memory) 202, RAM (Random Access Memory) 203, storage device 204, input controller 205, audio controller 206, video controller 207, memory controller 208, and communication I / F controller 209.

[0022] CPU201 provides comprehensive control over all devices and controllers connected to system bus 200.

[0023] ROM202 or external memory213 holds the BIOS (Basic Input / Output System) and OS (Operating System), which are control programs executed by the CPU201, as well as computer-readable and executable programs and various necessary data (including data tables) for realizing this information processing method.

[0024] RAM203 functions as the main memory, work area, etc., of the CPU201. The CPU201 loads the necessary programs, etc., from ROM202 or external memory 213 into RAM203, and then executes the loaded programs to perform various operations.

[0025] The input controller 205 controls input from input devices such as a keyboard 210 or a pointing device such as a mouse (not shown). If the input device is a touch panel, the user can give various instructions by pressing (touching with a finger, etc.) icons, cursors, or buttons displayed on the touch panel.

[0026] Furthermore, the touch panel may be a multi-touch screen or other touch panel capable of detecting the positions of multiple fingers touching it.

[0027] The video controller 207 controls the display to an external output device such as the display 212. The display may include the display of a notebook computer integrated with the main unit. The external output device is not limited to a display; for example, it may be a projector. Furthermore, for the aforementioned touch-enabled device, an input device is also provided.

[0028] The video controller 207 can control the video memory (VRAM) used for display control. It can utilize a portion of the RAM 203 as the video memory area, or it can provide a separate, dedicated video memory.

[0029] The memory controller 208 controls access to the external memory 213. The external memory can include an external storage device (hard disk), a flexible disk (FD), or a CompactFlash® memory connected to a PCMCIA card slot via an adapter, which stores boot programs, various applications, font data, user files, editing files, and other data.

[0030] The communication interface controller 209 connects to and communicates with external devices via a network and performs communication control processing over the network. For example, it can handle communication using TCP / IP, telephone lines such as ISDN, and mobile phone 4G and 5G lines.

[0031] Furthermore, the CPU 201 enables display on the display 212 by, for example, performing the process of expanding (rasterizing) outline fonts into the display information area in RAM 203. The CPU 201 also enables user input via a mouse cursor (not shown) on the display 212.

[0032] Next, the camera image display process will be explained using the flowchart in Figure 3. Note that in the flowchart in Figure 3, steps S301 to S306 are executed by the CPU 201 of the camera image display device 101, and steps S307 to S309 are executed by the CPU 201 of the map display device 102, respectively, by reading and executing a predetermined control program.

[0033] In step S301, the map display device 102 accepts operations to change the displayed map area. Specifically, it accepts operations to change the display range by scrolling, operations to change the zoom level, and so on.

[0034] In step S302, the map display device 102 changes the display area according to the operation received in step S301.

[0035] In step S303, the map display device 102 acquires information to identify the map area (modified area) displayed in step S302. As an example, it acquires the latitude and longitude information of the top left and bottom right of the display area. By acquiring the latitude and longitude of the top left and bottom right, it is possible to identify the rectangular area formed based on the latitude and longitude information as the display area.

[0036] In step S304, the map display device 102 determines whether a camera exists within the display area. Specifically, it reads a data table containing information such as the camera installation location shown in Figure 4, and determines whether a camera exists within the display area identified in step S303 based on the installation location (latitude and longitude) information.

[0037] If it is determined that a camera is present within the display area (step S304: YES), the process proceeds to step S305.

[0038] If it is determined that no camera is present within the display area (step S304: NO), the process of this flowchart is terminated.

[0039] In step S305, the map display device 102 identifies the installation locations (latitude and longitude) of cameras located within the display area and displays (maps) icons indicating the installation locations of those cameras on the map.

[0040] In step S306, the map display device 102 transmits information to the video management device 104 that identifies the camera whose icon was displayed on the map in step S305.

[0041] In step S307, the camera video display device 101 receives (acquires) video captured by the network camera 103 from the video management device 104. The video received here is video captured by the camera identified by the camera identification information transmitted from the map display device 102 to the video management device 104 in step S306. Information related to the camera (camera name, etc.) is also received. The captured video may be acquired in real time, or video that has been stored (recorded) in the storage unit of the video management device 104 or the like may be acquired.

[0042] In step S308, the camera image display device 101 determines the screen layout for displaying the video received in step S307. Specifically, it determines where on the screen to display the video captured by which camera. For example, by acquiring camera icons displayed on the map sequentially from the top left to the bottom right, and then arranging the videos on the camera image display device 101's screen from the top left to the bottom right in the order they were acquired, the positions of the camera icons on the map correspond to their positions on the video display screen. As a result, a layout can be achieved that makes it easy to understand which camera captured the video.

[0043] In step S309, the video received in step S307 and the camera name are displayed on the screen according to the layout determined in step S308. An example of the screen displayed in step S309 is shown in Figure 7.

[0044] Next, we will explain the data table in Figure 4.

[0045] The data table in Figure 4 is a table in which information related to the installation location of the network camera 103 is registered. Specifically, it consists of information such as camera ID 401 (which identifies the camera), camera name 402, installation location (latitude and longitude) 403, installation location (height and floor) 404, and shooting direction 405.

[0046] In this embodiment, latitude and longitude information (403) and floor-specific information are used to determine the installation location, but the method is not limited to these; any information that can identify the installation location is acceptable. For example, an address may be used instead of latitude and longitude information. Also, elevation (above sea level) may be used instead of floor information (such as floor number or rooftop).

[0047] Furthermore, while the shooting direction 405 is determined using angles where north is 0 degrees, east is 90 degrees, south is 180 degrees, and west is 270 degrees, it may also be determined using the cardinal directions (north, south, east, and west).

[0048] Note that the data table in Figure 4 may be stored in any of the camera image display device 101, map display device 102, or video management device 104.

[0049] Next, we will explain the map display screen shown in Figure 5.

[0050] Figure 5 shows an example of the screen displayed on the display unit of the map display device 102 in step S305, showing an example of a small-scale map. 501 shows the icon for the network camera 103, displaying the installation location and shooting direction. A list of network cameras displayed on the map is also shown (502). The scale can be changed by moving the slider shown in 503. Furthermore, the map display moves up, down, left, and right by accepting scroll operations.

[0051] Next, we will explain the map display screen shown in Figure 6.

[0052] Figure 6 shows an example of the screen displayed on the display unit of the map display device 102 in step S305, and shows an example where a map with a larger scale is displayed compared to Figure 5.

[0053] 601 shows the icon for network camera 103. A list of network cameras displayed on the map is also shown (602). It is possible to add checkboxes to the list to display only the checked cameras. Furthermore, as shown in 603, it is possible to add checkboxes to select floors (height information) to display only the cameras on the checked floors. This allows for, for example, displaying only the cameras installed on the 3rd floor of a building and viewing only the footage captured by those cameras. It also allows for displaying only the cameras installed on the rooftop (e.g., fixed-point cameras) and viewing only the footage captured by those cameras.

[0054] Changing the scale and scrolling can be done using the same operations as in the example in Figure 5.

[0055] In this embodiment, floor selection and camera selection are only accepted on the map display screen with a large scale, as shown in Figure 6. However, similar control and display may be performed in Figure 5 as well.

[0056] Next, we will explain the video display screen shown in Figure 7.

[0057] Figure 7 shows an example of the screen displayed on the camera image display device 101 in step S309, and is the screen displayed when the map shown in Figure 6 is displayed on the map display device 102. As shown in Figure 7, the images captured by "Camera at Point A," "Camera at Point B," "Camera at Point C," and "Camera at Point D," along with the camera names, are displayed.

[0058] As shown in the flowchart in Figure 3, when the scale of the map displayed on the map display device 102 is changed or scrolled, the camera included in the displayed map area changes, and consequently, the image displayed on the camera image display device 101 also changes.

[0059] In this embodiment, the camera image display device 101 and the map display device 102 are described as separate devices, and the map display screens in Figures 5 and 6 and the video display screen in Figure 7 are described as being displayed on separate devices. However, the maps shown in Figures 5 and 6 and the video shown in Figure 7 may be displayed on the same screen of a single device.

[0060] As explained above, displaying icons on the map indicating the installation location and shooting direction of network cameras makes it possible to understand the installation location and shooting direction of network cameras. Furthermore, displaying the video footage captured by the network cameras with icons on the map makes it easier to identify which network camera captured the footage. Additionally, by changing the map scale or scrolling, the video footage captured by the network camera in question can be displayed on the map, making network camera selection simpler and more intuitive.

[0061] The present invention can take the form of, for example, a system, apparatus, method, program, or recording medium. Specifically, it may be applied to a system consisting of multiple devices, or to an apparatus consisting of a single device.

[0062] Furthermore, the program in this invention is a program that allows a computer to execute the processing method shown in the flowchart in Figure 3, and the storage medium of this invention stores a program that allows a computer to execute the processing method shown in Figure 3. Note that the program in this invention may also be a program for each processing method of each device shown in Figure 3.

[0063] As described above, it goes without saying that the object of the present invention can also be achieved by supplying a recording medium containing a program that realizes the functions of the embodiments described above to a system or device, and by having the computer (or CPU or MPU) of that system or device read and execute the program stored on the recording medium.

[0064] In this case, the program read from the recording medium itself realizes the novel function of the present invention, and the recording medium on which that program is recorded constitutes the present invention.

[0065] For recording media used to supply programs, examples include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, silicon disks, and the like.

[0066] Furthermore, it goes without saying that the functions of the aforementioned embodiments are realized not only by the computer executing the program it has read, but also by the operating system (OS) running on the computer performing some or all of the actual processing based on the instructions of that program, thereby realizing the functions of the aforementioned embodiments.

[0067] Furthermore, it goes without saying that this also includes cases where, after a program read from a recording medium is written to the memory of a function expansion board inserted into a computer or a function expansion unit connected to a computer, the CPU or other components of the function expansion board or function expansion unit perform some or all of the actual processing based on the instructions of the program code, and the functions of the aforementioned embodiments are realized through that processing.

[0068] Furthermore, the present invention may be applied to a system consisting of multiple devices or to a device consisting of a single device. It goes without saying that the present invention can also be applied when the results are achieved by supplying a program to a system or device. In this case, by reading a recording medium containing a program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

[0069] Furthermore, by downloading and reading the program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or device can enjoy the effects of the present invention. It should be noted that configurations combining the above-described embodiments and their variations are all included in the present invention. [Explanation of symbols]

[0070] 101 Camera image display device 102 Map display device 103 Network Cameras 104 Video Management Device 105 Map Information Distribution Device

Claims

1. A means for accepting requests to change the map scale, A means for identifying an object located in the modified map area corresponding to the aforementioned modification operation, The system includes a display control means that controls the display of the map showing the location of the object identified by the identification means, The display control means controls the display to not display a display item that accepts the selection of whether or not to display an icon indicating the location of an object on the map when the map is displayed at a first scale, and to display the display item when the map is displayed at a second scale. An information processing system characterized by the following.

2. The aforementioned display item is further characterized by being an item that accepts a selection of height or floor, The display control means controls the display to show the map indicating the location of the object located at the height or floor selected in the display item. The information processing system according to claim 1, characterized by the following:

3. The aforementioned display item is further characterized by being an item that accepts the selection of a rooftop, The display control means, when it receives a selection of "rooftop" in the display items, controls the display to show the map indicating the location of the object located on the rooftop. An information processing system according to claim 1 or 2, characterized by the above.

4. The modification operation accepted by the aforementioned reception means is at least one of the following: zoom in or out, change the scaling factor, and scroll. An information processing system according to any one of claims 1 to 3, characterized by the above.

5. The second scale is larger than the first scale. An information processing system according to any one of claims 1 to 4, characterized by the above.

6. The display control means controls the display of the map showing the location of the object by mapping an icon to the location on the map where the object exists. An information processing system according to any one of claims 1 to 5, characterized by the following:

7. The aforementioned object is characterized by being a network camera. The aforementioned icon indicates the shooting direction of the network camera. The information processing system according to claim 6, characterized by the following:

8. The display control means further includes: Controlling the network camera, whose icon is displayed on the aforementioned map, to display the video captured by the camera on the video display screen. The information processing system according to claim 7, characterized by the following:

9. The information processing system's reception means includes a reception step that accepts an operation to change the map scale, The identification means of the information processing system includes an identification step of identifying an object located in the modified map area corresponding to the modification operation, The information processing system includes a display control step that controls the display control means to display the map showing the location of the object identified by the specific step, The display control step controls the system to not display a display item that accepts the selection of whether or not to display an icon indicating the location of an object on the map for each object when the map is displayed at a first scale, and to display the display item when the map is displayed at a second scale. An information processing method characterized by the following.

10. A program for causing a computer to function as one of the means described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Communication equipment, image processing unit, communication method and image processing method

    JP1997214937A

  • Map display system and terminal device constituting the system

    JP2004354819A

  • Monitoring camera system

    JP2008199531A

  • Monitoring device

    JP2012226485A

  • Monitoring device

    JP2013101460A