Information processing apparatus, information processing method, and program

Abstract

To improve convenience in a monitoring system using a vehicle.SOLUTION: A designation of a first period is received from a user, one or more icons indicating a position of a vehicle having a record of traveling in a predetermined area within the first period are displayed on a map for each time based on a traveling history of one or more vehicles, and when any one of the one or more icons is selected, data for requesting transmission of a video captured at a corresponding time is transmitted to a corresponding vehicle or an in-vehicle device mounted on the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to surveillance systems. [Background technology]

[0002] There is a technology for monitoring using a mobile object equipped with a camera. For example, Patent Document 1 discloses a system that uses a server device to manage the history of vehicle driving locations and identifies vehicles equipped with a drive recorder that are located near a caller. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-019792 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to improve the convenience of a vehicle-based monitoring system. [Means for solving the problem]

[0005] One aspect of the present disclosure is The information processing device has a control unit that performs the following operations: accepting a first period from a user; displaying one or more icons on a map for each time period, based on the driving history of one or more vehicles, indicating the locations of vehicles that have driven through a specified area within the first period; and, when one of the one or more icons is selected, transmitting data to the corresponding vehicle or an on-board device mounted on the vehicle requesting the transmission of video captured at the corresponding time.

[0006] One aspect of the present disclosure is An information processing method executed by an information processing device, comprising: receiving a designation of a first period from a user; displaying, on a map for each time period, one or more icons indicating the locations of vehicles that have traveled in a predetermined area within the first period based on the travel history of one or more vehicles; and, when any of the one or more icons is selected, transmitting data to a corresponding vehicle or an in-vehicle device mounted on the vehicle, requesting transmission of video captured at the corresponding time. The present invention relates to an information processing method.

[0007] Another aspect of the present invention is a program for causing a computer to execute the above-described method, or a computer-readable storage medium that non-transitory stores the program. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to improve the convenience of a monitoring system using a vehicle. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram of a monitoring system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating the configuration of each device included in the system. [Figure 3] 10A and 10B show examples of vehicle data, a vehicle data table, and a vehicle list. [Figure 4] 10 is an example of a screen displayed on a terminal device in the first embodiment. [Figure 5] FIG. 4 is a sequence diagram of a process in which the server device collects vehicle data and provides a vehicle list. [Figure 6] FIG. 10 is a sequence diagram of a process for playing back in-vehicle video. DETAILED DESCRIPTION OF THE INVENTION

[0010] In recent years, automobiles have become increasingly connected, with an increasing number of vehicles equipped with communication functions and in-vehicle cameras.

[0011] In relation to this, by making it possible for designated agencies to access footage captured by cameras (such as dashcams) mounted on vehicles, it can be useful in the initial response to incidents and accidents. For example, when a call is made to 110 or 119, relevant authorities can quickly confirm the situation at the scene by obtaining dashcam footage from a vehicle that was traveling near the relevant location around the time the incident occurred. As a system for this purpose, a system is known in which icons or the like representing the travel positions of a plurality of vehicles at a predetermined time in the past are mapped on a map and presented to an operator.

[0012] In this system, for example, an operator first specifies a target area and a time. The target area is, for example, an area that includes the location where the report was made. The system acquires location information for vehicles traveling in a specified area at a specified time, maps it on a map, and outputs it. When the operator selects a vehicle on the map, the system requests that vehicle to transmit dashcam footage taken at the corresponding time. This allows the operator to view dashcam footage that may have captured the scene of the call.

[0013] However, it is not possible to accurately identify when an event (e.g., a traffic accident) occurred from the content of the report. In other words, the operator must conduct multiple searches at different times to find the vehicle that captured the event. The information processing device according to the present disclosure solves such a problem.

[0014] An information processing device according to one aspect of the present disclosure has a control unit that performs the following operations: accepting a designation of a first period from a user; displaying one or more icons on a map for each time period, based on the driving history of one or more vehicles, indicating the locations of vehicles that have driven in a specified area within the first period; and, when one of the one or more icons is selected, transmitting data to the corresponding vehicle or an on-board device mounted on the vehicle requesting the transmission of video captured at the corresponding time.

[0015] The control unit, for example, extracts vehicles that have traveled within a specified area within a first period from the vehicle travel history stored in the storage device and displays their locations on a map using icons. The first period is preferably a period sufficient to extract multiple vehicles that may have captured the target event. For example, when a traffic accident is reported, the first period may be a period going back a specified amount of time from the time of the report. For example, if the report time is 6:00 PM, the period going back may be set to 5 minutes, and the period from 5:55 PM to 6:00 PM may be set as the first period. This makes it possible to extract multiple vehicles that have passed near the site and may have captured the target event.

[0016] The control unit may also receive a designation of a predetermined area on the map, and display the icon within the predetermined area. With this configuration, even if there are many vehicles traveling within the map display area, it is possible to narrow down the display of icons to a specific area, thereby improving the user experience and saving computer resources.

[0017] The control unit may also output a first user interface for specifying a reference time and a second user interface that allows a user to select a time span going back from the reference time from among a plurality of options, and may determine the first period based on the specified reference time and the selected time span.

[0018] The first user interface may be implemented by, for example, a time picker. Alternatively, the second user interface may be a user interface that allows the user to select multiple time intervals, such as 1 minute, 3 minutes, and 5 minutes. This allows the operator of the device to quickly set the first period.

[0019] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0020] (First embodiment) [System Overview] An overview of a monitoring system according to a first embodiment will be described with reference to Fig. 1. The monitoring system according to this embodiment includes a plurality of vehicles 10, a server device 2, and a terminal device 3. The vehicles 10 are connected vehicles that can access a wireless communication network. The vehicles 10 can communicate with the server device 2 via the wireless communication network (for example, a cellular communication network).

[0021] The vehicle 10 is equipped with an in-vehicle device 1. The in-vehicle device 1 functions as a drive recorder and a wireless communication device. The in-vehicle device 1 has a function of acquiring and storing video images (hereinafter referred to as "video" or "in-vehicle video") of the area in front of the vehicle using an in-vehicle camera, and a function of providing the stored video to an external device (e.g., a server device 2) in response to a request from the external device. The vehicle 10 also has a function of periodically transmitting location information to the server device 2.

[0022] In this embodiment, the in-vehicle device 1 has a wireless communication function, but the vehicle 10 may have a data communication module (hereinafter referred to as DCM) for connecting the components of the vehicle to a network. That is, the in-vehicle device and the wireless communication device may be separate devices.

[0023] The server device 2 is a device configured to be able to communicate with multiple vehicles 10 via a network. The server device 2 periodically acquires location information from the multiple vehicles 10 under its management and stores the information in a database. By referring to the database managed by the server device 2, it is possible to identify the locations and times at which the multiple vehicles 10 under the management of the system have traveled in the past.

[0024] Based on the information acquired from the server device 2, the terminal device 3 identifies a vehicle 10 that is presumed to have the desired vehicle-mounted video, and acquires the vehicle-mounted video from the vehicle 10. Specifically, the terminal device 3 queries the server device 2 and obtains a list of vehicles that were traveling within a specified area at a specified time. The terminal device 3 then maps the corresponding vehicles on a map and accepts a vehicle selection from an operator. The terminal device 3 then requests the selected vehicle 10 to transmit on-board video. This allows the operator of the terminal device 3 to check the video captured by the target vehicle.

[0025] The terminal device 3 is installed in an institution that uses the images captured by the vehicle 10. Examples of such agencies include a police agency and a fire department. For example, when a fire department uses the terminal device 3, a call to emergency services is used as a trigger, and an operator identifies a vehicle 10 that was traveling near the scene of the call around the time of the call, and acquires in-vehicle video from the vehicle 10.

[0026] Next, the hardware and software configurations of the devices that make up the system will be described. FIG. 2 is a diagram showing a schematic configuration of an in-vehicle device 1, a server device 2, and a terminal device 3 operated by an operator, all of which are installed in a vehicle 10. As shown in FIG.

[0027] The in-vehicle device 1 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.). The auxiliary memory device stores an operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions (software modules) that match predetermined purposes, as described below, can be realized. However, some or all of the functions may be realized as hardware modules using hardware circuits such as ASICs, FPGAs, etc.

[0028] The in-vehicle device 1 includes a control unit 11, a storage unit 12, a communication unit 13, a position information acquisition unit 14, and a camera 15.

[0029] The control unit 11 is a computing unit that executes predetermined programs to realize various functions of the in-vehicle device 1. The control unit 11 can be realized by, for example, a hardware processor such as a CPU. The control unit 11 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0030] In this embodiment, the control unit 11 of the in-car device 1 is configured to have three software modules: a photographing unit 111, a notification unit 112, and a provision unit 113. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 12. Note that the information processing executed by the software modules is synonymous with the information processing executed by the control unit 11 (CPU, etc.).

[0031] While the device is in operation, the photographing unit 111 photographs moving images (in-vehicle images) using the camera 15 and stores the obtained data in the storage unit 12. The photographing unit 111 receives power supply from the vehicle and photographs continuously, and records the obtained moving image data in the storage unit 12.

[0032] Video data is made up of multiple video files. There is an upper limit to the length of a video corresponding to one file, and if the upper limit is exceeded, a new video file is generated. In this embodiment, a video file is generated every minute. If the storage capacity is insufficient, the shooting unit 111 deletes the oldest video file to secure free space and then continues shooting. In this embodiment, each video file is associated with an identifier (date and time ID) that identifies the date and time the video file was generated (i.e., the date and time when shooting started). The date and time ID may uniquely identify the year, month, day, hour, minute, and second. When the image capturing unit 111 is activated, the in-vehicle device 1 functions as a drive recorder.

[0033] The notification unit 112 periodically generates data relating to the traveling of the vehicle (hereinafter referred to as vehicle data) and transmits it to the server device 2. In this embodiment, the vehicle data includes the position information of the vehicle 10, the traveling direction of the vehicle 10, and a date and time ID indicating the date and time when the position information was acquired. , an example of vehicle data is shown. In this embodiment, the vehicle data includes an identifier (vehicle ID) that uniquely identifies the vehicle 10, the date and time when the vehicle data was generated, an identifier (date and time ID) that uniquely identifies the date and time, location information, and information indicating the direction of travel. The location information and direction of travel can be acquired from the location information acquisition unit 14, which will be described later.

[0034] The vehicle data is generated and transmitted at a predetermined cycle. The predetermined cycle may be measured independently, or may be linked to the image capturing unit 111. For example, the notification unit 112 may generate vehicle data at the timing when the image capturing unit 111 generates a new video file (for example, at one-minute intervals). In this case, the date and time indicated by the vehicle data will be the same as the date and time when the new video file was generated.

[0035] The providing unit 113 provides the terminal device 3 with a video file that was shot at a specified time, based on a request (a request to provide a video file) sent from the terminal device 3. For example, when the providing unit 113 receives a provision request including a date and time ID from the terminal device 3, the providing unit 113 obtains the video file corresponding to the date and time ID from the storage unit 22 and transmits it to the terminal device 3.

[0036] The storage unit 12 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 12 stores programs executed by the control unit 11, data used by the programs, etc.

[0037] The communication unit 13 is a wireless communication interface for connecting the in-vehicle device 1 to an external network. The communication unit 13 is configured to be able to communicate with the server device 2 via, for example, a wireless LAN or a cellular communication network such as 3G, 4G, or 5G.

[0038] The position information acquisition unit 14 acquires position information of the vehicle 10. The position information acquisition unit 14 includes a GPS antenna and a positioning module for determining the position information. The GPS antenna is an antenna that receives positioning signals transmitted from positioning satellites (also referred to as GNSS satellites). The positioning module is a module that calculates position information based on the signals received by the GPS antenna. The position information acquisition unit 14 may determine the traveling direction of the vehicle 10 based on the transition of the position information. The camera 15 is an optical unit including an image sensor for acquiring images, and is mounted, for example, facing forward of the vehicle 10.

[0039] Next, the server device 2 will be described. Like the in-vehicle device 1, the server device 2 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0040] The server device 2 includes a control unit 21, a storage unit 22, and a communication unit .

[0041] The control unit 21 is a computing unit that executes predetermined programs to realize various functions of the server device 2. The control unit 21 can be realized by, for example, a hardware processor such as a CPU. The control unit 21 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0042] In this embodiment, the control unit 21 of the server device 2 is configured to have two software modules: a data update unit 211 and an information providing unit 212. Each software module is executed by the control unit 11 (CPU, etc.) to execute a program stored in the storage unit 22. The information processing executed by the software module is synonymous with the information processing executed by the control unit 21 (CPU, etc.).

[0043] The data update unit 211 receives vehicle data from a plurality of vehicles 10 (on-vehicle devices 1) and stores the vehicle data in the storage unit 22. For example, the data update unit 211 may store the vehicle data received from a plurality of vehicles 10 in a table (referred to as a vehicle data table) such as that shown in FIG. 3(B).

[0044] The information providing unit 212 provides information to the terminal device 3 based on the information stored in the storage unit 22. Specifically, the information providing unit 212 performs the following two types of processing.

[0045] (1) Providing information on vehicle location The vehicle data table stores location information of the vehicle 10 equipped with the in-vehicle device 1 that functions as a drive recorder, in association with date and time information. By referring to this, it is possible to extract vehicles that have traveled within a specified area within a specified time span. When a request is received from the terminal device 3, the information providing unit 212 extracts vehicles that have traveled within a specified area within a specified time period, and transmits pairs of location information and date and time information to the terminal device 3. This allows mapping onto a map on the terminal device 3 side. The location information may include information indicating the direction of travel.

[0046] (2) In-car video broadcasting When the terminal device 3 selects a target vehicle for which in-vehicle video is requested, the information providing unit 212 receives a video playback request from the terminal device 3. The video playback request includes information identifying the target vehicle and the target date and time. The information providing unit 212 transfers the video playback request to the target vehicle based on the information. The information providing unit 212 also transfers the video file (or video stream) of the in-vehicle video transmitted from the target vehicle to the terminal device 3.

[0047] The storage unit 22 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 22 stores programs executed by the control unit 21, data used by the programs, etc. The storage unit 22 also stores a table (vehicle data table) for storing data received from the in-vehicle device 1.

[0048] The communication unit 23 is a communication interface for connecting the server device 2 to a network. The communication unit 23 is configured to be able to communicate with the network via, for example, Ethernet (registered trademark), a wireless LAN, a cellular communication network, or the like.

[0049] Next, the terminal device 3 will be described. Like the in-vehicle device 1 and the server device 2, the terminal device 3 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0050] The terminal device 3 includes a control unit 31, a storage unit 32, a communication unit 33, and an input / output unit .

[0051] The control unit 31 is a computing unit that executes a predetermined program to realize various functions of the terminal device 3. The control unit 31 can be realized by a hardware processor such as a CPU. The control unit 31 also includes a RAM, a ROM (Read Only Memory), It may also be configured to include a cache memory, etc.

[0052] In this embodiment, the control unit 31 of the terminal device 3 is configured to have two software modules: a display control unit 311 and a video acquisition unit 312. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 32. Note that the information processing executed by the software module is synonymous with the information processing executed by the control unit 31 (CPU, etc.).

[0053] The display control unit 311 generates a user interface (GUI) for requesting acquisition of in-vehicle video and outputs it via the input / output unit 34, which will be described later. In this embodiment, the display control unit 311 generates and outputs a user interface including a road map image based on road map data stored or acquired in advance. The user interface includes a user interface component for specifying a target period (the "first period" in this disclosure).

[0054] In addition, based on the operation performed by the operator, the display control unit 311 requests the server device 2 for a "list of vehicles that were traveling within the display area of ​​the map during the target period," and based on the response, maps an icon representing the vehicle's location on the map. For example, if the operator specifies a period of "from 17:00 to 17:03 today," the display control unit 311 requests "a list of vehicles that have been traveling within the display range of the map from 17:00 to 17:03 today" from the server device 2. The display control unit 311 also maps icons based on the received list of vehicles.

[0055] When one of the mapped icons is selected by the operator, the video acquisition unit 312 transmits a request to play the in-vehicle video to the corresponding vehicle 10. The video acquisition unit 312 also plays the video file or video stream transmitted from the vehicle 10. In the following description, it is assumed that the playback request is transmitted to the vehicle 10 via the server device 2. It is also assumed that the video file or video stream is received via the server device 2.

[0056] The storage unit 32 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 32 stores programs executed by the control unit 31, data used by the programs, etc.

[0057] The communication unit 33 is a wireless communication interface for connecting the terminal device 3 to an external network. The communication unit 33 is configured to be able to communicate with the server device 2 via, for example, a wireless LAN or a cellular communication network such as 3G, 4G, or 5G.

[0058] The input / output unit 34 is a unit that receives input from an operator of the device and presents information to the operator. Specifically, the input / output unit 34 is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are composed of a single touch panel display.

[0059] 2 is an example, and all or part of the illustrated functions may be performed using a dedicated circuit. Also, programs may be stored or executed using a combination of a main memory and an auxiliary memory other than those shown in the figure.

[0060] [Processing details] Next, the operations performed by the operator via the terminal device 3 and the processes executed as a result will be described using specific examples.

[0061] FIG. 4(A) is an example of a screen provided to the operator of the terminal device 3. The display control unit 311 of the terminal device 3 generates a user interface including a road map centered on a predetermined point, and outputs the generated user interface to the input / output unit 34. The user interface includes a component (reference number 401) for specifying a reference time (reference time), a component (reference number 402) for specifying a time range going back from the reference time, and a button (reference number 403) for executing a search.

[0062] Reference numeral 401 denotes a user interface component for specifying a reference time. The operator uses this user interface component to specify the reference time. The reference time is, for example, the time when the emergency call was made to 119. Reference numeral 402 denotes a user interface component for specifying a time span going back from a reference time. The time span can be selected from a number of options. For example, multiple options are provided, such as "1 minute ago," "3 minutes ago," and "5 minutes ago," and the operator selects or specifies the desired time span. For example, if the operator specifies "3 minutes ago," the period to be searched will be "from 3 minutes before the reference time to the reference time" (the "first period" in this disclosure).

[0063] When the operator presses the search button (reference numeral 403), data requesting a list of vehicles that have traveled within a specified area during a set period (for example, from 16:57 to 17:00) is transmitted from the terminal device 3 to the server device 2. The request includes, for example, information for identifying the specified area, information indicating the target period, etc. The predetermined area may be the entire area corresponding to the map being displayed, or may be a partial area set on the map.

[0064] In response to the request, the server device 2 (information provider 212) generates a list of applicable vehicles (vehicle list) and returns it to the terminal device 3. FIG. 3(C) is an example of the returned vehicle list. Note that although it is referred to as a "vehicle list" here, the records included in the list may include the same vehicle. For example, the same vehicle may transmit vehicle data multiple times within a set period within the displayed map area. In this case, multiple records with the same vehicle ID will be included in the vehicle list.

[0065] The terminal device 3 (display control unit 311) that has received the vehicle list maps icons representing the vehicles at corresponding positions on the map. The icons may be arranged taking into consideration the traveling direction of the vehicles. An icon is generated for each record in the vehicle list. That is, the same vehicle may be displayed by more than one icon. However, since the difference between vehicles is not important to the operator, in this embodiment, information for identifying the vehicle is not displayed on the screen.

[0066] When the operator selects (for example, clicks) one of the icons, an operation for acquiring and playing back in-vehicle video from the vehicle corresponding to the icon is initiated.

[0067] When an icon is selected, the acquisition of video from the target vehicle may begin immediately, or the date and time corresponding to the selected icon (i.e., the date and time when the corresponding vehicle was traveling at the target location) may be displayed, and the operator may confirm this and instruct the acquisition of video again.

[0068] For example, when an icon is clicked by an operator, the date and time corresponding to the icon may be overlaid near the icon. The date and time can be obtained from the vehicle list received from the server device 2. This allows the operator to understand the time sequence even if there are multiple icons near a desired location (for example, a reporting location). In this case, when the operator checks the date and time corresponding to the icon and clicks on the icon again, video playback may be started.

[0069] When an operator performs an operation to request playback of a video, a request to play back the in-vehicle video (hereinafter referred to as a playback request) is transmitted from the terminal device 3 to the server device 2. The playback request includes a vehicle ID for specifying the vehicle and a date and time ID for specifying the date and time. Upon receiving the playback request, the server device 2 identifies the target vehicle and transfers the playback request to the corresponding in-vehicle device 1.

[0070] Upon receiving the playback request, the in-car device 1 extracts the video file corresponding to the specified date and time ID and transmits it to the server device 2. The subject of transmission may be a video file of the in-car video or a video stream. The transmitted video file (or video stream) is relayed by the server device 2 to the terminal device 3, where the video is played back. FIG. 4(B) shows an example of a playback screen on the terminal device 3.

[0071] In this example, since video files are generated in one-minute increments, playback is also in one-minute increments. If the operator wishes to play back the previous or next video file, he or she presses a button (reference numeral 404) that instructs moving forward or backward. When the button is pressed, a playback request for acquiring the corresponding video file is generated and transmitted to the target in-vehicle device 1 through the same process. This allows the operator of the terminal device 3 to play back the in-vehicle video for the specified date and time.

[0072] [Processing Sequence] Next, the steps executed by each device and the flow of data exchanged between the devices will be described.

[0073] Figure 5 is a sequence diagram of the process of transmitting vehicle data from the in-vehicle device 1 to the server device 2, and the process of transmitting information for mapping the vehicle's location information from the server device 2 to the terminal device 3, and the process of the terminal device 3 drawing a map. First, the process of transmitting vehicle data from the in-vehicle device 1 to the server device 2 (steps S11 to S13) will be described. This process is executed at a predetermined cycle. The predetermined cycle may be determined by the notification unit 112, or may be determined by the notification unit 112 in response to a notification from the image capture unit 111. For example, every time a video file is switched (for example, every minute), the image capture unit 111 may transmit a notification to the notification unit 112, and in response to this, the notification unit 112 may start the process shown in the figure.

[0074] First, in step S11, the in-vehicle device 1 (notification unit 112) acquires vehicle data. In this embodiment, the notification unit 112 acquires the position information and traveling direction of the vehicle from the position information acquisition unit 14, and generates vehicle data by combining the identifier of the vehicle with date and time information. The generated vehicle data is transmitted to the server device 2 (step S12).

[0075] In step S13, the server device 2 (data update unit 211) receives the vehicle data and stores the vehicle data in the vehicle data table in the storage unit 22.

[0076] By executing the above-described process for a plurality of vehicles 10, the server device 2 can collect and manage past position information of a plurality of vehicles under its management. Also, by referring to the vehicle data table stored in the server device 2, the server device 2 can collect and manage past position information of a plurality of vehicles under its management. This makes it possible to search for vehicles that were traveling at a certain point. Because each vehicle records video while traveling, it is possible to search for vehicles that are likely to have captured video of a specific event (such as a traffic accident, an event related to a report).

[0077] Next, a description will be given of a process (steps S21 to S23) in which the terminal device 3 outputs a road map onto which vehicle position information is mapped. This process is started, for example, when a road map is displayed on the terminal device 3 (display control unit 311).

[0078] First, in step S21, the terminal device 3 (display control unit 311) determines whether or not it is necessary to redraw the icon. For example, if a road map is displayed for the first time, or if an operation to change the display range of the road map or an operation to change the target period has been performed, this step will result in a positive determination. For example, if an operation to display a road map is performed by the operator of the terminal device 3 and a target period is specified, it will be necessary to redraw the icon. If the determination in this step is positive, the terminal device 3 generates a vehicle list generation request and transmits it to the server device 2. The vehicle list generation request includes information indicating the map display range and information indicating the target period specified by the operator.

[0079] In step S22, the server device 2 (information provider 212) generates a vehicle list based on the received request. Specifically, records of vehicles that have traveled within the display area of ​​the map during the specified period are extracted from the vehicle data table stored in the storage unit 22, and a vehicle list made up of the extracted records is generated. The generated vehicle list is transmitted to the terminal device 3.

[0080] In step S23, the terminal device 3 (display control unit 311) draws a map based on the acquired vehicle list, and maps icons to corresponding points on the map.

[0081] When the process of step S23 is completed, as shown in Fig. 4(A), a plurality of icons are mapped on the map on the terminal device 3. The icons represent the positions of vehicles that have been traveling within the target area during the specified period.

[0082] 6 is a sequence diagram of a process in which the in-vehicle device 1 provides video to the terminal device 3 based on a request from the terminal device 3. The illustrated process is started when an icon on a map is designated by the operator. First, the terminal device 3 (video acquisition unit 312) generates a playback request (step S31). The playback request is data for requesting the in-vehicle device 1 to provide in-vehicle video, and includes an identifier (vehicle ID) of the in-vehicle device 1 (vehicle 10) and an identifier (date and time ID) of the date and time when the in-vehicle video was captured. The vehicle ID and date and time ID are included in the vehicle list that the terminal device 3 receives from the server device 2. When the operator selects an icon on the map, the terminal device 3 can identify the vehicle ID and date and time ID of the corresponding vehicle.

[0083] The playback request is transmitted from the terminal device 3 to the server device 2, and is relayed from the server device 2 to the target in-vehicle device 1. At this time, the server device 2 may read the vehicle ID included in the playback request and identify the in-vehicle device 1 to which the playback request is to be relayed. For this reason, it is preferable that the server device 2 stores data associating the vehicle ID with the connection destination (e.g., network address, etc.) of the corresponding in-vehicle device 1. The playback request relayed by the server device 2 is received by the corresponding in-vehicle device 1.

[0084] Upon receiving the playback request, the in-car device 1 (providing unit 113) extracts the video file specified by the date and time ID from the video data stored therein (step S32). The extracted video file is transmitted to the terminal device 3 via the server device 2. The terminal device 3 generates a playback screen as shown in Fig. 4(B) and starts playing the received video file. Note that when an operation to specify another video file is performed (for example, when the button indicated by reference numeral 404 is pressed), the process shown in Fig. 6 is executed again, and a new playback request is generated. In this example, a moving image file is the target of transmission, but the target of transmission may be a video stream or the like.

[0085] As described above, in the monitoring system according to this embodiment, the terminal device 3 maps the vehicle's driving history on a map based on the vehicle data stored in the server device 2. The operator of the terminal device 3 can acquire a video file from a vehicle by specifying the vehicle on the displayed map. This allows the operator of the terminal device 3 to check the in-vehicle video captured by the vehicle traveling at a desired location at a desired time.

[0086] Furthermore, in this embodiment, a period for extracting vehicles can be set on the user interface, which makes it possible to efficiently extract multiple vehicles that may have captured the target event, compared to when a single time is specified.

[0087] (Variation) The above-described embodiment is merely an example, and the present disclosure can be modified and implemented as appropriate within the scope that does not deviate from the gist of the disclosure. For example, the processes and means described in this disclosure can be freely combined and implemented as long as no technical contradiction occurs.

[0088] Furthermore, in the embodiment, a vehicle equipped with an on-board device is exemplified, but any moving object other than a vehicle may be used as long as it is capable of capturing video.

[0089] In the embodiment, the terminal device 3 generates and outputs a user interface including a road map based on information received from the server device 2. However, the road map may be generated by the server device 2. In this case, instead of the server device 2 generating a vehicle list and transmitting it to the terminal device 3, the server device 2 may draw the road map and map icons. In this case, the user interface screen including the road map generated by the server device 2 may be transmitted to the terminal device 3, and the terminal device 3 may output it. That is, the functions of the terminal device 3 (display control unit 311) described in the embodiment may be provided in the server device 2 (information providing unit 212). The information processing device according to the present disclosure may be realized as the server device 2 or as the terminal device 3. When the server device 2 draws the user interface screen, the server device 2 outputs position information for arranging icons on the map and time information corresponding to the icons. Note that "output" is not limited to outputting to an external device and also includes passing information between elements of the server device 2.

[0090] In the embodiment, vehicles are extracted from within the area where the map is displayed. However, the area from which vehicles are extracted may be set separately. For example, a figure may be drawn on the map, and vehicles may be extracted from within the figure. The figure may be drawn automatically by the system, or may be drawn based on an operation performed by an operator of the device. In this case, information for identifying the set area is transmitted from the terminal device 3 to the server device 2, and the server device 2 generates a vehicle list based on this information.

[0091] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be shared and executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0092] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0093] 1...In-vehicle device 2. Server device 3. Terminal device 11, 21, 31... Control unit 12,22,32...Storage section 13, 23, 33... Communications Department 14...Location information acquisition unit 15. Camera 34...Input / output section

Claims

1. accepting a designation of a first period from a user; displaying, on a map for each time period, one or more icons indicating the locations of vehicles that have traveled within a predetermined area within the first period based on the travel history of the one or more vehicles; When any one of the one or more icons is selected, transmitting data to the corresponding vehicle or an in-vehicle device mounted on the vehicle, requesting transmission of video captured at the corresponding time; a control unit that executes the following: Information processing device.

2. the control unit outputs a first user interface for specifying a reference time and a second user interface for selecting a time range going back from the reference time from a plurality of options, and determines the first period based on the specified reference time and the selected time range. The information processing device according to claim 1 .

3. the control unit accepts designation of a predetermined area on the map; Displaying the icon within the predetermined area; The information processing device according to claim 1 .

4. An information processing method executed by an information processing device, accepting a designation of a first period from a user; displaying, on a map for each time period, one or more icons indicating the locations of vehicles that have traveled within a predetermined area within the first period based on the travel history of the one or more vehicles; When any one of the one or more icons is selected, transmitting data to the corresponding vehicle or an in-vehicle device mounted on the vehicle, requesting transmission of video captured at the corresponding time; An information processing method, including:

5. A program for causing a computer to execute the information processing method according to claim 4.

Images