Information processing device, information processing method, and program

Abstract

To provide a vehicle-based monitoring system with improved convenience.SOLUTION: An information processing device has a control unit configured to: display multiple icons on a map indicating locations of each vehicle at multiple points in time based on driving histories of one or more vehicles; and, upon selection of one of the multiple icons, transmit a command to a vehicle corresponding to the selected icon to transmit video footage captured at the time corresponding to the selected icon. The control unit acquires first information on a report regarding occurrence of an abnormal event from a specific administrative agency that received the report. Based on the first information, the control unit displays an estimated location of the abnormal event on the map.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] There is a technology for monitoring using a mobile object equipped with a camera. For example, Patent Document 1 discloses a system that uses a server device to manage the history of vehicle driving locations and identifies vehicles equipped with a drive recorder that are located near a caller. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-019792 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to provide a technology that can improve convenience when using a vehicle-based monitoring system. [Means for solving the problem]

[0005] One aspect of the present disclosure is an information processing device. In this case, the information processing device includes, for example, Displaying a plurality of icons on a map indicating the positions of each vehicle at a plurality of times based on the driving history of the one or more vehicles; When one of the plurality of icons is selected, transmitting a command to a vehicle corresponding to the selected icon to transmit an image captured at the corresponding time; An information processing device comprising a control unit that executes The control unit acquiring first information regarding the notification from a predetermined administrative agency that has received the notification regarding the occurrence of an abnormal event; displaying on the map a location where the abnormal event is estimated to have occurred based on the first information; The following may be executed.

[0006] Another aspect of the present disclosure is an information processing method. In this case, the information processing method includes, for example, Displaying a plurality of icons on a map indicating the positions of each vehicle at a plurality of times based on the driving history of the one or more vehicles; When one of the plurality of icons is selected, transmitting a command to a vehicle corresponding to the selected icon to transmit an image captured at the corresponding time; An information processing method executed by a computer, The computer acquiring first information regarding the report from a predetermined administrative agency that has received a report regarding the occurrence of an abnormal event; displaying on the map a location where the abnormal event is estimated to have occurred based on the first information; The following may be executed.

[0007] Another aspect of the present disclosure is a program for causing a computer to execute the information processing method, or a computer-readable storage medium non-temporarily storing the program. can be. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to provide a technique that can improve the convenience when using a vehicle-based monitoring system. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an overview of an example of a monitoring system according to an embodiment. [Figure 2] FIG. 1 is a diagram illustrating an example of a configuration of a monitoring system according to an embodiment. [Figure 3]3A to 3C are diagrams illustrating examples of vehicle data, a vehicle data table, and a vehicle list. [Figure 4] FIG. 10 is a diagram for explaining a flow of identifying an occurrence point from first information. [Figure 5] 3A and 3B are diagrams showing examples of a first map screen and a second map screen. [Figure 6] 10 is a flowchart illustrating an example of a processing routine executed by the terminal device. DETAILED DESCRIPTION OF THE INVENTION

[0010] In recent years, automobiles have become increasingly connected, and the number of vehicles equipped with communication functions is increasing. Furthermore, the number of vehicles equipped with onboard cameras such as dashcams is also increasing. In relation to this, a service is being considered that allows designated agencies to access video footage captured by onboard cameras (hereinafter also referred to as "onboard video footage"), thereby helping with initial responses to abnormal events such as crimes or accidents. For example, when an abnormal event is reported to a designated administrative agency, such as a police agency or a fire department, such a service can obtain onboard video footage from a vehicle traveling near the site where the abnormal event occurred around the time the designated administrative agency received the report (hereinafter also referred to as the "report time"), thereby enabling the designated administrative agency to quickly grasp the situation at the site.

[0011] A system for providing the above-described service is known, which maps icons representing the driving positions of multiple vehicles at a predetermined time in the past on a map and presents them to an operator. The operator selects on the map a vehicle that was driving near the scene at the time of the report. This allows the operator to request the vehicle to provide on-board video. The operator can also check on-board video that may have captured the scene.

[0012] However, in the above-mentioned system, the operator who received the report had to search for the location of the scene on a map. Therefore, it could take time and effort to identify the vehicle that is likely to have taken the scene, and there was room for improvement in terms of convenience.

[0013] One aspect of the present disclosure is an information processing device including a control unit that executes the following: displaying multiple icons on a map indicating the positions of one or more vehicles at multiple times based on the driving history of the vehicles; and, when one of the multiple icons is selected, transmitting a command to the vehicle corresponding to the selected icon to transmit video captured at the time corresponding to the selected icon. The control unit of the information processing device according to the present disclosure then acquires first information regarding the report from a predetermined administrative agency that has received a report of an abnormal event. The predetermined administrative agency is, for example, a police agency or a fire department that receives reports of abnormal events such as incidents or accidents and dispatches personnel to the scene of the abnormal event. In one example, the first information may include audio data of a conversation between a reporter and the predetermined administrative agency. In another example, the first information may include text data obtained by speech recognition of the conversation between the reporter and the predetermined administrative agency.

[0014] The control unit of the information processing device according to the present disclosure determines whether an abnormal event has occurred based on the acquired first information. The location where the abnormal event is estimated to have occurred (hereinafter, sometimes referred to as the "occurrence location") is displayed on a map. Here, if the first information is voice data of a conversation between the reporter and a predetermined administrative agency, the control unit may identify the occurrence location by analyzing the voice data using a predetermined language model. In one example, the predetermined language model may be a language model trained on the voice when the administrative agency received the report. Furthermore, if the first information is text data obtained by speech recognition of the conversation between the reporter and the predetermined administrative agency, the control unit may identify the location where the abnormal event is estimated to have occurred based on an address, a landmark name, or the like included in the text data.

[0015] The map on which the occurrence point is displayed may display icons corresponding to vehicles that have been traveling within a predetermined range including the occurrence point within a predetermined period including the time of the report (for example, within a period including several minutes before and after the time of the report). In this case, the first information may include the time of the report.

[0016] According to the information processing device of the present disclosure, an operator can quickly grasp the positional relationship between the incident point and vehicles that were traveling near the incident point within a predetermined period including the time of the report by viewing a map displaying multiple icons and the incident point. As a result, the operator can easily identify vehicles that are likely to have captured the incident point. Then, by selecting the icon of the identified vehicle, the operator can check on-board footage that may have captured the scene where the abnormal event occurred. This reduces the effort and time required to check on-board footage that may have captured the scene.

[0017] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0018] <Embodiment> (Overview of the monitoring system) An overview of the monitoring system according to this embodiment will be described with reference to Fig. 1. The monitoring system according to this embodiment includes an in-vehicle device 1 mounted on a vehicle 10, a server device 2, a terminal device 3, and a report receiving device 4. Note that although only one in-vehicle device 1 (vehicle 10) is shown in the example shown in Fig. 1, multiple in-vehicle devices 1 (vehicles 10) are included in the monitoring system.

[0019] Each in-vehicle device 1 is a computer configured to be able to communicate with the server device 2 via a wireless communication network (e.g., a cellular communication network). Each in-vehicle device 1 has a function as a drive recorder and a function as a wireless communication device. In detail, the in-vehicle device 1 has a function of acquiring moving images (in-vehicle video) of the area in front of the vehicle using a camera 15 (described later), a function of storing the acquired in-vehicle video, and a function of periodically transmitting position information of the vehicle 10 to the server device 2. Furthermore, the in-vehicle device 1 in this embodiment also has a function of providing the stored in-vehicle video to the server device 2 in response to a request from the server device 2.

[0020] In this embodiment, the in-vehicle device 1 has a wireless communication function, but the vehicle 10 may have a data communication module (hereinafter referred to as DCM) for connecting the components of the vehicle to a network. That is, the in-vehicle device and the wireless communication device may be separate devices.

[0021] The server device 2 is a computer configured to be able to communicate with a plurality of vehicles 10 under the control of the monitoring system via a network. The server device 2 has a function of periodically acquiring position information from each of the plurality of vehicles 10 under the control of the monitoring system, and a function of storing the acquired position information. The server device 2 of this embodiment also has a function to store vehicle information of the vehicle 10 that has been traveling within a predetermined range within a predetermined period of time (hereinafter, this may be referred to as a "vehicle list") in response to a request from the terminal device 3. The predetermined period is a period that includes the time of the report, which will be described later, and approximately three minutes before and after the time of the report. The predetermined range is a geographical range that includes the point of occurrence, which will be described later, and may be an area within 100 meters of the point of occurrence, for example. The server device 2 of this embodiment also has a function to acquire in-vehicle video from the vehicle 10 selected by the operator of the terminal device 3 in response to a request from the terminal device 3, and to provide the acquired in-vehicle video to the terminal device 3.

[0022] The terminal device 3 has a function of acquiring a vehicle list from the server device 2 when triggered by receiving first information transmitted from the report receiving device 4 (described later). Specifically, the terminal device 3 first identifies a location (occurrence location) where an abnormal event is estimated to have occurred, based on the first information received from the report receiving device 4. In this embodiment, the first information includes the time (report time) when the operator of the report receiving device 4 received a report about the occurrence of an abnormal event, and audio data of the conversation between the operator of the report receiving device 4 and the reporter. Accordingly, the terminal device 3 identifies the occurrence location by analyzing the audio data included in the first information. In this embodiment, the occurrence location is information indicating the location of the location where the abnormal event is estimated to have occurred. For example, the occurrence location may be the latitude and longitude of the location where the abnormal event is estimated to have occurred. As another example, the occurrence location may be the address of the location where the abnormal event is estimated to have occurred. Once the occurrence location is identified in this manner, the terminal device 3 transmits a request signal (hereinafter, sometimes referred to as a "first request signal") to the server device 2, requesting a vehicle list. In this embodiment, the first request signal includes information specifying a predetermined period (for example, a period from three minutes before to three minutes after the reporting time) and information specifying a predetermined range (for example, an area within 100 meters of the point of occurrence).

[0023] The terminal device 3 in this embodiment also has a function of outputting a first map screen in response to receiving the vehicle list transmitted from the server device 2. The first map screen is a user interface screen in which the location of the occurrence and the positions of the vehicles 10 included in the vehicle list are mapped on a map of a predetermined range. Details of the first map screen will be described later. Furthermore, the terminal device 3 in this embodiment also has a function of accepting an operator's selection operation of a vehicle 10 on the first map screen and transmitting a request signal (hereinafter sometimes referred to as a "second request signal") requesting in-vehicle video of the selected vehicle 10 to the server device 2. The second request signal in this embodiment includes information identifying the selected vehicle 10 and information identifying the date and time when the selected vehicle 10 captured the in-vehicle video. When the in-vehicle video is provided from the server device 2 to the terminal device 3 in response to the second request signal, the terminal device 3 plays back the provided in-vehicle video.

[0024] The terminal device 3 described above is disposed in a predetermined administrative agency. In this embodiment, the predetermined administrative agency is an agency that receives reports of abnormal events and dispatches staff to the scene of the abnormal event. Abnormal events include crimes and accidents. The predetermined administrative agency may be, for example, a police agency. In this case, the terminal device 3 can output the first map screen in response to a call to emergency services (110) and can acquire and play back on-board video of the vehicle 10 selected by the operator. This allows the operator of the police agency to grasp the situation at the scene of the abnormal event. In another example, the predetermined administrative agency may be a fire department. In this case, the terminal device 3 can output the first map screen in response to a call to emergency services (110) and can acquire and play back on-board video of the vehicle 10 selected by the operator. This allows the operator of the fire department to grasp the situation at the scene of the abnormal event.

[0025] Next, the notification receiving device 4 receives a notification regarding the occurrence of an abnormal event and transmits the first information to the terminal device. The report receiving device 4 is a computer having a function of transmitting the first information including the recorded report time and the audio data of the recorded conversation to the terminal device 3. Specifically, in response to receiving a report by telephone from the caller, the report receiving device 4 records the time when the report was received (report time) and also records the conversation (call) between the operator and the caller. Then, triggered by the end of the call between the operator and the caller, the report receiving device 4 transmits the first information including the recorded report time and the audio data of the recorded conversation to the terminal device 3.

[0026] The above-described report reception device 4 is placed in a predetermined administrative agency, similar to the terminal device 3. However, the report reception device 4 may be placed in a department that has jurisdiction over the entire area of ​​a prefecture or the like, and the terminal device 3 may be placed in a department that has jurisdiction over each region within the prefecture. In this case, an operator may input an operation to the report reception device 4 to designate the department that has jurisdiction over the site where the abnormal event occurred. Then, the report reception device 4 may transmit the first information to the terminal device 3 that is placed in the designated department.

[0027] (Monitoring system configuration) Next, the configuration of the monitoring system will be described with reference to Fig. 2. Fig. 2 is a diagram schematically showing an example of the configuration of the monitoring system.

[0028] The in-vehicle device 1 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.). The auxiliary memory device stores an operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions (software modules) that match predetermined purposes, as described below, can be realized. However, some or all of the functions may be realized by hardware circuits such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0029] As shown in FIG. 2, the in-vehicle device 1 in this embodiment includes a control unit 11, a storage unit 12, a communication I / F 13, a position acquisition unit 14, and a camera 15.

[0030] The control unit 11 is a computing unit that executes predetermined programs to realize various functions of the in-vehicle device 1. The control unit 11 can be realized by, for example, a hardware processor such as a CPU. The control unit 11 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0031] The storage unit 12 is a means for storing information, and is configured with a storage medium such as a RAM, a magnetic disk, or a flash memory. The storage unit 12 stores programs executed by the control unit 11, data used by the programs, etc. The storage unit 12 in this embodiment also stores data of in-vehicle images captured by the camera 15 (in-vehicle image data).

[0032] The communication I / F 13 is a wireless communication interface for connecting the in-vehicle device 1 to the network N1. The communication I / F 13 connects to the network N1 via, for example, a wireless LAN or a cellular communication network (e.g., 3G, 4G, or 5G), and communicates with the server device 2 through the network N1. The network N1 may be, for example, a wide area network (WAN), which is a global public communication network such as the Internet, or another communication network.

[0033] The position acquisition unit 14 acquires position information of the vehicle 10. The position acquisition unit 14 includes a GPS antenna and a positioning module for determining the position information. The GPS antenna is an antenna that receives positioning signals transmitted from positioning satellites (also called GNSS satellites). The positioning module is a module that calculates position information based on the signals received by the GPS antenna. The position acquisition unit 14 may determine the traveling direction of the vehicle 10 based on the transition of the position information.

[0034] The camera 15 is an optical unit including an image sensor for acquiring images, and is mounted, for example, facing forward of the vehicle 10.

[0035] In the in-vehicle device 1 configured as described above, the control unit 11 uses the camera 15 to capture video (in-vehicle video) while the vehicle 10 is traveling and / or parked, and stores the obtained in-vehicle video data in the storage unit 12. The in-vehicle video data includes a plurality of in-vehicle video files. In this embodiment, each in-vehicle video file is associated with an identifier (date and time ID) for identifying the date and time when the in-vehicle video file was created (i.e., the date and time when the in-vehicle video was captured). The date and time ID may uniquely identify the year, month, day, hour, minute, and second. By operating the control unit 11 in this manner, the in-vehicle device 1 functions as a drive recorder.

[0036] Furthermore, in the in-vehicle device 1, the control unit 11 periodically generates data related to the traveling of the vehicle 10 (hereinafter, sometimes referred to as "vehicle data") and transmits it to the server device 2. As shown in (A31) in FIG. 3 , the vehicle data may include, for example, a vehicle ID that uniquely identifies the vehicle 10, a date and time ID that identifies the date and time when the location information of the vehicle 10 was acquired, the date and time when the location information of the vehicle 10 was acquired, the location information of the vehicle 10, and the traveling direction of the vehicle 10. The location information and traveling direction included in the vehicle data are acquired by the control unit 11 via the location acquisition unit 14. The generation and transmission of the vehicle data are performed at a predetermined cycle. For example, the predetermined cycle may be a timing linked to the generation of an in-vehicle video file. In other words, the control unit 11 may generate and transmit the vehicle data each time a new in-vehicle video file is generated. In this case, the date and time included in the vehicle data (the date and time when the location information of the vehicle 10 was acquired) will be the same as the date and time when the new in-vehicle video file was generated (the date and time when the in-vehicle video was captured).

[0037] Furthermore, in the in-vehicle device 1, the control unit 11 transmits the in-vehicle video file to the server device 2 in response to a third request signal (described later) transmitted from the server device 2. Specifically, the control unit 11 accesses the in-vehicle video data in the storage unit 12 using the date and time ID included in the third request signal as an argument, and extracts a video file associated with a date and time ID that matches the date and time ID. The control unit 11 transmits the extracted in-vehicle video file to the server device 2 via the communication I / F 13.

[0038] Next, we will explain the server device 2. Similar to the in-vehicle device 1, the server device 2 can be configured as a computer having a processor (CPU, GPU, etc.), a main storage device (RAM, ROM, etc.), and an auxiliary storage device (EPROM, hard disk drive, removable media, etc.).

[0039] As shown in FIG. 2, the server device 2 in this embodiment includes a control unit 21, a storage unit 22, and a communication I / F 23.

[0040] The control unit 21 is a computing unit that executes predetermined programs to realize various functions of the server device 2. The control unit 21 can be realized by, for example, a hardware processor such as a CPU. The control unit 21 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0041] The storage unit 22 is a means for storing information, and is configured with a storage medium such as a RAM, a magnetic disk, or a flash memory. The storage unit 22 stores programs executed by the control unit 21, data used by the programs, and the like. The storage unit 22 in this embodiment is The monitoring system also stores a table (hereinafter, sometimes referred to as a "vehicle data table") in which vehicle data transmitted from each of the multiple vehicles 10 under the control of the monitoring system is registered.

[0042] The communication I / F 23 is a communication interface for connecting the server device 2 to the network N1. The communication I / F 23 is connected to the network N1 via, for example, Ethernet (registered trademark), a wireless LAN, or a cellular communication network, and communicates with the in-vehicle device 1 and the terminal device 3 through the network N1.

[0043] In the server device 2 configured as described above, the control unit 21 periodically receives vehicle data from each of the plurality of vehicles 10 (on-vehicle devices 1) under the control of the monitoring system, and stores the vehicle data in a vehicle data table in the storage unit 22. In this case, the vehicle data table may be, for example, a table that stores a plurality of pieces of vehicle data received from the plurality of vehicles 10 by record, as shown in (A32) in Fig. 3 .

[0044] Furthermore, in the server device 2, the control unit 21 provides information to the terminal device 3 based on the information stored in the vehicle-specific record in the storage unit 22. The information provided from the server device 2 to the terminal device 3 includes providing a vehicle list and providing an in-vehicle video file.

[0045] The vehicle list is provided in response to the communication I / F 23 receiving a first request signal transmitted from the terminal device 3. Specifically, the control unit 21 compares the predetermined period included in the first request signal with the date and time registered in the date and time field of each record in the vehicle data table to identify records in which the date and time registered in the date and time field falls within the predetermined period. Next, the control unit 21 compares the location information registered in the location information field of the identified record with the predetermined range included in the first request signal to extract records in which the location information registered in the location information field falls within the predetermined range. Then, the control unit 21 generates a list (vehicle list) of vehicles 10 that have traveled within the predetermined range within the predetermined period, based on the extracted records. In one example, the vehicle list may be a list of records extracted from the vehicle data table, as shown in (A33) in FIG. 3. Note that the records included in the vehicle list may include the same vehicle 10. For example, the same vehicle 10 may transmit vehicle data multiple times within the predetermined range within the predetermined period. In this case, multiple records with the same vehicle ID may be included in the vehicle list. The vehicle list generated in this manner is transmitted to the terminal device 3 via the communication I / F 23.

[0046] The provision of the in-vehicle video file is executed in response to the communication I / F 23 receiving a second request signal transmitted from the terminal device 3. In this embodiment, the second request signal includes a vehicle ID that identifies the vehicle 10 selected by the operator of the terminal device 3 and a date and time ID that identifies the date and time when the location information of the vehicle 10 selected by the operator of the terminal device 3 was acquired (the date and time when the in-vehicle video file was generated). When the communication I / F 23 of the server device 2 receives such a second request signal, the control unit 21 transmits a request signal (third request signal) to the in-vehicle device 1 of the vehicle 10 corresponding to the vehicle ID included in the second request signal, requesting the provision of the in-vehicle video file corresponding to the date and time ID included in the second request signal. Then, when the communication I / F 23 receives the in-vehicle video file transmitted from the in-vehicle device 1 in response to the third request signal, the control unit 21 transmits the received in-vehicle video file to the terminal device 3.

[0047] Next, we will explain the terminal device 3. Like the in-vehicle device 1 and the server device 2, the terminal device 3 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0048] As shown in FIG. 2, the terminal device 3 in this embodiment includes a control unit 31, a storage unit 32, a communication I / F 33, and an input / output unit .

[0049] The control unit 31 is a computing unit that executes predetermined programs to realize various functions of the terminal device 3. The control unit 31 can be realized by a hardware processor such as a CPU. The control unit 31 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0050] The storage unit 32 is a means for storing information and is configured with a storage medium such as a RAM, a magnetic disk, or a flash memory. The storage unit 32 stores programs executed by the control unit 31, data used by the programs, and the like. The programs stored in the storage unit 32 include application programs that correspond to the "programs" according to the present disclosure. The storage unit 32 in this embodiment also stores language models. Details of the language models stored in the storage unit 32 will be described later.

[0051] The communication I / F 33 is a communication interface for connecting the terminal device 3 to the network N1. The communication I / F 33 is connected to the network N1 via, for example, Ethernet (registered trademark), a wireless LAN, or a cellular communication network, and communicates with the server device 2 and the report receiving device 4 through the network N1.

[0052] The input / output unit 34 is a unit that receives input from an operator of the terminal device 3 and presents information to the operator. Specifically, the input / output unit 34 is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are combined into a single touch panel display. Note that the input / output unit 34 may include input devices such as a keyboard and a mouse in addition to the touch panel display.

[0053] In the terminal device 3 configured as described above, the control unit 31 transmits a first request signal to the server device 2 in response to the communication I / F 33 receiving first information transmitted from the report receiving device 4 (described later). Specifically, the control unit 31 first identifies the location of the occurrence in response to the first information. As shown in (A41) in FIG. 4, the first information in this embodiment includes the time (report time) at which the operator of the report receiving device 4 received a report regarding the occurrence of an abnormal event, and audio data of the conversation between the operator of the report receiving device 4 and the reporter. As shown in (A42)-(A44) in FIG. 4, the control unit 31 analyzes the audio data ((A42) in FIG. 3) included in the first information using a language model ((A43) in FIG. 4) stored in the storage unit 32, thereby identifying the location of the occurrence ((A44) in FIG. 4). The location of the occurrence is a location (position) estimated to be the site where the abnormal event occurred. In one example, the language model may be a language model trained by the speech generated when a government agency receives a report, and may take speech data as input and the geographic coordinates (latitude and longitude) or address of the point of origin as output.

[0054] Instead of voice data, the first information may include text data obtained by performing voice recognition on the conversation between the operator of the report receiving device 4 and the caller. In this case, the control unit 31 of the terminal device 3 may identify the point of occurrence based on the address or the name of a landmark included in the text data.

[0055] When the point of occurrence is identified as described above, the control unit 31 of the terminal device 3 generates a first request signal and transmits the generated first request signal to the server device 2. In this embodiment, the first request signal includes information specifying a predetermined period (for example, a period from three minutes before to three minutes after the notification time included in the first information) and a predetermined range (for example, a range from 10 minutes before to 12 minutes after the notification time included in the first information). Contains information specifying the area within 0 meters.

[0056] Furthermore, in the terminal device 3, in response to the communication I / F 33 receiving the vehicle list transmitted from the server device 2 in response to the first request signal, the control unit 31 outputs a first map screen to the input / output unit 34. The first map screen is a user interface (GUI) for requesting acquisition of in-vehicle video, and includes an image of a road map within the aforementioned predetermined range, an icon representing the position of the vehicle 10 included in the vehicle list acquired from the server device 2, and an image mapping the occurrence point identified above.

[0057] As shown in (A51) in FIG. 5, the first map screen, for example, includes a road map image (501 in FIG. 5) within a predetermined range, a GUI component (502 in FIG. 5) indicating the time of notification, and a GUI component (503 in FIG. 5) indicating a predetermined period. Furthermore, icons (IC1-IC7 in FIG. 5) indicating the location of the vehicle 10 included in the vehicle list and the point of occurrence (P1 in FIG. 5) are mapped onto the road map image (501 in FIG. 5) within the predetermined range. The icons (IC1-IC7 in FIG. 5) for the vehicle 10 are generated for each record in the vehicle list. That is, the same vehicle 10 may be displayed by two or more icons. However, since the differences between the vehicles are not important to the operator, information for identifying the vehicle need not be displayed on the screen. The icons (IC1-IC7 in FIG. 5) for the vehicle 10 may be configured to enable the traveling direction of the vehicle 10 to be identified.

[0058] Furthermore, when the operator of the terminal device 3 selects any one icon while the first map screen is being output to the input / output unit 34, the control unit 31 outputs a second map screen to the input / output unit 34 instead of the first map screen. As shown in (A52) in FIG. 5, for example, the second map screen includes, in addition to a road map image within a predetermined range (501 in FIG. 5), a GUI component indicating the notification time (502 in FIG. 5), and a GUI component indicating a predetermined period (503 in FIG. 5), a GUI component (504 in FIG. 5) indicating the time (shooting time) at which in-vehicle video was captured in the vehicle 10 corresponding to the icon selected on the first map screen (icon (IC1) is selected in the example shown in (A52) in FIG. 5), and a GUI component (505 in FIG. 5) indicating a video playback start button for requesting the start of playback of in-vehicle video captured in the vehicle 10 corresponding to the icon selected on the first map screen. The shooting time displayed in the GUI component (504 in FIG. 5) may be the time registered in the date and time field of the record corresponding to the icon (IC1 in FIG. 5) in the record included in the vehicle list.

[0059] Furthermore, when the operator of the terminal device 3 inputs an operation to press (for example, tap or click) the video playback start button (505 in FIG. 5) into the input / output unit 34 while the second map screen is being output to the input / output unit 34, the control unit 31 of the terminal device 3 generates a second request signal and transmits the generated second request signal to the server device 2. In this case, the second request signal includes the vehicle ID registered in the vehicle ID field of the record corresponding to the icon (IC1 in FIG. 5) and the date and time ID registered in the date and time ID field of the record.

[0060] In addition, the second map screen of this embodiment is provided with a video playback start button (505 in Figure 5), as illustrated in (A52) in Figure 5, but the second request signal may be generated and transmitted in response to the selected icon (IC1 in Figure 5) being tapped or clicked again.

[0061] Furthermore, when the communication I / F 33 receives the in-vehicle video file transmitted from the server device 2 in response to the second request signal, the control unit 31 of the terminal device 3 plays back the received in-vehicle video file.

[0062] 2, the report receiving device 4 will now be described. Similar to the in-vehicle device 1, the server device 2, and the terminal device 3, the report receiving device 4 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0063] As shown in FIG. 2, the report receiving device 4 in this embodiment includes a control unit 41, a storage unit 42, a communication I / F 43, and an input / output unit 44.

[0064] The control unit 41 is a calculation unit that executes a predetermined program to realize various functions of the report receiving device 4. The control unit 41 can be realized by a hardware processor such as a CPU. The control unit 41 may also be configured to include a RAM, a ROM (Read Only Memory), a cache memory, etc.

[0065] The storage unit 42 is a means for storing information and is configured with a storage medium such as a RAM, a magnetic disk, or a flash memory. The storage unit 42 stores programs executed by the control unit 41, data used by the programs, etc. The storage unit 42 in this embodiment stores voice data of a conversation between a reporter regarding the occurrence of an abnormal event and an operator of the report receiving device 4.

[0066] The communication I / F 43 is a communication interface for connecting the report receiving device 4 to the network N1. The communication I / F 43 connects to the network N1 via, for example, Ethernet (registered trademark), a wireless LAN, or a cellular communication network, and communicates with the terminal device 3 through the network N1. The communication I / F 43 in this embodiment also includes a communication interface for connecting to a telephone communication network. The communication I / F 43 communicates (voice calls) with the caller's terminal (such as a landline or mobile phone) via the telephone network.

[0067] The input / output unit 44 is a unit that receives input from the operator of the report receiving device 4 and presents information to the operator. Specifically, the input / output unit 44 is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are combined into one touch panel display. Note that the input / output unit 44 may include input devices such as a keyboard and a mouse in addition to the touch panel display.

[0068] In the report receiving device 4 configured as described above, in response to the communication I / F 43 receiving a report from the reporter, the control unit 41 records the time at which the report was received (report time) in the storage unit 42. Furthermore, the control unit 41 records the conversation (call) between the operator of the report receiving device 4 and the reporter, and stores the conversation in the storage unit 42. Then, when the call between the operator and the reporter ends, the control unit 41 transmits first information including the recorded voice data and the report time to the terminal device 3. Note that if the monitoring system includes multiple terminal devices 3, the control unit 41 may transmit the first information to the terminal device 3 designated by the operator (the terminal device 3 located in the department that has jurisdiction over the site where the abnormal event occurred).

[0069] (Processing flow) Here, the flow of processing executed by the terminal device 3 in this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of a processing routine executed by the terminal device 3 when the terminal device 3 is triggered by receiving the first information transmitted from the report receiving device 4.

[0070] 6, when the communication I / F 33 of the terminal device 3 receives the first information transmitted from the notification receiving device 4, the control unit 31 of the terminal device 3 acquires the first information through the communication I / F 33. After completing the process of step S101, the control unit 31 performs the process of step S102. Execute.

[0071] In step S102, as described above in the description of Fig. 4, the control unit 31 identifies the point of origin using the voice data included in the first information and the language model stored in the storage unit 32. After completing the processing of step S102, the control unit 31 executes the processing of step S103.

[0072] In step S103, control unit 31 generates a first request signal according to the reporting time included in the first information and the occurrence point identified in step S102, and transmits the generated first request signal to server device 2. As described above, the first request signal includes information specifying a predetermined period including the reporting time (for example, a period from three minutes before to three minutes after the reporting time included in the first information) and information specifying a predetermined range including the occurrence point (for example, an area within 100 meters of the occurrence point). After completing the process of step S103, control unit 31 executes the process of step S104.

[0073] In step S104, the control unit 31 receives the vehicle list transmitted from the server device 2 in response to the first request signal via the communication I / F 33. As described above, the vehicle list is a list of vehicles 10 that have a history of traveling within a predetermined range within a predetermined period of time. After completing the process of step S104, the control unit 31 executes the process of step S105.

[0074] In step S105, the control unit 31 generates a first map screen in accordance with the vehicle list received in step S104, and outputs the generated first map screen to the input / output unit 34. As described above in the explanation of FIG. 5 ((A51) in FIG. 5), the first map screen includes a road map image (501 in FIG. 5) within a predetermined range, a GUI component (502 in FIG. 5) indicating the time of notification, and a GUI component (503 in FIG. 5) indicating a predetermined period. At this time, icons (IC1-IC7 in FIG. 5) indicating the positions of vehicles 10 included in the vehicle list and the point of occurrence (P1 in FIG. 5) are mapped onto the road map image (501 in FIG. 5). After completing the processing of step S105, the control unit 31 executes the processing of step S106.

[0075] In step S106, the control unit 31 determines whether the operator of the terminal device 3 has input to the input / output unit 34 an operation (for example, a tap or a click) to select one of the icons (IC1-IC7 in FIG. 5) on the first map screen. If the operation to select one of the icons (IC1-IC7 in FIG. 5) on the first map screen has not been input to the input / output unit 34 (negative determination in step S106), the control unit 31 waits until the operation is input. On the other hand, if the operation to select one of the icons (IC1-IC7 in FIG. 5) on the first map screen has been input to the input / output unit 34 (positive determination in step S106), the control unit 31 executes the process of step S107.

[0076] In step S107, the control unit 31 generates a second map screen in accordance with the icon (IC1-IC7 in FIG. 5) selected in step S106, and outputs the generated second map screen to the input / output unit 34. As described above in the description of FIG. 5 ((A52) in FIG. 5), the second map screen includes a road map image within a predetermined range (501 in FIG. 5), a GUI component (502 in FIG. 5) indicating the notification time, a GUI component (503 in FIG. 5) indicating a predetermined period, a GUI component (504 in FIG. 5) indicating the time (shooting time) when in-vehicle video was captured in the vehicle 10 corresponding to the icon selected on the first map screen, and a GUI component (505 in FIG. 5) indicating a video playback start button for requesting the start of playback of in-vehicle video captured in the vehicle 10 corresponding to the icon selected on the first map screen. After completing the process of step S107, the control unit 31 executes the process of step S108.

[0077] In step S108, the control unit 31 determines whether a request to play back the in-vehicle video corresponding to the icon selected in step S106 has been input to the input / output unit 34. In one example, the control unit 31 determines whether an operation to press a video playback start button on the second map screen has been input to the input / output unit 34. If a request to play back the in-vehicle video corresponding to the icon selected in step S106 has not been input to the input / output unit 34 (negative determination in step S108), the control unit 31 executes the process of step S106 again. At that time, if the operator reselects an icon different from the previous icon, the control unit 31 changes the shooting time (504 in FIG. 5) displayed on the second map screen to the shooting time corresponding to the newly selected icon. Furthermore, if a request to play back the in-vehicle video corresponding to the icon selected in step S106 has been input to the input / output unit 34 (positive determination in step S108), the control unit 31 executes the process of step S109.

[0078] In step S109, the control unit 31 generates a second request signal in accordance with the icon selected in step S106, and transmits the generated second request signal to the server device 2. The second request signal at this time includes the vehicle ID registered in the vehicle ID field of the record corresponding to the icon selected in step S106, among the records included in the vehicle list received in step S104, and the date and time ID registered in the date and time ID field of that record. After completing the process of step S109, the control unit 31 executes the process of step S110.

[0079] In step S110, the control unit 31 receives the in-vehicle video file transmitted from the server device 2 in response to the second request signal via the communication I / F 33. After completing the process of step S110, the control unit 31 executes the process of step S111.

[0080] In step S111, the control unit 31 plays the in-vehicle video file received in step S110. The played in-vehicle video file may be output via the input / output unit 34. After completing the process of step S111, the control unit 31 ends the execution of the processing routine of FIG. 6.

[0081] According to the embodiment described above, the terminal device 3 can identify the occurrence point and display the first map screen when it receives the first information. This allows the operator of the terminal device 3 to quickly grasp the positional relationship between the occurrence point and the vehicle 10 that was traveling near the occurrence point (within a predetermined range) within a predetermined period including the time of the report. As a result, the operator can easily identify the vehicle 10 that is likely to have captured the occurrence point. Then, by selecting the icon of the identified vehicle 10, the operator can check the on-board video that may have captured the scene where the abnormal event occurred.

[0082] Therefore, according to this embodiment, it is possible to reduce the effort and time required to check in-vehicle video that may capture the scene of an abnormal event, thereby improving convenience for operators who use the surveillance system.

[0083] (others) The above-described embodiment is merely an example, and the present disclosure may be modified and implemented as appropriate within the scope of the present disclosure. For example, the processes and means described in the present disclosure may be freely combined and implemented as long as no technical contradictions arise. Furthermore, although the embodiment illustrates a vehicle equipped with an on-board device, a moving object other than a vehicle may be used as long as it is capable of capturing video.

[0084] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be shared and executed by a single device. Alternatively, the first map screen may be generated by the server device 2. For example, in the above embodiment, the terminal device 3 generates the first map screen based on the vehicle list received from the server device 2 and displays the generated first map screen on the input / output unit 24. However, the first map screen may be generated by the server device 2. That is, instead of the server device 2 generating the vehicle list and transmitting it to the terminal device 3, the server device 2 may draw a road map image within a predetermined range, map icons indicating the positions of the vehicles 10 included in the vehicle list, and map the generation point. In this case, the first map screen generated by the server device 2 may be transmitted to the terminal device 3, and the terminal device 3 may output it. That is, the functions of the terminal device 3 described in the embodiment may be provided in the server device 2. In this way, the information processing device according to the present disclosure can be realized as the server device 2 or as the terminal device 3. In a computer system, the hardware configuration for realizing each function can be flexibly changed.

[0085] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0086] 1. In-vehicle device, 10. Vehicle, 2. Server device, 3. Terminal device, 31. Control unit, 32. Storage unit, 33. Communication I / F, 4. Report receiving device

Claims

1. Displaying a plurality of icons on a map indicating the positions of each vehicle at a plurality of times based on the travel history of the one or more vehicles; When one of the plurality of icons is selected, transmitting a command to a vehicle corresponding to the selected icon to transmit an image captured at a time corresponding to the selected icon; a control unit that executes the The control unit acquiring first information regarding the report from a predetermined administrative agency that has received a report regarding the occurrence of an abnormal event; displaying on the map a location where the abnormal event is estimated to have occurred based on the first information; To execute Information processing device.

2. the first information includes audio data of a conversation between the reporter and the predetermined administrative agency; the control unit analyzes the voice data using a predetermined language model to identify a location where the abnormal event is estimated to have occurred. The information processing device according to claim 1 .

3. the predetermined language model is a language model trained by the speech when the predetermined administrative agency receives the report; The information processing device according to claim 2 .

4. Displaying a plurality of icons on a map indicating the positions of each vehicle at a plurality of times based on the travel history of the one or more vehicles; When one of the plurality of icons is selected, transmitting a command to a vehicle corresponding to the selected icon to transmit an image captured at the corresponding time; An information processing method executed by a computer, The computer acquiring first information regarding the report from a predetermined administrative agency that has received a report regarding the occurrence of an abnormal event; displaying on the map a location where the abnormal event is estimated to have occurred based on the first information; To execute Information processing methods.

5. Displaying a plurality of icons on a map indicating the positions of each vehicle at a plurality of times based on the travel history of the one or more vehicles; When one of the plurality of icons is selected, transmitting a command to a vehicle corresponding to the selected icon to transmit an image captured at the corresponding time; A program for causing a computer to execute the above, acquiring first information regarding the report from a predetermined administrative agency that has received a report regarding the occurrence of an abnormal event; displaying on the map a location where the abnormal event is estimated to have occurred based on the first information; to cause the computer to execute program.

Images