Information processing device, information processing method, and program

Abstract

To solve a problem in which data acquired by a camera or the like mounted on a mobile body cannot be effectively utilized.SOLUTION: A server 1 includes: a multi-modal DB 61 that stores traveling data (first type data) of a vehicle indicating a state of travelling of the vehicle and a second type data (for example, accident occurrence in a rain at a curvature radius of 10 m) indicating one or more kinds of context information for the vehicle, associated with a plurality of positions in the route of the travelling, respectively, in association with each other; a retrieval condition acquisition unit 51; and an extraction unit 52. The retrieval condition acquisition unit 51 acquires as a retrieval condition at least one or more kinds of the plurality of pieces of context information (for example, topographic data, meteorological data, geographical map data, accident data, etc.). The extraction unit 52 extracts a position associated with the second type data associated with the one or more kinds of context information as the retrieval condition from the multi-modal DB 61.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, for example, businesses related to moving objects such as vehicles have developed advanced driving assistance systems, automatic driving systems, drive recorders, and the like (for example, see Patent Document 1). The above-mentioned businesses repeatedly conduct driving tests on actual roads during and after product development, and therefore possess a huge amount of driving data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-193577 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, although operators possess a huge amount of driving data, the current situation is that it cannot be said that they are able to effectively utilize that vast amount of driving data.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a service that enables effective use of stored driving data. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to one aspect of the present invention comprises: An information processing device that communicates with a predetermined database in which a first type of data showing a state of movement of a moving object and a second type of data showing one or more types of context information of the moving object or its operator, each of which is associated with a plurality of positions on the path of the movement, are stored in association with each other, A search condition acquisition means for acquiring at least one type of multiple pieces of context information including a location as a search condition; an extraction means for extracting, as a search position, a position associated with second type data corresponding to one or more types of the context information as the search condition from the predetermined database; Equipped with.

[0007] An information processing method and a program according to one aspect of the present invention are each an information processing method and a program corresponding to the information processing device according to the aspect of the present invention described above. Effect of the Invention

[0008] According to the present invention, it is possible to provide a service that enables effective use of stored driving data. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an overview of a service that can be realized by an information processing system to which a server according to an embodiment of the information processing device of the present invention is applied. [Diagram 2] FIG. 2 is a diagram showing a system configuration of an information processing system that realizes the present service of FIG. [Diagram 3] 3 is a diagram illustrating an example of a hardware configuration of a server in the information processing system of FIG. 2 according to an embodiment of the information processing device of the present invention. [Figure 4] 4 is a functional block diagram showing an example of a functional configuration of a server having the hardware configuration of FIG. 3. [Diagram 5] FIG. 5 is a diagram showing an example of a screen of a location search function of a server having the functional configuration of FIG. [Figure 6]FIG. 6 is a diagram showing a screen transitioned from the screen in FIG. 5 by executing a position search. [Figure 7] FIG. 7 is a diagram showing an example of a screen showing the results of a search performed using the conditions specified on the screen of FIG. 6. [Figure 8] FIG. 8 is a diagram showing an enlarged view of the screen in FIG. 7. [Figure 9] FIG. 9 is a diagram showing a screen that is displayed when a thumbnail image in FIG. 8 is clicked. [Figure 10] FIG. 10 is a diagram showing a screen that is displayed when a thumbnail image in FIG. 9 is clicked. [Figure 11] FIG. 11 is a diagram showing a screen that is displayed when a full-screen display button on the screen of FIG. 10 is clicked. [Figure 12] FIG. 11 is a diagram showing a screen that is displayed when a jump to the location of occurrence button on the screen of FIG. 10 is clicked. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, with reference to FIG. 1, an overview of a service (hereinafter, referred to as "this service") that can be realized by an information processing system to which a server according to an embodiment of the present invention is applied will be described.

[0011] FIG. 1 is a diagram showing an overview of the present service that can be realized by an information processing system to which a server according to an embodiment of the information processing device of the present invention is applied.

[0012] This service provides a location search service by utilizing a multimodal DB 61 which stores driving data (video images such as road footage: Type 1 data) that continuously (chronologically) records the movement of a moving object, for example, from a vehicle and a drive recorder attached to the vehicle, or a drone and a camera mounted on the drone, and one or more types of context information of the moving object or its driver that is associated with multiple positions (longitude, latitude, altitude, etc. obtained from a GPS system) on the route of the movement (e.g., situation data indicating that the road curvature radius is 10 m, the weather is rain, the occurrence of an accident, etc.: Type 2 data).

[0013] In this embodiment, the context information (second type of data) includes at least one type of context information from among accident data B1, telematics data (hereinafter referred to as "telematics") B2, map data B3, moving object status B4, weather data B5, topographical data B6, vital signs data B7, drive monitor data (hereinafter referred to as "drum monitor") B8, and people flow data B9. Here, "context information" refers to information that indicates at least one of the internal and external states of a moving object or an operator of the moving object. In other words, one piece of context information is information that indicates at least one of the "internal state" and "external state" of a moving object or an operator. The "internal state" of a moving body refers to the internal situation of the moving body (hereinafter referred to as the "moving body status") acquired by an information processing device equipped in the moving body, or the state of the body of the moving body obtained from an external information processing device, etc. Specifically, the moving body status B4 is CAN data or the like. CAN is an abbreviation for Controller Area Network, a serial communication protocol developed by Bosch of Germany, and has been used in recent years for data communication between a vehicle's ECU and each instrument. This CAN data is an example of data indicating the "internal state" of a moving body. In addition, among the moving body accident data B1, imaging data including the moving body's accident location photographed by a camera or the like as a subject is an example of data indicating the "internal state" of a moving body, such as the state of the moving body's body, obtained from an external information processing device. The "internal state" of the operator refers to the internal state of the operator, which is indicated by various information obtained by subjecting the operator to sensing. The information indicating the "internal state" of the operator includes, for example, information indicating the physical characteristics of the operator, such as height, weight, body temperature, pulse, body fat percentage, body type, fingerprint, voiceprint, and age, obtained by measurement, investigation, etc. In addition, information indicating the internal state of the operator includes information such as the operator's physical condition and emotions, and the operator's behavior history, etc. For example, the vital data B7 of the operator is an example of the "internal state" of the operator. In addition, for example, the facial expression of the operator reflected on the operator's drum monitor B8 (emotions inferred from the facial expression, etc.) is also an example of the "internal state" of the operator. Furthermore, the "external state" of a moving object or an operator refers to the state outside the moving object or the operator, which is indicated by various information indicating the environment surrounding the moving object or the operator. Information indicating the "external state" includes, for example, information on the history and forecast of weather (weather, temperature, humidity, etc.), room temperature, etc., in a place where the moving object or the operator has been in the past, is currently in, or may be in the future. Information indicating the external state also includes information indicating the spatial or temporal location of the moving object or the operator, information indicating a predetermined state distributed in at least one of the spatial and temporal directions around the moving object or the operator, etc. In this specification, "time" is not limited to the original concept of "width," but also includes "time of day" and "timing" as concepts indicating "that time." Therefore, "data indicating a position of a temporal arrangement" includes, for example, a time at a specific timing in the past, the current time, etc. For example, among the accident data B1, data other than data indicating the internal state of the moving body or the operator, specifically, for example, imaging data showing the state of the surroundings of the moving body, such as the utility pole that the moving body collided with, and data such as the location and time of the accident, are examples of data indicating the "external state". Further, the contents of the telematics B2, the map data B3, the weather data B5, the topographical data B6, the people flow data B9, etc. are also examples of data indicating the "external conditions".

[0014] Specifically, in this service, the service provider obtains at least one or more types of second-type data (for example, second-type data such as the radius of curvature of the road is 10 m, the weather is rainy, and an accident occurs, etc.) among a plurality of context information as search conditions. Then, the service provider searches the multimodal DB61 based on the obtained search conditions, extracts the location (position on the map such as longitude, latitude, altitude, etc.) associated with the second-type data corresponding (matching or similar) to one or more types of context information from the multimodal DB61, and displays the extracted location on the map with an icon or the like and provides it to the user U.

[0015] As described above, according to this service, the following effects can be achieved. Conventionally, for companies developing advanced driving assistance systems, autonomous driving systems, and dashcams, and companies collecting data by imaging various locations evenly with drones or the like for terrain measurement and surveying, and further for companies such as insurance companies analyzing events for shooting data, etc., in order to confirm where the data was obtained or how much data of the location where the event occurred is held, it was necessary to confirm while collating both the obtained data and the map. For this reason, a great deal of effort was required to identify duplicates of data obtained at the same location, locations where data acquisition omissions occurred, locations where events and accidents frequently occurred, etc. In this service, by using the multimodal DB61 constructed by associating first-type data such as driving data and second-type data indicating one or more types of context information of the moving body or its driver respectively associated with a plurality of positions (longitude, latitude, altitude) during the moving route, at least one or more types of second-type data are obtained as search conditions, and locations (positions on the map) that match or are similar to the search conditions are provided to the user U. Therefore, for example, locations and places in an environment with the same conditions or similar to the place where an accident occurred in the past can be identified without going to the scene, and the company can significantly reduce the labor of traveling to the site. As a result, a service that can effectively utilize driving data can be provided.

[0016] Next, with reference to FIG. 2, a description will be given of the configuration of an information processing system that realizes the provision of the above-mentioned service, that is, an information processing system to which a server according to an embodiment of an information processing device of the present invention is applied. FIG. 2 is a diagram showing an example of the configuration of an information processing system to which the present service of FIG. 1 is applied, that is, an information processing system to which a server according to an embodiment of an information processing device of the present invention is applied.

[0017] The information processing system shown in FIG. The server 1 and the user terminal 2 are connected to each other so as to be able to communicate with each other via a predetermined network such as the Internet.

[0018] The server 1 is an information processing device managed by a service provider. The server 1 executes various processes for realizing the present service while appropriately communicating with a user terminal 2.

[0019] The user terminal 2 is an information processing device operated by a user U. The user terminal 2 is configured with a personal computer, a tablet, a smartphone, or the like. The user terminal 2, for example, accepts input operations of various information by the user U and transmits the information to the server 1, and receives and displays various information transmitted from the server 1.

[0020] FIG. 3 is a block diagram showing an example of a hardware configuration of a server in the information processing system shown in FIG.

[0021] The server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an input unit 16, an output unit 17, a memory unit 18, a communication unit 19, and a drive 20.

[0022] The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 into the RAM 13 . The RAM 13 also stores data and the like necessary for the CPU 11 to execute various processes.

[0023] The CPU 11, the ROM 12, and the RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to the bus 14. An input unit 16, an output unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

[0024] The input unit 16 is configured with, for example, a keyboard and is used to input various information. The output unit 17 is configured with a display such as a liquid crystal display, a speaker, and the like, and outputs various information as images and sounds. The storage unit 18 is configured with a dynamic random access memory (DRAM) or the like, and stores various data. The communication unit 19 communicates with other devices (for example, the user terminal 2 in FIG. 2) via a network including the Internet.

[0025] Removable media 31, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is appropriately loaded into the drive 20. A program read from the removable media 31 by the drive 20 is installed in the storage unit 18 as necessary. Further, the removable medium 31 can store various data stored in the storage unit 18 in the same manner as the storage unit 18 .

[0026] Although not shown, the user terminal 2 in Fig. 2 can also have a configuration basically similar to the hardware configuration shown in Fig. 4. Therefore, a description of the hardware configuration of the user terminal 2 will be omitted.

[0027] 4, various processes can be executed by cooperation of various hardware and various software, and as a result, the above-mentioned service can be provided. Hereinafter, the functional configuration of the server having the hardware configuration of FIG. 3 will be described with reference to FIG. FIG. 4 is a functional block diagram showing an example of a functional configuration of a server having the hardware configuration of FIG.

[0028] As shown in FIG. 4, in the CPU 11, a search condition acquisition unit 51, an extraction unit 52, and a display control unit 53 function when performing the position search process.

[0029] In one area of ​​the storage unit 18, a multi-modal database 61 (hereinafter referred to as "multi-modal DB 61") is provided. The multi-modal DB61 stores, in association with each other, vehicle driving data (first type of data) indicating the manner in which the vehicle moves, and second type of data indicating one or more types of context information of the vehicle, each of which is associated with a plurality of positions along the route of the movement. The second type of data includes, for example, at least one type of context information among the context information shown in FIG. 1 (accident data B1, telematics B2, map data B3, moving object status B4, weather data B5, topographical data B6, vital sign data B7, drone data B8, and people flow data B9, etc.). Specifically, the multi-modal DB 61 stores information such as the curvature radius of the road being 10 m, the weather being rainy, and the occurrence of an accident, as data on the location situation at a certain point on a hill on a mountain pass.

[0030] The search condition acquisition unit 51 acquires at least one type of multiple context information (e.g., topographical data B6, meteorological data B5, map data B3, accident data B1, etc.) as a search condition. Specifically, information such as a road curvature radius of 10 m as the topographical data B6, weather conditions such as rain as the meteorological data B5, and an occurrence of an accident as the accident data B1 is specified. Specifically, the search condition acquisition unit 51 acquires from the user terminal 2 the above-mentioned search conditions designated by the user U through an operation on the user terminal 2.

[0031] The extraction unit 52 extracts, from the multimodal DB 61, positions associated with the second type of data corresponding to one or more types of context information as a search condition. Specifically, the extraction unit 52 extracts from the multi-modal DB 61 points where accidents have occurred when the road has a curvature radius of 10 m and the weather is rain. The extraction unit 52 further extracts, from the multimodal DB 61, locations associated with the second type data (curvature radius 10 m, rain, accident occurrence) that is similar to or a part of the second type data (for example, road curvature radius 15 m, snow, satisfying some of the conditions for an accident occurrence) associated with the search location, as similar locations. "Partial" or "similar" means, for example, that no accidents have occurred, it is not raining, but the curvature radius is 10m.

[0032] The display control unit 53 executes control to display the extraction result of the extraction unit 52 on the user terminal 2 . As an extracted result, for example, if there is a place where an accident occurred, the display control unit 53 displays the place with an icon indicating the occurrence of the accident, or displays the icons indicating the occurrence of the accident in different colors by year. Furthermore, the display control unit 53 displays the icon within a specified range (area). The display control unit 53 displays detailed information about the location of the clicked icon, or cooperates with other map services (e.g., Google Maps, etc.) to display, for example, a photo image (Google Street View, etc.) of the location. Note that Google Maps and Google Street View are registered trademarks. The example shown here is merely an example, and driving data, map data, topographical data, etc. of the multimodal DB 61 owned by this service may also be displayed.

[0033] According to the server 1 of the embodiment as described above, the driving data (an example of the first type of data) and the position information (GPS data) acquired by a drive recorder (imaging means) mounted on a moving body such as a vehicle, the data acquisition location (position on the map), accident data B1, telematics B2, map data B3, moving body status B4, weather data B5, terrain data B6, vital data B7, dramoni B8, pedestrian flow data B9, etc. (an example of the second type of data) are associated and held in the multimodal DB61. Based on the search conditions (at least a part of the second type of data) input from the user terminal 2 by the user U, a position is extracted from the multimodal DB61, and the extraction result is dynamically displayed in various forms on the screen of the user terminal 2. Therefore, it is possible to provide a position search service that effectively utilizes the driving data held in the multimodal DB61.

[0034] Hereinafter, with reference to FIGS. 5 to 12, the position search function of the server 1 having the functional configuration of FIG. 4 will be described.

[0035] FIG. 5 is a diagram showing a screen of the position search function of the server having the functional configuration of FIG. 4. FIG. 6 is a diagram showing a screen transitioned from the screen of FIG. 5 by the execution of the position search. FIG. 7 is a diagram showing an example of a screen of a search result searched under the conditions specified on the screen of FIG. 6. FIG. 8 is a diagram showing a state in which the screen of FIG. 7 is enlarged. FIG. 9 is a diagram showing a screen displayed when the thumbnail image of FIG. 8 is clicked. FIG. 10 is a diagram showing a screen displayed when the thumbnail image of FIG. 9 is clicked. FIG. 11 is a diagram showing a screen displayed when the full-screen display button on the screen of FIG. 10 is clicked. FIG. 12 is a diagram showing a screen displayed when the jump button to the occurrence location of the screen of FIG. 10 is clicked.

[0036] As shown in FIG. 5, a screen 70 is a screen for searching a map for points that match desired conditions from among the travel data, traffic accident data, and road data stored in the multimodal DB 61. The screen 70 has a map screen 71 for displaying a map, and a search condition specification field 72 for narrowing down the search range for travel data. The map displayed on the map screen 71 can be enlarged or reduced by the user U using the "+" and "-" buttons, and the user U can also specify an area on the map by using the mouse. In this embodiment, the area is specified by enclosing the Kanto region in a rectangular frame (e.g., a red frame, etc.). The area can be changed by pressing the "Edit Area", "Cancel Area", and "Confirm Area" buttons at the bottom right of the screen. In the search condition specification column 72, a display data column and a traffic accident information specification column are arranged. In the display data column, check boxes are arranged for displaying checked data from among driving data, favorite data, traffic accident data, and road data. In this embodiment, the check boxes for the driving data, traffic accident data, and road data are checked by the operation of the user U. Note that all check boxes may be checked by default, and the user U may uncheck unnecessary data. The traffic accident information specification field contains an ON / OFF button to indicate whether or not traffic accident information is to be included in the extraction target, and check boxes for each attribute (whether to select all or not) to specify one or more attributes of a traffic accident (year of occurrence, accident type, accident details, etc.) when traffic accident information is to be extracted. In this embodiment, the ON button in the traffic accident information specification field is turned on so that traffic accident information is added to the extraction target, but one or more attributes of the traffic accident are not specified.

[0037] Here, when user U checks the “Select all” checkbox for the year of occurrence in the traffic accident information specification field, the screen transitions to screen 71 shown in Figure 6, and the year display of the year of occurrence is changed to a color-coded display of “2021,” “2020,” “2019,” and “2018.” At the same time, a check box is displayed in the column below to specify whether or not to display only the matching portion of the driving data. When user U checks the check box, the display of the extracted data is limited to only the matching portion of the driving data. By limiting the display to only the matching parts of the driving data, it is possible to display more specific locations and the contents of the driving data when the vehicle traveled through those locations (video footage taken from the vehicle, the vehicle conditions while driving, etc.).

[0038] On screen 71 in Figure 6, the data specified and displayed as search conditions are the driving data, traffic accident occurrence data, and road data obtained within the red frame, and are the locations where accidents occurred between 2018 and 2021.

[0039] Here, when user U performs an operation to execute a search (for example, by operating the Enter key on the keyboard), the search condition acquisition unit 51 acquires the search conditions on screen 71 of FIG. 6, and the extraction unit 52 searches the multimodal DB 61 based on the search conditions acquired by the search condition acquisition unit 51 to extract data (such as location data of points that match the search conditions and attribute data of those points), and the display control unit 53 displays a triangular icon (object) indicating the point of the accident at the point extracted by the extraction unit 52 as the search result on the map screen 81 of screen 80 shown in FIG. 7. The icons displayed on the map screen 81 are color-coded according to the year in which the accident occurred, and an exclamation mark "!" is displayed.

[0040] Here, when the user U moves the mouse over the icon of the desired location, a dialog box in which the attribute data (text-formatted data) of that location is input will pop up, so the user U can check the details of the accident occurrence situation. "Moving the mouse over" means an operation of moving the cursor by a mouse operation and overlapping it on the icon. Furthermore, when a click operation is performed on the underlined text (text with an underline) with a link among the attribute data in the displayed dialog box, the screen of the link destination will pop up and be displayed. In this screen example, when the user U clicks on the underlined "Display" in the "Display in Street View" in the dialog box, the screen of Google Street View pops up and is displayed.

[0041] The screen obtained by enlarging the map screen 81 in FIG. 7 is the map screen 91 in FIG. 8. In the map screen 91 of FIG. 8, driving data exists in a part of the road surrounded by the broken line 92, and the actual screen is displayed in a different color from other roads, for example, a blue line or the like. When a click operation is performed on the road where the driving data within the broken line 92 exists with the mouse, the road including the clicked point (the part of the road surrounded by the broken line 93) is changed to red, and a thumbnail image 94 of that point is displayed on the right side of the map screen 91. When the mouse is moved over the thumbnail image 94, playback starts as a double-speed video from the thumbnail image 94 (in a state where the video is static). By playing the driving data as a video in this way, the user U can visually recognize how the vehicle was driving at that time. In the lower column of the thumbnail image 94 (video), as the attribute data of the driving data, the date and time of data acquisition, the data imaging time, the weather information of the acquisition date, etc. are displayed.

[0042] Furthermore, when the user U performs a click operation on the thumbnail image 94 (video), the screen 100 shown in FIG. 9 pops up and is displayed. As shown in Fig. 9, on the screen 100, a driving video screen 101 and a map screen 102 are displayed side by side. At the upper right corner of the driving video screen 101, a thumbnail image 103 corresponding to the driving video is displayed. If the driving video is a front image, the corresponding thumbnail image 103 is, for example, a rear image, a side image, etc. On the map screen 102, a map on which the vehicle is traveling is displayed, and the position of the vehicle in the map is displayed as a mark 104 such as a red dot. Then, the map is displaced so that the mark 104 moves in accordance with the progress of the vehicle in the driving video. Two buttons 105 and 106 are arranged above the thumbnail image 103. The button 105 is a button for swapping the thumbnail image 103 and the driving video. The button 106 is a zoom-in / zoom-out button. When the swap button 105 is clicked, the size relationship and the front / back relationship between the driving video and the thumbnail image 103 are swapped and displayed.

[0043] Also, when the zoom-in / zoom-out button 106 is clicked, as shown in Fig. 10, an enlarged image 107 of the thumbnail image 103 is overlaid and displayed in front of the driving video screen 101. When the same button 106 is clicked again, it is reduced to the original thumbnail image 103. At the lower bar of the screen 100 in Fig. 10, a full-screen display button 108 is arranged. When the user U clicks the button 108, a full-screen display screen 110 as shown in Fig. 11 is displayed. By clicking the full-screen end button arranged at the lower right of the screen 110, the screen 110 transitions to the original screen 100 in Fig. 10.

[0044] Also, on the right column of the screen 100 in Fig. 10, a jump-to-occurrence-location button 109 is arranged. When user U clicks button 109, if the location of the accident is present in the driving data, the screen transitions to the location of the accident, and as shown in FIG. 12, screen 121 on the right side shows a video of the driving at the location of the accident, and map screen 122 on the left side shows a pop-up screen 123 with a red mark indicating the vehicle's current location, an icon of the location of the accident, and detailed information (text data) about the location of the accident.

[0045] In this way, according to the server 1 of the embodiment, the travel data stored in the multimodal DB 61 is managed in association with the position and the context information, and the multimodal DB 61 is searched using one or more types of context information input by the user U as a search condition, so that a place (point) matching the search condition can be confirmed on a map before going to the data acquisition location (local area). This makes it possible to support the user in carefully selecting from among the places confirmed on the map for which data has not yet been acquired, and in formulating a data acquisition plan and acquiring data. In addition, when searching by specifying any conditions on the map that require data acquisition (such as topographical conditions such as slope or curvature of curves), the system will display the relevant locations and whether or not data is held or possessed, allowing data acquisition to move away from the traditional method of relying on the knowledge, expertise, and experience of experts and data acquirers. More specifically, when the search condition acquisition unit 51 acquires search conditions specified by the user U, for example, a road curvature radius of 10 m, rainy weather, and the location where an accident occurred (at least one type of multiple context information), the extraction unit 52 extracts from the multimodal DB 61 locations associated with second-type data that matches, is similar to, or partially matches the search conditions (curvature radius of 10 m, rain, location where an accident occurred, etc.), and the display control unit 53 displays the locations on a map and presents them to the user U. Therefore, the user U can detect a location with the desired conditions on the user terminal 2 without having to go to the trouble of driving a vehicle and blindly searching for a location with a similar scenery or environment. As a result, a service can be provided that makes effective use of the driving data stored in the multimodal DB 61.

[0046] Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are considered to be included in the present invention.

[0047] In the above-described embodiment, the multimodal DB 61 is mainly used to identify the location of the accident, but it can also be used for various other purposes. Specifically, this service (location search service) can be used by insurance companies, taxi companies, and other businesses to alert drivers to accident prevention and conservation activities.In addition, by having this service used by public organizations such as local governments and road operators such as the Japan Highway Public Corporation, it can be used to help improve road conditions. Furthermore, for companies developing drive recorders or other automobile-related functions and services rather than accident information, when conducting testing during function development, they can pinpoint areas similar to where problems occurred, thereby improving development efficiency.

[0048] For example, the system configuration shown in FIG. 2 and the hardware configuration of the server 1 shown in FIG. 3 are merely examples for achieving the object of the present invention, and are not particularly limited.

[0049] In addition, the functional block diagram shown in Fig. 4 is merely an example and is not particularly limited. In other words, it is sufficient that the information processing system in Fig. 2 is provided with a function capable of executing the above-mentioned series of processes as a whole, and the functional blocks and databases used to realize this function are not particularly limited to the example in Fig. 4.

[0050] Furthermore, the locations of the functional blocks are not limited to those shown in FIG. For example, at least a part of the functional blocks arranged on the server 1 side may be provided in the user terminal 2 or another information processing device (not shown).

[0051] Furthermore, the above-described series of processes can be executed by hardware or software. Furthermore, one functional block may be configured as a single piece of hardware, a single piece of software, or a combination of both.

[0052] When the series of processes is executed by software, the program constituting the software is installed into a computer or the like from a network or a recording medium. The computer may be a computer implemented with dedicated hardware. Furthermore, the computer may be a computer capable of executing various functions by installing various programs thereon, such as a server, a general-purpose smartphone, or a personal computer.

[0053] A recording medium containing such a program may be composed not only of a removable medium (not shown) that is distributed separately from the device main body in order to provide the program to the user, but also of a recording medium that is provided to the user in a pre-installed state in the device main body.

[0054] In this specification, the steps of describing a program to be recorded on a recording medium include not only processes that are performed chronologically according to the order, but also processes that are not necessarily performed chronologically but are executed in parallel or individually.

[0055] In summary, it is sufficient for an information processing device to which the present invention is applied to have the following configuration, and various embodiments can be adopted. (1) That is, an information processing device to which the present invention is applied (for example, the server 1 in FIG. 4) In an information processing device (e.g., server 1 in FIG. 4 ) that communicates with a predetermined database (e.g., multimodal DB 61 in FIG. 4 ) in which first type data (e.g., vehicle driving data) indicating the state of movement of a moving body (e.g., a vehicle or a drone) and second type data (e.g., a curvature radius of 10 m, rain, accident occurrence) indicating one or more types of context information of the moving body (e.g., a vehicle) or its operator (e.g., a driver or pilot) that are respectively associated with a plurality of positions (e.g., longitude, latitude, altitude) in the path of the movement are stored in association with each other, A search condition acquisition unit (e.g., a search condition acquisition unit 51 in FIG. 4 ) that acquires at least one type of multiple context information including a location (e.g., topographical data, meteorological data, map data, accident data, etc.) as a search condition; an extraction means (e.g., the extraction unit 52 in FIG. 4) for extracting, as a search position, from the predetermined database (e.g., the multimodal DB 61 in FIG. 4 ), a position (e.g., a point on a map, “longitude, latitude, altitude”) associated with second-type data (e.g., a curvature radius of 10 m, rain, and an accident occurrence match) that corresponds to (matches or is similar to) one or more types of context information as the search condition; Equipped with.

[0056] In this way, at least one or more types of multiple context information including a position (e.g., topographical data, weather data, map data, accident data, etc.) are obtained as a search condition, and a position (e.g., a point on a map, "longitude, latitude, altitude") corresponding to second type data (e.g., a curvature radius of 10 m, rain, and some of the occurrence of an accident match) that corresponds to (matches or is similar to) one or more types of context information as the search condition is extracted as a search position from a specified database (e.g., the multimodal DB 61 in FIG. 4). This makes it possible to provide a service that can effectively utilize the driving data stored in a specified database (e.g., the multimodal DB 61 in FIG. 4).

[0057] (2) In the information processing device (for example, server 1 in FIG. 4), The extraction means (e.g., extraction unit 52 in FIG. 4) further extracts at least a portion of the first type of data (e.g., driving data) that includes the search position in the route of movement, and the second type of data (e.g., a curvature radius of 10 m, it is raining, and an accident has occurred) that corresponds to the search position, from the specified database (e.g., multimodal DB 61 in FIG. 4).

[0058] In this way, at least a portion of the second type data (e.g., a curvature radius of 10 m, it is raining, and an accident has occurred) is extracted from the specified database (e.g., the multimodal DB61 in Figure 4), so that the position can be extracted even if not all search conditions are satisfied.

[0059] (3) In the information processing device (for example, server 1 in FIG. 4), The search condition acquisition means (e.g., the search condition acquisition unit 51 in FIG. 4) acquires the search conditions input by a user (e.g., the user U in FIG. 4) to a user terminal (e.g., the user terminal 2 in FIG. 4), A display control means (e.g., the display control unit 52 in FIG. 4) for executing control to display an extraction result of the extraction means (e.g., the extraction unit 52 in FIG. 4) on the user terminal (e.g., the user terminal 2 in FIG. 4); Equipped with.

[0060] This allows the user to check the searched location on the user terminal that he or she operates.

[0061] (4) In the information processing device (for example, server 1 in FIG. 4), The display control means (for example, the display control unit 52 in FIG. 4) executes control to display the extraction result at the search position on a map.

[0062] This allows the user to directly visually confirm positions (places) that meet the conditions on the map.

[0063] (5) In the information processing device (for example, server 1 in FIG. 4), The extraction means (e.g., extraction unit 52 in FIG. 4) further extracts locations associated with the second type data (curvature radius 2 m, rain, accident occurrence) that is similar to or a part of the second type data (no accident occurrence, no rain but a curvature radius of 10 m means "a part"; curvature radius 15 m, snow, accident occurrence means "similar") from the specified database (e.g., multimodal DB 61 in FIG. 4) as similar locations.

[0064] This makes it possible to obtain positions (places) that are similar to or that include a part of the search condition (second type data) as search results.

[0065] (6) In the information processing device (for example, server 1 in FIG. 4), The second type of data is data indicating an internal state of the moving object (for example, accident information, CAN information), including accident data and moving object state data.

[0066] (7) In the information processing device (for example, server 1 in FIG. 4), The second type of data is data indicating the internal state of the operator (eg, driver, pilot, etc.), including vital information of the operator and facial expression of the operator obtained from a drive monitor.

[0067] (8) In the information processing device (for example, server 1 in FIG. 4), The second type of data is data indicating an external state of the moving object or its operator, including accident data, telematics, map data, weather data, topographical data, and people flow data.

[0068] (9) An information processing method to which the present invention is applied (for example, an information processing method by the server 1 in FIG. 4) is as follows: An information processing method executed by an information processing device (e.g., server 1 in FIG. 4 ) that communicates with a predetermined database (e.g., multimodal DB 61 in FIG. 4 ) in which first type data (e.g., vehicle driving data) indicating a state of movement of a moving body (e.g., a vehicle or a drone) and second type data (e.g., a curvature radius of 10 m, rain, accident occurrence) indicating one or more types of context information (e.g., terrain data) of the moving body (e.g., a vehicle) or its operator (e.g., a driver or a pilot) respectively associated with a plurality of positions in the path of the movement are stored in association with each other, a search condition acquisition step of acquiring at least one type of context information including a location (e.g., topographical data, meteorological data, map data, accident data, etc.) as a search condition; an extraction step of extracting, as a search position, from the predetermined database (e.g., the multimodal DB 61 in FIG. 4 ) a position (e.g., a point on a map, “longitude, latitude, altitude”) associated with second-type data (e.g., a curvature radius of 10 m, rain, and an accident occurrence match) that corresponds to (matches or is similar to) one or more types of context information as the search condition; Including, It is possible.

[0069] (10) A program to which the present invention is applied (for example, a program that operates the CPU 11 of the server 1 in FIG. 4) A computer (e.g., CPU 11 in FIG. 4 ) that communicates with a predetermined database (e.g., multimodal DB 61 in FIG. 4 ) that stores first type data (e.g., vehicle driving data) indicating the state of movement of a moving body (e.g., a vehicle or a drone) and second type data (e.g., a curvature radius of 10 m, rain, accident occurrence) indicating one or more types of context information (e.g., terrain data) of the moving body (e.g., a vehicle) or its operator (e.g., a driver or a pilot) that are respectively associated with a plurality of positions in the path of the movement, a search condition acquisition step of acquiring at least one type of context information including a location (e.g., topographical data, meteorological data, map data, accident data, etc.) as a search condition; an extraction step of extracting, as a search position, from the predetermined database (e.g., the multimodal DB 61 in FIG. 4 ) a position (e.g., a point on a map, “longitude, latitude, altitude”) corresponding to second-type data (e.g., a curvature radius of 10 m, rain, and an accident occurrence match) that corresponds to (matches or is similar to) one or more types of context information as the search condition; Executing a control process including It is possible. [Explanation of symbols]

[0070] Reference Signs List 1 server, 2 user terminal, U user, 11 CPU, 12 ROM, 13 RAM, 14 bus, 15 input / output interface, 16 input section, 17 output section, 18 memory section, 19 communication section, 20 drive, 31 removable media, 51 search condition acquisition section, 52 extraction section, 53 display control section, 61 multi-modal DB

Claims

1. An information processing device that communicates with a predetermined database in which a first type of data indicating a state of movement of a moving object and a second type of data indicating one or more types of context information of the moving object or its operator, each of which is associated with a plurality of positions on a route of the movement, are stored in association with each other, A search condition acquisition means for acquiring at least one type of a plurality of pieces of context information including a location as a search condition; an extraction means for extracting, as a search position, a position associated with second type data corresponding to one or more types of the context information as the search condition from the predetermined database; An information processing device comprising:

2. The extraction means further extracts, from the predetermined database, at least a portion of the first type data including the search position in a route of movement and the second type data associated with the search position. The information processing device according to claim 1 .

3. The search condition acquisition means acquires the search conditions inputted by a user to a user terminal, a display control means for controlling display of the extraction result of the extraction means on the user terminal; The information processing device according to claim 1 , further comprising:

4. the display control means executes control to display the extraction result at the search position on a map. The information processing device according to claim 3 .

5. The extraction means further extracts, from the predetermined database, a position that is similar to the second type data associated with the search position or that partially matches the second type data, as a similar position. The information processing device according to claim 1 .

6. The second type of data is data indicating an internal state of the moving body, including accident data and moving body state data. The information processing device according to claim 1 .

7. The second type of data is data indicating an internal state of the operator, including vital information of the operator and facial expressions of the operator obtained from a drive monitor. The information processing device according to claim 1 .

8. The second type of data is data indicating an external state of the moving object or its operator, including accident data, telematics, map data, weather data, topographical data, and people flow data. The information processing device according to claim 1 .

9. An information processing method is provided in which an information processing device communicates with a predetermined database in which first type data indicating a state of movement of a moving object and second type data indicating one or more types of context information of the moving object or its operator, each of which is associated with a plurality of positions on the route of the movement, are stored in association with each other, a search condition acquisition step of acquiring at least one type of context information including a location as a search condition; an extraction step of extracting, as a search position, a position associated with second type data corresponding to one or more types of the context information as the search condition from the predetermined database; An information processing method comprising:

10. A computer that communicates with a predetermined database in which a first type of data indicating the movement of a moving object and a second type of data indicating one or more types of context information of the moving object or its operator, each of which is associated with a plurality of positions on the path of the movement, are stored in association with each other, a search condition acquisition step of acquiring at least one type of context information including a location as a search condition; an extraction step of extracting, as a search position, a position associated with second type data corresponding to one or more types of the context information as the search condition from the predetermined database; A program that executes control processing including:

Images