Information processing device

Abstract

To improve convenience in an information providing system that utilizes a vehicle.SOLUTION: An information processing device extracts, from points on a first route, one or more points that have been traveled by a first vehicle having a function to provide on-vehicle video based on travel data acquired from a plurality of vehicles, and maps the one or more extracted points onto the map showing the first route.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to vehicles. [Background technology]

[0002] There is a technology for remotely checking video using a mobile object equipped with a camera. For example, Patent Document 1 discloses a system for receiving real-time video from a vehicle equipped with a drive recorder. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-164316 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to provide information using images captured by an in-vehicle camera. [Means for solving the problem]

[0005] A first aspect of the present disclosure is An information processing device having a control unit that executes the following operations: extracting, based on driving data acquired from a plurality of vehicles, one or more points on a first route that have been driven by a first vehicle having the function of providing in-vehicle video; and mapping the extracted one or more points on a map showing the first route.

[0006] Other aspects include a method executed by the above-described device, a program for causing a computer to execute the method, or a computer-readable storage medium non-transitoryly storing the program. [Effects of the Invention]

[0007] According to the present disclosure, information can be provided using images captured by an in-vehicle camera. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of an information providing system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating the configuration of each device included in the system. [Figure 3] 10 is an example of a vehicle data table. [Figure 4] 10 is an example of a screen displayed on a terminal device in the first embodiment. [Figure 5] FIG. 10 is a sequence diagram of a process in which the server device collects data. [Figure 6] FIG. 4 is a sequence diagram of a process in which the server device plays back in-vehicle video. DETAILED DESCRIPTION OF THE INVENTION

[0009] There is a demand for users to be able to check the road scenery at a specified location using actual video. For example, when a user drives a car for the first time, providing the user with a video of the specified location in advance can ensure a smooth driving experience.

[0010] There are known web services that provide panoramic images of specified locations. However, these panoramic images are still images taken at each location, which makes it difficult to get a sense of the atmosphere of the area when driving.

[0011] In this regard, a system is known that allows remote viewing of images captured by a camera mounted on a vehicle. However, with such a system, although it is possible to view in real time the video captured by a specified vehicle, it is not possible to play back the video captured at any point at any time. The information processing device according to the present disclosure solves such a problem.

[0012] An information processing device according to one embodiment of the present disclosure has a control unit that extracts, based on driving data acquired from a plurality of vehicles, one or more points on a first route that have been driven by a first vehicle having the function of providing in-vehicle video, and maps the extracted one or more points on a map showing the first route.

[0013] The travel data is, for example, data indicating the travel history of a vehicle (first vehicle) that has the function of providing in-vehicle video. By referring to the travel data, it is possible to extract one or more points on the first route that the first vehicle has traveled to, i.e., points where in-vehicle video can be provided.

[0014] The control unit extracts one or more such points based on the driving data and maps the extracted points on a map showing a first route, which may be specified by a user. According to this configuration, it is possible to visualize the locations on the specified route where in-vehicle video can be provided.

[0015] Note that "mapping on a map" may be indirect. For example, the control unit may generate a map on which the extracted points are mapped, or may transmit information for performing mapping to another device, thereby causing the other device to perform mapping. In other words, "mapping on a map" can also be read as "making the other device map on the map."

[0016] The control unit may receive from the first vehicle an in-vehicle image captured by the first vehicle and location information of the first vehicle, and store the two in association with each other. Furthermore, when one of the mapped locations is designated, the control unit may play back an in-vehicle video captured by the first vehicle at the designated location.

[0017] When the in-vehicle video is transmitted from the first vehicle together with the location information, these are stored in association with each other, thereby making it possible to provide the in-vehicle video corresponding to the specified location.

[0018] In addition, the control unit may further acquire predetermined conditions related to the target vehicle or the date and time of travel, and if there are multiple in-vehicle images taken by the first vehicle at the specified location, determine the in-vehicle image to play based on the predetermined conditions.

[0019] When there are multiple in-vehicle videos of the same location, it is preferable to selectively play back those that meet the conditions specified by the user. The conditions include, for example, the time period when the in-vehicle video was taken, the type of vehicle that took the in-vehicle video, etc. This allows the user to be provided with in-vehicle videos that are closer to the environment desired by the user.

[0020] The control unit may also superimpose thumbnails of in-vehicle images captured by the first vehicle on the map for each of the mapped points. This configuration allows for more intuitive operation.

[0021] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0022] (First embodiment) [System Overview] An overview of an information provision system according to a first embodiment will be described with reference to Fig. 1. The information provision system according to this embodiment includes a plurality of vehicles 10, a server device 2, and a terminal device 3. The vehicles 10 are connected vehicles that can access a wireless communication network. The vehicles 10 can communicate with the server device 2 via the wireless communication network (for example, a cellular communication network).

[0023] The vehicle 10 is equipped with an in-vehicle device 1. The in-vehicle device 1 functions as a drive recorder and a wireless communication device. The in-vehicle device 1 has a function of acquiring video images (hereinafter referred to as "video" or "in-vehicle video") of the area in front of the vehicle using an in-vehicle camera, and transmitting the acquired video images together with location information to the server device 2.

[0024] In this embodiment, the in-vehicle device 1 has a wireless communication function, but the vehicle 10 may have a data communication module (hereinafter referred to as DCM) for connecting the components of the vehicle to a network. That is, the in-vehicle device and the wireless communication device may be separate devices.

[0025] The server device 2 is a computer configured to be able to communicate with a plurality of vehicles 10 and terminal devices 3 via a network. The server device 2 periodically acquires in-vehicle images and location information from a plurality of vehicles 10 under its management and stores them in a database. The server device 2 also has a function of performing a route search based on a request from the terminal device 3 and providing a road map showing the results to the terminal device 3. At this time, the server device 2 maps points on the road map where in-vehicle video captured along the route can be played back based on the information stored in the database. Then, based on a request from the terminal device 3, the server device 2 transmits in-vehicle video captured at the specified point to the terminal device 3.

[0026] The terminal device 3 receives the results of the route search (for example, a road map with the searched route superimposed) from the server device 2. Furthermore, by specifying a point mapped on the road map, the terminal device 3 requests the server device 2 to play back the in-vehicle video captured at that point. This allows the user of the terminal device 3 to view the video captured at the specified point on the route.

[0027] Next, the hardware and software configurations of the devices that make up the system will be described. FIG. 2 is a diagram showing a schematic configuration of an in-vehicle device 1 mounted on a vehicle 10, a server device 2, and a terminal device 3 operated by a user.

[0028] The in-vehicle device 1 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.). The auxiliary memory device stores an operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions (software modules) that match predetermined purposes, as described below, can be realized. However, some or all of the functions may be realized as hardware modules using hardware circuits such as ASICs, FPGAs, etc.

[0029] The in-vehicle device 1 includes a control unit 11, a storage unit 12, a communication unit 13, a position information acquisition unit 14, and a camera 15.

[0030] The control unit 11 is a computing unit that executes predetermined programs to realize various functions of the in-vehicle device 1. The control unit 11 can be realized by, for example, a hardware processor such as a CPU. The control unit 11 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0031] In this embodiment, the control unit 11 of the in-vehicle device 1 is configured to have two software modules: an image capturing unit 111 and a transmission unit 112. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 12. Note that the information processing executed by the software module is synonymous with the information processing executed by the control unit 11 (CPU, etc.).

[0032] While the device is in operation, the photographing unit 111 photographs moving images (in-vehicle images) using the camera 15 described below, and stores the obtained data in the storage unit 12. The photographing unit 111 receives power supply from the vehicle and photographs continuously, and records the obtained moving image data in the storage unit 12.

[0033] Video data is made up of multiple video files. There is an upper limit to the length of a video corresponding to one file, and if the upper limit is exceeded, a new video file is generated. In this embodiment, a video file is generated every minute. If the storage capacity is insufficient, the shooting unit 111 deletes the oldest video file to secure free space and then continues shooting. In this embodiment, each video file is associated with an identifier (date and time ID) that identifies the date and time the video file was created (i.e., the date and time when shooting started). The date and time ID may uniquely identify the year, month, day, hour, minute, and second when the video file was created. When the image capturing unit 111 is activated, the in-vehicle device 1 functions as a drive recorder.

[0034] The transmission unit 112 transmits the video file captured by the image capturing unit 111 to the server device 2 together with data relating to the running of the vehicle (hereinafter referred to as vehicle data). The vehicle data in this embodiment includes an identifier (vehicle ID) that uniquely identifies the vehicle 10, the date and time when the vehicle data was generated, an identifier (date and time ID) that uniquely identifies the date and time, location information of the vehicle 10, and information indicating the traveling direction of the vehicle 10. The location information and traveling direction of the vehicle can be acquired from the location information acquisition unit 14, which will be described later.

[0035] The vehicle data is generated at a predetermined cycle and transmitted to the server device 2 together with any untransmitted video files. For example, if the predetermined cycle is five minutes, the transmission unit 112 transmits video files for the past five minutes to the server device 2 at the timing of transmitting the vehicle data. The predetermined cycle may be linked to the imaging unit 111. For example, if video files are generated at one-minute cycles, the transmission unit 112 may generate vehicle data at one-minute cycles. In this case, the transmission unit 112 transmits the latest video files to the server device 2 together with the vehicle data.

[0036] The storage unit 12 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 12 stores programs executed by the control unit 11, data used by the programs, etc.

[0037] The communication unit 13 is a wireless communication interface for connecting the in-vehicle device 1 to an external network. The communication unit 13 is, for example, a wireless LAN or a cellular communication such as 3G, 4G, or 5G. It is configured to be able to communicate with the server device 2 via a network.

[0038] The position information acquisition unit 14 acquires position information of the vehicle 10. The position information acquisition unit 14 includes a GPS antenna and a positioning module for determining the position information. The GPS antenna is an antenna that receives positioning signals transmitted from positioning satellites (also referred to as GNSS satellites). The positioning module is a module that calculates position information based on the signals received by the GPS antenna. The position information acquisition unit 14 may determine the traveling direction of the vehicle 10 based on the transition of the position information. The camera 15 is an optical unit including an image sensor for acquiring images, and is mounted, for example, facing forward of the vehicle 10.

[0039] Next, the server device 2 will be described. Like the in-vehicle device 1, the server device 2 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0040] The server device 2 includes a control unit 21, a storage unit 22, and a communication unit .

[0041] The control unit 21 is a computing unit that executes predetermined programs to realize various functions of the server device 2. The control unit 21 can be realized by, for example, a hardware processor such as a CPU. The control unit 21 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0042] In this embodiment, the control unit 21 of the server device 2 is configured to have three software modules: a data update unit 211, a route search unit 212, and an information provision unit 213. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 22. Note that the information processing executed by the software module is synonymous with the information processing executed by the control unit 21 (CPU, etc.).

[0043] The data update unit 211 receives vehicle data and video files of in-vehicle images from multiple vehicles 10 (in-vehicle devices 1) and stores them in the storage unit 22. For example, the data update unit 211 stores the vehicle data received from multiple vehicles 10 in a table (referred to as a vehicle data table) as shown in Fig. 3. The portion indicated by the dashed line in the figure corresponds to the vehicle data transmitted from the in-vehicle device 1. The vehicle data table includes, for example, information for identifying the vehicle (vehicle ID), information for identifying the date and time when the in-vehicle video was captured (date and time ID, etc.), vehicle position information and direction of travel, etc.

[0044] Furthermore, the data update unit 211 associates the vehicle data with the video file of the in-vehicle video and stores them in the vehicle data table. The video ID in the figure is an identifier for the video file of the in-vehicle video. When storing the vehicle data, the data update unit 211 assigns an identifier (video ID) to the video file received at the same time, and writes the assigned video ID into the vehicle data table.

[0045] The route search unit 212 performs a route search based on a request from the terminal device 3. The route search unit 212 acquires the departure point, destination, and search conditions (for example, whether or not toll roads are used) from the terminal device 3, and searches for a route connecting the departure point and the destination. The route may be determined by a pair of nodes and edges in a road network. Information about the road network may be acquired from an external device or may be stored in the storage unit 22. Information obtained as a result of the search (for example, a set of multiple edges representing the vehicle route) is sent to the information providing unit 213.

[0046] The information providing unit 213 provides information to the terminal device 3 based on the search result acquired from the route searching unit 212 and the information stored in the storage unit 22. Specifically, the information providing unit 213 performs the following two processes.

[0047] (1) Mapping locations where in-vehicle video can be provided to route search results The information providing unit 213 refers to the vehicle data table stored in the storage unit 22 and determines whether or not there is in-vehicle video previously captured at a point on the route acquired from the route searching unit 212. For example, if there is in-vehicle video previously captured at a point included in the route, the information providing unit 213 maps the point on a road map. This allows the server device 2 to show the user at which point on the route in-vehicle video has been captured.

[0048] (2) Providing in-vehicle footage When the user designates one of the above-mentioned locations, the information providing unit 213 transmits a video file of the in-vehicle video taken at the location to the terminal device 3. This allows the user of the terminal device 3 to check the road scenery at the designated location.

[0049] The storage unit 22 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 22 stores programs executed by the control unit 21, data used by the programs, etc. The storage unit 22 also stores a table (vehicle data table) that stores data received from the in-vehicle device 1, and video data (a collection of video files).

[0050] The communication unit 23 is a communication interface for connecting the server device 2 to a network. The communication unit 23 is configured to be able to communicate with the network via, for example, Ethernet (registered trademark), a wireless LAN, a cellular communication network, or the like.

[0051] Next, the terminal device 3 will be described. Like the in-vehicle device 1 and the server device 2, the terminal device 3 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0052] The terminal device 3 includes a control unit 31, a storage unit 32, a communication unit 33, and an input / output unit .

[0053] The control unit 31 is a computing unit that executes predetermined programs to realize various functions of the terminal device 3. The control unit 31 can be realized by a hardware processor such as a CPU. The control unit 31 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0054] In this embodiment, the control unit 31 of the terminal device 3 is configured to have two software modules: a display control unit 311 and a video acquisition unit 312. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 32. Note that the information processing executed by the software module is synonymous with the information processing executed by the control unit 31 (CPU, etc.).

[0055] The display control unit 311 displays a user interface (GUI) for requesting a route search. ) and outputs it via the input / output unit 34, which will be described later. In this embodiment, the display control unit 311 generates and outputs a user interface including a road map image and components for specifying a starting point and a destination, based on the road map data provided by the server device 2.

[0056] Furthermore, the display control unit 311 transmits a request for searching for a route (route search request) to the server device 2 based on the input content, and acquires the results of the route search from the server device 2. Based on the acquired information, the display control unit 311 outputs a user interface including the searched route and a list of points mapped on the route.

[0057] When the user selects one of the mapped locations, the video acquisition unit 312 transmits a request (playback request) to the server device 2 to play back the in-vehicle video captured at the corresponding location. The video acquisition unit 312 also receives and plays back the video file transmitted from the server device 2.

[0058] The storage unit 32 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 32 stores programs executed by the control unit 31, data used by the programs, etc.

[0059] The communication unit 33 is a wireless communication interface for connecting the terminal device 3 to an external network. The communication unit 33 is configured to be able to communicate with the server device 2 via, for example, a wireless LAN or a cellular communication network such as 3G, 4G, or 5G.

[0060] The input / output unit 34 is a unit that receives input from a user of the device and presents information to the user. Specifically, the input / output unit 34 is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are composed of a single touch panel display.

[0061] 2 is an example, and all or part of the illustrated functions may be performed using a dedicated circuit. Also, programs may be stored or executed using a combination of a main memory and an auxiliary memory other than those illustrated.

[0062] [Processing details] Next, specific examples of operations performed by the user via the terminal device 3 and the processes executed as a result will be described.

[0063] FIG. 4(A) is an example of a user interface provided to the user of the terminal device 3. The display control unit 311 of the terminal device 3 outputs a user interface including a road map to the input / output unit 34 based on the data acquired from the server device 2. The user interface includes a component (reference numeral 401) for specifying a departure point, a component (reference numeral 402) for specifying a destination, and a button (reference numeral 403) for executing a route search.

[0064] The starting point and destination may be set based on the results of an address search or landmark search, or may be specified on a map. The starting point may also be set to the current position of the vehicle.

[0065] When the user presses the button 403, a route search request is transmitted from the terminal device 3 to the server device 2. The request includes, for example, information indicating the departure point, destination, and search conditions.

[0066] In response to the request, the server device 2 (route search unit 212) searches for a route connecting the departure point and the destination. The route search results (for example, a set of edges and nodes connecting the departure point and destination) are transmitted to the information providing unit 213. The information providing unit 213 refers to the vehicle data table to determine whether there is a point on the route where in-vehicle video has been captured in the past. For example, the information providing unit 213 compares the position information of an edge or node included in the route with the position information included in the vehicle data table to determine whether the two match. If the two match, it can be determined that in-vehicle video has been captured in the past at a point on the route. In this case, the information providing unit 213 transmits information indicating the corresponding point to the terminal device 3, and the terminal device 3 generates and outputs a user interface that overlays a display indicating that in-vehicle video can be acquired at the point.

[0067] 4(B) is an example of a user interface output by the terminal device 3. The user interface includes an image in which a graphic (reference numeral 404) representing a route is superimposed on a road map. In addition, the user interface is overlaid with a graphic indicating points on the route where in-vehicle video has been captured in the past. In the example of Fig. 4(B), three points including the reference number 405 are indicated by black circles on the route connecting the departure point and the destination.

[0068] Furthermore, the user interface includes information (detailed information) about the details of each location. The detailed information may be, for example, the location name, the date and time when the in-vehicle video was captured, etc., as indicated by reference numeral 406. The detailed information may be generated based on information stored in the vehicle data table. The detailed information may also be a thumbnail of the corresponding in-vehicle video. The thumbnail may be a still image or a looping video. When a user selects (e.g., clicks on) a location, detailed information, thumbnail, etc. shown on the map, the server device 2 (information providing unit 213) obtains a video file of the in-vehicle video taken by the corresponding vehicle and transmits it to the terminal device 3.

[0069] When an operation to request playback of a video is performed on the terminal device 3, a request (playback request) to play the in-vehicle video is transmitted from the terminal device 3 to the server device 2. The playback request includes information for identifying the video file. For example, if the vehicle data table includes a video ID, the video ID may be included in the playback request. Upon receiving the playback request, the server device 2 identifies the target video file, reads out the video file, and transmits it to the terminal device 3. The transmitted video file is received by the terminal device 3 and played.

[0070] [Processing Sequence] Next, the steps executed by each device and the flow of data exchanged between the devices will be described.

[0071] 5 is a sequence diagram of a process for transmitting vehicle data and a video file from the in-vehicle device 1 to the server device 2. This process is executed at a predetermined interval. First, in step S11, the in-vehicle device 1 (transmission unit 112) determines whether or not it is time to transmit vehicle data. The timing may be determined by the transmission unit 112, or may be determined by the transmission unit 112 in response to a notification from the image capture unit 111. For example, the image capture unit 111 may transmit a notification to the transmission unit 112 every time a video file is switched (for example, every minute), and in response to this, the transmission unit 112 may determine that it is time to transmit vehicle data. If the timing to transmit the vehicle data has arrived, the process proceeds to step S12. If the timing to transmit the vehicle data has not arrived, the process repeats step S11.

[0072] Next, in step S12, the in-vehicle device 1 (transmitter 112) generates vehicle data and acquires the video file to be transmitted. In this embodiment, the transmitter 112 acquires the position information and traveling direction of the vehicle from the position information acquirer 14, and generates vehicle data by combining the vehicle identifier and date and time information. The transmitter 112 also acquires the latest video file from the in-vehicle videos stored in the memory 12. The acquired vehicle data and video file are transmitted to the server device 2.

[0073] In step S13, the server device 2 (data update unit 211) receives the vehicle data and stores the vehicle data in the vehicle data table in the storage unit 22.

[0074] By performing the above-described process for multiple vehicles 10, the server device 2 can collect and manage past location information and in-vehicle footage of multiple vehicles under its management. Furthermore, by referencing the vehicle data table stored in the server device 2, it becomes possible to subsequently search for vehicles that have previously traveled through points on a specified route.

[0075] Next, a process in which the terminal device 3 accesses the server device 2 and plays back in-vehicle video will be described. Fig. 6 is a sequence diagram of the process executed by the terminal device 3 and the server device 2. This process is started, for example, when a process to access the server device 2 is executed in the terminal device 3 (display control unit 311).

[0076] First, in step S21, the terminal device 3 (display control unit 311) acquires conditions (search conditions) for performing a route search and generates a route search request including the search conditions. The search conditions include information about the departure point and destination. The generated route search request is transmitted to the server device 2.

[0077] In step S22, the server device 2 (route search unit 212) executes a route search based on the received route search request, and as a result, a route (for example, a set of road edges and nodes) connecting the departure point and the destination is acquired. Next, in step S23, the server device 2 (information provider 213) refers to the vehicle data table, determines whether or not there is a point on the searched route where in-vehicle video has been captured in the past, and extracts that point.

[0078] Information about the extracted locations and the route obtained by the search is transmitted to the terminal device 3, and the terminal device 3 (display control unit 311) renders and outputs a user interface showing the search results (step S24). The user interface includes a graphic obtained by superimposing the route obtained by the search and the locations where the in-vehicle video can be viewed on a road map. The locations where the in-vehicle video can be viewed may be output together with the location name and information indicating the date and time when the in-vehicle video was captured, as exemplified in FIG. 4(B). Furthermore, they may be output together with a thumbnail of the in-vehicle video.

[0079] Next, in step S25, the terminal device 3 (video acquisition unit 312) acquires the location designation. For example, in the example of FIG. 4(B), the user can designate a location by clicking one of the three locations. The specified location is notified to the server device 2, and in step S26, the server device 2 (information provider 213) acquires a moving image file of the in-vehicle video captured at the specified location.

[0080] The video file is transmitted to the terminal device 3, and the terminal device 3 (video acquisition unit 312) receives the The video file is played (step S27).

[0081] As described above, in the information provision system according to this embodiment, the server device 2 that provides the route search service extracts one or more locations that have been traveled by vehicles capable of providing in-vehicle video when performing a route search. The extracted locations are then superimposed on the route search results, and when one of these locations is selected, a video file of the corresponding in-vehicle video is provided. This allows the user of the terminal device 3 to view the scenery at the locations on the route obtained by the search using the in-vehicle video.

[0082] (Second embodiment) In the first embodiment, all of the in-vehicle images stored in the server device 2 are provided. On the other hand, when multiple in-vehicle images are taken at the same location, it is preferable to provide in-vehicle images taken under conditions more suitable for the user. For example, when the user who performed the route search is traveling at night, it is preferable to provide in-vehicle images taken during the nighttime. Therefore, in the second embodiment, the server device 2 selectively presents, from among the in-vehicle images stored in the server device 2, those that match the conditions specified by the user (for example, the driving time zone, etc.).

[0083] As exemplified in the first embodiment, information regarding the date and time when the in-vehicle video was captured is included in the vehicle data generated by the in-vehicle device 1. In the second embodiment, this information is used to select the in-vehicle video. In the second embodiment, a component for inputting conditions related to travel time periods (hereinafter referred to as time period conditions) is added to the user interface shown in Fig. 4(A). The time period conditions may include, for example, specification of departure time and arrival time. The time period conditions do not necessarily represent only the time period, but may also include conditions related to the day of the week (weekday / holiday), date, etc. Furthermore, a time zone condition is added to the route search request sent from the terminal device 3 to the server device 2. If a route search can be performed taking into consideration the driving time zone, day of the week, etc., the server device 2 may perform a route search based on these conditions.

[0084] Furthermore, in the process of extracting the points where the in-vehicle video was captured, which is executed in step S23, the server device 2 also uses a time zone condition to perform the extraction. Specifically, when two or more in-vehicle images are acquired at the same (or substantially the same) location, the date and time information recorded in the vehicle data table is referenced, and the image that most closely matches the conditions specified by the user is selected. Note that when multiple time zone conditions are specified by the user, priorities may be assigned to each, and the image selected may be selected in descending order of priority. According to the second embodiment, it is possible to provide in-vehicle video that meets the specified time period conditions. For example, if a user who has performed a route search is traveling at night, it is possible to provide in-vehicle video taken during the nighttime hours.

[0085] (Modification of the second embodiment) In the second embodiment, the in-vehicle video is selected using the time zone condition, but other conditions related to the driving environment can also be used in combination to select the in-vehicle video. For example, the vehicle data may include information about the type of vehicle (e.g., passenger car, truck, bus, etc.) that captured the in-vehicle video. This makes it possible to obtain in-vehicle video captured by a specified type of vehicle.

[0086] (Variation) The above-described embodiment is merely an example, and the present disclosure can be modified and implemented as appropriate within the scope that does not deviate from the gist of the disclosure. For example, the processes and means described in this disclosure can be freely combined and implemented as long as no technical contradiction occurs.

[0087] Furthermore, in the embodiment, a vehicle equipped with an on-board device is exemplified, but any moving object other than a vehicle may be used as long as it is capable of capturing video.

[0088] In the embodiment, the server device 2 simultaneously collects vehicle data and in-vehicle video, but the two may be collected separately. For example, the server device 2 may periodically collect and store only vehicle data from multiple vehicles 10. In this case, the server device 2 may identify a vehicle that can provide in-vehicle video when a route search is performed, and receive a video file of the in-vehicle video from the vehicle.

[0089] Furthermore, if there are many points along the route where in-vehicle video can be provided, the points may be thinned out according to a predetermined criterion. For example, points may be classified into those for which in-vehicle video is desirable and those for which it is not desirable based on road width, traffic volume, and other characteristics, and only the former may be targeted for in-vehicle video provision.

[0090] In the embodiment, the in-vehicle device 1 transmits all of the captured in-vehicle video to the server device 2, but it is not necessary to transmit all of the in-vehicle video. For example, one or more event rules may be defined on the vehicle side, and the in-vehicle video may be transmitted to the server device 2 when the event rule occurs. Examples of event rules include "when a specified structure or landmark is detected," "when an intersection is passed," "when a right or left turn occurs," and "when a predefined point (such as a location prone to accidents) is passed."

[0091] In addition, in the embodiment, the terminal device 3 generates and outputs a user interface including a road map based on information received from the server device 2, but the road map may be generated by the server device 2. In this case, the server device 2 may draw the road map and map the locations. In this case, the user interface screen including the road map generated by the server device 2 may be transmitted to the terminal device 3, and the terminal device 3 may output this. In other words, the functions of the terminal device 3 (display control unit 311) described in the embodiment may be provided to the server device 2 (information providing unit 213).

[0092] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Alternatively, a process described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0093] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0094] 1...In-vehicle device 2. Server device 3. Terminal device 11, 21, 31... Control unit 12,22,32...Storage section 13, 23, 33... Communications Department 14...Location information acquisition unit 15. Camera 34...Input / output section

Claims

1. extracting, from among points on the first route based on driving data acquired from a plurality of vehicles, one or more points that have been driven by a first vehicle having a function for providing in-vehicle video; mapping the extracted one or more points on a map showing the first route; An information processing device having a control unit that executes the above.

2. The control unit receives, from the first vehicle, an in-vehicle image captured by the first vehicle and location information of the first vehicle, and stores the in-vehicle image and the location information of the first vehicle in association with each other. The information processing device according to claim 1 .

3. When any one of the mapped points is designated, the control unit plays back an in-vehicle video captured by the first vehicle at the designated point. The information processing device according to claim 2 .

4. The control unit further acquires predetermined conditions related to the target vehicle or the travel date and time, When there are a plurality of in-vehicle images taken by the first vehicle at the specified location, determining the in-vehicle image to be played back based on the predetermined condition. The information processing device according to claim 3 .

5. the control unit superimposes thumbnails of the in-vehicle video captured by the first vehicle on the map for each of the mapped points. The information processing device according to claim 2 .

Images