Program, method, and information processing device

Abstract

To provide a technique for further improving user's travel experiences.SOLUTION: A program for operating a computer causes a processor to perform the steps of: receiving a travel route on which a user travels and which includes at least a departure place and a destination; searching for a road guide moving image relating to the travel route of the user, based on at least one of information on the departure place, information on the destination, and information on locations on a route determined by the departure place and the destination; and presenting the road guide moving image extracted by the searching to the user, the road guide moving image being obtained by capturing the image of traveling from a departure place to a destination.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present disclosure relates to a program, a method, and an information processing device. [Background technology]

[0002] There are techniques for assisting users in moving around.

[0003] The following Patent Document 1 describes a technology that aims to "provide a map information recording and playback method and device that can effectively utilize recorded video, still image, and audio data in a navigation system."

[0004] Specifically, Patent Document 1 describes a map information recording and playback method in which, "when recording at least one type of recordable information of video, still image, audio, or text, position information including any one of longitude, latitude, or altitude is recorded on a recording medium in synchronization with the recordable information, and the recordable information associated with the position information corresponding to a specific position on a map in the navigation data is output."

[0005] This means that "for example, video, still images or recorded audio taken while driving a car can be associated with location data, and a map and video, or a map and still images, etc., in the navigation data can be output simultaneously on the screen."

[0006] The following Patent Document 2 describes a technology that aims to "provide continuous cityscape images" in order to address the problem of "loss of continuity at points where images change" in cityscape images.

[0007] Specifically, Patent Document 2 describes an image synthesis device that, in order to "provide an image synthesis device that creates a high-definition image with continuity at points where images switch along a route input by a user," "acquires city images captured by an omnidirectional camera," "estimates frame positions on a map for each of a plurality of frame images that constitute the acquired city images," "creates a shooting path for the omnidirectional camera based on the estimated frame positions for each of the plurality of frame images," "detects an intersection frame image at which the city image switches from one shooting path to another shooting path at an intersection where a plurality of shooting paths made up of a plurality of frame images whose frame positions have been estimated intersect with each other, from a plurality of frame images whose frame positions have been estimated in the one shooting path and the other shooting path," "connects the intersection frame images detected in the one shooting path and the other shooting path so that they are continuous at the intersection," and "outputs a composite city image including the connected intersection frame image corresponding to the input route that includes the intersection." [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2001-050756 A [Patent Document 2] Patent Publication No. 2021-022912 Summary of the Invention [Problem to be solved by the invention]

[0009] However, there is a need for technology that can further improve the user's travel experience, such as by helping users better understand the route they will take to get from their departure point to their destination so that they can travel without getting lost. [Means for solving the problem]

[0010] According to one embodiment of the present disclosure, there is provided a program for operating a computer having a processor and a memory, the program causing the processor to execute the steps of: accepting a travel route along which a user will travel, the travel route including at least a starting point and a destination; searching for a route guidance video related to the user's travel route based on at least one of information about the accepted starting point, information about the destination, and information about a position on the route determined by the starting point and the destination; and presenting to the user the route guidance video extracted by the search, where the route guidance video is a video of the travel from a starting point to the destination. Effect of the Invention

[0011] According to the present disclosure, the user's travel experience can be further improved. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a system 1. [Diagram 2] FIG. 2 is a diagram showing the functional configuration of the server 20. As shown in FIG. [Diagram 3] FIG. 3 is a diagram showing the functional configuration of the terminal 10. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing the data structure of the video management database 921. As shown in FIG. [Diagram 5] FIG. 5 is a diagram showing the data structure of the route search history 282. As shown in FIG. [Figure 6] FIG. 6 is a diagram showing the data structure of the map database 911. As shown in FIG. [Figure 7] FIG. 7 is a diagram showing a process flow for presenting a route guidance video together with the search results in response to a route search by a user. [Figure 8] FIG. 8 is a diagram showing a process flow for setting one or more waypoints on a travel route and presenting a route guidance video when a route guidance video from the starting point to the destination of the travel route is not found. [Figure 9] FIG. 9 is a diagram showing a process flow for updating the presentation of route guidance video as needed in accordance with the movement of the user. [Figure 10] FIG. 10 is an example of a screen in the system 1, showing an input screen for a route search service. [Figure 11] FIG. 11 is a diagram showing an example of a screen in the system 1, showing a situation in which route search results and route guidance video are displayed. [Figure 12] FIG. 12 is a diagram showing an example of a screen in the system 1, in which a route guidance video is presented with a travel route divided into a plurality of sections. [Figure 13] FIG. 13 is a diagram showing an example of a screen in the system 1, in which route search results including public transportation and a route guidance video are presented. [Figure 14] FIG. 14 is a diagram showing an example of a screen in the system 1, showing a situation in which the playlist of route guidance videos and the playback position of the videos are updated in response to the movement of the user. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[0014] <Outline of the first embodiment> In the first embodiment, a technology for providing various information to a user to ease the anxiety the user feels when traveling in a service that provides the user with a route for traveling from a departure point to an arrival point (destination) will be described. More specifically, in the above service, the following information is provided to the user so that the user does not get lost and does not arrive late to the arrival point (arrive by a specified time). Route on maps (roads, paths, etc.) from your starting point to your destination Information about the public transport you use (trains, buses, ride-sharing services, etc.) Directions videos that are posted by contributors on video distribution services and distributed so that they can be viewed by third parties (hereinafter referred to as "Directions Videos").

[0015] Regarding the system 1 of the first embodiment, examples of usage scenarios of users include the following. A user searches for route guidance videos as a preliminary step before visiting a destination (e.g., searching for route guidance videos at home prior to visiting a destination) Searching for route guidance videos while the user is traveling to their destination (e.g., searching while on the train to their destination) When multiple people are planning to get together, users can share a video showing directions to the meeting place in advance.

[0016] Here, a route guidance video is created by, for example, a person who is taking pictures with a camera while traveling on foot or in a vehicle from a departure point to a destination. Route guidance videos include the following:

[0017] (1) Range of movement recorded in the navigation video Traveling from one designated point to another within a facility (for example, at a busy station, walking from a designated platform for boarding and alighting trains to one of the multiple exits, filming from a pedestrian's perspective to evoke in the viewer the image of walking) Photos taken while walking around a city (e.g., photos taken while walking around a specific station, photos taken while walking from one point to another, etc.) - Filming of travel from a certain point to a destination such as a tourist spot (e.g. filming of travel from a station to a specific point such as a tourist spot by train, bus, taxi, or other vehicle, or on foot)

[0018] (2) The starting point or destination of a trip in a video guide In a route guidance video, the following are examples of possible starting points or destinations for travel. Tourist attractions (facilities, scenery, transportation, etc.) Accommodation Store Transportation The above-mentioned route guidance videos allow users to check the travel procedures in a video, and therefore may be easier for users to understand when, for example, traveling to a place for the first time, compared to directions that are only in text or audio.

[0019] System 1 provides a route search service for providing information such as the time required for a user to travel from a departure point to a destination, the means of travel, etc. The route search service accepts an inquiry from a user about a travel route that includes at least the destination, responds to the user with information about the travel route, and provides a navigation video related to the travel route.

[0020] This allows the user to refer to the screen displaying the searched route and / or map information, as well as the navigation video related to the route, while actually traveling based on the searched route, and therefore the user can easily understand how to travel on foot, etc., at each location that the user has traveled to. Therefore, compared to a case where the map is displayed and the route is only navigated by voice, the user can travel relatively without getting lost by referring to the navigation video, and this can alleviate anxiety about whether the user will get lost and not be able to reach the destination, or whether the user will be able to arrive on time and without being late.

[0021] In addition, when searching for a route guidance video related to a travel route, since users desire a variety of travel routes, there may be a route guidance video that covers the entire travel route, or there may be a plurality of route guidance videos that can cover the travel route. Also, there may be cases where the route guidance video cannot cover the entire travel route.

[0022] In the following embodiment, even in such a case, that is, when the route guidance video is not continuous along the travel route, when the travel route reaches a section where the route guidance video is not continuous, the voice guide of the route search service is switched to, and different content such as advertisements related to points included in the route is provided, thereby further improving the travel experience of the user.

[0023] In the following embodiment, a search is first performed for a route guidance video that covers the entire user's travel route, and if no route guidance video is found, intermediate points on the travel route are acquired or arbitrarily set, and consecutive route guidance videos that can cover the travel route via the intermediate points are searched for, and if no such consecutive route guidance videos are found in the search, blank sections on the route are replaced with content other than the route guidance video, and the search results are provided to the user.

[0024] <1.1 Overall system configuration> FIG. 1 is a block diagram showing an example of the overall configuration of a system 1.

[0025] System 1 is a system that supports a user to travel on time without getting lost by searching for a route, including public transportation, to a destination to which the user wishes to travel and responding to the user. For example, system 1 can be used by the following businesses: Business companies: To plan employee business trips (time required for travel), calculate and settle business trip expenses or commuting expenses, etc. Personal: For travel etc. 1 includes a terminal 10 of a user of a route search service, a server 20 of a route search service provider, a server 91 of a map service provider, a server 92 of a video distribution provider, a terminal 93 of a contributor of a route guidance video, a server 94 of an advertisement distribution provider, and a terminal 95 of an advertiser. These devices are communicatively connected via a network 80.

[0026] In the illustrated example, one terminal 10 is shown as the terminal used by the users, and each user operates their own terminal.

[0027] In this embodiment, each device (terminal device, server, etc.) can also be regarded as an information processing device. That is, a collection of the devices can be regarded as one "information processing device", and the system 1 may be formed as a collection of multiple devices. The method of allocating multiple functions required to realize the system 1 according to this embodiment to one or multiple pieces of hardware can be appropriately determined in consideration of the processing capacity of each piece of hardware and / or the specifications required for the system 1.

[0028] The terminal 10 is a device operated by a user. The terminal 10 is realized, for example, as follows. · Handheld mobile devices such as smartphones and tablets · Desktop PC (Personal Computer), laptop PC Wearable devices worn by users (wristwatches, glasses, etc.) The terminal 10 includes a communication IF (Interface) 12 , an input device 13 , an output device 14 , a memory 15 , a storage 16 , and a processor 19 .

[0029] The communication IF 12 is an interface for inputting and outputting signals so that the terminal 10 can communicate with an external device.

[0030] The input device 13 is a device for receiving an input operation from a user (for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.).

[0031] The output device 14 is a device (such as a display and a speaker) for presenting information to a user.

[0032] The memory 15 is for temporarily storing programs and data to be processed by the programs, and is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0033] The storage 16 is for storing data, and is, for example, a flash memory or a hard disk drive (HDD).

[0034] The processor 19 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, a register, peripheral circuits, and the like.

[0035] The server 20 is a device for providing a route search service to users.

[0036] The server 20 includes a communication IF 22 , an input / output IF 23 , a memory 25 , a storage 26 , and a processor 29 .

[0037] The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with external devices.

[0038] The input / output IF 23 functions as an interface with an input device for receiving an input operation from a user and an output device for presenting information to the user.

[0039] The memory 25 is for temporarily storing programs and data to be processed by the programs, and is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0040] The storage 26 is for storing data, and is, for example, a flash memory or a hard disk drive (HDD).

[0041] The processor 29 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, a register, peripheral circuits, and the like.

[0042] <1.2 Functional configuration of server 20> 2 is a diagram showing a functional configuration of the server 20. As shown in FIG. 2, the server 20 fulfills the functions of a communication unit 201, a storage unit 202, and a control unit 203.

[0043] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0044] The storage unit 202 stores various databases such as a user database 281, a route search history 282, a public transport service operation database 283, a video and advertisement viewing history 284, and a search result sharing history 285.

[0045] The user database 281 is a database for managing information on each user, the details of which will be described later.

[0046] The route search history 282 is a history of searches for a user's travel route using a route search service, as will be described in detail later.

[0047] The public transportation service operation database 283 is a database for managing operation schedules (timetables) of public transportation services such as trains and buses. When the system 1 provides a route search service to a user, it searches for a user's travel route including public transportation services based on information on the location of the departure point, arrival point, etc. specified by the user, information on the date and time such as the departure time, arrival time, etc. specified by the user, and information on the operation schedule of the public transportation services, and presents the search results to the user.

[0048] The video and advertisement viewing history 284 is a database for the system 1 to present route guidance videos to a user performing a route search and to manage the history of the user viewing the route guidance videos. The video and advertisement viewing history 284 also includes a history of advertisements delivered to a user performing a route search, and a history of advertisements provided to the user in response to the user's operation on the advertisements (users viewing the advertisements).

[0049] The search result sharing history 285 indicates a history of users sharing the results of a route search performed by the user and the route guidance video extracted by the route search.

[0050] The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. The control unit 203 performs functions indicated as a reception control module 2041, a transmission control module 2042, a user management module 2043, a route search module 2044, a video search module 2045, and a user sharing module 2046 by operating in accordance with the program.

[0051] The reception control module 2041 controls the process in which the server 20 receives a signal from an external device in accordance with a communication protocol.

[0052] The transmission control module 2042 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0053] The user management module 2043 is a module for managing information on each user who uses the system 1.

[0054] Specifically, the user management module 2043 accepts registration of information about each user and updates the user database 281 .

[0055] The route search module 2044 is a module for searching the user's travel route.

[0056] The route search module 2044 searches for a route for the user based on an algorithm for finding the shortest route between two points consisting of a start point and an end point. For example, the following is an algorithm for finding the shortest route. · breadth-first search Dijkstra algorithm Bidirectional Dijkstra Algorithm · A* method Bellman-Ford Method Ant Colony Optimization In addition, in order to provide a route search including public transportation services, the route search module 2044 accepts designation of a departure point and an arrival point and a date and time of travel from the user, searches for a travel route including boarding schedules of public transportation services such as trains, buses, airplanes, and taxis while referring to an operation database 283 of public transportation services, and responds with the search results to the user. The route search module 2044 updates the route search history 282 in response to the user's route search operation.

[0057] Although not shown, the route search module 2044 may communicate with a server of a ride-sharing service operator that shares means of transportation such as bicycles, and search for a travel route while also referring to the availability status of these ride-sharing services.

[0058] The video search module 2045 is a module for searching for videos related to the user's travel route.

[0059] Specifically, the video search module 2045 accepts input of search conditions related to the user's travel route, and searches for route guidance videos related to the travel route by communicating with the video distribution company's server 92. The video search module 2045 updates the route search history 282 by searching for route guidance videos in association with the search for the user's travel route.

[0060] The user sharing module 2046 is a module for performing a process of sharing, among users, the results of a route search performed by a user and a route guidance video related to the travel route obtained by the route search.

[0061] Specifically, the user-to-user sharing module 2046 issues a URL (Uniform Resource Locator) including the search results (search criteria) so that other users other than the user who performed the search can refer to the results of the route search. The user-to-user sharing module 2046 issues a URL for sharing route guidance videos (or a playlist for playing multiple route guidance videos) searched for in relation to the travel route searched by the route search. A user can share search results with other users by sending the URL to the other users via a messaging tool or the like.

[0062] <1.3 Configuration of Terminal 10> FIG. 3 is a block diagram showing the functional configuration of the terminal 10. As shown in FIG.

[0063] As shown in FIG. 3, the terminal 10 includes a plurality of antennas (antenna 111, antenna 112), communication units (first communication unit 120, second communication unit 121) corresponding to the respective antennas, an input device 130 (including a touch-sensitive device 131), a display 132, an audio processing unit 140, a microphone 141, a speaker 142, a position information sensor 150, a camera 160, a motion sensor 170, a storage unit 180, and a control unit 190. The terminal 10 also has functions and configurations (e.g., a battery for storing power, a power supply circuit for controlling the supply of power from the battery to each circuit, etc.) that are not particularly shown in FIG. 3. As shown in FIG. 3, each block included in the terminal 10 is electrically connected by a bus or the like.

[0064] The antenna 111 radiates a signal generated by the terminal 10 as a radio wave. The antenna 111 also receives the radio wave from space and provides the received signal to the first communication unit 120.

[0065] The antenna 112 radiates a signal generated by the terminal 10 as a radio wave. The antenna 112 also receives the radio wave from space and provides the received signal to the second communication unit 121.

[0066] The first communication unit 120 performs modulation and demodulation processing and the like for transmitting and receiving signals via the antenna 111 so that the terminal 10 can communicate with other wireless devices. The second communication unit 121 performs modulation and demodulation processing and the like for transmitting and receiving signals via the antenna 112 so that the terminal 10 can communicate with other wireless devices. The first communication unit 120 and the second communication unit 121 are communication modules including a tuner, a Received Signal Strength Indicator (RSSI) calculation circuit, a Cyclic Redundancy Check (CRC) calculation circuit, a high-frequency circuit, and the like. The first communication unit 120 and the second communication unit 121 perform modulation and demodulation, frequency conversion, and the like of wireless signals transmitted and received by the terminal 10, and provide the received signals to the control unit 190.

[0067] The input device 130 has a mechanism for accepting an input operation by a user. Specifically, the input device 130 is configured as a touch screen and includes a touch-sensitive device 131. The touch-sensitive device 131 accepts an input operation by a user of the terminal 10. The touch-sensitive device 131 detects a touch position of the user on the touch panel by using, for example, a capacitive touch panel. The touch-sensitive device 131 outputs a signal indicating the touch position of the user detected by the touch panel to the control unit 190 as an input operation.

[0068] Display 132 displays data such as images, videos, and text under the control of control unit 190. Display 132 is realized by, for example, an LCD, an organic EL display, or the like.

[0069] The audio processing unit 140 modulates and demodulates an audio signal. The audio processing unit 140 modulates a signal provided from the microphone 141 and provides the modulated signal to the control unit 190. The audio processing unit 140 also provides the audio signal to the speaker 142. The audio processing unit 140 is realized by, for example, a processor for audio processing. The microphone 141 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 140. The speaker 142 converts the audio signal provided from the audio processing unit 140 into audio and outputs the audio to the outside of the terminal 10.

[0070] The position information sensor 150 is a sensor that detects the position of the terminal 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals are received from at least three or four satellites, and the current position of the terminal 10 equipped with the GPS module is detected based on the received signals.

[0071] The camera 160 is a device that receives light with a light receiving element and outputs the received light as a captured image. The camera 160 is, for example, a depth camera that can detect the distance from the camera 160 to a subject being photographed.

[0072] The motion sensor 170 includes an acceleration sensor, an angular velocity sensor, etc., and detects the movement of the terminal 10 .

[0073] The storage unit 180 is configured, for example, from a flash memory or the like, and stores data and programs used by the terminal 10. The various types of information stored in the storage unit 180 will be described later.

[0074] The control unit 190 reads a program stored in the storage unit 180 and executes instructions included in the program to control the operation of the terminal 10. The control unit 190 is, for example, an application processor. The control unit 190 operates according to the program to fulfill the functions of an operation reception unit 191, a transmission / reception unit 192, a data processing unit 193, a notification control unit 194, and a storage control unit 195.

[0075] The operation reception unit 191 performs a process of receiving a user's input operation to an input device such as the touch-sensitive device 131. The operation reception unit 191 determines the type of operation, such as whether the user's operation is a flick operation, a tap operation, or a drag (swipe) operation, based on information about the coordinates where the user touches the touch-sensitive device 131 with a finger or the like.

[0076] The transmission / reception unit 192 performs processing for the terminal 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol.

[0077] The data processing unit 193 performs calculations on the data that the terminal 10 accepts as input in accordance with a program, and outputs the calculation results to a memory or the like.

[0078] The notification control unit 194 performs processing for displaying a display image on the display 132, processing for outputting sound from the speaker 142, and processing for generating vibrations.

[0079] The storage control unit 195 controls the storage of data in the storage unit 180. For example, the storage control unit 195 causes the storage unit 180 to store various data based on the operation of the user information 181.

[0080] A description will now be given of various types of information stored in storage unit 180. In one aspect, storage unit 180 stores user information 181 and map information 182.

[0081] The user information 181 is information about a user who uses the service provided by the server 20 .

[0082] The map information 182 is map information provided by a map service provided by the server 91 of a map service provider. When displaying a map related to a travel route to a user, the terminal 10 acquires the map from the map service and stores it as the map information 182, and then displays the map related to the travel route to the user.

[0083] <2 Data Structure> FIG. 4 is a diagram showing the data structure of a video management database 921 managed by the server 92 of a video distribution company.

[0084] The video management database 921 includes the items "content ID," "poster user ID," "video title," "video description," "related tags," "posting date," "thumbnail image," "number of views," "number of comments posted," "rating," and "playback time."

[0085] The item "content ID" is identification information for identifying each video.

[0086] Specifically, the item "Content ID" is identification information issued to each video by the video distribution provider's server 92 when a contributor uploads video data to the video distribution provider's server 92 or makes the video public.

[0087] The item "Contributor User ID" is identification information for identifying each user who is the contributor who posted each video.

[0088] Specifically, the item "Contributor User ID" is identification information issued to a user when the user registers on the video distribution provider's server 92, or when the user uses or links an ID of another service (such as various cloud services) as an ID for the video distribution provider's service.

[0089] The item "moving image title" is a title set by the user for each moving image.

[0090] Specifically, the item "video title" is information that is set by accepting text or the like indicating the title of a video when a user makes a video available to third parties on the video distribution provider's server 92.

[0091] The item "video description" is a description of each video set by the user.

[0092] Specifically, the item "video description" is information that is set when a user makes a video available to third parties on the video distribution provider's server 92, by accepting a description that allows viewers to check details on a web page for viewing each video, separate from the text of the video's title.

[0093] The item "related tags" is a tag that the user sets for each video.

[0094] Specifically, the item "Related Tags" is a keyword that the video poster or viewer arbitrarily sets for the video, and is information that accepts input as a tag for the video by setting a keyword together with a specified symbol (e.g., a hashtag).

[0095] The item "posting date" is information that indicates the timing when each video was posted to server 92 of the video distribution company.

[0096] Specifically, the item "posting date" is information that is set as the posting date of a video depending on the timing when the user makes the video available to third parties on the video distribution company's server 92. The information on the posting date is provided to viewers of the video.

[0097] The item "thumbnail image" is information about a thumbnail image set for each video.

[0098] Specifically, the item "thumbnail image" is information on a thumbnail image set by the poster of the video. When videos that are candidates for playback are displayed to the viewer, the thumbnail image is displayed to assist the viewer in selecting a video.

[0099] The item "number of plays" is information on the number of times each video has been played by viewers through the services of a video distribution company.

[0100] The item "number of comments posted" is information indicating the number of comments posted by users such as viewers for each video.

[0101] The item "rating" is information indicating the results of ratings given by users such as viewers to each video.

[0102] Specifically, the item "Rating" is information that indicates the results of viewers' ratings of a video, which is accumulated when viewers of a video give the video a positive rating (like, good button) or a negative rating (not good, bad button) on the video distribution service.

[0103] The item "playback time" is information indicating the time required to play the video (length of the video).

[0104] In addition to the information shown in the figure, the video distribution company's server 92 also holds a database of the viewing history of videos played by each user. The viewing history database manages, for example, the ID of the user who viewed the video, the content ID of the content that was the subject of viewing, information on the timing of the user's playback of the video in the time required to play the video (for example, the user is viewing the video at 4 minutes into a 12-minute video), and information such as the viewing date and time when the video was played. In a video management database 921, the video distribution company's server 92 manages, based on the viewing history of each video of each user in the viewing history database, the total number of times each video was played and the number of comments posted, etc.

[0105] FIG. 5 is a diagram showing the data structure of the route search history 282. As shown in FIG.

[0106] Route search history 282 includes an item "search history ID", an item "search user ID", an item "search date and time", an item "user's location at time of search", an item "starting point", an item "destination", an item "waypoint 1", an item "related route guidance video 1", an item "search options", an item "scheduled departure and arrival dates and times", an item "detour route", an item "videos viewed", an item "video viewing date and time", and an item "location of video viewing".

[0107] The item "search history ID" is information for identifying each history of route searches performed by the user.

[0108] The item "search user ID" is information that identifies each user who performed a route search.

[0109] The item "search date and time" is information indicating the time when the user performed a route search.

[0110] Specifically, the item "search date and time" may hold the following as the timing when the user performed a route search. The timing when the user specifies route search conditions such as the starting point in the route search service and performs an operation to instruct a search (such as pressing the start search button) When a user accessed the route search service The item "user's location at time of search" is information indicating the user's location when the user performed a route search.

[0111] Specifically, the item "user's location at the time of search" may hold the following information as the user's location. Location information acquired by the location information sensor 150 or the like in the user's terminal 10 (for example, the location information of the terminal 10 may be acquired on a screen for specifying route search conditions) The item "starting point" is information indicating the starting point from which the user performs a route search.

[0112] Specifically, the item "starting point" may include the following: Facilities for users to use public transport (stations, bus stops, airports, etc.) Any latitude and longitude coordinates Any building (store, etc.) Locations registered as tourist destinations, etc. The item "destination" is information indicating an arrival point (destination) for which the user searches for a route.

[0113] The item "waypoint 1" is information indicating a point on the route that is set by the user or the system 1 in conjunction with a route search.

[0114] The item "related route guidance video 1" is information on a video related to a route search performed by the user.

[0115] Specifically, the item "related route guidance video 1" includes information on route guidance videos related to a travel route obtained by a user's search using a route search service. The server 20 can generate a playlist of route guidance videos as follows by searching for route guidance videos related to the user's travel route. The process in which the server 20 searches for route guidance videos from the server 92 of the video distribution company will be described later in the description of the flowchart. A single video guide from departure point to destination - Multiple route guidance videos covering the journey from departure point to destination via intermediate points From the starting point to the destination, there is no driving guidance video for a specific section of the route, but the rest of the route is covered by driving guidance video. The item "search options" is information indicating search conditions designated by the user when performing a route search.

[0116] Specifically, the item "search options" may include the following as search conditions related to travel routes: Regarding public transport, whether or not you will be using a service that requires a fee just to use the vehicle (such as express trains) Do you travel by air? · Do you prioritize cheaper fares? · Do you prioritize short travel times? Do you give preference to certain payment methods (such as IC cards) that can be used for travel? Furthermore, the search conditions included in the item "search options" may include the following search conditions related to road navigation videos, which will be described in detail later in the explanation of the flowchart. · Few or many driving directions videos Fewer or more ads The item "Scheduled departure / arrival date and time" is information indicating the date and time of travel when the user searches for a route.

[0117] Specifically, the item "Scheduled departure and arrival dates and times" may include the following as dates and times related to travel. Date and time the move will begin Travel and arrival date and time The earliest time period during which public transport services are available on a business day (first departure) The last time public transport services are available on a business day (last train) The item "detour route" is information indicating a detour route that detours around a route shown in the search results when the detour route is set by performing a route search based on conditions specified by the user.

[0118] Specifically, the item "detour route" includes a detour route that is set by searching for a route guidance video including the vicinity of a point on a travel route obtained by a user's route search, when the route guidance video is interrupted at that point. Details will be described later in the explanation of the flowchart.

[0119] The item "Video Viewed" is information indicating a video that a user who performed a route search viewed while referring to the route search results.

[0120] Specifically, the item "viewed video" includes information on the route guidance video that the user viewed while referring to the route search results.

[0121] The item "video viewing date and time" is information indicating the time when a user who performed a route search viewed a video while referring to the route search results.

[0122] The item "video viewing location" is information indicating the location where a user who performed a route search viewed a video while referring to the route search results.

[0123] FIG. 6 is a diagram showing the data structure of the map database 911. As shown in FIG.

[0124] The map database 911 includes an item "object ID", an item "attribute 1", an item "attribute 2", an item "address", an item "latitude", an item "longitude", an item "business hours", an item "frequency of visit", an item "landmark rating", and an item "contact information".

[0125] The item "object ID" is information for identifying each object that displays the name of a facility, place, etc. on the map data.

[0126] Specifically, the item "Object ID" includes the following as the above targets (objects): Commercial facilities Public facilities Facilities for using public transport services (stations, bus stops, etc.) Tourist attractions (nature, architecture, etc.) The item "Attribute 1" is information about the attribute of an object, for example, information indicating a relatively large category.

[0127] The item "Attribute 2" is information about the attribute of an object, and is, for example, information indicating a more specific category compared to the item "Attribute 1".

[0128] The item "Address" is information about the address where the object is located.

[0129] The item "latitude" is information on the latitude among the coordinates at which an object is located.

[0130] The item "longitude" is information on the longitude of the coordinates at which the object is located.

[0131] The item "Business Hours" is information indicating the time period during which entry is permitted when the object is a facility or the like.

[0132] The item "Visit Frequency" is information indicating the frequency with which people visit the object.

[0133] Specifically, the item "Visit Frequency" includes information accumulated on the frequency of visits of each user to each facility, etc. by collecting the location of each user using the map service (location information acquired by each user's terminal 10).

[0134] The item "landmark evaluation" is information indicating the degree to which an object is a famous place and functions as a landmark.

[0135] Specifically, the item "landmark evaluation" may hold a value that evaluates the degree to which the feature functions as a landmark by weighting the following information: Frequency of visits by each user (location information history of each user's terminal 10) The number and frequency of comments posted by each user on map services etc. about the object Furthermore, the map service provider may set objects that function as landmarks.

[0136] The item "contact information" is information on the contact information for the facility or the like represented by the object.

[0137] <Processing flow> FIG. 7 is a diagram showing a process flow for presenting a route guidance video together with the search results in response to a route search by a user.

[0138] In step S721, the server 20, in response to an access from the terminal 10, transmits to the terminal 10 information on a screen for accepting a route search.

[0139] In step S711, the terminal 10 displays a screen for route search, and receives input of a departure point, a destination, search options, and other information from the user as information about the travel route along which the user will travel.

[0140] The terminal 10 accepts, from the user, designation of search conditions for searching for a route guidance video related to a travel route on a screen for searching for a travel route.

[0141] In step S723, the server 20 searches for information on a travel route including the use of public transportation from the information on the departure point and the information on the destination.

[0142] In step S725, the server 20 searches for route guidance videos from a video distribution service based on the departure point information and the destination information.

[0143] For example, the server 20 searches the server 92 of the video distributor for route guidance videos that include the departure point information and destination information received from the terminal 10 in keywords.

[0144] Alternatively, when the server 20 searches for a travel route using the information on the departure point and the information on the destination received from the terminal 10, the server 20 arbitrarily selects each point included in the travel route and searches for a route guidance video from the video distribution company's server 92. For example, the server 20 searches for a route guidance video that travels a route longer than the user's travel route.

[0145] In step S727, the server 20 transmits the search result for the user's route search and information on the route guidance video corresponding to the searched route to the terminal 10. The server 20 updates the route search history 282 based on the information on the travel route searched in response to the user's route search operation.

[0146] As described above, the server 20 searches for one route guidance video that covers the travel route searched for by the route search service, and presents the search result to the user of the terminal 10.

[0147] In step S713, the terminal 10 displays the route search result and the route guidance video corresponding to the route, and enables the route guidance video to be played back.

[0148] FIG. 8 is a diagram showing a process flow for setting one or more waypoints on a travel route and presenting a route guidance video when a route guidance video from the starting point to the destination of the travel route is not found.

[0149] In step S825, the server 20 searches the video distribution service for a first route guidance video that completes guidance from the departure point to the destination in one video, based on the departure point information and the destination information. If the first route guidance video is not found, the server 20 sets any of the points on the travel route as a waypoint and searches for multiple route guidance videos based on the departure point information, the waypoint information (including the vicinity of the waypoint on the travel route), and the destination information, so as to connect the travel route while shortening the blank section without route guidance video.

[0150] The server 20 may set a route point as follows. By making an inquiry to the server 91 of the map service provider, information on frequently visited points and points with a certain or higher landmark rating in the map database 911 is obtained, and these points are set as route points. When searching for a route from a departure point to a destination using a route search service, information on intermediate points set by the route search service is obtained. When a route search service searches for a route determined by specifying a departure point to a destination, one or more points on the route are extracted, and these extracted points are set as candidates for intermediate points, with at least one of the points set as an intermediate point. The server 20 may search for route guidance videos from the server 92 of the video distribution company as follows. The server 20 searches for a route guidance video including a trip from a departure point to a route point by using information on the departure point and information on the route point as search keywords and searching "video title," "video description," and "related tags" (video management database 921). Similarly, the server 20 searches for a route guidance video from a route point to another route point and a route guidance video from a route point to a destination.

[0151] When a route destination is set but a route guidance video including the route destination cannot be obtained by searching, the server 20 extracts information about nearby points from the route destination and uses the information about the nearby points to search for route guidance videos to the nearby points or route guidance videos starting from the nearby points.

[0152] Points nearby the transit point include: Any point within a certain distance from the stop Travel from a stop point (on foot or by public transport) to any other point within a certain period of time Landmarks that are within a certain distance from a route point or within a certain travel time from a route point (for example, landmarks that have a "landmark rating" of a certain level or higher in the map database 911 as a result of evaluations other than those of route search services) When a route point is set but a route guidance video including the route point cannot be obtained by searching, the server 20 weights the search results for the route guidance video based on blank sections on the travel route where no route guidance video is present. Combination of route guidance videos that shorten the length of blank sections (the distance information of the relevant section can be obtained by route search services) Combination of route guidance videos that shorten travel time in blank sections (travel time information for the relevant section can be obtained through route search services) In step S827, the server 20 transmits the search results for the user's route search and information on a plurality of route guidance videos that correspond to the searched route and extend from the departure point to the destination via the intermediate points to the terminal 10. If the server 20 has searched for route guidance videos including areas near the intermediate points, the server 20 sets a detour route that is different from the travel route determined by the route search results, and transmits the detour route and route guidance videos providing guidance on the detour route to the terminal 10. The server 20 searches for a travel route in accordance with the user's route search, searches for a detour route, and updates the route search history 282 based on the search for the route guidance videos.

[0153] When the user has specified search conditions for the road guidance video, the server 20 transmits the search results for the road guidance video to the terminal 10 according to the search conditions.

[0154] In step S813, the terminal 10 displays the route search result and the route guidance video corresponding to the route, and enables playback of the route guidance video. If a detour route is set as a result of the route search, the terminal 10 displays the route guidance video together with the detour route in a playable manner.

[0155] When there is a blank section in the travel route where there is no route guidance video, the terminal 10 presents to the user content different from the route guidance video for the blank section.

[0156] The server 20 may present to the user content other than the route guidance video for blank sections on the travel route where there is no route guidance video, and may present the following. Map (2D or 3D) information for blank sections stored on the map service provider's server 91, etc. Audio guidance to guide users along a route (for example, a navigation button that provides navigation guidance on a route screen that responds to a user's route search, and audio guidance is played in response to input operations on that button. The route search service responds with route search results that include travel on public transport services) For blank sections, photos stored on the server 91 of the map service provider (e.g., 360-degree images taken by a spherical camera, etc., associated with coordinates on the map) Advertisements related to the user's location (for example, advertisements related to the user's current location when the user is moving through the blank section based on the location information of the terminal 10) Advertisements related to a user's route search history (for example, ads associated with points along a route searched using a route search service) Random ads that are not relevant to the user Here, the terminal 10 may display content different from the route guidance video as follows, depending on the distance of a blank section where there is no route guidance video or the time required to travel through the blank section. If the distance or travel time of the blank section is below a certain value (i.e., the section without navigation video is below a certain value), display advertisements related to the user's current location. If the distance or travel time of the blank section is greater than a certain amount, the user is presented with a map display, voice guidance by navigation, route guidance by still images, or a combination of these. When the server 20 provides route guidance to the user using route guidance moving images or still images, the server 20 may arrange the following contents so that they can be played back simultaneously. Directions videos shot from different angles Still images taken from different angles The server 20 may present the user with a route guidance video for another destination according to the degree of congestion at the destination on the user's travel route. For example, there may be circumstances in which congestion causes a delay in arriving at the destination, or the destination is so crowded that the user may not be able to use the destination as intended.

[0157] The server 20 may present the user with a route guidance video to another destination according to the user's walking speed. For example, when the user's walking speed is relatively slow, the travel time may be long and the travel burden may be large, so a route guidance video to another destination may be presented.

[0158] The server 20 updates the route search history 282 in response to the user viewing the route guidance video and the advertisement.

[0159] FIG. 9 is a diagram showing a process flow for updating the presentation of route guidance video as needed in accordance with the movement of the user.

[0160] In step S901, the terminal 10 acquires location information of the terminal 10 while displaying the route search result and a route guidance video relating to the travel route.

[0161] In step S903, the terminal 10 updates the list of route guidance videos to be presented to the user in accordance with the location of the terminal 10, and controls the method of playing the route guidance videos.

[0162] The terminal 10 may provide guidance on movement along a travel route according to the user's position (position information of the terminal 10) and may perform the following. Update the list of navigation videos to make it easier for users to select navigation videos that are highly relevant to their journey For example, the terminal 10 can perform processing such as hiding from the playback list of route guidance videos the portion of the route that the user has already traveled from the starting point that the user has searched for using a route search service, thereby making it easier for the user to find and play the route guidance video that he or she needs. Control the playback method of route guidance videos, and give priority to the playback of route guidance videos that are highly necessary for the user's journey. For example, when the user is moving while referring to the road guidance video, the terminal 10 controls the section for playing the road guidance video so as not to play the range where the user has already moved. For example, when the user has moved to a certain extent within the section covered by the road guidance video, the terminal 10 controls the time point at which the road guidance video starts to be played so as to loop-play the section after the user has moved. For example, in the road guidance video, information such as from where to where the user has moved may be created in the summary section or chapter of the video. The terminal 10 can also estimate the location of each frame of the road guidance video by analyzing each moving image constituting the road guidance video.

[0163] <Screen example>

[0164] (Screen for searching routes and road guidance videos) FIG. 10 is an example of a screen in the system 1, showing an input screen for a route search service.

[0165] A screen 1001 is a screen for accepting both a route search and a search for videos related to the route.

[0166] A route search input screen 1002 is a screen for receiving route search details from the user.

[0167] The departure point input field 1002A is an area for receiving a departure point specification from the user.

[0168] The destination input field 1002B is an area for receiving a destination specification from the user.

[0169] The date and time input field 1002C is an area for receiving a date and time specification for the movement from the user.

[0170] As shown in the figure, in the date and time input field 1002C, the terminal 10 accepts from the user a designation of whether the date and time is a "departure" time or an "arrival" time in association with the date and time designated by the user. The terminal 10 accepts an operation to search for the "first train" on the date designated by the user, that is, the earliest time when public transportation starts operating on that day. The terminal 10 also accepts an operation to search for the "last train" on the date designated by the user, that is, the last train when public transportation ends operating.

[0171] The route display order designation portion 1002E is an area for accepting a setting of the priority of the travel route to be searched from the user.

[0172] The route display order designation unit 1002E accepts the following from the user as the priority of the travel route. Prioritize routes that require less travel time Prioritize routes with low travel costs (fares) Prioritize routes that require fewer public transport transfers The transfer time designation section 1002F is an area for accepting a setting of the travel time required for transferring between public transportation means from the user.

[0173] The transfer time designation unit 1002F may accept the following settings as the time required for transfer. - Transfer times are relatively long (e.g., you have a lot of luggage and it takes time to move around) Transfer times are normal (normal) Short transfer times (e.g., you have little luggage and can walk briskly) The fare display specification section 1002G is an area for receiving, from the user, specification of the nature of the fare to be applied when the fare required for using public transportation is displayed in a route search.

[0174] The fare display designation unit 1002G may be configured to accept the following designations from the user as the nature of the fare. Priority given to IC cards (if you use an IC card to board the train, the fare may be different from if you purchase a ticket instead and pass through the ticket gate) The express fare specification section 1002H is an area for receiving specification of whether or not to use a vehicle, such as an express train, for which a fee is charged for using the vehicle itself, in a route search.

[0175] The transportation means specification section 1002J is an area for receiving specification of the transportation means to be used by the user in route search.

[0176] As shown in the figure, the transportation means designation section 1002J accepts designation of transportation means including "walking."

[0177] The video search condition designation section 1002K is an area for accepting designation of search conditions from the user for searching for a route guidance video related to the travel route that the user is searching for.

[0178] The video search condition designation unit 1002K may accept the following designations from the user as conditions for searching for route guidance videos. Fewer navigation videos are needed to cover a route The blank sections between navigation videos are short (for example, (1) the blank sections are set to a certain distance or less or the travel time for the blank sections is set to a certain distance or less (for example, a detour route has a smaller blank section than the shortest route, but the shortest route may also be tolerable for a short blank section), or (2) a blank section with as short a blank section as possible is given priority (for example, if a detour route has a shorter blank section than the shortest travel route, the detour route is given priority). · The driving directions video is short in duration The time required to play one or more navigational videos along the route (including detours) is short. The creation date of the navigation video is recent (it is assumed that a more recent navigation video is more likely to match the situation at the time of viewing the navigation video than an older one) Fewer ad videos The video search text specification section 1002L is an area for accepting keywords for searching for route guidance videos from the user.

[0179] The route search receiving section 1002M is an area for receiving an operation to start a route search based on specified conditions from the user.

[0180] The route and video search receiving section 1002N is an area for receiving an operation to start a route search and a search for route guidance videos related to a route based on a specified condition from a user.

[0181] In the illustrated example, the route and video search receiving unit 1002N receives both a route search and a search for a route guidance video, but may receive a search for a route guidance video without a route search. For example, the terminal 10 may start a search for a route guidance video based on a user's specification in the departure point input field 1002A, the destination input field 1002B, etc.

[0182] The current location acquisition unit 1002P is an area for accepting an operation to refer to the location information of the terminal 10 in order to set the starting point of the travel route. In response to a user's operation on the current location acquisition unit 1002P, the terminal 10 acquires the location information of the terminal 10, and reflects the acquired location information in the starting point input field 1002A as the starting point.

[0183] The waypoint setting section 1002Q is an area for accepting an operation to arbitrarily set a waypoint on a travel route. The terminal 10 accepts the setting of a waypoint from the user in response to the user's operation on the waypoint setting section 1002Q. The server 20 may present facilities, points, etc. that have a certain or higher evaluation as landmarks in the map database 911 to the user of the terminal 10 as candidates for a waypoint by inquiring of the server 91 of the map service provider.

[0184] (An example of presenting a navigation video including directions from the starting point to the destination in response to a route search) FIG. 11 is a diagram showing an example of a screen in the system 1, showing a situation in which route search results and route guidance video are displayed.

[0185] A screen 1101 is a screen for providing a route search service to a user.

[0186] The route search display screen 1102 is an area for displaying the search results of the user's route and the search results of route guidance videos related to the route.

[0187] The route candidate display section 1103 is an area that displays route candidates searched in response to the user's designation of route search conditions.

[0188] The route candidate display unit 1103 presents the following as travel route candidates to the user. Origin and destination Dates and times of travel (departure time, arrival time, etc.) Route characteristics (e.g., short distance, low congestion, low delays, etc., in accordance with search criteria) The route details display section 1104 is an area for displaying details of a specific travel route.

[0189] The route details display section 1104 displays the following as details of a specific travel route: Travel time required Departure and arrival times Information that will be helpful in traveling between points along the route (e.g., road names, public transport lines, etc.) · Information on the mode of transportation between each point on the route (walking, train, etc.) The route guidance video display area 1105 is an area for displaying route guidance videos searched for from the server 92 of the video distributor in association with candidates for travel routes.

[0190] The route guidance video display unit 1105 may present the following to the user as information on the route guidance video related to a candidate travel route. · Whether there is a navigation video that covers the journey from the starting point to the destination The thumbnail display portion 1107 is an area for displaying thumbnail images set for the navigation video.

[0191] The video description display section 1108 is an area for displaying information set for the navigation video, such as the video title and summary.

[0192] (Example of guiding a route from a departure point to a destination by connecting multiple navigation videos) FIG. 12 is a diagram showing an example of a screen in the system 1, in which a route guidance video is presented with a travel route divided into a plurality of sections.

[0193] The route details display section 1104 displays information about a specific route, including stopovers, as details of the specific route.

[0194] The playlist display section 1112 is an area for displaying a playlist of a plurality of route guidance videos related to a travel route.

[0195] The playlist display unit 1112 displays each of the route guidance videos as a list when there are multiple consecutive route guidance videos passing through intermediate points on the route from the starting point to the destination specified by the user (when there are no gaps in the section of the route that is explained in the route guidance videos).

[0196] The play button 1112P is an area for accepting an operation to sequentially play back the route guidance videos included in the playlist.

[0197] The thumbnail display portion 1121 is an area for displaying thumbnail images set in the route guidance video.

[0198] The video description display section 1122 is an area for displaying information set for the navigation video, such as the video title and summary.

[0199] The thumbnail display portion 1123 is an area for displaying thumbnail images set in the route guidance video.

[0200] The video description display section 1124 is an area for displaying information set for the route guidance video, such as the video title and summary.

[0201] The playlist display section 1113 is an area for displaying a playlist of a plurality of route guidance videos related to a travel route.

[0202] In the illustrated example, the playlist display section 1113 has the same travel route as that shown in the playlist display section 1112, but different stopovers are set. As a result, the playlist display section 1113 shows an example in which the combination of consecutive route guidance videos along the travel route is different from that shown in the playlist display section 1112.

[0203] The play button 1113P is an area for accepting an operation to sequentially play back the route guidance videos included in the playlist.

[0204] The playlist display section 1114 is an area for displaying a playlist of consecutive route guidance videos on a detour route that passes through a nearby point when a search is performed for consecutive route guidance videos that are not consecutive at each point on the travel route but that include an area near the route point and an arbitrary point on the travel route is set as a waypoint.

[0205] The play button 1114P is an area for accepting an operation to sequentially play back the route guidance videos included in the play list.

[0206] The playlist display section 1115 is an area for displaying a playlist of route guidance videos when there is no continuous route guidance video at each point on the travel route and there is a blank section.

[0207] The play button 1115P is an area for accepting an operation to sequentially play back the route guidance videos included in the playlist.

[0208] The playlist priority setting section 1126 is an area for receiving a setting of the display priority of the list of route guidance videos displayed on the route search display screen 1102 from the user.

[0209] The playlist priority setting unit 1126 may receive the following settings from the user as the priority of the playlist of route guidance videos. A small number of navigation videos (where a small number of navigation videos cover the route from the starting point to the destination) The blank section without navigation video on the route is short Fewer ads (for example, ads are displayed while the user is moving through blank sections) FIG. 13 is a diagram showing an example of a screen in the system 1, in which route search results including public transportation and a route guidance video are presented.

[0210] The route candidate display section 1303 is an area that displays route candidates searched in response to the user's designation of route search conditions.

[0211] The route details display section 1304 is an area for displaying details of a specific travel route.

[0212] As in the illustrated example, the route details display unit 1304 displays travel routes including routes according to the operation schedule of public transportation services such as trains and routes according to the user's own travel (eg, walking).

[0213] The play button 1312 is an area for accepting an operation to play a route guidance video associated with a travel route.

[0214] In the illustrated example, the play button 1312 searches for a route guidance video associated with a specific section of travel or a means of travel (walking in this case) on the travel route, and the play button 1312 is displayed so as to be positioned in association with the specific section of travel or means of travel. This allows the user to easily understand that the route guidance video is associated with a portion of the travel route.

[0215] The route guidance video display section 1305 is an area for displaying route guidance videos retrieved from the video distribution provider's server 92 for a specific section or means of transportation (walking in the illustrated example) in the route in relation to a candidate route.

[0216] The thumbnail display portion 1307 is an area for displaying thumbnail images set in the navigation video.

[0217] The video description display section 1308 is an area for displaying information set for the navigation video, such as the video title and summary.

[0218] FIG. 14 is a diagram showing an example of a screen in the system 1, showing a situation in which the playlist of route guidance videos and the playback position of the videos are updated in response to the movement of the user.

[0219] Compared to the example in FIG. 12, the route details display section 1104 displays the route the user has already traveled, based on the user's travel route and information on the user's current location.

[0220] The current location display section 1131 is an area for displaying the current location of the user on the travel route based on the position information of the terminal 10.

[0221] As shown in the figure, the current location display section 1131 is arranged in association with the route on which the user is located, and displays which section of the travel route the current location is in.

[0222] Compared to the example of Figure 12, the playlist display section 1112 is an area for displaying that the user has already traveled, for navigation videos related to the route the user has traveled, based on the user's travel route and information about the user's current location.

[0223] In the illustrated example, the playlist display unit 1112 displays the route guidance video related to the route that has already been traveled so that the user can recognize that the route guidance video related to the route that has already been traveled is included in the playlist but does not need to be played. Here, the route guidance video related to the route that has already been traveled may be deleted from the list.

[0224] <Variation 1> As described above, the system 1 can be used in the following situations, for example.

[0225] (1) A user searches for a route guide video as a preliminary step before visiting a destination (e.g., a user searches for a route guide video at home before visiting a destination).

[0226] (2) Search for route guidance videos while the user is traveling to the destination (e.g., searching while on the train to the destination)

[0227] (3) When multiple people plan to get together, a video showing directions to the meeting place is shared among users in advance.

[0228] Here, in the cases of (1) and (2) above, the server 20 may rearrange the display order of the search results for the route guidance video depending on the location searched by the user (searched at home, searched while traveling to the destination, etc.) and the number of times searched (whether it was the first time or the second time or later).

[0229] For example, the server 20 may prioritize route guidance videos with short playback times (short length) when the user is on the way to the destination.

[0230] Also, for example, if the server 20 displays an advertisement when the user performs a first search, the server 20 may display a different content in place of the advertisement that has already been displayed when the user performs a second or subsequent search.

[0231] In the case of (3) above, the user who inputs the departure point and the user who inputs the destination may be different.

[0232] For example, assume that five users, a first user A, a second user B, a third user C, a fourth user D, and a fifth user E, are gathering at a destination (such as a store). Each user inputs their home as the starting point to use the route search service. The first user A, who is the organizer, inputs the meeting place as the destination. This allows multiple users to share the destination and use the route search service.

[0233] In the case of (3) above, the destination may be changed depending on the gathering situation of multiple people.

[0234] For example, a fourth user D and a fifth user E may not arrive at the meeting place even when it is time to meet. In this case, the other users, a first user A, a second user B, and a third user C, move from the meeting place to their destination (such as a store) first. The server 20 sends a route guidance video with the location of the store as the destination to the fourth user D and the fifth user E (the route guidance video may include the location of each user or the meeting place as the starting point).

[0235] (Either the starting point or the destination of the route search is set by one of multiple users.) As described above, there are cases where multiple users use a route search service to gather at a destination. The server 20 may accept a destination setting from at least one of the multiple users and provide the other users with a route search screen on which the destination is set. The other users each specify information about their own departure point and perform a route search.

[0236] The server 20 may also accept the setting of a departure point from any of a plurality of users, and accept the designation of the destination of each user with the departure point set for the other users. For example, when a plurality of users gather at a meeting place and head from the meeting place to the destination, there may be a situation in which some users head from the meeting place to the destination first, and the remaining users arrive at the meeting place later. In this case, the remaining users may be informed separately about the destination, with the meeting place as the departure point, and may input the destination into the route search service. Also, even when a plurality of users disperse from the meeting place, the convenience of the route search service may be further improved by allowing the other users to specify their respective destinations (next destinations) with the departure point (meeting place) already specified by some users.

[0237] As described above, the server 20 may accept at least one of the departure point or destination setting from the first user A, and present to the second user B, etc., an operation screen for route search with the departure point or destination already set by the first user A specified.

[0238] <Variation 2>

[0239] (1) Timing of showing route guidance videos to users In the above embodiment, an example has been described in which a user sets a departure point and a destination, and searches for a travel route, and then searches for a route guidance video related to the travel route.

[0240] In addition, the server 20 may search for route guidance videos based on the user's current location (e.g., location information of the terminal 10) without waiting for the user to input a destination. For example, the server 20 may search for route guidance videos related to the user's current location at regular time intervals or each time the user travels a certain distance, and present the search results to the user.

[0241] Navigation videos relevant to the user's current location include: Directions videos whose starting point is the user's current location (extracted by searching the title of the direction video, etc.) Routes shown in navigation videos that include the user's current location (the route in the navigation video is estimated by extracting the starting point and destination based on keywords included in the title, etc. of the navigation video)

[0242] (2) A device that displays the route guidance video you searched for In the above embodiment, an example has been described in which the server 20 displays the search results for the route guidance video on the terminal 10 of the user.

[0243] In addition, the server 20 may display the search results for the route guidance video on a display device, such as a signage terminal, located near the terminal 10. For example, when a search for route guidance videos is accepted at the terminal 10, the server 20 may transmit location information of the terminal 10 to the server 20 to identify a signage terminal located near the location of the terminal 10, and the identified signage terminal may display the search results for the route guidance video.

[0244] Furthermore, the terminal for route search and route guidance video search is not limited to the terminal 10 that the user can carry, but may be a display device that is installed and available to the user.

[0245] (3) When multiple navigation videos are available and navigation videos related to the route are presented The terminal 10 may play a route guidance video related to a point where the user can travel along a route that branches into multiple routes (i.e., when the user reaches a point where there are multiple route options that can be selected along the user's traveling direction), or may identify a playback point in the route guidance video at a point where there are multiple options and play the video from the playback point. This makes it possible to provide the user with a route guidance video at a point where the user is likely to get lost (there may be a situation where there are multiple route options and the user cannot determine which one to choose), making it less likely for the user to get lost.

[0246] (4) How to make it easier for multiple people to reach their destination In the above embodiment, it has been described that the search results for travel routes and the search results for route guidance videos can be shared among a plurality of users.

[0247] (Users share the playback time of the route guidance video) In addition, the server 20 may be able to share information on the time point of playback of the route guidance video being played back by the user with other users. The server 20 acquires a URL for sharing the route guidance video after identifying the timing of playback time for the route guidance video being played back by the user. In this way, the server 20 can enable users to share information on the route guidance video specifying the timing of playback time. The server 20 may issue information for sharing the route guidance video specifying the timing of playback time together with information for sharing the travel route searched by the user, to enable sharing between users.

[0248] In the above example, the server 20 may accept an operation from the user to play the route guidance video, while allowing a frame of the video at any timing to be shared as an image with other users.

[0249] This makes it easy for users to share images or videos related to the destination location of each user or the location where each user is currently located.

[0250] The server 20 may obtain an image of the route guidance video at a given timing by each user sharing an image of a frame at a given timing in the route guidance video, or by generating information indicating a given timing at which playback of the route guidance video should begin, and estimate the location represented by the image ((a) estimating the location of the subject and the angle at which the subject was photographed by comparing buildings, natural objects, etc. contained in the image with (b) aerial photographs or content such as 360-degree images of city streets).

[0251] When multiple people gather (for example, when multiple users share the results of a route search), the server 20 may present each user with a location where the multiple people can easily meet up. For example, the server 20 may manage multiple users as a group, and by accepting an operation to search for a travel route from each user in the group, may weight locations close to the travel route of each user and present the locations to each user. In this case, the server 20 may give a relatively high weight to locations highly evaluated as landmarks.

[0252] (5) Where driving directions video search is available In the above example, the server 20 may provide a route search service and a route guidance video search service to a user above ground or underground (for example, inside a subway station).

[0253] (6) Play a video guide suitable for the location The server 20 may determine the route guidance video to be transmitted to the terminal 10 based on the location (current location) where the user has searched for the route guidance video. For example, when the user searches for a travel route or searches for a route guidance video in a facility such as inside a station ticket gate (whether the user is in the facility is determined based on the location information of the terminal 10 and map data), the user may be notified of an exit in the facility according to the destination to which the user is moving. Since the station may become larger as the number of passengers getting on and off per day increases, such as at a terminal station, the server 20 searches for a route guidance video in the facility that guides the user to exit from an exit appropriate for reaching the destination to which the user wants to move, and enables the user to play the video.

[0254] (7)Other (7-1) Controlling the playback position of route guidance videos according to the user's movement When the user is moving while playing back the road guidance video (e.g., when the user is moving by searching for a route and a road guidance video), the server 20 may control the playback position of the road guidance video in accordance with the user's movement. For example, a seek bar indicating the playback position of the road guidance video may be updated in accordance with the user's movement.

[0255] (7-2) How to search for navigation videos, how to present search results, and how to use the search results The server 20 may receive an evaluation from the user regarding the search results of the route guidance video presented to the user. The server 20 may notify the server 92 of the video distribution company of the evaluation from the user.

[0256] The server 20 may enable each user to save the results of the user's search for route guidance videos, share them with other users, and edit the route guidance videos.

[0257] The server 20 may receive information on the creator of a video from a user as a condition for searching for a route guidance video. For example, if a person who shoots a particular video has created route guidance videos with a certain level of quality or higher, the server 20 can further encourage users to use the service.

[0258] The server 20 may present to the user factors that may affect the user's smooth travel, such as the congestion situation on the travel route searched by the user, disaster information, and the like.

[0259] In the above example, in step S725, etc., the route guidance videos searched for based on the route search conditions are associated with the video title, video description, video tags, etc., but the above route guidance videos may be searched for for which information about a route consisting of multiple points (a route that includes at least a starting point and a destination and is searched for by a route search service) is not associated.

[0260] (7-3) Search target In the above example, the server 20 searches for route guidance videos as content to be searched in conjunction with a route search. In addition, the server 20 may search for the following content other than route guidance videos in accordance with a route search, and present the search results for the content together with the search results for the route search. Content that includes information about locations. For example, articles about tourist spots posted on websites, etc. For example, businesses in the tourism industry (and businesses in other industries) such as travel, transportation, accommodation, food and beverage, amusement, and souvenir industries may post tourist guide articles and make them searchable. These articles include information about the locations of tourist spots (such as addresses of facilities). Individuals may also post articles about their tourist experiences on blogs, etc., and make them public. As described above, content that includes information about a location may display an operating member that accepts operations by a user who wants to use the experience, in order to easily provide an experience that the user can use at that location, as follows. Operations for using facilities (e.g., accommodation facilities, amusement facilities). For example, operations for purchasing tickets to enter a facility, operations for selecting accommodation dates, accommodation plans, and paying for accommodation at an accommodation facility, etc. An operation to search for a route to a facility. For example, the location information included in the content (if it is an article about a tourist spot, the location information of the tourist spot) is set as the destination or starting point in the route search, and a route search is accepted from the user. As described above, the server 20 identifies location information corresponding to the route based on the result of the route search, for example, in the process of step S725, etc. For example, the server 20 identifies the starting point of the route, the destination, and any point on the route from the starting point to the destination (any number of points may be extracted), and based on this information, searches for content including information on locations, such as tourist articles.

[0261] The server 20, for example, in the process of step S727, outputs the search result of the content including the information related to the position together with, for example, the result of the route search to the terminal 10. The terminal 10 displays the result of the route search and the search result of the content including the information related to the position corresponding to the route.

[0262] Here, when presenting the search results of content including information related to locations to the user, the server 20 may preferentially present to the user content that the user has previously viewed. For example, the server 20 may refer to the user's history of viewing tourist articles, and, depending on the result of the user's route search, preferentially present to the user tourist articles that the user has previously viewed.

[0263] This allows the user to easily obtain more detailed information about the travel route, further improving the user's travel experience.

[0264] Furthermore, the server 20 may present the search results of the content including information related to the location searched for to the user, and may present an operating member that accepts a user's operation for using an experience at that location, and may perform processing to allow the user to use the experience, such as reserving a facility, purchasing a ticket, etc. This allows the user to more easily enjoy experiences available at the destination while traveling.

[0265] (7-4) Route search and route guidance video search using other services As described in (7-3) Search Target above, in a service incorporating a route search function, a route search operation may be accepted, and content including information on directions and locations may be searched for according to the results of the route search. For example, the following forms are possible. - An operation screen that displays information on tourist spots and incorporates an operation screen for route search (for example, as shown in Figure 10, which accepts input of departure point, destination, date and time, etc.) or an operation member that transitions to an operation screen for route search. Services that accept searches and reservations for accommodations, that incorporate functions for searching routes to travel to the accommodations, searching for means of transportation to travel (railroad, bus, airplane, ship, etc.) and accepting reservations, or operation elements that transition to a screen for using such functions As a result, the server 20 can, for example, allow the user to first search for articles about tourist spots and extract general destination candidates, and then provide the user with search results for content including routes to these destinations, route guidance videos along the routes, and location-related information, thereby further increasing the resolution of the information used by the user to decide on a destination, making it easier for the user to decide on a destination.

[0266] In this way, the server 20 may respond to the external service with a travel route search, a route guidance video corresponding to the travel route search result, content including information about a location, etc. In the external service, location information (information about the location of tourist attractions, facilities, etc.) may be associated with content that the user can view in the service, and the server 20 may receive location information associated with the content viewed by the user in the external service, set it as a departure point or destination, and receive a route search operation by the user.

[0267] Although several embodiments of the present disclosure have been described above, these embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are within the scope of the invention and its equivalents as described in the claims, as well as the scope and spirit of the invention.

[0268] <Additional Notes> The matters explained in the above embodiment will be supplemented below.

[0269] (Appendix 1) A program for operating a computer having a processor and a memory, the program causing the processor to: A step of accepting a travel route that is a route traveled by a user and includes at least a starting point and a destination; searching for a route guidance video related to the user's travel route based on at least one of the received information on a departure point, information on a destination point, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain starting point to a destination, presenting the route guidance video extracted by the search to a user.

[0270] (Appendix 2) The program according to claim 1, wherein in the presenting step, one or more route guidance videos are presented so as to cover the accepted user's travel route.

[0271] (Appendix 3) In the searching step, if a navigation video from the starting point of the user's travel route to the destination is not searched for, one or more intermediate points on the travel route are set, and navigation videos from the starting point of the travel route to the intermediate point, from the intermediate point to another intermediate point, and from the intermediate point to the destination are searched for; The program according to claim 2, wherein in the presenting step, the searched route guidance video is presented to the user together with intermediate points of the travel route.

[0272] (Appendix 4) 4. The program according to claim 3, wherein in the searching step, a location or facility that satisfies certain conditions is set as a transit point.

[0273] (Appendix 5) In the searching step, when no route guidance video related to a route point on the user's travel route is searched for, a route guidance video related to the route point is also searched for in the vicinity of the route point that is within a predetermined range from the route point; A program according to any one of appendices 1 to 4, wherein in the presenting step, a route guidance video including the vicinity of a route destination is presented to the user.

[0274] (Appendix 6) A program described in any of Appendices 1 to 5, in which, in the presentation step, if no route guidance video is searched for regarding an intermediate point on the user's travel route, route guidance videos are presented to the user so as to shorten the length of a section of the travel route where there is no route guidance video, or so as to shorten the travel time for that section.

[0275] (Appendix 7) In the searching step, if no route guidance video related to the intermediate point on the user's travel route is searched for, a detour route that bypasses the intermediate point is set, and a route guidance video related to the detour route is searched for; A program according to any one of appendices 1 to 6, wherein in the presenting step, a route guidance video is presented to the user together with a detour route that bypasses the intermediate location.

[0276] (Appendix 8) A program described in any one of appendices 1 to 7, wherein in the presenting step, if there is a section on the user's travel route where there is no route guidance video, content other than the route guidance video is presented to the user in that section.

[0277] (Appendix 9) The program described in Appendix 8, in which in the presenting step, as content other than the route guidance video, at least one of advertisements related to the user's current location, advertisements related to the user's route search history, and audio guidance of a route provided by a service that responds with routes including the use of public transportation in response to route search conditions specified by the user is presented to the user.

[0278] (Appendix 10) A program described in any of Appendices 1 to 9, in which, in the presentation step, in response to a movement of the user's location, at least one of updating a list of route guidance videos to be presented to the user based on the user's location and controlling a method of playback of the route guidance videos.

[0279] (Appendix 11) A program described in any one of Appendices 1 to 10, in which in the presentation step, search results for routes including public transportation for the accepted user's travel route are presented to the user, and in the search results for the travel route, a road guidance video for the section is presented in association with the display of the travel route and associated with one or more sections that make up the travel route, so that the user can view it.

[0280] (Appendix 12) In the receiving step, a text input is received from a user, A program according to any one of appendices 1 to 11, wherein in the searching step, a route guidance video is searched for based on the input text.

[0281] (Appendix 13) By presenting an operation screen for searching for a travel route to a user, the system accepts designation of a departure point and a destination from the user, and responds to the user with search results for a travel route from the departure point to the destination, The program according to claim 1, which presents an operation screen to a user in a state in which at least one of a departure point or a destination set by a user other than the user is specified without any operation by the user.

[0282] (Appendix 14) The program described in Appendix 1, in which, in the searching step, content including information regarding positions related to the user's travel route is searched for based on at least one of the received information on the departure point, information on the destination, and information regarding positions on the route determined from the departure point and the destination, and in the presenting step, content including information regarding the searched position is presented to the user.

[0283] (Appendix 15) 1. A method of operating a computer having a processor and a memory, the method comprising the processor: A step of accepting a travel route that is a route traveled by a user and includes at least a starting point and a destination; searching for a route guidance video related to the user's travel route based on at least one of the received information on a departure point, information on a destination point, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain starting point to a destination, presenting the route guidance videos retrieved by the search to a user.

[0284] (Appendix 16) An information processing device including a processor and a memory, the processor comprising: A step of accepting a travel route that is a route traveled by a user and includes at least a starting point and a destination; searching for a route guidance video related to the user's travel route based on at least one of the received information on a departure point, information on a destination point, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain starting point to a destination, presenting the route guidance video extracted by the search to a user.

Claims

1. A program for operating a computer having a processor and a memory, the program causing the processor to: A step of accepting a travel route that is a route traveled by a user and that includes at least a starting point and a destination; searching for a route guidance video related to the travel route of the user based on at least one of the received information on the departure point, the information on the destination, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain departure point to a destination, presenting the route guidance video extracted by the search to the user.

2. The program according to claim 1 , wherein in the presenting step, one or more of the route guidance videos are presented so as to cover the accepted travel route of the user.

3. In the searching step, if the navigation video from the starting point to the destination of the user's travel route is not searched for, one or more intermediate points on the travel route are set, and the navigation video from the starting point to the intermediate point, from the intermediate point to another intermediate point, and from the intermediate point to the destination of the user's travel route is searched for; The program according to claim 2 , wherein in the presenting step, the searched route guidance video is presented to the user together with the waypoints on the travel route.

4. 4. The program according to claim 3, wherein in said searching step, a point or facility that satisfies a specific condition is set as said intermediate point.

5. in the searching step, when the route guidance video related to the route point on the user's travel route is not searched for, the route guidance video related to the route point is also searched for in the vicinity of the route point that corresponds to a point within a predetermined range from the route point; The program according to claim 3 , wherein in the presenting step, the route guidance video including the vicinity of the route point is presented to the user.

6. The program of claim 3, wherein, in the presenting step, if the route guidance video relating to an intermediate point on the user's travel route is not searched for, the route guidance video is presented to the user so that the length of a section on the travel route where there is no route guidance video is shortened or the travel time for that section is shortened.

7. In the searching step, if the route guidance video related to the intermediate point on the user's travel route is not searched for, a detour route is set to detour around the intermediate point, and the route guidance video related to the detour route is searched for; The program according to claim 3 , wherein in the presenting step, the route guidance video is presented to the user together with the detour route that bypasses the intermediate location.

8. 4. The program according to claim 3, wherein in the presenting step, if there is a section on the user's travel route where the route guidance video is not present, content different from the route guidance video is presented to the user in that section.

9. The program of claim 8, wherein in the presenting step, at least one of the following is presented to the user as content other than the route guidance video: an advertisement related to the user's current location, an advertisement related to the user's search history for a travel route, and an audio guide for the travel route provided by a service that responds with travel routes including the use of public transportation in response to search conditions for a travel route specified by the user.

10. The program according to claim 1, wherein in the presenting step, in response to a movement of the user's location, at least one of updating a list of route guidance videos to be presented to the user based on the user's location and controlling a method of playback of the route guidance videos is performed.

11. The program of claim 1, wherein in the presenting step, a search result for routes including public transportation for the accepted travel route of the user is presented to the user, and in the search result for the travel route, the navigation video for the section is associated with a display of the travel route and with one or more sections that make up the travel route, and is presented so that the user can view it.

12. In the receiving step, a text input is received from the user, The program according to claim 1 , wherein in the searching step, the route guidance video is searched for based on the input text.

13. by presenting an operation screen for searching for a travel route to the user, accepting designation of the departure point and the destination from the user, and responding to the user with a search result of searching for the travel route from the departure point to the destination, 2 . The program according to claim 1 , wherein the operation screen is presented to the user in a state in which at least one of a departure point and a destination set by a user different from the user is specified without an operation by the user.

14. In the searching step, a content including information about a position related to the travel route of the user is searched for based on at least one of the received information about the departure point, the information about the destination, and information about a position on a route determined by the departure point and the destination; The program according to claim 1 , wherein in the presenting step, content including information related to the searched location is presented to the user.

15. 1. A method of operating a computer having a processor and a memory, the method comprising: A step of accepting a travel route that is a route traveled by a user and that includes at least a starting point and a destination; searching for a route guidance video related to the travel route of the user based on at least one of the received information on the departure point, the information on the destination, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain departure point to a destination, presenting the navigation videos retrieved from the search to the user.

16. An information processing device comprising a processor and a memory, the processor comprising: A step of accepting a travel route that is a route traveled by a user and that includes at least a starting point and a destination; searching for a route guidance video related to the travel route of the user based on at least one of the received information on the departure point, the information on the destination, and information on a position on a route determined by the departure point and the destination; Here, the route guidance video is a video of a journey from a certain departure point to a destination, presenting the route guidance video extracted by the search to the user.

Images