Information processing system, information processing program, information processing device, and information processing method

Abstract

To improve convenience in using public transportation.SOLUTION: An information processing system (1) includes: identification means (321) which can determine, based on an image of an entrance / exit which can lead to a public transportation facility which has been recorded with imaging means (25), the location of the entrance / exit; generation means (322) which generates guide information on public transportation with the identified entrance / exit location taken into consideration; and output means (221) which outputs the generated guide information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing program, an information processing device, and an information processing method. [Background technology]

[0002] Conventionally, a technique has been adopted in which additional information related to an object is displayed on an image of the object captured by an imaging means. For example, Patent Document 1 discloses a technique in which the names of train lines accessible from a station are superimposed on a captured image of the station entrance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-37181 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technologies have not been sufficient to improve the convenience of using railways. For example, the presentation of information using augmented reality to users of public transportation has been insufficient.

[0005] Therefore, the present invention provides an information processing system, an information processing program, an information processing device, and an information processing method that can improve the convenience when using public transportation. [Means for solving the problem]

[0006] The information processing system according to the present invention comprises: an identification means for identifying the location of an entrance / exit that can connect to a facility of public transportation based on an image captured by an imaging means of the entrance / exit; a generating means for generating guidance information for the public transportation facility taking into consideration the location of the specified entrance / exit; an output means for outputting the generated guidance information; The present invention is characterized by the following. [Effects of the Invention]

[0007] According to the present invention, it is possible to improve the convenience when using public transportation. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating a schematic configuration of an information processing system according to a first embodiment. [Figure 2] 4 is a flowchart showing an example of the operation of the information processing system according to the first embodiment. [Figure 3] FIG. 2 is a diagram showing an entrance / exit image obtained by capturing an image of a station entrance, as an example of the operation of the information processing system according to the first embodiment. [Figure 4] FIG. 10 is a diagram showing guidance information superimposed on an entrance / exit image as an example of the operation of the information processing system according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing a dedicated guide screen for a station entrance / exit, as an example of the operation of the information processing system according to the first embodiment. [Figure 6] 10 is a flowchart showing an example of the operation of the information processing system according to the second embodiment. [Figure 7] FIG. 10 is a diagram showing guidance information superimposed on a departure sign image obtained by capturing an image of a departure sign at a station, as an example of the operation of the information processing system according to the second embodiment. [Figure 8] FIG. 10 is a diagram showing guidance information and related information superimposed on a departure sign image obtained by capturing an image of a departure sign at a station, as a modified example of the operation of the information processing system according to the second embodiment. [Figure 9] FIG. 10 is a diagram showing guidance information displayed in a foreign language as a modified example of the operation of the information processing system according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, components having equivalent functions are designated by the same reference numerals, and detailed description of the components having the same reference numerals will not be repeated.

[0010] (First embodiment) An information processing system 1 according to a first embodiment of the present invention will be described. The information processing system 1 according to the first embodiment is a system that provides public transportation guide information to users (hereinafter simply referred to as "users") of electronic devices such as mobile devices (smartphones, mobile phones, tablet devices, etc.) and wearable devices (glasses-type, wristwatch-type, earphone-type, etc.).

[0011] 1, the information processing system 1 includes a terminal device 2 corresponding to the electronic device described above, and a server 3. The terminal device 2 and the server 3 are connected to each other via a network such as the Internet so as to be able to communicate with each other.

[0012] The network may be either a wired line or a wireless line, and the type and form of the line are not important. At least a part of the terminal device 2 and the server 3 is realized by a computer.

[0013] The terminal device 2 is used by a user to receive guidance information for public transportation, and is, for example, an information processing terminal such as a mobile terminal or a wearable terminal. The terminal device 2 may be configured as a single device, or may be configured as multiple devices. When the terminal device 2 is configured as multiple devices, the terminal device 2 may be configured as, for example, a mobile terminal (e.g., a smartphone) that can be connected to the server 3 so as to be able to communicate with the server 3, and a wearable terminal that can be connected to the mobile terminal so as to be able to communicate with the mobile terminal, or may be configured as a mobile terminal and a camera that can be connected to the mobile terminal.

[0014] As shown in FIG. 1, the terminal device 2 includes a communication unit 21, an input unit 23, an output unit 24, an imaging unit 25 which is an example of an imaging means, and a control unit 22.

[0015] The communication unit 21 is an interface for transmitting and receiving information between the control unit 22 and the server 3 via a network.

[0016] The input unit 23 is an interface for the user to input information to the terminal device 2, and may be, for example, a touch panel, microphone, touch pad, dial buttons, or gestures in a mobile terminal.

[0017] The output unit 24 is an interface that outputs various types of information from the terminal device 2 to the user, and is, for example, a video display means such as a liquid crystal display. As an example, the output unit 24 displays a GUI (Graphical User Interface) for receiving operations from the user via the input unit 23. The output unit 24 may also have a speaker or earphones that output various types of information as audio.

[0018] The output unit 24 does not have to directly present information to the user. For example, the output unit 24 may output a video signal or an audio signal to a video display means or an audio output means connected to the outside of the terminal device 2, or may output data to an externally connected printing device, or may output data to a storage device within the terminal device 2 or an external storage device for storage.

[0019] The imaging unit 25 is a device that captures an image of an object and inputs the captured image to the terminal device 2, and is, for example, a camera equipped with a solid-state imaging element such as a CCD. The imaging unit 25 may be built into the main body of the terminal device 2, or may be connected to the main body of the terminal device 2 via an interface. In the first embodiment, the imaging unit 25 is used to capture an image of an entrance / exit that can be connected to a public transportation facility.

[0020] 1, the control unit 22 has a guidance information presentation unit 221, which is an example of an output means. The guidance information presentation unit 221 presents the guidance information for public transportation transmitted from the server 3 to the user by outputting the information via the output unit 24.

[0021] The control unit 22 also controls transmission of the captured image input from the imaging unit 25 to the server 3 via the communication unit 21. The control unit 22 may be realized by a processor in the terminal device 2 executing a predetermined program.

[0022] Next, a description will be given of the server 3. As shown in Fig. 1, the server 3 has a communication unit 31, a control unit 32, and a storage unit 33. Before describing the control unit 32, the communication unit 31 and the storage unit 33 will be described.

[0023] The communication unit 31 is an interface for transmitting and receiving information between the terminal device 2 and the control unit 32 of the server 3 via the network.

[0024] The storage unit 33 is a data storage such as a hard disk, and stores various databases. Note that the storage unit 33 does not necessarily have to be provided within the server 3, and may be provided within another device communicably connected to the server 3 via a network.

[0025] The storage unit 33 has a route network information database 331. The route network information database 331 is a database for route search, and includes, for example, transportation network information as route network information. The transportation network information is information that defines transportation networks such as railroads and buses, and road networks. The transportation network information includes public transportation route information, timetable information, fare information, and the like. Furthermore, the transportation network information is expressed by a combination of data on nodes on a route network representation, such as stations, and data on links, which are rail sections between the nodes. Furthermore, the road network information is expressed by a combination of data on nodes on a road network representation, such as intersections, and data on links, which are road sections between the nodes.

[0026] Although not shown, the storage unit 33 may also have a map information database used for displaying maps, searching for locations, and the like. The map information includes map data such as national or regional road maps, and may also include map object information (note information, symbol information, etc.) associated with the map data. Furthermore, the storage unit 33 may also have a POI (Point of Interest) information database used for searching for facilities and setting destinations. POI information is information about facilities and events. The POI information includes name information and location information about facilities and events. The POI information may also include information about entrances and exits that can connect to public transportation facilities such as stations. The storage unit 33 may also have station map information that shows station maps.

[0027] Next, a description will be given of the control unit 32 of the server 3. As shown in Fig. 1, the control unit 32 has an identification unit 321, which is an example of an identification means, and a guide information generation unit 322, which is an example of a generation means.

[0028] The identification unit 321 identifies the location of the entrance / exit on the entrance / exit image based on a captured image (hereinafter also referred to as an entrance / exit image) of an entrance / exit that can connect to a public transportation facility captured by the imaging unit 25.

[0029] Here, the public transportation facility is, for example, a train station, a bus terminal, etc. Furthermore, the entrances / exits that can connect to the public transportation facility are not limited to the entrances / exits of the public transportation facility itself, but also include, for example, the entrances / exits of facilities such as commercial buildings that are directly connected to the station.

[0030] The identification unit 321 may determine whether a facility on an entrance / exit image is an entrance / exit based on, for example, an algorithm constructed by learning images of entrances / exits that can connect to public transportation facilities throughout the country. If it is determined to be an entrance / exit, the identification unit 321 may identify the location of the determined entrance / exit using a VPS (Visual Positioning Service), a GPS, or a combination thereof. The location of the entrance / exit may be identified in the form of, for example, "Entrance A1 of Station A" or "Entrance B1 of Station B." After identifying the location of the entrance / exit using the VPS or GPS, the identification unit 321 may more accurately identify the location of the entrance / exit by extracting text information or the like using image recognition, as necessary.

[0031] The guidance information generating unit 322 generates guidance information for facilities of public transportation taking into consideration the locations of entrances and exits identified by the identifying unit 321. The guidance information is not limited to guidance information related to the use of the public transportation itself, such as timetables, but may also be guidance information related to the use of facilities of the public transportation, such as barrier-free facilities (e.g., elevators, escalators, slopes, etc.), toilets, ATMs, stores, etc.

[0032] More specifically, the guidance information that takes into account the location of the specified entrance / exit is information that takes into account the specified entrance / exit as a starting point for travel to use public transportation (travel on foot, in a wheelchair, etc.). Here, the use of public transportation is not limited to the use of the public transportation itself, but may also include the use of facilities of the public transportation.

[0033] As an example, the guidance information may be information that takes into account the time required to travel from a specified entrance / exit to the boarding / alighting location or ticket gate of public transportation. More specifically, the guidance information may be a timetable of public transportation that can be boarded within the required time. The timetable may be a timetable for each route. If there are multiple routes, the routes for which the timetable is displayed may be narrowed down based on user information (information such as routes, routes, and commuter passes registered in advance by the user), the order in which the timetable is displayed may be changed, or the timetable may be highlighted. By outputting a timetable of public transportation that can be boarded within the required time as guidance information, the user can easily understand that they will be able to catch the train shown in the timetable.

[0034] As another example, the guidance information may be a map of the public transportation facility showing the identified entrance / exit in an identifiable manner. In this case, the identified entrance / exit may be positioned at the center of the map or highlighted to make it easier to identify. The guidance information regarding the use of the public transportation facility (such as information on barrier-free facilities) described above may be displayed as an icon associated with the corresponding position on the map. By outputting a map of the facility showing the identified entrance / exit in an identifiable manner as the guidance information, the user can easily understand whether an escalator or elevator is located at the identified entrance / exit, whether there is a restroom outside the ticket gate, whether an entrance / exit other than the identified entrance / exit is closer to the platform, etc.

[0035] As another example, the guidance information may be an indoor route from the identified entrance / exit to the platform, which is the boarding / alighting location of the selected line. The route selection may be performed by the information processing system 1 (e.g., the guidance information generation unit 322) according to predetermined selection conditions. The route selected in generating the indoor route (i.e., the route selection conditions) may be, for example, a route or a route on the route registered in advance in the terminal device 2 by a user operation using the input unit 23, or may be a route indicated in electronic ticket information (e.g., a commuter pass, etc.) purchased in advance by the user and registered in the terminal device 2. By displaying the indoor route from the identified entrance / exit to the boarding / alighting location of the selected line as the guidance information, the user can easily understand which route to take to get to the platform.

[0036] The guidance information presenting unit 221 may superimpose the guidance information generated by the guidance information generating unit 322 on the captured image via the output unit 24. Furthermore, the guidance information presenting unit 221 may transition from the entrance / exit image to a dedicated entrance / exit guide image including the guidance information. Alternatively, the guidance information presenting unit 221 may switch between displaying the entrance / exit image with the guidance information superimposed thereon and the dedicated entrance / exit guide image.

[0037] Furthermore, the guidance information may be displayed in a display mode selectable by a user operation using the input unit 23. Selection of guidance information is not limited to manual input, but may also be performed by voice input, etc. When guidance information is selected, the guidance information generation unit 322 may generate related information related to the guidance information, and the guidance information presentation unit 221 may display the generated related information on the output unit 24. For example, when a floor plan of a public transportation facility is displayed as guidance information and an icon indicating a barrier-free facility selectably displayed on the floor plan is selected by a user operation, the guidance information generation unit 322 may generate, as related information, a guidance route from the identified entrance / exit to the barrier-free facility indicated by the selected icon or the nearest entrance / exit to the barrier-free facility. In this case, the guidance information presentation unit 221 may display the guidance route on the floor plan or may superimpose it on a live-action image. With this configuration, for example, when a user travels by wheelchair or stroller, even if the captured entrance does not have an elevator, the user can easily understand that there is an elevator at another entrance. Furthermore, by displaying a guide route from the captured point to an entrance with an elevator, user convenience can be improved. Furthermore, for example, when indoor routes from the identified entrance to the platform where a selected line is boarded or disembarked are displayed in a selectable display mode as guidance information, if the displayed indoor route is selected by a user operation, the guidance information generation unit 322 may display detailed information about the indoor route or alternative indoor route options as related information. Examples of detailed information about the indoor route include the distance of the indoor route, the ventilation characteristics of the indoor route (e.g., width and ceiling height), and the degree of congestion of the indoor route based on GPS information from other devices. With this configuration, it is possible to determine in advance whether the indoor route can be traveled smoothly and safely, and to change to another indoor route if necessary.

[0038] Furthermore, the output of the guidance information is not limited to an image display, but may also be accompanied by audio output.

[0039] The control unit 32 executes control to transmit the guidance information generated by the guidance information generation unit 322 to the terminal device 2 via the communication unit 31. The control unit 32 may be realized by a processor in the server 3 executing a predetermined program.

[0040] (Example of operation) Next, a description will be given of an example of the operation of the information processing system 1 according to the first embodiment. Fig. 2 is a flowchart showing an example of the operation of the information processing system 1 according to the first embodiment.

[0041] As shown in FIG. 2, first, the imaging unit 25 of the terminal device 2 captures an entrance / exit image by capturing an entrance / exit that can connect the user to a public transportation facility (step S21). FIG. 3 illustrates an entrance / exit image i1 obtained by capturing an entrance / exit of a station, which is an example of a public transportation facility, with the imaging unit 25, as an example of the operation of the information processing system 1 according to the first embodiment. When a station name ("Station A" in FIG. 3) appears in the image, as in the entrance / exit image i1 shown in FIG. 3, the facility in the image can be determined to be an entrance / exit based on, for example, machine learning results of character information on the station name. Then, image analysis of the characters and marks in the image can be performed to identify which entrance / exit belongs to which public transportation facility. Even if the station name is not captured in the captured image, the location of the entrance / exit can be uniquely identified using a VPS, a GPS, or a combination thereof.

[0042] After the entrance / exit image is acquired, the control unit 22 of the terminal device 2 transmits the acquired entrance / exit image to the server 3 via the communication unit 21 (step S22).

[0043] After the entrance / exit image is transmitted, the identification unit 321 of the server 3 identifies the location of the entrance / exit on the entrance / exit image based on the transmitted entrance / exit image (step S31). As described above, the location of the entrance / exit can be identified by learning the entrance / exit image, estimating the current position by combining the VPS and GPS, etc.

[0044] After the location of the entrance / exit is identified, the guidance information generation unit 322 of the server 3 generates guidance information for public transportation that takes into account the location of the identified entrance / exit (step S32). Specifically, the guidance information generation unit 322 generates information that takes into account the identified entrance / exit as the starting point for traveling to use public transportation. As an example, the guidance information generation unit 322 generates information that takes into account the time required to travel from the identified entrance / exit to the public transportation boarding / alighting location or ticket gate. More specifically, the guidance information generation unit 322 generates a timetable for public transportation that allows boarding within the required time from the identified entrance / exit to the public transportation boarding / alighting location or ticket gate. Even more specifically, the guidance information generation unit 322 generates a timetable for public transportation for each route that allows boarding within the required time from the identified entrance / exit to the public transportation boarding / alighting location or ticket gate. As another example, the guidance information generation unit 322 generates a premises map of the public transportation facility that identifiably shows the identified entrance / exit. As another example, the guidance information generating unit 322 generates an indoor route from the identified entrance / exit to the boarding / alighting location of the selected line.

[0045] After the guidance information is generated, the control unit 32 of the server 3 transmits the generated guidance information to the terminal device 2 via the communication unit 31 (step S33).

[0046] After the guidance information is transmitted, the guidance information presenting unit 221 of the terminal device 2 outputs the transmitted guidance information via the output unit 24 (step S23). When the guidance information is displayed on the screen of the terminal device 2, the guidance information presenting unit 221 may adjust the character size and the display amount of the guidance information as appropriate according to the screen size.

[0047] 4 is a diagram showing guidance information i2 superimposed on an entrance / exit image i1 as an example of the operation of the information processing system 1 according to the first embodiment. For example, as shown in Fig. 4, the guidance information presenter 221 outputs guidance information by superimposing the guidance information i2 on the entrance / exit image i1. In the example shown in Fig. 4, the guidance information i2 includes timetable information i21 showing train timetables for each line and station map information i22 showing a station map.

[0048] The time information i21 is image information generated to indicate the departure time of the nearest train that can be boarded within the required time, taking into account the time required to travel from the location of the entrance / exit on the entrance / exit image i1 to the station platform. Therefore, even if the nearest departure time is present at the current time or the time the entrance / exit is captured, the time information i21 does not include a time that departs before the required time to reach the platform has elapsed, or the user must scroll to display the departure time. The time information i21 also includes the required time from the entrance / exit to the platform calculated based on the route network information (e.g., 2 minutes for Line Z). By displaying such time information i21, the user can easily understand how long it will take to reach the station platform and whether they will be able to make the departure time listed in the displayed timetable. In the example shown in FIG. 4, the time information i21 further includes train delay information (e.g., a 5-minute delay), so the user can easily understand that the departure time will be delayed.

[0049] The station interior map information i22 is image information of a station interior map generated to clearly indicate entrances and exits on the entrance and exit image i1, taking into consideration that travel to use a train begins from the location of an entrance and exit on the entrance and exit image i1. As shown in FIG. 4 , in the station interior map information i22, the location P of the entrance and exit on the entrance and exit image i1 is prominently displayed at the center of the station interior map i221 using a circular mark or the like. The station interior map information i22 also includes multiple types of icons i222 indicating barrier-free facilities. The icons i222 can be selected by a user operation, and the guidance information generator 322 generates guidance information i2 so that the selected icon i223 is displayed in association with the corresponding position on the station interior map i221. Furthermore, the icons i223 displayed in association with the station interior map i221 can be selected by a user operation, and when an icon i223 is selected, the guidance information generator 322 generates a guidance route from the identified entrance and exit P to the barrier-free facility indicated by the selected icon i223. By displaying such station map information i22, the user can easily understand whether barrier-free facilities are available at the entrance / exit on the entrance / exit image i1, how to get to the entrance / exit where the barrier-free facilities are available, etc. Note that the station map information i22 may also include icons indicating station facilities other than barrier-free facilities.

[0050] FIG. 5 is a diagram illustrating a dedicated guide screen S for a station entrance / exit as an example of the operation of the information processing system 1 according to the first embodiment. For example, as illustrated in FIG. 5, the guide information presenting unit 221 may switch the display from the display screen of the guide information i2 in FIG. 4 to the dedicated guide screen S in FIG. 5 in response to a user operation, or may automatically switch the display without a user operation. The dedicated guide screen S is image information generated by the guide information generating unit 322 so as to include information similar to that of the guide information i2. The dedicated guide screen S may be a guide screen on a dedicated app provided on a mobile terminal or a guide screen on the web. In addition to information similar to that of the guide information i2, the dedicated guide screen S may also include unique information. For example, the dedicated guide screen S may include an operation button (a “Search” button in FIG. 5) that instructs a route search from the station corresponding to the identified entrance / exit to the destination. The dedicated guide screen S is convenient because it can be continuously displayed without the need for the imaging unit 25 to continuously capture the station entrance / exit.

[0051] As described above, according to the first embodiment, the location of an entrance / exit that can connect to a public transportation facility is identified based on a captured image of the entrance / exit, and public transportation guidance information that takes into account the identified entrance / exit location is generated and output, thereby making it possible to provide sufficient information using augmented reality to users of public transportation, thereby improving convenience when using public transportation.

[0052] (Second embodiment) Next, a second embodiment will be described, which provides guidance information accompanying a captured image of a departure sign for public transportation. The configuration of an information processing system 1 according to the second embodiment will be described below with reference to FIG.

[0053] As in the first embodiment, the information processing system 1 according to the second embodiment includes a terminal device 2 and a server 3 connected to each other via a network so as to be able to communicate with each other. In the second embodiment, the terminal device 2 also includes a communication unit 21, a control unit 22 having a guidance information presentation unit 221, an input unit 23, an output unit 24, and an imaging unit 25, and the server 3 includes a communication unit 31, a control unit 32 having an identification unit 321 and a guidance information generation unit 322, and a storage unit 33 having a route network information database 331. However, in the second embodiment, the content of the guidance information is different from that in the first embodiment, and therefore the functions of the components of the terminal device 2 and the server 3 are different from those in the first embodiment.

[0054] Specifically, the identification unit 321 of the server 3 determines whether the imaged object is a departure sign based on an image (hereinafter also referred to as a departure sign image) of a public transportation departure sign captured by the imaging unit 25, and identifies the public transportation facility where the departure sign is installed. As in the first embodiment, the public transportation facility may be a station or a bus stop.

[0055] The identification unit 321 may determine whether the captured object is a departure sign, for example, based on an algorithm constructed by learning images of departure signs at public transportation facilities throughout the country. If it is determined to be a departure sign, the identification unit 321 may identify the public transportation facility where the departure sign on the departure sign image is installed. The identification unit 321 may identify the public transportation facility where the departure sign on the departure sign image is installed by using a VPS, a GPS, or a combination of these. For example, the identification unit 321 may identify the public transportation facility where the departure sign is installed based on the platform number, route name, departure time, etc. indicated on the departure sign.

[0056] The guidance information generation unit 322 generates guidance information that includes at least information about departure times after the departure time shown on the departure sign image at the public transportation facility identified by the identification unit 321. The guidance information presentation unit 221 of the terminal device 2 outputs the guidance information via the output unit 24. The guidance information presentation unit 221 may superimpose the guidance information on the departure sign image in a display mode that is continuous with the end of the departure sign on the departure sign image. By displaying such guidance information, the user can easily grasp the subsequent departure information on the departure sign.

[0057] The guidance information may further include at least one of operation information and congestion information for the public transportation facility corresponding to the departure time indicated on the departure board. The guidance information may also further include at least one of operation information and congestion information for the public transportation facility corresponding to a departure time after the departure time indicated on the departure board. By displaying such guidance information, the user can easily determine whether or not to board the public transportation facility at the departure time indicated on the departure board or guidance information.

[0058] The guidance information may not include information about departure times after the departure time indicated on the departure sign, but may include only information related to the departure sign other than the departure time. Information related to the departure sign other than the departure time may be, for example, train congestion (such as congestion level per train or congestion per car) or operation information (such as delays) or location indicated on the departure sign, and this information may be superimposed on the departure sign (displayed near the departure sign).

[0059] The guidance information presentation unit 221 may switchably display a departure sign image on which guidance information is superimposed and a dedicated guidance screen for the departure sign. The dedicated guidance screen is, for example, a screen including the departure time indicated on the departure sign and the departure time indicated in the guidance information, and can be continuously displayed without continuously capturing the departure sign with the imaging unit 25. Furthermore, the guidance information presentation unit 221 may display the guidance information in a selectable display mode, and when guidance information is selected, the guidance information generation unit 322 may generate related information related to the selected guidance information and display it on the guidance information presentation unit 221. The related information may be, for example, information indicating the current location of the public transportation system at the departure time indicated in the selected guidance information.

[0060] (Example of operation) Next, an example of the operation of the information processing system 1 according to the second embodiment will be described below. Fig. 6 is a flowchart showing an example of the operation of the information processing system 1 according to the second embodiment.

[0061] As shown in FIG. 6, first, the imaging unit 25 of the terminal device 2 captures an image of a departure sign of a public transportation facility to obtain a departure sign image (step S211).

[0062] After the departure target image is acquired, the control unit 22 of the terminal device 2 transmits the acquired departure target image to the server 3 via the communication unit 21 (step S212).

[0063] After the departure sign image is transmitted, the identification unit 321 of the server 3 identifies the public transportation facility where the departure sign on the departure sign image is installed based on the transmitted departure sign image (step S311). As described above, the public transportation facility can be identified based on the learning results of the departure sign image, current position estimation using a combination of VPS and GPS, etc.

[0064] After the public transportation facility is identified, the guidance information generation unit 322 of the server 3 generates guidance information that provides information about departure times after the departure time shown on the departure sign image at the identified facility (step S312).

[0065] After the guidance information is generated, the control unit 32 of the server 3 transmits the generated guidance information to the terminal device 2 via the communication unit 31 (step S313).

[0066] After the guidance information is transmitted, the guidance information presenting unit 221 of the terminal device 2 outputs the transmitted guidance information via the output unit 24 (step S213).

[0067] 7 is a diagram showing guidance information i4 superimposed on a departure sign image i3 as an example of the operation of the information processing system 1 according to the second embodiment. For example, as shown in FIG. 7, the guidance information presenter 221 outputs guidance information by superimposing the guidance information i4 on a departure sign image i3 obtained by capturing an image of a station departure sign. In the example shown in FIG. 7, the guidance information i4 includes departure time information i41 indicating a departure time after the latest departure time (10:25 in FIG. 7) among the departure times indicated in the departure sign image i3, and congestion information i42 indicating the degree of congestion of the train corresponding to the departure time indicated in the departure sign image i3 and the degree of congestion of the train corresponding to the departure time indicated in the departure time information i41.

[0068] By displaying the departure time information i41, the user can easily grasp the subsequent departure time of the departure board. By displaying the congestion information i42, the user can easily grasp the congestion level of the train corresponding to the departure board and the train corresponding to the departure time information i41.

[0069] Fig. 8 is a diagram showing related information i5 as an example of the operation of the information processing system 1 according to the second embodiment. As shown in Fig. 8, when a departure time (10:34 in Fig. 8) shown in the departure time information i41 is selected by a user operation, the guidance information generation unit 322 generates related information i5 indicating the current running position of the train at the selected departure time, and the guidance information presentation unit 221 may superimpose and display the generated related information i5 on the departure target image i3.

[0070] Furthermore, as shown in Fig. 9, the guidance information i4 may be displayed in a foreign language other than Japanese. In this case, the departure time may be superimposed on the departure time on the departure sign image in the foreign language, as shown in Fig. 9. The guidance information generation unit 322 may determine whether to display the guidance information in a foreign language based on, for example, language information set in the OS of the device capturing the image, language information on an app, or the recognition result of a language input by voice.

[0071] According to the second embodiment, by identifying a public transportation facility where a departure sign is installed based on an image of the public transportation facility's departure sign, and generating and outputting guidance information that provides information about departure times after the departure time indicated on the departure sign at the identified public transportation facility, it is possible to provide sufficient information using augmented reality to users of public transportation, thereby improving the convenience of using public transportation.

[0072] In the above-described embodiment, there may be cases where there is no departure sign on a station platform or where the departure sign is too far away to be recognized. Therefore, similar means may be used to output guidance information when an image of a direction sign or station sign other than a departure sign is captured. Specifically, the identification unit 321 may identify a public transportation facility where a direction sign or station sign is installed by performing image recognition of the direction indicated by the direction sign or the station name indicated by the station sign based on a captured image of the public transportation facility's direction sign or station sign captured by the imaging unit 25. The guidance information generation unit 322 may generate, as guidance information, information about departure times after the current time at the public transportation facility identified based on the captured image of the direction sign or station sign, or may generate guidance information that includes at least information about departure times after the departure time indicated on the departure sign. Furthermore, the guidance information generation unit 322 may generate guidance information that includes information other than departure times (e.g., the degree of congestion of trains arriving at the identified station, delay information, location information, etc.). Furthermore, the generated guidance information may be displayed near a direction sign or a station sign in the captured image.

[0073] At least a part of the information processing system described in the above-described embodiment may be configured with hardware or software. The hardware constituting the information processing system may include a sensor such as LiDAR (light detection and ranging), which is an example of a sensor using laser light. The sensor may be installed (built-in) in the terminal device 2 as a standard feature, or may be connected to the terminal device 2 as an add-on. The sensor may detect, for example, the shape, position, and distance to an object. The sensor's detection information may be used to assist in determining whether an object captured by the imaging unit 25 is an entrance / exit, or in determining which of multiple entrances / exits connected to a public transportation facility the captured object is. The sensor's detection information may also be used to assist in determining the position, range, or level of detail in the captured image at which guidance information should be displayed. The sensor's detection information may also be used to assist in determining whether to automatically switch between the captured image and a dedicated guidance image. When the information processing system is configured with software, a program that realizes at least some of the functions of the information processing system may be stored on a recording medium such as a flexible disk or CD-ROM, and may be read and executed by a computer. The recording medium is not limited to removable media such as magnetic disks and optical disks, but may also be fixed media such as a hard disk drive or memory.

[0074] In addition, a program that realizes at least part of the functions of the information processing system may be distributed via a communication line (including wireless communication) such as the Internet. Furthermore, the program may be encrypted, modulated, or compressed and distributed via a wired or wireless line such as the Internet, or stored on a recording medium.

[0075] Furthermore, the information processing system may be operated by one or more information processing devices. When using multiple information processing devices, one of the information processing devices may be a computer, and the computer may execute a predetermined program to realize the function as at least one means of the information processing system.

[0076] In the method invention, all steps may be automatically controlled by a computer. Alternatively, each step may be performed by a computer, with progress control between steps being performed manually. Furthermore, at least some of the steps may be performed manually.

[0077] Based on the above description, a person skilled in the art may conceive additional effects and various modifications of the present invention, but the aspects of the present invention are not limited to the individual embodiments described above. Various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and spirit of the present invention, which is derived from the content defined in the claims and their equivalents. [Explanation of symbols]

[0078] 1. Information Processing Systems 2. Terminal Device 221 Guidance information presentation unit 3 Server 321 Specific part 322 Guidance information generation unit

Claims

1. an identification means for identifying which entrance / exit is an entrance / exit among a plurality of entrances / exits that can connect to a public transportation facility, based on an image captured by an imaging means of the entrance / exit that can connect to the facility; a generation means for generating guidance information for the public transportation facility taking into consideration the identified entrance / exit; an output means for outputting the generated guidance information; An information processing system comprising:

2. The information processing system according to claim 1 , wherein the guidance information is information that takes into consideration the specified entrance / exit as a starting point for travel to use the public transportation system.

3. 3. The information processing system according to claim 2, wherein the guidance information is information that takes into consideration the time required to travel from the specified entrance / exit to the boarding / alighting location or ticket gate of the public transportation facility.

4. 4. The information processing system according to claim 3, wherein the guide information is a timetable of public transportation for each route that can be boarded within the required travel time.

5. The information processing system according to claim 1, characterized in that, when the entrance / exit is an entrance / exit of a facility directly connected to the public transportation facility, the guidance information includes a mark indicating at least one of the public transportation facility and the public transportation route.

6. 2. The information processing system according to claim 1, wherein the guidance information is a map of the facility of the public transportation system, which indicates the specified entrance / exit in an identifiable manner.

7. The information processing system according to claim 2 , wherein the guidance information is an indoor route from the specified entrance to a boarding / alighting location of a selected line.

8. The information processing system according to any one of claims 1 to 7, characterized in that the output means displays the guidance information in a selectable display mode, and when the guidance information is selected, displays related information related to the guidance information.

9. 9. The information processing system according to claim 1, wherein the output means displays the guidance information by superimposing it on the captured image or by displaying it on a dedicated guidance screen.

10. The information processing system according to claim 9, wherein the output means switchably displays the captured image with the guidance information superimposed thereon and a dedicated guidance screen for the specified entrance / exit.

11. an identification means for identifying a facility of the public transportation facility where a departure sign of the public transportation facility is installed based on an image captured by an imaging means of the departure sign of the public transportation facility; a generating means for generating guidance information associated with the information indicated on the departure board at the identified public transportation facility; an output means for outputting the generated guidance information; An information processing system comprising:

12. 12. The information processing system according to claim 11, wherein the output means displays the guidance information superimposed on the captured image in a display manner continuous with the departure board.

13. 13. The information processing system according to claim 12, wherein the output means switchably displays the captured image on which the guidance information is superimposed and a dedicated guidance screen for the departure board.

14. An information processing system as described in any one of claims 11 to 13, characterized in that the guidance information further includes operation information and / or congestion information of the public transportation corresponding to at least one of the departure time indicated on the departure sign and departure times after the departure time.

15. The information processing system according to any one of claims 11 to 14, characterized in that the output means displays the guidance information in a selectable display mode, and when the guidance information is selected, displays related information related to the guidance information.

16. the generating means generates second guidance information that provides guidance on a guidance target other than the departure time indicated on the departure sign at the identified public transportation facility; 12. The information processing system according to claim 11, wherein the output means outputs the generated second guidance information.

17. the identification means is capable of identifying the facility of the public transportation system in which the information sign is installed based on an image of the information sign of the public transportation system other than the departure sign captured by the imaging means, the generating means generates third guidance information that accompanies information indicated on the guide sign at the identified public transportation facility where the guide sign is installed; outputting the generated third guidance information; 12. The information processing system according to claim 11.

18. Computer, an identification means for identifying which entrance / exit is an entrance / exit among a plurality of entrances / exits that can connect to a facility of public transportation based on an image captured by an imaging means of the entrance / exit that can connect to the facility; a generating means for generating guidance information for the public transportation facility taking into consideration the identified entrance / exit; and an output means for outputting the generated guidance information; An information processing program characterized by causing the program to function as:

19. a step in which an identification unit identifies which entrance / exit is one of a plurality of entrances / exits that can connect to a facility of public transportation based on an image captured by an imaging unit of the entrance / exit that can connect to the facility of public transportation; a step of generating guidance information for the public transportation facility taking into consideration the identified entrance / exit by a generating means; an output step of outputting the generated guidance information by an output means; An information processing method comprising:

20. Computer, an identification means for identifying a facility of the public transportation facility where the departure sign is installed based on an image captured by an imaging means of the departure sign of the public transportation facility; a generating means for generating guidance information accompanying the information displayed on the departure board at the identified public transportation facility; and an output means for outputting the generated guidance information; An information processing program characterized by causing the program to function as:

21. An information processing system configured by a plurality of computers connected to each other in a communicable manner, an identification means for identifying a facility of the public transportation facility where a departure sign of the public transportation facility is installed based on an image captured by an imaging means of the departure sign of the public transportation facility; a generating means for generating guidance information associated with the information indicated on the departure board at the identified public transportation facility; an output means for outputting the generated guidance information; In order to make the information processing system with An information processing program for causing at least one of the computers to function as at least one of the means.

22. In order to make the information processing system according to any one of claims 11 to 17 function by a plurality of computers connected in a communicable manner, 18. An information processing program for causing one of the computers to function as at least one of the means in the information processing system according to any one of claims 11 to 17.

23. 18. An information processing program for causing a computer to function as at least one of the means in the information processing system according to any one of claims 11 to 17.

24. By a plurality of information processing devices connected to each other so as to be able to communicate, an identification means for identifying a facility of the public transportation facility where a departure sign of the public transportation facility is installed based on an image captured by an imaging means of the departure sign of the public transportation facility; a generating means for generating guidance information associated with the information indicated on the departure board at the identified public transportation facility; an output means for outputting the generated guidance information; In order to configure an information processing system having An information processing device comprising at least one of the above means.

25. a step in which an identification unit identifies a facility of the public transportation facility in which a departure sign of the public transportation facility is installed based on an image captured by an imaging unit of the departure sign of the public transportation facility; a step of generating guidance information accompanying the information indicated on the departure board at the identified public transportation facility by a generating means; an output step of outputting the generated guidance information by an output means; An information processing method comprising:

Images