Information processing device and program

Abstract

To provide a technique that makes it easier to find a boarding place for an on-demand bus.SOLUTION: An information processing device according to the present disclosure is a computer carried by a first user who is scheduled to board an on-demand bus. The information processing device comprises a display device and a control unit. The control unit of the information processing device superimposes a first virtual image, which is a virtual image of a bus stop, on a position of a boarding place of the first user in a first real image, which is a captured image of a first actual scenery, and generates an AR image. The control unit displays the generated AR image on the display device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device and a program. [Background technology]

[0002] An operation management device is known that acquires location information of a user who plans to board a vehicle traveling along a predetermined operation route, uses the acquired location information to set a virtual stop where the user will board, and notifies the user of the location of the virtual stop (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-51431 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to provide technology that makes it easier to find a boarding location for an on-demand bus. [Means for solving the problem]

[0005] One aspect of the present disclosure is an information processing device carried by a first user who plans to board an on-demand bus. In this case, the information processing device includes, for example, A display device capable of displaying an image; a control unit that causes the display device to display a first virtual image indicating a bus stop in association with a first real scene including a boarding location of the first user; The above configuration may be adopted.

[0006] Another aspect of the present disclosure is a program for a computer carried by a first user who plans to ride an on-demand bus. The computer includes: A first virtual image indicating a bus stop may be displayed on a display device in association with a first actual scene including a boarding location of the first user.

[0007] Another embodiment is a non-transitory storage medium that stores the above-mentioned program in a computer-readable form. Effect of the Invention

[0008] According to the present disclosure, it is possible to provide a technology that makes it easier to find a boarding location for an on-demand bus. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an overview of an on-demand bus system according to an embodiment. [Diagram 2] 2 is a diagram illustrating an example of the hardware configuration of each of a server device and a user terminal included in the on-demand bus system in an embodiment. [Diagram 3] FIG. 2 is a block diagram illustrating an example of a functional configuration of a user terminal according to an embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information stored in a reservation management database. [Diagram 5] FIG. 13 is a diagram showing an example of a menu screen of an on-demand bus service. [Figure 6] FIG. 13 is a diagram showing an example of a screen showing a reservation list. [Figure 7] FIG. 13 is a diagram showing an example of a screen showing the contents of a reservation. [Figure 8] FIG. 11 is a diagram illustrating an example of a display screen of an AR image in the embodiment. [Figure 9] 5 is a flowchart showing a processing routine executed by a user terminal in the embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a display screen of an AR image in Modification Example 1. [Figure 11] FIG. 11 is a diagram showing an example of a display screen of an AR image in Modification Example 2. [Figure 12] FIG. 13 is a diagram showing an example of a display screen of an AR image in Modification Example 3. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] In recent years, on-demand buses that operate according to boarding and alighting locations and boarding and alighting dates and times arbitrarily designated by users have become more widespread. Unlike route buses and express buses that operate on regular routes, on-demand buses operate according to boarding and alighting locations and boarding and alighting dates and times arbitrarily designated by users. Therefore, there is a possibility that the boarding locations for on-demand buses do not have landmarks (e.g., signs indicating bus stops) like those for buses that operate on regular routes.

[0011] When a location where no bus stop sign is installed is used as a boarding location for an on-demand bus, the user may have difficulty finding the boarding location. The user may also be unsure whether the location where the user is waiting for the on-demand bus is the correct boarding location. Therefore, a measure to make it easier for the user to find the boarding location is desired.

[0012] In contrast, in the information processing device according to the present disclosure, a control unit causes a display device to display a first virtual image, which is a virtual image of an on-demand bus stop, in association with a first real scene. The information processing device is a small computer carried by a user (first user) who plans to board an on-demand bus, and includes a display device. The first real scene is a real scene including the boarding location of the first user (the real scene of the boarding location of the first user and its vicinity).

[0013] In the present disclosure, "displaying the first virtual image on a display device in association with a first real scene including a boarding location of a first user" may refer to, for example, displaying an AR image in which the first virtual image is superimposed on an image (first real image) of a captured first real scene on a display device. In this case, the first virtual image is superimposed on the position of the boarding location in the first real image.

[0014] In addition, when the information processing device according to the present disclosure is a computer equipped with a see-through display device, such as smart glasses, the first virtual image may be displayed in an area of ​​the display device corresponding to the boarding location when the display device is transmitting the first real scenery.

[0015] According to the information processing device of the present disclosure, the first user can find the boarding location by viewing the first virtual image associated with the first real scene. Also, it is possible to suppress the first user from feeling uneasy about whether the location where the first user is waiting for the on-demand bus is the correct boarding location.

[0016] <Embodiment> Specific embodiments of the present disclosure will be described below with reference to the drawings. Unless otherwise specified, the configurations and the like described in the following embodiments are not intended to limit the technical scope of the present disclosure to those configurations and the like. In the present embodiment, an example in which an information processing device according to the present disclosure is applied to an on-demand bus system will be described.

[0017] (Overview of the on-demand bus system) FIG. 1 is a diagram showing an overview of an on-demand bus system according to the present embodiment. The on-demand bus system in this embodiment includes a server device 100 that manages the operation of the on-demand bus 1, and a user terminal 200 used by a user (first user) of the on-demand bus 1. The server device 100 and the user terminal 200 are connected via a network N1. Note that, although only one user terminal 200 is illustrated in the example shown in FIG. 1, multiple user terminals 200 may be included.

[0018] The on-demand bus 1 is a vehicle that operates according to the boarding and alighting locations and boarding and alighting dates and times specified by a first user. Note that the on-demand bus 1 may be a vehicle whose operating route and operating times are determined in advance, and only the boarding and alighting locations are changed in response to a request from the first user.

[0019] The server device 100 receives a request for reservation of the on-demand bus 1 from a first user, and generates an operation plan for the on-demand bus 1. The request from the first user includes the boarding location desired by the first user, the boarding date and time desired by the first user, the disembarking location desired by the first user, and the disembarking date and time desired by the first user. A signal related to such a request is transmitted from the user terminal 200 used by the first user to the server device 100 via the network N1. The operation plan also includes the operation route of the on-demand bus 1, the locations where the on-demand bus 1 stops along the operation route (the boarding location and disembarking location of the first user), the operation time, and the like. The boarding location and disembarking location of the first user are determined to be the locations desired by the first user, in principle. However, if the boarding location and / or disembarking location desired by the first user is not suitable as a stop location of the on-demand bus, the provider of the on-demand bus service may determine a location that is near the boarding location and / or disembarking location desired by the first user and is suitable as a stop location of the on-demand bus as the boarding location and / or disembarking location of the first user. Also, if the boarding location and / or disembarking location of another user is set near the boarding location and / or disembarking location desired by the first user, the provider of the on-demand bus service may determine the boarding location and / or disembarking location of the first user to be the same location as the boarding location and / or disembarking location of the other user.

[0020] The server device 100 in this embodiment also has a function of transmitting a first signal including location information of the boarding location to the user terminal 200 when the reservation in response to the above-mentioned request is completed (when the boarding location, disembarking location, boarding date and time, disembarking date and time, etc. of the first user are decided). The location information of the boarding location is, for example, information indicating the latitude and longitude of the boarding location. The first signal may include an image of the actual scenery of the boarding location.

[0021] The user terminal 200 is a portable computer used by a first user. The user terminal 200 has a function of accepting the above-mentioned request input by the first user and transmitting a request signal corresponding to the accepted request to the server device 100.

[0022] The user terminal 200 in this embodiment generates an AR (Augmented Reality) image based on the first signal received from the server device 100, and displays the generated AR image to the first user. The AR image in this embodiment is an image in which a first virtual image is superimposed on a first real image. The first virtual image is a virtual image showing the boarding location of the on-demand bus 1, for example, a virtual image of a bus stop sign. The first real image is an image obtained by capturing a real scene including the boarding location of the first user (the boarding location and the real scene in the vicinity thereof). The first virtual image is superimposed on the position of the boarding location in the first real image. In this embodiment, the above-mentioned AR image is generated and presented when the first user who has arrived near the boarding location captures the first real scene with the camera 204 of the user terminal 200.

[0023] (Hardware configuration of on-demand bus system) An example of the hardware configuration of the on-demand bus system in this embodiment is shown in FIG. Fig. 2 is a diagram showing an example of the hardware configuration of each of the server device 100 and the user terminal 200 included in the on-demand bus system shown in Fig. 1. In the example shown in Fig. 2, only one user terminal 200 is shown, but the on-demand bus system includes the same number of user terminals 200 as the number of users of the on-demand bus 1.

[0024] The server device 100 is a computer that manages the operation of the on-demand bus 1, and is operated by a provider of the on-demand bus service. As shown in Fig. 2, the server device 100 includes a processor 101, a main memory unit 102, an auxiliary memory unit 103, and a communication unit 104. The processor 101, the main memory unit 102, the auxiliary memory unit 103, and the communication unit 104 are connected to each other via a bus.

[0025] The processor 101 is, for example, a central processing unit (CPU) or a digital signal processor (DSP). The processor 101 executes various arithmetic operations. The server device 100 is controlled by the above.

[0026] The main memory unit 102 is a storage device that provides the processor 101 with a storage area and a working area for loading programs stored in the auxiliary memory unit 103, and is used as a buffer for arithmetic processing. The main memory unit 102 includes semiconductor memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory).

[0027] The auxiliary storage unit 103 stores various programs and data used by the processor 101 when executing each program. The auxiliary storage unit 103 is, for example, an erasable programmable ROM (EPROM) or a hard disk drive (HDD). The auxiliary storage unit 103 may include a removable medium, i.e., a portable recording medium. The removable medium is, for example, a disk recording medium such as a Universal Serial Bus (USB) memory, a Compact Disc (CD), or a Digital Versatile Disc (DVD). The auxiliary storage unit 103 stores various programs, various data, and various tables in the recording medium in a readable and writable manner.

[0028] The programs stored in the auxiliary storage unit 103 include an operating system, a program for generating an operation plan for the on-demand bus 1, and the like.

[0029] The communication unit 104 is a device for connecting the server device 100 to the network N1. The network N1 is, for example, a WAN (Wide Area Network) that is a global public communication network such as the Internet, or other communication networks. 1, the server device 100 is connected to the user terminal 200. The communication unit 104 includes, for example, a LAN (Local Area Network) interface board, or a wireless communication circuit for wireless communication.

[0030] 2, the processor 101 loads a program from the auxiliary storage unit 103 into the main storage unit 102 and executes it to generate an operation plan for the on-demand bus 1. Specifically, when the communication unit 104 receives a request signal transmitted from the user terminal 200, the processor 101 determines the operation route and stops (boarding and disembarking locations of the first user) of the on-demand bus 1 based on the boarding and disembarking locations included in the request signal. The server device 100 determines the operation times of the on-demand bus 1 based on the boarding date and time and disembarking date and time included in the request signal.

[0031] The method for determining the operation plan for the on-demand bus 1 is not limited to the above-mentioned method. For example, if there is an on-demand bus 1 whose operating route and operating times have already been determined that passes through a boarding location specified by a first user at a boarding date and time specified by a first user, and that passes through a disembarking location specified by the first user at a disembarking date and time specified by the first user, an operation plan for the on-demand bus 1 may be generated by adding the boarding location and disembarking location specified by the first user to the stops of the on-demand bus 1.

[0032] The operation plan, including the operation route, stops, and operation times determined by the processor 101, is transmitted to a predetermined terminal via the communication unit 104. Here, if the on-demand bus 1 is an automatically driven vehicle capable of running autonomously, the predetermined terminal is a terminal mounted on the on-demand bus 1. This allows the on-demand bus 1 to run autonomously according to the operation plan generated by the server device 100. Also, if the on-demand bus 1 is a vehicle that is manually driven by a driver, the predetermined terminal is a terminal used by the driver. This allows the driver to run the on-demand bus 1 according to the operation plan generated by the server device 100.

[0033] In addition, in the server device 100, when the reservation for the first user is completed, the processor 101 transmits a first signal including location information of the boarding location of the first user to the user terminal 200 via the communication unit 104.

[0034] The hardware configuration of the server device 100 is not limited to the example shown in Fig. 2, and components may be omitted, replaced, or added as appropriate. Furthermore, the series of processes executed by the server device 100 can be executed by hardware, but can also be executed by software.

[0035] Next, the user terminal 200 is a small computer carried by the first user, and is an example of an "information processing device" according to the present disclosure. The user terminal 200 is, for example, a mobile terminal such as a smartphone or a tablet terminal. As shown in FIG. 2, the user terminal 200 in this embodiment includes a processor 201, a main memory unit 202, an auxiliary memory unit 203, a camera 204, a touch panel display 205, a position acquisition unit 206, and a communication unit 207. The processor 201, the main memory unit 202, the auxiliary memory unit 203, the camera 204, the touch panel display 205, the position acquisition unit 206, and the communication unit 207 are connected to each other by a bus.

[0036] The processor 201, main memory unit 202, and auxiliary memory unit 203 of the user terminal 200 are similar to the processor 101, main memory unit 102, and auxiliary memory unit 103 of the server device 100, respectively, and therefore their description will be omitted. However, the auxiliary memory unit 203 of the user terminal 200 stores an application program (hereinafter, sometimes referred to as a "first application program") for providing an on-demand bus service to a user.

[0037] The camera 204 captures an image of an object arbitrarily selected by the first user. The camera 204 captures an image of the object using, for example, a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

[0038] Touch panel display 205 outputs an image according to an instruction from processor 201, and outputs a signal input by the first user to processor 201. Note that, instead of touch panel display 205, user terminal 200 may be provided with a display device and an input device separately.

[0039] The location acquisition unit 206 is a sensor that acquires location information indicating the current location of the user terminal 200. The position acquisition unit 206 is, for example, a GPS (Global Positioning System) receiver. The location information acquired by the location acquisition unit 206 is, for example, latitude and longitude. Note that the location acquisition unit 206 is not limited to a GPS receiver, and the location information acquired by the location acquisition unit 206 is not limited to latitude and longitude.

[0040] The communication unit 207 is a wireless communication circuit. The wireless communication circuit is, for example, a wireless communication circuit for a mobile communication method such as 5G (5th Generation), 6G, 4G, or LTE (Long Term Evolution). The communication unit 207 connects to the network N1 via wireless communication. The wireless communication circuit may be configured to connect to the network N1 via a wireless communication method such as WiMAX or Wi-Fi (registered trademark). The communication unit 207 connects to the network N1 via wireless communication and communicates with the server device 100 via the network N1.

[0041] The hardware configuration of the user terminal 200 is not limited to the example shown in Fig. 2, and components may be omitted, replaced, or added as appropriate. Furthermore, the series of processes executed by the user terminal 200 can be executed by hardware, but can also be executed by software.

[0042] (User terminal functional configuration) Next, the functional configuration of the user terminal 200 in this embodiment will be described with reference to Fig. 3. The user terminal 200 in this embodiment includes, as its functional components, a reservation management database D210, a reservation section F210, and a display section F220.

[0043] The reservation management database D210 is constructed by a DBMS (Database Management System) program executed by the processor 201 managing data stored in the auxiliary storage unit 203. The reservation management database D210 may be constructed as a relational database.

[0044] The reservation unit F210 and the display unit F220 are achieved by the processor 201 executing a first application program stored in the auxiliary storage unit 203. The processor 201 that achieves the reservation unit F210 and the display unit F220 corresponds to the "control unit" of the information processing device according to the present disclosure.

[0045] In addition, either the reservation unit F210 or the display unit F220, or a part thereof, may be implemented using an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The information processing device according to the present disclosure may be realized by a hardware circuit such as a memory array. In this case, the hardware circuit corresponds to a "control unit" of the information processing device according to the present disclosure.

[0046] The reservation management database D210 stores information about reserved on-demand buses 1. FIG. 4 is a diagram showing an example of information stored in the reservation management database D210. The reservation management database D210 shown in FIG. 4 stores records for each reservation. Each record in the reservation management database D210 includes fields such as a reservation ID, boarding location, boarding date and time, disembarking location, and disembarking date and time. A record in the reservation management database D210 is generated when a reservation for an on-demand bus 1 is completed.

[0047] In the reservation ID field, information for identifying each reservation (reservation ID) is registered. In the boarding location field, position information of the boarding location of the on-demand bus 1 that is the subject of each reservation is registered. The position information of the boarding location is, for example, information indicating the latitude and longitude of the boarding location. In the boarding date and time field, information indicating the boarding date and time of the on-demand bus 1 that is the subject of each reservation is registered. In the disembarking location field, position information of the disembarking location of the on-demand bus 1 that is the subject of each reservation is registered. The position information of the disembarking location is, for example, information indicating the latitude and longitude of the disembarking location. In the alighting date and time field, information indicating the alighting date and time of the on-demand bus 1 that is the subject of each reservation is registered.

[0048] The structure of the records stored in the reservation management database D210 is not limited to the example shown in FIG. 4, and fields can be added, changed, or deleted as appropriate.

[0049] Returning to the explanation of FIG. 3, the reservation unit F210 will now be explained. When a user operation is input in the user terminal 200 to start the first application program, the processor 201 loads the first application program in the auxiliary storage unit 203 into the main storage unit 202 and executes it. When the first application program is started, the reservation unit F210 outputs a menu screen of the on-demand bus service to the touch panel display 205. FIG. 5 is a diagram showing an example of the menu screen of the on-demand bus service. In the example shown in FIG. 5, the menu screen of the on-demand bus service includes a "Make a reservation" button, a "Confirm reservation" button, and an explanation of each button.

[0050] When the first user inputs an operation to select a "Make a reservation" button on the touch panel display 205 outputting the menu screen of Fig. 5, the reservation unit F210 outputs a screen for inputting the first user's request (the boarding location, boarding date and time, disembarking location, and disembarking date and time, etc., desired by the first user) to the touch panel display 205. When the first user finishes inputting the request, the reservation unit F210 transmits a request signal to the server device 100 via the communication unit 207. The request signal includes the first user's desired boarding location, boarding date and time, disembarking location, and disembarking date and time, etc., as well as the first user's identification information (user ID).

[0051] In the server device 100 that has received the request signal, the boarding location, boarding date and time, disembarking location, disembarking date and time, etc. of the first user are determined based on the request signal, and a reservation for the on-demand bus 1 is made. When the reservation for the on-demand bus 1 is completed, the server device 100 transmits a first signal to the user terminal 200. The first signal includes a reservation ID in addition to the boarding location, boarding date and time, disembarking location, and disembarking date and time determined by the server device 100.

[0052] When the first signal transmitted from the server device 100 is received by the communication unit 207 of the user terminal 200, the reservation unit F210 accesses the reservation management database D210 and generates a new record. Information included in the first signal is registered in each field of the new record.

[0053] Furthermore, when the first user inputs an operation to select the "Confirm reservation" button on the touch panel display 205 that is outputting the menu screen of Fig. 5, the reservation unit F210 outputs a screen showing a list of reserved on-demand buses 1 (reservation list) to the touch panel display 205. Fig. 6 is a diagram showing an example of a screen showing the reservation list. In the example shown in Fig. 6, the screen showing the reservation list includes buttons for displaying the contents of each reservation (the "Reservation 1" button and the "Reservation 2" button in Fig. 6) and a "Back" button for returning to the screen of Fig. 5.

[0054] When the first user inputs an operation to select any of the reservation buttons in the reservation list on the touch panel display 205 outputting the reservation list screen of FIG. 6, the reservation unit F210 outputs a screen showing the reservation details corresponding to the selected button to the touch panel display 205. FIG. 7 is a diagram showing an example of the screen showing the reservation details. In the example shown in FIG. 7, the screen showing the reservation details displays character strings indicating the reservation details selected by the first user (e.g., boarding location, boarding date and time, disembarking location, disembarking date and time, etc.) and a confirmation screen for the boarding location. The reservation details include an explanation of the procedure for confirming the boarding location, a "Confirm boarding location" button, a "Cancel this reservation" button, and a "Back" button for returning to the screen of Fig. 6. Note that for the boarding location and disembarking location in the reservation details, character strings indicating addresses may be used instead of latitude and longitude. Alternatively, map information with the locations of the boarding and disembarking locations marked may be used.

[0055] When the first user inputs an operation to select the "Check boarding location" button on the touch panel display 205 outputting the reservation details screen of Fig. 7, the reservation unit F210 passes the location information (information indicating latitude and longitude) of the boarding location of the corresponding reservation to the display unit F220. Also, when the first user inputs an operation to select the "Cancel this reservation" button on the touch panel display 205 outputting the reservation details screen of Fig. 7, the reservation unit F210 transmits a request to cancel the corresponding reservation to the server device 100 through the communication unit 207. In response to this, when a signal indicating that the reservation cancellation has been completed is transmitted from the server device 100 to the user terminal 200, the reservation unit F210 accesses the reservation management database D210 and deletes the record of the corresponding reservation.

[0056] Returning to the explanation of Fig. 3, the display unit F220, when triggered by receiving position information of the boarding location from the reservation unit F210, displays a first virtual image associated with the first real scenery on the touch panel display 205. Specifically, when the first user inputs an operation to select a "Check boarding location" button on the touch panel display 205 outputting the reservation details screen of Fig. 7, the display unit F220 generates and displays an AR image. The AR image is an image in which a first virtual image (a virtual image of a bus stop sign) is superimposed on the position of the boarding location in the first real image (an image of the real scenery including the boarding location).

[0057] When generating the above-mentioned AR image, the display unit F220 first activates the camera 204 of the user terminal 200 and acquires an image captured by the camera 204. The display unit F220 determines whether the image captured by the camera 204 includes the boarding location. In other words, the display unit F220 determines whether the image captured by the camera 204 is a first real image (an image capturing a real landscape including the boarding location).

[0058] When the image captured by the camera 204 is the first real image, the display unit F220 generates an AR image by superimposing the first virtual image on the position of the boarding location in the first real image. The display unit F220 outputs the generated AR image to the touch panel display 205 of the user terminal 200.

[0059] In this embodiment, the determination of whether the boarding location is included in the image captured by the camera 204 and the generation of the AR image are performed by a location-based method based on the position information of the boarding location and the current position information of the user terminal 200 (position information acquired by the position acquisition unit 206). In this case, if the user terminal 200 is equipped with a sensor that detects the attitude and orientation, such as an acceleration sensor and a direction sensor, the above determination and generation may be performed using information such as the attitude and orientation of the user terminal 200 in addition to the position information of the boarding location and the current position information of the user terminal 200. Furthermore, the determination of whether the boarding location is included in the image captured by the camera 204 and the generation of the AR image may be performed by a vision-based method based on image recognition or spatial recognition.

[0060] An example of the display screen of the AR image in this embodiment is shown in Fig. 8. In the example shown in Fig. 8, the display screen of the AR image includes a first real image capturing the boarding location and the real scenery around it, a first virtual image showing the bus stop sign superimposed on the position of the boarding location in the first real image, and an "x" button for ending confirmation of the boarding location. A first user who has arrived near the boarding location can check the exact position of the boarding location by looking at a display screen such as that shown in Fig. 8. It is possible to grasp the location.

[0061] When the first user who has grasped the location of the boarding location operates the "x" button on the display screen of Fig. 8, the display unit F220 stops the camera 204 and ends the display of the AR image. When the display of the AR image ends, the reservation unit F210 causes the touch panel display 205 to display the screen of Fig. 7 described above.

[0062] When the image captured by the camera 204 is not the first real image, the display unit F220 displays the image captured by the camera 204 on the touch panel display 205 of the user terminal 200. In this case, the first user can change the orientation of the camera 204 so that an AR image such as that shown in FIG.

[0063] (Processing flow) Next, the flow of processing performed in the user terminal 200 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing a processing routine executed in the user terminal 200, triggered by the first user inputting an operation to select a "Confirm boarding location" button on the touch panel display 205 outputting the reservation details screen of Fig. 7. The processing routine shown in Fig. 9 is executed by the processor 201 of the user terminal 200, but here the description will be given assuming that the functional components of the user terminal 200 are the executing entities.

[0064] In Fig. 9, when a user who has arrived near the boarding location calls up the reservation details screen of Fig. 7 on the user terminal 200 and selects the "Confirm boarding location" button, the reservation unit F210 passes the location information of the boarding location to the display unit F220. The display unit F220 is triggered by receiving the information from the reservation unit F210 to start up the camera 204 of the user terminal 200 (step S101). After completing the process of step S101, the display unit F220 executes the process of step S102.

[0065] In step S102, the display unit F220 acquires an image captured by the camera 204. After completing the process of step S102, the display unit F220 executes the process of step S103.

[0066] In step S103, the display unit F220 judges whether the captured image of the camera 204 is the first actual image. Specifically, the display unit F220 judges whether the captured image of the camera 204 includes the boarding place by a location-based method based on the position information of the boarding place, the position information (current position information of the user terminal 200) acquired by the position acquisition unit 206, and the captured image of the camera 204. If the captured image of the camera 204 includes the boarding place, the display unit F220 judges that the captured image of the camera 204 is the first image (positive judgment in step S103). In this case, the display unit F220 executes the process of step S104. On the other hand, if the captured image of the camera 204 does not include the boarding place, the display unit F220 judges that the captured image of the camera 204 is not the first image (negative judgment in step S103). In this case, the display unit F220 executes the process of step S106.

[0067] In step S104, the display unit F220 generates an AR image by combining an image captured by the camera 204 (first real image) with a virtual image of a bus stop sign (first virtual image). In detail, the display unit F220 generates the AR image by superimposing the first virtual image on the boarding location position in the first real image. After completing the process of step S104, the display unit F220 executes the process of step S105.

[0068] In step S105, the display unit F220 displays the AR image generated in step S104 on the touch panel display 205 of the user terminal 200.

[0069] Also, in step S106, the display unit F220 displays the image captured by the camera 204 on the touch panel display 205 as is.

[0070] When the display unit F220 finishes executing the process of step S105 or step S106, it executes the process of step S107. In step S107, the display unit F220 determines whether an operation to end the display of the AR image or the captured image has been input. Specifically, the display unit F220 determines whether the "x" button on the display screen of FIG. 8 has been operated. If the "x" button on the display screen of FIG. 8 has not been operated (negative determination in step S107), the display unit F220 executes the processes of step S102 and thereafter again. On the other hand, if the "x" button on the display screen of FIG. 8 has been operated (positive determination in step S107), the display unit F220 executes the process of step S108.

[0071] In step S108, the display unit F220 stops the camera 204 and ends the display of the AR image or the captured image on the touch panel display 205. After the display of the AR image or the captured image on the touch panel display 205 has ended, the reservation unit F210 causes the touch panel display 205 to display the reservation details screen of FIG.

[0072] (Effects of the embodiment) According to this embodiment, the first user can activate the camera 204 of the user terminal 200 through the first application program in the vicinity of the boarding location, and display an AR image in which the first virtual image is superimposed on the position of the boarding location in the first real image on the touch panel display 205 of the user terminal 200. This allows the first user to grasp the exact position of the boarding location in real space by looking at the AR image. As a result, the first user can easily find the exact boarding location. In addition, the first user can also suppress anxiety about whether the place where the first user is waiting for the on-demand bus 1 is the correct boarding location.

[0073] <Variation 1> In the above-described embodiment, an example was described in which an AR image in which a first virtual image is superimposed on a first real image is generated and displayed. In this modified example, an example is described in which an AR image in which a second virtual image and a third virtual image are superimposed on a first real image in addition to the first virtual image is generated and displayed. The second virtual image here is a virtual image showing a location where a first user waits until the on-demand bus 1 arrives at the boarding location. The third virtual image is a virtual image showing the boarding order of the first users.

[0074] Fig. 10 is a diagram showing an example of a display screen of an AR image in this modified example. In the example shown in Fig. 10, the display screen of the AR image includes a first real image capturing a real scene of a boarding location and its vicinity, a first virtual image superimposed on the position of the boarding location in the first real image, a second virtual image superimposed on the position of the waiting location in the first real image, a third virtual image superimposed on a position other than the boarding location and the waiting location in the first real image, and an "x" button for terminating confirmation of the boarding location. Note that the AR image is not limited to one including both the second virtual image and the third virtual image, and may include only one of them.

[0075] In this modified example, the first signal includes, in addition to the position information of the boarding locations, position information of waiting locations and information indicating the boarding order of the first users. The boarding order of the first users may be determined, for example, according to the order in which the server device 100 accepts reservations. The display unit F220 generates a second virtual image based on the position information of the waiting locations included in the first signal, and superimposes the generated second virtual image on the first actual image. The display unit F220 also generates a third virtual image based on the boarding order information of the first users included in the first signal, and The third virtual image thus obtained is superimposed on the first actual image. The position at which the third virtual image is superimposed may be any position other than the positions at which the first virtual image and the second virtual image are superimposed.

[0076] According to this modification, the first user can grasp the location of the boarding place, the location of the waiting place, and the boarding order by looking at an AR image such as that shown in Fig. 10. This enables the first user to wait for the arrival of the on-demand bus 1 without disturbing passersby, etc. Also, multiple users, including the first user, can board the on-demand bus 1 in the boarding order.

[0077] <Variation 2> In the above-described embodiment, an example was described in which an AR image in which a first virtual image is superimposed on a first real image is generated and displayed. In this modified example, an example is described in which an AR image in which a fourth virtual image and a fifth virtual image are superimposed on a first real image in addition to the first virtual image is generated and displayed. The fourth virtual image here is a virtual image for identifying other users waiting for the on-demand bus 1 at the boarding location. The fifth virtual image is a virtual image that indicates the number of other users waiting for the on-demand bus 1 at the boarding location.

[0078] FIG. 11 is a diagram showing an example of a display screen of an AR image in this modified example. In the example shown in FIG. 11, the display screen of the AR image includes a first real image capturing a real scene of the boarding location and its vicinity, a first virtual image superimposed on the position of the boarding location in the first real image, a fourth virtual image superimposed on the positions of other users waiting for the on-demand bus 1 at the boarding location, a fifth virtual image superimposed on the positions other than the boarding location and the other users in the first real image, and an "x" button for terminating confirmation of the boarding location. Note that the AR image is not limited to one including both the fourth virtual image and the fifth virtual image, and may include only one of them.

[0079] In the user terminal 200 of this modification, from the time when the "Check boarding location" button on the reservation details screen in Fig. 7 described above is operated until the "X" button on the display screen of the AR image shown in Fig. 11 is operated, the display unit F220 communicates with the server device 100 via the communication unit 207 to obtain in real time position information and the number of other users waiting for the on-demand bus 1 at the boarding location. Then, the display unit F220 generates and superimposes a fourth virtual image and a fifth virtual image based on the information obtained from the server device 100.

[0080] 11, an image of an arrow pointing to other users waiting for the on-demand bus 1 at the boarding location is used as the fifth virtual image, but an image other than an arrow may be used. For example, the fifth virtual image may be a frame image surrounding other users waiting for the on-demand bus 1 at the boarding location, or an image in which other users waiting for the on-demand bus 1 at the boarding location are filled in with a specific color.

[0081] According to this modified example, the first user can distinguish between other users waiting for the on-demand bus 1 at the boarding location and pedestrians, etc., near the boarding location by looking at an AR image such as that shown in FIG. 11.

[0082] <Variation 3> In the above-described embodiment and modified example 1-2, an example was described in which a virtual image of a bus stop sign is used as the first virtual image. In this modified example, an example is described in which a virtual image that identifies a second user waiting for the on-demand bus 1 at the boarding location is used as the first virtual image. The second user here is one of the other users waiting for the on-demand bus 1 at the boarding location.

[0083] Fig. 12 is a diagram showing an example of a display screen of an AR image in this modified example. In the example shown in Fig. 12, the display screen of the AR image includes a first real image capturing a real scene of the boarding location and its vicinity, a first virtual image for identifying a second user waiting for the on-demand bus 1 at the boarding location in the first real image, and an "x" button for ending confirmation of the boarding location.

[0084] In the user terminal 200 in this modification, from the time when the "Check boarding location" button on the reservation details screen in Fig. 7 described above is operated until the "X" button on the display screen of the AR image shown in Fig. 11 is operated, the display unit F220 acquires the position information of the second user by communicating with the server device 100 through the communication unit 207. Then, the display unit F220 generates and superimposes a first virtual image based on the information acquired from the server device 100.

[0085] 12, when there are multiple other users waiting for the on-demand bus 1 at the boarding location, the other user who arrives at the boarding location first may be set as the second user. If the other user who arrives at the boarding location first leaves the boarding location before the on-demand bus 1 arrives at the boarding location, the other user who arrives at the boarding location second may be reset as the second user.

[0086] 12, a frame image surrounding the second user is used as the first virtual image, but an image other than a frame image may be used. For example, the first virtual image may be an image in which the second user is filled with a specific color.

[0087] According to this modification, it is possible to obtain the same effects as those of the above-described embodiment.

[0088] <Other> The above-mentioned embodiment and modified examples are merely examples, and the present disclosure may be modified as appropriate within the scope of the gist of the disclosure. In addition, the processes and configurations described in the above-mentioned embodiment and modified examples may be freely combined and implemented as long as no technical contradiction occurs. For example, the embodiment and modified examples 1-3 may be combined and implemented.

[0089] Furthermore, the processes described as being performed by one device may be shared and executed by a plurality of devices. For example, a part of the processes executed by the user terminal 200 may be executed by the server device 100. For example, the process of generating an AR image may be executed by the server device 100. In a computer system, the hardware configuration for implementing each function can be flexibly changed.

[0090] Furthermore, the information processing device according to the present disclosure is not limited to a mobile terminal such as a smartphone or a tablet terminal as exemplified in the above-mentioned embodiment and modified example, but may be smart glasses equipped with an optical see-through display device, etc. In this case, a processor of the smart glasses or the like may display a first virtual image at a position corresponding to the boarding location on the display device in a state where the first real scenery is transmitted.

[0091] The present disclosure can also be realized by supplying a computer program that implements the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium that can be connected to the system bus of the computer, or may be provided to the computer via a network. A non-transitory computer-readable storage medium is a recording medium that can store information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer or the like. Such a recording medium may be any type of disk, such as a magnetic disk (floppy disk, hard disk drive (HDD), etc.) and an optical disk (CD-ROM, DVD disk, Blu-ray disk, etc.). The recording medium may also be a medium such as a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or an SSD (Solid State Drive). [Explanation of symbols]

[0092] 1. On-Demand Bus 100 Server device 200 User terminals 201 Processor D210 Reservation Management Database F210 Reservations F220 display section 202 Main memory 203 Auxiliary storage 204 Camera 205 Touch Panel Display 206 Position acquisition part 207 Communications Department

Claims

1. An information processing device carried by a first user who plans to board an on-demand bus, A display device capable of displaying information; a control unit that causes the display device to display a first virtual image indicating a bus stop in association with a first real scene including a boarding location of the first user; Equipped with the first virtual image is an image that identifies a second user who is one of the other users waiting for the on-demand bus at the boarding location; The second user is another user who arrives at the boarding location first among other users waiting for the on-demand bus at the boarding location. Information processing device.

2. the control unit causes the display device to display, in addition to the first virtual image, a second virtual image indicating a location where the first user waits until the on-demand bus arrives at the boarding location in association with the first actual scenery; The information processing device according to claim 1 .

3. The control unit causes the display device to display, in addition to the first virtual image, a third virtual image indicating a boarding order of the first users in association with the first actual scenery. The information processing device according to claim 2 .

4. the control unit causes the display device to display, in addition to the first virtual image, a fourth virtual image indicating the number of other users waiting for the on-demand bus at the boarding location in association with the first actual scene; The information processing device according to claim 1 .

5. the control unit causes the display device to display, in addition to the first virtual image, a fifth virtual image that identifies other users waiting for the on-demand bus at the boarding location in association with the first actual scene; The information processing device according to claim 1 .

6. When the other user who first arrives at the boarding location leaves the boarding location, the control unit sets the other user who secondly arrives at the boarding location to the second user. The information processing device according to claim 1 .

7. a camera that captures the first actual scene to obtain a first actual image; The control unit is generating an AR image in which the first virtual image is superimposed on the position of the boarding location in the first actual image; displaying the AR image on the display device; Execute The information processing device according to claim 1 .

8. A computer carried by a first user who is scheduled to board an on-demand bus is to display, on a display device, a first virtual image indicating a bus stop in association with a first real scene including a boarding location of the first user; It is a program, the first virtual image is an image that identifies a second user who is one of the other users waiting for the on-demand bus at the boarding location; The second user is another user who arrives at the boarding location first among other users waiting for the on-demand bus at the boarding location. program.

9. The computer includes: displaying, on the display device, a second virtual image indicating a location where the first user waits until the on-demand bus arrives at the boarding location in addition to the first virtual image, in association with the first actual scene; The program according to claim 8.

10. The computer includes: displaying, on the display device, a third virtual image indicating a boarding order of the first users in addition to the first virtual image, in association with the first actual scenery; The program according to claim 8.

11. The computer includes: displaying, on the display device, a fourth virtual image indicating the number of other users waiting for the on-demand bus at the boarding location in addition to the first virtual image, in association with the first actual scene; The program according to claim 8.

12. The computer includes: displaying, on the display device, a fifth virtual image that identifies other users waiting for the on-demand bus at the boarding location in addition to the first virtual image, in association with the first real scene; The program according to claim 8.

13. when the other user who first arrives at the boarding location leaves the boarding location, the computer sets the other user who secondly arrives at the boarding location as the second user; The program according to claim 8.

14. the computer further includes a camera that captures the first actual scene to obtain a first actual image; generating an AR image in which the first virtual image is superimposed on the position of the boarding location in the first actual image; displaying the AR image on the display device; causing the computer to execute The program according to claim 8.

Images