Information processing method, information processing device, and information processing system

Abstract

To provide an information processing method which allows for adding a new value to the use of mobile vehicles by improving convenience for passengers while boarding or after getting off the mobile vehicle.SOLUTION: An information processing method is provided, comprising causing an information processing device to associate identification information of a mobile vehicle present at a remote site with identification information of a passenger of the mobile vehicle in the information processing device, and control a device in the mobile vehicle according to the associated information.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present disclosure relates to an information processing method, an information processing apparatus, and an information processing system.

Background Art

[0002] When a user uses a taxi, the user not only searches for a taxi without passengers on the road or the like, but also uses a dispatching application installed on the user terminal possessed by the user to transmit information such as the current location of the user and requests the taxi company to dispatch a vehicle. In recent years, due to the development of the means as described above, it can be said that the convenience of taxis has been further improved.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the scenes while a user (passenger) is in a taxi (mobile body) or after getting off have not been focused on, and means for improving the convenience of the user while in or after getting off a taxi have not been deeply studied.

[0005] Therefore, in the present disclosure, in view of the above situation, an information processing method, an information processing apparatus, and an information processing system are proposed that can add new added value to the use of a mobile body by improving the convenience of a passenger while in or after getting off a mobile body.

Means for Solving the Problems

[0006] According to this disclosure, an information processing method is provided which includes linking identification information of a mobile object located in a remote location with identification information of a passenger in the mobile object to the information processing device, and controlling equipment inside the mobile object based on the linked information.

[0007] Furthermore, according to this disclosure, an information processing device is provided which includes a control unit that links identification information of a mobile body located in a remote location with identification information of the passengers of the mobile body, and controls equipment inside the mobile body based on the linked information.

[0008] Furthermore, according to this disclosure, an information processing system is provided which includes an information processing device and equipment installed on a mobile body located remotely from the information processing device, wherein the information processing device links identification information of the mobile body with identification information of passengers on the mobile body, and controls equipment within the mobile body based on the linked information. [Brief explanation of the drawing]

[0009] [Figure 1] This is a system diagram showing the schematic functional configuration of the information processing system 10 according to the first embodiment of this disclosure. [Figure 2] This is an explanatory diagram showing an example of the installation of a rear-seat tablet 30 according to the first embodiment of this disclosure. [Figure 3] This is an explanatory diagram illustrating an example configuration of a driver tablet 40 and a taxi meter 50 according to the first embodiment of this disclosure. [Figure 4] This is a block diagram showing an example configuration of a user terminal 20 according to the first embodiment of this disclosure. [Figure 5] This is a block diagram showing an example configuration of the interface unit 60 according to the first embodiment of the present disclosure. [Figure 6] This is a block diagram showing an example configuration of the cloud server 80 according to the first embodiment of this disclosure. [Figure 7] This is a sequence diagram of an information processing method according to the first embodiment of the present disclosure. [Figure 8]This is an explanatory diagram illustrating an information processing method according to the first embodiment of this disclosure. [Figure 9] This figure shows an example of a configuration information table 842 according to the first embodiment of this disclosure. [Figure 10] This is an explanatory diagram (part 1) showing an example of a display in the information processing method according to the first embodiment of this disclosure. [Figure 11] This is an explanatory diagram (part 2) showing an example of a display in the information processing method according to the first embodiment of this disclosure. [Figure 12] This is a system diagram showing the schematic functional configuration of the information processing system 10a according to the second embodiment of this disclosure. [Figure 13] This is a block diagram showing an example configuration of the cloud server 80a according to the second embodiment of this disclosure. [Figure 14] This is a sequence diagram of an information processing method according to a second embodiment of the present disclosure. [Figure 15] This is an explanatory diagram (part 1) showing an example of a display in the information processing method according to the second embodiment of this disclosure. [Figure 16] This is an explanatory diagram illustrating an information processing method according to a second embodiment of the present disclosure. [Figure 17] This is an explanatory diagram (part 2) showing an example of a display in the information processing method according to the second embodiment of this disclosure. [Figure 18] This is an explanatory diagram (part 3) showing an example of a display in the information processing method according to the second embodiment of this disclosure. [Figure 19] This is a sequence diagram of an information processing method relating to a modified example of the second embodiment of the present disclosure. [Figure 20] This is an explanatory diagram (part 1) illustrating an information processing method relating to a modified example of the second embodiment of the present disclosure. [Figure 21] This is an explanatory diagram showing an example of a display in an information processing method relating to a modified example of the second embodiment of the present disclosure. [Figure 22] This is an explanatory diagram (part 2) illustrating an information processing method relating to a modified example of the second embodiment of the present disclosure. [Figure 23]It is a block diagram showing an example of a hardware configuration.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, for components having substantially the same functional configuration, the same reference numerals are given to omit duplicate explanations. Also, in this specification and the drawings, when distinguishing a plurality of components having substantially the same or similar functional configurations, different alphabets may be attached after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of components having substantially the same or similar functional configurations, only the same reference numeral is given.

[0011] In each of the following embodiments of the present disclosure, the use in a taxi (vehicle) will be described as an example, but each embodiment of the present disclosure can also be applied to use in ships and aircraft. Furthermore, in the present disclosure, moving bodies such as these vehicles, ships, and aircraft shall include autonomous vehicles, unmanned ships, etc. Also, in the following description, the user shall mean a passenger in a taxi.

[0012] The description will be made in the following order. 1. First Embodiment 1.1 Background 1.2 Configuration of Information Processing System 1.3 Detailed Configuration of User Terminal, Rear Seat Tablet, and Crew Tablet 1.4 Detailed Configuration of Interface Unit 1.5 Detailed Configuration of Cloud Server 1.6 Information Processing Method 2. Second Embodiment 2.1 Background 2.2 Configuration of Information Processing System 2.3 Detailed Configuration of Cloud Server 2.4 Information Processing Method 2.5 Variation 3. Summary 4. Example Hardware Configuration 5. Supplementary Information

[0013] <<1. First Embodiment>> <1.1 Background> As explained earlier, improving user convenience during and after a ride in a taxi has not been given much consideration until now. Here, we will focus on user convenience during the ride. For example, when a passenger gets into a taxi, they may ask the driver to adjust the cabin temperature or lighting. However, in such cases, the passenger has to make the request directly to the driver, which some passengers find bothersome. Also, some passengers want to avoid conversation with the driver as much as possible to prevent infection. Furthermore, if a wall is installed between the driver's seat and the back seat to prevent infection, smooth communication between the passenger and the driver becomes difficult.

[0014] Therefore, in the first embodiment of this disclosure, we propose an information processing system that can control in-vehicle equipment and set the in-vehicle environment to a state desired by the user, without requiring conversation between the user and the crew. According to this embodiment, the user's convenience during the ride is improved because the in-vehicle environment can be set to a state desired by the user while reducing inconvenience to the user. The details of this embodiment will be described in order below.

[0015] <1.2 Configuration of the Information Processing System> Next, an example of the configuration of the information processing system 10 according to the first embodiment of this disclosure will be described with reference to Figures 1 to 3. Figure 1 is a system diagram showing the schematic functional configuration of the information processing system 10 according to this embodiment, and Figure 2 is an explanatory diagram showing an example of the installation of the rear seat tablet 30 according to this embodiment. Figure 3 is an explanatory diagram illustrating an example of the configuration of the driver tablet 40 and taxi meter 50 according to this embodiment.

[0016] As shown in Figure 1, the information processing system 10 according to this embodiment includes a user terminal 20, a rear-seat tablet (passenger display terminal) 30, a driver's tablet (driver's display terminal) 40, a taxi meter 50, an interface unit 60, in-vehicle equipment 70 installed in the taxi such as an air conditioner (hereinafter referred to as "air conditioner") 70a, and a cloud server (information processing device) 80. In the embodiment of this disclosure, these devices are connected to each other so as to be able to communicate via a communication network 90. ​​Specifically, the user terminal 20, the rear-seat tablet 30, the driver's tablet 40, and the cloud server 80 are connected to the communication network 90 via a base station (not shown) or the like (e.g., a mobile phone base station, a wireless LAN (Local Area Network) access point, etc.). The communication method used in the communication network 90 can be any method, whether wired or wireless (e.g., 5G, WiFi®, Bluetooth®, etc.), but it is desirable to use a communication method that can maintain stable operation. The following describes the general features of each device included in the information processing system 10 according to this embodiment.

[0017] (User terminal 20) The user terminal 20 is a device used by the user on a daily basis, capable of sending user input information to the cloud server 80 and receiving notifications and images from the cloud server 80. In this embodiment, the user terminal 20 may have an application distributed by the administrator of the cloud server 80 installed, or it may have a browser installed for viewing websites provided by the administrator of the cloud server 80. For example, the user terminal 20 can be a smartphone, tablet, mobile phone, laptop PC (Personal Computer), smartwatch, Head Mounted Display (HMD), or other device. The detailed configuration of the user terminal 20 will be described later.

[0018] (Rear seat tablet 30) The rear-seat tablet 30 is a terminal used by the user, capable of transmitting input information from the passenger to the cloud server 80, etc., and displaying notifications and images from the cloud server 80. For example, the rear-seat tablet 30 can be a tablet or other device installed on the upper back of the passenger seat 702 of the vehicle, as shown in Figure 2. The detailed configuration of the rear-seat tablet 30 will be described later.

[0019] (Crew member tablet 40) The crew tablet 40 is a terminal used by the crew (driver) that can transmit input information from the crew to the cloud server 80, etc., and display notifications and images from the cloud server 80. For example, the crew tablet 40 can be a tablet or other device installed in front of the dashboard, etc. Alternatively, in this embodiment, instead of the crew tablet 40, there may be a projection device that can project onto the windshield. In this case, the input device used by the crew may be a microphone (hereinafter referred to as "microphone") installed inside the vehicle. The detailed configuration of the crew tablet 40 will be described later. In addition, in this embodiment, the crew tablet 40 can also cooperate with an ETC (Electronic Toll Collection) onboard unit (not shown), a drive recorder (not shown), etc. installed in the vehicle.

[0020] (Taxi meter 50) The taxi meter 50 is a device that automatically calculates and displays fares and charges based on the distance traveled or the ride time. Furthermore, the taxi meter 50 may transmit information about the vehicle's status (such as "empty" when there are no passengers, or "occupied" when there are passengers) along with location information via the driver's tablet 40. In this embodiment, as shown in Figure 3, the taxi meter 50 may be connected to a payment terminal 52 that processes fare settlement with the user, and may also be connected to the aforementioned driver's tablet 40.

[0021] Furthermore, the payment terminal 52 described above can perform payments such as credit card payments, electronic money payments, and QR code payments. More specifically, the payment terminal 52 may be equipped with a magnetic card reader for reading magnetic cards, an IC card reader for reading contact-type IC cards, a contactless reader / writer for reading and writing to contactless IC cards, a camera capable of reading QR codes, a thermal printer for issuing receipts after payment is completed, and the like.

[0022] (Interface unit 60) The interface unit 60 is a device that controls various in-vehicle equipment 70, which will be described later. For example, it can acquire control information from the cloud server 80 via the crew tablet 40 and control the various in-vehicle equipment 70 based on the acquired control information. The detailed configuration of the interface unit 60 will be described later.

[0023] (In-vehicle equipment 70) The in-vehicle equipment 70 may include an air conditioner (air conditioning equipment) 70a, lighting equipment 70b for the rear seats, seat heaters (heating equipment) 70c, and audio equipment (sound system) 70d installed inside the vehicle. In addition, the in-vehicle equipment 70 may also include a rear seat tablet 30, a crew tablet 40, or a reclining seat installed in the rear seat.

[0024] (Cloud Server 80) The cloud server 80 is installed in a remote location relative to the taxi. The cloud server 80 can obtain the user's identification information, along with the identification information of the taxi the user is riding in, from the user terminal 20. Furthermore, the cloud server 80 can extract control information for controlling the in-vehicle equipment 70 based on the user's identification information, and control the in-vehicle equipment 70 based on the extracted control information. In addition, the cloud server 80 can dispatch a taxi based on a request from the user. The cloud server 80 is composed of, for example, a computer. The detailed configuration of the cloud server 80 will be described later.

[0025] In Figure 1, the information processing system 10 according to this embodiment is shown as including one user terminal 20, a rear-seat tablet 30, a driver tablet 40, a taxi meter 50, and an interface unit 60, but this embodiment is not limited to this. For example, the information processing system 10 according to this embodiment may include multiple user terminals 20, rear-seat tablets 30, driver tablets 40, taxi meters 50, interface units 60, and in-vehicle equipment 70.

[0026] <1.3 Detailed Configuration of User Terminals, Rear Seat Tablets, and Crew Tablets> Next, the detailed configuration of the user terminal 20 will be described with reference to Figure 4. Figure 4 is a block diagram showing an example configuration of the user terminal 20 according to this embodiment. In this embodiment, the rear seat tablet 30 and the crew tablet 40 can be described in the same way as the user terminal 20.

[0027] In detail, as shown in Figure 4, the user terminal 20 according to this embodiment mainly comprises a control unit 200, an input unit 210, an output unit 220, a communication unit 230, and a storage unit 240. The functions of each part of the user terminal 20 will be described below.

[0028] (Control unit 200) The control unit 200 is implemented, for example, by a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and can control each functional part of the user terminal 20, which will be described later.

[0029] (Input section 210) The input unit 210 can receive data and commands to the user terminal 20. More specifically, the input unit 210 is implemented by a touch panel, keyboard, buttons, microphone, etc. In the case of the rear-seat tablet 30, the input unit can not only use its own built-in touch panel, etc., but also communicate with the user terminal 20, allowing the user terminal 20 to function as an input unit.

[0030] (Output section 220) The output unit 220 is composed of, for example, a display, speaker, lamp, video output terminal, audio output terminal, etc., and can output various types of information to the user in the form of images, flashing lights, sounds, etc.

[0031] (Communications Section 230) The communication unit 230 can send and receive information (for example, data and images) with external devices. In other words, the communication unit 230 can be described as a communication interface that has the function of sending and receiving data. Specifically, the communication unit 230 is realized by communication devices such as a communication antenna, a transmitting and receiving circuit, and a port.

[0032] (Storage unit 240) The memory unit 240 can store programs, information, etc., for the control unit 200 to execute various processes, as well as information obtained through those processes. The memory unit 240 can be implemented, for example, by a magnetic recording medium such as a hard disk (HD) or a nonvolatile memory such as flash memory.

[0033] The user terminal 20 according to this embodiment is not limited to the configuration example shown in Figure 4, and may further include other functional units. In this embodiment, the user terminal 20 and the crew tablet 40 may include a positioning sensor (not shown). This positioning sensor is a sensor that detects location, and specifically can be a GNSS (Global Navigation Satellite System) receiver or the like. In this case, the positioning sensor can generate sensing data indicating the latitude and longitude of the current location based on signals from GNSS satellites.

[0034] <1.4 Detailed Configuration of Interface Units> Next, the configuration of the interface unit 60 according to this embodiment will be described with reference to Figure 5. Figure 5 is a block diagram showing an example configuration of the interface unit 60 according to this embodiment. In detail, the interface unit 60 mainly comprises a control unit 600, a communication unit 630, and a storage unit 640, as shown in Figure 5. The following describes each functional part of the interface unit 60.

[0035] (Control unit 600) The control unit 600 is implemented, for example, by a CPU, ROM, RAM (Random Access Memory), etc., and can control each functional part of the interface unit 60, which will be described later. Furthermore, the control unit 600 can control the in-vehicle equipment 70 based on control information acquired from the cloud server 80.

[0036] (Communications Section 630) The communication unit 630 can send and receive information (for example, control information) between the crew tablet 40 and the in-vehicle equipment 70. In other words, the communication unit 630 can be described as a communication interface that has the function of sending and receiving data. Specifically, the communication unit 630 is realized by communication devices such as a communication antenna, a transmitting and receiving circuit, and a port.

[0037] (Storage unit 640) The storage unit 640 can store programs, information, etc., for the control unit 600 described above to execute various processes. The storage unit 640 can be implemented, for example, by a magnetic recording medium such as a hard disk or a non-volatile memory such as flash memory.

[0038] It should be noted that the interface unit 60 according to this embodiment is not limited to the configuration example shown in Figure 5, and may further include other functional parts, for example.

[0039] <1.5 Detailed configuration of the cloud server> Next, the configuration of the cloud server 80 according to this embodiment will be described with reference to Figure 6. Figure 6 is a block diagram showing an example configuration of the cloud server 80 according to this embodiment. In detail, as shown in Figure 6, the cloud server 80 mainly comprises a processing unit (control unit) 800, an input unit 810, an output unit 820, a communication unit (acquisition unit) 830, and a storage unit 840. The following describes each functional unit of the cloud server 80.

[0040] (Processing Unit 800) The processing unit 800 can control each functional unit of the cloud server 80. This processing unit 800 is implemented by hardware such as a CPU, ROM, and RAM. For example, the processing unit 800 can link taxi identification information with user identification information and extract control information from the storage unit 840 (described later) for controlling in-vehicle equipment 70 linked to the user identification information. Furthermore, the processing unit 800 can transmit the extracted control information to the interface unit 60 via the driver's tablet 40 linked to the taxi identification information. The interface unit 60, upon receiving the control information, then controls the in-vehicle equipment 70 based on that control information.

[0041] (Input section 810) The input unit 810 can accept data and commands to be input to the cloud server 80. More specifically, the input unit 210 is implemented by a touch panel, keyboard, buttons, microphone, etc.

[0042] (Output section 820) The output unit 820 is composed of, for example, a display, a speaker, etc., and can output various types of information, such as images and sounds, to the administrator of the cloud server 80.

[0043] (Communications Department 830) The communication unit 830 can send and receive information (e.g., information and images) between the user terminal 20, the rear seat tablet 30, and the crew tablet 40. In other words, the communication unit 830 can be described as a communication interface that has the function of sending and receiving data. Specifically, the communication unit 830 is realized by communication devices such as a communication antenna, a transmitting and receiving circuit, and a port.

[0044] (Storage unit 840) The memory unit 840 can store programs, information, etc., for the processing unit 800 to execute various processes, as well as information obtained through processing. In detail, the memory unit 840 stores control information (for example, a setting information table 842) for controlling the in-vehicle equipment 70 linked to the user's identification information. Furthermore, the memory unit 840 may also store estimation models, algorithms, etc., used by the processing unit 800. The memory unit 840 can be implemented, for example, by a magnetic recording medium such as a hard disk or a non-volatile memory such as flash memory.

[0045] The cloud server 80 according to this embodiment is not limited to the configuration example shown in Figure 6, and may further include other functional units, for example. Furthermore, the cloud server 80 may be composed of multiple information processing devices connected to each other via a communication network 90.

[0046] <1.6 Information Processing Methods> The details of the information processing system 10 and each device included in the information processing system 10 according to this embodiment have been described above. Next, the information processing method according to this embodiment will be described with reference to Figures 7 to 11. Figure 7 is a sequence diagram of the information processing method according to this embodiment, Figure 8 is an explanatory diagram for explaining the information processing method according to this embodiment, and Figure 9 is a diagram showing an example of the setting information table 842 according to this embodiment. Figures 10 and 11 are explanatory diagrams showing display examples in the information processing method according to this embodiment.

[0047] As shown in Figure 7, the information processing method according to this embodiment includes several steps from step S101 to step S114. The details of each step included in the information processing method according to this embodiment will be described below. Figure 7 shows an example of the information processing according to this embodiment, specifically the flow of information processing when a user finds and uses an empty taxi.

[0048] Furthermore, when using a ride-hailing app, the information processing according to this embodiment will begin with the following steps.

[0049] First, the user requests a taxi using an app installed on their mobile user terminal 20. Upon receiving the request, the cloud server 80 obtains the user's location information or the location information of the pickup location specified by the user from the user terminal 20. Next, the cloud server 80 generates a dispatch request number as the user's identification information, searches for a taxi close to the above location information, and determines that taxi to be dispatched to the user. The cloud server 80 then transmits information regarding the user's dispatch (the user's location information or the location information of the pickup location specified by the user, and the user's identification information, etc.) to the selected taxi (specifically, the driver's tablet 40). Furthermore, if the driver of the taxi approves the dispatch, the cloud server 80 links the taxi's identification information with the user's identification information and transmits information regarding the dispatch (the taxi's location information and identification information, etc.) to the user terminal 20. Finally, the driver's tablet 40 starts navigation based on the received information regarding the user's dispatch.

[0050] Next, when the user gets into the taxi, the driver switches the taxi meter 50 to occupying mode, and the driver's tablet 40 starts navigation to a destination registered in the app beforehand, or to a destination directly instructed by the user.

[0051] Then, when the user boards the vehicle, the rear seat tablet 30 displays a one-dimensional code (e.g., a barcode) or a two-dimensional code (e.g., a QR code (registered trademark), etc.) 350, as shown in Figure 8 (step S101). However, if the user requests a taxi dispatch using an application installed on the user terminal 20, the execution of step S101 is omitted.

[0052] As shown in Figure 8, the user reads a one-dimensional or two-dimensional code 350 displayed on the rear seat tablet 30 with their personal user terminal 20. Furthermore, the user terminal 20, having read these one-dimensional or two-dimensional codes 350, transmits the user's identification information (specifically, information identifying the user terminal 20, etc.) along with the identification information of the taxi they are riding in, to the cloud server 80 according to the information contained in these codes (step S102). In this way, the taxi and the user are linked. Note that if the user requests a taxi dispatch using an app installed on the user terminal 20, the user and the taxi are already linked in the cloud server 80, so the execution of step S102 is omitted.

[0053] The cloud server 80 checks if the received user identification information exists in its storage unit 840. If it confirms existence, it extracts the configuration information associated with that identification information from the storage unit 840. Furthermore, the cloud server 80 transmits the extracted configuration information to the rear seat tablet 30 and the crew tablet 40 (step S103).

[0054] The configuration information is stored in the storage unit 840 in the form of a configuration information table 842, as shown in Figure 9. The configuration information table 842 stores information related to each user's identification information (ID) and the user's previously set preferences for the interior temperature, interior illumination, and display on the rear seat tablet 30 (shown as "rear seat display" in the figure). More specifically, in addition to the above information, the configuration information also includes information on the display design of the rear seat tablet 30 (display style, background, icon arrangement, etc.), information on content the user has viewed or wants to view (news and news items, video content, music content, games, karaoke), and information on the state of the content at the end of viewing (when the user gets out of the taxi) when the user previously viewed that content (elapsed time, etc.). Furthermore, the settings information may also include instructions for the taxi driver (for example, instructions to drive in a way that does not cause motion sickness because the user is prone to motion sickness, instructions to avoid using the radio, instructions to pay attention to ventilation because the user is easily bothered by odors inside the car, etc.).

[0055] In this embodiment, the above-mentioned setting information may be set by the user when registering for the app, or it may be set when the user previously took a taxi.

[0056] The crew tablet 40 obtains the above configuration information from the cloud server 80 (step S104).

[0057] The crew tablet 40 displays the instructions for the crew included in the above setting information (step S105). In this embodiment, the instructions for the crew may be output by voice.

[0058] The rear seat tablet 30 obtains the above configuration information from the cloud server 80 (step S106).

[0059] The rear-seat tablet 30 switches the display according to the display control information included in the above setting information (step S107). In this way, in this embodiment, the rear-seat tablet 30 displays the content the user wants to view in the user's preferred style. Furthermore, if the display control information includes information on the content the user has viewed (video content, music content, games, karaoke, etc.) and information on the state of the content at the time the user finished viewing the content previously (when the user got out of the taxi) (elapsed time, etc.), the rear-seat tablet 30 will start playing the content from the state at the time the viewing ended, based on this information. In this embodiment, if the setting information does not include display control information, the rear-seat tablet 30 may display advertisements, etc. in the style defined in the initial settings. In this case, if the cloud server 80 has obtained the destination or the user's attribute information (gender, age, etc.) when registering the app, it may determine the content of the advertisement to display based on that attribute information.

[0060] The user inputs information to adjust the in-car equipment 70 via the touch panel of the rear-seat tablet 30, or, as shown in Figure 10, inputs information (changes) to adjust the in-car equipment 70 using the user terminal 20. In this case, the rear-seat tablet 30 acquires and saves the input information and then transmits it to the crew tablet 40 (step S108). If the input information includes information related to display control, the rear-seat tablet 30 switches the display as shown in Figure 11.

[0061] For example, in the example shown in Figure 10, the rear-seat tablet 30 displays an advertisement 360 along with various icons 370 that the user has set in advance. Specifically, the icons 370 include, for example, an icon to display the current time, an icon to display the weather and temperature of the destination, an icon to launch a map application to display the destination or current location, an icon to launch an application to display news, a calendar or schedule, and an icon to display a website that sells products, etc. In the example shown in Figure 10, the user uses the user terminal 20 to input the news items to be displayed. In the example shown in Figure 11, the rear-seat tablet 30 displays news 380 of the news items entered by the user, according to the input in Figure 10.

[0062] The rear seat tablet 30 updates the previously received setting information using the received input information and controls various in-car devices 70 based on the updated setting information (step S109). If there is no input information in step S108, the settings information is not updated, and the various in-car devices 70 are controlled based on the setting information. In this embodiment, the in-car environment can be set to the user's desired state without requiring conversation between the user and the crew. For example, in this embodiment, the interior temperature and interior illumination are automatically controlled to the user's desired level, and the user's preferred music and information are automatically output.

[0063] When the taxi arrives at its destination, the driver operates the driver's tablet 40 to charge the user the fare determined by the taxi meter 50, and the user makes the payment using the payment terminal 52. Furthermore, once the driver's tablet 40 confirms that the payment has been completed, it sends information to the cloud server 80 indicating that the payment has been completed (step S110).

[0064] Upon receiving information that the payment has been completed, the cloud server 80 triggers an information request to the crew tablet 40 and the rear seat tablet 30 (step S111).

[0065] The crew tablet 40 sends the current configuration information to the cloud server 80 (step S112).

[0066] The rear seat tablet 30 sends the currently entered information to the cloud server 80 (step S113).

[0067] The cloud server 80 updates the user's configuration information in the storage unit 840 based on the received configuration information and input information (step S114).

[0068] As described above, in this embodiment, the in-vehicle equipment 70 and the like can be automatically controlled based on pre-set setting information, so the in-vehicle environment can be set to the state desired by the user without requiring conversation between the user and the driver. Therefore, according to this embodiment, the convenience of the user while riding in the taxi can be improved, and new added value can be added to the taxi service. Furthermore, according to this embodiment, once the setting information has been set, it can be used again, so the in-vehicle environment can be set to the state desired by the user without the user having to do anything each time they ride in the taxi. In addition, according to this embodiment, multiple in-vehicle equipment 70 can be controlled simultaneously, so the in-vehicle environment can be set to the state desired by the user very quickly.

[0069] <<2. Second Embodiment>> <2.1 Background> As explained earlier, improving user convenience during and after a ride in a taxi has not been given much consideration until now. Here, we will focus on user convenience after the ride. For example, if a user leaves something behind in a taxi (lost property), even if the user realizes they have left something behind, it is difficult to return the lost item to the user reliably and quickly. Furthermore, if the lost item is something like a wallet, the taxi company must report it to the police, which adds to their workload.

[0070] Therefore, in the second embodiment of this disclosure, we propose an information processing system that can reliably and quickly return lost items to users. According to this embodiment, since lost items can be reliably and quickly returned to users, user convenience after boarding is improved. The details of this embodiment will be described in order below.

[0071] <2.2 Configuration of the Information Processing System> An example of the configuration of the information processing system 10a according to the second embodiment of this disclosure will be described with reference to Figure 12. Figure 12 is a system diagram showing the schematic functional configuration of the information processing system 10a according to this embodiment.

[0072] As shown in Figure 12, the information processing system 10a according to this embodiment includes a user terminal 20, a rear-seat tablet (passenger display terminal) 30, a crew tablet (driver display terminal) 40, a taxi meter 50, and an interface unit 60, similar to the first embodiment. Furthermore, the information processing system 10a according to this embodiment includes in-vehicle equipment 72 installed in the taxi (mobile body), such as lighting 72a, and a cloud server (information processing device) 80a. In this embodiment as well, these devices are connected to each other so as to be able to communicate via a communication network 90. ​​Below, an overview of each device included in the information processing system 10a according to this embodiment will be described, but the description of devices common to the first embodiment will be omitted.

[0073] (In-vehicle equipment 72) The in-vehicle equipment 72 may include a light 72a for illuminating the rear seats 704, a camera (imaging device) 72b for photographing the rear seats (passenger seats), an in-vehicle speaker 72c for outputting sound to the user, and an external speaker 72d for outputting sound to the outside of the vehicle. In this embodiment, the light 72a, camera 72b, and in-vehicle speaker 72c may be built into the rear seat tablet 30.

[0074] (Cloud Server 80a) The cloud server 80a can acquire multiple images of the rear seat from the camera 72b, which is part of the in-vehicle equipment 72, before and after the user disembarks. Furthermore, based on a request from the user, it can transmit at least one image taken after the user disembarks to the user terminal 20. The cloud server 80a is configured, for example, as a computer. The detailed configuration of the cloud server 80a will be described later.

[0075] In Figure 12, the information processing system 10a according to this embodiment is shown as including one user terminal 20, a rear-seat tablet 30, a driver tablet 40, a taxi meter 50, and an interface unit 60. However, this embodiment is not limited to this. For example, the information processing system 10a according to this embodiment may include multiple user terminals 20, rear-seat tablets 30, driver tablets 40, taxi meters 50, interface units 60, and in-vehicle equipment 72.

[0076] <2.3 Detailed configuration of the cloud server> Next, the configuration of the cloud server 80a according to this embodiment will be described with reference to Figure 13. Figure 13 is a block diagram showing an example configuration of the cloud server 80a according to this embodiment. In detail, the cloud server 80a mainly comprises a processing unit (control unit) 800a, an input unit 810, an output unit 820, a communication unit 830, and a storage unit 840a, as shown in Figure 13. The following describes each functional unit of the cloud server 80a, but the description of functional units common to the first embodiment will be omitted.

[0077] (Processing section 800a) The processing unit 800a can control each functional unit of the cloud server 80a, similar to the first embodiment. For example, the processing unit 800a can acquire multiple images of the rear seat from the camera 72b, which is an in-vehicle device 72, before and after the user disembarks, and can further transmit at least one of the images after disembarking to the user terminal 20 based on a request from the user. Furthermore, the processing unit 800a may perform image analysis on the acquired images. In detail, the processing unit 800a functions as an acquisition unit 802, an image analysis unit 804, and an information output unit 806 to realize the above-described functions. The details of these functions of the processing unit 800a according to this embodiment will be described below.

[0078] ~Acquisition part 802~ The acquisition unit 802 can acquire images from the camera 72b and output them to the image analysis unit 804 and the information output unit 806, which will be described later. The acquisition unit 802 can also acquire image requests from the user terminal 20, location information, and input information from the crew tablet 40 and output them to the information output unit 806.

[0079] ~Image Analysis Unit 804~ The image analysis unit 804 can estimate whether a lost item is present in an image by applying a predetermined algorithm to the image acquired from the camera 72b described above. Furthermore, the image analysis unit 804 can output the analysis results to the information output unit 806.

[0080] ~Information Output Unit 806~ The information output unit 806 can transmit images acquired from the camera 72b to the user terminal 20 in accordance with image requests from the user terminal 20, or transmit information corresponding to the analysis results of the image analysis unit 804 to the user terminal 20. In addition, the information output unit 806 can transmit the user's location information from the user terminal 20 to the crew tablet 40, or transmit information corresponding to the input information from the crew tablet 40 to the user terminal 20.

[0081] (Storage unit 840a) Similar to the first embodiment, the storage unit 840a can store programs, information, etc., for the processing unit 800a to execute various processes, as well as information obtained through processing. Specifically, in addition to the setting information table 842, which is control information for controlling the in-vehicle equipment 70 linked to the user's identification information, the storage unit 840a stores image information 844 acquired from the camera 72b and an estimation model 846 used by the image analysis unit 804. The storage unit 840a is implemented, similar to the first embodiment, by, for example, a magnetic recording medium such as a hard disk or a non-volatile memory such as flash memory.

[0082] In this embodiment as well, the cloud server 80a is not limited to the configuration example shown in Figure 13, and may include other functional units, for example.

[0083] <2.4 Information Processing Methods> The details of the information processing system 10a and each device included in the information processing system 10a according to this embodiment have been described above. Next, the information processing method according to this embodiment will be described with reference to Figures 14 to 18. Figure 14 is a sequence diagram of the information processing method according to this embodiment, and Figures 15, 17, and 18 are explanatory diagrams showing display examples in the information processing method according to this embodiment. Furthermore, Figure 16 is an explanatory diagram for explaining the information processing method according to this embodiment.

[0084] As shown in Figure 14, the information processing method according to this embodiment includes several steps from step S201 to step S212. The details of each step included in the information processing method according to this embodiment will be described below. Figure 14 shows an example of information processing according to this embodiment, illustrating the flow of information processing when a user finds and uses an available taxi.

[0085] The process for dispatching a vehicle when using a ride-hailing app is the same as in the first embodiment described above, so we will omit the explanation here.

[0086] First, when a user gets into a taxi, the driver switches the taxi meter 50 to the "onboard" mode, and the driver's tablet 40 starts navigating to a destination registered in the app beforehand, or a destination directly instructed by the user.

[0087] Then, when the user boards the vehicle, the rear seat tablet 30 displays a one-dimensional code (e.g., a barcode) or a two-dimensional code (e.g., a QR code (registered trademark), etc.) 350, as shown in Figure 8 (step S201). However, if the user requests a taxi dispatch using an application installed on the user terminal 20, the execution of step S201 is omitted.

[0088] As shown in Figure 8, the user reads a one-dimensional or two-dimensional code 350 displayed on the rear-seat tablet 30 with their personal user terminal 20. Furthermore, the user terminal 20, having read these one-dimensional or two-dimensional codes 350, transmits the user's identification information (specifically, information identifying the user terminal 20, etc.) along with the identification information of the taxi they are riding in, to the cloud server 80 according to the information contained in these codes (step S202). In this way, the taxi and the user are linked. Note that if the user requests a taxi dispatch using an app installed on the user terminal 20, the user and the taxi are already linked in the cloud server 80, so the execution of step S202 is omitted.

[0089] When the taxi arrives at its destination, the driver operates the driver's tablet 40 to charge the user the fare determined by the taxi meter 50, and the user makes the payment using the payment terminal 52. Furthermore, when the driver's tablet 40 confirms that payment has started, it sends information that payment is in progress to the rear seat tablet 30 and the cloud server 80 (step S203).

[0090] The rear seat tablet 30, the lighting 72a, and the in-car speaker 72c illuminate the rear seat and output warning displays and sounds to the user (step S204). For example, as shown in Figure 15, the rear seat tablet 30 displays a message such as, "Have you forgotten anything?". Alternatively, if the rear seat tablet 30 has a built-in lighting 72a, as shown in Figure 16, the lighting 72a (specifically the display) of the rear seat tablet 30 may be controlled to its maximum brightness to illuminate the rear seat 704. In this way, forgetting items is prevented in this embodiment.

[0091] The driver's tablet 40 instructs the camera 72b to capture images of the rear seat 704 before and after the passenger disembarks, acquiring multiple images and transmitting them to the cloud server 80a (step S205). The transmitted images are linked to the user's identification information and the taxi's identification information and stored in the cloud server 80a for a certain period of time. For example, the camera 72b starts taking pictures when payment begins and continues taking pictures until 5 seconds (a predetermined time) have elapsed since the user disembarked (for example, when the taxi meter switches to vacant mode).

[0092] After disembarking, a user who realizes they have left something behind can use their personal terminal 20 to request that an image be sent to the cloud server 80a via an app or a website provided by the taxi company (step S206). At that time, the user terminal 20 sends the user's identification information (specifically, information that identifies the user terminal 20, etc.) to the cloud server 80a.

[0093] The cloud server 80a sends an image linked to the acquired user identification information to the user terminal 20 (step S207). At this time, the image sent by the cloud server 80a includes at least an image of the rear seat 704 immediately after disembarking, and preferably includes images of the rear seat 704 before and after disembarking.

[0094] The user checks the image, and if they confirm that the lost item is present in the image, they use their personal device 20 to send their current location information along with a request to send the lost item via the app or a website provided by the taxi company (step S208). For example, the user can send their location information along with a request to send the lost item by pressing the "Please deliver my lost item" button displayed on the personal device 20 via the app (acknowledgment). At this time, the app may ask the user whether they want the lost item delivered immediately or if it is alright to do so at a later date.

[0095] In this embodiment, the user's location information may be continuously transmitted to the cloud server 80a by the operation of the application on the user terminal 20 until a certain period of time (for example, 10 minutes) has elapsed since disembarking.

[0096] The cloud server 80a transmits the user's location information to the driver's tablet 40, which is linked to the identification information of the taxi the user is riding in (step S209).

[0097] The crew member checks the user's location information displayed on the crew member tablet 40, determines whether or not they can handle the lost item, and enters the decision into the crew member tablet 40. The crew member tablet 40 transmits the decision to the user terminal 20 via the cloud server 80a (step S210). For example, the crew member tablet 40 displays a message such as, "The passenger you just picked up has left something behind. They want it delivered immediately. Please go to this location as quickly as possible," along with "OK" and "Deal with Later" buttons. The crew member can enter their decision into the crew member tablet 40 by pressing either the "OK" or "Deal with Later" button.

[0098] The user terminal 20 displays guidance (notifications) based on the driver's judgment (operations by the driver after confirming the location information) (step S211). For example, if the driver determines that they can respond, the user terminal 20 displays a message such as, "A taxi is on its way to you. Please wait where you are." as shown in Figure 17. In this case, the lost item will be promptly returned to the user by the taxi. On the other hand, if the driver determines that they cannot respond, the user terminal 20 displays a message such as, "We will contact you later regarding the pickup of your lost item." as shown in Figure 18. In this case, the user will either come to the taxi company to pick up the lost item, or the taxi company will send the lost item to the address specified by the user.

[0099] As described above, in this embodiment, even if a user forgets something and cannot return it immediately, the user and the forgotten item can be linked, ensuring that the forgotten item is returned to the user. Therefore, according to this embodiment, since the forgotten item can be returned to the user reliably, the user's convenience after boarding the vehicle is improved. Furthermore, in this embodiment, the rear seat tablet 30, the lighting 72a, and the in-car speaker 72c illuminate the rear seat and output warning displays and sounds to the user, thus preventing items from being forgotten.

[0100] In the above description, forgotten items are detected by image analysis, but this embodiment is not limited to this, and for example, forgotten items may be detected by a weight scale mounted on the rear seat 704.

[0101] <2.5 Variant Example> In this embodiment, the system received a notification from a user who noticed they had left something behind, sent an image, and allowed the user to identify the item from the image. However, in this disclosure, the system may automatically detect the lost item through image analysis and notify the user. This allows for rapid detection of the lost item, enabling its prompt return to the user. Modifications of this embodiment will now be described with reference to Figures 19 to 22. Figure 19 is a sequence diagram of the information processing method according to a modification of this embodiment, Figures 20 and 22 are explanatory diagrams for explaining the information processing method according to this embodiment, and Figure 21 is an explanatory diagram showing an example of the display in the information processing method according to a modification of this embodiment.

[0102] In this modified example, the configuration of the information processing system 10a and the devices included in the information processing system 10a are the same as in this embodiment, so their description is omitted here.

[0103] Referring to Figure 19, the information processing method according to this modified example will be explained. As shown in Figure 19, the information processing method according to this modified example includes several steps from step S301 to step S307. The details of each step included in the information processing method according to this modified example will be explained below.

[0104] In this modified example, steps S201 and S202 shown in Figure 14 are performed, but since they are the same as in the embodiment described above, their explanation is omitted here.

[0105] When the taxi arrives at its destination, as in this embodiment, the driver operates the driver tablet 40 to bill the user for the fare determined by the taxi meter 50, and the user makes the payment using the payment terminal 52. Furthermore, when the driver tablet 40 confirms that payment has started, it sends information that payment is in progress to the rear seat tablet 30 and the cloud server 80 (step S301).

[0106] Similar to this embodiment, the rear seat tablet 30, the lighting 72a, and the in-car speaker 72c illuminate the rear seat and output warning displays and sounds to the user (step S302).

[0107] Similar to this embodiment, the driver tablet 40 causes the camera 72b to capture images of the rear seat 704 before and after disembarking, acquires multiple images, and transmits them to the cloud server 80a (step S303). The transmitted images are linked to the user's identification information and the taxi's identification information and stored in the cloud server 80a for a certain period of time.

[0108] Next, the cloud server 80a analyzes the acquired images and determines whether any items have been left behind (step S304). For example, as shown in Figure 20, the cloud server 80a extracts the difference between images in which a person is recognized and images in which a person is not recognized, and if the difference has a predetermined shape (a bag in the example in Figure 20), it estimates (determines) that an item has been left behind.

[0109] Based on the determination made in step S304 described above, the cloud server 80a sends a notification to the user terminal 20 (step S305). For example, if it is determined in step S304 that an item has been left behind, the cloud server 80a sends a notification to the user terminal 20.

[0110] The user terminal 20 displays a notification of a lost item in accordance with the notification from the cloud server 80a. For example, as shown in Figure 21, the user terminal 20 displays a message such as, "You may have left something behind in a taxi. Would you like to check the image?" along with a "Check" button and a "Do not check" button. By pressing the "Check" button, the user can request that the cloud server 80a send the image.

[0111] In this modified example, if the user's location information is continuously transmitted to the cloud server 80a by the operation of the application on the user terminal 20 until a certain period of time has elapsed since the passenger disembarked, and if it is determined that an item has been left behind and the user is confirmed to be near the taxi, the external speaker 72d may be used to notify the user of the lost item. In this way, the lost item can be returned to the user reliably and quickly.

[0112] The user requests the cloud server 80a to send an image using their portable user terminal 20 (step S307). At that time, the user terminal 20 sends the user's identification information (specifically, information that identifies the user terminal 20, etc.) to the cloud server 80a.

[0113] In this modified example, steps S207 to S211 shown in Figure 14 are then carried out, but since they are the same as in the embodiment described above, their explanation is omitted here.

[0114] As described above, in this modified version, instead of receiving a notification from a user who has noticed a lost item and having them send an image to confirm the item from the image, the system automatically detects the lost item through image analysis and notifies the user. Therefore, this modified version allows for the rapid detection of lost items, making it possible to return them to the user quickly. Furthermore, if autonomous driving technology develops and driverless taxis come into operation, such automatic detection of lost items is expected to be useful.

[0115] Furthermore, in this modified version, machine learning may be used to improve the accuracy of detecting lost items.

[0116] For example, images and the user's judgment on whether or not an item has been left behind are input to a cloud server 80a or another information processing device (not shown), and machine learning is performed on a learning device 86 in the processing unit 800a of the cloud server 80a. Specifically, as shown in Figure 22, the cloud server 80a or the other information processing device is equipped with a supervised learning device 86 such as a support vector regression or deep neural network. Images of the rear seat 704 taken by the camera 72b before and after disembarking, and the user's judgment result after reviewing the images (specifically, whether or not a request for the return of a lost item has been made) are input to the learning device 86 as input signals and training signals. The learning device 86 performs machine learning on the relationship between this information according to predetermined rules and generates an estimation model 488.

[0117] Then, the image analysis unit 804 performs image analysis using the generated estimation model 488, thereby enabling detection of lost items with higher accuracy.

[0118] <<3. Summary>> As described above, according to the embodiments of this disclosure, new added value can be added to taxi use by improving the convenience of the user while riding in or after getting out of a taxi.

[0119] <<4. Example Hardware Configuration>> Figure 23 is a block diagram showing an example of the hardware configuration. The following explanation will use the cloud server 80 as an example. Similar explanations are possible for the user terminal 20, rear-seat tablet 30, and crew tablet 40. Various processes performed by the cloud server 80 are realized through the collaboration of software and the hardware described below.

[0120] As shown in Figure 23, the cloud server 80 has a CPU (Central Processing Unit) 901, ROM (Read Only Memory) 902, RAM (Random Access Memory) 903, and a host bus 904a. The cloud server 80 also has a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a drive 909, a connection port 911, and a communication device 913. The cloud server 80 may have a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) instead of, or together with, the CPU 901.

[0121] The CPU 901 functions as an arithmetic processing unit and control unit, controlling all operations within the cloud server 80 according to various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as needed during its execution. The CPU 901 can, for example, embody the processing unit 800 of the cloud server 80.

[0122] The CPU 901, ROM 902, and RAM 903 are interconnected by a host bus 904a, which includes the CPU bus, etc. The host bus 904a is connected to an external bus 904b, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 904. Note that the host bus 904a, bridge 904, and external bus 904b do not necessarily need to have separate configurations from each other and may be implemented in a single configuration (e.g., one bus).

[0123] The input device 906 is implemented by a device into which information is input by the user, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever. Alternatively, the input device 906 may be a remote control device utilizing infrared or other radio waves, or an externally connected device such as a mobile phone or PDA (Personal Digital Assistant) that supports operation of the cloud server 80. Furthermore, the input device 906 may include, for example, an input control circuit that generates an input signal based on the information input by the user using the above-mentioned input means and outputs it to the CPU 901. By operating this input device 906, the user can input various data to the cloud server 80 or instruct it to perform processing operations.

[0124] The output device 907 is formed of a device capable of visually or audibly notifying the implementer of the acquired information. Examples of such devices include display devices such as CRT (Cathode Ray Tube) displays, liquid crystal displays, plasma displays, EL (Electro Luminescent) displays, and lamps, as well as sound output devices such as speakers and headphones, and printers.

[0125] The storage device 908 is a device for storing data. The storage device 908 can be implemented by, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 908 may also include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. This storage device 908 stores programs executed by the CPU 901, various data, and various data acquired from external sources. The storage device 908 can, for example, embody the storage unit 840 of a cloud server 80.

[0126] Drive 909 is a reader / writer for storage media, and is either built into or external to the cloud server 80. Drive 909 reads information recorded on removable storage media such as magnetic disks, optical disks, magneto-optical disks, or semiconductor memory, and outputs it to RAM 903. Drive 909 can also write information to removable storage media.

[0127] Connection port 911 is an interface for connecting to external devices, and is a connection port for external devices that can transmit data via, for example, USB (Universal Serial Bus).

[0128] The communication device 913 is, for example, a communication interface formed by a communication device for connecting to the network 920. The communication device 913 is, for example, a communication card for wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB). Alternatively, the communication device 913 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication. This communication device 913 can, for example, send and receive signals with the Internet or other communication devices in accordance with a predetermined protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol). The communication device 913 can, for example, embody the communication unit 830 of a cloud server 80.

[0129] Network 920 is a wired or wireless transmission path for information transmitted from devices connected to Network 920. For example, Network 920 may include public networks such as the Internet, telephone networks, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks), including Ethernet®. Network 920 may also include dedicated network lines such as IP-VPN (Internet Protocol-Virtual Private Network).

[0130] The above describes an example of a hardware configuration that can realize the functions of the cloud server 80. Each of the above components may be implemented using general-purpose parts, or it may be implemented using hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration used as appropriate depending on the technological level at the time of implementation of this disclosure.

[0131] <<5. Supplement>> The embodiments of the disclosure described above may include, for example, an information processing method executed by an information processing device or information processing system as described above, a program for making the information processing device function, and a non-temporary tangible medium on which the program is recorded. Furthermore, the program may be distributed via communication lines such as the Internet (including wireless communication).

[0132] Furthermore, each step in the information processing method of the embodiments of this disclosure described above does not necessarily have to be processed in the order described. For example, each step may be processed in a different order as appropriate. Also, each step may be processed partially in parallel or individually instead of chronologically. Moreover, the processing of each step does not necessarily have to be carried out in the manner described, and may be processed by other functional units in other ways, for example.

[0133] Of the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0134] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0135] While preferred embodiments of the present disclosure have been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear to any person with ordinary skill in the art of the present disclosure that various modifications or alterations may be conceived within the scope of the technical idea set forth in the claims, and these will naturally also fall within the technical scope of the present disclosure.

[0136] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology relating to this disclosure may produce other effects that will be apparent to those skilled in the art from the description herein, in addition to or in lieu of the effects described herein.

[0137] Furthermore, this technology can also be configured as follows. (1) Information processing device, The information processing device is linked with the identification information of a mobile object located in a remote location and the identification information of the passengers of the mobile object. This includes controlling the equipment within the mobile vehicle based on the linked information. Information processing methods. (2) The information processing method described in (1) above, wherein the equipment includes at least one of the following: air conditioning equipment, lighting equipment, heating equipment, sound equipment, passenger display terminal, crew display terminal, imaging device, and reclining chair. (3) The aforementioned information processing device This includes obtaining identification information of the mobile vehicle and identification information of the passenger from a user terminal carried by the passenger, which reads a one-dimensional code or a two-dimensional code displayed on the passenger display terminal inside the mobile vehicle. The information processing method described in (2) above. (4) The aforementioned information processing device The passenger's user terminal is used to obtain the request for the mobile vehicle and the passenger's location information. Based on the passenger's location information, select the vehicle to be dispatched to the passenger. The identification information of the selected mobile body is linked to the identification information of the passenger. The information processing method described in (2) above, including the above. (5) The information processing device includes controlling at least one of the following based on setting information linked to the passenger identification information: the air conditioning equipment, the lighting equipment, the heating equipment, the sound equipment, the passenger display terminal, the crew display terminal, and the recliner. The information processing method described in (3) or (4) above. (6) The information processing device includes controlling the crew display terminal or the sound device based on the passenger identification information to output instructions to the crew of the mobile vehicle. The information processing method described in (5) above. (7) If the passenger riding in the mobile vehicle changes the setting information, When the passenger disembarks from the mobile vehicle, the information processing device updates the setting information based on the changes, The information processing method described in (5) or (6) above. (8) The information processing method described in (7) above, wherein the changes include identification information of the content viewed by the passenger inside the mobile vehicle, and information regarding the state of the content at the time the passenger disembarked from the mobile vehicle. (9) The information processing device includes acquiring images of the passenger seats from the imaging device before and after the passenger disembarks from the moving vehicle. The information processing method described in (3) or (4) above. (10) The imaging device is Based on the commencement of the payment processing for the aforementioned passenger, photography of the aforementioned passenger seat was commenced. Based on the fact that a predetermined amount of time has elapsed since the passenger disembarked from the vehicle, the photography of the passenger seats is terminated. The information processing method described in (9) above. (11) The information processing method according to (10) above, wherein at least one of the lighting equipment, the passenger display terminal, and the sound device starts an operation to draw the passenger's attention based on the commencement of the passenger's payment processing. (12) The aforementioned information processing device Multiple images of the passenger seats taken in succession are analyzed using image analysis. This includes notifying the passenger based on the analysis results. The information processing method described in any one of (9) to (11) above. (13) The information processing device makes the notification if it can be estimated from the analysis results that the passenger's lost item is located in the passenger seat. The information processing method described in (12) above. (14) The information processing method according to (12) or (13) above, wherein the information processing device performs the image analysis using an estimation model obtained by machine learning. (15) The information processing method according to any one of (9) to (14) above, wherein the information processing device transmits an image of the passenger seat immediately after the passenger disembarks from the mobile vehicle to the user terminal based on a request from the passenger. (16) The information processing device includes obtaining the passenger's location information from the user terminal after the passenger disembarked from the mobile vehicle, in accordance with the passenger's consent after the passenger has viewed an image of the passenger seat immediately after disembarking from the mobile vehicle. The information processing method described in (15) above. (17) The information processing method according to (16) above, wherein the information processing device transmits a notification to the user terminal in response to an operation by a crew member who has confirmed the location information. (18) The information processing method described in any one of (1) to (17) above, wherein the moving object is one of a vehicle, a ship, or an aircraft. (19) The system includes a control unit that links identification information of a mobile object located in a remote location with identification information of the passengers of the mobile object, and controls the equipment inside the mobile object based on the linked information. Information processing device. (20) An information processing system including an information processing device and equipment installed on a mobile device located remotely from the information processing device, The information processing device links the identification information of the mobile body with the identification information of the passengers of the mobile body, and controls the equipment inside the mobile body based on the linked information. Information processing system. [Explanation of Symbols]

[0138] 10, 10a Information Processing Systems 20 User Terminals 30 Rear seat tablet 40 Crew Tablets 50 Taxi meter 52 Payment terminals 60 Interface Units 70, 72 In-car equipment 70a air conditioner 70b, 72a lighting 70°C seat heater 70d Audio Equipment 72b Camera 72c In-car speaker 72d exterior speakers 80, 80a Cloud Server 86 Learning devices 90 Communication Networks 200, 600 Control Unit 210, 810 Input section 220, 820 output section 230, 630, 830 Communications Department 240, 640, 840, 840a storage section 350 QR codes 360 Ads 370 icons 380 News 700 Driver's seat 702 Passenger seat 704 Rear Seats 800, 800a Processing Unit 802 Acquisition Department 804 Image Analysis Department 806 Information Output Unit 842 Configuration Information Table 844 Image Information 846 Estimated Models

Claims

1. Information processing device, The information processing device reads a one-dimensional code or a two-dimensional code displayed on a passenger display terminal located in a mobile vehicle at a remote location, and obtains identification information of the mobile vehicle and the passenger from a user terminal carried by a passenger in the mobile vehicle. The identification information of the moving object and the identification information of the passenger are linked. Based on the linked information, control at least one of the following within the mobile vehicle: air conditioning equipment, lighting equipment, heating equipment, sound equipment, passenger display terminal, crew display terminal, imaging device, and recliner. The imaging device acquires images of the passenger seats before and after the passenger disembarks from the moving vehicle. In response to a request from the passenger, based on the linked information, an image of the passenger seat immediately after the passenger disembarks from the vehicle is transmitted to the user terminal. Upon confirmation of the passenger's seat image immediately after the passenger disembarked from the mobile vehicle, and with the passenger's consent, the system obtains the passenger's location information after disembarking from the mobile vehicle, based on sensing data from the user terminal's positioning sensor. The crew member who has confirmed the location information will send a notification to the user terminal regarding the passenger's lost item. Linking the passenger's identification information with information regarding the passenger's lost property, including, Information processing methods.

2. The imaging device is Based on the commencement of the payment processing for the aforementioned passenger, photography of the aforementioned passenger seat was commenced. Based on the fact that a predetermined amount of time has elapsed since the passenger disembarked from the vehicle, the photography of the passenger seats is terminated. The information processing method according to claim 1.

3. The information processing method according to claim 2, wherein at least one of the lighting equipment, the passenger display terminal, and the sound device starts an operation to attract the passenger's attention based on the commencement of the passenger's payment processing.

4. The aforementioned information processing device Multiple images of the passenger seats taken in succession are analyzed using image analysis. This includes notifying the passenger based on the analysis results. The information processing method according to claim 1.

5. The information processing device makes the notification if it can be estimated from the analysis results that the passenger's lost item is located in the passenger seat. The information processing method according to claim 4.

6. The information processing method according to claim 4 or 5, wherein the information processing device includes performing the image analysis using an estimation model obtained by machine learning.

7. The information processing method according to any one of claims 1 to 6, wherein the moving body is one of a vehicle, a ship, or an aircraft.

8. The process involves reading a one-dimensional or two-dimensional code displayed on a passenger display terminal inside a mobile vehicle located in a remote location, and then obtaining identification information of the mobile vehicle and the passenger from a user terminal carried by the passenger in the mobile vehicle. The identification information of the moving object and the identification information of the passenger are linked. Based on the linked information, control at least one of the following within the mobile vehicle: air conditioning equipment, lighting equipment, heating equipment, sound equipment, passenger display terminal, crew display terminal, imaging device, and recliner. The imaging device acquires images of the passenger seats before and after the passenger disembarks from the moving vehicle. In response to a request from the passenger, based on the linked information, an image of the passenger seat immediately after the passenger disembarks from the vehicle is transmitted to the user terminal. Upon confirmation of the passenger's seat image immediately after the passenger disembarked from the mobile vehicle, and with the passenger's consent, the system obtains the passenger's location information after disembarking from the mobile vehicle, based on sensing data from the user terminal's positioning sensor. A notification corresponding to the operation performed by the crew member who confirmed the location information is sent to the user terminal. Linking the passenger's identification information with information regarding the passenger's lost property, It includes a control unit that performs the following: Information processing device.

9. An information processing system including an information processing device and equipment installed on a mobile device located remotely from the information processing device, The aforementioned information processing device is The information processing device reads a one-dimensional code or a two-dimensional code displayed on a passenger display terminal located inside the mobile vehicle at a remote location, and obtains identification information of the mobile vehicle and identification information of the passenger from a user terminal carried by a passenger in the mobile vehicle. The identification information of the moving object and the identification information of the passenger are linked. Based on the linked information, control at least one of the following within the mobile vehicle: air conditioning equipment, lighting equipment, heating equipment, sound equipment, passenger display terminal, crew display terminal, imaging device, and recliner. The imaging device acquires images of the passenger seats before and after the passenger disembarks from the moving vehicle. In response to a request from the passenger, based on the linked information, an image of the passenger seat immediately after the passenger disembarks from the vehicle is transmitted to the user terminal. Upon confirmation of the passenger's seat image immediately after the passenger disembarked from the mobile vehicle, and with the passenger's consent, the system obtains the passenger's location information after disembarking from the mobile vehicle, based on sensing data from the user terminal's positioning sensor. A notification corresponding to the operation performed by the crew member who confirmed the location information is sent to the user terminal. The identification information of the passenger is linked to the information regarding the passenger's lost property. Information processing system.

Images