Information processing device, information processing method, program for information processing and recording medium

Abstract

To provide an information processing device capable of guiding a recipient to a facility related to an action that the recipient should take, without time and efforts for the recipient under driving in a case where the action is indicated by a sender.SOLUTION: In a server device S connectable to a smart speaker SK of a sender, a navigation device NV and a smart phone SP2 of a recipient, a request message indicating an action that the recipient should take and related to a facility which is related to the action is acquired from the smart speaker SK. In a case where the recipient is driving a vehicle, facility information indicating the facility is transmitted for guidance to the navigation device NV.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present application belongs to the technical field of an information processing device, an information processing method, an information processing program, and a recording medium. More specifically, the present application belongs to the technical field of an information processing device connectable to a sending terminal of a sender and a plurality of receiving terminals of a recipient, an information processing method executed in the information processing device, a program for the information processing device, and a recording medium on which the program is recorded. [Background technology]

[0002] Conventionally, a telephone call is made between, for example, a sender at home and a recipient driving a vehicle. In this case, the technology described in the following Patent Document 1 is configured to limit the above call based on the driving state of the recipient in consideration of the safety of the recipient while driving. More specifically, instead of a telephone call, a message is left on a portable wireless phone (hereinafter simply referred to as a "mobile phone") carried by the recipient. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-144850 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, according to the technology disclosed in the above Patent Document 1, in order for the recipient to check the contents of the sender's message using his / her mobile phone, there is a problem that the recipient must perform a separate operation on the mobile phone to play or check the message. In addition, even if the contents of the message are, for example, a request from the sender to stop by a certain facility, the recipient of the message must perform an operation to input the requested facility into, for example, a navigation device installed in the vehicle while the recipient is driving, and then perform a facility search using the information input by that operation. These problems become even more serious when the recipient is driving a vehicle.

[0005] Therefore, the present application has been made in consideration of the above-mentioned problems, and one example of the object of the application is to provide an information processing device that, when an action that the recipient should take is indicated by the sender, can guide the recipient to a facility related to that action without causing the recipient trouble while driving, and an information processing method executed in the information processing device, as well as a program for the information processing device and a recording medium on which the program is recorded. [Means for solving the problem]

[0006] In order to solve the above problem, the invention described in claim 1 includes an information processing device connectable to a sending terminal of a sender and multiple receiving terminals of a receiver, the information processing device comprising: an acquisition means for acquiring, from the sending terminal, action information indicating an action to be taken by the receiver and associated with a facility related to the action; and a transmission control means for transmitting, when the receiver is driving a vehicle, facility information indicating the related facilities to the receiving terminal that provides the driving guidance, for the purpose of the guidance.

[0007] In order to solve the above problem, the invention described in claim 10 is an information processing method executed in an information processing device that can be connected to a sending terminal of a sender and multiple receiving terminals of a recipient, and that has an acquisition means and a transmission control means, and includes an acquisition step of acquiring, from the sending terminal by the acquisition means, action information that indicates an action that the recipient should take and that is associated with a facility related to the action, and a transmission control step of transmitting, when the recipient is driving a vehicle, facility information indicating the related facility to the receiving terminal that provides the driving guidance by the transmission control means for the guidance.

[0008] In order to solve the above problem, the invention described in claim 11 causes a computer connectable to a sender's sending terminal and a receiver's multiple receiving terminals to function as an information processing device described in any one of claims 1 to 9.

[0009] In order to solve the above problem, the invention described in claim 12 provides an information processing program described in claim 11, which is recorded so as to be readable by the computer described in claim 11. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment. [Diagram 2] 1 is a block diagram showing a schematic configuration of an information processing system according to a first embodiment. [Diagram 3] 1 is a block diagram showing the general configuration of a server device etc. in the first embodiment, (a) is a block diagram showing the general configuration of the server device, (b) is a block diagram showing the general configuration of a smart speaker in the first embodiment, (c) is a block diagram showing the general configuration of a navigation device in the first embodiment, and (d) is a block diagram showing the general configuration of a smartphone in the first embodiment. [Figure 4] 4 is a flowchart showing information processing according to the first embodiment. [Diagram 5]10 is a flowchart showing information processing according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Next, an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a schematic configuration of an information processing device according to the embodiment.

[0012] As shown in FIG. 1, the information processing device S according to the embodiment is configured to include an acquisition means 1 and a transmission control means 2, and is connectable to a sending terminal TT of the sender and multiple receiving terminals RT1 and RT2 of the receiver.

[0013] In this configuration, the acquisition means 1 acquires, from the sending terminal TT, behavior information indicating an action that the recipient should take and associated with a facility related to the action.

[0014] When the recipient is driving a vehicle, the transmission control means 2 transmits facility information indicating facilities related to the recipient's action to the receiving terminal RT1 that provides the driving guidance for the guidance.

[0015] As described above, according to the operation of the information processing device S according to the embodiment, when the recipient is driving a vehicle, facility information indicating the facility associated with the action information acquired from the transmitting terminal TT is transmitted to the receiving terminal RT1 that guides the driving of the recipient, for use in guiding the driving of the recipient. Therefore, when an action that the recipient should take is indicated by the sender, the recipient can be guided to a facility related to the action without causing the recipient trouble while driving. EXAMPLES

[0016] Next, specific examples corresponding to the above-mentioned embodiment will be described with reference to the drawings. Each of the examples described below is an example in which the present application is applied to an information processing system in which a transmitting terminal such as a so-called smart speaker operated by a sender at home and a plurality of receiving terminals (for example, a so-called smartphone carried by the receiver and a navigation device installed in the vehicle) of a receiver driving a vehicle are connected to a server device via a network such as the Internet.

[0017] (I) First Example First, a first example corresponding to the above-mentioned embodiment will be described with reference to Figures 2 to 4. Figure 2 is a block diagram showing a schematic configuration of an information processing system according to the first example, Figure 3 is a block diagram showing a schematic configuration of a server device etc. according to the first example, and Figure 4 is a flowchart showing information processing according to the first example. In Figures 2 and 3, the same component numbers as those of the respective components in the information processing device S according to the embodiment shown in Figure 1 are used for the respective components of the first example.

[0018] As shown in FIG. 2, the information processing system SS according to the first embodiment is composed of a smart speaker SK operated by a sender at home, a navigation device NV and a smartphone SP in a case where the navigation device NV is installed in a vehicle driven by a receiver carrying the smartphone SP, and a server device S. The server device S and the smart speaker SK, and the server device S, the navigation device NV, and the smartphone SP can exchange messages and the like with each other via the network NW, and thus the information processing system SS executes information processing according to the first embodiment described in detail below. Here, the receiver is, for example, a husband who uses a vehicle to do business and plans to return home by the vehicle, and the sender is, for example, a wife who is at home and wants to ask her husband to do some shopping when she returns home. The server device S corresponds to an example of the information processing device S according to the embodiment, the smart speaker SK corresponds to an example of the transmitting terminal TT according to the embodiment, the navigation device NV corresponds to an example of the receiving terminal RT1 according to the embodiment, and the smartphone SP corresponds to an example of another receiving terminal RT2 according to the embodiment.

[0019] In the information processing according to the first embodiment in the information processing system SS shown in FIG. 2, first, when the wife, who is the sender, speaks to the smart speaker SK about a shopping request she wants to make, for example, "Dad, buy me some tofu!", the smart speaker SK transmits a request message corresponding to the content of the utterance to the server device S via the network NW. Then, the server device S transmits a display message having a content corresponding to the content of the request message (i.e., the content of the above utterance) to the smartphone SP and the navigation device NV via the network NW. In addition, the server device S determines whether the husband is driving a vehicle or not, and if he is driving, transmits stop-off point information indicating a facility (e.g., a supermarket, etc.) to stop at to buy the shopping (tofu) to the navigation device NV via the network NW. In the following description, the facility to stop at is simply referred to as a "stop-off point". As a result, the smartphone SP displays a display corresponding to the above-mentioned transmitted display message. Furthermore, the navigation device NV displays a message corresponding to the display message transmitted, sets the stop-off point indicated by the transmitted stop-off point information, and guides the vehicle to the stop-off point. After that, when the vehicle driven by the husband arrives at the stop-off point or departs from the stop-off point, the navigation device NV transmits an arrival message or departure message indicating the arrival or departure of the stop-off point to the server device S via the network NW. The server device S then transmits a stop-off completion message corresponding to the arrival message or departure message to the smart speaker SK. The smart speaker SK then utters a message corresponding to the content of the stop-off completion message. As a result, the wife operating the smart speaker SK recognizes that the husband has stopped at the stop-off point to do the shopping she requested.

[0020] If the husband has already exited the vehicle, the server S transmits a message to that effect to the smart speaker SK. The smart speaker SK then utters a message corresponding to the content of the message. This allows the wife, who is operating the smart speaker SK, to recognize that the requested shopping has not been completed.

[0021] Next, a schematic configuration of the server device S according to the first embodiment will be described with reference to FIG.

[0022] First, the schematic configuration of the server device S according to the first embodiment will be described with reference to FIG. 3(a). As shown in FIG. 3(a), the server device S according to the first embodiment is composed of an interface 1, a processing unit 2 consisting of a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), etc., a display 3 consisting of a liquid crystal display or the like, an operation unit 4 consisting of a keyboard, a mouse, etc., and a recording unit 5 consisting of, for example, a HDD (Hard Disc Drive) or an SSD (Solid State Drive). In this case, the interface 1 corresponds to an example of the acquisition means 1 according to the embodiment, and the processing unit 2 corresponds to an example of the transmission control means 2 according to the embodiment. The processing unit 2 corresponds to an example of the "recognition means" according to the present application, an example of the "location information acquisition means" according to the present application, an example of the "search means" according to the present application, an example of the "search means" according to the present application, and an example of the "route detection means" according to the present application.

[0023] In this configuration, the interface 1, under the control of the processing unit 2, controls the transmission and reception of messages between the server device S and the smart speaker SK, the navigation device NV, and the smartphone SP via the network NW. In addition, in the recording unit 5, a program corresponding to the processing to be executed by the server device S among the information processing according to the first embodiment is non-volatilely recorded, and data necessary for executing the information processing is temporarily recorded. On the other hand, when an operation by an administrator or an operator to instruct the operation of the server device S is executed on the operating unit 4, the operating unit 4 generates an operation signal corresponding to the operation and outputs it to the processing unit 2. As a result, the processing unit 2 transmits and receives necessary messages between the smart speaker SK, the smartphone SP, and the navigation device NV while using the above programs and data recorded in the recording unit 5 based on the operation signal, and mainly executes the processing to be executed by the server device S among the information processing according to the first embodiment. Furthermore, data necessary for executing the processing is presented to the administrator or the operator via the display 3.

[0024] Next, the schematic configuration of the smart speaker SK according to the first embodiment will be described with reference to FIG. 3(b). As shown in FIG. 3(b), the smart speaker SK according to the first embodiment is configured with an interface 10, a CPU 11, an indicator 12 consisting of a small liquid crystal display or an LED (Light Emission Diode), etc., an operation unit 13 consisting of operation buttons, etc., a speaker 14, a memory 15 consisting of a ROM, a RAM, etc., and a microphone 16. In this configuration, the interface 10 controls the transmission and reception of messages via the network NW with the server device S under the control of the CPU 11. In addition, the memory 15 non-volatilely records a program corresponding to the processing to be executed by the smart speaker SK among the information processing according to the first embodiment, and temporarily records data required for executing the information processing. On the other hand, when an operation by the sender to instruct the operation of the smart speaker SK (for example, detection of speech by the sender) is executed on the operation unit 13, the operation unit 13 generates an operation signal corresponding to the operation and outputs it to the CPU 11. As a result, based on the operation signal, the CPU 11 uses the above programs and data recorded in the memory 15 to exchange necessary messages with the server device S, and mainly executes the processing to be executed by the smart speaker SK among the information processing according to the first embodiment. Furthermore, under the control of the CPU 11, the execution status of the processing is presented to the sender via the indicator 12. Also, under the control of the CPU 11, the microphone 16 detects the voice when the sender speaks to the smart speaker SK, and outputs corresponding voice data to the CPU 11. Furthermore, under the control of the CPU 11, the speaker 14 outputs the voice required for the processing, so that the sender can recognize it.

[0025] Next, the outline of the configuration of the navigation device NV according to the first embodiment will be described with reference to Fig. 3(c). As shown in Fig. 3(c), the navigation device NV according to the first embodiment is composed of an interface 20, a processing unit 21 including a CPU, a ROM, a RAM, etc., a display 22 including a liquid crystal display or the like, an operation unit 23 including operation buttons, a touch panel, a remote control, etc., a speaker 24, a sensor unit 25 including a GPS (Global Positioning System) sensor, etc., and a recording unit 26 including, for example, an HDD or SSD, etc. In this configuration, the interface 20 controls the transmission and reception of messages via the network NW with the server device S under the control of the processing unit 21. In addition, the recording unit 26 non-volatilely records programs corresponding to the processes to be executed by the navigation device NV among the information processes according to the first embodiment, map data necessary for guiding the vehicle in which the navigation device NV is installed, etc., and also temporarily records data necessary for executing the information processes. On the other hand, when the receiver performs an operation on the operation unit 23 to instruct the operation of the navigation device NV (for example, setting a destination), the operation unit 23 generates an operation signal corresponding to the operation and outputs it to the processing unit 21. As a result, the processing unit 21, based on the operation signal, exchanges necessary messages with the server device S while using the above programs and data recorded in the recording unit 26, and mainly executes the processing to be executed by the navigation device NV among the information processing related to the first embodiment. At this time, the processing includes a detection process of the current position of the navigation device NV using the GPS sensor, the above-mentioned search process for a stop-off point, and a guidance process to the searched stop-off point. Furthermore, the execution state of the processing is presented to the receiver via the display 22 under the control of the processing unit 21. Also, the speaker 24, under the control of the processing unit 21, outputs a guidance voice required for the processing to be recognized by the receiver.

[0026] Finally, the schematic configuration of the smartphone SP according to the first embodiment will be described with reference to FIG. 3(d). As shown in FIG. 3(d), the smartphone SP according to the first embodiment is configured with an interface 30, a CPU 31, a display 32 consisting of a small liquid crystal display or the like, an operation unit 33 consisting of operation buttons or the like, a speaker 34, a sensor unit 35 consisting of a GPS sensor or the like, and a memory 36 consisting of a ROM, a RAM, or the like. In this configuration, the interface 30 controls the transmission and reception of messages via the network NW with the server device S under the control of the CPU 31. In addition, in the memory 36, a program corresponding to the processing to be executed by the smartphone SP among the information processing according to the first embodiment is non-volatilely recorded, and data required for executing the information processing is temporarily recorded. On the other hand, when an operation by a receiver to instruct the operation of the smartphone SP is executed on the operation unit 33, the operation unit 33 generates an operation signal corresponding to the operation and outputs it to the CPU 31. As a result, the CPU 31, based on the operation signal, uses the programs and data recorded in the memory 36 to exchange necessary messages with the server device S, and mainly executes the processing to be executed by the smartphone SP among the information processing according to the first embodiment. At this time, the processing includes a detection process of the current location of the smartphone SP using the GPS sensor. Furthermore, under the control of the CPU 31, the execution status of the processing is presented to the recipient via the display 32. Also, under the control of the CPU 31, the speaker 34 outputs a sound required for the processing, so that the recipient can recognize it.

[0027] Next, the information processing according to the first embodiment executed by the server device S etc. will be explained with reference to Fig. 4. In Fig. 4, the flow of each message exchanged between the server device S and the smart speaker SK etc. is indicated by dashed arrows. The processing in the server device S, smart speaker SK, navigation device NV and smartphone SP shown in Fig. 4 starts, for example, when the power of the server device S etc. is turned on.

[0028] 4, first, when the information processing according to the first embodiment is started, the CPU 31 of the smartphone SP and the processing unit 21 of the navigation device NV each perform a process of detecting the current position of the smartphone SP using the sensor unit 25 and a process of detecting the current position of the navigation device NV using the sensor unit 35. After that, the CPU 31 and the processing unit 21 each monitor whether or not a preset timing has arrived for transmitting current situation information including the detected current position to the server device S (steps S25 and S30). If the timing has not arrived in the monitoring of steps S25 and S30 (steps S25: NO and S30: NO), the CPU 31 and the processing unit 21 each continue to monitor the arrival of the timing. On the other hand, if the timing has arrived in the monitoring of steps S25 and S30 (step S25: YES and step S30: YES), the CPU 31 and the processing unit 21 transmit the current status information of the smartphone SP and the navigation device NV to the server device S via the network NW (steps S26 and S31), respectively. Thereafter, the CPU 31 and the processing unit 21 monitor for reception of a display message according to the first embodiment (steps S27 and S32), respectively. If the display message has not been received in the monitoring of steps S27 and S32 (steps S27: NO and step S32: NO), the CPU 31 and the processing unit 21 continue to monitor for reception of the display message, respectively.

[0029] On the other hand, when the information processing according to the first embodiment is started, the CPU 11 of the smart speaker SK monitors whether or not a request utterance from the sender, such as the above-mentioned "Dad, buy me some tofu!", has been made based on the voice data from the microphone 16 (step S1). If the utterance has not been made in the monitoring of step S1 (step S1: NO), the CPU 11 continues the monitoring. On the other hand, if the utterance has been made in the monitoring of step S1 (step S1: YES), the CPU 11 generates the request message, which is a voice message corresponding to the utterance, and transmits the generated request message to the server device S via the network NW (step S2). Thereafter, the CPU 11 monitors whether any message has been received from the server device S (step S3). If no message has been received in the monitoring of step S3 (step S3: NO), the CPU 11 continues the monitoring.

[0030] On the other hand, when the information processing according to the first embodiment is started, the processing unit 2 of the server device S monitors whether the current status information has been transmitted from either or both of the smartphone SP and the navigation device NV via the network NW (step S10). If the current status information has not been received in the monitoring of step S10 (step S10: NO), the processing unit 2 continues the monitoring. On the other hand, if the current status information has been received in the monitoring of step S10 (step S10: YES), the processing unit 2 records the current status information in the recording unit 5 (step S11). This allows the server device S to grasp the current positions, etc. of the smartphone SP and the navigation device NV.

[0031] Next, the processing unit 2 monitors whether the request message is transmitted from the smart speaker SK via the network NW (step S12). If the request message is not received in the monitoring of step S12 (step S12: NO), the processing unit 2 continues the monitoring. On the other hand, if the request message is received in the monitoring of step S12 (step S12: YES), the processing unit 2 analyzes the content as a voice message, for example, using a conventional voice recognition method (step S13). More specifically, the processing unit 2 converts the voice message into text information using the conventional voice recognition method, and then determines the recipient to whom the display message is to be sent, based on a word indicating the subject of the action (behavior) related to the request message (for example, "Dad", a specific name, or a nickname of the subject). Then, the processing unit 2 generates the display message having content equivalent to the content of the request message based on the analysis result, and transmits the display message to the smartphone SP via the network NW (step S14). Then, the CPU 31 of the smartphone SP to which the display message was transmitted receives the display message (step S27: YES), and further displays the received display message on the display 32 (step S28). This allows the recipient carrying the smartphone SP to recognize that the sender has made a request related to the request message (i.e., a request to buy tofu). The CPU 31 of the smartphone SP then determines whether or not to terminate the process to be executed by the smartphone SP among the information processing according to the first embodiment due to, for example, the power switch of the smartphone SP being turned off (step S29). If it is determined in step S29 that the process should not be terminated (step S29: NO), the CPU 31 returns to step S25 and repeats the process described above.

[0032] Meanwhile, the processing unit 2 of the server device S that sent the display message in step S14 next determines whether the state of the recipient using the navigation device NV is "before boarding," "in boarding," or "disembarking," based on the current status information from the navigation device NV and the smartphone SP received and recorded in steps S10 and S11 (step S15).

[0033] Here, the method of judgment in step S15 above may be, for example, the following methods i) to iv). i) If the current location of the smartphone SP is, for example, near the recipient's workplace or near a business stop, and the power switch of the navigation device NV is off or the navigation device NV is not connected to the network NW (i.e., offline), it is determined to be “before boarding.” ii) If the navigation device NV is used only by the receiver, and the power switch of the navigation device NV is on or the navigation device NV is connected to the network NW (i.e., online), it is determined that the receiver is “in the car.” iii) If multiple people, including the receiver, use the navigation device NV at different times, and the current location of the smartphone SP and the current location of the navigation device NV are in a positional relationship that allows them to be determined to be the same, or if the smartphone SP and the navigation device NV are connected via short-range wireless communication or wireless LAN (Local Area Network), it is determined that the receiver is “in the car.” iv) If the current location of the smartphone SP is near the sender's home and the power switch of the navigation device NV is off or the navigation device NV is not connected to the network NW, it is determined that the sender has “disembarked.”

[0034] As another method of judgment in step S15, for example, v) A method of determining that the smartphone SP and the navigation device NV are “in a car” when the current location of the smartphone SP and the current location of the navigation device NV are in a positional relationship that can be determined to be the same and are moving together; vi) A method of determining that the recipient is “in a car” if the car follows a ride (movement) pattern of the recipient that has been detected in advance according to the time period, or vii) A method of determining whether the state is “on board”, “before boarding”, or “disembarking” depending on whether “on boarding”, “before boarding”, or “disembarking” is manually set in the navigation device NV or the smartphone SP, respectively; etc.

[0035] If it is determined in step S15 that the recipient has not yet boarded the vehicle (step S15: before boarding), the processing unit 2 of the server device S performs the determination in step S15 again after, for example, a preset time has elapsed. On the other hand, if it is determined in step S15 that the recipient is boarding the vehicle (step S15: while boarding the vehicle), the processing unit 2 transmits a display message similar to the display message transmitted to the smartphone SP in step S14 to the navigation device NV via the network NW (step S16). Then, the processing unit 21 of the navigation device NV to which the display message has been transmitted receives the display message (step S32: YES), and further displays the received display message on the display 22 (step S33). As a result, the recipient using the navigation device NV recognizes that the sender has made a request related to the request message (i.e., a request to buy tofu).

[0036] On the other hand, following step S16, the processing unit 2 of the server device S searches for a stop-off point related to the request message (i.e., a supermarket to stop at to buy tofu, etc.) using map data or the like recorded in the recording unit 26, and further searches for a route from the current position of the navigation device NV to the searched stop-off point (step S17). More specifically, in searching for a stop-off point as step S17, the processing unit 2 identifies (searches for) a facility as a stop-off point using the analysis result of step S15 from a word or a group of words indicating a store name or facility attribute (e.g., attribute such as "supermarket") as a stop-off point, an object (e.g., product name such as "tofu") and a corresponding action (buying). In addition, in step S17, the processing unit 2 may search for the stop-off point on the return route when returning home, or may search for the stop-off point on the travel route when moving to another place, or may search for the stop-off point closest to the current position of the navigation device NV.

[0037] Thereafter, the processing unit 2 generates the stop-off place information including the search result of the stop-off place in step S17 and the search result of the route to the stop-off place, and transmits the stop-off place information to the navigation device NV via the network NW (step S18). Thereafter, the processing unit 2 monitors whether the arrival message or the departure message has been transmitted from the navigation device NV (step S19). In the monitoring of step S19, if neither the arrival message nor the departure message has been received (step S19: NO), the processing unit 2 continues the monitoring.

[0038] On the other hand, following the above step S33, the processing unit 21 of the navigation device NV receives the stop-off place information transmitted from the server device S in the above step S18 (step S34). Then, the processing unit 21 sets the stop-off place and guides the vehicle to the stop-off place based on the stop-off place information and the route information included in the received stop-off place information (step S35). The guidance itself in step S35 can be performed using a method similar to that of the past. Thereafter, the processing unit 21 monitors whether the vehicle has arrived at the stop-off place (step S36). If the vehicle has not yet arrived at the stop-off place in the monitoring of step S36 (step S36: NO), the processing unit 21 continues the monitoring. On the other hand, if the vehicle has arrived at the stop-off place in the determination of step S36 (step S36: YES), the processing unit 21 transmits either an arrival message indicating the arrival at the time of arrival or a departure message indicating the departure at the time of departure from the stop-off place to the server device S via the network NW (step S37). Thereafter, the processing unit 21 judges whether or not to terminate the process to be executed by the navigation device NV among the information processing according to the first embodiment due to, for example, the power switch of the navigation device NV being turned off (step S38). If it is judged in step S38 that the process is not to be terminated (step S38: NO), the processing unit 21 returns to the above step S30 and repeats the above-described process.

[0039] Next, in the monitoring of step S19, if either the arrival message or the departure message transmitted in step S37 is received (step S19: YES), the processing unit 2 of the server device S generates the stop-off completion message indicating that the recipient has stopped at the stop-off location related to the request message, and transmits the message to the smart speaker SK via the network NW (step S20). After that, the processing unit 2 determines whether or not to terminate the processing to be executed by the server device S among the information processing according to the first embodiment due to, for example, the power switch of the server device S being turned off (step S22). If the processing is not to be terminated in the determination of step S22 (step S22: NO), the processing unit 2 returns to step S10 and repeats the processing described above.

[0040] On the other hand, if it is determined in the above step S15 that the recipient has disembarked (step S15: disembarking), the processing unit 2 generates a disembarking message indicating that the recipient has disembarked (in other words, that the recipient did not stop at the stop-off point related to the request message) and transmits the message to the smart speaker SK via the network NW (step S21). After that, the processing unit 2 proceeds to the above step S22.

[0041] Next, if either the stop-off completion message (see step S20) or the dismount message (see step S21) is received in the monitoring of step S3 (step S3: YES), the CPU 11 of the smart speaker SK outputs the content of either one of them using the speaker 14. This allows the sender to recognize that the sender has either stopped at the stop-off point related to the request message uttered in step S1 (if the stop-off completion message is received in step S3) or did not stop at the stop-off point (if the dismount message is received in step S3). After that, the CPU 11 determines whether or not to end the processing to be executed by the smart speaker SK among the information processing according to the first embodiment due to, for example, the power switch of the smart speaker SK being turned off (step S5). If the processing is not to be ended in the determination of step S5 (step S5: NO), the CPU 11 returns to step S1 and repeats the processing described above.

[0042] As described above, according to the information processing of the first embodiment, when the recipient is in a vehicle (driving) (see step S15 in Figure 4: "In a vehicle"), stop-off place information indicating stop-off places related to the request message acquired from the smart speaker SK is transmitted to the navigation device NV for use in guiding the recipient's driving (see step S18 in Figure 4). Therefore, when an action (stop-off) that the recipient should take is indicated by the sender, the recipient can be guided to a stop-off place related to that action without causing the recipient trouble while driving.

[0043] In addition, since a display message is sent to the recipient's smartphone SP (see step S14 in FIG. 4), the recipient can also check the information on the actions at the stop-off point on the smartphone SP.

[0044] Furthermore, since the request message is voice data corresponding to an action spoken by the sender, and based on the recognition result, stop-off place information is transmitted to the navigation device NV for guidance, the recipient can be guided to related stop-off places based on the content of the sender's speech.

[0045] Furthermore, current status information including the position of the recipient's navigation device NV is obtained (see step S10 in Figure 4), the position of a stop-off point related to the request message is searched for, a route from the position of the navigation device NV to the position of the stop-off point is searched for (see step S17 in Figure 4), and the stop-off point information including the route is transmitted to the navigation device NV (see step S18 in Figure 4), so that the recipient can be guided to the related stop-off point without causing any inconvenience to the recipient who is driving.

[0046] 4, when searching for a stop-off point closest to the current position of the navigation device NV, the receiver can be guided to the stop-off point closest to the position of the navigation device NV and related to the request message. On the other hand, when searching for a stop-off point on a preset vehicle route in FIG. 4, step S17, the receiver can be guided to a stop-off point on the route and related to the request message.

[0047] Furthermore, when the navigation device NV detects that the user has passed through a stopover point (see step S19 in Figure 4), it sends a stopover completion message to the smart speaker SK indicating the stopover (see step S20 in Figure 4), allowing the sender to recognize the stopover.

[0048] Furthermore, if the recipient is unable to stop at the relevant stop-off point (step S15 in Figure 4: Disembark), a disembarkation message is sent to the smart speaker SK instead of a stop-off completion message, so that the sender can quickly recognize that the stop-off was not made.

[0049] (II) Second Example Next, a second example, which is another example corresponding to the above-described embodiment, will be described with reference to Fig. 5. Fig. 5 is a flowchart showing information processing according to the second example.

[0050] Here, the hardware configuration of the information processing system and server device etc. according to the second embodiment is basically the same as the hardware configuration of the information processing system SS and server device S etc. according to the first embodiment. Therefore, in the following description of the information processing system and server device etc. according to the second embodiment, the same component numbers are used for components similar to the information processing system SS and server device S etc. according to the first embodiment, and detailed descriptions are omitted. Similarly, in the information processing according to the second embodiment, the same step numbers are used for processes similar to the information processing according to the first embodiment, and detailed descriptions are omitted.

[0051] In the information processing according to the first embodiment described above, in step S15, it is determined whether the state of the recipient is "before boarding", "in boarding", or "getting off". In contrast, in the information processing according to the second embodiment, it is determined only whether the state of the recipient is "in boarding".

[0052] That is, as shown in FIG. 5, in the information processing of the second embodiment, steps S1 and S2 similar to those of the first embodiment are executed in the smart speaker SK, and then steps S10 to S14 similar to those of the first embodiment are executed in the server device S.

[0053] In addition, the processing of the information processing related to the second embodiment that should be performed by the smartphone SP (steps S25 to S29) and the processing of the information processing related to the second embodiment that should be performed by the navigation device NV (steps S30 to S38) are similar to the processing of the information processing related to the first embodiment that should be performed by the smartphone SP and the processing of the information processing related to the first embodiment that should be performed by the navigation device NV, respectively.

[0054] Then, following step S14, the processing unit 2 of the server device S determines whether or not the receiver using the navigation device NV is currently riding in a car, based on the current status information received and recorded in step S10 and step S11 from the navigation device NV and the smartphone SP (step S40). Here, as for the method of determination in step S40, it is possible to determine whether or not the receiver is currently riding in a car by using any of the methods ii) to vii) in step S15 in the information processing according to the first embodiment.

[0055] Then, if the determination in step S40 indicates that the receiver is not currently riding in a car (step S40: NO), the processing unit 2 repeats the determination in step S40, for example, at regular time intervals, until the receiver is currently riding in a car. On the other hand, if the determination in step S40 indicates that the receiver is currently riding in a car (step S40: YES), the processing unit 2 then executes steps S16 to S20 and S22 similar to those in the first embodiment. Note that in the information processing according to the second embodiment, the processing to be executed by the server device S does not execute step S19 in the first embodiment (see FIG. 4).

[0056] Thereafter, when the CPU 11 of the smart speaker SK receives a stopover completion message from the server device S in step S3 (step S3: YES), it executes steps S4 and S5 similar to those in the first embodiment.

[0057] As described above, the information processing according to the second embodiment can achieve the same effects as the information processing according to the first embodiment (excluding the effects due to the sending and receiving of the disembarking message according to the first embodiment) with simpler processing.

[0058] In step S17 of the information processing according to the first embodiment and the information processing according to the second embodiment described above, if the relevant stop-off point cannot be searched for because, for example, the distance to the stop-off point related to the request message is too far, the stop-off point is not on the route planned for the vehicle driven by the recipient, or the recipient has already arrived at home, a search impossible message indicating this may be transmitted to the smart speaker SK instead of the stop-off completion message and the disembarkation message. Even in this case, the sender can quickly recognize that the search was not possible.

[0059] In each of the above-described embodiments, the server device S is configured to search for a route to a related stop-off point. Alternatively, the navigation device NV may be configured to transmit only stop-off point information indicating the searched stop-off point (see step S17 in FIG. 4 and FIG. 5), and the navigation device NV may search for and provide guidance on a route to the stop-off point.

[0060] Furthermore, in each of the above-mentioned embodiments, a case has been described in which the recipient carrying a smartphone SP is driving a vehicle equipped with a navigation device NV, but the present application can also be applied to a case in which the vehicle is a two-wheeled vehicle (bicycle or motorcycle) and the recipient is using it to travel.

[0061] Furthermore, in each of the above-mentioned embodiments, only "whether or not the stop-off point was made" is determined in relation to the stop-off point, and it is not determined whether or not the purpose of the stop-off point (purchasing tofu in each of the embodiments) was achieved. For this reason, for example, by linking with a POS (Point Of Sale) system installed in the stop-off point via a network NW, the server device S or the like may determine whether or not the purpose itself was achieved, and the result may be transmitted as a message to the smart speaker SK.

[0062] In each of the above-described embodiments, a display message corresponding to a request message from a sender is sent to the smartphone SP carried by the recipient and the navigation device NV, respectively, and the stop-off place information is sent to the navigation device NV. In response to this, the destinations of the stop-off place information and the behavior information indicating the behavior of the recipient corresponding to the display message and the stop-off place information can be the following patterns in addition to the destinations in each embodiment. (a) A pattern in which both the behavior information and the stopover information are transmitted to the navigation device NV, and neither is transmitted to the smartphone SP. In the case of this pattern, since no message is transmitted to the smartphone SP, it is possible to have an effect of, for example, not causing the driver to become inattentive. (b) A pattern in which both the behavioral information and the stopover information are transmitted to the navigation device NV, and only the behavioral information is transmitted to the smartphone SP. In this pattern, the behavioral information is transmitted to the smartphone SP, which has the effect of enabling, for example, the recipient who has left the vehicle to confirm what action to take thereafter (in the case of each embodiment, what to buy). In this pattern, if the recipient is driving, it is preferable to transmit the behavioral information to the smartphone SP after the recipient arrives at the destination. Furthermore, it is also possible to limit the transmission target of the behavioral information to a mobile terminal (such as the smartphone SP) carried by the recipient. (c) A pattern in which both the behavior information and the stopover place information are transmitted to the navigation device NV and also to the smartphone SP. In the case of this pattern, the same effects and ideas as those in the above-mentioned (b) pattern can be considered.

[0063] Furthermore, other patterns include the following patterns: (d) A pattern in which only stop-off place information is transmitted to the navigation device NV, and neither is transmitted to the smartphone SP. (e) A pattern in which only stop-off place information is transmitted to the navigation device NV, and only behavior information is transmitted to the smartphone SP. (f) A pattern in which only stop-off place information is transmitted to the navigation device NV, and both behavior information and stop-off place information are transmitted to the smartphone SP.

[0064] In each of the above-described embodiments, a display message with contents equivalent to the contents of a request message corresponding to the behavioral information to be transmitted to the recipient is transmitted to the navigation device NV and the smartphone SP for display, but the voice message itself that is the source of the request message may be transmitted to the navigation device NV and / or the smartphone SP for playback, or the contents of the display message may be read out using the mechanical voice of the navigation device NV and / or the smartphone SP. Furthermore, the behavioral information transmitted to the recipient is not limited to the contents of the sender's voice message itself, but may be a summary of the request using the voice message.

[0065] As an example of applying the present application to the control of a so-called autonomously driven vehicle, the vehicle may be configured to stop at necessary stopover points by transmitting stopover point information to a control device (e.g., a navigation device) that controls the vehicle while traveling autonomously.

[0066] Furthermore, the receiving terminal of the recipient may be not only a combination of the navigation device NV and the smartphone SP in each of the above-mentioned embodiments, but also a combination of a smart speaker (i.e., a smart speaker that guides the vehicle using voice) placed in the vehicle and a smartphone.

[0067] Furthermore, for processes that may be performed at any terminal, such as the voice recognition process (see step S13 in FIGS. 4 and 5) and the stop-off point search process (step S17 in FIGS. 4 and 5) in each of the above-described embodiments, the terminal that performs the processes may be changed as appropriate.

[0068] In addition, programs corresponding to the flowcharts shown in Figures 4 and 5, respectively, can be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and these can be read out and executed by a general-purpose microcomputer, etc., to cause the microcomputer, etc. to function as the processing unit 2, CPU 11, processing unit 21, or CPU 31 according to each embodiment. [Explanation of symbols]

[0069] 1. Acquisition method (interface) 2 Transmission control means (processing unit) S Information processing device (server device) TT Transmitting Terminal RT1, RT2 receiving terminal SK Smart Speaker SP Smartphone NV navigation equipment SS Information Processing System

Claims

[Claim 1] In an information processing device that can be connected by communication to a sending terminal of a sender and a plurality of receiving terminals of a recipient, An acquisition means for acquiring, from the transmitting terminal, action information indicating an action to be taken by the recipient and associated with a facility related to the action; a transmission control means for transmitting facility information indicating the related facility to the receiving terminal that provides the driving guidance for the guidance; An information processing device comprising:

Images