Information notification system and information notification method

Abstract

An information notification system and an information notification method are provided, which can enable the user of a mobile body to more reliably identify the information of a task entrusted to be executed during the movement. The information notification system (10) includes: a task entrustment message extraction unit (22) that extracts a task entrustment message from the messages received by the message reception unit (21), where the task entrustment message entrusts a specified task that the first user is expected to execute during the movement of the mobile body (1); and a task entrustment information notification unit (24) that, in a state where a task entrustment message is extracted by the task entrustment message extraction unit (22), when the user action recognition unit (23) recognizes an action that can estimate that the first user gets off the mobile body (1), causes the output device (90) used by the mobile body to output the content of the specified task.

Description

Technical Field

[0001] The present invention relates to an information notification system and an information notification method. Background Art

[0002] Conventionally, an information notification device has been proposed. The information notification device detects the situation where a user gets out of the vehicle, obtains information associated with the location where the vehicle is located from a database, converts the obtained information into voice data, and outputs normal information in voice (for example, refer to Patent Document 1). The above information notification device outputs security information, traffic congestion information, shopping information, event information, etc. as notification information associated with the location where the vehicle is located.

[0003] Patent Document 1: Japanese Patent Application Laid-Open No. 2017-528085

[0004] As in the above conventional information notification device, as information to be notified to a user of a moving body such as a vehicle, information on a task that the user is expected to perform during the movement is considered. Moreover, in this case, it is desired to enable the user to more reliably identify the information on the entrusted task. Summary of the Invention

[0005] The present invention has been made in view of this background, and an object thereof is to provide an information notification system and an information notification method that can enable a user of a moving body to more reliably identify information on a task entrusted to be performed during the movement.

[0006] As a first aspect for achieving the above object, there is provided an information notification system having: a message receiving unit that receives a message sent to a moving body; a task entrustment message extraction unit that extracts a task entrustment message from the message received by the message receiving unit, the task entrustment message entrusting a specified task that a user of the moving body is expected to perform during the movement of the moving body; a user action recognition unit that recognizes the action of the user of the moving body; and a task entrustment information notification unit that, when the user action recognition unit recognizes an action that can estimate that the user gets out of the moving body, causes an output device used in the moving body to output the content of the specified task extracted by the task entrustment message extraction unit.

[0007] In the above information notification system, it may be configured such that the information notification system has a task commitment intention recognition unit that recognizes the user's commitment intention to the specified task, and the task entrustment information notification unit causes the output device to output the content of the specified task entrusted by the task entrustment message and recognized by the task commitment intention recognition unit as the user's commitment among the specified tasks.

[0008] In the above information notification system, it may also be configured such that when the task entrustment information notification unit recognizes the user's commitment intention for the specified task through the task commitment intention recognition unit and then recognizes, through the user action recognition unit, an action that can estimate that the user boards the moving body, the output device outputs the content of the specified task.

[0009] In the above information notification system, it may also be configured such that the information notification system has a task commitment intention recognition unit that recognizes the user's commitment intention, and when the task entrustment information notification unit recognizes the user's commitment intention for the specified task through the task commitment intention recognition unit and then recognizes, through the user action recognition unit, an action that can estimate that the user boards the moving body, the output device outputs the content of the specified task.

[0010] In the above information notification system, it may also be configured such that the information notification system has a task commitment notification unit that, when recognizing the user's commitment intention for the specified task through the task commitment intention recognition unit, sends a task commitment notification notifying that the specified task has been committed to the sender of the task entrustment message.

[0011] In the above information notification system, it may also be configured such that when the user action recognition unit recognizes an action that can estimate that the user gets off the moving body, the task entrustment information notification unit only outputs the content of the specified task from the output device and prohibits the output device from outputting information related to messages other than the task entrustment message.

[0012] In the above information notification system, it may also be configured such that the task entrustment message extraction unit extracts the task entrustment message received by the message receiving unit during the period from when the moving body departs from a specified location until the user action recognition unit recognizes an action that can estimate that the user gets off the moving body.

[0013] In the above information notification system, it may also be configured such that the task entrustment message extraction unit extracts the task entrustment message by searching for a message containing a specified keyword indicating movement to the specified location among the messages received by the message receiving unit.

[0014] In the above information notification system, it may also be configured such that the information notification system has a passenger recognition unit that recognizes the passengers of the moving body, and when the passenger recognition unit recognizes a passenger other than the driver of the moving body, the task entrustment information notification unit prohibits the output device from outputting the content of the specified task.

[0015] In the above information notification system, it may also be configured such that the information notification system has a task-related facility information providing unit, and this task-related facility information providing unit causes the output device to output information on facilities for performing the specified task.

[0016] In the above information notification system, it may also be configured such that the information notification system has a route guidance unit, and this route guidance unit causes the output device to output route guidance information for guiding the user to the facility.

[0017] As a second mode for achieving the above object, an information notification method is provided, which is executed by a computer. The information notification method includes the following steps: a message reception step of receiving a message sent to a moving body; a task delegation message extraction step of extracting a task delegation message from the message received in the message reception step, where the task delegation message delegates a specified task that the user of the moving body is desired to execute during the movement of the moving body; a user action recognition step of recognizing the action of the user of the moving body; and a task delegation information notification step of causing an output device used in the moving body to output the content of the specified task extracted in the task delegation message extraction step when an action that can estimate that the user gets off the moving body is recognized in the user action recognition step.

[0018] Advantages of the Invention

[0019] According to the above information notification system, it is possible to enable the user of the moving body to more reliably recognize the information on the task delegated to be executed during the movement. Brief Description of the Drawings

[0020] Figure 1 It is an explanatory diagram of a mode in which a task to be executed during the return home is delegated to a user who returns home by using a vehicle through an information notification system.

[0021] Figure 2 It is a structural diagram of a vehicle equipped with an information notification system.

[0022] Figure 3 It is a structural diagram of an information notification system.

[0023] Figure 4 It is a flowchart of a process for determining whether to output task information when a user gets on a vehicle.

[0024] Figure 5 It is a first flowchart of an auxiliary process for task execution.

[0025] Figure 6 It is a second flowchart of an auxiliary process for task execution.

[0026] Figure 7 This is the 3rd flowchart of the auxiliary processing for task execution.

[0027] Label Explanation

[0028] 1…Vehicle (mobile body), 10…Information notification system, 20…Processor, 21…Message receiving unit, 22…Task delegation message extraction unit, 23…User action recognition unit, 24…Task delegation information notification unit, 25…Task commitment intention recognition unit, 26…Task commitment notification unit, 27…Passenger identification unit, 28…Task-related facility information providing unit, 29…Route guidance unit, 30…Task completion notification unit, 35…Memory, 36…Information notification program, 90…Touch panel, 150…Second user terminal, 600…Vehicle management server. Detailed Implementation Manner

[0029] [1. Output of Task Information Based on the Information Notification System]

[0030] Refer to Figure 1 The method of outputting task information by the information notification system 10 of this embodiment will be described. Figure 1 It shows a situation where the first user U1 drives the vehicle 1 to go to work from home 700 and then drives the vehicle 1 back home 700 from work. At home 700, the second user U2, who is a family member of the first user U1, is at home, and the second user U2 uses the second user terminal 150.

[0031] The information notification system 10 is mounted on the vehicle 1 and communicates with the vehicle management server 600 and the second user terminal 150 via the communication network 500. When the second user U2 wants to entrust the first user U1, who uses the vehicle 1 to go to work, to do shopping on the way home, the second user U2 operates the second user terminal 150 to send a task delegation message Jmsg for entrusting shopping to the vehicle 1. In Figure 1 this example, a task delegation message Jmsg conveying "Buy eggs when coming back!" is sent. Buying eggs is equivalent to the specified task of the present invention.

[0032] In this embodiment, the task delegation message Jmsg sent from the second user terminal 150 is temporarily stored in the message DB (Data Base) 610 of the vehicle management server 600. Then, during the use of the vehicle 1, the task delegation message Jmsg is sent from the vehicle management server 600 to the vehicle 1.

[0033] When the vehicle 1 arrives at the workplace 710 and the first user U1 gets off the vehicle 1, the information notification system 10 displays a task notification screen 200 on the touch panel of the vehicle 1. The task notification screen 200 shows the content of the task entrusted by the task entrustment message Jmsg. Then, when the information notification system 10 recognizes the commitment of the first user U1 to the task through the touch operation of the commitment button 201 on the task notification screen 200, it sends a task commitment notification Amsg to the second user terminal 150.

[0034] Then, when the first user U1 finishes work at the workplace 710 and gets on the vehicle 1, the information notification system 10 again displays (reminder display) a task notification screen 210 on the touch panel of the vehicle 1. The task notification screen 210 shows the content of the task entrusted by the task entrustment message Jmsg. Then, when the information notification system 10 recognizes the confirmation of the first user U1 to the task through the touch operation of the confirmation button 211 on the task notification screen 210, it sends a task confirmation notification Rmsg to the second user terminal 150.

[0035] In addition, the information notification system 10 displays the information of the facility (egg purchase) where the task can be executed, that is, the store 720, on the touch panel and starts guiding the route to the store 720. When the vehicle 1 arrives at the store 720 and the first user U1 gets off the vehicle 1, and then, at the moment when the first user U1 returns to the vehicle 1 and gets on, the information notification system 10 displays a task execution confirmation screen 220 on the touch panel. The task execution confirmation screen 220 is a screen that shows the content of the task and asks whether the task has been executed (whether eggs have been purchased). When the task completion button 221 on the task execution confirmation screen 220 is touched, the information notification system 10 sends a task completion message Cmsg notifying that the task has been executed to the second user terminal 150.

[0036] When the vehicle 1 arrives at the home 700 and the information notification system 10 recognizes the action of the first user U1 getting off the vehicle 1, it displays a task execution confirmation screen 230 on the touch panel of the vehicle 1. Then, when the task completion button 231 on the task execution confirmation screen 230 is touched, the information notification system 10 sends a task completion message Cmsg notifying that the task has been executed to the second user terminal 150.

[0037] Through the series of processes described above, the information notification system 10 notifies the first user U1 of the information of the task entrusted to be executed during the movement and assists the first user U1 in executing the task. When the first user U1 gets on the vehicle 1 to go home, the task notification screen 200 is displayed on the touch panel, so that the first user U1 can surely recognize the entrustment of the task.

[0038] [2. Structure of the vehicle]

[0039] Refer to Figure 2 The structure of the vehicle 1 equipped with the information notification system 10 will be described. The vehicle 1 is a passenger car specified to seat five people, and has a driver's seat 7a, a front passenger seat 7b, a rear right seat 7c, a rear middle seat 7d, and a rear left seat 7e. Seat belt switches 60 to 64 and occupancy sensors 70 to 74 for detecting whether a seat belt (not shown) is fastened are provided at each of the seats 7a to 7e.

[0040] In Figure 2 shows the situation where the first user U1 who holds the portable key 160 of the vehicle 1 is seated on the driver's seat 7a. In addition, the second user terminal 150 used by the second user U2 is placed on the front passenger seat 7b. The vehicle 1 has a right front door 2, a left front door 3, a right rear door 4, and a left rear door 5, and a door touch sensor 53 is provided at the door knob of the right front door 2. The first user U1 who holds the portable key 160 can unlock the doors 2 to 6 of the vehicle 1 by touching the door touch sensor 53.

[0041] A front camera 40 for photographing the front of the vehicle 1 is provided at the front of the vehicle 1, and a rear camera 43 for photographing the rear of the vehicle 1 is provided at the rear of the vehicle 1. A right side camera 41 for photographing the right side of the vehicle 1 is provided at the right side of the vehicle 1, and a left side camera 42 for photographing the left side of the vehicle 1 is provided at the left side of the vehicle 1.

[0042] A front seat camera 45, a touch panel 90, and a speaker 91 for photographing the users seated on the driver's seat 7a and the front passenger seat 7b are provided on the instrument panel in the passenger compartment. The touch panel 90 and the speaker 91 correspond to the output devices of the present invention. A rear seat camera 46 for photographing the users seated on the rear right seat 7c, the rear middle seat 7d, and the rear left seat 7e is provided on the ceiling of the passenger compartment.

[0043] Door switches 80 to 83 for detecting the opening and closing of the doors are provided on each of the doors 2 to 5. A door switch 85 for detecting the opening and closing of the tailgate 6 is also provided on the tailgate 6. And, a power switch 54 and a shift switch 55a for detecting the shift position of the shift lever 55 are provided near the driver's seat 7a. In addition, the vehicle 1 has a side brake switch 52a for detecting whether the side brake pedal 52 is depressed or not depressed.

[0044] And, the vehicle 1 has door lock mechanisms 100 to 104 for locking the doors 2 to 5 and the tailgate 6, a speed sensor 120 for detecting the traveling speed of the vehicle 1, a communication unit 130, a navigation device 140, and a vehicle ECU 141.

[0045] The communication unit 130 communicates with the second user terminal 150, the portable key 160, the vehicle management server, communication terminals near the vehicle 1, etc. The navigation device 140 has a GPS (Global Positioning System) sensor (not shown) and map data, and based on the position of the vehicle 1 detected by the GPS sensor and the map data, performs route guidance to the destination, etc. The vehicle ECU 141 controls the overall operation of the vehicle 1.

[0046] [3. Structure of the Information Notification System]

[0047] Refer to Figure 3 The structure of the information notification system 10 will be described. The information notification system 10 includes a processor 20 (equivalent to the computer of the present invention), a memory 35, an interface circuit (not shown), etc. An information notification program 36 is stored in the memory 35, and this information notification program 36 is used to execute the above-mentioned task delegation and auxiliary processing for task implementation.

[0048] Images of the surroundings of the vehicle 1 captured by the front camera 40, the right camera 41, the left camera 42, and the rear camera 43 are input to the information notification system 10. In addition, images inside the vehicle 1 captured by the front seat camera 45 and the rear seat camera 46 are input to the information notification system 10.

[0049] Furthermore, detection signals of the side brake switch 52a, the door touch sensor 53, the power switch 54, the shift switch 55a, the seat belt switches 60 to 64, the occupancy sensors 70 to 74, the door switches 80 to 84, and the locking detection signals of each door 2 to 5 and the tailgate 6 based on the door lock sensors (not shown) provided in the door lock mechanisms 100 to 104 are input to the information notification system 10.

[0050] In addition, the touch position detection signal of the touch panel 90, the speed detection signal of the speed sensor 120, and information on the current position (latitude, longitude) of the vehicle 1 detected by the navigation device 140 are input to the information notification system 10.

[0051] The screen display of the touch panel 90, the sound output from the speaker 91 (voice guidance, ringtone, etc.), the actions (locking, unlocking) of the door lock mechanisms 100 to 104, etc. are controlled by the control signal output from the information notification system 10. In addition, the information notification system 10 communicates with the vehicle ECU 141 and communicates with the vehicle management server 600, the second user terminal 150, etc. via the communication unit 130.

[0052] The processor 20 reads and executes the information notification program 36 stored in the memory 35, thereby functioning as a message receiving unit 21, a task delegation message extraction unit 22, a user action recognition unit 23, a task delegation information notification unit 24, a task commitment intention recognition unit 25, a task commitment notification unit 26, a passenger recognition unit 27, a task-related facility information providing unit 28, a route guidance unit 29, and a task completion notification unit 30.

[0053] The processor 20 corresponds to the computer of the present invention. The process executed by the message receiving unit 21 corresponds to the message receiving step in the information notification method of the present invention, and the process executed by the task delegation message extraction unit 22 corresponds to the task delegation message extraction step in the information notification method of the present invention. The process executed by the user action recognition unit 23 corresponds to the user action recognition step in the information notification method of the present invention, and the process executed by the task delegation information notification unit 24 corresponds to the task delegation information notification step in the information notification method of the present invention.

[0054] The message receiving unit 21 receives a message sent from the second user terminal 150 or the like to the vehicle 1 from the vehicle management server 600 and stores it in the memory 35. Alternatively, the message may be directly received from the second user terminal 150 or the like without passing through the vehicle management server 600. The task delegation message extraction unit 22 extracts a task delegation message Jmsg (see Figure 1 ) from the message received by the message receiving unit 21 and stored in the memory 35. This task delegation message Jmsg notifies a specified task that the first user U1 is desired to execute during the movement of the vehicle 1. Here, it is also possible that the task delegation message extraction unit 22 extracts the task delegation message Jmsg sent from the second user terminal 150 during the period from when the first user U1 departs from his / her home 700 (corresponding to the specified location in the present disclosure) using the vehicle 1 until he / she arrives at the workplace and gets off the vehicle 1.

[0055] The user action recognition unit 23 recognizes the actions of the first user U1 based on the captured images around the vehicle 1 captured by the front camera 40, the right camera 41, the left camera 42, and the rear camera 43, the captured images inside the vehicle 1 captured by the front seat camera 45 and the rear seat camera 46, the detection signals of the side brake switch 52a, the door touch sensor 53, the power switch 54, the shift switch 55a, the seat belt switch 60, the seating sensor 70, the door switch 80, and the locking detection signal of the right front door 2 based on the door lock sensor (not shown) provided in the door lock mechanism 100.

[0056] In the present embodiment, the user action recognition unit 23 recognizes the movement of the first user U1 towards the door direction identified from the captured image inside the vehicle 1, the detection of the change of the side brake to the operating state based on the side brake switch 52a, the disconnection operation of the power switch 54, the change of the seat sensor 70 from the on-detection state (the state where seating is detected) to the off-detection state (the state where seating is not detected), the change of the seat belt switch 60 from on to off, etc., so as to recognize the action of the first user U1 getting out of the vehicle 1 that can be estimated.

[0057] In addition, the user action recognition unit 23 recognizes the movement of the first user U1 towards the inside of the vehicle 1 identified from the captured image around the vehicle 1, the detection of the change of the side brake to the non-operating state (brake cut-off state) based on the side brake switch 52a, the connection operation of the power switch 54, the change of the seat sensor 70 from the off-detection state (the state where seating is not detected) to the on-detection state (the state where seating is detected), the change of the seat belt switch 60 from off to on, etc., so as to recognize the action of the first user U1 getting into the vehicle 1 that can be estimated.

[0058] When the task delegation information notification unit 24 recognizes, through the user action recognition unit 23, the action of the first user U1 getting out of the vehicle 1 that can be estimated, it displays the task notification screen 200 (refer to Figure 1 ) on the touch panel 90, and this task notification screen 200 displays the information of the specified task to be entrusted and executed during the movement. In addition, when the task delegation information notification unit 24 recognizes, through the user action recognition unit 23, the action of the first user U1 getting into the vehicle 1 that can be estimated, it displays the task notification screen 210 (refer to Figure 1 ) that notifies the reminder of the specified task on the touch panel 90. Then, the task delegation information notification unit 24 displays the task execution confirmation screens 220, 230 (refer to Figure 1 ) for confirming whether the first user U1 has executed the specified task on the touch panel 90.

[0059] When the task commitment notification unit 26 recognizes the commitment of the specified task through the operation of the commitment button 201 (refer to Figure 1 ) of the task notification screen 200, it sends the task commitment message Amsg (refer to Figure 1 ) to the second user terminal 150. The passenger recognition unit 27 recognizes the passengers in the vehicle 1 based on the captured image inside the vehicle 1, the detection status of the seat belt switches 60 - 64 and the seat sensors 70 - 74, etc.

[0060] The task-related facility information providing unit 28 provides the facilities available for executing the specified task (in Figure 1In the example, information of the store 720) (store name, location, business hours, map to the facility, etc.) is displayed on the touch panel 90. The route guidance unit 29 sets the facility where a prescribed task can be executed as the destination in the navigation device 140 and executes route guidance to the facility. The task completion notification unit 30 sends a task completion message Cmsg to the second user terminal 150 when the completion of the prescribed task is confirmed by operating the task completion buttons 221, 231 (refer to Figure 1 ) of the task execution confirmation screens 220, 230.

[0061] [4. Output Judgment Processing of Task Information]

[0062] The output judgment processing of task information will be described according to the Figure 4 flowchart shown below. Hereinafter, as Figure 1 shown, the following situation will be described: A prescribed task of purchasing eggs on the way back from the workplace 710 to the home 700 is entrusted to the first user U1, and the execution of the prescribed task is assisted.

[0063] In step S1 of Figure 4 , when the user action recognition unit 23 recognizes that the vehicle 1 has stopped based on the detection signal of the speed sensor 120, the process proceeds to step S2, and the action of the first user U1 is recognized as described above. In the next step S3, when the user action recognition unit 23 recognizes an action that can estimate that the first user U1 gets out of the vehicle 1, the process proceeds to step S4. On the other hand, when an action that can estimate that the first user U1 gets out of the vehicle 1 is not recognized, the user action recognition unit 23 makes the process proceed to step S1.

[0064] In step S4, the passenger recognition unit 27 recognizes the passengers in the vehicle 1. In the next step S5, when the passenger recognition unit 27 does not recognize a passenger (co - passenger) other than the first user U1, the task entrustment information notification unit 24 makes the process proceed to step S6. On the other hand, when the passenger recognition unit 27 recognizes a co - passenger, the task entrustment information notification unit 24 makes the process proceed to step S9, and in this case, the display of the task notification screen 200 (refer to Figure 1 ) is not executed.

[0065] In step S6, the task entrustment message extraction unit 22 retrieves the task entrustment message Jmsg from the messages received by the message reception unit 21 and stored in the memory 35. The task entrustment message Jmsg entrusts the first user U1 to execute a task on the way back to the home 700. The task entrustment message extraction unit 22 retrieves the task entrustment message Jmsg, which is a message containing prescribed keywords indicating the movement to the home 700, such as "when returning", "when going home", "when coming back", etc.

[0066] Then, in the next step S7, when the task delegation information notification unit 24 extracts the task delegation message Jmsg through the task delegation message extraction unit 22, the process proceeds to step S8, and in this case, auxiliary processing for task execution is performed. On the other hand, when the task delegation message extraction unit 22 does not extract the task delegation message Jmsg, the task delegation information notification unit 24 causes the process to proceed to step S9, and in this case, auxiliary processing for task execution is not performed.

[0067] [5. Auxiliary Processing for Task Execution]

[0068] According to Figures 5 - 7 the flowchart shown, the auxiliary processing for task execution will be described. In Figure 5 step S20, the task delegation information notification unit 24 displays the task notification screen 200 (refer to Figure 1 ) on the touch panel 90. Here, the task delegation information notification unit 24 prohibits the display of information of messages other than the task delegation message Jmsg on the touch panel 90, so that the first user U1 can easily recognize only the content of the task.

[0069] In the next step S21, the task commitment intention recognition unit 25 confirms whether there is a touch operation (task commitment operation) on the commitment button 201 of the task notification screen 200. Then, when there is a task commitment operation, the task commitment intention recognition unit 25 causes the process to proceed to step S22, and when there is no task commitment operation, the task commitment intention recognition unit 25 causes the process to proceed to step S40.

[0070] In step S40, the task commitment notification unit 26 sends a task non-executable message notifying that the task has not been committed to the second user terminal 150, and causes the process to proceed to Figure 6 step S35. In this case, the auxiliary processing after step S23 is not executed. In addition, in step S22, the task delegation information notification unit 24 displays the content of the committed task on the touch panel 90.

[0071] Here, when multiple task delegation messages Jmsg are extracted by the task delegation message extraction unit 22, information of multiple tasks and the commitment buttons for each task are displayed on the task notification screen 200. Then, the task commitment notification unit 26 displays only the content of the committed task among the multiple tasks displayed on the task notification screen 200 on the touch panel 90 in step S22.

[0072] In the next step S23, the task commitment notification unit 26 sends a task commitment message Amsg (refer to Figure 1)Sent to the second user terminal 150. In the next step S24, the user action recognition unit 23 recognizes the action of the first user U1. In the next step S25, when the user action recognition unit 23 recognizes an action that can estimate that the first user U1 is riding in the vehicle 1, the process proceeds to step S26. When an action that can estimate that the first user U1 is riding in the vehicle 1 is not recognized, the process proceeds to step S24. In step S26, the task delegation information notification unit 24 displays a task notification screen 210 (refer to Figure 1 ) that shows the content of the committed task on the touch panel 90 (reminder display).

[0073] In the next step S27, the task-related facility information providing unit 28 uses the keywords extracted from the task delegation message Jmsg to retrieve facilities available for performing the specified task. In Figure 1 's example, the task-related facility information providing unit 28 extracts "egg" and "buy" as keywords from a message like "Buy eggs when you come back!", and retrieves supermarkets, drugstores, convenience stores, etc. as facilities where eggs can be bought. Then, the task-related facility information providing unit 28 displays the information (name, location, business hours, etc. of the store) of the store 720 extracted through the retrieval on the touch panel 90.

[0074] In the next step S28, the route guidance unit 29 sets the store 720, which is the task-related facility extracted by the task-related facility information providing unit 28, as the destination in the navigation device 140, thereby starting the route guidance to the store 720. In addition, when the task-related facility information providing unit 28 extracts multiple task-related facilities, it displays the information of the multiple facilities on the touch panel 90 and determines the facility to be used as the destination based on the selection operation of the first user U1.

[0075] In the next Figure 6 step S29, when the task delegation information notification unit 24 recognizes that the vehicle 1 is approaching the store 720 based on the information of the current position of the vehicle 1 detected by the navigation device 140, the process proceeds to step S30. On the other hand, when it is not recognized that the vehicle 1 is approaching the store 720, the task delegation information notification unit 24 makes the process proceed to step S50 to determine whether the vehicle 1 has passed by the store 170. Then, when the vehicle 1 has passed by the store 170, the task delegation information notification unit 24 makes the process proceed to step S51. When the vehicle 1 has not passed by the store 170, the task delegation information notification unit 24 makes the process proceed to step S29.

[0076] In step S51, the task delegation information notification unit 24 displays the task notification screen 200 on the touch panel 90. In the next step S52, when it is estimated based on the information on the current position of the vehicle 1 detected by the navigation device 140 that the vehicle 1 is to return to the store 170, the task delegation information notification unit 24 advances the process to step S29. On the other hand, when it is estimated that the vehicle 1 does not return to the store 170, the task delegation information notification unit 24 advances the process to Figure 7 step S39, in which case the auxiliary process for task execution ends.

[0077] In step S30, the user action recognition unit 23 recognizes the action of the first user U1. In the next step S31, when the user action recognition unit 23 recognizes an action that can estimate that the first user U1 is riding in the vehicle 1, the process advances to step S32, and when it does not recognize an action that can estimate that the first user U1 is riding in the vehicle 1, the process advances to step S30.

[0078] In step S32, the task delegation information notification unit 24 displays the task execution confirmation screen 220 (refer to Figure 1 ) on the touch panel 90. In the next step S33, the task completion notification unit 30 determines whether there is an operation of the task completion button 221 (task completion operation). When there is a task completion operation, the process advances to step S60, and when there is no task completion operation, the process advances to Figure 7 step S34. In step S60, the task completion notification unit 30 sends a task completion message Cmsg notifying that a specified task has been completed (purchased eggs in the example of Figure 1 ) to the second user terminal 150 and returns the process to Figure 7 step S34.

[0079] In step S34, when the task delegation information notification unit 24 recognizes that the vehicle 1 has reached the home 700 based on the information on the current position of the vehicle 1 detected by the navigation device 140, the process returns to step S35. In step S35, the user action recognition unit 23 recognizes the action of the first user U1. In the next step S36, when the user action recognition unit 23 recognizes an action that can estimate that the first user U1 gets off the vehicle 1, the process advances to step S37, and when it does not recognize an action that can estimate that the first user U1 gets off the vehicle 1, the process advances to step S35.

[0080] In step S37, the task delegation information notification unit 24 displays the task execution confirmation screen 230 (refer to Figure 1) It is displayed on the touch panel 90. In the next step S38, the task completion notification unit 30 determines whether there is an operation of the task completion button 231 (task completion operation). When there is a task completion operation, the process proceeds to step S70. When there is no task completion operation, the process proceeds to step S39. In step S70, the task completion notification unit 30 sends a task completion message Cmsg notifying that a specified task has been completed (in the case of Figure 1 the example of

[0081] [6. Other Embodiments]

[0082] In the above embodiment, the four-wheel vehicle 1 is exemplified as the moving body of the present invention. However, the present invention can also be applied to various passenger moving bodies such as two-wheel vehicles, flying bodies, and ship hulls.

[0083] In the above embodiment, as the process of outputting the content of the specified task of the present invention, the task entrustment information notification unit 24 executed the process of displaying the task notification screens 200, 210, the task execution confirmation screens 220, 230 on the touch panel 90 of the vehicle 1. As another embodiment, the content of the specified task may be output by sound from the speaker 91. Alternatively, the content of the specified task may be output by both displaying on the touch panel 90 and outputting sound from the speaker 91.

[0084] In the above embodiment, the purchase of eggs is exemplified as the specified task of the present invention. However, the specified task is not limited to this, and any task that is executed during the movement of the moving body is acceptable. For example, it may also be tasks such as the purchase of goods other than eggs, picking up and delivering laundry to the laundry, and depositing and withdrawing money at an ATM.

[0085] In the above embodiment, there are a task commitment intention recognition unit 25 and a task commitment notification unit 26, which notify the second user U2 that the first user U1 has committed to the specified task. However, it may also be configured to omit the task commitment intention recognition unit 25 and the task commitment notification unit 26.

[0086] In the above embodiment, there is a passenger identification unit 27, and when there are passengers other than the first user U1 in the vehicle 1, the task notification screen 200 is not displayed. However, it may also be configured to omit the passenger identification unit 27.

[0087] In the above embodiment, there is a task completion notification unit 30, which notifies the second user U2 that the first user U1 has completed the specified task. However, it may also be configured to omit the task completion notification unit 30.

[0088] In the above-described embodiment, there are a task-related facility information providing unit 28 and a route guidance unit 29, which provide information on facilities where a prescribed task can be executed and perform route guidance to the facilities. As another embodiment, it may be configured to omit the route guidance unit 29, or it may be configured to omit both the task-related facility information providing unit 28 and the route guidance unit 29.

[0089] In the above-described embodiment, an example in which the information notification system 10 is mounted on the vehicle 1 is shown. However, the information notification system 10 may also be constituted by the vehicle management server 600. In this case, the computer constituting the vehicle management server 600 executes a program corresponding to the information notification program 36, whereby it functions as a message receiving unit 21, a task commission message extraction unit 22, a user action recognition unit 23, a task commission information notification unit 24, a task commitment intention recognition unit 25, a task commitment notification unit 26, a passenger recognition unit 27, a task-related facility information providing unit 28, a route guidance unit 29, and a task completion notification unit 30. Then, the vehicle management server 600 transmits information on a prescribed task to the vehicle 1, displays task notification screens 200 and 210 and task execution confirmation screens 220 and 230 on the touch panel 90, and receives operation information of the touch panel 90 transmitted from the vehicle 1 to recognize the commitment and completion of the prescribed task.

[0090] In addition, the message receiving unit 21, the task commission message extraction unit 22, the user action recognition unit 23, the task commission information notification unit 24, the task commitment intention recognition unit 25, the task commitment notification unit 26, the passenger recognition unit 27, the task-related facility information providing unit 28, the route guidance unit 29, and the task completion notification unit 30 may be dispersedly arranged between the vehicle management server 600 and the vehicle 1 to constitute the information notification system 10 in this way.

[0091] In addition, Figure 3 This is a schematic diagram showing the functional structure of the information notification system 10 by distinguishing the main processing contents for easy understanding of the invention of the present application. The information notification system 10 may also be configured by other distinguishing methods. In addition, the processing of each structural element may be executed by one hardware unit or by a plurality of hardware units. In addition, Figures 4 - 6 The processing of each structural element shown may be executed by one program or by a plurality of programs.

[0092] [7. Structure Supported by the Above Embodiment]

[0093] The above-described embodiment is a specific example of the following structure.

[0094] (Item 1) An information notification system, comprising: a message receiving unit that receives a message sent to a moving body; a task delegation message extraction unit that extracts a task delegation message from the message received by the message receiving unit, the task delegation message delegating a specified task that a user of the moving body is desired to execute during the movement of the moving body; a user action recognition unit that recognizes the actions of the user of the moving body; and a task delegation information notification unit that, when the user action recognition unit recognizes an action that can estimate that the user gets off the moving body, causes an output device used in the moving body to output the content of the specified task extracted by the task delegation message extraction unit.

[0095] According to the information notification system of Item 1, it is possible to enable the user of the moving body to more reliably recognize the information of the task delegated to be executed during the movement.

[0096] (Item 2) According to the information notification system of Item 1, wherein the information notification system has a task commitment intention recognition unit that recognizes the commitment intention of the user with respect to the specified task, and the task delegation information notification unit causes the output device to output the content of the specified task among the specified tasks entrusted by the task delegation message, for which the user's commitment has been recognized by the task commitment intention recognition unit.

[0097] According to the information notification system of Item 2, it is possible to cause the output device to output the content of the specified task committed by the user.

[0098] (Item 3) According to the information notification system of Item 2, wherein the task delegation information notification unit, when, after the task commitment intention recognition unit recognizes the commitment intention of the user with respect to the specified task, the user action recognition unit recognizes an action that can estimate that the user boards the moving body, causes the output device to output the content of the specified task.

[0099] According to the information notification system of Item 3, it is possible to remind the user who has committed to a specified task of the execution of the specified task at the moment when the user boards the moving body later.

[0100] (Item 4) According to the information notification system of Item 1, wherein the information notification system has a task commitment intention recognition unit that recognizes the commitment intention of the user, and the task delegation information notification unit, when, after the task commitment intention recognition unit recognizes the commitment intention of the user with respect to the specified task, the user action recognition unit recognizes an action that can estimate that the user boards the moving body, causes the output device to output the content of the specified task.

[0101] The information notification system according to item 4 is capable of reminding the execution of a specified task at the moment when a user who has promised a specified task boards a moving body later.

[0102] (Item 5) The information notification system according to any one of items 2 to 4, wherein

[0103] the information notification system has a task commitment notification unit that, when the task commitment intention recognition unit recognizes the user's commitment intention to the specified task, sends a task commitment notification indicating that the specified task has been committed to the sender of the task entrustment message.

[0104] The information notification system according to item 5 is capable of notifying the entruster of a specified task who has sent a task entrustment message that the user of the moving body has committed to the specified task.

[0105] (Item 6) The information notification system according to any one of items 1 to 5, wherein when the user action recognition unit recognizes an action that can estimate that the user gets off the moving body, the task entrustment information notification unit only outputs the content of the specified task from the output device and prohibits the output device from outputting information related to messages other than the task entrustment message.

[0106] The information notification system according to item 6 is capable of efficiently notifying the content of a specified task to a user who gets off the moving body.

[0107] (Item 7) The information notification system according to any one of items 1 to 6, wherein the task entrustment message extraction unit extracts the task entrustment message received by the message receiving unit during the period from when the moving body departs from a specified location to when the user action recognition unit recognizes an action that can estimate that the user gets off the moving body.

[0108] The information notification system according to item 7 can efficiently notify the information of a specified task to the user at a moment when the specified task can be executed during the movement of the moving body by extracting the task entrustment message received during the period from when, for example, a user departs from a specified location such as home and goes to other places by the moving body until getting off the moving body.

[0109] (Item 8) The information notification system according to item 7, wherein the task entrustment message extraction unit extracts the task entrustment message by searching for a message containing a specified keyword indicating movement to the specified location among the messages received by the message receiving unit.

[0110] The information notification system according to item 8 is capable of limiting the information to be notified to the user of the moving body to the information of the following tasks, and notifying the information of the tasks that the user is expected to execute during the return to the specified location while riding on the moving body.

[0111] (Item 9) The information notification system according to any one of items 1 to 8, wherein the information notification system has a passenger identification unit that identifies the passengers of the moving body, and when a passenger other than the driver of the moving body is identified by the passenger identification unit, the task delegation information notification unit prohibits the output device from outputting the content of the specified task.

[0112] The information notification system according to item 9 can prevent the co-riders of the moving body from knowing the content of the specified task.

[0113] (Item 10) The information notification system according to any one of items 1 to 7, wherein the information notification system has a task-related facility information providing unit that causes the output device to output information on facilities available for executing the specified task.

[0114] The information notification system according to item 10 can assist in the execution of the specified task by providing the user of the moving body with information on facilities available for executing the specified task.

[0115] (Item 11) The information notification system according to item 10, wherein the information notification system has a route guidance unit that causes the output device to output route guidance information for guiding the user to the facility.

[0116] The information notification system according to item 11 enables the moving body to easily move to the facility.

[0117] (Item 12) An information notification method executed by a computer, wherein the information notification method includes the following steps: a message receiving step of receiving a message sent to the moving body; a task delegation message extraction step of extracting a task delegation message from the message received in the message receiving step, the task delegation message delegating a specified task that the user of the moving body is expected to execute during the movement of the moving body; a user action recognition step of recognizing the action of the user of the moving body; and a task delegation information notification step of causing an output device used in the moving body to output the content of the specified task extracted in the task delegation message extraction step when an action that can estimate that the user gets off the moving body is recognized in the user action recognition step.

[0118] By means of the information notification method of item 12 executed by a computer, the same effects as those of the information notification system of item 1 above can be obtained.

Claims

1. An information notification system, comprising: A message receiving unit that receives messages sent to a moving body; A task delegation message extraction unit that extracts task delegation messages from the messages received by the message receiving unit, where the task delegation messages delegate a specified task that the user of the moving body is expected to perform during the movement of the moving body; A user action recognition unit that recognizes the actions of the user of the moving body; A task delegation information notification unit that, when the user action recognition unit recognizes an action that can estimate that the user is about to get off the moving body, causes an output device used in the moving body to output the content of the specified task extracted by the task delegation message extraction unit; And A task commitment intention recognition unit that recognizes the user's commitment intention to the specified task, When the task commitment intention recognition unit recognizes the user's commitment intention to the specified task and then the user action recognition unit recognizes an action that can estimate that the user is about to board the moving body, the task delegation information notification unit causes the output device to output the content of the specified task that is committed by the user as recognized by the task commitment intention recognition unit among the specified tasks entrusted by the task delegation message.

2. The information notification system according to claim 1, Wherein, The information notification system has a task commitment notification unit that, when the task commitment intention recognition unit recognizes the user's commitment intention to the specified task, sends a task commitment notification indicating that the specified task has been committed to the sender of the task delegation message.

3. The information notification system according to claim 1 or 2, Wherein, When the user action recognition unit recognizes an action that can estimate that the user is about to get off the moving body, the task delegation information notification unit only outputs the content of the specified task from the output device and prohibits the output of information related to messages other than the task delegation message from the output device.

4. The information notification system according to claim 1 or 2, Wherein, The task delegation message extraction unit extracts the task delegation messages received by the message receiving unit during the period from when the moving body departs from a specified location until the user action recognition unit recognizes an action that can estimate that the user is about to get off the moving body.

5. The information notification system according to claim 4, Wherein, The task delegation message extraction unit extracts the task delegation messages by searching for messages containing a specified keyword indicating movement to the specified location among the messages received by the message receiving unit.

6. The information notification system according to claim 1 or 2, Wherein, The information notification system has a passenger recognition unit that recognizes the passengers of the moving body, When the passenger recognition unit recognizes a passenger other than the driver of the moving body, the task delegation information notification unit prohibits the output of the content of the specified task from the output device.

7. The information notification system according to claim 1 or 2, wherein, the information notification system has a task-related facility information providing unit that causes the output device to output information on facilities available for performing the specified task.

8. The information notification system according to claim 7, wherein, the information notification system has a path guidance unit that causes the output device to output path guidance information for guiding to the facility.

9. An information notification method executed by a computer, wherein, the information notification method includes the following steps: a message receiving step of receiving a message sent to the mobile body; a task entrustment message extraction step of extracting a task entrustment message from the message received in the message receiving step, the task entrustment message entrusting a specified task that the user of the mobile body is desired to execute during the movement of the mobile body; a user action recognition step of recognizing the action of the user of the mobile body; a task entrustment information notification step of causing the output device used in the mobile body to output the content of the specified task extracted in the task entrustment message extraction step when it is recognized in the user action recognition step that an action in which the user is estimated to get off the mobile body is recognized; and a task commitment intention recognition step of recognizing the commitment intention of the user with respect to the specified task, when it is recognized in the task commitment intention recognition step that the user's commitment intention with respect to the specified task is recognized and then it is recognized in the user action recognition step that an action in which the user is estimated to board the mobile body is recognized, in the task entrustment information notification step, causing the output device to output the content of the specified task in the specified task entrusted by the task entrustment message and recognized by the user's commitment in the task commitment intention recognition step.

10. An information notification system having: a message receiving unit that receives a message sent to the mobile body; a task entrustment message extraction unit that extracts a task entrustment message from the message received by the message receiving unit, the task entrustment message entrusting a specified task that the user of the mobile body is desired to execute during the movement of the mobile body; a user action recognition unit that recognizes the action of the user of the mobile body; a task entrustment information notification unit that causes the output device used in the mobile body to output the content of the specified task extracted by the task entrustment message extraction unit when it is recognized by the user action recognition unit that an action in which the user is estimated to get off the mobile body is recognized; and a task commitment intention recognition unit that recognizes the commitment intention of the user, when it is recognized by the task commitment intention recognition unit that the user's commitment intention with respect to the specified task is recognized and then it is recognized by the user action recognition unit that an action in which the user is estimated to board the mobile body is recognized, the task entrustment information notification unit causes the output device to output the content of the specified task.

11. An information notification method executed by a computer, the information notification method includes the following steps: Message receiving step: receiving a message sent to the mobile body; Task delegation message extraction step: extracting a task delegation message from the message received in the message receiving step, where the task delegation message delegates a specified task that the user of the mobile body is expected to perform during the movement of the mobile body; User action recognition step: recognizing the actions of the user of the mobile body; Task delegation information notification step: when an action indicating that the user is expected to get off the mobile body is recognized in the user action recognition step, causing an output device used in the mobile body to output the content of the specified task extracted in the task delegation message extraction step in this task delegation information notification step; And Task commitment intention recognition step: recognizing the commitment intention of the user, When an action indicating that the user is expected to board the mobile body is recognized in the user action recognition step after the commitment intention of the user to the specified task is recognized in the task commitment intention recognition step, causing the output device to output the content of the specified task in the task delegation information notification step.

Images