Driving assistance system, driving assistance method, and recording medium

Abstract

The present invention increases countermeasures that can be taken when health abnormality occurs in a user on a moving body.　This driving assistance system comprises: an acquisition means that acquires an image of a user on a moving body; an estimation means that analyzes the image of the user and estimates the health condition of the user; and an adjustment means that adjusts a travel plan of the moving body on which the user is on board, on the basis of the health condition of the user.

Description

Driving Support System, Driving Support Method, and Recording Medium , ,

[0004] , ,

[0003] , ,

[0007] ,

[0002] ,

[0006] ,

[0001] , ,

[0005] ,

[0001] The present invention relates to a driving support system, a driving support method, and a recording medium.

[0002] Patent Document 1 discloses a display control device that can suppress motion sickness of a vehicle passenger. According to this document, this display control device determines whether the passenger is in a state of pre-motion sickness or a state of motion sickness based on vehicle information indicating the running state of the vehicle and the recognition result of the passenger from video data obtained by photographing the vehicle passenger. Then, when it is determined that the passenger is in a state of pre-motion sickness or a state of motion sickness, this display control device displays a horizontal image indicating horizontal on a display unit. Further, this document describes that when it is determined that the passenger is in a state of pre-motion sickness or a state of motion sickness, the driver is notified that the passenger is highly likely to have motion sickness and to drive without sudden acceleration or deceleration.

[0003] Japanese Unexamined Patent Application Publication No. 2021-115911

[0004] There are cases where a passenger of a moving body may feel unwell during movement. The display control device of Patent Document 1 focuses on motion sickness and performs display of a horizontal image or the like, but it is assumed that this is not a fundamental solution for a passenger who is unwell.

[0005] An object of the present disclosure is to provide a driving support system, a driving support method, and a recording medium that can contribute to enriching countermeasures when a health abnormality occurs to a user riding in a moving body.

[0006] According to a first aspect, there is provided a driving support system including an acquisition unit that acquires an image of a user riding in a moving body, an estimation unit that analyzes the image of the user and estimates the health state of the user, and an adjustment unit that adjusts a travel plan of the moving body on which the user is riding based on the health state of the user.

[0007] From a second perspective, a driving assistance method is provided that acquires an image of a user riding in a mobile vehicle, analyzes the user's image, estimates the user's health condition, and adjusts the driving plan of the mobile vehicle on which the user is riding based on the user's health condition.

[0008] From a third perspective, a recording medium is provided that contains a program that causes a computer to perform the following steps: acquiring an image of a user riding in a mobile vehicle; analyzing the user's image and estimating the user's health condition; and adjusting the travel plan of the mobile vehicle on which the user is riding based on the user's health condition.

[0009] According to this disclosure, it will be possible to provide a driver assistance system, a driver assistance method, and a recording medium that can enhance the options for dealing with health problems experienced by users riding in a mobile vehicle.

[0010] This is a diagram showing one configuration of the present disclosure. This is a flowchart illustrating the operation of the present disclosure. This is a diagram for explaining the operation of the present disclosure. This is another diagram for explaining the operation of the present disclosure. This is a diagram showing one configuration of the present disclosure. This is a functional block diagram showing the detailed configuration of the driver assistance system of the present disclosure. This is a diagram showing an example of a driving plan. This is a flowchart for explaining the operation of the present disclosure. This is a diagram showing an example of a adjusted driving plan. This is another example of an adjusted driving plan. This is a functional block diagram showing another configuration of the driver assistance system of the present disclosure. This is a flowchart for explaining the operation of the present disclosure. This is a diagram showing an example of a driving plan. This is an example of an adjusted driving plan. This is a diagram showing one configuration of the present disclosure. This is a diagram showing the configuration of the computers constituting the driver assistance system of the present disclosure.

[0011] First, an overview of one embodiment of this disclosure will be described with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. The reference numerals in the drawings appended to this overview are provided for convenience as examples to aid understanding and are not intended to limit this disclosure to the illustrated embodiments. In addition, the connecting lines between blocks in the drawings and other references referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as needed. This computer device is also configured to communicate with devices (including computers) inside or outside the device via the communication interface, whether wired or wireless. In addition, there are ports or interfaces at the input / output connection points of each block in the figures, but these are omitted from the illustration.

[0012] In one embodiment, this disclosure can be realized by a driving assistance system 10 comprising an acquisition means 11, an estimation means 12, and an adjustment means 13, as shown in Figure 1. More specifically, the acquisition means 11 acquires an image of a user riding in a mobile vehicle. The estimation means 12 analyzes the user's image and estimates the user's health condition. The adjustment means 13 adjusts the driving plan of the mobile vehicle in which the user is riding based on the user's health condition.

[0013] The driver assistance system 10 configured as described above operates as follows. First, the driver assistance system 10 acquires an image of a user riding in the vehicle (step S01 in Figure 2). The image of the user riding in the vehicle can be acquired, for example, from a camera mounted on the vehicle or a camera capable of photographing the vehicle while it is moving. The user may be a person sitting in the front passenger seat or a person sitting in the back seat. If the vehicle is a bus or the like, the user will be a passenger, and will include both standing and seated passengers. If the vehicle is an autonomous vehicle, the user will also include the person sitting in the driver's seat.

[0014] Next, the driver assistance system 10 analyzes the user's image and estimates the user's health status (step S02 in Figure 2). This health status can be estimated by obtaining vital information from the skin color and subtle movements of the person in the image.

[0015] Next, the driver assistance system 10 adjusts the driving plan of the vehicle in which the user is riding, based on the user's health condition (step S03 in Figure 2).

[0016] Figure 3 is a diagram illustrating the operation of the present disclosure. Figure 3 shows the travel plan when a vehicle V moves from point A to point B as a moving object. The table in the lower left of Figure 3 shows the initial travel plan. According to it, the travel plan for vehicle V is to depart from point A at 9:00 AM and arrive at point B at 10:00 AM.

[0017] Based on the estimation of the user's health condition as described above, if the user's health condition is poor, the driving assistance system 10 modifies the driving plan to stop at store P along the way. As a result, vehicle V departs from point A at 9:00 AM, stops at store P along the way for a 10-minute break, departs from store P at 9:40 AM, and arrives at point B at 10:10 AM.

[0018] By doing so, it becomes possible to provide users who appear to be in poor health with an opportunity to take a break, even if they do not report it to those around them or the driver.

[0019] Figure 4 is another diagram illustrating the operation of the present disclosure. In the example in Figure 4, stores P1 and P2 are located between point A and point B. The table in the lower left of Figure 3 shows the initial travel plan. According to this plan, vehicle V is scheduled to depart from point A at 9:00 AM, stop at store P2 at 9:30 AM, and then arrive at point B.

[0020] Based on the estimation of the user's health condition as described above, if the user's health condition is poor, the driving support system 10 will adjust the driving plan to bring the break earlier and stop at store P1, which is closer to point A than store P2. As a result, vehicle V departs point A at 9:00 AM, stops at store P1 at 9:15 AM for a 10-minute break, departs store P1 at 9:25 AM, and arrives at point B at 10:00 AM.

[0021] As described above, this disclosure adjusts the travel plan by changing rest stops. This makes it possible to provide users who are suspected to be in poor health with the opportunity to rest as soon as possible. Furthermore, as shown in Figures 3 and 4, this disclosure can be configured to adjust the rest time or rest location during the travel plan of the mobile vehicle (V) based on the user's health condition.

[0022] [First Embodiment] Next, a first embodiment will be described in which the driver assistance system 100 is located on the network side and adjusts the driving plan of the bus B as a mobile entity. Figure 5 is a diagram showing one configuration of the present disclosure. Referring to Figure 5, a configuration is shown that includes a bus B equipped with a camera C, a driver assistance system 100 that receives images from inside the bus B and adjusts the driving plan to assist in driving the bus B, and a road condition management server 200 that manages road conditions.

[0023] Bus B is equipped with a camera C that takes pictures of the interior of Bus B and transmits images of the interior of Bus B to the driver assistance system 100. Bus B has a function to drive according to a driving plan. Bus B may be an autonomous vehicle or a manually driven vehicle. In this case, the driving plan may take the form of route information to the destination set in the car navigation system.

[0024] On the other hand, if bus B is an autonomous vehicle, bus B (autonomous vehicle) will drive autonomously according to a driving plan received from outside the vehicle or decided inside the vehicle. The driver assistance system 100 may also have a function to control bus B (autonomous vehicle) to drive according to the driving plan.

[0025] The road condition management server 200 manages road conditions and provides them to the driver assistance system 100. This road condition information includes details about rest stops located within the bus B's travel area and road congestion. The road condition management server 200 can also be a server that manages dynamic maps. Rest stops include highway service areas, parking areas, drive-ins, large parking lots, and large stores with parking facilities.

[0026] Figure 6 is a functional block diagram showing the detailed configuration of the driver assistance system 100. Referring to Figure 6, the system is configured to include an acquisition unit 101, an estimation unit 102, a road condition acquisition unit 103, a driving plan adjustment unit 104, a driving plan storage unit 105, and a transmission unit 106. The driver assistance system 100 also functions as a type of driving plan adjustment system that adjusts the driving plan of bus B.

[0027] The acquisition unit 101 acquires images of the interior of bus B from bus B. This acquisition unit 101 corresponds to the acquisition means 11 described above.

[0028] The estimation unit 102 analyzes images of the interior of bus B, estimates the health status of the people (passengers) in the images, and sends this information to the driving plan adjustment unit 104. The people (passengers) whose health status is estimated may be those sitting in specific seats that are in a favorable position for health status estimation. Alternatively, the estimation unit 102 may estimate the health status of all people (passengers) in the images and send the health status of the person (passenger) with the worst health status to the driving plan adjustment unit 104.

[0029] Furthermore, a person's health status can be estimated by taking vital signs from the skin color and subtle movements of the person in the image. Examples of such vital signs include respiratory rate, pulse rate, and oxygen saturation (SpO2). Hereinafter, these will be collectively referred to as "vital information." Respiratory rate can be measured by extracting periodic subtle movements from an image of a person over a certain period. Pulse rate can be measured by extracting changes in the brightness value of a specific color that appears in an image of a person's skin over a certain period. Oxygen saturation can be measured by extracting changes in a specific red component that appears in an image of a person's skin over a certain period. These are just examples of items measured as vital signs, and other items can also be added to the measurement targets. For example, concentration level, stress level, and alertness level can be added to the measurement targets based on facial expressions and eye movements. This estimation unit 102 corresponds to the estimation means 12 described above.

[0030] The road condition acquisition unit 103 acquires road conditions for the area in which bus B is traveling from the road condition management server 200. When the road condition acquisition unit 103 acquires road conditions from the road condition management server 200, it may also transmit information about the bus's travel plan and prescribed route, and request road conditions for areas necessary for adjusting the travel plan. This road condition acquisition unit 103 corresponds to the road condition acquisition means.

[0031] The driving plan adjustment unit 104 adjusts the driving plan of bus B based on the road conditions along the route of bus B and the health condition of the passengers. More specifically, if the driving plan adjustment unit 104 finds a passenger who is in poor health, it retrieves the driving plan of bus B stored in the driving plan storage unit 105 and adjusts the driving plan based on its contents and the road conditions. In addition, when adjusting the driving plan, the driving plan adjustment unit 104 can also change the driving course in the driving plan of bus B based on the road conditions to the destination of bus B and the health condition of the user. This driving plan adjustment unit 104 corresponds to the adjustment means 13 described above.

[0032] The travel plan storage unit 105 stores the travel plan set for each bus. Figure 7 shows an example of a travel plan set for bus B. In the example in Figure 7, the travel course from the departure point S to the destination G, passing through an area with continuous curves such as a mountainous region, is shown by a dashed line.

[0033] The transmission unit 106 transmits the travel plan adjusted by the travel plan adjustment unit 104 to bus B.

[0034] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 8 is a flowchart illustrating the operation of this disclosure. Referring to Figure 8, first, the driver assistance system 100 acquires an image of the interior of the bus B (step S001). In the following description, it will be assumed that the bus B is traveling just before point A in Figure 7.

[0035] Next, the driver assistance system 100 analyzes the acquired images to estimate the passenger's health condition (step S002).

[0036] Next, the driver assistance system 100 determines whether or not there are any passengers in poor health (step S003). If no passengers in poor health are found (No. in step S003), no adjustment to the driving plan is necessary, and the system returns to step S001.

[0037] If a passenger in poor health is found in step S003 (Yes in step S003), the driver assistance system 100 obtains road conditions from the road condition management server 200 (step S004).

[0038] Next, the driver assistance system 100 searches for an alternative route by referring to the road conditions obtained from the road condition management server 200 (step S005). Specifically, the driver assistance system 100 refers to the road congestion status and available rest areas to determine whether it is possible to set a route that allows passengers in poor health to rest or a route that is desirable for passengers in poor health.

[0039] If, as a result of the search, an alternative route cannot be set (No in step S006), the travel plan cannot be adjusted, and the process returns to step S001. On the other hand, if, as a result of the search, an alternative route can be set (Yes in step S006), the driving support system 100 transmits the route searched in step S005 to bus B as the travel plan (step S007).

[0040] Figure 9 shows an example of a travel plan set in step S005 above. In the example in Figure 9, an alternative route AR is set to avoid an area with a series of curves. By switching to such a route, it is possible to prevent passengers with poor health from becoming even more ill.

[0041] Figure 10 shows another example of the driving plan set in step S005 above. In the example in Figure 10, an alternative route AR is set that avoids areas with a series of curves and includes a stop at a parking area (PA). By switching to such a route, it becomes possible to allow passengers who are unwell to rest at the parking area (PA).

[0042] As explained above, this embodiment allows for monitoring the health of bus passengers, and if any passengers become unwell, it is possible to promptly change the route or set up stops.

[0043] [Second Embodiment] Next, a second embodiment will be described in which a function for analyzing the direction of the passenger's gaze is added to the driver assistance system 100. Figure 11 is a functional block diagram showing the configuration of the driver assistance system 100a of this disclosure. The first difference from the driver assistance system 100 of the first embodiment shown in Figure 6 is that a gaze direction estimation unit 107 is added to the driver assistance system 100a. The second difference from the driver assistance system 100 of the first embodiment is that the driving plan adjustment unit 104a determines whether or not to set an alternative route using the gaze direction estimated by the gaze direction estimation unit 107 in addition to the passenger's vital information. The other configurations are almost the same as in the first embodiment, so the differences in operation will be explained below.

[0044] The gaze direction estimation unit 107 estimates the direction (gaze direction) in which a person (passenger) shown in an image inside the bus B is gazing, and sends it to the travel plan adjustment unit 104a. At that time, the gaze direction estimation unit 107 may estimate the gaze directions of a plurality of persons (passengers) and send them to the travel plan adjustment unit 104a. Further, the gaze direction estimation unit 107 may estimate the gaze direction of the person (passenger) specified from the estimation unit 102 and send it to the travel plan adjustment unit 104a. This gaze direction estimation unit 107 corresponds to the gaze direction estimation means.

[0045] In addition to adjusting the travel plan based on the road conditions on the route of the bus B and the health state of the passengers, the travel plan adjustment unit 104a adjusts the travel plan of the moving body based on the gaze direction of the health state of the passengers and the course on which the bus B is traveling. More specifically, when the travel plan adjustment unit 104a discovers a passenger whose gaze direction is different from that of other passengers, it retrieves the travel plan of the bus B stored in the travel plan storage unit 105, and adjusts the travel plan based on the content thereof and the road conditions. More specifically, first, the travel plan adjustment unit 104a takes into account the presence of landmarks, tourist spots, etc. on the road on the route of the bus B, and discovers a passenger whose gaze direction is different from that of other passengers. For example, when the bus B is traveling near a landmark or a tourist spot, it is considered that many passengers gaze in the direction of the landmark or the tourist spot. Nevertheless, if a certain passenger is not gazing in that direction, it is considered that the passenger is not enjoying the trip for some reason. Therefore, the travel plan adjustment unit 104a regards the behavior of such a passenger as abnormal, and adjusts the travel plan so as to change the rest on the travel plan of the bus B or change the travel course.

[0046] Subsequently, the operation of the present embodiment will be described in detail with reference to the drawings. FIG. 12 is a flowchart for explaining the operation of the present disclosure. The acquisition of the image inside the vehicle in FIG. 12 and the process of estimating the health state of the passengers from the image are the same as those in the first embodiment.

[0047] Next, the driving support system 100a estimates the gaze direction of the passengers from the image inside the bus B (step S101).

[0048] Next, the driving support system 100a determines whether there is a passenger in poor health or a passenger who is not enjoying the journey (step S102). If no passenger in poor health or with a different line of sight is found (No in step S102), since adjustment of the driving plan is unnecessary, the process returns to step S001. A passenger who is not enjoying this journey can be detected by, for example, whether their line of sight is different from that of other passengers or whether they are not facing the direction of a landmark or tourist attraction.

[0049] In step S102, if a passenger in poor health or a passenger who is not enjoying the journey is found (Yes in step S103), the driving support system 100a acquires the road conditions from the road condition management server 200 (step S004). Then, the driving support system 100a searches for an alternative route by referring to the road conditions acquired from the road condition management server 200 (step S005). Since the subsequent operations are the same as those in the first embodiment, the description thereof is omitted.

[0050] FIG. 13 is a diagram for explaining the operation of this embodiment. As shown in FIG. 13, the bus B departs from the departure point S, and a driving course that reaches the destination G through the tourist spot L and an area with continuous curves on the way is indicated by a dashed line. For example, when passing through this tourist spot L, if a certain passenger is not looking at the tourist spot L, it is presumed that the passenger is not enjoying the journey.

[0051] FIG. 14 is an example of a driving plan after adjustment of the driving plan of the driving support system 100a. In the example of FIG. 14, since passengers with different lines of sight are found at the tourist spot L, an alternative route AR that detours to the parking area PA for a break is set. By switching to such a route, in addition to passengers in poor health, passengers who are presumed not to be enjoying the journey can be given an opportunity to change their mood.

[0052] As explained above, according to this embodiment, in addition to the health status of the passengers on bus B, if there are passengers who are not enjoying the trip, it is possible to quickly respond by changing the route or setting up stops. In the flowchart of Figure 12, the driver support system 100a estimates the passengers' health status and then their gaze direction, but these orders can be reversed. Furthermore, the health status estimation process and the gaze direction estimation process may be performed in parallel.

[0053] [Third Embodiment] In the first and second embodiments described above, the driver assistance systems 100 and 100a were described as being located on a network, but the driver assistance systems 100 and 100a may be mounted on the bus B (mobile vehicle). Figure 15 is a diagram showing one configuration of the present disclosure. As shown in Figure 15, the driver assistance system 100b can be located on the bus B side. In this case, the driver assistance system 100b will receive road conditions from the road condition management server 200 via the network. Furthermore, the functions of such a driver assistance system 100b can also be realized as a function of a car navigation system. For example, the driver assistance system 100b analyzes images of passengers on the bus B and estimates their health condition. The driver assistance system 100b then adjusts the driving plan of the bus B based on the health condition of the passengers. As part of the adjustment of the driving plan, the driver assistance system 100b will perform operations similar to a car navigation system, such as changing the route to the destination and suggesting rest stops.

[0054] While the embodiments of this disclosure have been described above, this disclosure is not limited to the embodiments described above, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of this disclosure. For example, the network configurations, element configurations, and data representations shown in the drawings are examples to aid in understanding this disclosure and are not limited to the configurations shown in these drawings.

[0055] For example, in the first to third embodiments described above, the mobile vehicle was explained using the example of a bus B, but the mobile vehicle may be something other than a bus B. For example, the mobile vehicle may be a taxi or a private passenger car. Furthermore, the mobile vehicle does not have to be a land vehicle; for example, it may be a ship or an aircraft. For example, if this disclosure is applied to a sightseeing boat, the driver assistance system will estimate the health status of passengers in the cabin and adjust the travel plan, such as changing ports of call.

[0056] (Hardware Configuration) In each embodiment of this disclosure, each component of each device represents a functional unit block. Some or all of each component of each device is realized by any combination of an information processing device 900 and a program, for example, as shown in Figure 16. Figure 16 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: ・CPU (Central Processing Unit) 901 ・ROM (Read Only Memory) 902 ・RAM (Random Access Memory) 903 ・Program 904 loaded into RAM 903 ・Storage device 905 that stores the program 904 ・Drive device 907 that reads and writes to the recording medium 906 ・Communication interface 908 that connects to a communication network 909 ・Input / output interface 910 that performs data input and output ・Bus 911 that connects each component

[0057] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes these functions. That is, the CPU 901 in Figure 16 executes a health status estimation program and a driving plan adjustment program, and performs update processing of each calculation parameter held in RAM 903, storage device 905, etc. The program 904 that realizes the functions of each component of each device is, for example, stored in storage device 905 or ROM 902 in advance and read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via a communication network 909, or it may be stored in a recording medium 906 in advance, and the drive device 907 may read the program and supply it to the CPU 901.

[0058] There are various variations in how each device is implemented. For example, each device may be implemented by any combination of a separate information processing device 900 and a program for each component. Alternatively, multiple components of each device may be implemented by any combination of a single information processing device 900 and a program. That is, each part (processing means, function) of the above-described driving support systems 100 to 100b can be implemented by a computer program that causes a processor mounted on the device to execute the above-described processes using its hardware.

[0059] Furthermore, some or all of the components of each device are realized by other general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be made up of a single chip or multiple chips connected via a bus.

[0060] Some or all of the components of each device may be realized by a combination of the circuits and programs described above.

[0061] When some or all of the components of each device are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-and-server system or a cloud computing system.

[0062] The embodiments described above are preferred embodiments of this disclosure and do not limit the scope of this disclosure to these embodiments alone. That is, a person skilled in the art can modify or substitute the embodiments described above to construct various modified forms without departing from the gist of this disclosure.

[0063] Some or all of the above embodiments may also be described as follows, but are not limited to these.

[0064] [Note 1] A driving support system comprising: acquisition means for acquiring an image of a user riding in a mobile vehicle; estimation means for analyzing the user's image and estimating the user's health condition; and adjustment means for adjusting the driving plan of the mobile vehicle on which the user is riding based on the user's health condition. [Note 2] The adjustment means of the above-described driving support system may be configured to adjust rest times or rest locations during the driving plan of the mobile vehicle based on the user's health condition. [Note 3] The above-described driving support system further comprises: road condition acquisition means for acquiring road conditions along the path of the mobile vehicle; and the adjustment means may be configured to adjust the driving plan of the mobile vehicle based on the road conditions along the path of the mobile vehicle and the user's health condition. [Note 4] The adjustment means of the above-described driving support system may be configured to change the driving course during the driving plan of the mobile vehicle based on the road conditions to the destination of the mobile vehicle and the user's health condition. [Note 5] The above-described driving assistance system further includes a gaze direction estimation means for estimating the gaze direction of a user riding in the mobile vehicle, and the adjustment means can be configured to adjust the driving plan of the mobile vehicle based on the gaze direction and the course the mobile vehicle is traveling on. [Note 6] A driving assistance method that acquires an image of a user riding in a mobile vehicle, analyzes the image of the user to estimate the user's health condition, and adjusts the driving plan of the mobile vehicle in which the user is riding based on the user's health condition. [Note 7] A recording medium that stores a program causing a computer to execute a process for acquiring an image of a user riding in a mobile vehicle, a process for analyzing the image of the user to estimate the user's health condition, and a process for adjusting the driving plan of the mobile vehicle in which the user is riding based on the user's health condition. The forms described in each of the above notes can be combined with each other after making the necessary modifications. For example, a configuration that combines the contents of Note 2 and the contents of Note 3 is also included in the scope of disclosure of this specification.In this case, the driver assistance system will adjust the rest time or rest location during the vehicle's travel plan based on the user's health condition, and will also adjust the vehicle's travel plan taking into account the road conditions along the route. Note that the forms described in appendices 6 to 7 above can be expanded to the forms described in appendices 2 to 5, similar to appendice 1.

[0065] Furthermore, each disclosure in the above-mentioned patent documents is incorporated into this document by reference and may be used as the basis or part of this disclosure as necessary. Within the framework of this disclosure (including the claims), further modifications and adjustments to the embodiments or examples are possible based on their fundamental technical concept. Also, within the framework of this disclosure, various combinations or selections (including partial deletions) of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, this disclosure naturally includes the entire disclosure, including the claims, and various modifications and alterations that a person skilled in the art could make in accordance with the technical concept. In particular, with respect to the numerical ranges described in this document, any numerical value or sub-range included within that range should be interpreted as being specifically described, even if not otherwise stated. Furthermore, each disclosure item of the above-mentioned cited documents may, as necessary, be used in part or in whole as part of this disclosure, in accordance with the spirit of this disclosure, and this is also considered to be included in the disclosure items of this application.

[0066] 10 Driving support system 11 Acquisition means 12 Estimation means 13 Adjustment means 100, 100a, 100b Driving support system 101 Acquisition unit 102 Estimation unit 103 Road condition acquisition unit 104, 104a Driving plan adjustment unit 105 Driving plan storage unit 106 Transmission unit 107 Gaze direction estimation unit 200 Road condition management server 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / output interface 911 Bus A, B Location AR Alternative Route B Bus G Destination P, P1, P2 Store PA Parking Area S Departure Point V Vehicle

Claims

1. A driving assistance system comprising: acquisition means for acquiring an image of a user riding in a mobile vehicle; estimation means for analyzing the user's image and estimating the user's health condition; and adjustment means for adjusting the driving plan of the mobile vehicle on which the user is riding based on the user's health condition.

2. The driving support system according to claim 1, wherein the adjustment means adjusts the rest time or rest location during the driving plan of the mobile body based on the user's health condition.

3. The driving support system according to claim 1 or 2, further comprising road condition acquisition means for acquiring road conditions along the path of the moving body, wherein the adjustment means adjusts the driving plan of the moving body based on the road conditions along the path of the moving body and the user's health condition.

4. The driving assistance system according to claim 3, wherein the adjustment means changes the driving course of the mobile body during its driving plan based on the road conditions to the destination of the mobile body and the health condition of the user.

5. A driving assistance system according to any one of claims 1 to 4, further comprising a gaze direction estimation means for estimating the gaze direction of a user riding in the mobile vehicle, wherein the adjustment means adjusts the driving plan of the mobile vehicle based on the gaze direction and the course the mobile vehicle is traveling on.

6. A driving assistance method comprising: acquiring an image of a user riding in a mobile vehicle; analyzing the user's image; estimating the user's health condition; and adjusting the driving plan of the mobile vehicle on which the user is riding based on the user's health condition.

7. A recording medium that contains a program that causes a computer to perform the following: a process of acquiring an image of a user riding in a mobile vehicle; a process of analyzing the user's image and estimating the user's health condition; and a process of adjusting the travel plan of the mobile vehicle on which the user is riding based on the user's health condition.

Images