Information processing device, information processing method, and recording medium

Abstract

An information processing device according to the present disclosure comprises a detection unit, a notification unit, an acquisition unit, and a notification control unit. The detection unit detects a notification event occurring in a mobile body. The notification unit gives notification of the detection of the notification event. The acquisition unit acquires status information indicating a status of the mobile body. The notification control unit changes at least one of a notification method and notification content for giving notification of the detection of the notification event depending on the status of the mobile body.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] A technology related to this disclosure is disclosed in Patent Document 1. Patent Document 1 discloses a technology for detecting an abnormality occurring inside a vehicle and notifying the driver of the abnormality. This technology changes the timing of outputting the notification depending on the driving situation of the vehicle. Specifically, if a low-urgency abnormality is detected during a lane change, this technology notifies the driver after the lane change is completed. Furthermore, if a high-urgency abnormality is detected during a lane change, this technology immediately notifies the driver.

[0003] International Publication No. 2022 / 269697

[0004] There is a technology that detects a predetermined event (such as a person falling) that occurs on a moving object such as a bus and notifies a predetermined notified person. In this technology, for example, a driver who is "driving" is notified. When notifying a notified person who is performing such an operation that requires attention (such as driving), it is necessary to provide an appropriate notification according to the situation at the time.

[0005] For example, the technology disclosed in Patent Document 1 changes the "timing" of notification output depending on the driving situation of the vehicle. This technology allows notifications to be issued at appropriate timing depending on the situation at the time. However, there are cases where controlling the notification timing alone is insufficient.

[0006] An example of an objective of this disclosure is to provide a technology for making an appropriate notification in response to the detection of a predetermined event occurring in a mobile object.

[0007] According to this disclosure, an information processing device is provided that has: a detection means for detecting a notification event that occurs in a mobile body; a notification means for notifying the detection of the notification event; an acquisition means for acquiring status information indicating the status of the mobile body; and a notification control means for changing at least one of the notification method and notification content in the notification depending on the status of the mobile body.

[0008] This disclosure also provides an information processing method in which one or more computers detect a notification event that occurs in a mobile object, notify the detection of the notification event, obtain status information indicating the status of the mobile object, and change at least one of the notification method and notification content in the notification depending on the status of the mobile object.

[0009] Furthermore, according to this disclosure, a program is provided that causes a computer to function as: a detection means for detecting a notification event that occurs in a mobile body; a notification means for notifying the detection of the notification event; an acquisition means for acquiring status information indicating the status of the mobile body; and a notification control means for changing at least one of the notification method and notification content in the notification depending on the status of the mobile body.

[0010] According to one aspect of the present disclosure, a technique is realized for providing an appropriate notification in response to the detection of a predetermined event occurring in a mobile object.

[0011] FIG. 1 is a diagram illustrating an example of a functional block diagram of an information processing device. FIG. 2 is a flowchart illustrating an example of a processing flow of the information processing device. FIG. 3 is a diagram illustrating an example of a hardware configuration of the information processing device. FIG. 4 is a diagram illustrating an example of information output by the information processing device. FIG. 5 is a diagram illustrating another example of information output by the information processing device. FIG. 6 is a diagram illustrating another example of information processed by the information processing device. FIG. 7 is a diagram illustrating another example of information processed by the information processing device.

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0013] First Embodiment Fig. 1 is a functional block diagram showing an overview of an information processing device 10. Fig. 2 is a flowchart showing an example of the flow of processing executed by the information processing device 10.

[0014] 1, the information processing device 10 includes a detection unit 11, a notification unit 12, an acquisition unit 13, and a notification control unit 14. These functional units execute the process of the flowchart in FIG.

[0015] In S10, the detection unit 11 detects a notifiable event that has occurred in the mobile object. In S11, the acquisition unit 13 acquires status information indicating the status of the mobile object. In S12, the notification control unit 14 determines at least one of the notification method and the notification content based on the status of the mobile object indicated by the status information. The notification control unit 14 changes at least one of the notification method and the notification content depending on the status of the mobile object indicated by the status information. In S13, the notification unit 12 notifies the detection of the notifiable event in the manner determined in S12.

[0016] In this way, the information processing device 10 can detect a notifiable event that occurs in a mobile object and notify the detection of the notifiable event. The information processing device 10 can change at least one of the "notification method" and "notification content" in the notification depending on the status of the mobile object.

[0017] According to the information processing device 10, in response to the detection of a predetermined event occurring in a mobile object, it is possible to issue a notification in an appropriate manner or with appropriate content according to the status of the mobile object.

[0018] <<Second Embodiment>> <Overview> A processing device 10 according to a second embodiment is a specific implementation of the configuration of the information processing device 10 according to the first embodiment. A detailed description will be given below.

[0019] <Hardware Configuration> First, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the realization method and device. The software includes programs that are pre-stored in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0020] FIG. 3 is a block diagram illustrating an example of the hardware configuration of an information processing device 10. As shown in FIG. 3, the information processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The information processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the information processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0021] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a central processing unit (CPU) or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, and touch panel. Examples of output devices include a display, projection device, speaker, printer, and mailer. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0022] <Functional Configuration> Next, a detailed description will be given of the functional configuration of the information processing device 10. Fig. 1 shows an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has a detection unit 11, a notification unit 12, an acquisition unit 13, and a notification control unit 14.

[0023] The detection unit 11 detects a notifiable event that has occurred in a mobile object. The detection unit 11 detects the notifiable event based on at least one of an image captured inside the mobile object and a sound collected inside the mobile object.

[0024] A "mobile body" is a vehicle that carries people. A mobile body may be a vehicle that moves on land. Examples of such mobile bodies include, but are not limited to, vehicles that move on land, such as buses, trains, large vehicles, and automobiles. A mobile body may also be a vehicle that moves on or in water. Examples of such mobile bodies include, but are not limited to, ships and yachts. A mobile body may also be a vehicle that moves in the air. Examples of such mobile bodies include, but are not limited to, airplanes.

[0025] At least one of a camera that captures images of the interior of the moving body and a microphone that collects sound from inside the moving body is installed in the moving body. The number of cameras installed in the moving body may be one or more. The installation position and orientation of the camera are various, and any configuration can be adopted, but it is preferable to install the camera so that there are no blind spots. Furthermore, the number of microphones installed in the moving body may be one or more. The installation position and orientation of the camera are various, and any configuration can be adopted.

[0026] Hereinafter, an image captured inside a moving object may be referred to as an "internal image." Also, sound collected inside a moving object may be referred to as an "internal sound."

[0027] A "notifiable event" is an event that should be notified to a specified notified party. "Notified parties" include at least one of the driver, workers other than the driver, and passengers. A worker other than the driver may be a person who rides with the mobile vehicle and assists in the operation of the mobile vehicle. Alternatively, a worker other than the driver may be a person who does not ride with the mobile vehicle but monitors the status of the mobile vehicle at another location, such as a monitoring center.

[0028] An event that can be identified by analyzing at least one of the internal image and the internal sound is predetermined as a notification event. For example, at least one of the following may be predetermined as a notification event. Note that the following notification events are merely examples and are not limited to these.

[0029] ・A person falling over ・A person standing up from their seat while the vehicle is moving ・An elderly person (a person whose age is above a certain threshold) standing up from their seat while the vehicle is moving ・A pregnant woman standing up from her seat while the vehicle is moving ・A child (a person whose age is below a certain threshold) standing up from their seat while the vehicle is moving ・A person crouching ・A person lying down ・A person raising their hand ・An argument ・Leaving something behind (forgotten something) ・A person staying behind after arriving at the final destination

[0030] The detection unit 11 can detect the occurrence of a notification event using any well-known image analysis technique and sound analysis technique.

[0031] For example, the detection unit 11 can detect a person in a moving object using person detection technology. Furthermore, the detection unit 11 can detect predetermined postures, such as a person crouching, a person lying down, or a person raising their hand, using posture estimation technology such as OpenPose or MMPose. Furthermore, the detection unit 11 can detect predetermined behaviors, such as a person falling, a person standing up, a person crouching, a person lying down, or a person raising their hand, using behavior recognition technology based on posture estimation technology. Furthermore, the detection unit 11 can estimate a person's age, gender, status (pregnancy status, etc.), etc., using attribute estimation technology that estimates a person's attributes from the appearance of the face, body, etc. Furthermore, the detection unit 11 can detect the occurrence of a predetermined event, such as an argument, based on the volume of the voice, the content of the speech, the speaker's emotions, etc. The detection unit 11 can estimate the speaker's emotions, for example, using emotion analysis technology that analyzes the speaker's emotions from the voice. Furthermore, the detection unit 11 can convert the speech content into text using speech recognition and interpret the speech content using techniques such as syntactic analysis. Furthermore, the detection unit 11 can detect things such as being left behind by using an object detection technique or a technique for estimating the relationship between a person and an object.

[0032] The acquisition unit 13 acquires status information indicating the status of the mobile object. The acquisition unit 13 can acquire status information indicating the status of the mobile object at that time in response to the detection of a notifiable event that has occurred in the mobile object by the detection unit 11. Note that the acquisition unit 13 may acquire status information at other times.

[0033] The acquisition unit 13 can acquire situation information relating to the state of the mobile body, the driving details of the driver, etc., from, for example, sensors, ECUs (Electronic Control Units), and other devices (navigation systems, etc.) installed in the mobile body. Examples of sensors include, but are not limited to, position sensors such as GPS (Global Positioning System) sensors, sensors that detect the speed and acceleration of the mobile body, sensors that detect the state of the steering wheel (total steering angle), and brake pedal stroke sensors.

[0034] The acquisition unit 13 can also acquire situation information indicating the identified situation inside the vehicle by analyzing the internal image and internal sound.

[0035] Furthermore, the acquisition unit 13 can acquire status information related to the traveling of the mobile object stored in advance in a predetermined storage device. The predetermined storage device may be provided within the information processing device 10 or may be provided in a device external to the information processing device 10. For example, in the case of a mobile object that travels along a predetermined route, such as a bus, the traveling route is determined in advance. Such predetermined status information related to the traveling of the mobile object may be stored in advance in the predetermined storage device.

[0036] The status information may include, for example, at least one of the following: Note that the status information below is merely an example and is not limited to the examples given here.

[0037] - Information indicating the location inside the mobile body where the notification event occurred - Information indicating the location of the mobile body - Information indicating the future driving route of the mobile body - Information indicating the condition of the road at the current location of the mobile body - Information indicating the condition of the road along which the mobile body will travel in the future - Information indicating the current driving condition of the mobile body - Information about passengers - Information about passengers who are involved in the notification event

[0038] The "information indicating the location where the notification event occurred inside the mobile object" is generated by analyzing the internal image and internal sound. For example, the acquisition unit 13 can identify the location where the notification event occurred inside the mobile object based on the internal image and internal sound.

[0039] In one example, information indicating the photographing area of ​​each camera that photographs the interior of the moving body is registered in advance in the information processing device 10. Based on the information, the acquisition unit 13 identifies the photographing area of ​​the camera that generated the internal image in which the notifiable event was detected. Then, the acquisition unit 13 generates situation information indicating the "identified photographing area" as the location inside the moving body where the notifiable event occurred.

[0040] Alternatively, objects that can serve as landmarks inside the moving body may be registered in advance in the information processing device 10 in association with positions inside the moving body. In this case, the acquisition unit 13 can detect landmarks within the internal image in which the notifiable event is detected. Then, the acquisition unit 13 can generate situation information indicating "the internal position of the moving body associated with the detected landmark" as the position inside the moving body where the notifiable event occurred.

[0041] Additionally, when the notifiable event is an argument, the acquisition unit 13 can estimate the sound source position of utterances related to the argument using a sound source position estimation technique. Then, the acquisition unit 13 can generate situation information indicating the "estimated sound source position" as the position inside the mobile body where the notifiable event occurred. With the sound source position estimation technique, the sound source position is identified based on, for example, the ratio of the audio volumes of predetermined utterances related to the argument detected by each of multiple microphones.

[0042] The "information indicating the position of the mobile object" is generated using a position sensor that acquires position information, such as a GPS sensor, installed on the mobile object. For example, the acquisition unit 13 can acquire situation information indicating the position of the mobile object from the position sensor.

[0043] The "information indicating the future travel route of the mobile object" is generated based on the travel route of the mobile object and the current position of the mobile object.

[0044] First, the acquisition unit 13 acquires information indicating the travel route of the mobile object. In one example, as described above, the travel route of the mobile object is registered in advance in a predetermined storage device. The acquisition unit 13 can acquire the information indicating the travel route of the mobile object from the storage device. Alternatively, the acquisition unit 13 may acquire information indicating the travel route of the mobile object set at that time from a navigation system installed in the mobile object.

[0045] The acquisition unit 13 also acquires information indicating the current position of the mobile object from a position sensor installed in the mobile object.

[0046] Then, based on information indicating the traveling route of the mobile body and information indicating the current position of the mobile body, the acquisition unit 13 can generate information indicating the traveling route from the current position onwards as status information indicating the future traveling route of the mobile body.

[0047] The "information indicating the road conditions at the current position of the mobile object" is generated based on the current position of the mobile object and map information.

[0048] First, the acquisition unit 13 acquires map information. The map information indicates road conditions. The road conditions indicate straight lines, curves, the size of the curve (such as the radius of curvature), the slope (gradient), the degree of slope (slope angle), the width of the road, the pavement condition, the location of traffic lights, the location of bus stops, etc. The map information may be registered in advance in the information processing device 10. The acquisition unit 13 may then acquire the map information registered in advance in the information processing device 10. Alternatively, the acquisition unit 13 may acquire map information from an external device.

[0049] The acquisition unit 13 also acquires information indicating the current position of the mobile object from a position sensor installed in the mobile object.

[0050] The acquisition unit 13 then acquires, from the map information, information indicating the condition of the road at the current position of the mobile object as condition information.

[0051] The "information indicating the condition of the road along which the mobile object will travel in the future" is generated based on the travel route of the mobile object, the current position of the mobile object, and map information.

[0052] First, the acquisition unit 13 acquires information indicating the travel route of the mobile object, map information, and information indicating the current position of the mobile object. An example of how to acquire these information has been described above, so a description thereof will be omitted here.

[0053] The acquisition unit 13 then acquires, from the map information, information indicating the condition of roads along the future travel route of the mobile object as situation information.

[0054] The "information indicating the current traveling status of the mobile object" is generated based on information acquired from sensors, ECUs, etc. installed in the mobile object.

[0055] For example, the acquisition unit 13 can acquire situation information indicating the current traveling situation of the mobile object from a sensor, an ECU, etc. installed in the mobile object. Specifically, the acquisition unit 13 can acquire situation information indicating the speed, acceleration, steering angle of the steering wheel, brake pedal depression amount, brake pedal depression force, etc. of the mobile object. Note that the situation information exemplified here is merely an example and is not limited to these.

[0056] "Passenger information" is generated by analyzing internal images and audio.

[0057] The information about passengers includes the number of passengers, congestion rate, attributes of each passenger (age, gender, status (pregnancy status, etc.)), statistical results of passenger attributes, and the position of each passenger within the moving object. The congestion rate is the ratio of the number of passengers to a predetermined number of passengers that can be transported. The statistical results of passenger attributes include the number of passengers with each attribute (e.g., number of males, number of females), and the ratio of the number of passengers with each attribute to the number of passengers with other attributes (e.g., ratio of males to females, ratio of each age group, etc.). The position of each passenger within the moving object is identified by analyzing internal images.

[0058] There are many techniques for detecting the number of passengers on a moving object by image analysis and for estimating the attributes of people. The acquisition unit 13 can generate the situation information about the passengers described above by using these techniques.

[0059] "Information about passengers involved in the notification event" is generated by analyzing internal images and audio.

[0060] The parties involved in the notification event may be, for example, a person who has fallen, a person who has stood up from a seat while the vehicle is moving, a person who is crouching, a person who is lying down, a person who is arguing, a person who has left something behind, a person who has stayed behind after arriving at the destination, etc.

[0061] The acquisition unit 13 generates situation information indicating the attributes (age, gender, status (pregnancy status, etc.)) of the passenger who is the subject of such a notification event. There are a wide variety of technologies for estimating a person's attributes based on an image. The acquisition unit 13 can use these technologies to generate situation information indicating the attributes of a specific passenger.

[0062] The notification control unit 14 determines at least one of the notification method and the notification content for notifying the detection of a notifiable event according to the status of the moving object indicated by the status information. Hereinafter, the notification of the detection of a notifiable event may be referred to as a “detection notification.”

[0063] The notification control unit 14 changes at least one of the notification method and the notification content of the detection notification according to the status of the moving object indicated by the status information, and then causes the notification unit 12 to issue the detection notification in the determined manner (at least one of the method and the content).

[0064] In this way, the notification control unit 14 can change at least one of the notification method and the notification content of the detection notification depending on the status of the moving object indicated by the status information.

[0065] First, a process related to the notification method will be described. A plurality of output devices are installed in the mobile object. For example, the output devices may include two or more of the following:

[0066] ・Display devices for the driver (displays, projection devices, etc.) ・Speakers for the driver ・Lights for the driver ・Vibrators for the driver ・Display devices for workers other than the driver (displays, projection devices, etc.) ・Speakers for workers other than the driver ・Lights for workers other than the driver ・Vibrators for workers other than the driver ・Display devices for passengers (displays, projection devices, etc.) ・Speakers for passengers ・Lights for passengers

[0067] The driver's display and driver's light are installed in a position where the driver can see them, the driver's speaker is installed in a position where the driver can hear them, and the driver's vibrator is installed in a position where the driver can feel them (driver's seat, steering wheel, etc.).

[0068] The display devices and lights for workers other than the driver are installed in positions where they can be seen by workers other than the driver. The speakers for workers other than the driver are installed in positions where they can be heard by workers other than the driver. The vibrators for workers other than the driver are installed in positions where they can be felt by workers other than the driver (such as the seats of workers other than the driver).

[0069] The passenger display devices and passenger lights are installed in positions where they can be seen by passengers, and the passenger speakers are installed in positions where they can be heard by passengers.

[0070] The notification control unit 14 determines the output device that will issue a notification according to the status of the moving object indicated by the status information. The notification control unit 14 can change the output device that will issue a notification according to the status of the moving object indicated by the status information. Furthermore, the notification control unit 14 can change the number of output devices that will issue a notification according to the status of the moving object indicated by the status information.

[0071] In the second embodiment, the specific process for determining the notification method is not limited. A specific example of the determination will be described in the following embodiment.

[0072] Next, processing related to the notification content will be described. The detection notification is sent to recipients such as the driver, workers other than the driver, and passengers. The notification content for such recipients can include at least one of the following: The level of danger and instructions will be described in detail in the following embodiment.

[0073] - Information indicating the occurrence of a notification event - Information indicating the notification event that has occurred - The status of the moving object indicated by the status information acquired in response to the detection of the notification event - The danger level of the notification event that has occurred - An internal image in which the notification event has been detected - A portion of the internal audio in which the notification event has been detected - Instructions for actions to be taken in response to the notification event that has occurred

[0074] The notification control unit 14 can change the content of the notification as described above depending on the status of the moving object indicated by the status information.

[0075] For example, the notification control unit 14 can determine the content of the instruction for the action to be taken in response to the generated notified event according to the status of the mobile object indicated by the status information. The notification control unit 14 can change the content of the instruction for the action to be taken in response to the generated notified event according to the status of the mobile object indicated by the status information.

[0076] Furthermore, the notification control unit 14 can determine the status of the mobile object to be notified from among the various statuses of the mobile object indicated by the status information, depending on the status of the mobile object indicated by the status information. As described above, the status of the mobile object indicated by the status information is diverse. The notification control unit 14 can determine the status of the mobile object to be notified from among the various statuses of the mobile object indicated by the status information, depending on the status of the mobile object indicated by the status information. The notification control unit 14 can change the status of the mobile object to be notified, depending on the status of the mobile object indicated by the status information.

[0077] Furthermore, the notification control unit 14 can change the amount of information to be notified depending on the status of the moving object indicated by the status information. For example, the notification control unit 14 can determine the content to be notified from the wide range of notification contents described above depending on the status of the moving object indicated by the status information. The notification control unit 14 can change the content to be notified depending on the status of the moving object indicated by the status information. Furthermore, the notification control unit 14 can change the amount of information to be notified depending on the status of the moving object indicated by the status information.

[0078] In the second embodiment, the specific process for determining the notification content is not limited. A specific example of the determination will be described in the following embodiment.

[0079] The notification unit 12 notifies the detection of a notification event by the detection unit 11 (detection notification). The notification unit 12 can issue the detection notification via an output device installed in the mobile object as described above. The notification unit 12 issues the notification in a manner determined by the notification control unit 14. That is, when the notification control unit 14 determines the notification method for the detection notification, the notification unit 12 issues the detection notification using the determined method. Furthermore, when the notification control unit 14 determines the notification content for the detection notification, the notification unit 12 issues the detection notification using that content.

[0080] Next, an example of the flow of processing by the information processing device 10 will be described using the flowchart of Fig. 2. Note that details of the processing at each step have been described above, so a description thereof will be omitted here.

[0081] In S10, the information processing device 10 monitors the occurrence of a notification event in the mobile object and detects the occurrence of the notification event in the mobile object. The information processing device 10 acquires at least one of an internal image and an internal sound in real time processing and analyzes the acquired image and audio to monitor and detect the occurrence of the notification event in the mobile object.

[0082] In S11, the information processing device 10 acquires status information indicating the status of the mobile object. In response to the detection of a notification event that has occurred in the mobile object in S10, the information processing device 10 can acquire status information indicating the status of the mobile object at that time.

[0083] In S12, the information processing device 10 determines at least one of the notification method and the notification content of the detection notification based on the status information acquired in S11. The information processing device 10 can change at least one of the notification method and the notification content depending on the status of the moving object indicated by the status information acquired in S11.

[0084] In S13, the information processing device 10 performs detection notification in the mode determined in S12.

[0085] <Effects> According to the information processing device 10 of the second embodiment, the same effects as those of the information processing device 10 of the first embodiment are achieved.

[0086] Furthermore, the information processing device 10 can acquire the characteristic situation information as described above and identify the situation of the moving object in detail based on the characteristic situation information.The information processing device 10 can then change at least one of the notification method and notification content of the detection notification depending on the detailed situation of the identified moving object.With such an information processing device 10, the notification method and notification content of the detection notification can be appropriately determined.Then, the detection notification can be issued using an appropriate method and content.

[0087] Furthermore, the information processing device 10 can change the amount of information to be notified depending on the status of the mobile object. When issuing a detection notification to a notified person (such as a driver) who is performing an operation that requires careful attention (such as driving), it is preferable to have a small amount of information. On the other hand, depending on the notifiable event that has occurred, it may be preferable to notify the notifiable person of the notifiable event in detail. When notifying the notifiable event that has occurred in detail, the amount of information increases. In view of this, the information processing device 10 can change and optimize the amount of information to be notified depending on the status of the mobile object. As a result, it is possible to issue a detection notification with appropriate content.

[0088] Furthermore, the information processing device 10 can change the notification content depending on the status of the mobile object. The information processing device 10 can change and optimize the notification content depending on the status of the mobile object. For example, the information processing device 10 can change the content of instructions for an action to be taken in response to a notified event that has occurred depending on the status of the mobile object. The action to be taken in response to a notified event that has occurred may differ depending on the status of the mobile object. It is not easy for a notified person performing an operation that requires careful attention (such as driving) to make an appropriate and prompt decision. In light of this, the information processing device 10 can determine the action to be taken in response to a notified event that has occurred depending on the status of the mobile object and notify the user of instructions for that action. The information processing device 10 can change and optimize the content of instructions depending on the status of the mobile object. As a result, a detection notification can be made with appropriate content.

[0089] Furthermore, the information processing device 10 can determine the output device to issue a notification depending on the status of the mobile object. The preferred recipient of the notification varies depending on the status of the mobile object. For example, the driver needs to be particularly careful when traveling at a relatively high speed, around a curve, or on a narrow road. In such cases, it is preferable not to notify the driver, but to notify a worker or passenger other than the driver and have them take action regarding the notified event. On the other hand, it is not a problem to notify the driver when the vehicle is stopped. In consideration of these points, the information processing device 10 can determine the output device to issue a notification depending on the status of the mobile object. The information processing device 10 can change and optimize the output device to issue a notification depending on the status of the mobile object.

[0090] <<Third Embodiment>> An information processing device 10 according to a third embodiment calculates a risk level based on the state of a moving object, and changes at least one of the notification method and notification content of a detection notification according to the calculated risk level. This will be described in detail below.

[0091] The notification control unit 14 calculates the degree of danger based on the state of the moving object. Then, the notification control unit 14 determines at least one of the notification method and notification content of the detection notification by the notification unit 12 according to the calculated degree of danger. The notification control unit 14 can change at least one of the notification method and notification content of the detection notification according to the calculated degree of danger.

[0092] First, a method for calculating the risk level will be described. The notification control unit 14 calculates the risk level based on the content of the notification event detected by the detection unit 11 and the status of the mobile object indicated by the status information acquired by the acquisition unit 13.

[0093] A risk calculation model that inputs the content of the notifiable event and the status of the mobile body indicated by the status information and outputs a risk level is generated in advance and stored in the information processing device 10. The notification control unit 14 calculates the risk level by inputting the content of the notifiable event detected by the detection unit 11 and the status of the mobile body indicated by the status information acquired by the acquisition unit 13 into the risk calculation model. The risk level may be indicated in three levels of "high, medium, low," or may be indicated by a score out of 100 points, or may be indicated by some other index.

[0094] The risk calculation model may be generated using any technology. For example, the risk calculation model may be an arithmetic expression in which the content of the notifiable event detected by the detection unit 11 and the status of the mobile body indicated by the status information acquired by the acquisition unit 13 are variables, and the risk level is a solution. Alternatively, the risk calculation model may include a table indicating the correspondence between the combination of the content of the notifiable event and the status of the mobile body and the risk level. The risk calculation model may then refer to the table to identify and output the risk level corresponding to the input content of the notifiable event and the status of the mobile body. Note that the configuration of the risk calculation model is not limited to the example given here.

[0095] The risk calculation model may be configured to calculate a higher risk as the speed of the moving object increases. Also, the risk calculation model may be configured to calculate a higher risk as the acceleration of the moving object increases.

[0096] The risk calculation model may be configured to calculate a higher risk when the road conditions at the current location of the mobile object satisfy a predetermined condition compared to when the predetermined condition is not satisfied. The predetermined condition may be one or more of the following, connected by a predetermined logical operator: a curve, a curve with a curvature radius equal to or greater than a predetermined threshold, a slope, a slope with an inclination angle equal to or greater than a predetermined threshold, a width equal to or less than a predetermined threshold, and an unpaved road.

[0097] The risk calculation model may be configured to calculate a higher risk when the road conditions within a predetermined distance from the current position on the future driving route satisfy a predetermined condition compared to when the predetermined condition is not satisfied. The predetermined condition may be one or more of the following, connected by a predetermined logical operator: a curve, a curve with a curvature radius equal to or greater than a predetermined threshold, a slope, a slope with an inclination angle equal to or greater than a predetermined threshold, a width equal to or less than a predetermined threshold, and an unpaved road.

[0098] The risk calculation model may be configured to calculate a higher risk level the further from the driver the location of the notifiable event inside the moving body is. The further from the driver the location of the notifiable event inside the moving body is, the more difficult it is for the driver to grasp the situation. As a result, the risk level increases.

[0099] The risk calculation model may be configured to calculate a higher risk when the information about passengers satisfies a predetermined condition compared to when the information does not satisfy the predetermined condition, such as the number of passengers being 1, the number of passengers with a predetermined attribute being 0, or the congestion rate being equal to or greater than a predetermined threshold.

[0100] If there is only one passenger, that passenger is considered to be the person involved in the notifiable event (such as a fall). If there is only one passenger, there is no passenger who can take action in response to the notifiable event, such as helping or assisting the passenger. In this case, the risk level is high.

[0101] Furthermore, passengers with a predetermined attribute are passengers who can take action in response to a notifiable event (such as a fall), for example. An example of passengers with such a predetermined attribute is, for example, people in their teens to sixties, but is not limited to this. If there are no passengers with such a predetermined attribute, there will be no passengers who can take action in response to a notifiable event. In this case, the risk level will be high.

[0102] Furthermore, if the congestion rate is equal to or exceeds a predetermined threshold and passengers are unable to move, there is a possibility that no one will be able to take action in response to the notification event, which increases the risk.

[0103] Furthermore, the risk calculation model may be configured to calculate a higher risk when the attributes of a passenger involved in a notifiable event satisfy a predetermined condition compared to when the predetermined condition is not satisfied. Passengers involved in a notifiable event may be, for example, a person who has fallen, a person who has stood up from their seat while the vehicle is moving, a person who is crouching, a person who is lying down, a person who has raised their hand, a person who is arguing, a person who has left something behind, a person who has stayed behind after arriving at the final destination, etc. In this case, the predetermined condition may be, for example, under the age of 10 or over the age of 80, but is not limited to this.

[0104] Next, a process of determining at least one of the notification method and the notification content when the notification unit 12 notifies the detection of a notifiable event according to the calculated risk level will be described.

[0105] The notification control unit 14 can determine the output device that will issue a notification according to the level of risk. The notification control unit 14 can change the output device that will issue a notification according to the level of risk. Furthermore, the notification control unit 14 can change the number of output devices that will issue a notification according to the level of risk. The output devices are as described in the second embodiment.

[0106] Furthermore, the notification control unit 14 can change the content of the notification as described in the second embodiment depending on the degree of risk.

[0107] For example, the notification control unit 14 can determine the content of the instruction for the action to be taken in response to the generated notifiable event according to the risk level. The notification control unit 14 can change the content of the instruction for the action to be taken in response to the generated notifiable event according to the risk level.

[0108] Furthermore, the notification control unit 14 can determine the status of the moving object to be notified from among various statuses of the moving object indicated by the status information according to the level of danger. The notification control unit 14 can change the status of the moving object to be notified according to the level of danger.

[0109] Furthermore, the notification control unit 14 can change the amount of information to be notified depending on the level of risk. For example, the notification control unit 14 can determine the content to be notified from the various notification contents described in the second embodiment depending on the level of risk. The notification control unit 14 can change the content to be notified depending on the level of risk. Furthermore, the notification control unit 14 can change the amount of information to be notified depending on the level of risk.

[0110] Other configurations of the information processing device 10 are the same as those in the first and second embodiments.

[0111] According to the information processing device 10 of the third embodiment, the same effects as those of the information processing device 10 of the first and second embodiments are realized.

[0112] Furthermore, the information processing device 10 can calculate the degree of danger based on the state of the moving object, and change at least one of the notification method and notification content of the detection notification according to the degree of danger. With such information processing device 10, it is possible to issue a detection notification in an appropriate method and content according to the degree of danger of the moving object.

[0113] <<Fourth Embodiment>> An information processing device 10 according to a fourth embodiment changes the amount of information to be notified depending on the situation and degree of danger of a moving object. This will be described in detail below.

[0114] The notification control unit 14 changes the amount of information to be notified depending on the situation of the mobile object. When notifying a notified person (such as a driver) who is performing an operation that requires attention (such as driving), it is preferable to have a small amount of information. On the other hand, depending on the notifiable event that has occurred, it may be preferable to notify the notifiable person of the notifiable event in detail. When notifying the notifiable event in detail, the amount of information becomes large.

[0115] In view of this, the notification control unit 14 changes and optimizes the amount of information to be notified depending on the state of the mobile object.

[0116] In one example, the notification control unit 14 can change the amount of information to be notified depending on the location inside the mobile body where the notifiable event occurred. If the location where the notifiable event occurred is a location where it is easy to check the situation, there is no need to notify more information than necessary. On the other hand, if the location where the notifiable event occurred is a location where it is difficult to check the situation, it is better to notify more detailed information.

[0117] Therefore, the notification control unit 14 can increase the amount of information to be notified when a notification event occurs in a first area where it is difficult to check the situation, compared to the amount of information to be notified when a notification event occurs in a second area where it is easy to check the situation.

[0118] For example, when a notifiable event occurs in a first area where it is difficult to check the situation, the notification control unit 14 may notify some or all of the following types of information: When a notifiable event occurs in a second area where it is easy to check the situation, the notification control unit 14 may notify some of the following types of information: Note that the number of types of information notified when a notifiable event occurs in the second area where it is easy to check the situation is fewer than the number of types of information notified when a notifiable event occurs in the first area where it is difficult to check the situation.

[0119] - Information indicating the occurrence of a notification event - The status of the moving object indicated by the status information acquired in response to the detection of the notification event - The risk level of the notification event that has occurred - An internal image in which the notification event has been detected - Instructions for actions to be taken in response to the notification event that has occurred

[0120] Here, a specific example will be described with reference to Figures 4 to 6. Note that Figures 4 to 6 are merely examples, and the present invention is not limited to these. In this example, the moving body is a bus, and the driver is the notified party.

[0121] When a notifiable event occurs in a first area where it is difficult to confirm the situation, the notification control unit 14 may notify information D as shown in Fig. 4. In the example of Fig. 4, information indicating the occurrence of the notifiable event and the content of the notifiable event (occurrence of a fall), the risk level (high risk level), and the situation of the moving object indicated by the situation information acquired in response to the detection of the notifiable event are notified.

[0122] The status of the moving object being notified includes the location inside the moving object where the notified event occurred, and the attributes of the passenger involved in the notified event (male in his 40s). Mark M in image V indicates the location inside the moving object where the notified event occurred. Image V is a floor map of the inside of the moving object, showing seat positions, aisles, etc. Image V also shows the locations of other passengers (occupied seats). The locations of passengers inside the moving object can be identified by analyzing the internal image.

[0123] On the other hand, when a notifiable event occurs in a second area where the situation can be easily confirmed, the notification control unit 14 may notify information D as shown in Fig. 5. In the example of Fig. 5, information indicating the occurrence and content of the notifiable event (fall has occurred) and the level of danger (high danger) is notified.

[0124] FIG. 6 shows another example of a notification when a notification event occurs in a second area where the situation can be easily confirmed. The notification control unit 14 may notify information D as shown in FIG. 6 when a notification event occurs in the second area where the situation can be easily confirmed. In the example of FIG. 6, the risk level (medium risk level) is notified. Note that the example of FIG. 6 may be configured to display a screen showing the information as shown on a display. Alternatively, the example of FIG. 6 may be configured to notify information D by lighting multiple color-coded lamps (three lamps in the example) corresponding to the risk level as shown, without using a display. When lamps are used, the amount of information that can be notified is smaller than when information is displayed on a display, but costs can be reduced.

[0125] Although not shown in the examples of Figures 4 to 6, if a notifiable event occurs in a first area where it is difficult to check the situation, the notification control unit 14 may include an internal image in which the notifiable event was detected in the notification content. Internal images are useful information for intuitively and quickly understanding the situation. If a notifiable event occurs in a second area where it is easy to check the situation, the notification control unit 14 may not include an internal image in which the notifiable event was detected in the notification content.

[0126] Next, the first area and the second area will be described. The first area and the second area may be determined in advance and registered in the information processing device 10.

[0127] An example is shown in Figure 7. In this example, the moving body is a bus and the driver is the notified party. Area E is the first area. Other areas are second areas. In the example of Figure 7, areas far from the driver and areas directly behind the driver are registered as first areas.

[0128] Another example is shown in Figure 8. In this example, the moving body is an articulated bus, and the driver is the notified party. Area E is the first area. In the example of Figure 8, the inside of the second vehicle where the driver is not located, the area inside the first vehicle where the driver is located and away from the driver, and the area immediately behind the driver are registered as the first area.

[0129] Additionally, areas that cannot be seen through the rearview mirror, areas hidden by equipment installed inside the vehicle, etc. may also be registered as the first area.

[0130] In this example, the notification control unit 14 identifies the first area and the second area based on such pre-registered information.

[0131] Here, another example of the process for identifying the first area and the second area will be described. The areas where it is difficult to check the situation and the areas where it is easy to check the situation may change depending on the congestion rate of mobile objects. The higher the congestion rate, the larger the area where it is difficult to check the situation may be.

[0132] 9 and 10 , information indicating a first area where it is difficult to check the situation and a second area where it is easy to check the situation may be registered in advance in the information processing device 10. Then, the notification control unit 14 may determine the first area and the second area based on the information and the congestion rate of the mobile object indicated by the situation information.

[0133] In the information in Fig. 9, the interior of the moving body is divided into three areas, A to C. In the information in Fig. 10, one or more of A to C are registered as first areas (areas where it is difficult to check the situation) for each congestion rate. Note that any area among A to C that is not registered as a first area (area where it is difficult to check the situation) is the second area.

[0134] In this example, the notification control unit 14 identifies the first area and the second area based on such pre-registered information and the congestion rate at that time.

[0135] So far, an example has been described in which the amount of information to be notified is changed depending on the "location inside the mobile body where the notifiable event occurred." The notification control unit 14 may also change the amount of information to be notified depending on other conditions of the mobile body.

[0136] For example, the notification control unit 14 may reduce the amount of information to be notified as the speed of the moving object increases. Also, the notification control unit 14 may reduce the amount of information to be notified as the acceleration of the moving object increases. The faster the speed of the moving object and the faster the acceleration of the moving object, the more attention the driver needs to pay to driving. The amount of information in such cases can be reduced.

[0137] Furthermore, the notification control unit 14 may reduce the amount of information to be notified when the road conditions at the current location of the mobile object satisfy a predetermined condition compared to when the predetermined condition is not satisfied. The predetermined condition may be one or more of the following, connected by a predetermined logical operator: a curve, a curve with a curvature radius equal to or greater than a predetermined threshold, a slope, a slope with a slope angle equal to or greater than a predetermined threshold, a width equal to or less than a predetermined threshold, and unpaved road. When the road conditions at the current location of the mobile object satisfy the predetermined condition, the driver needs to pay more attention to driving. The amount of information to be notified in such cases can be reduced.

[0138] Furthermore, the notification control unit 14 may reduce the amount of information to be notified when the road conditions within a predetermined distance from the current position on the future driving route satisfy a predetermined condition compared to when the predetermined condition is not satisfied. The predetermined condition may be one or more of the following, connected by a predetermined logical operator: a curve, a curve with a curvature radius equal to or greater than a predetermined threshold, a slope, a slope with a slope angle equal to or greater than a predetermined threshold, a width equal to or less than a predetermined threshold, and unpaved road. When the road conditions within a predetermined distance from the current position on the future driving route satisfy a predetermined condition, the driver needs to pay more attention to driving. The amount of information to be notified in such cases can be reduced.

[0139] Furthermore, the notification control unit 14 may notify a larger amount of information when the information about passengers satisfies a predetermined condition than when the information does not satisfy the predetermined condition, such as the number of passengers being one, the number of passengers with a predetermined attribute being zero, or the congestion rate being equal to or greater than a predetermined threshold.

[0140] If there is only one passenger, that passenger is considered to be the party involved in the notifiable event. If there is only one passenger, there is no passenger who will take action in response to the notifiable event, such as helping or assisting the passenger. The notification control unit 14 can increase the amount of information to be notified in this case and convey the situation in more detail. In other cases, i.e., when there is a passenger who will take action to help or assist the passenger who is the party involved in the notifiable event, the notification control unit 14 can reduce the amount of information to be notified.

[0141] Furthermore, passengers with a predetermined attribute are passengers who can take action in response to a notifiable event (such as a fall), for example. An example of such passengers with a predetermined attribute is, for example, people in their teens to their sixties, but is not limited to this. If there are no passengers with such a predetermined attribute, there are no passengers who can take action in response to the notifiable event. The notification control unit 14 can increase the amount of information to be notified in this case and convey the situation in more detail. In other cases, i.e., when there are passengers who can take action to help or support the passenger who is the subject of the notifiable event, the notification control unit 14 can reduce the amount of information to be notified. In this case, an example of passengers with a predetermined attribute is, for example, people in their teens to their sixties, but is not limited to this.

[0142] Furthermore, if the congestion rate is equal to or greater than a predetermined threshold and passengers are unable to move, there is a possibility that no one will be able to take action in response to the notified event. Furthermore, if the congestion rate is equal to or greater than the predetermined threshold, it will be difficult for the driver to grasp the situation. The notification control unit 14 can increase the amount of information to be notified in this case and convey the situation in more detail. Furthermore, the notification control unit 14 can reduce the amount of information to be notified when the congestion rate is less than the predetermined threshold.

[0143] Furthermore, the notification control unit 14 may notify a larger amount of information when the attributes of the passenger involved in the notification event satisfy a predetermined condition compared to when the predetermined condition is not satisfied. Passengers involved in the notification event include, for example, a person who has fallen, a person who has stood up from their seat while the vehicle is moving, a person who is crouching, a person who is lying down, a person who has raised their hand, a person who is arguing, a person who has left something behind, a person who has stayed behind after arriving at the final destination, etc. In this case, the predetermined condition may be, for example, under the age of 10 or over the age of 80, but is not limited to this.

[0144] If the attributes of the passenger involved in the notification event satisfy such predetermined conditions, a prompt response may be required. Therefore, the notification control unit 14 can increase the amount of information to be notified in this case and convey the situation in more detail.

[0145] Additionally, the notification control unit 14 may change the amount of information to be notified depending on the danger level of the moving object. The higher the danger level, the more information the notification control unit 14 notifies, allowing the situation to be conveyed in more detail.

[0146] Other configurations of the information processing device 10 are the same as those of the first to third embodiments.

[0147] According to the information processing device 10 of the fourth embodiment, the same effects as those of the information processing devices 10 of the first to third embodiments are realized.

[0148] Furthermore, the information processing device 10 can change the amount of information to be notified depending on the situation and the degree of danger of the moving object. When notifying a notified person (such as a driver) who is performing an operation that requires caution (such as driving), it is preferable to provide a small amount of information. On the other hand, depending on the notifiable event that has occurred, it may be preferable to notify the notifiable person of the notifiable event in detail. When notifying the notifiable event in detail, the amount of information becomes large.

[0149] The information processing device 10, which can change the amount of information to be notified depending on the status and danger level of the moving object, can provide detection notification in an optimal manner taking the above points into consideration. As a result, it is possible to prevent inconveniences such as information being overlooked due to the notification of an unnecessarily large amount of information, or secondary disasters such as accidents caused by such notifications. It is also possible to prevent inconveniences such as an inability to grasp the situation due to the amount of information being too small, resulting in an inability to take appropriate action, or a delayed response.

[0150] <<Fifth Embodiment>> An information processing device 10 according to a fifth embodiment changes the content of the instruction to be notified depending on the situation and the degree of danger of a moving object. This will be described in detail below.

[0151] The notification control unit 14 includes instructions for actions to be taken in response to the notified event that has occurred in the content of the detection notification. The notification control unit 14 then determines the content of the instructions depending on the status of the mobile object indicated by the status information. The notification control unit 14 can change the content of the instructions depending on the status of the mobile object. The instructions to the driver may include, for example, at least one of the following:

[0152] ・Stop immediately and respond to the notified event ・Stop at the next stop and respond to the notified event ・Slow down and continue driving ・Continue driving as normal ・Continue driving, taking special care to avoid sudden braking or sharp turns, etc. ・Play a prepared announcement ・Give a verbal warning

[0153] Instructions to workers other than the driver (people riding in the vehicle and assisting in the operation of the vehicle) may include, for example, at least one of the following:

[0154] ・Respond promptly to the notification event ・Play pre-prepared announcements ・Give verbal warnings

[0155] An instruction decision model that takes the content of the notified event and the status of the moving object indicated by the status information as input and outputs the content of the instruction is generated in advance and stored in the information processing device 10. The notification control unit 14 inputs the content of the notified event detected by the detection unit 11 and the status of the moving object indicated by the status information acquired by the acquisition unit 13 into the instruction decision model, thereby determining the content of the instruction.

[0156] The instruction determination model is generated using any technology. For example, the instruction determination model may include a table showing the correspondence between the combination of the content of the notified event and the status of the mobile object, and the content of the instruction. The instruction determination model may then refer to the table to identify and output the content of the instruction corresponding to the content of the input notified event and the status of the mobile object. Note that the configuration of the instruction determination model is not limited to the example given here.

[0157] Below, examples of the contents of instructions determined by the instruction determination model are shown, but the present invention is not limited to these.

[0158] First Example The instruction decision model may determine the contents of the instructions to be "continue normal driving" and "play a prepared announcement" in the following cases: Content of the notification event: "A person stands up from their seat while the vehicle is moving" Age range of the person involved in the notification event: "Teens to 60s"

[0159] The instruction decision model may determine the contents of the instruction to be "slow down and continue driving" and "verbal warning" in the following cases: Content of the notification event: "A person stands up from their seat while the vehicle is moving" Age group of the person involved in the notification event: "Under 10 years old or over 70 years old"

[0160] Second Example The instruction decision model may determine the contents of the instructions to be "continue driving normally" and "play a prepared announcement" in the following cases: - Content of the notified event: "A person stands up from their seat while the moving object is moving" - Age range of the person involved in the notified event: "Teens to 60s" - Condition of the road the moving object will travel in the future: "No curves or slopes within a specified distance"

[0161] The instruction decision model may determine the contents of the instructions to be "continue driving, taking special care not to brake suddenly or take sharp turns" and "verbal warning" in the following cases: Content of the notified event: "A person stands up from their seat while the moving object is moving" Age group of the person involved in the notified event: "Teens to 60s" Condition of the road on which the moving object will travel: "There are curves and slopes within a specified distance"

[0162] The instruction decision model may determine the contents of the instructions to be "slow down and continue driving" and "play a prepared announcement" in the following cases: Content of the notified event: "A person stands up from their seat while the moving object is moving" Age group of the person involved in the notified event: "Under 10 years old or over 70 years old" Condition of the road on which the moving object will travel: "No curves or slopes within a specified distance"

[0163] The instruction decision model may determine the contents of instructions to be "slow down and continue driving", "continue driving while taking special care not to brake suddenly or take sharp turns", and "verbal warning" in the following cases: - Content of the notification event: "A person stands up from their seat while the moving object is moving" - Age group of the person involved in the notification event: "Under 10 years old or over 70 years old" - Conditions of the road the moving object will travel in the future: "There is a curve and a slope within a specified distance"

[0164] ○Third example The instruction decision model may determine that the instruction content is "stop at the next stop and respond to the notified event that has occurred" if the content of the notified event is "person falling," "person crouching," "person lying down," "person raising a hand," or "argument," and the distance to the next stop is less than a predetermined threshold.

[0165] The instruction decision model may determine that the instruction content is "stop immediately and respond to the notified event that has occurred" if the content of the notified event is "person falling," "person crouching," "person lying down," "person raising a hand," or "argument," and the distance to the next stop is greater than a predetermined threshold.

[0166] The instruction determination model may be a model that receives a risk level as an input and outputs the content of an instruction. In this case, the notification control unit 14 determines the content of an instruction by inputting the content of the notifiable event detected by the detection unit 11 and the risk level calculated based on the situation information acquired by the acquisition unit 13 into the instruction determination model. For example, the instruction determination model may include a table indicating a correspondence between the risk level and the content of an instruction. The instruction determination model may then refer to the table to identify and output the content of an instruction corresponding to the input risk level. The configuration of the instruction determination model is not limited to the example given here.

[0167] Other configurations of the information processing device 10 are the same as those of the first to fourth embodiments.

[0168] According to the information processing device 10 of the fifth embodiment, the same effects as those of the information processing devices 10 of the first to fourth embodiments are realized.

[0169] Furthermore, the information processing device 10 changes the content of the instruction to be notified depending on the status and danger level of the mobile object. When a certain notifiable event occurs, the action to be taken in response to the notifiable event may differ depending on the status and danger level of the mobile object. It is not easy for a notified person performing an operation requiring caution (such as driving) to make an appropriate and prompt decision. In consideration of this, the information processing device 10 can determine the action to be taken in response to the notifiable event that has occurred depending on the status and danger level of the mobile object, and notify instructions for that action. The information processing device 10 can change and optimize the content of the instruction depending on the status and danger level of the mobile object. As a result, a detection notification can be made with appropriate content.

[0170] <<Sixth Embodiment>> An information processing device 10 according to a sixth embodiment changes the notification method depending on the situation and danger level of a moving object. This will be described in detail below.

[0171] The mobile object is equipped with two or more of the following output devices:

[0172] ・Display devices for the driver (displays, projection devices, etc.) ・Speakers for the driver ・Lights for the driver ・Vibrators for the driver ・Display devices for workers other than the driver (displays, projection devices, etc.) ・Speakers for workers other than the driver ・Lights for workers other than the driver ・Vibrators for workers other than the driver ・Display devices for passengers (displays, projection devices, etc.) ・Speakers for passengers ・Lights for passengers

[0173] The notification control unit 14 determines the output device that will issue a notification depending on the status or danger level of the moving object indicated by the status information. The notification control unit 14 can change the output device that will issue a notification depending on the status or danger level of the moving object indicated by the status information. Furthermore, the notification control unit 14 can change the number of output devices that will issue a notification depending on the status or danger level of the moving object indicated by the status information.

[0174] An output device determination model is generated in advance, which takes as input the content of the notification event and the status of the mobile object indicated by the status information, and outputs information indicating the output device that will issue the notification, and is stored in the information processing device 10. The notification control unit 14 inputs the content of the notification event detected by the detection unit 11 and the status of the mobile object indicated by the status information acquired by the acquisition unit 13 into the output device determination model, thereby determining the output device that will issue the notification.

[0175] The output device determination model may be generated using any technique. For example, the output device determination model may include a table showing a correspondence relationship between a combination of the content of a notification event and the status of a mobile object, and an output device that causes a notification. The output device determination model may then refer to the table to identify an output device that corresponds to the content of the input notification event and the status of the mobile object, and output the output device.

[0176] Alternatively, an output device determination model may be generated in advance, which inputs the risk level and outputs information indicating the output device that is to issue a notification, and stored in the information processing device 10. The notification control unit 14 inputs the risk level calculated based on the content of the notification event detected by the detection unit 11 and the status of the moving object indicated by the status information acquired by the acquisition unit 13 into the output device determination model, thereby determining the output device that is to issue a notification.

[0177] The output device determination model may be generated using any technique. For example, the output device determination model may include a table showing a correspondence relationship between a risk level and an output device that is to issue a notification. The output device determination model may then refer to the table to identify an output device that corresponds to the input risk level and output the notification.

[0178] The configuration of the output device determination model is not limited to the example given here.

[0179] The output device determination model may be configured to determine the content of the notification to be sent from more output devices as the risk level increases. In this way, when the risk level is high, more output devices are made to send the notification, thereby more reliably realizing the notification to the notified person.

[0180] The output device determination model may also determine the output device based on the traveling conditions of the vehicle. For example, the model may determine a driver's speaker when the vehicle is traveling, and a driver's display and driver's speaker when the vehicle is stopped.

[0181] Note that "driving" may be replaced with "driving at a speed equal to or greater than a predetermined threshold," "driving around a curve," "driving on an incline," "driving on a road whose width is equal to or less than a predetermined threshold," etc. Furthermore, "stopped" may be replaced with "driving at a speed less than a predetermined threshold," "driving on a straight road," "driving on a road with no incline," "driving on a road whose width is greater than a predetermined threshold," etc.

[0182] In this way, when the driver needs to pay more attention to driving, the number of output devices can be reduced or notifications via the display can be omitted, thereby preventing inconveniences that may interfere with driving.

[0183] In addition, in the case of a situation where the driver needs to pay more attention to driving as described above, the output device determination model may determine an output device for a worker other than the driver or an output device for a passenger as the output device to be notified. In other words, in the case of a situation where the driver needs to pay more attention to driving as described above, the output device determination model does not need to include the output device for the driver in the output devices to be notified.

[0184] Furthermore, the output device determination model may determine the output device to be used to notify among the output devices for passengers, depending on the passenger's location, etc. For example, the output device determination model may determine the output device that is closest to the passenger's location as the output device to be used to notify. In this way, notification to passengers can be more reliably achieved.

[0185] Furthermore, the output device determination model may determine, based on the congestion rate, which output device among the passenger output devices to notify. The higher the congestion rate, the more difficult it is to see an output device that is farther away. Therefore, the output device determination model may determine, as the congestion rate increases, more passenger output devices to be used as output devices to notify. This more reliably notifies passengers.

[0186] Furthermore, the output device determination model may determine an output device to be operated among the passenger output devices according to a location where a notification event has occurred inside the mobile body. For example, the output device determination model may determine an output device that is closest to a location where a notification event has occurred inside the mobile body as the output device that will issue a notification. In this way, passengers who are helping a party involved in the notification event at the location where the notification event has occurred can be reliably notified of instructions on actions to take in response to the notification event.

[0187] Alternatively, the output device determination model may determine an output device that is far from the location where the notification event occurred inside the mobile body (an output device other than the nearest output device) as the output device that will send the notification. This can prevent the person involved in the notification event from feeling that some kind of notification was sent to them and causing them to feel upset.

[0188] Furthermore, when there is only one passenger, the output device determination model may determine the output device for the driver or the output device for a worker other than the driver as the output device to be notified. When there is only one passenger, that passenger is considered to be the party involved in the notified event. When there is only one passenger, there is no passenger who can take action in response to the notified event that has occurred, such as taking action to help or assist the passenger. In this case, it is meaningless to have the output device for passengers issue a notification. Therefore, in such a case, the output device determination model does not include the output device for passengers in the output devices to be notified.

[0189] Furthermore, if there are no passengers with a predetermined attribute, for example, passengers who can take action in response to a notifiable event, the output device determination model may determine the driver's output device or the output device for a worker other than the driver as the output device to be notified. In this case, an example of passengers with a predetermined attribute is, for example, people in their teens to sixties, but this is not limiting. It is meaningless to have the passenger output device issue a notification if there are no passengers who can take action in response to a notifiable event. Rather, passengers who cannot take action may try to take action in accordance with the notified instructions, which could result in a secondary disaster. Therefore, in such a case, the output device determination model does not include the passenger output device in the output devices to be notified.

[0190] Here, a modified example will be described. The notification control unit 14 may change the output device or the number of output devices to be used for notification depending on the content of the notification. For example, the notification control unit 14 may determine, depending on the content of the notification, one of the output device for the driver, the output device for workers other than the driver, and the output device for passengers as the output device to be used for notification. In this way, it is possible to send the notification via an appropriate output device depending on the content of the notification.

[0191] Other configurations of the information processing device 10 are the same as those of the first to fifth embodiments.

[0192] According to the information processing device 10 of the sixth embodiment, the same effects as those of the information processing devices 10 of the first to fifth embodiments are realized.

[0193] Furthermore, the information processing device 10 changes the notification method depending on the situation and danger level of the mobile object. The preferred recipient of the notification varies depending on the situation and danger level of the mobile object. For example, the driver needs to be particularly careful when traveling at a relatively high speed, around a curve, or on a narrow road. In such cases, it is preferable not to notify the driver, but to notify workers or passengers other than the driver and have them take action in response to the notified event. On the other hand, it is not a problem to notify the driver when the vehicle is stopped. In consideration of these points, the information processing device 10 can determine the output device to be used for notification depending on the situation and danger level of the mobile object. The information processing device 10 can change and optimize the output device to be used for notification depending on the situation and danger level of the mobile object.

[0194] <<Modifications>> Modifications applicable to all the embodiments will be described below. The following modifications also achieve the same effects as the above-described embodiments.

[0195] <Modification 1> The notification control unit 14 may cause a notification to be sent to the notified person when a predetermined condition is met. The predetermined condition here is that "the number of passengers is less than a predetermined threshold" or "the moving object can stop for a certain period of time", etc.

[0196] If the number of passengers is relatively large, it is expected that other passengers will take action in response to the notified event. In this case, the notification control unit 14 does not need to notify the notified person.

[0197] Furthermore, there are cases where a response to a notifiable event can only be made when the mobile body is stopped. Despite this premise, if a notification is made in a situation where the mobile body cannot stop for a certain period of time, the notified person may become disoriented by the notification, which may result in a secondary disaster. Therefore, the notification control unit 14 can control the notification to be made only when an environment in which the mobile body can respond to the notifiable event can be secured. For example, the notification control unit 14 may determine that "the mobile body can stop for a certain period of time" when the next bus stop is nearby. Alternatively, the notification control unit 14 may identify the status of the traffic light ahead of the mobile body using a camera that captures the exterior of the mobile body. Furthermore, the notification control unit 14 may determine that "the mobile body can stop for a certain period of time" when the traffic light ahead of the mobile body is red.

[0198] <Variation 2> When "raising a hand" is detected as a notification event, the notification control unit 14 may not notify the notified person if the person is a child accompanied by an adult. In this case, the child (the person) may just be playing. This configuration can suppress unnecessary notifications.

[0199] <Modification 3> When the congestion rate of the mobile object is equal to or greater than a predetermined threshold, the notification control unit 14 may cause an output device to output an announcement for congestion leveling. For example, the notification control unit 14 may notify the density of people in each area inside the mobile object. For example, the notification control unit 14 may notify the density of people in each area inside the mobile object using a heat map or the like.

[0200] This notification may be provided to passengers, with the hope that passengers in high-density areas will move to areas with less density of people.

[0201] This notification may also be sent to the driver or a worker other than the driver, who can then guide passengers in a high-density area to a low-density area based on the notification.

[0202] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0203] In addition, in the flowcharts used in the above explanation, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of the content.

[0204] Some or all of the above embodiments may be described as, but are not limited to, the following notes. 1. An information processing device having: detection means for detecting a notifiable event occurring in a mobile body; notification means for notifying the detection of the notifiable event; acquisition means for acquiring status information indicating the status of the mobile body; and notification control means for changing at least one of the notification method and the notification content of the notification in accordance with the status of the mobile body. 2. The information processing device described in 1, wherein the status information includes at least one of information indicating the location inside the mobile body where the notifiable event occurred, information indicating the location of the mobile body, information indicating a future travel route of the mobile body, information indicating the status of roads at the current location of the mobile body, information indicating the status of roads along which the mobile body will travel in the future, information indicating the current travel status of the mobile body, information about passengers, and information about passengers who are parties involved in the notifiable event. 3. The information processing device described in 1 or 2, wherein the notification control means changes the amount of information to be notified in accordance with the status of the mobile body. 4. The information processing device described in 3, wherein the notification control means changes the amount of information to be notified in accordance with the location inside the mobile body where the notifiable event occurred. 5. 5. The information processing device according to any one of 1 to 5, wherein the notification means issues the notification via an output device including two or more of a display device for the driver, a speaker for the driver, a light for the driver, a vibrator for the driver, a display device for workers other than the driver, a speaker for workers other than the driver, a light for workers other than the driver, a vibrator for workers other than the driver, a display device for passengers, a speaker for passengers, and a light for passengers, and the notification control means determines the output device to issue the notification depending on the status of the mobile object.8. The information processing device according to any one of 1 to 7, wherein the notification control means calculates a level of danger based on the status of the mobile body, and changes at least one of the notification method and notification content in the notification in accordance with the level of danger. 9. An information processing method in which one or more computers detect a notifiable event that has occurred in a mobile body, notify the detection of the notifiable event, acquire status information indicating the status of the mobile body, and change at least one of the notification method and notification content in the notification in accordance with the status of the mobile body. 10. A program that causes a computer to function as: detection means that detects a notifiable event that has occurred in a mobile body, notification means that notifies the detection of the notifiable event, acquisition means that acquires status information indicating the status of the mobile body, and notification control means that changes at least one of the notification method and notification content in the notification in accordance with the status of the mobile body.

[0205] Some or all of Supplements 2 to 8 that are dependent on the information processing device of Supplement 1 described above may also be dependent on the information processing method of Supplement 9 and the program of Supplement 10 in the same dependent relationship as Supplement 1 and Supplements 2 to 8. Furthermore, within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements can be realized in various hardware, software, various recording means for recording software, or systems.

[0206] This application claims priority based on Japanese Patent Application No. 2024-072257, filed April 26, 2024, the disclosure of which is incorporated herein by reference in its entirety.

[0207] REFERENCE SIGNS LIST 10 Information processing device 11 Detection unit 12 Notification unit 13 Acquisition unit 14 Notification control unit 1A Processor 2A Memory 3A Input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. An information processing device having: a detection means for detecting a notification event that occurs in a mobile body; a notification means for notifying the detection of the notification event; an acquisition means for acquiring status information indicating the status of the mobile body; and a notification control means for changing at least one of the notification method and notification content in the notification depending on the status of the mobile body.

2. The information processing device of claim 1, wherein the status information includes at least one of the following: information indicating the location within the mobile body where the notification event occurred; information indicating the location of the mobile body; information indicating the future driving route of the mobile body; information indicating the road conditions at the current location of the mobile body; information indicating the road conditions along which the mobile body will drive in the future; information indicating the current driving conditions of the mobile body; information about passengers; and information about passengers who are parties to the notification event.

3. An information processing device according to claim 1 or 2, wherein the notification control means changes the amount of information to be notified depending on the status of the mobile object.

4. An information processing device according to claim 3, wherein the notification control means changes the amount of information to be notified depending on the location within the mobile body where the notification event occurs.

5. An information processing device as described in claim 4, wherein the notification control means increases the amount of information to be notified when the notification event occurs in a first area where it is difficult to check the situation, compared to the amount of information to be notified when the notification event occurs in a second area where it is easy to check the situation.

6. An information processing device as claimed in any one of claims 1 to 5, wherein the notification includes instructions for actions to be taken in response to the notification event that has occurred, and the notification control means changes the content of the instructions depending on the status of the mobile body.

7. An information processing device according to any one of claims 1 to 6, wherein the notification means issues the notification via an output device including two or more of a display device for the driver, a speaker for the driver, a light for the driver, a vibrator for the driver, a display device for workers other than the driver, a speaker for workers other than the driver, a light for workers other than the driver, a vibrator for workers other than the driver, a display device for passengers, a speaker for passengers, and a light for passengers, and the notification control means determines the output device that will issue the notification depending on the status of the moving body.

8. An information processing device as claimed in any one of claims 1 to 7, wherein the notification control means calculates a degree of danger based on the status of the moving body, and changes at least one of the notification method and notification content in the notification according to the degree of danger.

9. An information processing method in which one or more computers detect a notification event that occurs in a mobile object, notify the detection of the notification event, obtain status information indicating the status of the mobile object, and change at least one of the notification method and notification content in the notification depending on the status of the mobile object.

10. The information processing method of claim 9, wherein the status information includes at least one of the following: information indicating the location within the mobile body where the notification event occurred; information indicating the location of the mobile body; information indicating the future driving route of the mobile body; information indicating the road conditions at the current location of the mobile body; information indicating the road conditions along which the mobile body will travel in the future; information indicating the current driving conditions of the mobile body; information about passengers; and information about passengers who are parties to the notification event.

11. An information processing method according to claim 9 or 10, wherein the amount of information to be notified is changed depending on the state of the mobile unit.

12. The information processing method according to claim 11, wherein the amount of information to be notified is changed depending on the location within the mobile body where the notifiable event occurs.

13. An information processing method as described in claim 12, wherein the amount of information notified when the notification event occurs in a first area where it is difficult to check the situation is greater than the amount of information notified when the notification event occurs in a second area where it is easy to check the situation.

14. An information processing method according to any one of claims 9 to 13, wherein the notification includes instructions for actions to be taken in response to the notified event that has occurred, and the content of the instructions is changed depending on the status of the mobile body.

15. A recording medium having recorded thereon a program that causes a computer to function as: a detection means for detecting a notification event that occurs in a mobile body; a notification means for notifying the detection of said notification event; an acquisition means for acquiring status information indicating the status of said mobile body; and a notification control means for changing at least one of the notification method and notification content in said notification depending on the status of said mobile body.

16. The recording medium described in claim 15, wherein the status information includes at least one of the following: information indicating the location within the mobile body where the notification event occurred; information indicating the location of the mobile body; information indicating the future driving route of the mobile body; information indicating the road conditions at the current location of the mobile body; information indicating the road conditions along which the mobile body will drive in the future; information indicating the current driving conditions of the mobile body; information about passengers; and information about passengers who are involved in the notification event.

17. A recording medium according to claim 15 or 16, wherein said notification control means changes the amount of information to be notified depending on the status of said moving body.

18. A recording medium according to claim 17, wherein said notification control means changes the amount of information to be notified depending on the location within said mobile body where said notification event has occurred.

19. A recording medium as described in claim 18, wherein the notification control means increases the amount of information to be notified when the notification event occurs in a first area where it is difficult to check the situation, compared to the amount of information to be notified when the notification event occurs in a second area where it is easy to check the situation.

20. A recording medium according to any one of claims 15 to 19, wherein the notification includes instructions for actions to be taken in response to the notification event that has occurred, and the notification control means changes the content of the instructions depending on the status of the mobile body.

Images