WARNING PRESENTATION METHOD, WARNING PRESENTATION DEVICE, AND WARNING PRESENTATION PROGRAM

Abstract

To provide a warning presentation method, a warning presentation device, and a warning presentation program capable of keeping an awakening effect by presenting new warning.SOLUTION: A warning presentation method #100 is a method for presenting warning to a warning object person by a warning generation section which generates warning when reduction of an awakening level of the warning object person is detected. The warning presentation method #100 includes: a localization reaction detection process #120 of detecting presence / absence of a localization reaction of the warning object person with respect to the warning; and a warning change instruction process #130 of instructing the warning generation section to generate warning after changing when the localization reaction of the warning object person is not detected in the localization reaction detection process #120. The warning change instruction process #130 includes a process of determining that the warning object person gets used to the warning when the localization reaction of the warning object person is not detected, so as to instruct the warning generation section to generate warning after changing the warning.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an alarm presentation method, an alarm presentation device, and an alarm presentation program for presenting an alarm to a target person by an alarm generation unit that generates an alarm when a decrease in the alertness of the target person is detected. [Background technology]

[0002] Systems that primarily detect drowsiness in automobile drivers and issue warnings provide appropriate warnings by presenting different warning sounds depending on the driver's level of drowsiness, their physical and mental state, and whether or not they react to the warning, or by changing the threshold for determining whether or not to issue a warning.

[0003] A conventional drowsiness warning device (hereinafter referred to as Prior Art 1) includes a drowsiness level judgment means for judging the driver's drowsiness level, a preliminary warning means for issuing a preliminary warning when the drowsiness level exceeds a warning threshold, a warning means for issuing a main warning to encourage the driver to wake up from drowsiness after the preliminary warning, a response detection means for detecting the driver's response after the preliminary warning, and a threshold change means for changing the warning threshold higher when the response is detected (see, for example, Patent Document 1). Prior Art 1 appropriately issues a preliminary warning and a main warning at a drowsiness level that matches the driver's sense while driving a vehicle.

[0004] A conventional drowsy driving warning device (hereinafter referred to as Prior Art 2) includes a driver image drowsiness level determining means for determining the driver's drowsiness level determined based on a captured image of the driver, a vehicle behavior drowsiness level determining means for determining the driver's drowsiness level based on the vehicle's behavior, a total drowsiness level determining means for determining a total drowsiness level based on these drowsiness levels, and a warning level setting means for setting a warning level based on the frequency distribution of the total drowsiness level (see, for example, Patent Document 2). Prior Art 2 accurately determines the driver's drowsiness level, and outputs a warning from an output device according to the driver's drowsiness level.

[0005] A conventional notification system (hereinafter referred to as Prior Art 3) includes a first detection means for detecting a correlation value of the driver's drowsiness level based on a facial image of the driver, a second detection means for detecting a correlation value of the driver's wakefulness effort level based on the driver's biological information, an alarm command means for commanding an alarm based on the correlation value of the driver's drowsiness level, and an alarm reduction means for commanding a reduction in the alarm based on the correlation value of the driver's wakefulness effort level (see, for example, Patent Document 3). In Prior Art 3, when the driver makes an effort to wake up and his drowsiness is reduced, the alarm is reduced or stopped, preventing the alarm from continuing after the driver's drowsiness level has been reduced. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-113925 A

[0007] [Patent Document 2] JP 2019-016178 A

[0008] [Patent Document 3] JP 2012-093867 A Summary of the Invention [Problem to be solved by the invention]

[0009] In conventional techniques 1 to 3, when a driver becomes drowsy, a warning sound is presented to wake the driver up, but if the driver experiences this warning sound multiple times, the driver becomes accustomed to the warning sound, and the warning sound no longer has the same effect as it did initially.

[0010] An object of the present invention is to provide an alarm presentation method, an alarm presentation device, and an alarm presentation program that can maintain the awakening effect by presenting a new alarm. [Means for solving the problem]

[0011] The present invention solves the above problems by the means described below. In addition, although the present invention will be described with reference to corresponding reference numerals, the present invention is not limited to this embodiment. The invention of claim 1 is a method for presenting a warning to a warning target (M) by a warning generating unit (6c) that generates a warning when a decrease in the level of wakefulness of the warning target (M) is detected, as shown in Figs. 1 to 3 and 5, Generate (T 1 ) within a given time (ΔT) The alarm presentation method (#100) includes an orientation response detection process (#120) for detecting whether or not there is an orientation response from the person to whom the alarm is to be applied, and an alarm change command process (#130) for commanding the alarm generation unit to change and issue the alarm when no orientation response from the person to whom the alarm is to be applied is detected in the orientation response detection process.

[0012] The invention of claim 2 is the alarm presentation method according to claim 1, characterized in that the alarm change command step (#120) includes a step of determining that the alarm recipient has become accustomed to the alarm when an orientation response is not detected from the alarm recipient, and commanding the alarm generation unit to change and generate the alarm.

[0013] The invention of claim 3 is a warning presentation method according to claim 1 or 2, characterized in that, as shown in Figures 3 and 5, the localized response detection step (#120) includes a step of detecting whether or not there is a temporary decrease in the heart rate of the person to be warned immediately after the warning generation unit generates an alarm sound, and the warning change command step (#130) includes a step of commanding the warning generation unit to change and generate the alarm sound when a temporary decrease in the heart rate of the person to be warned is not detected in the localized response detection step.

[0014] The invention of claim 4 is the alarm presentation method according to claim 1 or 2, characterized in that the localized response detection process (#120) includes a process of detecting whether or not there is a temporary decrease in the pulse rate of the person to be alarmed immediately after the alarm generation unit generates an alarm sound, and the alarm change command process (#130) includes a process of commanding the alarm generation unit to change the alarm sound and generate it when a temporary decrease in the pulse rate of the person to be alarmed is not detected in the localized response detection process.

[0015] The invention of claim 5 is an alarm presentation method according to claim 1 or claim 2, characterized in that the localized response detection process (#120) includes a process for detecting whether or not there is a temporary increase in the electrodermal activity of the person to be alarmed immediately after the alarm generation unit generates an alarm sound, and the alarm change command process (#130) includes a process for commanding the alarm generation unit to change and generate the alarm sound when a temporary increase in the electrodermal activity of the person to be alarmed is not detected in the localized response detection process.

[0016] The invention of claim 6 is an alarm presentation method according to claim 1 or claim 2, characterized in that the localized response detection process (#120) includes a process of detecting whether or not there is a temporary decrease in the skin temperature of the person to be alarmed immediately after the alarm generation unit generates an alarm sound, and the alarm change command process (#130) includes a process of commanding the alarm generation unit to change and generate the alarm sound when a temporary decrease in the skin temperature of the person to be alarmed is not detected in the localized response detection process.

[0017] The invention of claim 7 is an alarm presentation method according to claim 1 or claim 2, characterized in that the localized response detection process (#120) includes a process for detecting whether or not there is an increase in a characteristic brain wave occurring in the person to be alarmed immediately after the alarm generation unit generates an alarm sound, and the alarm change command process (#130) includes a process for commanding the alarm generation unit to change and generate the alarm sound when no increase in a characteristic brain wave occurring in the person to be alarmed is detected in the localized response detection process.

[0018] The invention of claim 8 is a warning presentation device for presenting a warning to a warning target (M) by a warning generation unit (6c) that generates a warning when a decrease in the level of awakening of the warning target (M) is detected, as shown in Figs. 1 to 3, Generate (T 1 ) within a given time (ΔT) The alarm presentation device (6) includes an orientation response detection unit (6f) that detects whether or not there is an orientation response from the person to whom the alarm is to be sent, and an alarm change command unit (6g) that commands the alarm generation unit to change and issue the alarm when the orientation response detection unit does not detect an orientation response from the person to whom the alarm is to be sent.

[0019] The invention of claim 9 is a warning presentation program for presenting a warning to a warning target person (M) by a warning generation unit (6c) that generates a warning when a decrease in the level of wakefulness of the warning target person (M) is detected, as shown in Figs. 1 to 3 and 6, Within a specified time after the occurrence of This is an alarm presentation program that causes a computer to execute an orientation response detection procedure (S140, S170, S210) for detecting whether or not there is an orientation response from the person to whom the alarm is to be applied, and an alarm change command procedure (S150, S190) for commanding the alarm generation unit to change and issue the alarm when no orientation response from the person to whom the alarm is to be applied is detected in the orientation response detection procedure. Effect of the Invention

[0020] According to the present invention, the wakefulness effect can be maintained by presenting a new alarm. [Brief description of the drawings]

[0021] [Figure 1] 1 is a schematic diagram showing a configuration of a support system for preventing a decrease in alertness level that includes a warning presentation device according to a first embodiment of the present invention. [Diagram 2] 1 is a configuration diagram that illustrates a warning presentation device according to a first embodiment of the present invention. [Diagram 3] 4 is a graph showing a schematic diagram of a detection operation of a localization response detection unit of the warning presentation device according to the first embodiment of the present invention. [Figure 4] 4 is a graph showing, as an example, a change in average heart rate before and after alarm presentation detected by the localization response detection unit of the alarm presentation device according to the first embodiment of the present invention. [Diagram 5] 1 is a process diagram of a warning presentation method according to a first embodiment of the present invention. [Figure 6] 5 is a flowchart illustrating the operation of the alert presentation device according to the first embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] (First embodiment) Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings. 1 is a warning target to whom a warning is presented by the warning presentation device 6. The driver M is, for example, a driving train crew member who is always on duty in order to operate a railroad vehicle such as a locomotive, an electric car, or an internal combustion railcar having a power generating device.

[0023] The support system 1 for preventing a decrease in alertness level shown in Fig. 2 is a system for supporting prevention of a decrease in the alertness level of a driver M while driving a train. The support system 1 for preventing a decrease in alertness level detects the face of the driver M based on a photographed image of the driver M, extracts feature points, and estimates the alertness (sleepiness) level of the driver M based on the feature points of the driver M's face, thereby detecting the onset of drowsiness in the driver M and presenting a warning to the driver M. The support system 1 for preventing a decrease in alertness level includes a photographing device 2, a face detecting device 3, an alertness estimating device 4, a physiological index measuring device 5, a warning presenting device 6, and the like.

[0024] The photographing device 2 is a device that photographs the driver M. The photographing device 2 is installed in the driver's cab (crew room) of the train, and photographs the head of the driver M in the cab. The photographing device 2 is adaptable to various light environments in the cab, and includes an infrared illuminator 2a that irradiates the driver M with an appropriate amount of infrared light, and a near-infrared camera 2b that photographs the driver M.

[0025] The face detection device 3 is a device that detects the face of the driver M. The face detection device 3 detects the face of the driver M based on the head image of the driver M captured by the photographing device 2, and extracts feature points of the driver M. The face detection device 3 extracts the face area of ​​the driver M from the head image of the driver M by machine learning. Here, machine learning is a type of artificial intelligence, and is a computer algorithm that automatically improves by learning from experience. Machine learning is capable of grasping the characteristics of the data and making identification or predictions by learning from the data.

[0026] The alertness estimation device 4 is a device that estimates the alertness of the driver M. The alertness estimation device 4 analyzes the face image of the driver M detected by the face detection device 3 to calculate an alertness estimation value (drowsiness rating value). For example, the alertness estimation device 4 estimates the alertness of the driver M by multivariate analysis or machine learning based on frame-by-frame images of the feature points of the driver M, or estimates the alertness of the driver M by machine learning based on time-series images of the feature points of the driver M. The alertness estimation device 4 outputs an alarm command signal to the alarm presentation device 6 so that the alarm presentation device 6 presents an alarm according to the alertness estimation value, thereby commanding the alarm presentation device 6 to perform an alarm presentation operation.

[0027] The physiological index measuring device 5 is a device that measures the physiological index of the driver M. The physiological index measuring device 5 measures the heart rate of the driver M as a physiological index. Here, the heart rate is the number of times the heart pulsates within a certain period of time. The physiological index measuring device 5 is, for example, a device that is attached to a master controller handle that the driver M manually operates while driving and measures the heart rate of the driver M, or a wearable device of clothing type or wristwatch type that is worn on the clothes or arm of the driver M and measures the heart rate of the driver M. The physiological index measuring device 5 outputs the heart rate of the driver M after measurement to the warning presentation device 6 as physiological index data.

[0028] The warning presentation device 6 shown in FIG. 2 and FIG. 3 is a device that presents a warning to the driver M by the warning generation unit 6c when a decrease in the driver M's level of arousal is detected. The warning presentation device 6 presents a warning sound to the driver M when the arousal level estimation device 4 detects a decrease in the driver M's level of arousal. The warning presentation device 6 presents a new warning to the driver M when no orientation response is observed in the driver M immediately after presenting the warning to the driver M. Here, the orientation response (orientation reflex) refers to a behavior in which attention is directed toward a stimulus when some stimulus is presented to a living body from the outside. The orientation response is one of the physiological indices for the warning sound, and is a phenomenon such as a temporary decrease in heart rate that is seen when attention is directed to a new matter. The orientation response disappears when the presentation of the warning sound becomes routine and habituation (familiarity or familiarity) occurs. Here, habituation is a phenomenon in which a reaction to a certain stimulus is gradually lost due to repeated presentation of the stimulus, and is one of the concepts in psychology.

[0029] The warning presentation device 6 detects the presence or absence of the driver M's orientation response based on the driver M's heart rate, and changes and presents a warning when the driver M's orientation response is not detected. The warning presentation device 6 presents a warning according to the driver M's awakening level based on the awakening level estimated value estimated by the awakening level estimation device 4. For example, the warning presentation device 6 generates a loud warning sound when the driver M is relatively drowsy, and generates a soft warning sound when the driver M is relatively drowsy. As shown in FIG. 3, the warning presentation device 6 includes a warning command signal input unit 6a, a physiological index data input unit 6b, a warning generation unit 6c, a warning data storage unit 6d, a physiological index data storage unit 6e, a orientation response detection unit 6f, a warning change command unit 6g, a warning condition setting unit 6h, a warning condition storage unit 6i, a warning presentation program storage unit 6j, a control unit 6k, and the like. The warning presentation device 6 is composed of, for example, a personal computer, and when a decrease in the driver M's level of alertness is detected, the warning presentation device 6 causes the computer to execute a predetermined process in accordance with a warning presentation program for presenting a warning to the driver M via the warning generation unit 6c.

[0030] The alarm command signal input unit 6a shown in Fig. 3 is a means for inputting an alarm command signal output by the arousal level estimation device 4. The alarm command signal input unit 6a is, for example, an interface (I / F) circuit that inputs an alarm command signal from the arousal level estimation device 4 to the control unit 6k. The physiological index data input unit 6b is a means for inputting physiological index data output by the physiological index measuring device 5. The physiological index data input unit 6b is, for example, an interface (I / F) circuit that inputs an alarm command signal from the physiological index measuring device 5 to the control unit 6k.

[0031] The alarm generating unit 6c is a means for generating an alarm. The alarm generating unit 6c presents an alarm to the driver M through his sense of hearing by generating an alarm sound. The alarm generating unit 6c is, for example, an acoustic device such as a speaker that converts an electrical signal into sound. The alarm generating unit 6c presents an alarm according to the alertness (sleepiness) of the driver M based on the overall estimated value calculated by the alertness estimation device 4. The alarm generating unit 6c changes and generates multiple pre-prepared alarms in accordance with the set change conditions based on the alarm data stored in the alarm data storage unit 6d and the alarm condition data stored in the alarm condition storage unit 6i.

[0032] The alarm data storage unit 6d is a means for storing the alarm generated by the alarm generating unit 6c as alarm data. The alarm data storage unit 6d is, for example, a storage device that stores a plurality of different types of alarm sounds as alarm sound data. The alarm data storage unit 6d stores, as alarm sound data, sounds that can be distinguished from the running sounds of the vehicle in which the driver M is driving, are not mistaken for sounds in the driver's compartment or sounds of daily life, and are likely to wake the driver M up. The alarm data storage unit 6d stores, for example, three types of alarms A to C with different alarm sounds as alarm data.

[0033] The physiological index data storage unit 6e is a means for storing the physiological index data output by the physiological index measurement device 5. The physiological index data storage unit 6e is, for example, a storage device that stores the heart rate of the driver M in a chronological order in a manner that allows updating in association with time.

[0034] The orientation response detection unit 6f is a means for detecting the presence or absence of an orientation response of the driver M to the alarm. The orientation response detection unit 6f detects an orientation response within a predetermined time (for example, 10 seconds after the alarm is presented) after the alarm generation unit 6c generates an alarm based on the physiological index data stored in the physiological index data storage unit 6e. The orientation response detection unit 6f detects the presence or absence of a temporary decrease in the heart rate of the driver M immediately after the alarm generation unit 6c generates an alarm sound. For example, as shown in FIG. 3, the orientation response detection unit 6f detects the presence or absence of a decrease in the heart rate within a predetermined time ΔT from the alarm presentation time T1 to the orientation response detection end time T2. Here, the vertical axis in FIG. 3 is the heart rate, and the horizontal axis is the time. The orientation response detection unit 6f determines that an orientation response exists when the heart rate decreases immediately after the alarm is presented, and determines that an orientation response does not exist when the heart rate does not change or increases immediately after the alarm is presented.

[0035] FIG. 4 is a graph showing an example of the change in average heart rate before and after the presentation of an alarm. The vertical axis in FIG. 4 is the average heart rate (bpm), and the horizontal axis is the calculation time of the average heart rate. bpm (Beats Per Minute) is a unit of heart rate, which is the number of times the heart beats in one minute. As shown in FIG. 4, statistical verification has shown that when there is a possibility of a localization reaction, the heart rate is lower 10 seconds after the presentation of an alarm than the heart rate one minute before the presentation of the alarm, and the heart rate recovers one minute after the presentation of the alarm.

[0036] The orientation response detection unit 6f shown in FIG. 3 judges whether the heart rate decrease rate is equal to or lower than a threshold value, and judges that there is no orientation response when the heart rate decrease rate is equal to or lower than the threshold value, and judges that there is an orientation response when the heart rate decrease rate exceeds the threshold value. Here, the heart rate decrease rate is [bpmR-bpmA]*100 / bpmR(%) when the average heart rate (bpmR) is the average heart rate (bpmA) immediately after the alarm (up to 10 seconds). The heart rate decrease rate is a positive value when the average heart rate immediately after the alarm decreases, and is a negative value when the average heart rate immediately after the alarm increases. The heart rate decrease rate is a value greater than zero when there is an orientation response. The orientation response detection unit 6f calculates the heart rate decrease rate based on the measurement result of the physiological index measurement device 5, and judges whether the heart rate decrease rate is equal to or lower than a threshold value. The orientation response detection unit 6f outputs the detection result of the presence or absence of an orientation response to the control unit 6k as an orientation response detection signal (orientation response detection data).

[0037] The alarm change command unit 6g is a means for commanding the alarm generation unit 6c to change and issue an alarm when the orientation response detection unit 6f does not detect the orientation response of the driver M. The alarm change command unit 6g commands the alarm generation unit 6c to change and issue an alarm based on the detection result of the orientation response detection unit 6f. When the orientation response of the driver M is not detected, the alarm change command unit 6g determines that the driver M is accustomed to the alarm and commands the alarm generation unit 6c to change and issue the alarm. When the orientation response detection unit 6f does not detect a temporary decrease in the driver M's heart rate, the alarm change command unit 6g commands the alarm generation unit 6c to change and issue the alarm. As shown in FIG. 3, when a decrease in heart rate is recognized within a predetermined time ΔT and an orientation response is detected, the alarm change command unit 6g determines that the driver M is not accustomed to the alarm and does not command the alarm generation unit 6c to change the alarm. On the other hand, when no decrease in heart rate is observed within the specified time ΔT and no orientation response is detected, the alarm change command unit 6g determines that the driver M has become accustomed to the alarm and commands the alarm generation unit 6c to change the alarm.

[0038] The alarm condition setting unit 6h is a means for setting the conditions of an alarm generated by the alarm generating unit 6c. The alarm condition setting unit 6h sets a change condition when changing and presenting an alarm. The alarm condition setting unit 6h is, for example, an input device or an auxiliary input device that inputs various information to the alarm presentation device 6 by manual operation of a setter. The alarm condition setting unit 6h sets a change condition such that the alarm sound changes stepwise when changing and presenting an alarm sound, sets the order of presenting the alarm sound as a change condition, sets a change condition such that the alarm sound changes randomly, or sets a change condition such that the alarm sound changes to a high alarm sound and a low alarm sound having a high effect of awakening drowsiness. The alarm condition setting unit 6h is set, for example, to present different alarms A to C in the order of alarms A to C. The alarm condition setting unit 6h outputs the set change condition to the control unit 6k as change condition data.

[0039] The alarm condition storage unit 6i is a means for storing the alarm conditions set by the alarm condition setting unit 6h. The alarm condition storage unit 6i is, for example, a storage device that stores the alarm conditions set by the alarm condition setting unit 6h as alarm condition data in an updatable manner.

[0040] The warning presentation program storage unit 6j is a means for storing a warning presentation program for causing the warning generating unit 6c to present a warning to the driver M when a decrease in the driver M's level of alertness is detected. The warning presentation program storage unit 6j is a storage device that stores a warning presentation program read from an information recording medium or a warning presentation program downloaded via an electric communication line.

[0041] The control unit 6k is a central processing unit (CPU) that controls various operations related to the warning presentation device 6. The control unit 6k reads out a warning presentation program from the warning presentation program storage unit 6j, and executes a predetermined warning presentation process in accordance with the warning presentation program. The control unit 6k, for example, when an alarm command signal is input from the alarm command signal input unit 6a, causes the alarm generating unit 6c to generate an alarm, reads alarm data from the alarm data storage unit 6d and causes the alarm generating unit 6c to generate an alarm based on the alarm data, outputs physiological index data input from the physiological index data input unit 6b to the physiological index data storage unit 6e, instructs the physiological index data storage unit 6e to store the physiological index data, reads physiological index data from the physiological index data storage unit 6e and outputs it to the orientation response detection unit 6f, instructs the orientation response detection unit 6f to detect the presence or absence of an orientation response, instructs the alarm change command unit 6g to change an alarm based on the detection result of the orientation response detection unit 6f, outputs alarm condition data output by the alarm condition setting unit 6h to the alarm condition storage unit 6i, instructs the alarm condition storage unit 6i to store the alarm condition data, reads alarm condition data from the alarm condition storage unit 6i and causes the alarm generating unit 6c to generate an alarm based on the alarm condition data, and so on. The control unit 6k is connected to an alarm command signal input unit 6a, a physiological index data input unit 6b, an alarm generation unit 6c, an alarm data memory unit 6d, a physiological index data memory unit 6e, a localization response detection unit 6f, an alarm change command unit 6g, an alarm condition setting unit 6h, an alarm condition memory unit 6i, and an alarm presentation program memory unit 6j so that they can communicate with each other.

[0042] Next, a warning presentation method according to a first embodiment of the present invention will be described. 5 is a method for presenting an alarm to the driver M by the alarm generating unit 6c when a decrease in the driver M's level of alertness is detected. The alarm presenting method #100 includes an alarm presenting step #110, an orientation response detecting step #120, an alarm change command step #130, an alarm presenting step #140, and the like.

[0043] The warning presentation step #110 is a step of presenting a warning to the driver M. When the warning level estimation device 4 estimates that the driver M's level of alertness has decreased, the warning level estimation device 4 outputs a warning command signal to the warning presentation device 6, and the warning generation unit 6c of the warning presentation device 6 generates a warning.

[0044] Localization anti The response detection step #120 is a step of detecting whether or not the driver M has an orientation response to the alarm. The orientation response detection unit 6f evaluates physiological index data of the driver M immediately after the alarm generation unit 6c generates an alarm, and the orientation response detection unit 6f determines whether or not there is an orientation response. In the orientation response detection step #120, as shown in FIG. 3, the orientation response detection unit 6f detects whether or not there is a temporary decrease in the heart rate of the driver M immediately after the alarm generation unit 6c generates an alarm sound. For example, based on the physiological index data of the driver M immediately after the alarm is generated, the orientation response detection unit 6f determines whether or not the heart rate decrease rate is equal to or lower than a threshold value, and when the heart rate change rate is equal to or lower than the threshold value, the orientation response detection unit 6f determines that the driver M has not had an orientation response.

[0045] The alarm change command process #130 is a process of commanding the alarm generating unit 6c to change and generate an alarm when the driver M's orientation response is not detected in the orientation response detection process #120. In the alarm change command process #130, when the driver M's orientation response is not detected, it is determined that the driver M is accustomed to the alarm, and the alarm generating unit 6c is commanded to change and generate an alarm. In the alarm change command process #130, as shown in FIG. 3, when a temporary decrease in the driver M's heart rate is not detected in the orientation response detection process #120, the alarm generating unit 6c is commanded to change and generate an alarm sound. For example, when the driver M does not have an orientation response, it is considered that the driver M has become accustomed to the presentation of the alarm and has lost his orientation response, so the alarm change command unit 6g commands the alarm generating unit 6c to change and generate an alarm.

[0046] The alarm presentation process #140 is a process of presenting an alarm to the driver M. When the alarm change command unit 6g commands a change in the alarm, the alarm generation unit 6c presents a new alarm. For example, the alarm generation unit 6c generates an alarm B that is different from the initial alarm A. After the alarm presentation process #140, the process returns to the orientation response detection process #120, where the orientation response detection unit 6f determines whether or not the driver M has responded to the new alarm B, and the steps from the orientation response detection process #120 onwards are repeated.

[0047] Next, the operation of the warning presentation device according to the first embodiment of the present invention will be described. The following description will focus on the operation of the control unit 6k shown in FIG. 3, and will be given by way of example of a case in which three different types of alarms A to C are presented. 6, the control unit 6k reads the warning presentation program from the warning presentation program storage unit 6j. When the control unit 6k reads the warning presentation program, the control unit 6k executes a series of warning presentation processes.

[0048] In S110, the control unit 6k commands the physiological index data storage unit 6e to store the physiological index data. When the driver M starts driving, the physiological index measuring device 5 starts measuring the physiological indexes of the driver M. As a result, the physiological index measuring device 5 outputs the physiological index data to the control unit 6k through the physiological index data input unit 6b of the warning presentation device 6, and the physiological index data is stored in chronological order by the physiological index data storage unit 6e. For example, the physiological index measuring device 5 starts measuring the heart rate of the driver M, and the heart rate data is stored as physiological index data in the physiological index data storage unit 6e.

[0049] In S120, the control unit 6k judges whether an alarm command signal has been input. The alertness estimation device 4 estimates the alertness of the driver M based on the image of the driver M captured by the photographing device 2. When the alertness estimation device 4 judges that the alertness level of the driver M is equal to or lower than the threshold value and that the alertness of the driver M has decreased, the alertness estimation device 4 outputs an alarm command signal to the control unit 6k via the alarm command signal input unit 6a of the alarm presentation device 6. When the control unit 6k judges that an alarm command signal has been input, the process proceeds to S130, and when the control unit 6k judges that an alarm command signal has not been input, the control unit 6k repeats the judgment of S120 until an alarm command signal is input.

[0050] In S130, the control unit 6k commands the alarm generating unit 6c to present the alarm A. The control unit 6k reads out alarm data from the alarm data storage unit 6d and outputs the alarm data to the alarm generating unit 6c, while the control unit 6k reads out alarm condition data from the alarm condition storage unit 6i and outputs the alarm condition data to the alarm generating unit 6c. As a result, the alarm generating unit 6c generates an alarm sound corresponding to the alarm A for the driver M.

[0051] In S140, the control unit 6k commands the orientation response detection unit 6f to detect the presence or absence of an orientation response of the driver M. The control unit 6k reads out physiological index data from the physiological index data storage unit 6e, and outputs this physiological index data to the orientation response detection unit 6f. As a result, based on the physiological index data before the presentation of the alarm A and the physiological index data immediately after the presentation of the alarm A, the orientation response detection unit 6f detects the presence or absence of an orientation response of the driver M during a predetermined time ΔT from time T1 to time T2 immediately after the presentation of the alarm, as shown in FIG. 3. For example, the orientation response detection unit 6f detects the rate of decrease in the driver M's heart rate to determine the presence or absence of an orientation response of the driver M. When the orientation response detection unit 6f determines that the driver M has an orientation response, the process returns to S120, and when the control unit 6k determines that an alarm command signal has been input in S120, the same alarm A is presented again in S130. On the other hand, when the orientation response detection unit 6f determines that there is no orientation response from the driver M, the process proceeds to S150.

[0052] In S150, the alarm change command unit 6g commands the alarm generating unit 6c to change the alarm A. When the localization response detection unit 6f does not detect the localization response of the driver M, the localization response detection unit 6f outputs a localization response detection signal to the control unit 6k, and the control unit 6k commands the alarm change command unit 6g to change the alarm generated by the alarm generating unit 6c. The control unit 6k reads alarm data from the alarm data storage unit 6d and outputs the alarm data to the alarm generating unit 6c, while the control unit 6k reads alarm condition data from the alarm condition storage unit 6i and outputs the alarm condition data to the alarm generating unit 6c. For example, when the alarm change command unit 6g commands the alarm generating unit 6c to change the alarm, the alarm generating unit 6c determines the order of generating the three types of alarms A to C based on the alarm data and alarm condition data each time an alarm command signal is input. As a result, the alarm change command unit 6g commands the alarm generating unit 6c to change the alarm A to alarm B and generate it.

[0053] In S160, the control unit 6k commands the alarm generating unit 6c to present an alarm B. As a result, the alarm generating unit 6c presents an alarm sound corresponding to alarm B to the driver M instead of alarm A. In S170, the control unit 6k commands the orientation response detection unit 6f to detect the presence or absence of an orientation response from the driver M. When the orientation response detection unit 6f determines that the driver M has an orientation response, the process proceeds to S180, and when the orientation response detection unit 6f determines that the driver M has not had an orientation response, the process proceeds to S190. In S180, the control unit 6k determines whether an alarm command signal has been input. When the control unit 6k determines that an alarm command signal has been input, the process returns to S160, and the same alarm B is presented again in S160. On the other hand, when the control unit 6k determines that an alarm command signal has not been input, the control unit 6k repeats the determination in S160 until an alarm command signal is input.

[0054] In S190, the alarm change command unit 6g commands the alarm generating unit 6c to change the alarm B. As a result, the alarm change command unit 6g commands the alarm generating unit 6c to change the alarm B to alarm C and generate it. In S200, the control unit 6k commands the alarm generating unit 6c to present the alarm C. As a result, the alarm generating unit 6c presents an alarm sound corresponding to the alarm C to the driver M instead of the alarm B. In S210, the control unit 6k commands the orientation response detection unit 6f to detect the presence or absence of an orientation response of the driver M. When the orientation response detection unit 6f determines that the driver M has an orientation response, the process proceeds to S220, and when the orientation response detection unit 6f determines that the driver M has no orientation response, the control unit 6k ends the series of alarm presentation processes. In S220, the control unit 6k judges whether an alarm command signal has been input. When the control unit 6k determines that an alarm command signal has been input, the process returns to S200, and the same alarm C is presented again in S200. On the other hand, when the control unit 6k determines that the alarm command signal has not been input, the control unit 6k repeats the determination of S220 until the alarm command signal is input.

[0055] The warning presentation method, the warning presentation device, and the warning presentation program according to the first embodiment of the present invention have the following advantages. (1) In the first embodiment, the presence or absence of the driver M's orientation response to the alarm is detected, and when the driver M's orientation response is not detected, the alarm generating unit 6c is commanded to change and generate an alarm. Therefore, the driver M is encouraged to be awakened by presenting a new alarm to the driver M, and it is possible to prevent the driver M from becoming accustomed to the alarm and the driver M's level of awakening from decreasing, and the awakening effect can be maintained.

[0056] (2) In this first embodiment, when the driver M's orientation response is not detected, it is determined that the driver M has become accustomed to the alarm, and the alarm generating unit 6c is instructed to change and issue the alarm. As a result, the driver M's orientation response is measured in order to accommodate the driver M's habituation to the alarm, which differs from driver to driver, and when the orientation response exceeds a certain threshold, it is determined that the orientation response to the alarm has disappeared. Therefore, by automatically issuing a new alarm, the initial awakening effect can be maintained or the awakening effect can be encouraged to return.

[0057] (3) In the first embodiment, the alarm generating unit 6c detects whether or not there is a temporary decrease in the heart rate of the driver M immediately after generating an alarm sound, and when a temporary decrease in the heart rate of the driver M is not detected, the alarm generating unit 6c is instructed to change and generate the alarm sound. For this reason, for example, when the driver M is drowsy while driving a railway vehicle and an alarm sound is presented to the driver M, if the driver M becomes accustomed to the sound due to repeated ringing and a physiological index indicates that the awakening effect has decreased, the initial awakening effect can be maintained by presenting a new alarm sound.

[0058] Second embodiment In the following, the same parts as those shown in Figs. 1 to 6 are denoted by the same reference numerals and detailed description thereof will be omitted. In the second embodiment, unlike the first embodiment, the presence or absence of an orientation response of the driver M is detected based on the pulse of the driver M, and a different alarm is issued when the orientation response of the driver M is not detected. The physiological index measuring device 5 shown in FIG. 2 measures the pulse of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a wristwatch-type biosignal acquiring device that is attached to a master controller handle that is manually operated by the driver M while driving and measures the pulse of the driver M. The physiological index measuring device 5 outputs the pulse of the driver M after measurement to the alarm presentation device 6 as physiological index data.

[0059] The alarm presentation device 6 detects the presence or absence of the orientation response of the driver M based on the pulse of the driver M, and when the orientation response of the driver M is not detected, the alarm presentation device 6 changes and issues an alarm. Here, the pulse is the pulsation that occurs in the artery when the heart pumps blood. The physiological index data storage unit 6e, for example, stores the pulse of the driver M in a chronological order in a manner that allows updating in correspondence with time. The orientation response detection unit 6f detects the presence or absence of a temporary decrease in the pulse of the driver M immediately after the alarm generation unit 6c generates an alarm sound. The orientation response detection unit 6f determines that there is an orientation response when the pulse rate decreases immediately after the alarm presentation, and determines that there is no orientation response when the pulse rate does not change or increases immediately after the alarm presentation. The alarm change command unit 6g commands the alarm generation unit 6c to change and issue an alarm sound when the orientation response detection unit 6f does not detect a temporary decrease in the pulse of the driver M.

[0060] The warning presentation method, warning presentation device, and warning presentation program according to the second embodiment of the present invention have the following advantages in addition to the advantages of the first embodiment. In this first embodiment, the alarm generating unit 6c detects whether or not there is a temporary decrease in the pulse rate of the driver M immediately after generating an alarm sound, and when a temporary decrease in the pulse rate of the driver M is not detected, the alarm generating unit 6c is instructed to change and generate an alarm sound. Therefore, it is possible to detect a decrease in the arousal effect by measuring the pulse rate, which has a high correlation with the heart rate, and to maintain the initial arousal effect by presenting a new alarm sound.

[0061] Third embodiment In the third embodiment, unlike the first and second embodiments, the presence or absence of the driver M's orientation response is detected based on the driver M's electrodermal activity, and when the driver M's orientation response is not detected, a different alarm is issued. Here, electrodermal activity (EDA) is electrical activity induced from electrodes attached to mental sweating sites. Generally, electrodermal activity appears as an electrical phenomenon caused by the activity of eccrine sweat glands, decorated by the state of the skin, sweat ducts, etc. Electrodermal activity includes skin conductance response (SCR), which is the electrical conductivity of the skin, and skin potential activity (SPA), which is the potential difference of the skin.

[0062] 2 measures the electrodermal activity of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biosignal acquiring device that is attached to the skin of the driver M and measures the electrical resistance or potential difference (absolute value of the skin potential) between two points on the skin of the driver M as the electrodermal activity. The physiological index measuring device 5 outputs the electrodermal activity of the driver M after measurement to the warning presentation device 6 as physiological index data.

[0063] The alarm presentation device 6 detects the presence or absence of an orientation response of the driver M based on the driver's electrodermal activity, and issues a modified alarm when the driver's orientation response is not detected. The physiological index data storage unit 6e, for example, stores the driver's electrodermal activity in a time-series manner in a manner that allows updating in correspondence with time. The orientation response detection unit 6f detects the presence or absence of a temporary increase in the driver's electrodermal activity immediately after the alarm generation unit 6c generates an alarm sound. The orientation response detection unit 6f determines that there is an orientation response when the electrodermal activity increases immediately after the alarm presentation, and determines that there is no orientation response when the electrodermal activity does not change or decreases immediately after the alarm presentation. The alarm change command unit 6g commands the alarm generation unit 6c to issue a modified alarm sound when the orientation response detection unit 6f does not detect a temporary increase in the driver's electrodermal activity.

[0064] The warning presentation method, warning presentation device, and warning presentation program according to the third embodiment of the present invention have the following advantages in addition to the advantages of the first embodiment. In the first embodiment, the alarm generating unit 6c detects whether or not there is a temporary increase in the electrodermal activity of the driver M immediately after generating an alarm sound, and when no temporary increase in the electrodermal activity of the driver M is detected, commands the alarm generating unit 6c to change and generate an alarm sound. Therefore, it is possible to detect a decrease in the arousal effect by measuring the electrodermal activity that appears as an orientation response, and to maintain the initial arousal effect by presenting a new alarm sound.

[0065] (Fourth embodiment) In this fourth embodiment, unlike the first to third embodiments, the presence or absence of an orientation response of the driver M is detected based on the skin temperature of the driver M, and a different alarm is issued when an orientation response of the driver M is not detected. The physiological index measuring device 5 shown in FIG. 2 measures the skin temperature of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biosignal acquiring device that is attached to the skin of the driver M or measures the peripheral skin temperature of the driver M in a non-contact manner at a distance from the driver M. The physiological index measuring device 5 outputs the skin temperature of the driver M after measurement to the alarm presentation device 6 as physiological index data.

[0066] The alarm presentation device 6 detects the presence or absence of an orientation response of the driver M based on the skin temperature of the driver M, and issues a modified alarm when the driver M's orientation response is not detected. The physiological index data storage unit 6e, for example, stores the driver M's skin temperature in a chronological order in a manner that allows updating in correspondence with time. The orientation response detection unit 6f detects the presence or absence of a temporary drop in the driver M's skin temperature immediately after the alarm generation unit 6c issues an alarm sound. The orientation response detection unit 6f determines that an orientation response exists when the skin temperature drops immediately after the alarm presentation, and determines that an orientation response does not exist when the skin temperature does not change or rises immediately after the alarm presentation. The alarm change command unit 6g commands the alarm generation unit 6c to issue a modified alarm when the orientation response detection unit 6f does not detect a temporary drop in the driver M's skin temperature.

[0067] In addition to the effects of the first embodiment, the warning presentation method, the warning presentation device, and the warning presentation program according to the fourth embodiment of the present invention have the following effects. In the fourth embodiment, the alarm generating unit 6c detects whether or not there is a temporary drop in the skin temperature of the driver M immediately after generating an alarm sound, and when a temporary drop in the skin temperature of the driver M is not detected, the alarm generating unit 6c is instructed to change and generate an alarm sound. For this reason, for example, a decrease in the arousal effect can be detected by measuring the peripheral skin temperature that drops due to vasoconstriction when there is an orientation response such as in the driver's nose, and the initial arousal effect can be maintained by presenting a new alarm sound.

[0068] Fifth embodiment In the fifth embodiment, unlike the first to fourth embodiments, the presence or absence of the orientation response of the driver M is detected based on the characteristic electroencephalogram of the driver M, and when the orientation response of the driver M is not detected, a different alarm is issued. Here, the electroencephalogram (EEG) is a signal that records a potential change that occurs with the activity of brain nerve cells. The characteristic electroencephalogram is, for example, a P200 component or a P300 component that indicates a positive voltage displacement 200 to 300 milliseconds after the presentation of a stimulus.

[0069] 2 measures the characteristic brain waves of the driver M as a physiological index. The physiological index measuring device 5 is, for example, a biological signal acquiring device such as an electroencephalograph that is attached to the head of the driver M and measures the brain waves of the driver M. The physiological index measuring device 5 outputs the characteristic brain waves of the driver M after measurement to the warning presentation device 6 as physiological index data.

[0070] The warning presentation device 6 detects the presence or absence of the driver M's orientation response based on the driver M's characteristic brain waves, and issues a modified warning when the driver M's orientation response is not detected. The physiological index data storage unit 6e, for example, stores the driver M's brain waves in a time-series manner in a manner that allows updating in correspondence with time. The orientation response detection unit 6f detects the presence or absence of a temporary increase in the characteristic brain waves that occur in the driver M immediately after the warning generation unit 6c issues a warning sound. The orientation response detection unit 6f determines that there is an orientation response when the characteristic brain waves that occur immediately after the warning presentation increase, and determines that there is no orientation response when the characteristic brain waves that occur immediately after the warning presentation do not increase. The warning change command unit 6g commands the warning generation unit 6c to issue a modified warning sound when the orientation response detection unit 6f does not detect a temporary increase in the characteristic brain waves that occur in the driver M.

[0071] The warning presentation method, warning presentation device, and warning presentation program according to the fifth embodiment of the present invention have the following advantages in addition to the advantages of the first embodiment. In the fifth embodiment, the alarm generating unit 6c detects whether or not there is a temporary increase in the characteristic brain waves occurring in the driver M immediately after generating an alarm sound, and when a temporary increase in the characteristic brain waves occurring in the driver M is not detected, the alarm generating unit 6c is instructed to generate a modified alarm sound. Therefore, by measuring the characteristic brain waves that are significantly generated in association with the presence of an orienting response, a decrease in the arousal effect can be detected, and the initial arousal effect can be maintained by presenting a new alarm sound.

[0072] (Other embodiments) The present invention is not limited to the above-described embodiment, and various modifications and variations are possible as described below, which are also within the scope of the present invention. (1) In this embodiment, the case where the person to be warned is the driver M has been described as an example, but the present invention can also be applied to cases where the person to be warned is a conductor. In addition, in this embodiment, the case where the person to be warned is a train driver has been described as an example, but the present invention can also be applied to cases where the person to be warned is a train driver of a transportation facility such as an automobile, aircraft, or ship. Furthermore, in this embodiment, the present invention can also be applied to cases where the person to be warned is a worker who operates a machine, tool, or device used in a plant, factory, construction site, or the like.

[0073] (2) In this embodiment, an example has been described in which the alertness level of the driver M is estimated and an alarm command signal is output, but the present invention can also be applied to a case in which a threshold value is set for each driver M and an alarm command signal is output according to the alertness level of each driver M. In this case, an alarm can be presented to the driver M when the alertness level becomes high, or when the alertness level of the driver M is low, or an alarm can be presented according to the alertness level of each driver M. In addition, in this embodiment, an example has been described in which a heart rate, a pulse rate, an electrodermal activity, a skin temperature, or a characteristic brain wave is measured as a physiological index, but the present invention can also be applied to a case in which physiological indexes other than these physiological indexes are measured.

[0074] (3) In this embodiment, the presence or absence of an orientation response is detected based on the heart rate decrease rate, but the present invention can also be applied to a case where the presence or absence of an orientation response is detected based on the heart rate change rate (=bpmA*100 / bpmR(%)). In this case, it can be determined that an orientation response exists when the heart rate change rate falls to a value below 100%, and that an orientation response does not exist when the heart rate change rate increases to a value equal to or greater than 100%. In addition, in this embodiment, the warning presentation device 6 includes the warning generation unit 6c, but the present invention can also be applied to a case where a warning presentation device is provided separately from the warning presentation device 6 and a command to change the warning is given from the warning presentation device 6.

[0075] (4) In this embodiment, the case where the alarm generating unit 6c generates an alarm that the driver M can recognize through his hearing has been described as an example, but the present invention can also be applied to a case where the alarm generating unit 6c generates an alarm that the driver M can recognize through his sight or smell. For example, the case where the alarm generating unit 6c generates multiple alarm sounds has been described as an example, but the present invention can also be applied to a case where the alarm generating unit 6c generates multiple smells or multiple indications other than the alarm sounds. In addition, in this embodiment, the case where three types of alarms A to C are presented has been described as an example, but the present invention can also be applied to a case where two types or four or more types of alarms are presented.

[0076] (5) In this embodiment, the case where the presence or absence of the orientation reaction is detected depending on whether or not the threshold value is exceeded and then the alarm is changed and presented is explained as an example, but the present invention can also be applied to the case where the threshold value is changed each time the alarm is changed and presented to detect the presence or absence of the orientation reaction. In addition, in this embodiment, the case where the series of alarm presentation processes is terminated when there is no orientation reaction after the presentation of the alarm C is explained as an example, but the present invention is not limited to such an alarm presentation process. For example, when there is no orientation reaction after the presentation of the alarm C, the series of alarm presentation processes are repeated by returning to the presentation of the alarm A, or when the awakening effect is not recognized even when the alarm C is presented, the present invention can also be applied to the case where the state of the driver M is notified to the driving control center or the like. [Explanation of symbols]

[0077] 1. System to support prevention of decline in alertness level 2. Imaging Device 3. Face detection device 4. Arousal Level Estimation Device 5 Physiological index measuring device 6 Alarm presentation device 6c Alarm generation section 6f Localization response detector 6g Alarm change command unit 6k Control Unit M Driver (warning recipient) T1 alarm presentation time T2 localization response detection end time ΔT Predetermined time

Claims

1. A warning presentation method for presenting a warning to a warning recipient by a warning generating unit that generates a warning when a decrease in a level of wakefulness of the warning recipient is detected, comprising: an orientation response detection step of detecting whether or not the person to be alerted has an orientation response within a predetermined time after the alert is generated; an alarm change command step of commanding the alarm generating unit to change and generate the alarm when a direction-directed response of the alarm target person is not detected in the direction-directed response detection step; A method for presenting an alert comprising:

2. The method for presenting a warning according to claim 1 , the warning change command step includes a step of determining, when a direction-directed response of the warning target is not detected, that the warning target is accustomed to the warning, and commanding the warning generation unit to change and generate the warning; A warning presentation method comprising:

3. The method for presenting an alarm according to claim 1 or 2, The localization response detection step includes a step of detecting whether or not there is a temporary decrease in the heart rate of the person to be warned immediately after the warning generation unit generates a warning sound, the warning change command step includes a step of commanding the warning generation unit to change and generate the warning sound when a temporary decrease in the heart rate of the person to be warned is not detected in the localization response detection step; A warning presentation method comprising:

4. The method for presenting an alarm according to claim 1 or 2, The localization response detection step includes a step of detecting whether or not there is a temporary decrease in the pulse rate of the person to be warned immediately after the warning generation unit generates a warning sound, the warning change command step includes a step of commanding the warning generation unit to change and generate the warning sound when a temporary decrease in the pulse rate of the person to be warned is not detected in the localization response detection step; A warning presentation method comprising:

5. The method for presenting an alarm according to claim 1 or 2, The localization response detection step includes a step of detecting whether or not there is a temporary increase in the electrodermal activity of the person to be warned immediately after the warning generation unit generates a warning sound, the warning change command step includes a step of commanding the warning generation unit to change and generate the warning sound when a temporary increase in the electrical skin activity of the person to be warned is not detected in the localization response detection step; A warning presentation method comprising:

6. The method for presenting an alarm according to claim 1 or 2, The localization response detection step includes a step of detecting whether or not there is a temporary decrease in the skin temperature of the person to be warned immediately after the warning generation unit generates a warning sound, the warning change command step includes a step of commanding the warning generation unit to change and generate the warning sound when a temporary decrease in the skin temperature of the person to be warned is not detected in the localization response detection step; A warning presentation method comprising:

7. The method for presenting an alarm according to claim 1 or 2, The localization response detection step includes a step of detecting whether or not there is an increase in a characteristic electroencephalogram occurring in the alarm target immediately after the alarm generation unit generates an alarm sound, the warning change command step includes a step of commanding the warning generation unit to change and generate the warning sound when an increase in a characteristic electroencephalogram occurring in the warning target is not detected in the localization response detection step; A warning presentation method comprising:

8. A warning presentation device that presents a warning to a warning target by a warning generation unit that generates a warning when a decrease in a warning target's wakefulness is detected, an orientation response detection unit that detects whether or not the alert target has an orientation response within a predetermined time after the alert is generated; an alarm change command unit that commands the alarm generation unit to change and generate the alarm when the orientation response detection unit does not detect the orientation response of the alarm target person; A warning presentation device comprising:

9. A warning presentation program for presenting a warning to a warning recipient by a warning generating unit that generates a warning when a decrease in a level of wakefulness of the warning recipient is detected, a direction-directed response detection step for detecting whether or not the person to be alerted has a direction-directed response within a predetermined time period after the alert is generated; an alarm change command step of commanding the alarm generating unit to change and generate the alarm when a direction-directed response of the alarm target person is not detected in the direction-directed response detection step; A warning display program that causes a computer to execute the above.

Images