Method and system for identifying or preventing drowsy driving based on driver's biometric information collected through a portable device mounted on the driver's seat belt

Abstract

According to one embodiment, a system for preventing drowsy driving based on biometric information of a driver collected through a portable device mounted on a vehicle's seat belt may include the portable device and a first vibration device. The portable device may include a BCG sensor board that collects raw data generated based on the driver's biometric vibration, a data processing unit that converts the raw data into biometric data, a connecting wire connected to the BCG sensor board, an artificial intelligence model trained to determine the driver's state based on the biometric data, a device unit including a processor electrically connected to the BCG sensor board, and a pad unit including a plurality of air cells.

Description

Technology Field

[0001] The present disclosure relates to a method and system for identifying a driver's drowsy state through a portable device that can be attached to and detached from a driver's seatbelt. More specifically, the disclosure relates to a method and system for collecting a driver's biometric information non-contactually through a portable device, identifying the driver's drowsy state based on this information, and relieving the drowsy state by vibrating the driver through a vibration device provided in the portable device. Background Technology

[0002] Numerous technologies have previously been introduced that collect and analyze users' biometric information to monitor their health status and provide personalized feedback based on that status.

[0003] Meanwhile, a significant number of driving accidents occur due to drowsy driving or the decline in physical capabilities of the elderly; in the case of drowsy driving, it impairs the driver's sensory functions and is a factor that hinders safe driving.

[0004] Korean Utility Model Registration No. 20-0483102 discloses technology regarding a driver's wristband that can prevent safety accidents caused by drowsiness, etc., by monitoring the driver's biological condition in real time while driving through a sensor module worn on the driver's wrist.

[0005] However, there is a problem in that these conventional technologies only identify the driver's drowsy state and lack the technical implementation to prevent or stop drowsiness.

[0006] In addition, Korean registered patent No. 10-2378834 discloses a vibration band system for preventing drowsy driving accidents that measures the carbon dioxide concentration inside the vehicle cabin and provides vibration or low-frequency massage to the driver's wrist or forearm to eliminate drowsiness and induce ventilation.

[0007] However, since this conventional technology determines whether a driver is drowsy based on factors such as the concentration of carbon dioxide inside the vehicle rather than the driver's biometric information, the accuracy of the drowsiness determination may not be precise. Furthermore, because the functional implementation of relieving drowsiness is limited to a band worn on the wrist and provides vibration only to the wrist—a very small part of the body—the effect of relieving drowsiness may be insufficient. The problem to be solved

[0008] Conventionally, devices for collecting users' biometric information were designed to collect such information in a manner that contacted the user's body, which caused inconvenience to the user's usability.

[0009] For example, to determine a driver's drowsiness, conventional methods involved having the user wear a device that comes into contact with their body, such as their wrist, collecting the user's biometric information through the worn device, and determining the drowsiness state based on this data.

[0010] To solve these problems, the present invention presents a method and system capable of collecting biometric information from a driver's body in a non-contact manner through a biometric information sensing device designed to be detachably attached to the driver's seat belt and capable of identifying health conditions such as the driver's drowsiness.

[0011] In addition, when the driver is identified as being drowsy, a method is presented to effectively relieve drowsiness by providing vibrations through a wide area of ​​the driver's body via a vibration device installed on the driver's seat, backrest, or seat belt.

[0012] In addition, the present invention provides a technology for preventing accidents involving drivers, such as switching the driving mode of a vehicle from manual mode to autonomous driving mode when it is determined that emergency measures are required due to the driver being drowsy while driving or due to physical aging, such as being an elderly person, and inducing the selection of a route and stopping to prevent accidents through autonomous driving.

[0013] In addition, this invention presents a technology capable of preventing driving accidents involving elderly drivers by establishing safe zones for each driver based on their health status (especially elderly drivers), detecting their location in real time, and guiding them to drive without leaving the safe zones. means of solving the problem

[0014] According to one embodiment, a system for preventing drowsy driving based on a driver's biometric information collected through a portable device mounted on a vehicle's seat belt may include the portable device and a first vibration device. The portable device may include a BCG sensor board that collects raw data generated based on the driver's bio-vibrations, a data processing unit that converts the raw data into bio-data, a connecting wire connected to the BCG sensor board, an artificial intelligence model trained to determine the driver's state based on the bio-data, a device unit including a processor electrically connected to the BCG sensor board, and a pad unit including a plurality of air cells, a piezoelectric sensor connected to the connecting wire, a spacing member that surrounds the connecting wire and contacts the piezoelectric sensor, a silicone tube that is perforated and connected to one side of the plurality of air cells, one side of the silicone tube is connected to one side of the plurality of air cells, and the other side of the silicone tube is formed to seal the piezoelectric sensor and the spacing member, and the connecting wire penetrates a part of the other side of the silicone tube and is connected to the BCG sensor board, and may include a first vibration device that is located on the seat bottom of the vehicle or the backrest of the vehicle and provides vibration. The processor can acquire raw data about the driver through the BCG sensor board based on the driver's bio-vibrations transmitted to the plurality of air cells while the driver's body part is in contact with the plurality of air cells, convert the raw data into bio-data through the data processing unit, process the bio-data through the artificial intelligence model to determine the driver's state, and provide customized feedback to the driver based on the determined driver's state.

[0015] According to one embodiment, the data processing unit obtains biometric data by sequentially applying a Fourier transform and a wavelet transform to the raw data, and the biometric data may include data on heart rhythm and data on respiration.

[0016] According to one embodiment, the spacing member has a spherical shape and can be made of a plastic material that is an insulator.

[0017] According to one embodiment, the pad portion may further include a second vibration device comprising a plurality of actuators that provide vibration and are positioned to surround a plurality of air cells, and a vibration reduction portion positioned between the plurality of air cells and the second vibration device.

[0018] According to one embodiment, the system may further include a camera and a speaker installed inside the vehicle. The processor acquires eye data by photographing the driver's eyeball through the camera, and inputs at least one of the driver's biometric data or the eye data into the artificial intelligence model for processing to identify whether the driver's condition is drowsy, and if the driver's condition is identified as drowsy, controls the first vibration device to provide vibration to the driver and controls the speaker to output a warning sound to relieve drowsiness to the driver.

[0019] According to one embodiment, the processor inputs the driver's biometric data into the artificial intelligence model and processes it to determine whether the driver's condition is an emergency state including at least one of a sudden drop in heart rate or cessation of breathing; if the driver's condition is determined to be an emergency state, the processor converts the vehicle's mode from manual driving mode to autonomous driving mode, and controls the vehicle so that the vehicle autonomously drives along an optimal path to stop in a stopping area located around the vehicle based on vehicle information including the vehicle's speed and location, surrounding information regarding structures around the vehicle, and map information.

[0020] According to one embodiment, the processor sets a safe zone for each driver, identifies the real-time location of the driver, compares the real-time location of the driver with the safe zone to identify whether the driver is leaving the safe zone, and if it is identified that the driver has left the safe zone, provides guide information to move the driver's vehicle into the safe zone. The shape of the safe zone is circular or polygonal, the circular shape has a radius of a specified distance centered on the driver, and the polygonal shape can be formed by selecting a specified number of areas or buildings frequently visited by the driver and connecting the selected areas or buildings with straight lines.

[0021] According to one embodiment, the processor readjusts at least one of the size or shape of the safety zone based on the driver's health condition, and if the driver's health condition is identified as deteriorating based on the biometric data, it may reduce the radius of the circular safety zone, reduce the specified number of polygonal shapes, or change the polygonal shapes to the circular shape.

[0022] According to one embodiment, when the driver is located outside the safe zone, the processor applies a weight value to the raw data to convert the raw data into biometric data through the data processing unit, and can increase the weight value applied to the raw data as the driver's location moves further away from the safe zone.

[0023] According to one embodiment, the processor identifies that the driver's condition is drowsy based on the biometric data and provides vibration through the first vibration device; if the driver's condition is still identified as drowsy even after a specified time has elapsed, the processor changes the pattern of vibration provided through the first vibration device, and the pattern of vibration may include the intensity and duration of the vibration. Effects of the invention

[0024] As the portable device is manufactured to be detachable from the driver's seatbelt, the usability and functionality of the portable device can be improved by removing the device when a driver who does not need it boards the vehicle, and attaching the portable device to the seatbelt when a driver who does need it boards the vehicle.

[0025] By collecting the user's biometric information non-contactually through a portable device mounted on the driver's seatbelt, wearability can be improved compared to existing biometric information collection devices that require contact with the body.

[0026] When a driver's drowsiness is detected through a portable device, the drowsiness can be effectively relieved by providing vibrations to a wide area of ​​the driver's body through vibration devices installed at locations such as the driver's seat, backrest, and seatbelt.

[0027] As a driver-specific safe zone is established based on the driver's health condition and the driver's location is detected in real time, driving within the driver-specific safe zone is guided, thereby effectively preventing driving accidents and enabling immediate action in emergency situations.

[0028] In addition, various effects identified directly or indirectly through the present disclosure may be provided. Brief explanation of the drawing

[0029] FIG. 1 illustrates a system for detecting a driver's drowsy state through a portable device equipped on a driver's seat belt according to one embodiment. FIG. 2 illustrates a portable device mounted on the outer surface of a driver's seat belt according to one embodiment. FIG. 3 illustrates an air cell mounted on the inner surface of a driver's seat belt according to one embodiment. FIG. 4 illustrates the external view of the device part of a portable device according to one embodiment. FIG. 5 illustrates the internal view of the main body device of a portable device according to one embodiment. FIG. 6 illustrates a silicone tube and a connecting wire connecting an air cell and a BCG sensor board according to one embodiment, with the wire covered by a cover. FIG. 7 is a drawing for explaining a piezoelectric sensor and a spacing member that are sealed in a silicone tube and connected to a wire according to one embodiment. FIG. 8 is a cross-sectional view illustrating a piezoelectric sensor and a spacing member according to one embodiment being sealed with a silicone tube, and the piezoelectric sensor being connected to a BCG sensor board through a wire. FIG. 9 illustrates an actuator that provides vibration along the edge area of ​​a portable device according to one embodiment. FIG. 10 illustrates a portable device mounted on a waist safety belt according to one embodiment. FIG. 11 illustrates that, according to one embodiment, the air cell portion of the portable device is located on the backrest, and the device portion of the portable device is located on the headrest portion. FIG. 12 illustrates a flowchart of an operation that determines the state of a user based on biometric data acquired through a biometric sensor according to one embodiment and provides customized feedback according to the user's state. FIG. 13 illustrates a flowchart of an operation for setting a user-specific safe zone according to one embodiment and providing a customized guide to enter the safe zone when leaving the safe zone. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Specific details for implementing the invention

[0030] Hereinafter, various embodiments of the present invention are described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the present invention.

[0031] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0032] Additionally, terms such as “…part,” “…unit,” and “module” described in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software.

[0033] Furthermore, throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components in between.

[0034] Furthermore, when a part is said to "include" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but rather may include additional components, and it should be understood as not excluding in advance the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0036] FIG. 1 illustrates a system for detecting a driver's drowsy state through a portable device (101) provided on a driver's seat belt according to one embodiment.

[0037] Referring to FIG. 1, the portable device (101) can be mounted on a part of the driver's seat seat belt of a vehicle and can collect biometric information of the driver sitting in the driver's seat through a biometric sensor equipped in the portable device (101). Based on the collected biometric information, the driver's health condition (e.g., drowsiness, abnormal blood pressure, rapid heart rate, etc.) can be identified, and based on the identified driver's health condition, customized feedback (e.g., providing vibration to relieve drowsiness, warning sound notification, inducing stopping and guidance, switching to autonomous driving mode, etc.) can be provided.

[0038] According to one embodiment, the portable device (101) may be provided with a pad portion containing an air cell in a part that comes into contact with the user's body, and a device portion on the opposite side. The air cell is compressed according to the user's bio-vibrations, causing a change in air pressure inside the air cell, and the change in air pressure can be detected through a BCG sensor provided in the device portion. The detected change in air pressure can be converted into ballistocardiogram information of the user, thereby allowing the user's condition to be identified.

[0039] According to one embodiment, the portable device (101) can be manufactured with a Velcro configuration to be detachable and can be attached to the chest or waist portion of the driver's belt as needed.

[0040] According to one embodiment, biometric information of a user (or driver) collected through a portable device (101) can be transmitted to a user terminal (102) and a server (103). The user terminal (102) may be the driver's own terminal or the driver's guardian's terminal.

[0041] According to one embodiment, the user terminal (102) can graph or quantify the user's biometric information received from the portable device (101) and display it on the display. Through the user terminal (102), the user or the user's guardian can monitor the user's health status.

[0042] According to one embodiment, the server (103) can database the user's biometric information received from the portable device (101). For example, information regarding biometric information can be stored separately for each user.

[0043] According to one embodiment, the server (103) can store and run an artificial intelligence model. For example, it can store and run an artificial intelligence model that determines the user's condition based on the user's biometric information collected through a portable device (101).

[0044] According to another embodiment, the artificial intelligence model may be provided in a portable device (101) and stored and operated thereon. The artificial intelligence model may refer to an artificial intelligence model trained to determine the state of the user based on the user's biometric information.

[0046] FIG. 2 illustrates a portable device (101) mounted on the outer surface of a driver's seat belt according to one embodiment.

[0047] Referring to FIG. 2, the portable device (101) can be mounted on the driver's first seat belt (231). The portable device (101) may be equipped with a first Velcro (211) and a second Velcro (212), and can be mounted on the first seat belt (231) through the first Velcro (211) and the second Velcro (212).

[0048] According to one embodiment, the first seat belt may refer to a seat belt located on the chest of a driver. A portable device (101) may be mounted such that a pad portion (202) is located on the part that comes into contact with the user's body (e.g., chest area, abdomen area) while mounted on the first seat belt, and a device portion (201) is located on the opposite side.

[0049] According to one embodiment, the device part (201) may contain various electronic components such as a BCG sensor (or ballistocardiogram sensor), a processor (or MCU), a wireless communication module, and a battery. The device part (201) may be attached to the upper surface of the second Velcro (212) of the portable device (101). Although not shown in FIG. 2, the device part (201) may also be attached to the upper surface of the first Velcro (211) of the portable device (101).

[0050] According to one embodiment, the pad portion (202) may include a plurality of air cells. The plurality of air cells may be connected via a connecting wire (222) and a silicone tube (223). For example, a change in air pressure inside the air cell is propagated through the silicone tube (223) and applied to a piezoelectric sensor located at the point where the silicone tube (223) and the connecting wire (222) meet, and the piezoelectric sensor may generate sensing data based on the applied change in air pressure and transmit it to a BCG sensor board (221) via the connecting wire (222).

[0051] According to one embodiment, a BCG sensor board (221) may be mounted inside the device part (201), and a connecting wire (222) may be extended from the BCG sensor board (221), exposed to the outside through one side of the housing of the device part (201), and connected to a silicone tube (223). The one side of the housing may refer to the back side of the device part (201).

[0053] FIG. 3 illustrates an air cell mounted on the inner surface of a driver's seat belt according to one embodiment.

[0054] Referring to FIG. 3, the portable device (101) may have a pad portion (202) on the inner surface of the first safety belt (231), and the pad portion (202) may include air cells (e.g., first air cell (301), second air cell (302)). FIG. 3 illustrates an example mounted on the inner surface of the first safety belt (231), but the same technical details may apply when mounted on the inner surface of the second safety belt (232).

[0055] According to one embodiment, the first air cell (301) may be composed of a plurality of air cells. For example, three air cells may be arranged along the thickness direction of the driver's seat belt and five air cells may be arranged along the length direction of the driver's seat belt, so that the first air cell (301) may be composed of a total of 15 air cells. However, the number of air cells of the first air cell (301) may not be limited to the number shown in FIG. 3.

[0056] According to one embodiment, the second air cell (302) may be positioned adjacent to the first air cell (301), and the size of the second air cell (302) may be larger than the size of one air cell of the first air cell (301). An injection part (311) may be positioned through an opening provided on one side of the second air cell (302), a connection part (312) may be connected to the injection part (311), and a silicone tube (223) may be connected to the connection part (312).

[0058] FIG. 4 illustrates the external view of the device part (201) of a portable device (101) according to one embodiment.

[0059] Referring to FIG. 4, an emergency button (401) and a plurality of LEDs (e.g., a first LED (411), a second LED (412), a third LED (413), and a fourth LED (414)) may be arranged on the outer surface of the housing of the device part (201) of the portable device (101). The first LED (411) may flash when a user wearing the wearable device (101) falls. The second LED (412) may flash when the user wearing the wearable device (101) has an abnormal body temperature. The third LED (413) may flash when the user wearing the wearable device (101) has an abnormal breathing rate. The fourth LED (414) may flash when the user wearing the wearable device (101) has an abnormal heart rate. The first LED (411) can be flashed in a first color (e.g., purple), the second LED (412) in a second color (e.g., green), the third LED (413) in a third color (e.g., orange), and the fourth LED (414) in a fourth color (e.g., red).

[0060] According to one embodiment, although not shown in FIG. 4, a C-type fast charging port may be provided on the bottom surface of the device part (201).

[0062] FIG. 5 illustrates the internal view of the device part (201) of a portable device (101) according to one embodiment.

[0063] Referring to FIG. 5, the device portion (201) of the portable device (101) may include an emergency button (401), a plurality of LEDs (e.g., a first LED (411), a second LED (412), a third LED (413), a fourth LED (414)), an MCU (Micro Controller Unit) (or processor) (501), a BCG sensor board (502), a charging port (504), and a battery (505). An opening (520) may be provided in part of the rear of the device portion (201), and a connecting wire (222) may extend to the outside of the device portion (201) through the opening (520).

[0064] According to one embodiment, a first connector (511) may be provided on a part of the BCG sensor board (502), and a connecting wire (222) may be electrically connected to the first connector (511). An electrical signal received from a piezoelectric sensor can be transmitted to the BCG sensor board (502) through the connecting wire (222). The processor (501) can obtain the driver's biometric information by processing the electrical signal recognized by the BCG sensor board (502).

[0066] FIG. 6 illustrates a silicone tube (223) connecting an air cell and a BCG sensor board (221) according to one embodiment and a connecting wire (222) connected with the cover (600) covering them.

[0067] Referring to FIG. 6, a BCG sensor board (221) mounted inside the device part (201) of a portable device (101) and a connecting wire (222) can be electrically and physically connected through a connector. For example, a first connector (511) provided on the BCG sensor board (221) and a second connector (512) provided at one end of the connecting wire (222) can be physically and electrically connected.

[0068] According to one embodiment, the other end of the connecting wire (222) may be connected to a silicone tube (223), and a cover (600) may be placed over the portion where the other end of the connecting wire (222) and the silicone tube (223) are connected. The cover (600) may be made of an elastic rubber material.

[0069] According to one embodiment, a connecting wire (222) penetrates an opening provided at one end of a silicone tube (223) and can be physically and electrically connected to a piezoelectric sensor provided inside the silicone tube (223). The connecting wire (222) penetrates the opening of the silicone tube (223), and the connection wire (222) and the opening are bonded together through an adhesive member so as to seal the connection so that air inside the silicone tube (223) does not leak out.

[0071] FIG. 7 is a drawing for explaining a piezoelectric sensor (701) and a spacing member (702) that are sealed in a silicone tube (223) according to one embodiment and connected to a connecting wire (222).

[0072] Referring to FIG. 7, a spacing member (702) is disposed on the side of the piezoelectric sensor (701), and a connecting wire (222) can be electrically and physically connected to the piezoelectric sensor (701) by penetrating the center of the spacing member (702). One side of the silicone tube (223) can be manufactured to have a sealed structure that surrounds the piezoelectric sensor (701) and the spacing member (702). The connecting wire (222) can pass through a part of the said side of the silicone tube (223), but the penetrating part may be coated with an adhesive material to maintain sealing.

[0073] According to one embodiment, the spacing member (702) may be manufactured in a spherical (or spherical) shape that passes through the center and has a through hole into which a connecting wire (222) can be placed. The spacing member (702) may be manufactured from an insulating material. For example, the spacing member (702) may be manufactured from at least one of polycarbonate, Teflon, or polypropylene.

[0075] FIG. 8 is a cross-sectional view illustrating a piezoelectric sensor (701) and a spacing member (702) according to one embodiment being sealed with a silicone tube (223), and the piezoelectric sensor (701) being connected to a BCG sensor board (502) through a connecting wire (222).

[0076] Referring to FIG. 8, the silicone tube (223) is manufactured in a shape that encloses the piezoelectric sensor (701) and the spacing member (702), so that the piezoelectric sensor (701) and the spacing member (702) can be positioned inside the silicone tube (223). The spacing member (702) can be understood as a structure to prevent the silicone tube (223) from directly contacting the point where the piezoelectric sensor (701) and the connecting wire (222) come into contact.

[0077] According to one embodiment, the connecting wire (222) can physically and electrically connect the piezoelectric sensor (701) and the BCG sensor board (502). For example, the connecting wire (222) can be connected to the BCG sensor board (502) through a second connector (512). Specifically, one end of the connecting wire (222) is provided with a first connector (511), and the connecting wire (222) and the BCG sensor board (502) can be connected by connecting the first connector (511) and the second connector (512).

[0078] According to one embodiment, the cover (600) may be manufactured in a form that covers a portion of the silicone tube (223) and the entirety of the piezoelectric sensor (701) and the spacing member (702). The cover (600) may be made of at least one material selected from polyvinyl chloride or polyethylene as an insulator.

[0079] FIG. 9 illustrates an actuator (900) that provides vibration along the edge area of ​​a portable device (101) according to one embodiment.

[0080] Referring to FIG. 9, a plurality of actuators (900) that provide vibration to a first region (901) around a first air cell (301) located on the pad portion (202) of a portable device (101) may be arranged. The actuator (900) may be composed of a plurality of substructures, and each of the substructures may have a different vibration pattern, such as vibration intensity, vibration duration, and vibration frequency.

[0081] According to one embodiment, a portable device (101) equipped with an actuator (900) may additionally be equipped with a vibration reduction member (not shown) to minimize the propagation of vibrations generated through the actuator (900) to the first air cell (301). For example, the vibration reduction member may be located between the actuator (900) and the first air cell (301) and may be arranged along the periphery of the first air cell (301).

[0082] According to one embodiment, a portable device (101) equipped with an actuator (900) may be provided on a first safety belt (231).

[0083] According to another embodiment, a portable device (101) that does not have an actuator (900) may be provided on the first seat belt (231). In this case, the actuator devices that provide vibration may be located on the bottom or backrest of the driver's seat.

[0084] According to one embodiment, the operation of the vibration device including the actuator (900) can be controlled based on the driver's condition. For example, if the driver's condition is identified as drowsy as a result of analyzing the driver's biometric information, the vibration device including the actuator (900) can be controlled to generate vibration. The pattern of the vibration can be varied depending on the degree of the driver's condition. For example, if the driver's drowsy condition is higher than a drowsiness threshold, a vibration of a first intensity can be provided for a first duration, and if the driver's drowsy condition is lower than the drowsiness threshold, a vibration of a second intensity lower than the first intensity can be provided for a second duration shorter than the first duration.

[0086] FIG. 10 illustrates a portable device (101) mounted on a waist safety belt according to one embodiment.

[0087] Referring to FIG. 10, the portable device (101) can be attached to the second safety belt (232) using the first Velcro (211) and the second Velcro (212).

[0088] According to one embodiment, when mounted on a second seat belt (232) rather than a first seat belt (231), the portable device (101) may not have an actuator that provides vibration, and in this case, the actuator that provides vibration may be provided on the seat base or backrest of the driver's seat.

[0089] According to another embodiment, when a portable device (101) is provided on the second safety belt (232), an actuator (900) that provides vibration around the pad portion (202) of the portable device (101) may be provided.

[0091] FIG. 11 illustrates that, according to one embodiment, the air cell portion of the portable device (101) is located on the backrest, and the device portion of the portable device (101) is located on the headrest portion.

[0092] Referring to FIG. 11, the air cell portion of the portable device (101) (e.g., the third air cell (1103)) is located in the driver's backrest portion, the device portion (201) of the portable device (101) may be located between the headrest and the backrest of the chair, and the vibration device (e.g., an actuator) of the portable device (101) may be arranged surrounding the third air cell (1103). Although not shown in FIG. 11, a vibration reduction portion may additionally be provided between the vibration device and the third air cell (1103).

[0093] According to another embodiment, the actuator providing the vibration may be located at the bottom of the chair rather than at the driver's backrest.

[0095] FIG. 12 illustrates a flowchart of an operation that determines the state of a user based on biometric data acquired through a biometric sensor according to one embodiment and provides customized feedback according to the user's state.

[0096] Referring to FIG. 12, the driver's body vibration is applied to the first air cell (301) provided in the portable device (101), and the applied body vibration can be transmitted as raw data to the BCG sensor board (502) through the piezoelectric sensor (701). The raw data is converted into bio-data through a data processing process, and by analyzing the bio-data, the driver's condition can be determined. Customized feedback can be provided according to the driver's condition.

[0097] In operation 1201, while the portable device (101) is mounted on the first seat belt (231) or the second seat belt (232), the driver's biological vibration can be detected through the first air cell (301). According to the driver's biological vibration, the first air cell (301) is compressed, and the air pressure inside the first air cell (301) changes, and this change in air pressure is applied to the piezoelectric sensor (701) to generate an electrical signal. The electrical signal is transmitted along the connecting wire (222) to the BCG sensor board (221), and the BCG sensor board (221) can acquire the electrical signal as raw data.

[0098] In operation 1202, the portable device (101) can convert the raw data into biological data through a processor (501) or a data processing unit. The process of converting the raw data into biological data can be performed by sequentially proceeding with a Fourier transform and a Wavelet transform. The Fourier transform may refer to a process of separating frequencies corresponding to biological rhythms (e.g., heart rhythm or respiratory rhythm) from the raw data. The Wavelet transform may refer to a process of creating various bands from low to high frequencies by performing adjustments to lengthen or shorten the signal length in the time axis direction, and a process of converting by calculating the correlation coefficient with the raw data while changing the time scale of the wavelet function modeled according to specific rules.

[0099] According to one embodiment, the portable device (101) can process the raw data to extract ballistocardiographic data representing a heart rhythm or respiration data representing a respiration rhythm and obtain it as bio-data.

[0100] According to one embodiment, the portable device (101) may further include a GPS device (not shown) capable of determining the location of a user, and the location of the user can be determined in real time through the GPS device. The portable device (101) can perform bidirectional communication with an external device (e.g., user terminal (102), server (103), etc.) via various communication methods (e.g., LTE, LoRa, Wi-Fi, BLE, etc.) using location data representing the location of the user determined in real time.

[0101] In operation 1203, the portable device (101) can determine the state of the user by processing the biometric data through an artificial intelligence model. The artificial intelligence model may refer to an artificial intelligence model trained to determine the state of the user based on the biometric data. The artificial intelligence model may be trained to determine whether the user is in a drowsy state, an elderly person with a health abnormality, a state of loss of consciousness, a state of fatigue due to long-term driving, or a state of distraction such as operating a smartphone or navigation system when receiving the user's biometric data and additional data.

[0102] According to one embodiment, a drowsy state can be determined by processing it together with biometric data by the artificial intelligence model when eye data is input as additional data. According to another embodiment, a drowsy state can be determined by processing it together with biometric data by the artificial intelligence model when facial data is input as additional data. For example, whether a driver is yawning can be determined by measuring the size of the driver's mouth and the time the mouth is kept open, and if the determined yawning exceeds a specified number of times within a specified period, it can be determined as drowsy driving.

[0103] According to one embodiment, the artificial intelligence model may mean an artificial intelligence model trained to receive the driver's biometric data, eye data, and user's state data (e.g., drowsy state, emergency state such as sudden drop in heart rate or cessation of breathing, fatigue state due to long-term driving, health abnormality state by age of the elderly, etc.) as a training data set, and to output the driver's state data as output data when the biometric data and eye data are received.

[0104] According to one embodiment, the vehicle may acquire data regarding the degree of lane departure of the vehicle identified based on at least one of the vehicle's radar sensor, lidar sensor, or vision sensor. The vehicle may transmit the acquired data regarding the degree of lane departure to a portable device (101). The artificial intelligence model may refer to an artificial intelligence model trained to receive the driver's biometric data, eye data, user state data (e.g., drowsy state, emergency state such as sudden drop in heart rate or cessation of breathing, fatigue state due to long-term driving, health abnormality state by age of the elderly, etc.), and data regarding the degree of lane departure as a training data set, and to output the driver's state data as output data when the biometric data, eye data, and data regarding the degree of lane departure are received.

[0105] According to one embodiment, an abnormal health condition of an elderly person can be determined by processing biometric data indicating a rapid increase in at least one of heart rate or blood pressure by the artificial intelligence model.

[0106] According to one embodiment, a state of loss of consciousness may be determined by processing biometric data indicating a sudden drop in heart rate and cessation of breathing by the artificial intelligence model. If the driver is identified as being in a state of loss of consciousness, a notification may be sent to the driver's guardian and / or emergency service agency (e.g., a hospital).

[0107] According to one embodiment, whether a person is in a fatigued state can be determined by processing the driving time data and chair pressure data together with the biometric data by the artificial intelligence model when the driving time data and chair pressure data are input as additional data. If the driving time designated for each user is exceeded and the degree of positional change of the pressure detected through the pressure sensor equipped in the chair exceeds a threshold level, the artificial intelligence model can determine that the driver is in a fatigued state.

[0108] According to one embodiment, a distracted state can be determined by receiving eye data as additional data and processing it with the artificial intelligence model. For example, if the time the driver's eyes rest on a navigation system or a mobile phone inside the vehicle exceeds a threshold time, the artificial intelligence model may determine that the driver is in a distracted state.

[0109] In operation 1204, customized feedback can be provided according to the state of the user.

[0110] According to one embodiment, based on the eye data, it can be determined that the user has closed their eyes for less than a threshold time, and if it is determined that the user is in a drowsy state, a warning sound and vibration through the actuator (900) can be provided.

[0111] According to one embodiment, if the rate of change of at least one of the heart rate or blood pressure exceeds a threshold rate of change within a specified time, the user may determine that the elderly person is in an abnormal health condition and may provide guidance to stop the driver's vehicle. For example, based on information about the driver's vehicle's surroundings, map information, and vehicle information, stopping zones located around the driver's vehicle may be listed and recommended in order of distance, and such information may be displayed via the driver's vehicle's head-up display (HUD) or output via voice.

[0112] According to one embodiment, if the rate of change of heart rate within a specified time drops sharply above a threshold rate of change or is identified as data indicating cessation of breathing, the driver may be identified as being in a state of loss of consciousness, and the driver's vehicle may switch from manual driving mode to autonomous driving mode, and based on vehicle information, surrounding information, and map information, stop areas located around the driver's vehicle may be listed and the vehicle may stop autonomously at a location where it can stop in the shortest possible time.

[0113] According to one embodiment, in addition to the user's biometric data, if the rate of change of the chair pressure distribution is greater than a specified rate of change and the driving time exceeds a specified time, the driver's fatigue state can be detected, and vibration can be provided through the actuator (900) and a warning sound can be output.

[0114] According to one embodiment, if the user's condition is identified as ambient distraction, the actuator (900) may provide vibration and output a warning sound.

[0115] According to one embodiment, based on a pressure sensor embedded in the driver's chair and a pressure sensor embedded in the backrest, the waist position and hip position can be identified, and by comprehensively considering the waist position and hip position, it can be identified whether the driver is in a hunched posture, and based on the degree of the hunched posture, it can be identified whether the driver is in a fatigued state or a drowsy state. In this case, vibration can be provided through an actuator (900) and a warning sound can be output.

[0117] FIG. 13 illustrates a flowchart of an operation for setting a user-specific safe zone according to one embodiment and providing a customized guide to enter the safe zone when leaving the safe zone.

[0118] Referring to FIG. 13, the portable device (101) further includes a GPS sensor, and when the driver drives the vehicle with the portable device (101) mounted on the driver's seatbelt, the location of the vehicle can be identified in real time. Based on the identified location of the portable device (101), whether the driver's vehicle is located within a safety zone is checked in real time, and based on this, guidance information can be provided to the driver so that the vehicle can be driven safely within the safety zone.

[0119] According to one embodiment, when a driver drives a vehicle equipped with a portable device (101), the location of the portable device (101) can be identified as substantially the same as the location of the vehicle and the driver, and it can be identified whether the driver's vehicle is within or has moved out of a safe zone range set for each driver.

[0120] According to one embodiment, when the vehicle leaves the safe zone, a departure warning sound may be provided through a speaker provided in the portable device (101), or a vehicle movement path that can move into the safe zone may be recommended, or information regarding the recommended movement paths may be displayed on the navigation or head-up display (HUD) inside the vehicle. The information regarding the recommended movement paths may mean that a specified number of movement paths are listed and displayed based on the shortest distance or minimum distance.

[0121] According to one embodiment, when the vehicle leaves the safe zone, the driving mode of the vehicle may be switched from manual mode to autonomous driving mode. When the driving mode of the vehicle is switched to autonomous driving mode, the vehicle may move autonomously by selecting an optimal path so that it moves into the safe zone corresponding to the driver.

[0122] In operation 1301, safe zones can be set differently for each vehicle driver (user). The safe zone can be set as a circle with a radius of a designated distance (e.g., 1 km, 5 km, etc.) centered on the vehicle driver. As another example, the safe zone may be set as a polygonal area. For example, a designated number of frequently visited areas (or regions) or buildings can be selected, and the entire area connecting the selected regions or buildings with straight lines can be set as the safe zone. When the entire area of ​​the frequently visited region is pixelated on a map, the entire area may include multiple sub-pixels, and the sub-pixels may be squares. For example, the sub-pixels may be a 10m x 10m square area. The designated number may be set by the driver or may be automatically set based on the driver's physical information. For example, the designated number may decrease as the driver's age or physical age increases. As the number of specified numbers increases, the size of the safe zone area can be increased; therefore, as the driver's age or physical age increases, the size of the area can be reduced to effectively prevent accidents while driving.

[0123] According to one embodiment, the size and shape of the safe zone may be determined based on the driver's health condition. The driver's health condition may be determined based on biometric data obtained through a portable device (101). For example, if the driver's heart rate and respiration data are within a normal range, a safe zone of a basic range may be set. The basic range may be set as a default value to a distance specified relative to the driver (e.g., about 30 km). The default value may be modified by the driver's settings. The shape of the safe zone may be set as a circle with a radius specified around the driver as a default value. The default shape of the safe zone may also be set as a polygonal area. As another example, if the safe zone is set as a circle and the duration of the driver's heart rate and respiration data being within a normal range exceeds a specified time, the shape of the safe zone may be converted to a polygonal shape. Since a polygonal shape is generally wider than a circle, this is intended to set a safe zone of a larger area as the driver's health condition improves.

[0124] According to one embodiment, the size and shape of the set safe zone may be readjusted in real time or at designated intervals depending on the driver's health condition. For example, if the driver's heart rate exceeds the normal range or the stress index exceeds the normal range, the size of the safe zone may be reduced by methods such as changing the shape of the safe zone from a polygonal shape to a circular shape, reducing the radius of the circular shape, or reducing the designated number of polygonal shapes. Conversely, as the driver's heart rate falls within the normal range and the duration of being within the normal range increases, the size of the safe zone may be increased by methods such as changing the shape of the safe zone from a circular shape to a polygonal shape, increasing the radius of the circular shape, or increasing the designated number of polygonal shapes.

[0125] According to one embodiment, the size and shape of the safe zone can be readjusted based on the driver's driving experience data. For example, a vehicle travel route frequently used by the driver can be set as a safe zone, but the area of ​​the safe zone can be set with a first size that is wider than the default value. Conversely, a vehicle travel route not frequently used by the driver can be set as a safe zone, but the area of ​​the safe zone can be set with a second size that is narrower than the first size which is the default value. The criteria for determining a frequently used vehicle travel route is based on whether the driver has exceeded a specified number of times (e.g., 10 times). If the specified number of times is exceeded, it is determined to be a frequently used vehicle travel route, and if not, it is determined to be a frequently used vehicle travel route.

[0126] According to one embodiment, the size and shape of the safety zone may be readjusted based on environmental information of the road on which the driver is traveling. For example, the size of the safety zone may be reduced as the traffic volume on the road on which the driver is traveling increases. As another example, roads with high traffic volume may be excluded from the safety zone.

[0127] According to one embodiment, the size and shape of the safe zone can be readjusted based on the driver's physical age. The driver's physical age can be determined based on biometric data obtained through a portable device (101). As the driver's physical age increases, the size of the safe zone may increase, and the shape may be changed from a polygonal shape to a circle, the radius of the circle may be reduced, or the number of polygonal shapes may be reduced.

[0128] According to one embodiment, the size and shape of the safety zone can be readjusted based on the time of day when the driver is driving the vehicle. For example, if the driver is driving during the evening hours, the size of the safety zone can be reduced by methods such as changing the shape of the safety zone from a polygonal shape to a circular shape, reducing the radius of the circle, or reducing the specified number of polygonal shapes.

[0129] According to one embodiment, the size and shape of the safety zone can be readjusted according to the driver's driving time. For example, as the driver drives for a longer period, the size of the safety zone can be reduced by methods such as changing the shape of the safety zone from a polygonal shape to a circle, reducing the radius of the circle, or reducing the designated number of polygonal shapes.

[0130] According to one embodiment, when the driver is located within the safe zone, no weight may be applied when converting raw data obtained based on the driver's bio-vibration obtained through the portable device (101) into bio-data. Conversely, when the driver is located outside the safe zone, weight may be applied when converting raw data obtained based on the driver's bio-vibration obtained through the portable device (101) into bio-data. When applying the weight in converting the raw data into bio-data, a larger value of bio-data can be obtained even based on the same raw data value, and since the driver's condition can be determined based on this data processing result, the driver may react more sensitively to the driver's bio-vibration when the driver is outside the safe zone compared to when the driver is inside the safe zone. That is, even based on the same raw data value, a larger value of biometric data is obtained when the driver is outside the safe zone than when the driver is inside the safe zone, and since the driver's drowsy state is determined based on this, even with the same raw data value, the driver's state may not be determined as drowsy when inside the safe zone, but may be determined as drowsy when outside the safe zone.

[0131] According to one embodiment, the value of the weight applied to the driver's raw data can be increased as the driver's location moves further away from the safe zone. That is, as the driver moves further away from the safe zone, the driver can be guided to respond more sensitively to the driver's bio-vibrations to prevent leaving the safe zone.

[0132] In operation 1302, the location of each driver (user) can be detected in real time through the GPS sensor of the portable device (101).

[0133] In operation 1303, the real-time location of each driver (user) is compared with the area of ​​a pre-set safe zone for each user to detect whether the driver has left the safe zone. For example, if the time during which the driver's real-time location is outside the safe zone exceeds a specified threshold time, it can be determined that the driver has left the safe zone. As another example, if the number of times the driver repeatedly travels back and forth between the inside and outside of the safe zone within a specified time exceeds a specified number, it can be determined that the driver has left the safe zone.

[0134] In operation 1304, if it is determined that the driver has left the safe zone, a customized guide for each driver may be provided to bring the driver's vehicle into the safe zone. For example, an optimal recommended route to move to the safe zone may be listed and displayed on at least one of a navigation system, a head-up display (HUD), or a user terminal (102). As another example, the vehicle's mode may be switched from manual mode to autonomous driving mode to move to the safe zone, and then the vehicle may be moved into the safe zone autonomously.

[0136] According to one embodiment, a system for preventing drowsy driving based on a driver's biometric information collected through a portable device mounted on a vehicle's seat belt may include the portable device and a first vibration device. The portable device may include a BCG sensor board that collects raw data generated based on the driver's bio-vibrations, a data processing unit that converts the raw data into bio-data, a connecting wire connected to the BCG sensor board, an artificial intelligence model trained to determine the driver's state based on the bio-data, a device unit including a processor electrically connected to the BCG sensor board, and a pad unit including a plurality of air cells, a piezoelectric sensor connected to the connecting wire, a spacing member that surrounds the connecting wire and contacts the piezoelectric sensor, a silicone tube that is perforated and connected to one side of the plurality of air cells, one side of the silicone tube is connected to one side of the plurality of air cells, and the other side of the silicone tube is formed to seal the piezoelectric sensor and the spacing member, and the connecting wire penetrates a part of the other side of the silicone tube and is connected to the BCG sensor board, and may include a first vibration device that is located on the seat bottom of the vehicle or the backrest of the vehicle and provides vibration. The processor can acquire raw data about the driver through the BCG sensor board based on the driver's bio-vibrations transmitted to the plurality of air cells while the driver's body part is in contact with the plurality of air cells, convert the raw data into bio-data through the data processing unit, process the bio-data through the artificial intelligence model to determine the driver's state, and provide customized feedback to the driver based on the determined driver's state.

[0137] According to one embodiment, the data processing unit obtains biometric data by sequentially applying a Fourier transform and a wavelet transform to the raw data, and the biometric data may include data on heart rhythm and data on respiration.

[0138] According to one embodiment, the spacing member has a spherical shape and can be made of a plastic material that is an insulator.

[0139] According to one embodiment, the pad portion may further include a second vibration device comprising a plurality of actuators that provide vibration and are positioned to surround a plurality of air cells, and a vibration reduction portion positioned between the plurality of air cells and the second vibration device.

[0140] According to one embodiment, the system may further include a camera and a speaker installed inside the vehicle. The processor acquires eye data by photographing the driver's eyeball through the camera, and inputs at least one of the driver's biometric data or the eye data into the artificial intelligence model for processing to identify whether the driver's condition is drowsy, and if the driver's condition is identified as drowsy, controls the first vibration device to provide vibration to the driver and controls the speaker to output a warning sound to relieve drowsiness to the driver.

[0141] According to one embodiment, the processor inputs the driver's biometric data into the artificial intelligence model and processes it to determine whether the driver's condition is an emergency state including at least one of a sudden drop in heart rate or cessation of breathing; if the driver's condition is determined to be an emergency state, the processor converts the vehicle's mode from manual driving mode to autonomous driving mode, and controls the vehicle so that the vehicle autonomously drives along an optimal path to stop in a stopping area located around the vehicle based on vehicle information including the vehicle's speed and location, surrounding information regarding structures around the vehicle, and map information.

[0142] According to one embodiment, the processor sets a safe zone for each driver, identifies the real-time location of the driver, compares the real-time location of the driver with the safe zone to identify whether the driver is leaving the safe zone, and if it is identified that the driver has left the safe zone, provides guide information to move the driver's vehicle into the safe zone. The shape of the safe zone is circular or polygonal, the circular shape has a radius of a specified distance centered on the driver, and the polygonal shape can be formed by selecting a specified number of areas or buildings frequently visited by the driver and connecting the selected areas or buildings with straight lines.

[0143] According to one embodiment, the processor readjusts at least one of the size or shape of the safety zone based on the driver's health condition, and if the driver's health condition is identified as deteriorating based on the biometric data, it may reduce the radius of the circular safety zone, reduce the specified number of polygonal shapes, or change the polygonal shapes to the circular shape.

[0144] According to one embodiment, when the driver is located outside the safe zone, the processor applies a weight value to the raw data to convert the raw data into biometric data through the data processing unit, and can increase the weight value applied to the raw data as the driver's location moves further away from the safe zone.

[0145] According to one embodiment, the processor identifies that the driver's condition is drowsy based on the biometric data and provides vibration through the first vibration device; if the driver's condition is still identified as drowsy even after a specified time has elapsed, the processor changes the pattern of vibration provided through the first vibration device, and the pattern of vibration may include the intensity and duration of the vibration.

Claims

Claim 1 There is a system for preventing drowsy driving based on biometric information of a driver collected through a portable device mounted on a vehicle's seat belt, wherein the portable device includes a device section and a pad section, and the device section comprises: a BCG sensor board that collects raw data generated based on the driver's bio-vibrations; a data processing section that converts the raw data into biometric data; and an artificial intelligence model trained to determine the driver's state based on the biometric data. and a processor electrically connected to the BCG sensor board, the data processing unit, and the artificial intelligence model; wherein the pad unit comprises: a plurality of air cells, wherein the plurality of air cells are located on one side of the pad unit, and a first vibration device located on the seat floor of the vehicle or the backrest portion of the vehicle and providing vibration; wherein a silicone tube connected by a through hole on one side of the plurality of air cells, wherein one end of the silicone tube is connected to one side of the plurality of air cells, and the other end of the silicone tube is configured to position the piezoelectric sensor and the spacing member inside the silicone tube to seal the piezoelectric sensor and the spacing member, wherein the spacing member is located on the side of the spacing member so as to simultaneously contact the side of the piezoelectric sensor and the other end of the silicone tube, and the spacing member is composed of a spherical insulating material, and a connecting wire, wherein the connecting wire connects the piezoelectric sensor and the BCG sensor board, and one end of the connecting wire is located in the area of ​​the piezoelectric sensor such that the piezoelectric sensor and the spacing member It is connected to the contact area, and the connecting wire extends from the contact area through the center of the spacing member and through an opening provided therein, and penetrates a part of the other end of the silicone tube and penetrates an opening formed on the rear of the device part, so that the other end of the connecting wire is connected to the BCG sensor board, and the part of the other end of the silicone tube through which the connecting wire penetrates is coated with an adhesive member to maintain sealing, and a first Velcro and a second Velcro,The first Velcro and the second Velcro are located on the other side of the pad portion, and the first Velcro and the second Velcro wrap around the seat belt of the vehicle, so that the portable device is attached to the seat belt, and the back surface of the device portion is adhered to the upper surface of the second Velcro, so that the device portion is fixed to the second Velcro, and the pad portion further includes a second vibration device, the second vibration device is arranged along the periphery of a plurality of air cells located on one side of the pad portion, the second vibration device is composed of a plurality of substructures, and a vibration reduction unit is located between the second vibration device and the plurality of air cells to prevent the vibration of the second vibration device from propagating to the plurality of air cells, and the processor: acquires raw data about the driver through the BCG sensor board based on the driver's bio-vibrations propagated to the plurality of air cells while a part of the driver's body is in contact with the plurality of air cells, converts the raw data into bio-data through the data processing unit, and the bio-data through the artificial intelligence model A system that processes and determines the state of the driver, and provides customized feedback to the driver based on the determined state of the driver. Claim 2 A system according to claim 1, wherein the data processing unit obtains biometric data by sequentially applying a Fourier transform and a wavelet transform to the raw data, and the biometric data includes data on heart rhythm and data on respiration. Claim 3 delete Claim 4 delete Claim 5 The system of claim 1 further comprises a camera and a speaker installed inside the vehicle; and the processor comprises: acquiring eye data by photographing the driver's eyeball through the camera, and inputting at least one of the driver's biometric data or the eye data into the artificial intelligence model for processing to identify whether the driver's state is drowsy, and if the driver's state is identified as drowsy, controlling the first vibration device to provide vibration to the driver and controlling the speaker to output a warning sound to relieve drowsiness to the driver. Claim 6 A system according to claim 1, wherein the processor: inputs and processes the driver’s biometric data into the artificial intelligence model to determine whether the driver’s condition is an emergency condition including at least one of a sudden drop in heart rate or cessation of breathing; if the driver’s condition is determined to be an emergency condition, converts the vehicle’s mode from a manual driving mode to an autonomous driving mode; and controls the vehicle so that the vehicle is autonomously driven to stop in a stopping area located around the vehicle along an optimal path based on vehicle information including the speed and location of the vehicle, surrounding information regarding structures around the vehicle, and map information. Claim 7 In claim 1, the processor: sets a safe zone for each driver, identifies the real-time location of the driver, compares the real-time location of the driver with the safe zone to identify whether the driver is leaving the safe zone, and if it is identified that the driver has left the safe zone, provides guide information to move the driver's vehicle into the safe zone, wherein the shape of the safe zone is circular or polygonal, the circular shape has a radius of a specified distance centered on the driver, and the polygonal shape is formed by selecting a specified number of areas or buildings frequently visited by the driver and connecting the selected areas or buildings with straight lines. Claim 8 A system according to claim 7, wherein the processor readjusts at least one of the size or shape of the safety zone based on the health condition of the driver, and if the health condition of the driver is identified as deteriorating based on the biometric data, reduces the radius of the circular safety zone, reduces the specified number of the polygonal shape, or changes the polygonal shape to the circular shape. Claim 9 A system according to claim 7, wherein the processor: applies a weight value to the raw data to convert the raw data into the biometric data through the data processing unit when the driver is located outside the safe zone, and increases the weight value applied to the raw data as the driver's location moves further away from the safe zone. Claim 10 A system according to claim 1, wherein the processor identifies that the driver's state is drowsy based on the biometric data and provides vibration through the first vibration device, and if the driver's state is still identified as drowsy even after a specified time has elapsed, changes the pattern of vibration provided through the first vibration device, and the pattern of vibration includes an intensity and a duration of vibration.

Images