Method, apparatus and computer program for notifying driver's health condition and dangerous situations based on biometric signals

Abstract

A method for notifying a health condition risk situation based on a driver's biosignal according to various embodiments of the present invention is disclosed. The method may include the steps of acquiring a user biosignal corresponding to a driver, monitoring whether the driver's health condition corresponds to a risk condition based on the user biosignal, and outputting a warning signal using an output device provided inside and outside a vehicle when the user biosignal corresponds to the risk condition.

Description

Technology Field

[0001] The present invention relates to a method for monitoring a dangerous situation regarding a driver's health condition while driving, and more specifically, to a method, device, and computer program for acquiring real-time biometric data of a driver during driving and predicting the occurrence of an emergency situation based on the acquired biometric data. Background Technology

[0003] Automotive safety technology has advanced significantly in recent years, with particular attention focused on technologies that monitor driver health and safety. These technologies prioritize the early detection of potential medical emergencies while driving and enable appropriate responses. Existing approaches largely rely on single-sensor systems, focusing on monitoring specific vital signs such as heart rate and electrocardiograms (ECG).

[0004] However, these systems had a problem in that they failed to adequately consider the driving environment and the physiological differences of individual drivers. For example, single-sensor systems struggle to respond to the various situations that may occur while driving, and data accuracy can deteriorate, particularly due to changes in road conditions or the influence of the external environment. Furthermore, relying solely on a single data point increases the possibility of errors and limits the ability to comprehensively analyze various biosignals.

[0005] Furthermore, existing systems tended not to adequately consider the individual health status or physiological characteristics of drivers, posing a problem in applying uniform standards. This made it difficult to accurately monitor drivers with specific health conditions and implement appropriate warning systems.

[0006] These problems have acted as limiting factors for effective responses to medical emergencies that may occur while driving, and the need for a new approach to overcome them has emerged.

[0007] Accordingly, recognizing the limitations of existing technologies, there may be a demand in the industry for research and development of new solutions that can more effectively protect the safety and health of drivers. Prior art literature

[0008] Republic of Korea Registered Patent Publication No. 10-1828068 The problem to be solved

[0009] The present invention is devised in response to the aforementioned background technology and aims to provide a method, device, and program for notifying a driver of a health condition risk situation based on their biosignals.

[0010] The technical problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0012] According to an embodiment of the present invention for solving the problem described above, a method for notifying a health condition risk situation based on a driver's biosignal is disclosed. The method may include the steps of acquiring a user biosignal corresponding to a driver, monitoring whether the driver's health condition corresponds to a risk condition based on the user biosignal, and outputting a warning signal using an output device provided inside and outside a vehicle when the user biosignal corresponds to the risk condition.

[0013] In an alternative embodiment, the step of acquiring the user biosignal comprises acquiring a plurality of candidate biosignals corresponding to the driver and acquiring the user biosignal based on the plurality of candidate biosignals, wherein the plurality of candidate biosignals may include a first candidate biosignal acquired through a first module provided corresponding to the steering wheel in the vehicle, a second candidate biosignal acquired through a second module provided corresponding to the seat in the vehicle, a third candidate biosignal acquired through a third module provided corresponding to the driver's seat in the vehicle, and a fourth candidate biosignal acquired through a fourth module provided in contact with the user's body.

[0014] In an alternative embodiment, the step of acquiring the user biosignal may include determining the reliability of each of the plurality of candidate biosignals and determining the candidate biosignal with the highest real-time reliability as the user biosignal.

[0015] In an alternative embodiment, the reliability of each of the plurality of candidate biosignals is calculated based on the pattern accuracy and reaction time of each candidate biosignal, and is characterized by being weighted based on the driving state information of the vehicle, wherein the driving state information may include information regarding driving speed, road stability, driving complexity, external driving environment, driving time, and driving posture.

[0016] In an alternative embodiment, the step of determining the reliability of each of the plurality of candidate biosignals may include acquiring each of the plurality of candidate biosignals corresponding to a driver during a test drive, determining each of the optimal candidate biosignals according to driving conditions and environmental conditions to construct customized sensor selection information corresponding to the driver, and determining the user biosignal among the plurality of candidate biosignals based on the customized sensor selection information corresponding to the driver.

[0017] In an alternative embodiment, the step of monitoring whether the driver's health condition corresponds to a dangerous condition includes the step of monitoring whether the driver's health condition corresponds to a first dangerous condition based on the biosignal and the step of monitoring whether the driver's health condition corresponds to a second dangerous condition based on the biosignal, and the step of outputting a warning signal may include the step of outputting a first warning signal through a display unit provided inside the driver's vehicle when the driver's health condition corresponds to the first dangerous condition and the step of outputting a second warning signal through an output device provided outside the driver's vehicle when the driver's health condition corresponds to the second dangerous condition.

[0018] In an alternative embodiment, the method may include the steps of: acquiring location information of the vehicle when the driver's health condition corresponds to the second risk condition; selecting an adjacent emergency medical institution based on the real-time location information of the vehicle; transmitting an emergency control signal to the vehicle control system of the vehicle; and transmitting an emergency signal to the emergency medical institution.

[0019] In an alternative embodiment, the method comprises the steps of: acquiring location information of the vehicle and identifying an adjacent external user terminal based on the real-time location information of the vehicle when the health condition of the driver corresponds to the second risk condition; detecting the approach of the external user terminal and determining to transmit an emergency explanation user interface to the external user terminal when the external user terminal is within a certain distance of the location of the vehicle, wherein the emergency explanation user interface may include a reporting explanation screen regarding the procedure for reporting an emergency situation, an explanation information screen corresponding to an emergency rescue operation, and an emergency rescue operation screen that counts and displays the execution time and number of executions of the emergency rescue operation based on the user's selection input.

[0020] According to one embodiment of the present invention for solving the above-described problem, an apparatus is disclosed. The apparatus comprises: a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory, and the processor can perform the above-described methods by executing the one or more instructions.

[0021] According to one embodiment of the present invention for solving the above-described problem, a computer program stored on a computer-readable recording medium is disclosed, which is combined with a computer as hardware to perform the above-described methods.

[0022] Other specific details of the present invention are included in the detailed description and drawings. Effects of the invention

[0024] The present invention provides a new method for detecting a driver's biosignals more accurately and reliably. Specifically, it utilizes multiple sensor modules to acquire multiple candidate biosignals and integrates and analyzes them to monitor the driver's health status.

[0025] Furthermore, the present invention, through an algorithm that determines which biosignals to use as primary data based on driving conditions and signal accuracy, can more accurately detect various health risk situations that may occur while driving and effectively protect the driver's safety by outputting appropriate warning signals. This represents a significant advancement in the field of automotive safety technology and can contribute to protecting drivers' lives and further enhancing traffic safety.

[0026] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below. Brief explanation of the drawing

[0028] FIG. 1 is a schematic diagram showing a system for performing a method for notifying a driver of a health condition risk situation based on a biosignal of the driver related to one embodiment of the present invention. FIG. 2 is a hardware configuration diagram of a server that performs a method for notifying a driver of a health condition risk situation based on a biosignal of the present invention. FIG. 3 illustrates a flowchart exemplarily showing a method for notifying a driver of a health condition risk situation based on a biosignal of the present invention. FIG. 4 illustrates a flowchart exemplarily showing the process of acquiring a user biosignal related to one embodiment of the present invention. FIG. 5 illustrates a flowchart that exemplarily shows a process of outputting various warning signals based on the health condition of a driver related to an embodiment of the present invention. FIG. 6 illustrates a flowchart exemplifying an immediate emergency response situation based on the results of monitoring a driver's health condition related to an embodiment of the present invention. Specific details for implementing the invention

[0029] Various embodiments are now described with reference to the drawings. In this specification, various descriptions are provided to facilitate an understanding of the invention. However, it is evident that these embodiments can be practiced without such specific descriptions.

[0030] As used herein, terms such as “component,” “module,” “system,” etc. refer to computer-related entities, hardware, firmware, software, combinations of software and hardware, or executions of software. For example, a component may be, but is not limited to, a procedure executed on a processor, a processor, an object, an execution thread, a program, and / or a computer. For example, both an application executed on a computing device and the computing device itself may be a component. One or more components may reside within a processor and / or an execution thread. A component may be localized within a single computer. A component may be distributed among two or more computers. Additionally, these components may be executed from various computer-readable media having various data structures stored therein. Components may communicate through local and / or remote processes, for example, according to signals having one or more data packets (e.g., data from a component interacting with another component in a local system or distributed system, and / or data transmitted through signals to other systems and networks such as the Internet).

[0031] Furthermore, the term "or" is intended to mean an implicit "or" rather than an exclusive "or." That is, unless otherwise specified or evident from the context, "X uses A or B" is intended to mean one of the natural implicit substitutions. In other words, if X uses A; if X uses B; or if X uses both A and B, "X uses A or B" may apply to any of these cases. Additionally, the term "and / or" as used herein should be understood to refer to and include all possible combinations of one or more of the enumerated related items.

[0032] Additionally, the terms “comprising” and / or “comprising” should be understood to mean that such features and / or components are present. However, the terms “comprising” and / or “comprising” should be understood not to exclude the presence or addition of one or more other features, components and / or groups thereof. Furthermore, unless otherwise specified or clearly evident from the context to indicate a singular form, the singular in this specification and claims should generally be interpreted to mean “one or more.”

[0033] Those skilled in the art should recognize that the various exemplary logical blocks, configurations, modules, circuits, means, logics, and algorithmic steps described in connection with the embodiments disclosed herein may be implemented in electronic hardware, computer software, or a combination of both. To clearly exemplify the interchangeability of hardware and software, various exemplary components, blocks, configurations, means, logics, modules, circuits, and steps have been generally described above in terms of their functionality. Whether such functionality is implemented in hardware or software depends on the specific application and design constraints imposed on the overall system. Skilled technicians may implement the described functionality in various ways for each specific application. However, such decisions regarding implementation should not be interpreted as moving out of the scope of the invention.

[0034] The description of the presented embodiments is provided to enable those skilled in the art to use or practice the present invention. Various modifications to these embodiments will be apparent to those skilled in the art. The general principles defined herein may be applied to other embodiments without departing from the scope of the present invention. Thus, the present invention is not limited to the embodiments presented herein. The present invention should be interpreted in the broadest possible scope consistent with the principles and novel features presented herein.

[0035] In this specification, the term "computer" refers to any type of hardware device comprising at least one processor, and may be understood to include software configurations operating on said hardware device according to the embodiments. For example, the term "computer" may be understood to include smartphones, tablet PCs, desktops, laptops, and user clients and applications running on each of these devices, but is not limited thereto.

[0036] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0037] Each step described in this specification is described as being performed by a computer, but the subject of each step is not limited thereto, and depending on the embodiment, at least some of each step may be performed on different devices.

[0039] FIG. 1 is a schematic diagram showing a system for performing a method for notifying a driver of a health condition risk situation based on a biosignal of the driver related to one embodiment of the present invention.

[0040] Referring to FIG. 1, a system according to one embodiment of the present invention may include a computing device (100), a vehicle (200), and an external server (300) for performing a method for notifying a health condition risk situation based on a driver's biosignal. Here, the system for performing a health condition risk situation notification method based on a driver's biosignal illustrated in FIG. 1 is according to one embodiment, and its components are not limited to the embodiment illustrated in FIG. 1 and may be added, changed, or deleted as needed.

[0041] In one embodiment, a computing device (100) (hereinafter referred to as the computing device (100)) that performs a method for notifying a health condition risk situation based on a driver's biosignal can acquire a driver's real-time biosignal according to the driving situation and can determine whether the driver's health condition corresponds to a risk condition based on the real-time biosignal. In addition, if the computing device (100) detects that the driver's health condition is dangerous, it can effectively protect the driver's safety by outputting an appropriate warning signal in real time.

[0042] For example, existing technologies have primarily focused on detecting only specific biosignals, such as heart rate and electrocardiogram (ECG), using a single sensor. However, this approach has limitations in that it fails to adequately consider diverse driving environments and the characteristics of individual drivers.

[0043] The computing device (100) of the present invention overcomes the limitations of existing technology and provides a new method for detecting a driver's biosignal more accurately and reliably. The computing device (100) acquires a plurality of candidate biosignals by utilizing a plurality of sensor modules and monitors the driver's health condition by integrally analyzing them. These sensor modules may include a hand grip type heart rate sensor mounted on the steering wheel, an ECG electrocardiogram sensor equipped on the seat (or seat), a camera module that acquires heart rate information using an image-based RPPG method, and a wearable device in the form of a PPG bracelet. Additionally, the computing device (100) may include an algorithm that determines which biosignal to use as primary data based on driving conditions, signal accuracy, etc. Through this, various health risk situations that may occur while driving can be detected more accurately, and appropriate warning signals can be output to effectively protect the driver's safety.

[0044] In one embodiment, the computing device (100) can predict a dangerous situation based on the driver's biosignal and generate a warning signal based thereon and provide it to the vehicle (200). Here, the vehicle may refer to various types of automobiles, such as passenger cars, commercial vehicles, and special purpose vehicles.

[0045] In FIG. 1, the computing device (100) and the vehicle (200) are shown as separate entities, but according to the embodiment, the computing device (100) may be included and provided within the vehicle. In this case, the system of the computing device (100) and the vehicle (200) can operate as a single integrated system.

[0046] In an embodiment, an output device (or display means) may be provided in the interior and exterior of the vehicle, respectively, and each output device is driven based on a warning signal received from a computing device (100). For example, when a first warning signal is received from the computing device (100), the first warning signal may be output through a display unit provided inside the vehicle, and when a second warning signal is received from the computing device (100), the second warning signal may be output through an output device provided outside the vehicle (e.g., an LED display device).

[0047] The first warning signal may be a direct health risk alert or a message requesting action to the driver, and the second warning signal may be the activation of a warning light indicating a more serious danger or automatic contact with emergency services.

[0048] In this way, when a vehicle receives a warning signal corresponding to a predicted dangerous situation (i.e., a dangerous situation predicted based on the driver's biosignal) through a computing device (100), it can provide this to various users through an output device, thereby effectively protecting the driver's safety and health and enabling a rapid response in emergency situations.

[0049] In various embodiments, the computing device (100) may provide Web or Application-based services. However, it is not limited thereto.

[0050] The computing device (100) may include any type of computer system or computer device, such as, for example, a microprocessor, a mainframe computer, a digital processor, a portable device, and a device controller. However, it is not limited thereto.

[0051] According to an embodiment, a computing device (100) for performing a method to control the seat environment of a vehicle may include any server implemented by an Application Programming Interface (API).

[0052] According to one embodiment of the present invention, the computing device (100) may be a server that provides cloud computing services. More specifically, the computing device (100) may be a server that provides cloud computing services, which are a type of internet-based computing, where information is processed by another computer connected to the internet rather than the user's computer. The cloud computing service may be a service that stores data on the internet and allows users to access necessary data or programs anytime and anywhere via internet access without installing them on their own computers, and allows data stored on the internet to be easily shared and transmitted through simple operations and clicks. Furthermore, the cloud computing service may not only simply store data on a server on the internet but also allow users to perform desired tasks using the functions of applications provided on the web without installing separate programs, and may be a service that allows multiple people to work while sharing documents simultaneously. Additionally, the cloud computing service may be implemented in at least one form among IaaS (Infrastructure as a Service), PaaS (Platform as a Service), SaaS (Software as a Service), a virtual machine-based cloud server, and a container-based cloud server. That is, the computing device (100) of the present invention may be implemented in at least one form among the cloud computing services described above. The specific description of the aforementioned cloud computing service is merely an example, and the present invention may include any platform for establishing a cloud computing environment.

[0053] In various embodiments, the computing device (100) may be connected to the vehicle (200) via a network and may provide control information for changing the seat environment of the vehicle. A plurality of environment change modules are disposed in the vehicle (200), and each environment change module may be individually driven based on control information (e.g., seat environment control information) received from the computing device (100).

[0054] In various embodiments, the computing device (100) may be connected to the vehicle (200) via a network and may collect and analyze the driver's biometric information in real time from various sensors placed inside the vehicle (200). The collected biometric information may include the driver's heart rate, breathing pattern, blood pressure, oxygen saturation, etc., and this data may be used as an important indicator related to the driver's health status.

[0055] The vehicle (200) may include a seat, steering wheel, seat belt, etc., with various sensor modules built in to detect the driver's biosignals. These sensor modules collect precise biosignals through direct contact with the driver. For example, a sensor built into the steering wheel can detect the heart rate and body temperature from the driver's hands, and a sensor built into the seat can detect pressure changes to track the driver's breathing pattern.

[0056] In a specific embodiment, the vehicle may be equipped with a hand grip type heart rate sensor module mounted on the steering wheel, an ECG electrocardiogram sensor module equipped on the seat (or seat), a camera module that acquires heart rate information using an image-based RPPG method, and a wearable device in the form of a PPG bracelet, thereby enabling the acquisition of multiple heart rate data corresponding to the driver.

[0057] The computing device (100) can analyze the driver's biometric data in real time to provide a comprehensive overview of the driver's health status. Based on the analysis results, the computing device (100) can identify situations that may pose a threat to the driver's health and generate an immediate warning signal. For example, if the driver's heart rate is detected to be abnormally high or low, which may be a sign of stress or heart problems, the computing device (100) can determine this as a danger signal and activate the vehicle's warning system.

[0058] The warning system operates through various output devices installed inside and outside the vehicle. Inside, visual warning messages can be displayed via the display unit, and voice warnings can be provided through the audio system. Outside, warnings can be provided to other drivers and pedestrians through LED traffic lights, turn signals, or other warning devices.

[0059] Additionally, the computing device (100) can receive additional input from the driver through a user interface. The user interface is implemented in the form of a display unit to receive touch input, and the driver can check detailed information about their health condition through this and take additional measures if necessary. For example, the driver can check information about their health condition on the display unit and request emergency services immediately if medical assistance is needed.

[0060] This system can respond quickly to various medical emergencies that may occur while driving and effectively protect the driver's health and safety. This interaction between the computing device (100) and the vehicle (200) enhances the safety functions of the vehicle while providing the driver with a safer and healthier driving environment.

[0061] The computing device (100) of the present invention monitors the driver's biometric information in real time within a vehicle and provides a method for responding immediately and quickly to dangerous situations based on this information. Through this, the driver can have a safer and more comfortable driving experience, and the vehicle manufacturer can provide technology that can more effectively protect the driver's health and safety.

[0062] In one embodiment, an external server (300) may be connected to a computing device (100) via a network and may provide various information / data necessary for the computing device (100) to provide a method for controlling the environment of a vehicle seat, or receive, store, and manage result data derived from performing the method for controlling the environment of a vehicle seat. For example, the external server (300) may be a storage server separately provided outside the computing device (100), but is not limited thereto. The hardware configuration of the computing device (100) will be described below with reference to FIG. 2.

[0064] FIG. 2 is a hardware configuration diagram of a computing device that performs a method for notifying a driver of a health condition risk situation based on a biosignal of the driver according to one embodiment of the present invention.

[0065] Referring to FIG. 2, a computing device (100) according to one embodiment of the present invention may include one or more processors (110), a memory (120) for loading a computer program (151) executed by the processor (110), a bus (130), a communication interface (140), and a storage (150) for storing the computer program (151). Here, FIG. 2 illustrates only the components related to the embodiment of the present invention. Therefore, a person skilled in the art to which the present invention pertains will understand that other general-purpose components may be included in addition to the components illustrated in FIG. 2.

[0066] The processor (110) controls the overall operation of each component of the computing device (100). The processor (110) may be configured to include a CPU (Central Processing Unit), an MPU (Micro Processor Unit), an MCU (Micro Controller Unit), a GPU (Graphic Processing Unit), or any form of processor well known in the art of the present invention.

[0067] According to one embodiment of the present invention, the processor (110) can typically handle the overall operation of the computing device (100). The processor (110) can provide or process appropriate information or functions to a user or user terminal by processing signals, data, information, etc. that are input or output through the components described above, or by running an application program stored in memory (120).

[0068] Additionally, the processor (110) can perform operations for at least one application or program for executing the method according to embodiments of the present invention, and the computing device (100) may have one or more processors.

[0069] In various embodiments, the processor (110) may further include RAM (Random Access Memory, not shown) and ROM (Read-Only Memory, not shown) for temporarily and / or permanently storing signals (or data) processed within the processor (110). Additionally, the processor (110) may be implemented in the form of a system-on-chip (SoC) comprising at least one of a graphics processing unit, RAM, and ROM.

[0070] Memory (120) stores various data, instructions and / or information. Memory (120) may load a computer program (151) from storage (150) to execute a method / operation according to various embodiments of the present invention. When the computer program (151) is loaded into memory (120), the processor (110) may perform the method / operation by executing one or more instructions constituting the computer program (151). Memory (120) may be implemented as volatile memory such as RAM, but the technical scope of the present invention is not limited thereto.

[0071] The bus (130) provides communication functions between components of the computing device (100). The bus (130) can be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

[0072] The communication interface (140) supports wired and wireless internet communication of the computing device (100). Additionally, the communication interface (140) may support various communication methods other than internet communication. To this end, the communication interface (140) may be configured to include a communication module well known in the art of the present invention. In some embodiments, the communication interface (140) may be omitted.

[0073] Storage (150) can store a computer program (151) non-temporarily. When performing a process to provide a driver's biosignal-based health condition risk situation notification service through a computing device (100), storage (150) can store various information necessary to provide the process to provide a driver's biosignal-based health condition risk situation notification service.

[0074] The storage (150) may be configured to include non-volatile memory such as ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0075] A computer program (151) may include one or more instructions that cause a processor (110) to perform a method / operation according to various embodiments of the present invention when loaded into memory (120). That is, the processor (110) may perform the method / operation according to various embodiments of the present invention by executing the one or more instructions.

[0076] In one embodiment, a computer program (151) may include one or more instructions for performing a method for notifying a health condition risk situation based on a driver's biosignal, comprising the steps of acquiring a user biosignal corresponding to a driver, monitoring whether the driver's health condition corresponds to a risk condition based on the user biosignal, and outputting a warning signal using an output device provided inside and outside the vehicle when the user biosignal corresponds to the risk condition.

[0077] The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. The software module may reside in RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0078] The components of the present invention may be implemented as a program (or application) and stored on a medium to be executed in combination with a computer, which is hardware. The components of the present invention may be executed as software programming or software elements, and similarly, embodiments may be implemented in programming or scripting languages ​​such as C, C++, Java, assembler, etc., including various algorithms implemented as a combination of data structures, processes, routines, or other programming configurations. Functional aspects may be implemented as algorithms executed on one or more processors. Hereinafter, with reference to FIGS. 3 through 6, a method for controlling the seat environment of a vehicle performed by a computing device (100) will be described.

[0080] FIG. 3 illustrates a flowchart exemplarily illustrating a method for notifying a health condition risk situation based on a driver's biosignal according to an embodiment of the present invention. FIG. 4 illustrates a flowchart exemplarily illustrating a process for acquiring a user's biosignal according to an embodiment of the present invention. FIG. 5 illustrates a flowchart exemplarily illustrating a process for outputting various warning signals based on a driver's health condition according to an embodiment of the present invention. FIG. 6 illustrates a flowchart exemplarily illustrating an immediate emergency response situation based on the results of monitoring a driver's health condition according to an embodiment of the present invention.

[0081] Referring to FIG. 3, a method for notifying a health condition risk situation based on a driver's biosignal may include the step (S100) of acquiring a user biosignal corresponding to the driver.

[0082] More specifically, referring to FIG. 4, the step of acquiring a user biosignal may include the step of acquiring a plurality of candidate biosignals corresponding to a driver (S110) and the step of acquiring a user biosignal based on the plurality of candidate biosignals. In this case, the plurality of candidate biosignals may include a first candidate biosignal acquired through a first module provided corresponding to a steering wheel in the vehicle, a second candidate biosignal acquired through a second module provided corresponding to a seat in the vehicle, a third candidate biosignal acquired through a third module provided corresponding to a driver's seat in the vehicle, and a fourth candidate biosignal acquired through a fourth module provided in contact with the user's body.

[0083] In an embodiment, a vehicle (200) may be equipped with a plurality of sensor modules (first to fourth modules), and a plurality of candidate biosignals acquired in real time through the plurality of sensor modules may be transmitted to a computing device (100).

[0084] Specifically, each of the first to fourth modules is provided at each of the various locations of the vehicle. As a specific example, a hand grip type heart rate sensor (first module) may be mounted on the steering wheel of the vehicle (200). This sensor can detect the heart rate when the driver holds the steering wheel and transmit this information to the computing device (100). An ECG electrocardiogram sensor (second module) is built into the seat (or seat) of the vehicle, which detects the driver's electrocardiogram signal and provides it to the computing device (100).

[0085] Additionally, a camera module (third module) installed inside the vehicle acquires the driver's heart rate information using an image-based RPPG method. This module can measure the heart rate by analyzing changes in the driver's face color and transmit this data to a computing device (100). In one embodiment, when the computing device (100) generates heart rate data based on changes in the face color, it can detect the user's face in a frame of an image containing a face image. Additionally, the computing device (100) can define a measurement area in the detected face. Furthermore, the computing device (100) can track head movements caused by the user's movement and extract subtle changes in color accordingly to extract a color-based subtle movement signal. That is, even if the user moves, the computing device (100) can track a specific area of ​​the user's face to extract color information. And, the computing device (100) can generate heart rate data based on the subtle movement signal.

[0086] Finally, a wearable device (fourth module) in the form of a PPG bracelet that can be worn on the driver's wrist monitors the driver's heart rate and blood oxygen saturation and transmits this information to a computing device (100). Specifically, the computing device (100) can receive heart rate data from a wearable device worn by a user. For example, a wearable device connected to a vehicle (200) can measure the user's heart rate data. And, the vehicle (200) can acquire heart rate data from the wearable device and transmit it to the computing device (100).

[0087] According to various embodiments, the computing device (100) can acquire an image through a camera module (third module) that captures the user's face. By analyzing changes in face color over time in this image, the computing device (100) generates heart rate data. This image-based heart rate measurement method provides convenience as the user does not need to wear separate equipment, but it may have limitations in terms of accuracy. To compensate for this, the computing device (100) performs an additional correction procedure to improve the accuracy of the heart rate data.

[0088] For example, the computing device (100) can perform correction on the first heart rate data generated based on the camera module by utilizing the second heart rate data received from the wearable device (fourth module) at predetermined intervals. This helps to improve the accuracy of the first heart rate data. Additionally, even in situations where the user does not wear the wearable device at all times, the accuracy of the first heart rate data can be improved by utilizing the second heart rate data provided whenever the wearable device is used.

[0089] In this way, the computing device (100) can provide a balanced solution that minimizes inconvenience to the user while ensuring the accuracy of heart rate data measurement. This has the advantage of contributing to the establishment of a reliable health monitoring system while considering user convenience.

[0090] In addition, in an embodiment, the computing device (100) may obtain basic information of the user from a user profile database. Here, the user profile database may be a database composed of information entered by the user when subscribing to a risk situation detection service provided by the computing device (100) to the user.

[0091] For example, the computing device (100) may obtain physical information such as the user's gender, age, height, and weight, and a heart rate value during resting period from a user profile database. However, it is not limited thereto, and the computing device (100) may also receive the user's physical information and heart rate value during resting period from a vehicle (200) or a separate device connected to the vehicle.

[0092] When a user profile database is established, the computing device (100) can utilize this information to provide a customized health monitoring service for the individual user's physical condition. For example, based on information such as the user's basic heart rate, age group, and gender, a general heart rate range can be set, and compared with heart rate data received from a camera module (third module) and a wearable device (fourth module) to generate an appropriate warning signal when any abnormal signal is detected.

[0093] In this way, the computing device (100) can provide health monitoring and risk detection services customized to the user. By combining the user's basic information with biometric data collected in real time, the computing device (100) provides more accurate and reliable health status information. This can be particularly useful for users who are vulnerable to specific health issues, such as heart disease or stress-related diseases.

[0094] The computing device (100) comprehensively monitors heart health status, stress levels, fatigue levels, etc., based on the user's biosignals and profile information, and based on this, adjusts various safety and health functions within the vehicle (200) and can provide warning signals or guidance messages to the user when necessary. Through this, the driver can always be aware of their health status and take appropriate measures, and the vehicle provides a safer and healthier driving environment.

[0095] In an embodiment, the step of acquiring a user biosignal may include a step of determining the reliability of each of a plurality of candidate biosignals (S120) and a step of determining the candidate biosignal with the highest real-time reliability as the user biosignal (S130).

[0096] The reliability of each of the multiple candidate biosignals may be calculated based on the pattern accuracy and reaction time of each candidate biosignal, and may be characterized by being weighted based on the driving state information of the vehicle. Here, the driving state information may include information regarding driving speed, road stability, driving complexity, external driving environment, driving time, and driving posture.

[0097] More specifically, the step of acquiring user biosignals may include a process of determining the reliability of each of multiple candidate biosignals and determining the candidate biosignal with the highest reliability in real time as the user biosignal. This refers to a process of evaluating the accuracy and responsiveness of biosignals collected from various sensor modules.

[0098] The reliability of each of the multiple candidate biosignals is calculated based on the pattern accuracy and response time of the corresponding signal. For example, the accuracy and response speed of heart rate data generated by a heart rate sensor, and the consistency of electrocardiogram data obtained from an ECG sensor may be evaluation factors. This evaluation process is conducted by considering the technical characteristics and performance of each sensor.

[0099] In addition, weights can be assigned to the reliability of each candidate biosignal by considering the vehicle's driving state information. Here, driving state information may include driving speed, road stability, driving complexity, external driving environment, driving time, and driving posture. For example, during high-speed driving on a highway, signals from specific sensors may be less accurate due to vehicle vibration or the influence of the external environment, and the reliability of the signals can be adjusted by taking these factors into account.

[0100] To explain in more detail, the computing device (100) analyzes the vehicle's driving data and biosignal data collected from sensors in real time. For example, when the vehicle is driving on an unstable road, the data from the heart rate sensor mounted on the steering wheel may be less reliable, and in this case, the computing device (100) may give higher reliability to the data from the ECG sensor or camera module. Conversely, when the vehicle is driving in a stable environment, the data from the heart rate sensor on the steering wheel or the PPG bracelet may be more reliable. In this way, the computing device (100) can monitor the driver's health condition by selecting the most accurate and reliable biosignal according to the driving situation and, if necessary, take appropriate warnings or actions.

[0101] In various embodiments, the computing device (100) can determine the optimal candidate biosignal according to driving and environmental conditions. The computing device (100) can evaluate the reliability of data obtained from each sensor according to driving conditions (e.g., speed, road conditions) and environmental conditions (e.g., climate, traffic conditions). Through this process, it can determine which sensor provides the most reliable data under specific driving and environmental conditions.

[0102] In an embodiment, the computing device (100) can construct sensor selection information most suitable for the driver based on pre-evaluated information. This information may be characterized by being customized by taking into account the individual characteristics and driving patterns of the driver. Based on the customized sensor selection information, the computing device (100) can determine a biosignal for the driver in real time and, if necessary, perform an action for an appropriate warning or measure.

[0103] In a specific embodiment, the step of determining the reliability of each of a plurality of candidate biosignals may include: acquiring each of a plurality of candidate biosignals corresponding to a driver during a test drive; determining each of the optimal candidate biosignals according to driving conditions and environmental conditions to construct customized sensor selection information corresponding to the driver; and determining the user biosignal among the plurality of candidate biosignals based on the customized sensor selection information corresponding to the driver.

[0104] More specifically, the computing device (100) can continuously learn the driver's biosignal patterns and, based on this, provide health monitoring tailored to the individual driver. For example, it can recognize changes in biosignals that occur when a specific driver is under stress and select and use the most reliable sensor data in such situations. This enables data analysis and emergency response better suited to the individual driver's characteristics, and has the advantage of protecting the driver's health and safety more effectively.

[0105] According to an embodiment of the present invention, a method for notifying a health condition risk situation based on a driver's biosignal may include a step (S200) of monitoring whether the driver's health condition corresponds to a risk condition based on the user's biosignal.

[0106] More specifically, the step of monitoring whether the driver's health condition corresponds to a dangerous condition may include the step of monitoring whether the driver's health condition corresponds to a first dangerous condition based on a biosignal and the step of monitoring whether the driver's health condition corresponds to a second dangerous condition based on the biosignal.

[0107] Here, the first risk condition may be whether the heart rate data exceeds 130, and the second risk condition may be whether the heart rate data drops to 60 or lower.

[0108] In an embodiment, the computing device (100) may monitor whether the driver's health condition corresponds to a first risk condition based on the driver's biosignals. For example, the first risk condition may be determining whether the driver's heart rate data exceeds a specific high-risk threshold (e.g., 130). This condition may indicate the possibility that the driver is in a state of excessive stress or tension, in which case a warning signal may be generated immediately and necessary measures may be taken.

[0109] Additionally, the computing device (100) can monitor whether the driver's health condition corresponds to a second risk condition based on the driver's biosignals. The second risk condition may be determining whether the driver's heart rate data falls below a specific low-risk threshold (e.g., 60). Such a condition may indicate a heart or circulatory system problem, or a state of severe fatigue or drowsiness, in which case a warning signal may be immediately generated and necessary measures taken.

[0110] In this way, the computing device (100) can continuously monitor the driver's health condition and take appropriate warnings and response measures when a specific dangerous condition occurs, thereby improving the safety of the vehicle and protecting the driver's health and safety.

[0111] According to an embodiment of the present invention, a method for notifying a health condition risk situation based on a driver's biosignal may include the step (S300) of outputting a warning signal using output devices provided inside and outside the vehicle when the user's biosignal corresponds to a risk condition.

[0112] In a specific embodiment, referring to FIG. 5, the step of outputting a warning signal may include a step of outputting a first warning signal through a display unit provided inside the driver's vehicle when the driver's health condition corresponds to the first risk condition (S310), and a step of outputting a second warning signal through an output device provided outside the driver's vehicle when the driver's health condition corresponds to the second risk condition (S320).

[0113] To explain in more detail, the computing device (100) outputs a first warning signal through a display unit provided inside the driver's vehicle when the driver's health condition corresponds to a first danger condition (e.g., when the heart rate exceeds 130). This warning signal informs the driver that their current health condition is in a potentially dangerous state and prompts them to take appropriate measures if necessary. For example, a message such as "High heart rate risk - stop the vehicle in a safe place immediately" may be displayed on the display unit.

[0114] Additionally, the computing device (100) outputs a second warning signal through an output device located outside the vehicle when the driver's health condition corresponds to a second danger condition (e.g., when the heart rate drops below 60). This warning signal alerts surrounding drivers or pedestrians to the driver's potential health problems and allows them to request external assistance if necessary. For example, an LED signal light outside the vehicle may flash or a siren may sound to alert the surroundings to an emergency situation.

[0115] These warning signal output stages protect the safety of the driver and surrounding personnel and enable a rapid response in the event of an emergency. Warnings inside the vehicle prompt immediate action from the driver, while warnings outside the vehicle alert those around the vehicle to the situation, allowing them to take necessary measures. This configuration provides a safety function that is particularly important for individuals driving independently.

[0116] In various embodiments, a method for notifying a health condition risk situation based on a driver's biosignal may include, as illustrated in FIG. 6, a step of obtaining location information of a vehicle and selecting an adjacent emergency medical institution based on the real-time location information of the vehicle when the driver's health condition corresponds to a second risk condition (S410), a step of transmitting an emergency control signal to a vehicle control system (S420), and a step of transmitting an emergency signal to an emergency medical institution (S430).

[0117] To explain in more detail, the computing device (100) can acquire real-time location information of the vehicle and select an emergency medical facility in the vicinity when the user's health condition corresponds to a second risk condition. This may include a process of identifying and selecting the nearest emergency medical facility by utilizing GPS technology and the vehicle's network connection.

[0118] Additionally, the computing device (100) can transmit an emergency control signal to the vehicle control system. Transmitting an emergency control signal to the vehicle control system indicating an emergency situation may include taking measures such as activating the vehicle's autonomous driving function or guiding the vehicle to a safe parking location. This allows the vehicle to stop safely even in a situation where the driver loses consciousness or is unable to respond.

[0119] Additionally, the computing device (100) can transmit an emergency signal to an emergency medical institution. The emergency signal transmitted by the computing device (100) may include information on the driver's current location, an overview of their health status, and emergency measures to be taken if necessary.

[0120] As described above, the computing device (100) enables an immediate and effective emergency response when the driver is in a dangerous health condition. By utilizing GPS technology and the vehicle's network connection to accurately determine the driver's location and rapidly transmit it to an emergency medical institution, it is possible to provide quick assistance to the driver who requires emergency medical services. Additionally, by transmitting an emergency control signal to the vehicle control system, the vehicle can stop safely and, if necessary, automatically move to the nearest safe location, thereby ensuring the safety of the driver and people around them.

[0121] In an additional embodiment, if the driver's health condition corresponds to a second risk condition, the method may include the steps of obtaining vehicle location information and identifying an adjacent external user terminal based on the vehicle's real-time location information, detecting the approach of the external user terminal, and determining to transmit an emergency explanation user interface to the external user terminal when the external user terminal is within a certain distance of the vehicle's location.

[0122] According to one embodiment, the emergency explanation user interface may include a report explanation screen regarding the procedure for reporting an emergency situation, an explanation information screen corresponding to an emergency rescue operation, and an emergency rescue operation screen that counts and displays the execution time and number of executions of the emergency rescue operation based on the user's selection input.

[0123] More specifically, the computing device (100) may include the step of obtaining location information of the vehicle and identifying an adjacent external user terminal based on the real-time location information of the vehicle when the driver's health condition corresponds to a second danger condition (e.g., when the heart rate drops below 60). In this step, the vehicle's network system may be utilized to identify external user terminals, such as smartphones or other connected devices in the vicinity. This step may be intended to facilitate awareness and response to an emergency situation by utilizing the sensor system and GPS tracking function within the vehicle to locate external user terminals, such as smartphones, tablets, or other connected devices in the vicinity.

[0124] Following the above steps, the computing device (100) detects the approach of an external user terminal, and if the terminal approaches within a certain distance of the vehicle's location, it can transmit an emergency explanation user interface to the external user terminal. This is to enable people in the vicinity to respond more quickly and effectively to the emergency situation.

[0125] According to one embodiment, the emergency explanation user interface may include a report explanation screen, an explanation information screen, and an emergency rescue operation screen.

[0126] The reporting instructions screen informs external users of an emergency situation occurring within the vehicle or on the driver's side, and provides instructions on how to report it. For example, the screen may display step-by-step instructions for the reporting procedure, along with a message such as, "Emergency patient responding to cardiac arrest in the vehicle - Call 119 immediately." Additionally, the reporting instructions screen may display messages such as, "Vehicle Location: [Current GPS Location], Driver Status: [Description of Driver Status]." Along with this, it includes a direct phone button or voice command function for reporting the emergency, enabling the user to quickly contact emergency services. Furthermore, the screen may provide information to bystanders regarding additional actions, such as whether CPR is needed or if the vehicle should be moved to a safe location.

[0127] In addition, the explanatory information screen provides information on emergency rescue actions to assist the driver or people inside the vehicle. For example, it explains first aid methods step-by-step, such as cardiopulmonary resuscitation (CPR), how to move an unconscious person to a safe position, and how to control bleeding. For instance, the screen may provide step-by-step instructions such as, "How to perform CPR: Identify chest compression location, perform 30 rapid and deep chest compressions, and administer 2 breaths of artificial respiration." These instructions are displayed in the form of animations, graphics, or short videos to enable users to easily understand and follow them.

[0128] In addition, the emergency rescue action screen provides information on how often and for how long emergency rescue actions should be performed. For example, it may include a timer or counter that visually displays the number and rhythm of chest compressions. Furthermore, voice guidance such as "Perform 2 breaths of artificial respiration after 30 chest compressions" may also be provided. This is particularly useful when laypeople without emergency training perform first aid, helping them take effective emergency measures through real-time feedback.

[0129] As described above, the computing device (100) provides an emergency explanation user interface to an external user terminal, thereby helping people nearby to quickly recognize an emergency situation inside the vehicle and take appropriate action. In particular, when a driver or passenger inside the vehicle loses consciousness or suffers from a serious health problem, it can help other people nearby to quickly provide emergency treatment. This can be very important for saving lives in the event of an accident, especially in remote areas or areas where the time to reach emergency medical services is long.

[0130] Additionally, in an embodiment, the computing device (100) may provide a reward to an external user terminal that performs first aid. This reward system may be a method of encouraging people around who provide first aid for the driver or other passengers inside the vehicle and expressing gratitude.

[0131] More specifically, individuals responding to emergencies using external user devices may receive specific reward points, for example, through a mobile app. These rewards may be provided in the form of digital coupons, discount codes, loyalty points, or other benefits. The reward system may be designed to encourage active response in the event of an emergency.

[0132] The computing device (100) provides a reward after the emergency situation is resolved and an external user performs first aid. For example, after reporting the emergency situation, the process may proceed by providing a reward to the terminal of the user who provided first aid. The reward contributes to raising awareness of the importance and necessity of first aid and promoting active participation in health and safety within the community.

[0133] In addition, these reward programs may be sponsored or managed by vehicle manufacturers or insurance companies. This involves vehicle manufacturers providing additional protective measures for the safety of drivers and passengers, which can contribute to strengthening corporate social responsibility while building a positive brand image. For insurance companies, supporting these reward programs can be beneficial as it helps prevent larger accidents or damages that may occur by responding quickly to emergencies.

[0135] The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. The software module may reside in RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0136] The components of the present invention may be implemented as a program (or application) and stored on a medium to be executed in combination with a computer, which is hardware. The components of the present invention may be implemented as software programming or software elements, and similarly, embodiments may be implemented in programming or scripting languages ​​such as C, C++, Java, assembler, etc., including various algorithms implemented as combinations of data structures, processes, routines, or other programming configurations. Functional aspects may be implemented as algorithms executed on one or more processors.

[0137] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without altering its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.

Claims

Claim 1 A method performed on one or more processors of a computing device comprises: a step of acquiring a user biosignal corresponding to a driver; a step of monitoring whether the driver's health condition corresponds to a dangerous condition based on the user biosignal; and a step of outputting a warning signal using output devices provided inside and outside a vehicle when the user biosignal corresponds to the dangerous condition; wherein the step of acquiring the user biosignal comprises: a step of acquiring a plurality of candidate biosignals corresponding to the driver; and a step of acquiring the user biosignal based on the plurality of candidate biosignals; wherein the plurality of candidate biosignals include a first candidate biosignal acquired through a first module provided corresponding to a steering wheel inside the vehicle, a second candidate biosignal acquired through a second module provided corresponding to a seat inside the vehicle, a third candidate biosignal acquired through a third module provided corresponding to a driver's seat inside the vehicle, and a fourth candidate biosignal acquired through a fourth module provided in contact with the user's body; and wherein the step of acquiring the user biosignal comprises: a step of determining the reliability of each of the plurality of candidate biosignals. A method for notifying a health condition risk situation based on a driver's biosignal, comprising the step of determining the candidate biosignal with the highest real-time reliability as the user biosignal; wherein the reliability of each of the plurality of candidate biosignals is calculated based on the pattern accuracy and reaction time of each candidate biosignal, and is weighted based on the driving state information of the vehicle, wherein the driving state information includes information regarding driving speed, road stability, driving complexity, external driving environment, driving time, and driving posture. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 A method for notifying a health condition risk situation based on a driver's biosignal according to claim 1, wherein the step of determining the reliability of each of the plurality of candidate biosignals comprises: acquiring each of the plurality of candidate biosignals corresponding to a driver during a test drive; determining each of the optimal candidate biosignals according to driving conditions and environmental conditions to construct customized sensor selection information corresponding to the driver; and determining the user biosignal among the plurality of candidate biosignals based on the customized sensor selection information corresponding to the driver. Claim 6 A method for notifying a health condition risk situation based on a driver's biosignal according to claim 1, wherein the step of monitoring whether the driver's health condition corresponds to a risk condition includes: a step of monitoring whether the driver's health condition corresponds to a first risk condition based on the biosignal; and a step of monitoring whether the driver's health condition corresponds to a second risk condition based on the biosignal; and the step of outputting a warning signal includes: a step of outputting a first warning signal through a display unit provided inside the driver's vehicle when the driver's health condition corresponds to the first risk condition; and a step of outputting a second warning signal through an output device provided outside the driver's vehicle when the driver's health condition corresponds to the second risk condition. Claim 7 A method for notifying a health condition risk situation based on a driver's biosignal, wherein, in the case where the driver's health condition corresponds to the second risk condition, the method comprises: a step of acquiring location information of the vehicle and selecting an adjacent emergency medical institution based on the real-time location information of the vehicle; a step of transmitting an emergency control signal to the vehicle control system of the vehicle; and a step of transmitting an emergency signal to the emergency medical institution. Claim 8 In claim 6, the method comprises: a step of acquiring location information of the vehicle and identifying an adjacent external user terminal based on the real-time location information of the vehicle when the driver's health condition corresponds to the second risk condition; and a step of detecting the approach of the external user terminal and determining to transmit an emergency explanation user interface to the external user terminal when the external user terminal is within a certain distance of the vehicle's location; wherein the emergency explanation user interface includes a reporting explanation screen regarding the procedure for reporting an emergency situation, an explanation information screen corresponding to an emergency rescue operation, and an emergency rescue operation screen that counts and displays the execution time and number of executions of the emergency rescue operation based on the user's selection input. Claim 9 A device comprising: a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory, wherein the processor performs the method of claim 1 by executing the one or more instructions. Claim 10 A computer program stored on a recording medium readable by a computer, combined with a computer which is hardware, to perform the method of claim 1.

Images