Driver monitoring device and operation method thereof

The driver monitoring system employs a smart pad with electronic threads for non-contact monitoring, addressing accuracy issues in conventional systems by providing immediate and accurate detection of driver conditions, thus enhancing safety through real-time vehicle control.

WO2024248182A1PCT designated stage expired Publication Date: 2024-12-05LG ELECTRONICS INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/007470
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional driver monitoring systems face challenges in accuracy due to difficulties in camera recognition when the driver moves and the complexity of biometric recognition methods, particularly with pulse wave analysis being influenced by driving habits and requiring non-contact electrocardiogram implementation.

Method used

A driver monitoring system utilizing a smart pad with a core substrate and fabric-based electronic thread for non-contact monitoring, which includes sensing data detection and processing to generate control signals for vehicle control, ensuring accuracy and minimizing driver burden.

Benefits of technology

The system enables immediate and accurate monitoring of driver conditions upon entering the vehicle, reducing errors and enhancing safety by providing real-time feedback and control signals for potential hazards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023007470_05122024_PF_FP_ABST
    Figure KR2023007470_05122024_PF_FP_ABST
Patent Text Reader

Abstract

A driver monitoring system control method, according to at least one embodiment of various embodiments of the present disclosure, may comprise the steps of: detecting a user; acquiring sensing data related to the detected user; converting and processing the sensing data if the difference between the sensing data and reference data is greater than or equal to a threshold value; and generating a control signal on the basis of the processed sensing data and transmitting same to a terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Driver monitoring device and method of operation thereof

[0001] The present disclosure relates to a driver monitoring device and an operating method thereof.

[0002] The vehicle DMS (Driver Monitoring System) is a system designed to enhance driver safety. It is a technology that monitors the driver's condition by detecting the driver's face, eye movements, head movements, and hand movements.

[0003] These vehicle DMSs detect driver drowsiness, inattention, and drunk driving, contributing to accident prevention by proactively recognizing these conditions. They can also detect whether the driver is wearing a seatbelt and, if any abnormalities are detected, sound an alarm or automatically bring the vehicle to a halt.

[0004] Conventional vehicle DMSs have used camera recognition or biometric recognition methods.

[0005] However, in the case of the camera recognition method, there were problems such as difficulty in making an accurate judgment when the driver moves a lot, and the technology that analyzes pulse waves through the displacement value of IR reflected back to the driver, which resulted in low accuracy.

[0006] In addition, in the case of biometric methods, pulse analysis is difficult to establish due to the significant influence of the driver's driving habits, and electrocardiogram has to be implemented in a non-contact manner, which has become a problem.

[0007] The present disclosure provides a driver monitoring device and method that enables a DMS (Driver Monitoring System) to be implemented immediately when a driver gets into a vehicle and sits in a seat.

[0008] The present disclosure provides a driver monitoring device and method that ensures accuracy while minimizing the burden on the driver when applying DMS to a vehicle.

[0009] A method for controlling a driver monitoring system according to at least one embodiment among various embodiments of the present disclosure may include the steps of: detecting a user; obtaining sensing data for the detected user; converting and processing the sensing data when a difference between the sensing data and reference data is greater than a threshold; and generating a control signal based on the processed sensing data and transmitting the control signal to a terminal.

[0010] According to the method for controlling a driver monitoring system according to the present disclosure, the step of detecting the user and the step of obtaining sensing data for the detected user can be performed through a smart pad built into a seat in a vehicle.

[0011] According to the method for controlling a driver monitoring system according to the present disclosure, the smart pad can be formed through a core substrate and a fabric-based electronic thread.

[0012] According to the driver monitoring system control method according to the present disclosure, the electronic thread can be formed by forming a metal electrode on a core substrate and radiating a conductive fiber.

[0013] According to the method for controlling a driver monitoring system according to the present disclosure, the electronic thread can be formed by laminating a core substrate on a high strength / elasticity fiber and radiating conductive fibers.

[0014] According to the method for controlling a driver monitoring system according to the present disclosure, the electronic thread can be formed by laminating a core substrate on a high strength / elasticity fiber and radiating conductive fibers onto the core substrate.

[0015] According to the method for controlling a driver monitoring system according to the present disclosure, the configuration of each electronic chamber forming the smart pad may be different from each other.

[0016] According to the driver monitoring system control method according to the present disclosure, the first electronic thread may be formed by radiating conductive fibers after a first metal electrode is laminated on a core substrate, and the second electronic thread may be formed by radiating conductive fibers after a second metal electrode is laminated on a core substrate.

[0017] According to the method for controlling a driver monitoring system according to the present disclosure, the electronic thread can be formed by radiating or coating a transparent synthetic fiber on a core substrate on which an optical element is mounted.

[0018] According to the method for controlling a driver monitoring system according to the present disclosure, the electronic thread can be formed by radiating or coating a transparent synthetic fiber on a core substrate on which a non-photoelectric element is mounted.

[0019] According to the driver monitoring system control method according to the present disclosure, the optical element may include an LED and an ELD.

[0020] According to the driver monitoring system control method according to the present disclosure, the non-photoelectric element may include a battery and a sensor.

[0021] According to the driver monitoring system control method according to the present disclosure, a driving unit may be coupled to one end of the smart pad.

[0022] According to the driver monitoring system control method according to the present disclosure, a driving element may be distributed in one area of ​​the smart pad.

[0023] According to a driver monitoring system control device according to the present disclosure, there is provided a smart pad that detects a user and obtains sensing data about the detected user; and a processor that converts and processes the sensing data when a difference between the sensing data and reference data is greater than a threshold value, and generates a control signal based on the processed sensing data and transmits the control signal to a terminal, wherein the smart pad can be formed through a core substrate and a fabric-based electronic thread.

[0024] According to at least one of the various embodiments of the present disclosure, there is provided a driver monitoring device and method based on a non-contact method using an electronic thread that enables a DMS (Driver Monitoring System) to be performed immediately when a driver gets into a vehicle and sits in a seat.

[0025] According to at least one of the various embodiments of the present disclosure, there is provided a driver monitoring device and method that ensure accuracy while minimizing the burden on the driver.

[0026] FIG. 1 is a schematic diagram of a driver monitoring system according to one embodiment of the present disclosure.

[0027] Figure 2 is a block diagram of the driver monitoring device of Figure 1.

[0028] FIG. 3 is a flowchart illustrating a driver monitoring method according to one embodiment of the present disclosure.

[0029] FIG. 4 is a diagram illustrating the application of a non-contact monitoring technology according to one embodiment of the present disclosure to clothing and a smart band.

[0030] FIGS. 5 and 6 are drawings illustrating application of a non-contact monitoring technology according to one embodiment of the present disclosure to a vehicle.

[0031] FIG. 7 illustrates a smart pad built into a vehicle seat and clothing according to one embodiment of the present disclosure.

[0032] FIGS. 8 to 11 illustrate the structure of an electronic thread forming a smart pad according to one embodiment of the present disclosure.

[0033] FIG. 12 is a drawing illustrating the formation of a smart pad and a driving unit of an ECG, BTM, and PPG monitoring system according to one embodiment of the present disclosure.

[0034] FIG. 13 is a drawing illustrating a method of directly mounting a driving board according to one embodiment of the present disclosure on fabric.

[0035] FIG. 14 is a drawing illustrating a method of forming an electronic thread through a radiation process after manufacturing a core wiring board according to one embodiment of the present disclosure.

[0036] FIG. 15 is a drawing illustrating a method for manufacturing an electronic thread used as a smart pad according to one embodiment of the present disclosure.

[0037] FIGS. 16 and 17 are drawings illustrating an E-field collector for constructing a non-contact monitoring system according to one embodiment of the present disclosure.

[0038] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0039] A monitoring device (or system) according to various embodiments of the present disclosure may be installed, for example, in a vehicle. In this case, the monitoring device may be described as a driver monitoring device.

[0040] Meanwhile, the driver monitoring device according to the present disclosure may be a Driver Monitoring System (DMS) or a part thereof. However, the present disclosure is not limited thereto. For example, the driver monitoring device may be a separate component for the DMS or a comprehensive device including the DMS.

[0041] Below, a driver monitoring device (or system) based on a smart pad (e.g., an ECG pad) using an electronic room, a sensor pad using an electronic room, and a vehicle including a sensor pad are described.

[0042] FIG. 1 is a schematic diagram of a driver monitoring system (1) according to one embodiment of the present disclosure.

[0043] Figure 2 is a block diagram of the driver monitoring device of Figure 1.

[0044] Referring to FIG. 1, a driver monitoring system (1) may be configured to include a vehicle (100) and a server (500).

[0045] The server (500) may not be an essential component. The server (500) may receive or collect and process data from the vehicle (100).

[0046] The server (500) may, in particular, perform at least some functions of the driving unit (300) of the vehicle (100) when data is received from the vehicle (100). The server (500) may process the received data of the vehicle (100) and, based on the data, return or transmit a signal containing a control command for controlling the target vehicle (100) to the vehicle (100). The server (500) may be, for example, a cloud server. The server (500) may be provided by a manufacturer of the vehicle or driver monitoring device / system, but is not limited thereto.

[0047] The vehicle (100) may include a smart pad (200), a driving unit (300), a display (400), etc. In this case, the driving unit (300) may also be referred to as a processor.

[0048] A smart pad (200) can be installed on a vehicle seat. The smart pad (200) can sense and acquire status information of vehicle occupants (particularly, the driver). The data of the vehicle (100) described above may include data acquired through the smart pad (200).

[0049] The driving unit (300) can process various signals related to driving, such as vehicle operation. The driving unit (300) can generate a vehicle control signal based on the driver's status information obtained through the smart pad (200). The vehicle control signal may include various control signals related to various events within the vehicle, such as a control signal related to vehicle operation, a control signal unrelated to vehicle operation but related to actions according to the driver's status, and a control signal for providing information through the display (400). In this sense, the driving unit (300) may be referred to as a controller, processor, etc. that controls the overall driving, i.e., operation, of the vehicle, but is not limited thereto.

[0050] In Fig. 2, detailed configuration blocks of a vehicle (100) are illustrated.

[0051] The driving unit (300) may include a first amplifier (310), a filter (320), a comparator (330), a second AMP (340), a converter (350), a processing unit (360), a battery (370), a transceiver (380), a memory (390), etc.

[0052] However, not all of the listed components of the driving unit (300) may be essential components. Depending on the embodiment, some of the components listed as components of the driving unit (300) may be omitted. Alternatively, at least one or more components not listed may be added and included in the driving unit (300).

[0053] The first AMP (310) can receive and amplify a signal containing data sensed from the smart pad (200).

[0054] The filter (320) can filter the signal amplified by the first AMP (310).

[0055] The comparator (330) can compare a signal filtered by the filter (320) (for convenience, a first signal) with an input reference signal (for convenience, a second signal). If the difference between the first signal and the second signal is greater than a preset threshold as a result of the comparison, the comparator (330) can output the result to the second AMP (340), and if not, can return the result to the filter (320).

[0056] In the above, the second signal, i.e., the reference signal, may include a value set to verify the validity of data sensed by the smart pad (200) or to process only meaningful sensed data. To this end, the reference signal may be generated based on a value determined by directly using the driver's set value or the initial sensed value for the driver, or by referencing such a value.

[0057] Meanwhile, the reference signal isn't always a fixed value; it can fluctuate. For example, even if a driver uses a vehicle daily, the driver's physical condition may not always be constant or identical. In this case, for example, when getting into a vehicle, the user's initial sensing data can be compared with a previously set reference, and the user's initial sensing data can then be used as a reference.

[0058] The second AMP (340) can re-amplify the signal input through the comparator (330).

[0059] The conversion unit (350) can convert the second amplified signal from the second AMP (340). At this time, the conversion may refer to, for example, converting an analog signal into a digital signal.

[0060] The processing unit (360) can process a signal based on the signal converted by the conversion unit (350). With respect to signal processing, the processing unit (360) can include at least one algorithm related to driver monitoring according to the present disclosure. That is, the processing unit (360) can process the driver's bio-signals and analyze the status by applying an algorithm to the converted signal. The processing unit (360) can perform a controller function that controls the overall operation of the driving unit (300).

[0061] The battery (370) can supply power to each component of the aforementioned driving unit (300). The battery (370) can include software such as algorithms, modules, and programs for controlling power supply to the components.

[0062] The transceiver (380) can transmit the results processed by the processing unit (360). The transceiver (380) can receive various signals (including control commands) from the outside and transmit them to the processing unit (360) for processing.

[0063] The memory (390) may be built into or detachably attached to the vehicle (100). The memory (390) may be in the form of a remotely located database (DB) server or may be linked thereto.

[0064] In the driving unit (300) according to the present disclosure, rather than processing all data sensed by the smart pad (200), only meaningful sensed data is processed, thereby reducing battery consumption, improving data processing speed, and efficiently using limited resources compared to processing all data.

[0065] In this disclosure, “monitoring” may refer to, for example, but is not limited to, monitoring a user’s bio-signals.

[0066] In relation to this, examples of technologies for monitoring users' bio-signals include PPG (Photoplethysmography), ECG (Electrocardiography), and BTM (Blood Temperature Management).

[0067] PPG is a noninvasive technology that uses infrared or light to measure blood circulation. It measures the blood pressure waves generated as blood flows from the arteries to the heart, allowing it to determine pulse rate, heart rate, and cardiac health. PPG is easy to measure and is commonly used in smartwatches, smartbands, and other devices.

[0068] An ECG is a technology that measures the heart's electrical activity to assess cardiac health. It typically uses electrodes attached to the chest to measure the heart's electrical signals, which are generated by the nervous system that controls the heart's contraction and relaxation. These ECGs are used to identify heart rhythms and abnormalities.

[0069] BTM is a technology that regulates the user's body temperature. It is commonly used in cardiac surgery, intensive care, and other settings. It cools or heats the blood within the body to maintain and stabilize the user's body temperature, thereby helping to maintain the user's body temperature within a certain range and reducing the risk of complications. However, BTM is typically controlled by medical professionals in medical institutions.

[0070] Regarding user monitoring methods, monitoring can be accomplished through contact or non-contact methods. However, this disclosure specifically describes a monitoring technique using a non-contact method as an example, but is not limited thereto.

[0071] The non-contact monitoring technology according to the embodiments of the present disclosure can utilize sensor technology utilizing electronic yarn. This sensor technology can be applied to various locations where the electronic yarn-based electrode pad, i.e., the aforementioned sensor pad, can be applied, through a method of manufacturing a core wiring board and then performing a radiation process. For example, it can be applied to clothing, shoes, watches, etc. worn by the user. Furthermore, if the user is a driver, it can be applied to the vehicle's seat belt, seat, driver's seat, etc.

[0072] In this way, monitoring technology using electronic real-time electrode pads can monitor a user's condition in a non-contact manner, even without the user (including the driver) directly attaching or wearing the device. This monitoring can be used to control the vehicle and provide various related information.

[0073] FIG. 3 is a flowchart illustrating a driver monitoring method according to one embodiment of the present disclosure.

[0074] Referring to FIG. 3, the driver monitoring device can detect the seat seating of a driver in a vehicle (S10).

[0075] The driver monitoring device can obtain sensing data on the target driver when seat seating is detected due to the driver's boarding of the vehicle (S20).

[0076] The driver monitoring device can calculate the difference between the acquired sensing data and reference data and determine whether the calculated difference is greater than a preset threshold (S30).

[0077] If the calculated difference is below a preset threshold as determined by step S30, the driver monitoring device may discard or ignore the sensing data acquired in step S20 and wait until new sensing data is acquired. In this regard, sensing data may be continuously acquired for the target driver at a predetermined interval.

[0078] The driver monitoring device can convert and process the sensing data acquired in step S20 if the difference calculated as a result of the judgment in step S30 is greater than a preset threshold (S40).

[0079] The driver monitoring device can generate and transmit a vehicle control signal based on the sensing data processed in step S40 (S50).

[0080] At step S50, the vehicle control signal may not only control the vehicle's operation, but may also include signals for controlling other in-vehicle devices, such as the heater, air conditioning, audio system, and display. Furthermore, the vehicle control signal may also include signals to be transmitted not only within the vehicle but also outside the vehicle. For example, if the driver's physical condition is deemed critical or extremely critical based on sensed data, a rescue signal to a pre-registered terminal or a relevant center (e.g., 119 ambulance) may be included in the vehicle control signal.

[0081] FIG. 4 is a diagram illustrating the application of non-contact monitoring technology according to one embodiment of the present disclosure to clothing and a smart band. However, the technology is not necessarily limited to clothing or smart bands; it can also be applied to vehicles, for example.

[0082] Figure 4 illustrates an ECG monitoring system and a BTM monitoring system built into clothing, and a PPG monitoring system built into a smart band. Note that not all systems need to be built simultaneously.

[0083] As shown in Fig. 4, multiple monitoring systems may be built simultaneously for clothing or smart bands, or only one monitoring system may be built.

[0084] Referring to Fig. 4, clothing or a smart band (450) can continuously sense the user's status periodically / non-periodically through a non-contact monitoring system and transmit a related signal to at least one terminal. Fig. 4 illustrates that a sensing signal is transmitted to a pre-registered medical institution terminal or vehicle (or vehicle control unit) via a pre-registered terminal.

[0085] At this time, the clothing or smart band illustrated in FIG. 4 may include components such as a battery or an input / output interface for transmitting / receiving signals to a non-contact monitoring system formed through an electronic thread.

[0086] The status of the monitored user may include, but is not limited to, electrocardiograms associated with ECG monitoring systems, body temperature associated with BTM monitoring systems, and pulse waves associated with PPG monitoring systems.

[0087] Referring to FIG. 4, an electronic thread-based electrode pad (410) for an ECG monitoring system can be formed by embedding a smart pad sensor on a fabric through a sewing process.

[0088] The electronic real-based electrode pad (420) for the BTM monitoring system is also formed by mounting a smart pad sensor on a fabric, and the smart pad sensor may be an electrode (Cu), an electrode (Ni / Cu), etc.

[0089] An electronically-based electrode pad (430) for a PPG monitoring system is also formed by mounting a smart pad sensor on a fabric, and the smart pad sensor can be a light source (e.g., R-LED), a sensor (PD: Photodiode), etc.

[0090] FIGS. 5 and 6 are drawings illustrating application of a non-contact monitoring technology according to one embodiment of the present disclosure to a vehicle.

[0091] Figure 5 (a) is illustrated to explain the driver monitoring method.

[0092] Assume that a driver's heart condition is to be monitored. Referring to Fig. 5 (a), a smart pad (200) is installed on the seat, and when the driver sits in the seat, data regarding the driver's heart condition can be acquired through non-contact sensing.

[0093] In this specification, the term "contact type" refers to a case where the smart pad is directly attached to the human body (or skin), and otherwise, it can be referred to as a non-contact type. In the case of the present disclosure, the smart pad (200) is installed on, for example, a vehicle seat or steering wheel rather than being attached to the human body to sense the driver's status, and therefore, it can be referred to as a non-contact type. For example, according to the present disclosure, even if a seat cover is placed on the vehicle seat, there is no problem with sensing.

[0094] Referring to Fig. 5 (b), a smart pad built into a vehicle seat is illustrated.

[0095] In the present disclosure, a smart pad can be manufactured using a fabric-based electronic thread structure as a fabric-based electrode pad.

[0096] Referring to the enlarged drawing shown in (b) of Fig. 5, each smart pad (200) can be implemented in the form of a textile using an electronic thread of a predetermined size. However, the present invention is not limited thereto.

[0097] The smart pad (200) may include a sensor module. Each sensor constituting the sensor module may include an electronic chamber surrounded by an insulating layer and including a passage through which electrons can move. The electronic chamber is preferably 10 mm or less in diameter, but is not necessarily limited thereto.

[0098] In (a) and (b) of FIG. 5, the smart pad (200) is depicted to facilitate explanation. For example, the smart pad (200) may be built-in and not exposed to the outside at all, or may be difficult to distinguish with the naked eye from the outside. To this end, the smart pad (200) may include an indicator (not shown) to notify that the smart pad (200) has been installed or to provide information based on the sensed driver's status.

[0099] According to the present disclosure, a smart pad (200) including a sensor module can construct an electric field collector (E-field collector) on a core substrate to detect an electric field measured during a sensing process in order to monitor the driver's status in a non-contact manner, as shown in (c) of FIG. 5.

[0100] FIG. 5 shows a smart pad built (or attached) to a vehicle seat, for example, through a sawing process, on a predetermined area of ​​the vehicle seat, while FIG. 6 shows a detachable / attachable smart pad on a predetermined area of ​​the vehicle seat.

[0101] Figure 6 (a) shows that the smart pad (610) is detachable / attachable.

[0102] Figure 6 (b) illustrates a structure for attaching / detaching a smart pad to / from a vehicle seat, as illustrated in Figure 6 (a). However, this is merely an example, and the present disclosure is not limited thereto.

[0103] In the present disclosure, an attachment pad may be used to attach / detach a smart pad to a vehicle seat. However, the present disclosure is not limited thereto.

[0104] Referring to (b) of FIG. 6, an element (640) such as a fabric sensor may be mounted on a fabric, and an attachment layer (630) may be bonded to an electronic thread (620) in which one end of an electrode pad (625) is connected to the element (640). Meanwhile, in response to the attachment layer (630), a corresponding configuration may be provided on the vehicle seat so that the attachment layer can be attached / detached for easy attachment / detachment of the smart pad.

[0105] In Fig. 7(a), a smart pad (710) built into a vehicle seat is illustrated, and in Fig. 7(b), a smart pad (720) built into clothing is illustrated.

[0106] Meanwhile, Fig. 7 (c) illustrates a general fiber, and Fig. 7 (d) illustrates an electronic thread.

[0107] Referring to (a) and (b) of FIG. 7, other parts except for the electronic room-based smart pad part shown in (d) of FIG. 7 can be composed of general fibers shown in (c) of FIG. 7.

[0108] Figures 8 to 11 describe the structure of the electronic chamber forming the smart pad.

[0109] In this specification, various types of fibers may be used as the fibers radiated onto the substrate. For example, such fibers may be dielectric fibers, polymer fibers, etc.

[0110] Referring to (a) of Fig. 8, a dielectric fiber (813) may be radiated onto a pure core substrate to form an electronic thread. At this time, the pure core substrate may be formed by laminating a metal electrode (812) on PI or GF (811).

[0111] Referring to (b) of FIG. 8, conductive fibers (824) may be radiated onto a core substrate to which high-strength / elongation fibers are attached, thereby forming an electronic thread. At this time, the core substrate may be formed on the high-strength / elongation fibers (821). The core substrate may be the pure core substrate described above. Meanwhile, the high-strength / elongation fibers (821) may include nylon, etc.

[0112] Referring to (c) of Fig. 8, there is an example in which the electronic thread is formed by coating the fibers rather than radiating them onto the core substrate as in (a) to (b) of Figs. 8. At this time, the core substrate may be the pure core substrate described above. Meanwhile, the core substrate may be formed on a high-strength / elongation fiber (831). In addition, conductive fibers (834) may be applied and coated on the core substrate. In the above manner, the tensile strength of the electronic thread can be strengthened compared to the radiating form. Thereafter, the electronic thread may be cut as needed to obtain an electronic thread of a desired size. However, the thickness of the electronic thread according to (c) of Fig. 8 is preferably within 50 μm, but is not limited thereto.

[0113] Figure 9 illustrates, for example, an electronic chamber for temperature measurement. For this purpose, the electronic chambers may be paired. Temperature data can be obtained from the difference in thermal conductivity between the paired electronic chambers. For example, a pair can be formed with one electronic chamber having high thermal conductivity and the other having low thermal conductivity and thus slow thermal conductivity. In this case, temperature can be measured by measuring the electromotive force based on the time difference in thermal conductivity data obtained through the two electronic chambers.

[0114] Referring to (a) of FIG. 9, each electron room constituting the pair may be formed by radiating conductive fibers (913, 916) on a pure core substrate. However, the structures of each electron room constituting the pair may be different from each other. For example, the pure core substrate of the first electron room may include a metal electrode (Ni / Cu) (913) on PI or GF (912), and the pure core substrate of the second electron room may include a metal electrode (Cu) (914) on PI or GF (9124).

[0115] Referring to (b) of FIG. 9, in each electronic room constituting the pair of FIG. 9 (a), high-strength / elastic fibers (921, 925) are attached to the bottom of each core substrate (922-923, 926-927) and conductive fibers (924, 928) are radiated so that each electronic room constituting the pair can be formed.

[0116] Referring to (c) of Fig. 9, rather than forming each electron thread constituting a pair by radiating conductive fibers onto the core substrate of Fig. 9 (a) or (b), the electron threads may be formed by coating conductive fibers. As described above, in this case, at least two electron threads forming a pair may be formed individually through a cutting process, as needed.

[0117] Referring to Fig. 10(a), optical elements may be mounted in the electronic chamber. The mounting of these optical elements may be performed before the fiber is radiated. Meanwhile, the optical elements may include LEDs, ELDs, and the like.

[0118] For example, green LED PnP (1015) can be mounted at a predetermined interval on the core substrate ((1010).

[0119] Referring to (b) of FIG. 10, a transparent synthetic fiber (1020) may be radiated onto a core substrate (1020) on which an optical element is mounted, thereby forming an electronic thread.

[0120] Referring to (c) of FIG. 10, a core substrate (1030) on which an optical element is mounted is laminated on a high-strength / flexible fiber (1020), a transparent synthetic fiber (1010) is coated on the core substrate (1030), and a transparent synthetic fiber (1040) is radiated therefrom to form an electronic thread.

[0121] Referring to (d) of FIG. 10, similar to (c) of FIG. 10, a core substrate (1060) on which an optical element (1070) is mounted is laminated on a high-strength / flexible fiber (1050), and a transparent synthetic fiber (1080) is coated on the core substrate (1060) to form an electronic thread.

[0122] When the electronic thread formed in the same manner as in (b) to (d) of FIG. 10 is mounted between fabrics by a sawing process as shown in (e) of FIG. 10, the electronic thread including the optical element, i.e. the green optical fabric electronic thread, can be identified from the outside through light emission.

[0123] Referring to (a) of Fig. 11, unlike (a) of Fig. 10, instead of optical elements being mounted, general elements may be mounted in the electronic chamber. Such general elements may include batteries, sensors, etc.

[0124] That is, an electronic chamber can be formed by mounting, for example, a general PnP element on a core substrate and radiating synthetic fibers.

[0125] (b) to (d) of Fig. 11 are the same except that a general element is mounted on the core substrate instead of the optical element, and reference is made to the above.

[0126] When a smart pad is formed through an electronic thread having a shape such as (b) to (d) of FIG. 11, a fabric-based wearable battery can be formed as shown in (e) of FIG. 11.

[0127] The synthetic fibers of Fig. 11 can be replaced with the transparent synthetic fibers or polymer-based fibers described above.

[0128] Figure 12 illustrates a driving unit assembled with a smart pad. At this time, a monitoring system based on at least one of ECG, BTM, and PPG may be placed in the driving unit (1210, 1220).

[0129] Referring to (a) of Fig. 12, the smart pad itself is a smart pad, and a driving unit (1210) can be assembled to one end of the smart pad to form a monitoring system.

[0130] (b) of Fig. 12 is also a smart pad in itself, and the driving unit (1220) can be mounted on an area of ​​the smart pad and then assembled to form a monitoring system.

[0131] However, in Fig. 12 (a), the entire driving unit constitutes a single monitoring system, whereas in Fig. 12 (b), the monitoring system can be segmented and arranged in the driving unit.

[0132] Figure 13 is a drawing illustrating a method of directly mounting a drive board on fabric. That is, it is for the case where the board is raised above the fabric when constructing a fabric-based monitoring system.

[0133] Referring to (a) of Fig. 13, a sacrificial layer is first laminated on a glass substrate (GLS), and a PI or GF substrate is formed thereon to form a wiring layer. Thereafter, components are mounted, and after mounting, the glass substrate (GLS) is separated to form a driving board.

[0134] Referring to (b) of Fig. 13, a driving board (e.g., a fiber sensor) can be directly mounted and attached to the fabric and connected via an electronic thread.

[0135] After installation, you can communicate with the wireless signal transmission board to confirm whether the installation was done properly.

[0136] Figure 14 is a drawing illustrating the process of forming an electronic thread through a method of emitting light through a radiation process after manufacturing a core wiring board.

[0137] Figure 14 (a) discloses the formation of an electronic thread by radiating conductive fibers (1420) onto a general fiber (1410). However, only electrical signals are transmitted through this electronic thread.

[0138] On the other hand, in (b) to (d) of FIG. 14, an electronic thread according to the present disclosure is illustrated.

[0139] Basically, referring to (b) of Fig. 14, a fiber (1450) may be radiated onto a PI or GF-based core substrate (1430) on which a metal electrode (1440) is formed, thereby forming an electronic thread.

[0140] At this time, the radiating fiber may be a conductive fiber such as in (c) of Fig. 14, or a general fiber such as in (d) of Fig. 14.

[0141] Referring to (c) and (d) of FIG. 14, metal electrodes having various electrode patterns can be formed on a substrate.

[0142] Meanwhile, it is preferable that the width and thickness of the electronic chamber according to the present disclosure are both 5 mm or less, but are not limited thereto.

[0143] Figure 15 is a drawing illustrating a method for manufacturing an electronic thread used as a smart pad (i.e., electrode pad).

[0144] In Fig. 15 (a), for convenience, an electronic thread is formed using a pure core substrate and a conductive fiber as an example.

[0145] First, the FPCB substrate is cut, and PnP can be formed through the SMT process.

[0146] Afterwards, the FPCB substrate can be cut as desired, and fiber thread can be spun onto the cut FPCB substrate, and a spun and sewn process can be performed to form an electronic thread and an electrode pad using the same.

[0147] After this, an electronic room-based smart pad can be formed by assembling the driving board and pad.

[0148] Referring to Fig. 15(b), an electronic thread may be formed by laminating a core substrate on a high-strength / elongation fiber and then spinning conductive fibers. In this case, in particular, an attachment process to the fiber fabric may be further incorporated into the aforementioned process. That is, a process of attaching the high-strength / elongation fiber to the fiber fabric may be added, thereby forming an electronic thread, and thereby forming an electrode pad.

[0149] Referring to (c) of Fig. 15, a core substrate is laminated on high-strength / elasticity and conductive fibers, and conductive fibers are coated on the core substrate to form an electronic thread.

[0150] In Fig. 15(c), a fiber fabric attachment process is added to the aforementioned process, but the spinning process is excluded from the aforementioned process, and the sewing process is performed directly to form an electronic thread, which can then be used to form an electrode pad. Since the conductive fiber is attached to a core substrate rather than spinning, the spinning process can be omitted.

[0151] Meanwhile, the process of FIG. 15 can be similarly referenced when mounting an optical element or a non-optical element (such as a sensor or battery).

[0152] In order to construct a non-contact type monitoring system according to the present disclosure, an E-field collector for detecting an electric field in an electronic room may be constructed on a core substrate.

[0153] As shown in (a) of Fig. 16, a dielectric is applied on a core wiring board, and an electric field is applied as shown in (b) of Fig. 16 to change the arrangement.

[0154] Accordingly, as shown in (c) of Fig. 16, electrodes can be laminated on the core wiring board, and an electric field collector can be formed thereon again.

[0155] As shown in (a) of Fig. 17, for example, an electrode (1720) is laminated on a core substrate (1710) such as PI or GF, a dielectric layer (1730) is laminated on the electrode (1720), and a protective film (1740) is laminated thereon, thereby ultimately forming an electric field collector. At this time, the protective film (1740) may include glass fiber, but is not limited thereto.

[0156] In (b) of Fig. 17, it is similar to (a) of Fig. 17, but it may be different in that the electrodes (1720) are not continuously laminated on the core substrate (1710), but are arranged at a predetermined interval and disconnected.

[0157] In this specification, various fibers may include cotton, silk, wool, rayon, acetate, nylon, polyester, acrylic, etc. Appropriate fibers may be selected by referring to at least one of the strength, wet strength, elongation (%), etc. of each fiber.

[0158] Although the present disclosure has described a monitoring technology for a driver in a vehicle for convenience of explanation, it will be apparent to those skilled in the art that this can be applied to various devices or systems other than vehicles.

[0159] Alternatively, the monitoring device according to the present disclosure may be applied to a person's clothing.

[0160] Even if not specifically mentioned, the order of at least some of the operations disclosed in the present disclosure may be performed simultaneously, in a different order than the order described above, or some may be omitted / added.

[0161] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0162] The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

[0163] According to the driver monitoring device and its operating method according to the present disclosure, an electronic room-based smart pad is installed in a vehicle, the driver is monitored in a non-contact manner, and the vehicle's operation, etc. are controlled based on the monitoring results. Such a device can be applied to various industrial fields in addition to vehicles, and thus has industrial applicability.

Claims

1. User detection step; A step of acquiring sensing data about a detected user; A step of converting and processing the sensing data when the difference between the sensing data and the reference data is greater than a threshold; and A step of generating a control signal based on processed sensing data and transmitting the control signal to a terminal, Method for controlling a driver monitoring system.

2. In paragraph 1, The step of detecting the user and the step of obtaining sensing data for the detected user are as follows: This is done through a smart pad built into the vehicle seat. Method for controlling a driver monitoring system.

3. In paragraph 2, The above smart pad, Formed through a core substrate and a fabric-based electronic thread, Method for controlling a driver monitoring system.

4. In paragraph 3, The above electronic thread is, A metal electrode is formed on a core substrate, and conductive fibers are radiated to form it. Method for controlling a driver monitoring system.

5. In paragraph 3, The above electronic thread is, A core substrate is laminated on a high strength / elasticity fiber, and conductive fibers are radiated to form a Method for controlling a driver monitoring system.

6. In paragraph 3, The above electronic thread is, A core substrate is laminated on a high strength / elasticity fiber, and a conductive fiber is coated on the core substrate to form a Method for controlling a driver monitoring system.

7. In paragraph 3, The configuration of each electronic room forming the above smart pad is different. Method for controlling a driver monitoring system.

8. In paragraph 7, The first electronic thread is formed by radiating conductive fibers after a first metal electrode is applied on a core substrate, The second electronic thread is formed by radiating conductive fibers after a second metal electrode is laminated on a core substrate. Method for controlling a driver monitoring system.

9. In paragraph 3, The above electronic thread is, A core substrate on which an optical element is mounted is formed by radiating or coating transparent synthetic fibers. Method for controlling a driver monitoring system.

10. In paragraph 3, The above electronic thread is, A core substrate on which a non-photonic element is mounted is formed by radiating or coating transparent synthetic fibers. Method for controlling a driver monitoring system.

11. In paragraph 9, In the above optical device, Includes LED and ELD, Method for controlling a driver monitoring system.

12. In paragraph 10, In the above non-photonic device, Includes battery and sensor, Method for controlling a driver monitoring system.

13. In paragraph 3, One end of the above smart pad is connected to a driving unit, Method for controlling a driver monitoring system.

14. In paragraph 3, In one area of ​​the above smart pad, the driving element is distributed, Method for controlling a driver monitoring system.

15. A smart pad that detects a user and obtains sensing data about the detected user; and If the difference between the sensing data and the reference data is greater than a threshold, a processor is included that converts and processes the sensing data, generates a control signal based on the processed sensing data, and transmits the control signal to the terminal. The above smart pad is formed by a core substrate and a fabric-based electronic thread. Driver monitoring system control unit.

Citation Information

Patent Citations

  • A system, computer media, and computer execution method for monitoring the health and ergonomic conditions of a vehicle driver.

    JP2014520607A

  • The wearable light-emitting element having a light emitting diode inside fiber layers and its preparing method

    KR101673236B1

  • Antibiotic deodorant and manufacturing method of a toe pad with antibiotic and deodorization function

    KR102113444B1

  • Fiber complexes and methods of manufacturing the same

    KR102243054B1

  • KR20200082318A