Convenience device control apparatus and method for vehicle

By using light sources and EEG sensors in the vehicle to analyze the frequency of the user's brain signals, the operation of the convenience device is controlled, solving the problem that users have difficulty operating the vehicle's convenience device in rest mode. This achieves convenience device control without gestures or voice, improving ease of operation.

CN111907446BActive Publication Date: 2024-11-29HYUNDAI MOTOR CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN201910990044.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-10-17
Publication Date
2024-11-29
Estimated Expiration
2039-10-17

AI Technical Summary

Technical Problem

In the existing technology, it is difficult for users to conveniently operate the convenience devices on the vehicle through gestures or voice commands, especially in rest mode, such as when the seat back is lowered and used as a foot pedal, the convenience of operating the convenience devices is poor.

Method used

By installing a light source, an electroencephalogram (EEG) sensor, an EEG analyzer, and a controller in a vehicle, the operation of the convenience device is controlled using the frequency of the EEG signal. The light source uses different frequencies and color changes to indicate the user's operating intentions, the EEG sensor measures the user's EEG signal, the EEG analyzer analyzes the signal frequency, and the controller operates the convenience device based on the analysis results.

Benefits of technology

This allows users to control the device via EEG signals without using gestures or voice commands, improving ease of operation during rest mode.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111907446B_ABST
    Figure CN111907446B_ABST
Patent Text Reader

Abstract

A convenience device control apparatus for a vehicle and a method thereof are provided. The convenience device control apparatus includes a light source that emits light at a specified frequency and an electroencephalogram (EEG) sensor that measures an EEG signal of a user. An EEG analyzer analyzes the frequency of the EEG signal measured by the EEG sensor and a controller operates a convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Citations of Related Applications

[0002] This application claims the benefit of priority to Korean Patent Application No. 10-2019-0053490, filed on May 8, 2019, which is hereby incorporated by reference in its entirety. Technical Field

[0003] The present disclosure relates to a technology for providing convenience to a user in connection with the operation of various convenience devices installed on a vehicle, and more particularly, to a convenience device control apparatus that allows a user to operate various convenience devices installed on a vehicle by providing the user with an intention to operate the convenience device based on an EEG signal of the user and controlling the convenience device corresponding to the user's intention. Background Art

[0004] Recently, in addition to various safety devices, vehicles have developed various convenience devices for providing various convenience functions, such as power windows, power seats, power foot pedals, power sunshades, lighting devices, air conditioners, displays, entertainment devices, etc. Such various convenience devices are generally operated by users engaging buttons. However, considering the inconvenience of users, a technology for controlling corresponding convenience devices by recognizing user gestures or words is proposed.

[0005] This conventional technology also requires the user to make a gesture to operate the convenient device or operate by voice command, and thus may reduce the convenience of the user. Specifically, a user sitting in the seat back of the vehicle may often operate the seat in a rest mode (e.g., a state where the backrest is put down and the front seat is used as a footrest), and may have difficulty operating the convenient device due to a large distance from the device for recognizing the user's gesture or the device for recognizing the user's voice. Summary of the invention

[0006] The present disclosure provides a convenience device control apparatus for a vehicle and a method thereof, which can allow a user to easily operate various convenience devices installed on a vehicle by understanding the user's intention to operate the convenience device based on the user's electroencephalogram (EEG) signal and operating the convenience device based on the user's intention.

[0007] The technical problems to be solved by the inventive concept are not limited to the aforementioned problems, and those skilled in the art to which the present disclosure belongs will clearly understand any other technical problems not mentioned herein from the following description.

[0008] According to one aspect of the present disclosure, a convenience device control apparatus for a vehicle may include: a light source configured to emit light at a specified frequency; an electroencephalogram (EEG) sensor configured to measure an EEG signal of a user; an EEG analyzer configured to analyze the frequency of the EEG signal measured by the EEG sensor; and a controller configured to operate a convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

[0009] The controller may be configured to change the light emission frequency of the light source corresponding to the operating state of the convenience device. In addition, the controller may be configured to change the light emission color of the light source corresponding to the light emission frequency of the light source. The controller may be configured to operate the light source at the time point of operating the convenience device, and emit light a specified number of times at a time interval. The controller is configured to increase the light emission intensity of the light source at the time point of operating the convenience device. The controller is configured to change the light emission color of the light source at the time point of operating the convenience device. The light source may be located around the convenience device.

[0010] According to another aspect of the present disclosure, a method for controlling a convenience device of a vehicle may include: a light source emitting light at a specified frequency; an electroencephalogram (EEG) sensor measuring an EEG signal of a user; an EEG analyzer analyzing the frequency of the EEG signal measured by the EEG sensor; and a controller operating the convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

[0011] Operating a convenience device in a vehicle may include changing the light emission frequency of a light source corresponding to the operating state of the convenience device. In addition, operating a convenience device in a vehicle may include changing the light emission color of a light source corresponding to the light emission frequency of the light source and allowing the light source to emit light a specified number of times at a time interval at a point in time when the convenience device is operated. Operating a convenience device in a vehicle may also include increasing the light emission intensity of the light source at a point in time when the convenience device is operated. In addition, operating a convenience device in a vehicle may include changing the light emission color of the light source at a point in time when the convenience device is operated. The light source may be located around the convenience device.

[0012] According to another aspect of the present disclosure, a convenience device control apparatus for a vehicle may include: a plurality of light sources having light emission frequencies different from each other; an electroencephalogram (EEG) sensor configured to measure an EEG signal of a user; an EEG analyzer configured to analyze the frequency of the EEG signal measured by the EEG sensor; and a controller configured to operate a convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

[0013] The controller may be configured to operate the convenience device when continuously measuring an EEG signal having a first frequency and an EEG signal having a second frequency within a specified time. The controller may be configured to change the light emission color of the light source corresponding to the light emission frequency of the light source. In addition, the controller may be configured to allow the light source to be operated at a time point when the convenience device is operated, and to emit light a specified number of times at a time interval. The controller may be configured to increase the light emission intensity of the light source at a time point when the convenience device is operated. The controller may be configured to change the light emission color of the light source at a time point when the convenience device is operated. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description made in conjunction with the accompanying drawings.

[0015] Figure 1 is a block diagram showing a configuration of a convenience device control apparatus of a vehicle according to an exemplary embodiment of the present disclosure;

[0016] Figure 2 is a view showing a light emission frequency of a light source included in a convenience device control apparatus of a vehicle and an SSVEP corresponding thereto according to an exemplary embodiment of the present disclosure;

[0017] Figure 3 is a view showing a light source provided in a convenience device control apparatus for a vehicle according to a first exemplary embodiment of the present disclosure;

[0018] Figure 4 is a view showing a light source provided in a convenience device control apparatus for a vehicle according to a second exemplary embodiment of the present disclosure;

[0019] Figure 5 is a view showing a light emission color of each light source in a second embodiment of a light source provided in a convenience device control apparatus for a vehicle according to an exemplary embodiment of the present disclosure;

[0020] Figure 6 is a flowchart illustrating a method of operating a convenience device of a vehicle according to an exemplary embodiment of the present disclosure;

[0021] Figure 7 is a flowchart illustrating a method of operating a convenience device of a vehicle according to another exemplary embodiment of the present disclosure; and

[0022] Figure 8 is a block diagram illustrating a computing system that performs a method of operating a convenience device of a vehicle according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] It should be understood that the term "vehicle" or "vehicular" or other similar terms as used herein include a broad range of motor vehicles, such as passenger vehicles including sport utility vehicles (SUVs), buses, trucks, various commercial vehicles, watercraft including various boats and ships, spacecraft, etc., and include hybrid vehicles, electric vehicles, internal combustion engines, plug-in hybrid electric vehicles, hydrogen-powered vehicles, and other alternative fuel vehicles (e.g., fuel obtained from resources other than petroleum).

[0024] Although the exemplary embodiment is described as using multiple units to perform the exemplary process, it should be understood that the exemplary process can also be performed by one or more modules. In addition, it should be understood that the term controller / control unit refers to a hardware device including a memory and a processor. The memory is configured to store the modules, and the processor is specifically configured to execute the modules to perform one or more processes further described below.

[0025] In addition, the control logic of the present disclosure may be embodied as a non-volatile computer-readable medium on a computer-readable medium, which includes executable program instructions executed by a processor, a controller / control unit, etc. Examples of computer-readable media include, but are not limited to, ROM, RAM, compact disk (CD)-ROM, magnetic tape, floppy disk, flash disk, smart card, and optical data storage device. The computer-readable medium may also be distributed in a network-coupled computer system, so that the computer-readable medium is stored and executed in a distributed manner, for example, through a telematics server or a controller area network (CAN).

[0026] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. Unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" as used herein are intended to include the plural forms. It should be further understood that when used in this specification, the terms "comprises" and / or "comprising" specify the presence of the features, integers, steps, operations, elements and / or parts described, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups thereof. As used herein, the term "and / or" includes any and all combinations of one or more of the relevant listed items.

[0027] Unless specifically stated or apparent from the context, the term "about" as used herein is understood to be within the normal tolerance range in the art, e.g., within 2 standard deviations of the mean. "About" may be understood to be within 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, 1%, 0.5%, 0.1%, 0.05%, or 0.01 of a set value. Unless the context clearly indicates otherwise, all numerical values ​​provided herein are modified by the term "about".

[0028] Hereinafter, some exemplary embodiments of the present disclosure will be described in detail with reference to the exemplary drawings. When adding reference numerals to the components of each drawing, it should be noted that the same or equivalent components are designated by the same numerals when they are displayed on other drawings. In addition, in describing the exemplary embodiments of the present disclosure, in order not to unnecessarily obscure the main points of the present disclosure, detailed descriptions of well-known features or functions will be excluded.

[0029] When describing components according to exemplary embodiments of the present disclosure, terms such as first, second, "A", "B", (a), (b), etc. may be used. These terms are intended only to distinguish one component from another, and the terms do not limit the nature, sequence, or order of the constituent components. Unless otherwise defined, the terms used herein, including technical terms or scientific and technological terms, have the same meanings as those commonly understood by those skilled in the art to which the present disclosure belongs. Such terms as defined in commonly used dictionaries should be interpreted as having a meaning equal to the contextual meaning in the relevant art, and should not be interpreted as having an ideal or overly formal meaning unless expressly defined in this application as having an ideal or overly formal meaning.

[0030] Figure 1 is a block diagram showing a configuration of a convenience device control apparatus of a vehicle according to an exemplary embodiment of the present disclosure. Figure 1 As shown, the convenience device control apparatus 100 for a vehicle according to an exemplary embodiment of the present disclosure may include a memory 10, a light source 20, an electroencephalogram (EEG) sensor 30, an EEG analyzer 40, and a controller 50. Meanwhile, according to a manner of implementing the convenience device control apparatus 100 for a vehicle according to an exemplary embodiment of the present disclosure, the components may be coupled to each other to form one unit. In addition, some components may be omitted according to a manner of executing the exemplary embodiment.

[0031] With reference to each component, the memory 10 may be configured to obtain the user's intention to operate various convenience devices in the vehicle based on the user's EEG signal, and may be configured to store various logics, algorithms, and programs required to operate the convenience devices corresponding to the user's acquisition intention. The memory 10 may be configured to store various data set by the user. For example, the memory 10 may be configured to store functions such as turning on the interior lights as a function matching the first EEG signal, turning off the interior lights as a function matching the second EEG signal, raising the sunshade as a function matching the third EEG signal, lowering the sunshade as a function matching the fourth EEG signal, opening the window as a function matching the fifth EEG signal, closing the window as a function matching the sixth EEG signal, turning on the entertainment device as a function matching the seventh EEG signal, and turning off the entertainment device as a function matching the eighth EEG signal.

[0032] In addition, the memory 10 may also be configured to store EEG signals related to functions of interior lights, displays, audio-visual navigation (AVN) systems, door lock / unlock, rear seat entertainment monitor, seat heating wires, ventilated seats, steering wheel heating wires, etc. The memory 10 may include at least one type of storage medium such as a flash memory, a hard disk memory, a micro memory, a card-type (e.g., a secure digital (SD) card or an extreme digital (XD) card) memory, etc., as well as a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), a programmable ROM (PROM), an electrically erasable programmable read-only PROM (EEPROM), a magnetic memory (MRAM), a magnetic disk, and an optical disk-type memory.

[0033] In addition, the light source 20 may be implemented with a light emitting diode (LED) and may be installed inside the vehicle for operating various convenient devices. The light source 20 may be configured to emit light at a frequency corresponding to each EEG signal matching the functions of various convenient devices installed on the vehicle under the operation of the controller 50. The light of the light source 20 emitting light at a specific frequency may be configured to perform the function of a visual stimulation signal.

[0034] For example, the light source 20 can be configured to emit light at a first frequency (first light emission frequency) corresponding to the first EEG signal, at a second frequency (second light emission frequency) corresponding to the second EEG signal, at a third frequency (third light emission frequency) corresponding to the third EEG signal, at a fourth frequency (fourth light emission frequency) corresponding to the fourth EEG signal, at a fifth frequency (fifth light emission frequency) corresponding to the fifth EEG signal, at a sixth frequency (sixth light emission frequency) corresponding to the sixth EEG signal, at a seventh frequency (seventh light emission frequency) corresponding to the seventh EEG signal, and at an eighth frequency (eighth light emission frequency) corresponding to the eighth EEG signal.

[0035] The EEG sensor 30 may be configured to measure the user's EEG signal in a contact or non-contact manner, and the EEG sensor is a sensor mounted on the headrest of the seat. The EEG sensor 30 may include a plurality of EEG electrodes in contact with the scalp, and the plurality of EEG electrodes are divided into signal electrodes and reference electrodes. When the EEG electrodes are in contact with the lateral lobe of the neck ring, the current generated when the signal is transmitted between neurons in the nervous system can be measured by the EEG electrodes.

[0036] The EEG sensor 30 may be configured to measure EEG signals based on the principle of steady-state visual evoked potential (SSVEP). In other words, the EEG sensor 30 may be configured to measure EEG signals using the following principle: when a person stares at a visual stimulation signal having a specific frequency, a frequency pattern of a frequency band identical to that of the specific frequency appears in the cervical lobule. For reference, EEG refers to a potential obtained by measuring, by electrodes, a signal of a fine brain surface generated by synthesizing electrical signals generated by many nerves of the brain. SSVEP is an EEG signal induced near the cervical lobule responsible for the visual field when staring at a visual stimulation signal provided at a specific frequency. Since the SSVEP includes a frequency component equal to the frequency of the visual stimulation signal, the frequency of the EEG signal measured at the cervical lobule of the user can be compared with the frequency of the visual stimulation signal provided to the user to determine whether the user is staring at the corresponding visual stimulation signal.

[0037] Figure 2 2 is a diagram showing a light emission frequency of a light source included in a convenience device control apparatus of a vehicle and an SSVEP corresponding thereto according to an exemplary embodiment of the present disclosure. Figure 2 As shown in , when the light source 20 installed in the vehicle emits light at a frequency of about 7 Hz, the EEG sensor 30 may be configured to measure an EEG signal of a frequency of 7 Hz and its harmonics at the side lobe of the user's neck loop.

[0038] Meanwhile, the EEG sensor 30 may further include a transmitter (not shown) configured to wirelessly transmit the measured EEG signal to the EEG analyzer 40 or an external server. Specifically, the transmitted EEG signal may be an analog signal or a digital signal. When transmitting a digitally converted EEG signal, the transmitter may include an analog-to-digital converter (ADC). In addition, the transmitter may include at least one of a mobile communication module, a wireless Internet module, and a short-range communication module.

[0039] The mobile communication module can be configured to send EEG signals in the mobile communication network using a mobile communication technical standard or communication scheme (e.g., Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), CDMA 2000, Enhanced Voice Data Optimization or Enhanced Voice Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Advanced Evolution (LTEA), etc.).

[0040] The wireless Internet module (a module for wireless Internet access) can be configured to communicate via wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) direct, Digital Living Network Alliance (DLNA), wireless broadband (WiBro), Worldwide Interoperability for Microwave Access (WiMAX), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), long-term evolution (LTE), long-term advanced evolution (LTE-A), etc. The short-range communication module can be connected by using Bluetooth TM , Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wireless Universal Serial Bus (USB) technologies.

[0041] In addition, the EEG analyzer 40 may be configured to determine whether the user's EEG signal measured by the EEG sensor 30 has a specific frequency. Specifically, the EEG analyzer 40 may use various types of analysis techniques. For example, a power spectrum density analysis technique and a canonical correlation analysis technique may be used.

[0042] The EEG analyzer 40 may be configured to perform a preprocessing process such as amplification or filtering before analyzing the EEG signal. The EEG analyzer 40 may use a band filter (such as a high-pass filter) to pass only frequencies in a specific frequency band, or may use a spatial filter to eliminate or emphasize a spatial frequency band. For example, a high-pass filter may be used to block frequency signals below about 0.1 Hz, or a low weight may be assigned to peripheral signals of the motor cortex, and the EEG of the motor cortex to be measured may be amplified.

[0043] As spatial filters, filters such as common average reference (CAR), large surface Laplace (large SL), small surface Laplace (small SL), common spatial pattern (CSP) can be used, and noise removal algorithms such as independent component analysis (ICA), linear discriminant analysis (LDA), principal component analysis (PCA), and canonical correlation analysis (CCA) can be used to eliminate the noise of the EEG signal.

[0044] The EEG analyzer 40 may be configured to analyze the frequency components of the EEG signal. For example, a frequency sequence power spectrum may be obtained by Fourier transform, and a specific frequency component may be determined by comparing the magnitude of the power spectrum values. Since the EEG signal of a user staring at a visual stimulation signal may include a fundamental frequency and a harmonic frequency (the fundamental frequency is the frequency of the visual stimulation signal, and the harmonic frequency is a multiple of the fundamental frequency), the EEG analyzer 40 may be configured to determine the frequency components of the EEG signal by cepstrum analysis.

[0045] In an exemplary embodiment of the present disclosure, although an embodiment in which the EEG analyzer 40 is implemented in a separate configuration has been described, the EEG analyzer 40 may be integrated into the controller 50 and the controller 50 may be configured to perform the functions of the EEG analyzer 40 in batches. Next, the controller 50 may be configured to perform overall control so that each component performs its respective function normally. The controller 50 may be implemented in the form of hardware or software, or a combination of hardware and software. The controller 50 may be implemented with a microprocessor, but the exemplary embodiment is not limited thereto.

[0046] Furthermore, the controller 50 may be configured to obtain the user's intention to operate various convenience devices in the vehicle based on the user's EEG signal, and perform various required controls in the process of operating the corresponding convenience device corresponding to the obtained user's intention.

[0047] First embodiment

[0048] In a first exemplary embodiment, a method for controlling various functions of a convenience device 200 using one light source 20 is provided, wherein a controller 50 may be configured to change the light emission frequency of the light source 20 corresponding to a situation, and thus various functions of the convenience device 200 may be performed by one or more light sources 20.

[0049] In the following, reference will be made to Figure 3 A specific implementation method is given. Figure 3 1 is a view showing a light source provided in a convenience device control apparatus for a vehicle according to a first exemplary embodiment of the present disclosure. As an example of a convenience device, a room light will be described.

[0050] like Figure 3As shown, when the indoor light is in the off state, the controller 50 may be configured to set the light emission frequency of the light source 20 to a first frequency (e.g., about 40 Hz) so that the user turns on the indoor light. Subsequently, when the user stares at the light source 20, the controller 50 may be configured to obtain the first frequency pattern using the EEG sensor 30 and the EEG analyzer 40, and perform a function of turning on the indoor light corresponding to the first frequency. Then, the controller 50 may be configured to set the light emission frequency of the light source 20 to a second frequency (e.g., about 50 Hz) so that the user can turn off the indoor light when the indoor light is on.

[0051] Specifically, in order to improve the user's awareness of each function, for example, the controller 50 may be configured to set the light color of the light source 20 to red when the light frequency of the light source 20 is set to the first frequency (for example, the light source 20 can emit light at the first frequency), and the controller 50 may be configured to set the light color of the light source 20 to blue when the light frequency of the light source 20 is set to the second frequency (for example, the light source 20 can emit light at the second frequency). In addition, when the first or second frequency is obtained, in order to inform the user of the mode, the controller 50 may be configured to operate the light source 20 to emit light a specified number of times at a time interval, increase the light intensity of the light source 20, or change the light color (for example, green) of the light source 20. Specifically, the light source 20 may be arranged around the indoor lamp, but is not limited thereto.

[0052] At the same time, the controller 50 can implement the setting mode by providing an additional light source around the interior light. For example, when the light source 20 and the additional light source for operating the interior indicator light are provided, the user can enter the setting mode by staring at the additional light source. Specifically, the controller 50 can be configured to repeatedly turn on and off the additional light source to notify the user that the setting mode has been activated. Of course, both the light source 20 and the additional light source can be repeatedly turned on and off (e.g., flashing mode).

[0053] When the user directly operates the window in the setting mode, the controller 50 may be configured to prevent the flashing of the additional light source and enter the light source setting process. In other words, the controller 50 may be configured to determine the order in which the user stares at the light source. Through this process, the controller 50 may be configured to use the light source of the interior light to set the function of another convenience device through the staring order of the light source 20 and the additional light source. When there are multiple additional light sources, a function can be set for one light source without using its combination. The first exemplary embodiment may also include a display operated by the controller 50 to display the current operating mode of the convenience device in the form of a phrase or icon to improve the user's awareness of operating the convenience device.

[0054] Second embodiment

[0055] In the second exemplary embodiment, a method of controlling various functions of one convenience device 200 using a plurality of light sources 20 is provided, wherein each light source 20 matches each function of the convenience device 200 .

[0056] In the following, reference will be made to Figure 4 A specific implementation method is given. Figure 4 2 is a view showing a light source provided in a convenience device control apparatus for a vehicle according to a second exemplary embodiment of the present disclosure. As an example of a convenience device, an AVN system will be described.

[0057] like Figure 4 As shown, a plurality of light sources 20 may be provided, and the first light source 21 may emit light at a frequency (e.g., about 40 Hz) for turning on an audio-visual navigation (AVN) system under the operation of the controller 50. As an example, the light emission color may be red. The second light source 22 may emit light at a frequency (e.g., about 50 Hz) for turning off the AVN system under the operation of the controller 50, and as an example, the light emission color may be blue. The third light source 23 may emit light at a frequency (e.g., about 60 Hz) for entering a channel change mode under the operation of the controller 50, and as an example, the light emission color may be purple.

[0058] The first exemplary embodiment may be added to the second exemplary embodiment. In other words, when entering the channel change mode, the controller 50 may be configured to operate the first light source 21 to emit light at a frequency of an increased channel, operate the second light source 22 to emit light at a frequency of a decreased channel, and operate the third light source 23 to emit light at a frequency of leaving the channel change mode. During this process, the controller 50 may be configured to recognize the emission of light based on the situation as another function without changing the emission frequency of each light source.

[0059] For example, when entering the channel change mode, the frequency of turning on the AVN system may be identified as the frequency of raising the channel, the frequency of turning off the AVN system may be identified as the frequency of lowering the channel, and the frequency of entering the channel change mode may be identified as the frequency of leaving the channel change mode.

[0060] Figure 5 1 is a view showing the light emission color of each light source in a second exemplary embodiment of the light source provided in the convenience device control apparatus of the vehicle according to the exemplary embodiment of the present disclosure. Figure 5 As shown in , when the AVN system is in an off state, the controller 50 may be configured to operate the first light source 21 to emit red light for turning on the AVN system, and may be configured to turn off the remaining second light source 22 and third light source 23.

[0061] Thereafter, when the AVN system is turned on, the controller 50 may be configured to turn on all the light sources 20. When the AVN system is turned on, the controller 50 may be configured to display the current operation mode of the AVN system in the form of a phrase or icon on the display to improve the user's awareness of each function. The controller 50 may also be configured to set the function of each light source from the user through an input device of the AVN system.

[0062] Third embodiment

[0063] The third exemplary embodiment is a method for operating a convenience device by a combination of a plurality of light sources, which may be applied to a combination of the first and second exemplary embodiments or the second exemplary embodiment. Specifically, the controller 50 may be configured to perform functions of various convenience devices in the vehicle by a combination of EEG signals having different frequencies analyzed by the EEG analyzer 40.

[0064] For example, when a first light source 21 emitting light at a first frequency and a second light source 22 emitting light at a second frequency are provided for operating the sunshade, the controller 50 may be configured to raise the sunshade when an EEG signal corresponding to the first frequency of the first light source 21 and a second EEG signal corresponding to the second frequency of the second light source 22 are continuously measured within a critical period. When a second EEG signal corresponding to the second frequency of the second light source 22 and an EEG signal corresponding to the first frequency of the first light source 21 are continuously measured within a critical period, the controller 50 may be configured to lower the sunshade.

[0065] Specifically, in the operation of raising the sun visor, the user knows in advance that the first light source 21 emitting light at the first frequency should be stared at for a certain period of time (e.g., 1 to 1.5 seconds), and then the second light source 22 emitting light at the second frequency should be stared at for a certain period of time (e.g., 1 to 1.5 seconds). Specifically, in order to lower the sun visor, the user knows in advance that the first light source 21 emitting light at the first frequency should be stared at for a certain period of time (e.g., 1 to 1.5 seconds) and then the second light source 22 emitting light at the second frequency should be stared at for a certain period of time (e.g., 1 to 1.5 seconds).

[0066] The controller 50 may be configured to obtain or detect the user's intention to operate a power window, operate an electric sunshade, adjust the angle of an electric seat, operate an electric foot pedal, operate a lighting device, operate an air conditioner, operate a display, operate an entertainment device, etc. through a combination of EEG signals with different frequencies, and then may perform corresponding operations. The controller 50 may be configured to set the luminous color of the first light source 21 to, for example, red and the luminous color of the second light source 22 to, for example, blue to improve the user's awareness of each function.

[0067] When a first EEG signal corresponding to the first frequency of the first light source 21 and a second EEG signal corresponding to the second frequency of the second light source 22 are continuously measured within a critical period, or when a second EEG signal corresponding to the second frequency of the second light source 22 and a first EEG signal corresponding to the first frequency of the first light source 21 are continuously measured within a critical period, in order to provide a notification to the user, the controller 50 may be configured to operate the light source 20 to emit light a specified number of times at a time interval, increase the light intensity of the light source 20, or change the light color of the light source 20 (for example, to green). In other words, the controller 50 may be configured to operate the light source 20 to emit light a specified number of times at a time interval, increase the light intensity of the light source 20, or change the light color of the light source 20 (for example, to green).

[0068] According to the third exemplary embodiment, a display device may be further included to display a current operation mode of the convenience device in a phrase or icon form on a display to improve the user's awareness of the operation of the convenience device.

[0069] Figure 6 601, the light source 20 may be configured to emit light at a specified frequency. Then, in operation 602, the EEG sensor 30 may be configured to measure the EEG signal of the user. In operation 603, the EEG analyzer 40 may be configured to analyze the frequency of the EEG signal measured by the EEG sensor 30. In other words, the EEG analyzer 40 may be configured to detect an EEG signal having a specific frequency. Thereafter, in operation 604, the controller 50 may be configured to operate the convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer 40.

[0070] Figure 7 701 is a flowchart illustrating a method for operating a convenience device of a vehicle according to another exemplary embodiment of the present disclosure. First, in operation 701, a plurality of light sources emit light at different frequencies. Then, in operation 702, the EEG sensor 30 may be configured to send an EEG signal of a user. In operation 703, the EEG analyzer 40 may be configured to analyze the frequency of the EEG signal measured by the EEG sensor 30. In other words, the EEG analyzer 40 may be configured to detect an EEG signal having a specific frequency. Thereafter, in operation 704, the controller 50 may be configured to operate a convenience device in the vehicle by a combination of EEG signals having different frequencies analyzed by the EEG analyzer 40.

[0071] Figure 8 is a block diagram illustrating a computing system for executing a method of operating a convenience device of a vehicle according to an exemplary embodiment of the present disclosure. Figure 8The method for operating a convenience device of a vehicle according to an exemplary embodiment of the present disclosure may be implemented by a computing system. The computing system 1000 may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, a storage device 1600, and a network interface 1700 connected to each other via a bus 1200.

[0072] The processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and / or the storage 1600. The memory 1300 and the storage 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a ROM (read only memory) and a RAM (random access memory).

[0073] Therefore, the operation of the method or algorithm described in conjunction with the embodiments disclosed herein may be directly embodied in a hardware or software module or a combination of the two executed by the processor 1100. The software module may be present in a storage medium (i.e., memory 1300 and / or storage device 1600), for example, RAM, flash memory, ROM, EPROM, EEPROM, register, hard disk, solid state drive (SSD), removable disk, CD-ROM. An exemplary storage medium may be coupled to the processor 1100, and the processor 1100 may read information from the storage medium and may write information in the storage medium. Alternatively, the storage medium may be integrated with the processor 1100. The processor 1100 and the storage medium may be present in an application specific integrated circuit (ASIC). The ASIC may be present in a user terminal. In another case, the processor 1100 and the storage medium may be present in a user terminal as separate components.

[0074] According to an exemplary embodiment of a convenience device control apparatus for a vehicle and a method thereof, it is possible to detect a user's intention to operate a convenience device based on the user's EEG signal and operate a corresponding convenience device corresponding to the detected user's intention, thereby enabling the user to more easily operate various convenience devices installed in the vehicle.

[0075] Although the present disclosure has been described above with reference to exemplary embodiments and the accompanying drawings, the present disclosure is not limited thereto and various modifications and changes may be made by those skilled in the art without departing from the spirit and scope of the present disclosure as claimed in the appended claims.

[0076] Therefore, the exemplary embodiments of the present disclosure are provided to illustrate the spirit and scope of the present disclosure, but not to limit them, so the spirit and scope of the present disclosure are not limited by the embodiments. The scope of the present disclosure should be interpreted based on the attached claims, and all technical concepts within the scope are equivalent to the claims that should be included in the scope of the present disclosure.

Claims

1. A convenience device control apparatus for a vehicle, comprising: a light source configured to emit light at a first frequency in a first time period, and to emit light at a second frequency different from the first frequency in a second time period different from the first time period; an electroencephalogram sensor configured to measure an electroencephalogram signal of a user gazing at the light source; an EEG analyzer configured to analyze the frequency of the EEG signal measured by the EEG sensor; as well as A controller is configured to operate a convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

2. The convenience device control apparatus according to claim 1, wherein: The controller is configured to change a lighting frequency of the light source corresponding to an operating state of the convenience device.

3. The convenience device control apparatus according to claim 1, wherein: The controller is configured to change a light emission color of the light source corresponding to a light emission frequency of the light source.

4. The convenience device control apparatus according to claim 1, wherein: The controller is configured to operate the light source to emit light a specified number of times at a time interval at a point in time when the convenience device is operated.

5. The convenience device control apparatus according to claim 1, wherein: The controller is configured to increase the light intensity of the light source at a point in time when the convenience device is operated.

6. The convenience device control apparatus according to claim 1, wherein: The controller is configured to change a light emission color of the light source at a point in time when the convenience device is operated.

7. The convenience device control apparatus according to claim 1, wherein: The light sources are located around the convenience device.

8. The convenience device control apparatus according to claim 1, wherein: The light source is configured to emit light of a first color at the first frequency and to emit light of a second color different from the first color at the second frequency.

9. A method for controlling a convenience device of a vehicle, comprising the following steps: The light source emits light at a first frequency in a first time period, and emits light at a second frequency different from the first frequency in a second time period different from the first time period; measuring, by an electroencephalogram sensor, an electroencephalogram signal of a user staring at the light source; analyzing, by an EEG analyzer, the frequency of the EEG signal measured by the EEG sensor; and A convenience device in the vehicle is operated by a controller based on the frequency of the EEG signal analyzed by the EEG analyzer.

10. The method according to claim 9, wherein: Operating a convenience device of the vehicle includes changing a lighting frequency of the light source corresponding to an operating state of the convenience device.

11. The method according to claim 9, wherein: Operating a convenience device in the vehicle includes changing a light emission color of the light source corresponding to a light emission frequency of the light source.

12. The method according to claim 9, wherein: Operating a convenience device in the vehicle includes causing the light source to emit light a specified number of times at a time interval at a point in time when the convenience device is operated.

13. The method according to claim 9, wherein: Operating a convenience device in the vehicle includes increasing the light intensity of the light source at a point in time when the convenience device is operated.

14. The method according to claim 9, wherein: Operating a convenience device in the vehicle includes changing a light emission color of the light source at a point in time when the convenience device is operated.

15. The method according to claim 9, wherein: The light sources are located around the convenience device.

16. The method according to claim 9, wherein: The light source is configured to emit light of a first color at the first frequency and to emit light of a second color different from the first color at the second frequency.

17. A convenience device control apparatus for a vehicle, comprising: A plurality of light sources having different light emission frequencies, wherein the plurality of light sources include a first light source and a second light source, the first light source being configured to emit light of a first color at a first frequency, and the second light source being configured to emit light of a second color different from the first color at a second frequency different from the first frequency; an electroencephalogram sensor configured to measure an electroencephalogram signal of a user gazing at any one of the plurality of light sources; an EEG analyzer configured to analyze the frequency of the EEG signal measured by the EEG sensor; and A controller is configured to operate a convenience device in the vehicle based on the frequency of the EEG signal analyzed by the EEG analyzer.

18. The convenience device control apparatus according to claim 17, wherein: The controller is configured to operate the convenience device when the electroencephalogram signal having the first frequency and the electroencephalogram signal having the second frequency are measured continuously within a specified time.

19. The convenience device control apparatus according to claim 17, wherein: The controller is configured to change a light emission color of the light source corresponding to a light emission frequency of the light source.

20. The convenience device control apparatus according to claim 17, wherein: The controller is configured to operate the light source to emit light a specified number of times at a time interval at a point in time when the convenience device is operated.

21. The convenience device control apparatus according to claim 17, wherein: The controller is configured to increase the light intensity of the light source at a point in time when the convenience device is operated.

22. The convenience device control apparatus according to claim 17, wherein: The controller is configured to change a light emission color of the light source at a point in time when the convenience device is operated.

Citation Information

Patent Citations

  • Process for preparing high purity pheophytin, Chlorin e6, and Chlorin e6 and PVP complex from natural products containing chlorophyll

    KR1020190053490A

  • Apparatus for analyzing brain wave

    US20100010365A1