Multi-user EEG-based signal sharing system and cooperative control method thereof
The multi-user brainwave sharing system addresses multi-user cooperation challenges by preprocessing and analyzing brainwave signals to ensure synchronized intentions, providing real-time feedback and accurate control.
Patent Information
- Application Number
- KR1020250092331
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-07-09
- Publication Date
- 2026-11-05
- Estimated Expiration
- 2045-07-09
AI Technical Summary
Existing brain-computer interface technologies struggle with multi-user cooperation due to differences in brainwave response timing, cognitive reliability, and signal link stability, leading to judgment inconsistencies, control delays, and cooperation failures.
A multi-user brainwave sharing system that collects and preprocesses brainwave signals from multiple users to extract feature information, analyzes for cooperative conditions, and generates control commands only when intentions match, providing real-time feedback through external devices.
Enables consistent cooperative control by correcting user-specific response characteristics and ensuring synchronized intentions, allowing intuitive feedback and precise decision-making among users.
Smart Images

Figure 112025077508592-PAT00001_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to a multi-user brainwave sharing system and a cooperative control method thereof, which cooperatively controls an external device by sharing and interpreting the brainwaves of multiple users in real time. Background Technology
[0003] Recently, brain-computer interface (BCI) technology has been attracting attention as a non-contact interface technology that allows direct interaction with machines using human biosignals. In particular, electroencephalography (EEG) is a representative signal that reflects selective perception (Event Related Potential, P300) based on the user's motor imagery (MI) and stimulus response, and is being utilized in various application fields such as medical rehabilitation, robot control, and emotion recognition systems.
[0004] Existing brainwave-based control technologies have primarily focused on controlling external devices by interpreting a single user's brainwave signals. For example, this includes methods that analyze a user's MI or P300 signals to operate a moving object or implement interactions within a virtual environment.
[0005] Some studies have attempted to visualize or statistically analyze the degree of interaction through the analysis of brainwave similarity among multiple users, but this was limited to static analysis and could not be extended to real-time cooperative control.
[0006] Existing technologies have limitations in multi-user-based cooperation judgment because they fail to adequately account for differences in brainwave response timing between users, variations in cognitive reliability, or issues regarding signal link stability. Due to these limitations, problems such as judgment inconsistencies, control delays, and cooperation failures may occur.
[0007] Furthermore, while some existing studies have attempted to integrate intent and cognitive information based on multiple users, they lacked a real-time information sharing structure and cooperation judgment procedures, resulting in insufficient implementation of mutual feedback through external mediating devices such as actual moving objects. The problem to be solved
[0009] The present invention is intended to provide a multi-user brainwave sharing system and a cooperative control method thereof, which share and interpret the brainwaves of multiple users in real time to cooperatively control an external device.
[0010] Furthermore, the present invention aims to provide a multi-user brainwave sharing system and a cooperative control method capable of providing consistent cooperative control, reliability-based judgment, and intuitive feedback among multiple users by correcting differences in response characteristics between users, establishing cooperative judgment criteria, and feeding back the judgment results through an external device. means of solving the problem
[0012] According to one aspect of the present invention, a cooperative control method for a brainwave sharing system among multiple users is provided.
[0013] According to one embodiment of the present invention, a brainwave-based cooperative control method may be provided, comprising: a step of collecting first and second brainwave signals based on each user's motor imagery (MI) or selective perception (P300) from an EEG device worn by a plurality of users; a step of preprocessing the first and second brainwave signals to extract first and second feature information, wherein the first and second feature information includes intention information, confidence value, and time information for the occurrence of the first or second brainwave signal; a step of analyzing the first feature information and the second feature information to determine whether a cooperative condition is satisfied, and if the cooperative condition is satisfied, generating a cooperative control command and transmitting it to a control target device; and a step of feeding back the result of the control target device in the form of visual information.
[0014] The above cooperation conditions may include whether the intention information matches, whether the reliability value is above a threshold, and whether the occurrence time information is synchronized.
[0015] The above-mentioned control target device is a mobile body, a smart home device, an educational content providing device, or a user terminal, and the above-mentioned control target device can perform at least one of performing an action within a virtual reality-based game, moving the direction or reconnaissance of a drone, changing the state of a smart home device, or controlling educational content according to the above-mentioned cooperative control command.
[0016] The above feedback may be provided as visual guidance on whether cooperation conditions are established or whether control operations are executed, changes within the virtual environment, changes in device status, or whether educational content is in progress.
[0017] The above cooperative control command is generated only when the intentions of multiple users match, and in the event of a mismatch in intentions, the generation of the command may be withheld or determined based on priority or majority criteria.
[0018] The above preprocessing includes correcting the brainwave response speed, repetition period, repetition delay time, and signal pattern by applying user-specific correction criteria set according to the response characteristics of each user, and the user-specific correction criteria can be set through a digital twin-based model generated by pre-learning information regarding each user's brainwave response speed, repetition period, and signal pattern in a virtual simulation environment.
[0020] According to another aspect of the present invention, a brainwave sharing system among multiple users may be provided.
[0021] According to one embodiment of the present invention, a system may be provided comprising: a brainwave collection unit that collects first and second brainwave signals based on each user's motor imagery (MI) or selective perception (P300) from an EEG device worn by a plurality of users; an analysis unit that preprocesses the first and second brainwave signals to extract first and second feature information, wherein the first and second feature information includes intention information, a confidence value, and information on the occurrence time of the first or second brainwave signal; a cooperation control unit that analyzes the first feature information and the second feature information to determine whether a cooperation condition is satisfied and generates a cooperation control command when the cooperation condition is satisfied; a transmission unit that transmits the cooperation control command to a control target device; and a feedback interface unit that feeds back the execution result of the control target device in the form of visual information. Effects of the invention
[0023] By providing a multi-user brainwave sharing system and a cooperative control method according to an embodiment of the present invention, intention and cognitive signals based on the brainwaves (MI, P300) of multiple users are collected in real time, and by integrating and analyzing data packets including the time of occurrence, repetition period, and reliability information of each signal, it is possible to quickly and precisely determine whether there is a match in intentions between users.
[0024] In addition, the present invention can improve the consistency between brainwave signals and increase the accuracy of cooperation judgment by simulating physiological characteristics such as user-specific reaction speed, signal generation period, and pattern in a virtual environment and forming correction criteria through iterative learning.
[0025] In addition, the present invention provides intuitive feedback linked with an external device, so that cooperation commands generated based on whether the intention matches are output as physical movements through an external mobile body (such as a UAV), and the user can visually and tactilely perceive the movements, thereby enabling real-time verification of whether their intention matches that of other users.
[0026] In addition, the present invention goes beyond simple command execution and enables cooperative commands to be executed only when the brainwave signals of multiple users match under specific conditions, thereby enabling users to implement a communication structure that allows for mutual agreement and decision-making through brainwaves. Brief explanation of the drawing
[0028] FIG. 1 is a schematic diagram illustrating the configuration of a multi-user brainwave cooperation control system according to one embodiment of the present invention. FIG. 2 is a block diagram schematically illustrating the internal configuration of a cooperative control device according to one embodiment of the present invention. FIG. 3 is a flowchart illustrating a cooperative control method of a brainwave sharing system according to an embodiment of the present invention. Specific details for implementing the invention
[0029] As used in this specification, singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "composed" or "comprising" should not be interpreted as necessarily including all of the various components or steps described in the specification, and should be interpreted as meaning that some of the components or steps may be excluded, or that additional components or steps may be included. Furthermore, terms such as "...part," "module," etc., as used in the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.
[0030] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
[0032] FIG. 1 is a schematic diagram illustrating the configuration of a multi-user brainwave cooperation control system according to one embodiment of the present invention.
[0033] Referring to FIG. 1, a multi-user brainwave cooperation control system (100) according to one embodiment of the present invention comprises a first EEG device (110a), a second EEG device (110b), a brainwave cooperation control device (120), and a control target device (130).
[0034] The first EEG device (110a) and the second EEG device (110b) are devices worn by each user and are means for measuring brainwave signals corresponding to each user's movement intention (MI) or selective cognition (P300).
[0035] For the convenience of understanding and explanation, the first EEG device (110a) is assumed to be worn by a first user, and the second EEG device (110b) is assumed to be worn by a second user.
[0036] The first EEG device (110a) and the second EEG device (110b) may include a plurality of electrodes in contact with the scalp, and the electrophysiological signal measured through the electrodes may be processed in an analog or digital form.
[0037] The method by which the first EEG device (110) and the second EEG device (120) measure each user's brainwave signal is obvious to those skilled in the art who have ordinary knowledge in the field of EEG measurement technology, so a detailed explanation thereof will be omitted.
[0038] The brainwave cooperation control device (120) is a means for determining cooperation conditions between users and generating cooperation control commands based on first and second brainwave signals received from the first EEG device (110) and the second EEG device (120).
[0039] For example, the brainwave cooperation control device (130) can perform preprocessing on the received brainwave signal and generate feature data including intention information, confidence value, and brainwave generation time information extracted from each user.
[0040] The brainwave cooperation control device (130) determines whether the cooperation condition is satisfied by comprehensively evaluating whether the intention information matches, whether the reliability value exceeds a reference value, and whether the timing of brainwave generation is synchronized by comparing the first and second feature information, and if the cooperation condition is satisfied, it can generate a cooperation control command by considering the intentions of multiple users to be in agreement.
[0041] The control target device (140) is a configuration that operates according to a cooperation control command received from the brainwave cooperation control device (130), and may be, for example, a mobile vehicle (UAV), a smart home device, an educational content providing device, or an interactive object within virtual reality.
[0042] The controlled device (140) can perform physical actions such as moving, rotating, and stopping according to the received cooperative control command, or perform screen content control, device state switching, and event triggering within the virtual environment.
[0043] The result of the operation of the control target device (140) is fed back to the user in the form of visual information or sensory signals, and the user can intuitively recognize whether their intention matches that of another user.
[0044] For example, let's assume the case where the device to be controlled is a moving object.
[0045] The brainwave cooperation control device (130) collects first and second brainwave signals from the first user and the second user, respectively, preprocesses them to extract first feature information and second feature information, respectively, analyzes the first feature information and second feature information to determine whether cooperation conditions are satisfied, and if cooperation conditions are satisfied, transmits a cooperation control command to the mobile body, and the mobile body can perform actions such as moving in a designated direction or rotating, or stopping, according to the received cooperation control command.
[0046] As another example, let us assume a case where family members cooperatively control the status of home appliances (e.g., turning on the TV, changing channels, etc.) through brainwaves.
[0047] In this case, the brainwave cooperation control device (130) can preprocess brainwave signals collected from multiple family members through an EEG device and generate feature information including each user's intention information, reliability, and the time of signal generation. Subsequently, the brainwave cooperation control device (130) determines a cooperation condition when two or more members simultaneously recall the same intention within a certain period of time. For example, when a child suggests watching TV and a guardian parent simultaneously approves the action (e.g., turning on the TV), or when multiple family members simultaneously recall a specific channel, the command is considered a jointly agreed-upon cooperative intention.
[0048] Only when these cooperation conditions are met, the brainwave cooperation control device (130) can control the execution of a change in the state of the home appliance (e.g., turning on the power, switching channels, etc.) by generating a cooperation control command and transmitting it to the control target device (e.g., TV, set-top box, etc.).
[0049] In this way, by implementing consensus-based execution of decision-making among users through brainwaves, it can be effectively applied to TV viewing permission control, child protection functions, or content access methods based on mutual coordination among family members.
[0050] As another example, let's assume a teacher-student collaboration system.
[0051] The brainwave cooperation control device (130) collects each brainwave signal from the EEG device worn by the teacher and the student, and preprocesses the signal to extract feature information including intention information and cognitive state information.
[0052] For example, when a teacher indicates an intention to adjust the progress of the content or start solving problems (MI-based) and a student indicates a brainwave response based on concentration or understanding (P300-based), the brainwave cooperation control device (130) can determine that the cognitive states of both are in agreement if these signals are synchronized in terms of timing and meet the judgment criteria.
[0053] Accordingly, the brainwave cooperation control device (130) determines that the cooperation conditions are satisfied and transmits a cooperation control command to an educational content providing device (e.g., tablet, electronic whiteboard, etc.), thereby allowing the learning flow to proceed based on bilateral brainwave cooperation, such as automatically advancing the progress of the content or starting a new problem-solving screen.
[0054] Unlike unidirectional lecture methods, this enables the realization of an immersive educational environment and a feedback-based adaptive content delivery system by controlling learning content based on the synchronization of attention or the alignment of learning intentions between the teacher and the student.
[0055] In this way, the brainwave cooperation control device (130) can determine whether cooperation conditions are satisfied based on various scenarios based on brainwave signals between multiple users and transmit a cooperation control command for controlling the device to be controlled.
[0056] Below, the configuration of the cooperative control device (130) will be described in detail.
[0058] FIG. 2 is a block diagram schematically illustrating the internal configuration of a cooperative control device according to one embodiment of the present invention.
[0059] Referring to FIG. 2, a cooperative control device (120) according to one embodiment of the present invention comprises a brainwave collection unit (210), an analysis unit (220), a cooperative control unit (230), a communication unit (240), a feedback interface unit (250), a memory (260), and a processor (270).
[0060] The brainwave collection unit (210) is a means for collecting brainwave signals from multiple users. For example, it is assumed that multiple users are wearing EEG headsets, and these EEG headsets can non-invasively measure brainwave signals through multiple electrodes placed on the user's scalp.
[0061] Brainwave signals may include signals based on the user's motor imagery (MI) or cognitive responses to external stimuli (Event Related Potential, P300), and may reflect neurophysiological information related to the user's behavioral intention, attention, selective response, etc.
[0062] In addition, the brainwave collection unit (210) can correspond to individual equipment for each user and can collect time information and raw data per channel, taking into account differences in timing, intensity, and repetition cycle of brainwave signals occurring according to the user, so that analysis and correction can be performed in a subsequent processing module.
[0063] The analysis unit (220) is a means for preprocessing collected brainwave signals and extracting feature information about the preprocessed brainwave signals.
[0064] The analysis unit (220) can extract meaningful feature information from the user's brainwave after performing preprocessing steps such as noise removal, filtering, baseline correction, and time-frequency conversion on the input brainwave signal. For example, the extracted feature information may include a change pattern of a specific frequency band corresponding to the user's motor intention (MI), and time delay and amplitude information after stimulation related to selective cognitive response (P300).
[0065] In addition, the analysis unit (220) may include a reliability value and time-stamp information on the occurrence of a brainwave event as feature information in the feature information extracted from the brainwave signal. The reliability value is a value that quantitatively evaluates whether a specific brainwave signal sufficiently reflects the user's intention, and can be calculated based on prediction reliability, pattern matching rate, or output probability of a classification algorithm.
[0066] In addition, the timing of brainwave event occurrence refers to the precise time information at which the corresponding neurophysiological response was detected, and can be utilized as a criterion for determining signal synchronization among multiple users, evaluating cooperation conditions, etc.
[0067] Additionally, the analysis unit (220) can learn or apply individual signal tuning and calibration criteria according to the response characteristics of each user. For example, a specific user's brainwave may have a large response delay or a small signal amplitude, and criteria for correcting such physiological deviations may also be established.
[0068] The cooperation control unit (230) analyzes feature information extracted from the brainwave signals of multiple users to determine whether the cooperation condition is satisfied, and if the cooperation condition is satisfied, it can generate a cooperation control command.
[0069] For example, the cooperation control unit (230) can determine whether the cooperation condition is satisfied by comparing and analyzing the intention label, confidence score, and time-stamp of the brainwave event included in each feature information (e.g., first feature information and second feature information).
[0070] That is, the cooperation control unit (230) can determine whether the cooperation condition is satisfied by analyzing the intention labels included in the first feature information and the second feature information to determine whether multiple users have imagined the same command or intention. At this time, the cooperation control unit (230) can compare and analyze the intention labels only when each reliability value included in the first feature information and the second feature information, respectively, exceeds a preset threshold.
[0071] Additionally, the cooperation control unit (230) can calculate the time difference between the event occurrence time included in the first feature information and the second feature information, and determine that the cooperation condition is satisfied only if the time difference exists within a predefined allowable time range.
[0072] As described above, the cooperative control unit (230) can determine whether the intentions of multiple users are aligned by considering whether the intention labels included in the feature information extracted for the brainwave signals of multiple users match, whether the criteria for the reliability value are satisfied, and whether the time of event occurrence is synchronized.
[0073] When cooperation conditions are met, the cooperation control unit (230) can transmit a cooperation control command to the device to be controlled. Here, the device to be controlled may be a mobile body, a screen content control, a device state switching, or an event trigger within a virtual environment, as described above.
[0074] A control target device that receives a cooperative control command from a cooperative control unit (230) can execute a predefined action according to the command, and, for example, control such as moving a UAV in a specific direction, progressing content to the next learning stage, changing the state of a smart home device, or activating an event in a virtual space can be performed.
[0075] The communication unit (240) is a means for transmitting a cooperative control command to a device to be controlled and receiving feedback from the device to be controlled regarding the execution of an operation. Here, the feedback may include current state information of the device to be controlled or operation information regarding the result of the command execution.
[0076] For example, the actual direction of movement of a moving object, whether content is progressing, changes in the state of home appliances, and the results of event triggers within a virtual environment may fall under this category.
[0077] The communication unit (240) can be implemented in various ways, such as wireless communication, near-field communication (NFC), Wi-Fi, Bluetooth, or a wired interface, and can enable real-time transmission and reception to form a mutual feedback loop between the cooperation judgment result and the control response.
[0078] The feedback interface section (250) can display feedback from the controlled device in the form of visual information so that the user can recognize whether their intention matches that of other users.
[0079] Feedback information may include changes in the state of the device to be controlled, whether an operation is executed, or the result of an event processing, and the feedback interface unit (250) may provide this to the user in a visual manner, such as a display screen, an augmented reality interface, or a graphic UI.
[0080] For example, a scene of a UAV moving in a specific direction in response to a user's cooperative command may be displayed on the screen in real time, changes in the state of a smart device (e.g., TV turned on, channel change, etc.) may be visually indicated, or graphic effects triggered by interactive objects within the virtual reality may be provided.
[0081] In this way, the feedback interface unit (250) can clearly recognize whether the user's brainwave-based command has actually been reflected and whether the judgment of cooperation with other users has matched.
[0082] Additionally, as needed, the feedback interface unit (250) may also provide a five-sense-based cognitive feedback environment by utilizing sensory stimuli such as vibration, sound, and color change.
[0083] The memory (260) stores various instructions for performing a cooperative control method in a multi-user cooperative control device according to one embodiment of the present invention.
[0084] The processor (270) is a means for controlling internal components (e.g., brainwave collection unit (210), analysis unit (220), cooperative control unit (230), communication unit (240), feedback interface unit (250), memory (260), etc.) of a cooperative control device (120) according to one embodiment of the present invention.
[0086] FIG. 3 is a flowchart illustrating a cooperative control method of a brainwave sharing system according to an embodiment of the present invention. FIG. 3 describes a method for cooperatively controlling a target device by multiple users, assuming that the target device is a mobile body (e.g., a UAV).
[0087] In step 310, the brainwave sharing system (100) collects brainwave signals from multiple users.
[0088] Multiple users can each wear an EEG (Electroencephalography) device and generate brainwave signals based on motor imagery (MI) or event-related potential (P300) by imagining specific actions, such as moving, stopping, or turning, or by paying attention to visual and auditory stimuli.
[0089] The brainwave sharing system (100) can collect individual user brainwave signals in real time from EEG devices worn by multiple users. Since each user's brainwave signal may differ in terms of expression timing, repetition period, amplitude, response pattern, etc., time synchronization processing and identification information assignment during the collection stage may be considered important.
[0090] For example, the brainwave sharing system (100) can collect a first brainwave signal from a first user and collect a second brainwave signal from a second user.
[0091] In step 315, the brainwave sharing system (100) preprocesses the first brainwave signal and the second brainwave signal, respectively, to extract the first feature information and the second feature information, respectively.
[0092] The preprocessing process may include signal refinement steps, such as removing unnecessary noise from the collected EEG signals, isolating necessary frequency bands, or aligning baselines. Techniques such as filtering, normalization, artifact removal, and time-frequency analysis may be used in this process.
[0093] The brainwave sharing system (100) can analyze the preprocessed signal to extract first and second feature information, such as intention information, reliability value, and event occurrence time, respectively.
[0094] In step 320, the brainwave sharing system (100) analyzes the first feature information and the second feature information to determine whether the cooperation condition is satisfied.
[0095] If the cooperation conditions are not met, proceed to Step 310.
[0096] However, if the cooperation conditions are met, in step 325, the brainwave sharing system (100) generates a cooperation control command and transmits it to the device to be controlled.
[0097] Next, in step 330, the brainwave sharing system (100) receives feedback information from the device to be controlled and displays the feedback information in the form of visual information, thereby enabling the user to intuitively recognize whether their intention matches that of another user.
[0099] An apparatus and method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the computer-readable medium may be those specifically designed and configured for the present invention, or they may be those known and available to a person skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.
[0100] The hardware device described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.
[0101] The present invention has been described above with reference to its embodiments. Those skilled in the art will understand that the present invention may be implemented in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention.
Claims
Claim 1 A method for brainwave-based cooperative control comprising: a step of collecting first and second brainwave signals based on each user's motor imagery (MI) or selective perception (P300) from an EEG device worn by multiple users; a step of preprocessing the first and second brainwave signals to extract first and second feature information, wherein the first and second feature information includes intention information, confidence value, and information on the occurrence time of the first or second brainwave signal; a step of analyzing the first feature information and the second feature information to determine whether a cooperation condition is satisfied, and if the cooperation condition is satisfied, generating a cooperative control command and transmitting it to a control target device; and a step of feeding back the execution result of the control target device in the form of visual information, wherein the preprocessing includes correcting the brainwave response speed, repetition period, repetition delay time, and signal pattern by applying user-specific correction criteria set according to each user's response characteristics, and wherein the user-specific correction criteria are set through a digital twin-based model generated by pre-learning information regarding each user's brainwave response speed, repetition period, and signal pattern in a virtual simulation environment. Claim 2 A brainwave-based cooperation control method according to claim 1, characterized in that the cooperation conditions include whether intention information matches, whether the reliability value is greater than or equal to a threshold, and whether the occurrence time information is synchronized. Claim 3 A brainwave-based cooperative control method according to claim 1, wherein the control target device is a mobile body, a smart home device, an educational content providing device, or a user terminal, and the control target device performs at least one of performing an action within a virtual reality-based game, moving the direction or reconnaissance of a drone, changing the state of a smart home device, or controlling educational content according to the cooperative control command. Claim 4 A brainwave-based cooperative control method according to claim 1, characterized in that the feedback is provided as visual guidance on whether a cooperative condition is established or whether a control operation is executed, a change within a virtual environment, a change in the device state, or whether educational content is being advanced. Claim 5 A brainwave-based cooperative control method according to claim 1, wherein the cooperative control command is generated based on the matched intentions when the intentions of multiple users match, and when the intention information of the multiple users does not match, the generation of the cooperative control command is withheld or generated based on intention information determined according to priority or majority criteria. Claim 6 delete Claim 7 A system comprising: a brainwave collection unit that collects first and second brainwave signals based on each user's motor imagery (MI) or selective perception (P300) from an EEG device worn by multiple users; an analysis unit that preprocesses the first and second brainwave signals to extract first and second feature information, wherein the first and second feature information includes intention information, confidence value, and information on the occurrence time of the first or second brainwave signal; a cooperation control unit that analyzes the first feature information and the second feature information to determine whether a cooperation condition is satisfied and generates a cooperation control command if the cooperation condition is satisfied; a transmission unit that transmits the cooperation control command to a control target device; and a feedback interface unit that feeds back the execution result of the control target device in the form of visual information, wherein the preprocessing includes correcting the brainwave response speed, repetition period, repetition delay time, and signal pattern by applying user-specific correction criteria set according to each user's response characteristics, and wherein the user-specific correction criteria are set through a digital twin-based model generated by pre-learning information regarding each user's brainwave response speed, repetition period, and signal pattern in a virtual simulation environment.
Citation Information
Patent Citations
Systems and methods of multimodal interaction-based e-commerce
US12608739B1
Apparatus, method, and system for pre-action therapy
US20190099104A1
Brain-computer interface system and method for air-ground cooperative multi-unmanned system
CN119620858A
Brainwave actuated apparatus
US9563273B2
