Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for estimating perceptual semantic content by analysis of brain activity

A brain activity, activity detection technology, applied in semantic analysis, neural learning methods, sensors, etc., can solve problems such as coding model difficulties

Active Publication Date: 2017-12-01
NAT INST OF INFORMATION & COMM TECH
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Second, the best decoding model can be obtained directly from the encoding model, but it is far more difficult to obtain the encoding model from the decoding model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for estimating perceptual semantic content by analysis of brain activity
  • Method for estimating perceptual semantic content by analysis of brain activity
  • Method for estimating perceptual semantic content by analysis of brain activity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Figure 4 A configuration example of a device for applying the present invention is shown. In the display device 1, training stimuli (images, animations, etc.) are presented to the subject 2, and the brain activity of the subject 2 is detected by the brain activity detector 3 capable of detecting, for example, EEG (brain waves) and fMRI signals. Signal. As brain activity signals, the activation patterns of brain nerve cells, and signals of activity changes in single or multiple specific regions are detected. In addition, the detected brain activity signal is processed in the data processing device 4 . In addition, natural language comments from the subject 2 are input to the data processing device 4 . The semantic space used for data processing is obtained by analyzing the corpus data from the storage device 5 in the analysis device 6 and stored in the storage device 7 .

[0038] In addition, regarding training stimuli, the natural language annotation data from the ...

Embodiment 2

[0058] The topic model in LDA (Latent Dirichlet Allocation, Dirichlet Allocation) can be applied to the handling of annotations in the above-mentioned first embodiment. Therefore, it is easy to express as an article that infers perceptual semantic content from estimated brain activity. The procedures for this are as follows, for example.

[0059] (A) Regarding the stimulus 11 (image, animation, etc.) for training, a language description (annotation) 13 of the content of perception induced by the stimulus to the subject is acquired.

[0060] More specifically, some kind of still picture or animation (training data) is presented to the subject 12 as a training stimulus, and a list of language descriptions recalled by the subject who received the presentation is created.

[0061] (B) Using a large-scale database such as the corpus 16, construct a topic model describing the semantic relationship between words appearing in the language description. This topic model can be prepare...

Embodiment 3

[0073] figure 2The example shown is an example of inferring perceptual semantic content from brain activity in CM animation viewing. Specifically, the purpose is to reasonably respond to a question about how the viewer can induce a sense of "friendliness", for example. which means about figure 2 The suggested CM animation, the perceptual semantic content estimated from the brain activity through the procedures (a) to (e) above, the left column shows the example of the CM segment presented to the subject, and, in the right column, The perceptual semantic content estimated from the brain activity during viewing of the clip is shown. Each line next to the fragment shows the word with a high probability of being perceived by the test subject with respect to each part of speech of a noun, a verb, and an adjective in order from the top.

[0074] figure 2 (a): The scene where the daughter holds up the mobile phone to the mother for a conversation

[0075] (noun) male female s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for estimating perceptual semantic content by analysis of brain activity. Provided is an estimation method for measuring and analyzing brain activity to estimate a perceptual semantic content thereof. This method comprises: (1) inputting, to a data processing means, an output when a cranial nerve activity detection means detects an annotation of a perceptual content and brain activity induced in a subject by a training stimulation; (2) associating a sematic space representation of the training stimulation and the output of the cranial nerve activity detection means in a stored semantic space and storing the association in a training result information storage means; (3) inputting, to the data processing means, an output when the cranial nerve activity detection means detects brain activity induced by a novel stimulation, and obtaining a probability distribution in the semantic space which represents perceptual semantic contents for the output of the novel stimulation-induced brain activity by the cranial nerve activity detection means on the basis of the association; and (4) estimating a highly probable perceptual semantic content on the basis of the probability distribution. The association process may be performed for each subject. In the probability estimation process, the likelihood calculated on the basis of the coordinate of a given word in the semantic space and the probability distribution is used as an indicator.

Description

technical field [0001] The present invention relates to the estimation of the semantic content of perception perceived by the subject by measuring the brain activity of the subject under natural perception such as when watching animation, analyzing the measured information, and inferring the semantic content of perception through the analysis of brain activity method. Background technique [0002] A technology (brain information decoding technology) for estimating the content of perception and predicting behavior by analyzing the brain activity of the subject has been developed. These technologies are expected to be the elemental technologies of the brain-computer interface, and are also expected to be means for performing imaging, prior evaluation of various products, purchase prediction, and the like. [0003] The current semantic perception inference technology based on the above-mentioned brain activity estimation is not limited to the technology of inferring predetermi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): A61B5/0484A61B5/0476
CPCA61B5/7267A61B5/055A61B5/165G16H50/70A61B5/378G06F40/30G06N3/082A61B5/377G06F3/015
Inventor 西本伸志柏冈秀纪
Owner NAT INST OF INFORMATION & COMM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com