Sensor device, method, program, and system

Abstract

To make it easier to grasp the extent to which a specific periodic stimulus is given to a user.SOLUTION: A sensor device of an aspect of the present disclosure includes: means for detecting an external stimulus signal; means for extracting a target component whose intensity changes at a specific period, from the external stimulus signal; and means for generating an index regarding the amount of a specific external stimulus on the basis of the target component.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present disclosure relates to a sensor device, a method, a program, and a system. [Background technology]

[0002] There are research reports that suggest that exposing an organism to pulsating light or sound stimuli at a frequency of about 40 times per second and inducing gamma waves in the organism's brain can be effective in improving the organism's cognitive function (see Non-Patent Document 1). Gamma waves refer to neural oscillations that capture periodic neural activity in the brain's cortex using electrophysiological techniques such as electroencephalography and magnetoencephalography, and whose frequencies fall within the gamma band (25 to 140 Hz).

[0003] When attempting to improve cognitive function by optical or acoustic stimulation, it is desirable to know whether an appropriate amount of stimulation that leads to improvement of cognitive function is being given. Patent Document 1 discloses a method of measuring the neural response of a subject to stimulation using a neural vibration monitor. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2020-501853 [Non-patent literature]

[0005] [Non-Patent Document 1] Multi-sensory Gamma Stimulation Ameliorates Alzheimer's-Associated Pathology and Improves Cognition Cell 2019 Apr 4;177(2):256-271.e22. doi: 10.1016 / j.cell.2019.02.014. Summary of the Invention [Problem to be solved by the invention]

[0006] However, monitors that measure neural responses (such as electroencephalographs) are difficult to carry around and expensive, which places significant limitations on the environments in which measurements can be performed.

[0007] An object of the present disclosure is to make it easier to understand to what extent a specific periodic stimulus is being given to a user. [Means for solving the problem]

[0008] A sensor device according to one aspect of the present disclosure includes a means for detecting an external stimulus signal, a means for extracting a target component whose intensity changes at a specific period from the external stimulus signal, and a means for generating an index relating to the amount of the specific external stimulus based on the target component. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing a configuration of a sensor device according to an embodiment of the present invention; [Diagram 3] FIG. 2 is a block diagram showing a configuration of a light sensor unit according to the embodiment; [Figure 4] FIG. 2 is a block diagram showing a configuration of a sound sensor unit of the present embodiment. [Diagram 5] FIG. 2 is a block diagram showing a configuration of a host unit according to the present embodiment. [Figure 6] FIG. 2 is a block diagram showing a configuration of a gateway terminal according to the present embodiment. [Figure 7] FIG. 2 is a block diagram showing a configuration of a server according to the present embodiment. [Figure 8] FIG. 1 is an explanatory diagram of one aspect of the present embodiment. [Figure 9] 4 is a flowchart of a sensing process according to the present embodiment. [Figure 10] 13 is a flowchart of a result visualization process according to the present embodiment. [Figure 11]11A to 11C are diagrams illustrating examples of screens displayed in the information processing of the present embodiment. [Figure 12] FIG. 13 is a block diagram showing a configuration of an information processing system according to a first modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and the repeated description will be omitted.

[0011] (1) Information Processing System Configuration The configuration of the information processing system will be described below. Fig. 1 is a block diagram showing the configuration of the information processing system according to the present embodiment.

[0012] As shown in FIG. 1, the information processing system 1 includes a sensor device 10, a gateway terminal 50, and a server 70.

[0013] The sensor device 10 and the gateway terminal 50 are wirelessly connected by, for example, Bluetooth (registered trademark), LTE (registered trademark) (Long Term Evolution) or Wi-Fi (registered trademark). Alternatively, the sensor device 10 and the gateway terminal 50 may be wired connected by, for example, a Universal Serial Bus (USB).

[0014] The gateway terminal 50 and the server 70 are connected via a network (eg, the Internet or an intranet) NW.

[0015] The sensor device 10 is configured to measure at least one of the following physical quantities: temperature; The amount of light stimulation whose intensity changes at a specific period (hereafter referred to as the "amount of light stimulation") The amount of sound stimulation whose intensity changes at a specific period (hereafter referred to as the "amount of sound stimulation") As will be described later, the sensor device 10 may measure the amount of light stimulation taking into account the visual characteristics of humans, or may measure the amount of sound stimulation taking into account the auditory characteristics of humans.

[0016] The sensor device 10 is directly attached to the user's body (for example, near the eye or ear), is configured to be attachable to the user's accessories (for example, clothing, glasses, headphones, etc.), or is installed in the user's living environment (for example, a chair used by the user, etc.). The sensor device 10 measures a specific periodic stimulus given to the user that is related to the improvement of cognitive function.

[0017] Furthermore, the sensor device 10 may generate at least one of a light-related stimulation index, a sound-related stimulation index, or a comprehensive stimulation index based on the measurement results.

[0018] The gateway terminal 50 is an example of an information processing device or a display device. The gateway terminal 50 acquires a measurement result or a stimulation index from the sensor device 10, and transmits a request to the server 70. The gateway terminal 50 may be a dedicated terminal or may be a general-purpose terminal such as a smartphone, a tablet terminal, or a personal computer.

[0019] The server 70 is an example of an information processing device. The server 70 provides the gateway terminal 50 with a response in response to a request transmitted from the gateway terminal 50. The server 70 is, for example, a server computer.

[0020] (1-1) Sensor device configuration The configuration of the sensor device of this embodiment will be described below with reference to Fig. 2, which is a block diagram showing the configuration of the sensor device of this embodiment.

[0021] 2, the sensor device 10 includes an optical sensor unit 20, a sound sensor unit 30, and a host unit 40. When the sensor device 10 does not require a function for measuring the amount of optical stimulation, the optical sensor unit 20 can be omitted. On the other hand, when the sensor device 10 does not require a function for measuring the amount of sound stimulation, the sound sensor unit 30 can be omitted.

[0022] The optical sensor unit 20 and the host unit 40 may be connected by wire, for example, a universal asynchronous receiver / transmitter (UART), a serial peripheral interface (SPI), or an inter-integrated circuit (I2C). Alternatively, the optical sensor unit 20 and the host unit 40 may be connected wirelessly, for example, by Bluetooth or Wi-Fi.

[0023] Similarly, the sound sensor unit 30 and the host unit 40 may be connected by wire, for example, UART, SPI, or I2C. Alternatively, the sound sensor unit 30 and the host unit 40 may be connected wirelessly, for example, by Bluetooth or Wi-Fi.

[0024] The optical sensor unit 20 performs light-related measurements. The optical sensor unit 20 includes a detector such as a photodiode or an image sensor. As an example, the optical sensor unit 20 may be configured to have a sampling rate that is at least twice as high as a specific frequency (specifically, a frequency corresponding to gamma waves) and to measure the amount of light stimulation whose intensity changes at a period corresponding to the specific frequency. Optionally, the optical sensor unit 20 may be configured to measure the intensity of light over the entire measurable frequency band. The optical sensor unit 20 outputs the measurement result to the host unit 40.

[0025] The sound sensor unit 30 performs measurements related to sound. As an example, the sound sensor unit 30 may be configured to measure the amount of sound stimulation whose intensity changes with a period corresponding to a specific frequency (specifically, a frequency corresponding to gamma waves). Optionally, the sound sensor unit 30 may be configured to measure the intensity of sound across the entire measurable frequency band. The sound sensor unit 30 outputs the measurement result to the host unit 40.

[0026] The host unit 40 generates a stimulation index based on the measurement results by the light sensor unit 20 and the sound sensor unit 30. The host unit 40 outputs the stimulation index to the gateway terminal 50. The host unit 40 corresponds to a controller for the light sensor unit 20 and the sound sensor unit 30.

[0027] (1-1-1) Optical sensor configuration The configuration of the optical sensor unit of this embodiment will be described below with reference to Fig. 3, which is a block diagram showing the configuration of the optical sensor unit of this embodiment.

[0028] As shown in FIG. 3, the optical sensor unit 20 includes a light receiving unit 21, an amplifier unit 22, a filter 23, a rectifier / smoothing unit 24, an A / D converter 25, and a transmitter unit .

[0029] The light receiving unit 21 receives light coming from the outside world and generates an electrical signal (hereinafter referred to as a "light detection signal") corresponding to the intensity of the light. The light receiving unit 21 may be equipped with a relative luminous efficiency filter, and may generate an electrical signal corresponding to the result of adjusting (correcting) the intensity of light from the outside world for each frequency according to the visual characteristics of humans as the light detection signal. The light receiving unit 21 outputs the generated light detection signal to the amplifier 22.

[0030] The amplifier 22 receives the light detection signal from the light receiving unit 21. The amplifier 22 amplifies the light detection signal. The amplifier 22 outputs the amplified light detection signal (hereinafter, referred to as the “amplified signal”) to the filter 23.

[0031] Optionally, the amplifier 22 may output the amplified signal to a filter 23 and then to a rectifier / smoothing unit 24 .

[0032] The filter 23 receives the amplified signal from the amplifier 22. The filter 23 performs a filtering process to pass components of a specific frequency band of the amplified signal and block the remaining frequency components. The filter 23 outputs the result of the filtering process (hereinafter, referred to as a “first filtered signal”) to the rectifier / smoothing unit 24.

[0033] The rectification / smoothing unit 24 receives the first filtered signal from the filter 23. The rectification / smoothing unit 24 rectifies and smooths the first filtered signal. The rectification / smoothing unit 24 outputs the result of the rectification and smoothing (hereinafter referred to as the “analog light stimulus signal”) to the A / D conversion unit 25.

[0034] Optionally, the rectifier / smoothing unit 24 may receive an amplified signal from the amplifier unit 22. The rectifier / smoothing unit 24 may rectify and smooth the amplified signal. The rectifier / smoothing unit 24 may output the result of the rectification and smoothing (hereinafter referred to as an “analog total light amount signal”) to the A / D converter unit 25.

[0035] The A / D conversion unit 25 receives the analog light stimulus signal from the rectification and smoothing unit 24. The A / D conversion unit 25 performs analog / digital conversion on the analog light stimulus signal. The A / D conversion unit 25 outputs the result of the analog / digital conversion (hereinafter referred to as the “light stimulus signal”) to the transmission unit 26.

[0036] As an option, the A / D conversion unit 25 may receive an analog total light amount signal from the rectification and smoothing unit 24. The A / D conversion unit 25 may perform analog / digital conversion on the analog total light amount signal. The A / D conversion unit 25 may output the result of the analog / digital conversion (hereinafter referred to as a "digital total light amount signal") to the transmission unit 26.

[0037] The transmission unit 26 receives the light stimulus signal from the A / D conversion unit 25. The transmission unit 26 transmits the light stimulus signal to the host unit 40.

[0038] Optionally, the transmitting unit 26 may receive a digital total light amount signal from the A / D conversion unit 25. The transmitting unit 26 may transmit the digital total light amount signal to the host unit 40.

[0039] (1-1-2) Sound sensor configuration The configuration of the sound sensor unit of this embodiment will be described below. Fig. 4 is a block diagram showing the configuration of the sound sensor unit of this embodiment.

[0040] As shown in FIG. 4, the sound sensor unit 30 includes a microphone 31, an A-weighting filter 32, an HPF (High Pass Filter) 33, an envelope detection unit 34, a smoothing unit 35, a BPF (Band Pass Filter) 36, an A / D conversion unit 37, and a transmission unit 38.

[0041] The microphone 31 picks up a sound coming from the outside world and generates an electrical signal (hereinafter referred to as a “sound detection signal”) corresponding to the intensity (sound pressure) of the sound. The microphone 31 outputs the generated sound detection signal to the A-weighting filter 32.

[0042] The A-weighting filter 32 receives a sound detection signal from the microphone 31. The A-weighting filter 32 adjusts (corrects) the sound detection signal for each frequency in accordance with the human hearing characteristics. The A-weighting filter 32 outputs the adjustment result (hereinafter referred to as the “corrected sound detection signal”) to the HPF 33.

[0043] As an option, the A-weighting filter 32 may add the corrected sound detection signal to the HPF 33 and output it to the A / D conversion unit 37 .

[0044] The HPF 33 receives the corrected sound detection signal from the A-weighting filter 32. The HPF 33 performs a filtering process to pass frequency components of the corrected sound detection signal that are equal to or higher than the cutoff frequency and to block the remaining frequency components. The cutoff frequency of the HPF 33 is set higher than the specific frequency band. As an example, when the specific frequency band is approximately 40 Hz (e.g., 35 to 45 Hz), the cutoff frequency of the HPF 33 may be set to about 100 Hz. The HPF 33 outputs the result of the filtering process (hereinafter referred to as the "second filter signal") to the envelope detection unit 34.

[0045] The envelope detection unit 34 receives the second filtered signal from the HPF 33. The envelope detection unit 34 detects the envelope of the waveform of the second filtered signal. The envelope detection unit 34 outputs a signal representing the detected envelope (hereinafter, referred to as an “envelope signal”) to the smoothing unit 35.

[0046] The smoothing unit 35 receives the envelope signal from the envelope detection unit 34. The smoothing unit 35 smoothes the envelope signal. The smoothing unit 35 outputs the result of the smoothing (hereinafter, referred to as the “smoothed envelope signal”) to the BPF 36.

[0047] The BPF 36 receives the smoothed envelope signal from the smoothing unit 35. The BPF 36 performs a filtering process to pass components of a specific frequency band of the smoothed envelope signal and block the remaining frequency components. The BPF 36 outputs the result of the filtering process (hereinafter, referred to as an “analog sound stimulation signal”) to the A / D conversion unit 37.

[0048] The A / D conversion unit 37 receives the analog sound stimulation signal from the BPF 36. The A / D conversion unit 37 performs analog / digital conversion on the analog sound stimulation signal. The A / D conversion unit 37 outputs the result of the analog / digital conversion (hereinafter, referred to as the "sound stimulation signal") to the transmission unit 38.

[0049] Optionally, the A / D conversion unit 37 may receive the corrected sound detection signal from the A-weighting filter 32. The A / D conversion unit 25 may perform analog / digital conversion on the corrected sound detection signal. The A / D conversion unit 25 may perform rectification and smoothing of the signal before the analog / digital conversion. The A / D conversion unit 25 may output the result of the analog / digital conversion (hereinafter referred to as the "noise intensity signal") to the transmission unit 38.

[0050] The transmission unit 38 receives the sound stimulation signal from the A / D conversion unit 37. The transmission unit 38 transmits the sound stimulation signal to the host unit 40.

[0051] Optionally, the transmitting unit 38 may receive the noise intensity signal from the A / D conversion unit 37. The transmitting unit 38 may transmit the noise intensity signal to the host unit 40.

[0052] (1-1-3) Host section configuration The configuration of the host unit of this embodiment will be described below with reference to Fig. 5, which is a block diagram showing the configuration of the host unit of this embodiment.

[0053] As shown in FIG. 5, the host unit 40 includes a storage device 41, a processor 42, an input / output interface 43, and a communication interface 44.

[0054] The storage device 41 is configured to store programs and data. The storage device 41 is, for example, a combination of a Read Only Memory (ROM), a Random Access Memory (RAM), and a storage (for example, a flash memory or a hard disk).

[0055] The programs include, for example, the following programs: ·OS (Operating System) programs Applications that process information (e.g. web browsers)

[0056] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0057] The processor 42 is a computer that realizes the functions of the host unit 40 by starting a program stored in the storage device 41. The processor 42 is, for example, at least one of the following. ·CPU(Central Processing Unit) ·GPU(Graphic Processing Unit) ·ASIC(Application Specific Integrated Circuit) ·FPGA(Field Programmable Gate Array)

[0058] The input / output interface 43 is configured to acquire information (e.g., measurement results, user instructions) from an input device connected to the host unit 40, and to output information (e.g., images, sounds) to an output device connected to the host unit 40. The input device is, for example, the optical sensor unit 20, the sound sensor unit 30, a button, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display, a speaker, a lamp, or a combination thereof.

[0059] The communication interface 44 is configured to control communication between the host unit 40 and an external device (eg, the gateway terminal 50).

[0060] (1-2) Gateway terminal configuration The configuration of the gateway terminal of this embodiment will be described below with reference to Fig. 6, which is a block diagram showing the configuration of the gateway terminal of this embodiment.

[0061] 6, the gateway terminal 50 includes a storage device 51, a processor 52, an input / output interface 53, and a communication interface 54. The gateway terminal 50 is connected to a display 61.

[0062] The storage device 51 is configured to store programs and data, and is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).

[0063] The programs include, for example, the following programs: -OS programs Applications that process information (e.g. web browsers)

[0064] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0065] The processor 52 is a computer that realizes the functions of the gateway terminal 50 by starting a program stored in the storage device 51. The processor 52 is, for example, at least one of the following: ·CPU GPU ·ASIC FPGA

[0066] The input / output interface 53 is configured to obtain information (for example, a user's instruction) from an input device connected to the gateway terminal 50, and to output information (for example, an image) to an output device connected to the gateway terminal 50.

[0067] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display 61, a speaker, or a combination thereof.

[0068] The communication interface 54 is configured to control communication between the gateway terminal 50 and an external device (eg, the sensor device 10 or the server 70).

[0069] The display 61 is configured to display an image (still image or moving image). The display 61 is, for example, a liquid crystal display or an organic EL display.

[0070] (1-3) Server configuration The configuration of the server of this embodiment will be described below with reference to Fig. 7, which is a block diagram showing the configuration of the server of this embodiment.

[0071] As shown in FIG. 7, the server 70 includes a storage device 71, a processor 72, an input / output interface 73, and a communication interface 74.

[0072] The storage device 71 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage (for example, a flash memory or a hard disk).

[0073] The programs include, for example, the following programs: -OS programs Application programs that perform information processing

[0074] The data includes, for example, the following data: Databases referenced in information processing Results of information processing

[0075] The processor 72 is a computer that realizes the functions of the server 70 by starting a program stored in the storage device 71. The processor 72 is, for example, at least one of the following: ·CPU GPU ·ASIC FPGA

[0076] The input / output interface 73 is configured to obtain information (eg, a user's instruction) from an input device connected to the server 70, and to output information (eg, an image) to an output device connected to the server 70.

[0077] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0078] The communication interface 74 is configured to control communication between the server 70 and an external device (eg, the gateway terminal 50).

[0079] (2) One aspect of the embodiment An embodiment of the present invention will now be described with reference to Fig. 8, which is an explanatory diagram of an embodiment of the present invention.

[0080] As shown in Fig. 8, the sensor device 10 is worn on the body of a user US2. As an example, the sensor device 10 may be configured in the form of glasses or configured to be attachable to glasses or other accessories. The sensor device 10 receives light or sound emitted from a stimulus output device SO1 or other light source or sound source (which may include artificial light source or sound source or non-artificial light source or sound source).

[0081] The sensor device 10 extracts a component of the received light whose intensity changes in a cycle corresponding to a specific frequency (for example, a frequency corresponding to gamma waves, such as approximately 40 Hz). Based on the extraction result, the sensor device 10 generates an index (hereinafter referred to as an "optical stimulus index") that quantitatively represents the detection result of the specific optical stimulus received by the user US2. The specific optical stimulus refers to a visual stimulus whose intensity increases and decreases in a cycle corresponding to the specific frequency, in other words, an optical stimulus accompanied by an increase and decrease in brightness in a specific cycle.

[0082] Similarly, the sensor device 10 extracts a component whose intensity changes in a cycle corresponding to a specific frequency (for example, a frequency corresponding to gamma waves, such as approximately 40 Hz). Based on the extraction result, the sensor device 10 generates an index (hereinafter, referred to as a "sound stimulation index") that quantitatively represents the detection result of the specific sound stimulation received by the user US2. The specific sound stimulation refers to an auditory stimulation whose intensity increases and decreases in a cycle corresponding to the specific frequency, in other words, a sound stimulation accompanied by an increase and decrease in volume in a specific cycle.

[0083] This makes it possible to obtain an index that allows a quantitative understanding of a specific periodic stimulus (light stimulus, sound stimulus, or a combination thereof) received by the user US2.

[0084] Furthermore, the sensor device 10 may transmit the generated stimulation indicator (the light stimulation indicator, the sound stimulation indicator, or a combination thereof) to the gateway terminal 50.

[0085] The gateway terminal 50 may store the stimulation index received from the sensor device 10. The gateway terminal 50 may, as necessary, tally up the stimulation indexes and display on the display 61 a screen (hereinafter, referred to as a "performance confirmation screen") for confirming the performance of the stimulation indexes over a predetermined period (for example, one day) (an example of "information based on stimulation indexes").

[0086] This makes it possible to easily grasp to what extent a particular cycle of stimulation (light stimulation, sound stimulation, or a combination thereof) is being given to the user.

[0087] (3) Information processing The information processing of this embodiment will be described.

[0088] (3-1) Sensing process The sensing process of this embodiment will be described with reference to a flowchart of FIG 9.

[0089] The sensing process of the present embodiment may start, for example, when the sensor device 10 is powered on or when the sensing function of the sensor device 10 is enabled.

[0090] As shown in FIG. 9, the sensor device 10 detects an external stimulus signal (S110). Specifically, the sensor device 10 detects optical signals, sound signals, or a combination thereof from the outside world.

[0091] As a first example of detecting an external stimulus signal (S110), the optical sensor unit 20 (light receiving unit 21) generates a light detection signal according to the intensity of light arriving from the outside world. The light detection signal may be corrected by a relative luminous efficiency filter.

[0092] As a second example of detection of an external stimulus signal (S110), the sound sensor unit 30 (microphone 31) generates a sound detection signal in response to the intensity of a sound coming from the outside world.

[0093] After step S110, the sensor device 10 executes pre-processing (S111). Specifically, the sensor device 10 performs a predetermined pre-processing on the signal detected in step S110.

[0094] As a first example of the pre-processing (S111), the optical sensor section 20 (amplifier section 22) amplifies the optical detection signal generated in step S110 to obtain an amplified signal.

[0095] As a second example of pre-processing (S111), the sound sensor unit 30 (A-weighting filter 32) adjusts the sound detection signal generated in step S110 for each frequency according to the human hearing characteristics to obtain a corrected sound detection signal. The sound sensor unit 30 (HPF 33) performs high-pass filter processing on this corrected sound detection signal to obtain a second filtered signal. The sound sensor unit 30 (envelope detection unit 34) detects the envelope of the waveform of this second filtered signal to obtain an envelope signal. The sound sensor unit 30 (smoothing unit 35) smoothes this envelope signal to obtain a smoothed envelope signal.

[0096] After step S111, the sensor device 10 executes extraction of a specific component (S112). Specifically, the sensor device 10 extracts a specific frequency component from the preprocessed signal obtained in step S111.

[0097] As a first example of extraction of a specific component (S112), the optical sensor unit 20 (filter 23) performs bandpass filtering on the amplified signal obtained in step S111, with a specific frequency band (e.g., approximately 40 Hz) as the passband, to obtain a first filtered signal.

[0098] As a second example of extraction of a specific component (S112), the sound sensor unit 30 (BPF36) performs bandpass filtering on the smoothed envelope signal obtained in step S111, with a specific frequency band (e.g., approximately 40 Hz) as the passband, to obtain an analog sound stimulation signal.

[0099] After step S112, the sensor device 10 executes post-processing (S113). Specifically, the sensor device 10 performs a predetermined post-processing on the result of extraction of the specific frequency component in step S113.

[0100] As a first example of post-processing (S113), the optical sensor unit 20 (rectifier / smoother 24) rectifies and smoothes the first filtered signal obtained in step S112 to obtain an analog light stimulus signal. The optical sensor unit 20 (A / D converter 25) performs analog / digital conversion on this analog light stimulus signal to obtain a light stimulus signal. The optical sensor unit 20 (transmitter 26) transmits this light stimulus signal to the host unit 40.

[0101] As an option for the first example of post-processing (S113), the optical sensor unit 20 (rectifier / smoother 24) may rectify and smooth the amplified signal obtained in step S111 to obtain an analog total light amount signal. The optical sensor unit 20 (A / D converter 25) may perform analog / digital conversion on this analog total light amount signal to obtain a digital total light amount signal. The optical sensor unit 20 (transmitter 26) may transmit this digital total light amount signal to the host unit 40.

[0102] As a second example of the post-processing (S113), the sound sensor unit 30 (A / D conversion unit 37) performs analog / digital conversion on the analog sound stimulation signal obtained in step S112 to obtain a sound stimulation signal. The sound sensor unit 30 (transmission unit 38) transmits this sound stimulation signal to the host unit 40.

[0103] As an option for the second example of post-processing (S113), the sound sensor unit 30 (A / D conversion unit 37) may perform analog / digital conversion on the corrected sound detection signal obtained in step S111 to obtain a noise intensity signal. The sound sensor unit 30 (transmission unit 38) may transmit this noise intensity signal to the host unit 40.

[0104] After step S113, the sensor device 10 generates a stimulation index (S114). Specifically, the sensor device 10 generates a stimulation index based on the stimulation signal obtained in step S113.

[0105] As a first example of generating a stimulus index (S114), the host unit 40 generates a stimulus index by aggregating the light stimulus signals obtained in step S113 for each unit time (for example, every second or every minute). The host unit 40 may store the light stimulus index in the storage device 41 in association with the date and time.

[0106] As an option for the first example of generating a stimulus index (S114), the host unit 40 may generate a total light intensity index by aggregating the digital total light intensity signals obtained in step S113, for example, for each unit time (for example, every second or every minute, etc.). The host unit 40 may store the total light intensity index in the storage device 41 in association with the date and time. The total light intensity index quantitatively represents the detection result of a visual stimulus in a wider frequency band than the light stimulus index (i.e., a specific frequency band).

[0107] As a second example of generating a stimulation index (S114), the host unit 40 generates a sound stimulation index by aggregating the sound stimulation signals obtained in step S113, for example, for each unit time (for example, every second or every minute). The host unit 40 may store the sound stimulation index in the storage device 41 in association with the date and time.

[0108] As an option for the second example of generating the stimulus index (S114), the host unit 40 may generate a noise index by aggregating the noise intensity signal obtained in step S113, for example, for each unit time (for example, every second or every minute). The host unit 40 may store the noise index in the storage device 41 in association with the date and time. The noise index quantitatively represents the detection result of an auditory stimulus in a wider frequency band than the sound stimulus index (i.e., a specific frequency band).

[0109] After step S114, the sensor device 10 outputs a stimulation index (S115). Specifically, the sensor device 10 outputs (transmits) the stimulation index (including a light stimulation index, a sound stimulation index, or a combination thereof. The stimulation index may further include at least one of a total light intensity index or a noise index as an option) generated in step S114 to the gateway terminal 50. The gateway terminal 50 stores the received stimulation index. The gateway terminal 50 may also transmit the stimulation index to the server 70.

[0110] (3-2) Performance visualization processing The result visualization process of this embodiment will be described below with reference to Fig. 10, which is a flowchart of the result visualization process of this embodiment. Fig. 11 is a diagram showing an example of a screen displayed in the information processing of this embodiment.

[0111] The result visualization process of this embodiment can be started, for example, when a user issues an instruction to the gateway terminal 50 requesting the display of a result confirmation screen.

[0112] As shown in FIG. 10, the gateway terminal 50 executes identification of a target period (S150). Specifically, the gateway terminal 50 specifies a collection range of the stimulation results (hereinafter, referred to as a "target period") based on an instruction from the user. The target period may include, for example, any of the following. The day to which the current date and time belongs (i.e. today) or the day specified by the user, or each time that belongs to that day The week to which the current date and time belongs (i.e. this week) or the week specified by the user, or each day or time belonging to that week The month to which the current date and time belongs (i.e. this month) or the month specified by the user, or each week or day belonging to that month The year to which the current date and time belongs (i.e. this year) or the year specified by the user, or each month or week in that year - Each time period from the current date to the past day (24 hours) - Each day or hour from the current date and time to the past week - Each week or day in the past month from the current date and time - Each month or week in the past year from the current date and time

[0113] After step S150, the gateway terminal 50 executes acquisition of a stimulation index (S151). Specifically, the gateway terminal 50 acquires a stimulation index associated with the date and time belonging to the target period identified in step S150. The stimulation index may be acquired from the sensor device 10, from the storage device 51, or from the server 70.

[0114] After step S151, the gateway terminal 50 executes calculation of the stimulation result (S152). Specifically, the gateway terminal 50 calculates the results to be displayed (for example, the sum of stimulation indices belonging to a specific period (e.g., hour, day, week, month, year) (i.e., the cumulative time during which a specific light stimulation or a specific sound stimulation was received), the difference between the sum and a target value, or the ratio of the sum to the target value (degree of satisfaction), etc.) by aggregating the stimulation indices acquired in step S151. The gateway terminal 50 may also calculate the overall stimulation results by adding up the sum of the light stimulation indices and the sound stimulation indices.

[0115] After step S152, the gateway terminal 50 executes output of a performance confirmation screen (S153). Specifically, the gateway terminal 50 generates a result confirmation screen showing the stimulation result calculated in step S152, and displays it on the display 61. An example of the result confirmation screen is shown in FIG.

[0116] 11 includes objects J20 to J23. The objects J20 to J23 each display the stimulation results on a daily basis. The objects J20 to J23 are configured in a tab format, and can be selectively displayed or hidden in response to a user instruction.

[0117] Object J20 includes objects J20a, J20b, and J20c. The object J20a displays the overall stimulation performance. In the example of Fig. 11, the object J20a shows, in a pie chart, the sum of the light stimulation index and the sound stimulation index over the day to which the current date and time belongs (i.e., today) (overall performance), the sum of the light stimulation target value and the sound stimulation target value for that day (overall goal), and the ratio of the overall performance to the overall goal (satisfaction level).

[0118] 11, the object J20b displays the light stimulation performance by using a pie chart to show the total light stimulation index (light stimulation performance) for the day to which the current date and time belongs (i.e., today), the target value of the light stimulation for that day (light stimulation target), and the ratio of the light stimulation performance to the light stimulation target (satisfaction level).

[0119] Object J20c displays the sound stimulation results. In the example of Fig. 11, object J20c shows, in a pie chart, the sum of the sound stimulation indexes (sound stimulation results) for the day to which the current date and time belongs (i.e., today), the target value of the sound stimulation for that day (sound stimulation target), and the ratio of the sound stimulation results to the sound stimulation target (satisfaction level).

[0120] Although not shown in the screen of Fig. 11, at least one of the results of the total light index and the noise index may be included in the results confirmation screen. The results of the total light index allow the user to know what time and how much light the user was exposed to, and to evaluate the effect of the light on the circadian rhythm of the user. The results of the noise index allow the user to know whether the user has been listening to high volume for a long time, and to evaluate the risk of hearing loss of the user.

[0121] Although not shown in the screen of Fig. 11, in addition to the performance or satisfaction level for a predetermined period (e.g., daily), a cumulative score for a longer period (e.g., weekly, monthly, or yearly) may be included in the performance confirmation screen. Alternatively, the performance of the stimulation index in real time (for example, from the current time to a predetermined second or minute ago) may be included in the performance confirmation screen.

[0122] Furthermore, although not shown in the screen of Fig. 11, a comment based on the stimulation performance may be included in the performance confirmation screen. As a first example, when the degree of satisfaction is less than a threshold, a comment such as "try harder" that encourages the user to receive a specific light stimulus or a specific sound stimulus more positively may be included in the performance confirmation screen. As a second example, when the degree of satisfaction is equal to or greater than a threshold, a comment such as "enough" that inhibits the user from receiving a specific light stimulus or a specific sound stimulus excessively may be included in the performance confirmation screen.

[0123] (4) Summary As described above, the sensor device 10 of this embodiment detects an external stimulus signal, extracts a component (hereinafter referred to as a "target component") whose intensity changes at a specific cycle from the external stimulus signal, and generates a stimulus index related to the amount of a specific external stimulus based on the target component. This makes it possible to obtain an index that can quantitatively grasp a specific cycle of stimulus (for example, light stimulus, sound stimulus, or a combination thereof related to improving cognitive function) received by the user.

[0124] The stimulation index may represent the amount of visual and / or auditory stimulation that changes in intensity in a specific cycle, thereby providing an index that allows a user to quantitatively grasp the amount of visual and / or auditory stimulation that changes in intensity in a specific cycle that the user has received.

[0125] The external stimulus signal may be a sound detection signal obtained by collecting sound. The sensor device 10 may extract a high-frequency component from the external stimulus signal that is higher than a frequency threshold that is set higher than a frequency corresponding to a specific period, and detect an envelope of the waveform of the high-frequency component. After detecting the envelope, the sensor device 10 may extract the target component by performing a frequency filter process with a frequency band corresponding to the specific period as a pass band. This makes it possible to properly detect a modulated sound that is amplitude-modulated so that its intensity increases and decreases in a specific period without erroneously detecting a low-frequency sound such as a pure tone of 40 Hz.

[0126] The sensor device 10 may extract the target component using the filter 23, generate a first signal by rectifying an output signal of the filter 23, and generate a second signal by smoothing the first signal. The sensor device 10 may generate a stimulation index based on the second signal. This makes it possible to suppress the sampling rate required to generate the stimulation index. The external stimulus signal may be a light detection signal obtained by receiving light. After detecting the external stimulus signal, the sensor device 10 may extract the target component by performing frequency filtering with a frequency band corresponding to a specific period as a pass band. This allows appropriate detection of modulated light that is amplitude modulated so that its intensity increases and decreases in a specific period.

[0127] The sensor device 10 may correct the external stimulus signal based on the visual and / or auditory characteristics of humans, thereby making it possible to extract a target component that reflects the amount of stimulus that a person can sense according to the human perception characteristics.

[0128] The sensor device 10 may output the stimulation index (for example, to the gateway terminal 50 that displays information based on the index on the display 61). This allows an external device to present information based on the stimulation index to a user or use it for further information processing.

[0129] The sensor device 10 may generate a total light index or a noise index based on the external stimulus signal, which represents the amount of visual and / or auditory stimuli in a frequency band that is independent of a specific period, thereby providing useful information for the evaluation of a user's circadian rhythm or risk of hearing loss.

[0130] (5) Variations A modification of this embodiment will now be described.

[0131] (5-1) Variation 1 A description will be given of Modification 1. Modification 1 is an example in which a stimulation index is used to control a stimulation output device.

[0132] FIG. 12 is a block diagram showing a configuration of an information processing system according to the first modification.

[0133] As shown in FIG. 12, the information processing system 2 of the first modification includes a sensor device 10, a gateway terminal 50, a server 70, and a stimulus output device 80.

[0134] At least one of the gateway terminal 50 and the server 70 is connected to the stimulus output device 80 via a network NW. Alternatively, the gateway terminal 50 and the stimulus output device 80 may be wirelessly connected, for example, by Bluetooth or Wi-Fi. In any case, at least one of the gateway terminal 50 or the server 70 (hereinafter, for convenience, referred to as a "stimulus control device") generates a device input signal (control signal) based on the stimulation index and transmits the device input signal to the stimulus output device 80.

[0135] The stimulation output device 80 may include at least one of the following: -Display device equipped with a function to increase and decrease screen brightness at a cycle according to a specific frequency Speakers, earphones, or hearing aids that have a function to increase or decrease the output volume at a cycle corresponding to a specific frequency - Lighting equipment with a function that blinks the light at a cycle according to a specific frequency -Light-blocking windows or curtains that can change the intensity of outside light intake at a specific frequency

[0136] As a first example, the stimulus control device may generate a device input signal to the stimulus output device 80 to increase the amount of a particular light stimulus provided to the user (e.g., increase the duration or frequency with which the particular light stimulus is provided, or increase the intensity of the particular light stimulus) when the light stimulus indicator satisfies a first condition.

[0137] The first condition may be any of the following: The light stimulation performance for a specific period (for example, the day to which the current date and time belongs (i.e. today)) is below the threshold. - The shortfall in the actual light stimulation performance for a specific period from the target value is equal to or exceeds the threshold value. - The rate of increase in light stimulation performance over a specific period is below the threshold

[0138] As a second example, the stimulus control device may generate a device input signal to the stimulus output device 80 to reduce the amount of a particular light stimulus provided to the user (e.g., reduce the duration or frequency with which the particular light stimulus is provided, or reduce the intensity of the particular light stimulus) when the light stimulus indicator satisfies a second condition.

[0139] The second condition may be one of the following: The light stimulation performance for a specific period (for example, the day to which the current date and time belongs (i.e. today)) is above the threshold. - The shortfall in the actual light stimulation performance for a specific period against the target value is below the threshold - The rate of increase in light stimulation performance over a specific period is above a threshold

[0140] As a third example, the stimulus control device may generate a device input signal to the stimulus output device 80 to increase the amount of a particular sound stimulus provided to the user (e.g., increase the duration or frequency at which the particular sound stimulus is provided, or increase the intensity of the particular sound stimulus) when the sound stimulus indicator satisfies a third condition.

[0141] The third condition may be any of the following: - The sound stimulation record for a specific period (for example, the day to which the current date and time belongs (i.e. today)) is below the threshold. - The shortfall in the sound stimulation performance against the target value for a specific period is equal to or exceeds the threshold. - The rate of increase in sound stimulation performance over a specific period is below the threshold

[0142] As a fourth example, the stimulus control device may generate a device input signal to the stimulus output device 80 to reduce the amount of a particular sound stimulus provided to the user (e.g., reduce the duration or frequency with which the particular sound stimulus is provided, or reduce the intensity of the particular sound stimulus) when the sound stimulus indicator satisfies a fourth condition.

[0143] The fourth condition may be any of the following: - The number of sound stimulation records for a specific period (for example, the day to which the current date and time belongs (i.e. today)) is above a threshold - The shortfall in the sound stimulation performance for a specific period against the target value is below the threshold. - The rate of increase in sound stimulation performance over a specific period is above a threshold

[0144] As described above, the sensor device 10 of the first modified example outputs the stimulation index to a stimulation control device (an external device such as the gateway terminal 50 or the server 70 that controls the stimulation output device 80). This appropriately controls the amount of light stimulation or sound stimulation for the user, so that the light stimulation record or sound stimulation record can be prompted to achieve a target value and not to become excessive.

[0145] As a further modification, the sensor device 10, the gateway terminal 50, or the server 70 may receive the device input signal generated by the stimulus control device (which may include relaying to the stimulus output device 80). Then, the sensor device 10 may generate a stimulus index or a stimulus performance further based on the device input signal (which may include correction). This makes it possible to obtain a stimulus index or a stimulus performance that is close to the actual situation even in an environment in which the sensor device 10 cannot properly detect an external stimulus, such as when the user is not wearing the sensor device 10 or when the external stimulus from the stimulus output device 80 does not reach the sensor device 10.

[0146] As a further modification, the sensor device 10, the gateway terminal 50, or the server 70 may generate (and may include correction) a device input signal based on sensing data of the user's biomarkers or the analysis results thereof (particularly, the user's stress markers, or whether the user is asleep or awake, etc.). For example, the amount of a particular light or sound stimulus may be reduced in a situation where the user has little capacity to receive stimuli, such as when the user is under strong stress.

[0147] (5-2) Variation 2 The second modification is an example in which a notification is given based on a stimulation index or a stimulation record.

[0148] The gateway terminal 50 or the server 70 of the second modification transmits a notification based on the stimulation record to a notification target device. The notification target device may be the gateway terminal 50, another information processing device used by the user, or an information processing device used by a related person of the user.

[0149] A user's related party may be at least one of the following: · User's family The user's doctor Insurers (insurance companies) of insurance policies for which the user is an insured person - The administrator of the facility the user is using The company to which the user belongs (in particular, the company's management department)

[0150] The gateway terminal 50 or the server 70 may transmit a notification to the notification target device when, for example, any of the following conditions is met. A regularly scheduled notification time has arrived (for example, a specific time every day, or a specific time on a specific day of the week). - The fulfillment level is below the threshold - The number of consecutive days when the satisfaction level was below the threshold exceeded the threshold The frequency of days when the fulfillment level was below the threshold exceeded the threshold. - The degree of satisfaction is above the threshold - The number of consecutive days when the satisfaction level was above the threshold exceeded the threshold The frequency of days when the fulfillment level was equal to or greater than the threshold value exceeded the threshold value.

[0151] The notification may be the same as the information included in the achievement confirmation screen. Alternatively, the notification may include a message encouraging the relevant person to take action against the user. The action may be, for example, encouraging the user to receive a specific light stimulus or a specific sound stimulus more actively, or praising the user for appropriately receiving the specific light stimulus or the specific sound stimulus.

[0152] (5-3) Variation 3 The third modification is an example in which the sensor device 10 operates in a low power mode or stops operating under specific conditions.

[0153] The sensor device 10 of the third modification operates in a low power mode or stops operating when, for example, any of the following conditions related to the state of the user or the sensor device 10 is satisfied. The user is not wearing the sensor device 10. The user is asleep -Almost no external stimuli (for example, complete darkness or silence) - A user command was entered to switch to low power mode

[0154] Whether or not the user is wearing the sensor device 10 can be determined, for example, by comparing sensing data from an acceleration sensor or a gyro sensor with a reference, or based on the state of a switch that is turned on upon contact with the user's body.

[0155] Whether the user is asleep can be determined, for example, by comparing sensing data from a light sensor, an acceleration sensor, or a gyro sensor with a reference, based on sensing data of the user's biometric indicators, or based on data from other apps or devices that manage the user's sleep.

[0156] Whether or not there is almost no external stimulation can be determined by, for example, comparing sensing data from a noise sensor or an illuminance sensor, or the above-mentioned noise index or total light amount index, with a reference.

[0157] Here, operating in a low power mode may include any of the following operations. -Reduce the frequency of sensing processing Reduce the operating speed (e.g. clock speed) of at least one piece of hardware that performs the sensing process. Discard some of the data (stimulus index) obtained by the sensing process.

[0158] Stopping the operation means at least not performing the sensing process.

[0159] As described above, the sensor device of the third modification detects the situation of the user or the sensor device, and controls the operation so that power consumption is reduced when a specific condition is satisfied for the result of the detection of the situation. This makes it possible to save power consumption and extend the continuous operation time of the sensor device 10 in a situation where it is difficult to detect a specific light or sound stimulus or to properly measure the stimulus received by the user. In addition, it is possible to suppress the difference between the measurement result of the stimulus and the stimulus actually given to the user, which is caused by the sensor detecting a stimulus that the user cannot sense during sleep, etc.

[0160] (6) Other modifications The storage device 41 may be connected to the host unit 40 via a network NW. The storage device 51 may be connected to the gateway terminal 50 via the network NW. The display 61 may be integrated with the gateway terminal 50. The storage device 71 may be connected to the server 70 via the network NW.

[0161] Each step of the above information processing can be executed by any of the sensor device 10, the gateway terminal 50, and the server 70. For example, a process described as being executed by any device may be executed by another device, and a process described as being executed by the interaction of a plurality of devices may be executed by a single device. For example, the sensor device 10 and the gateway terminal 50 may be integrated. In addition, in the above description, an example is shown in which each step in each process is executed in a specific order, but the execution order of each step is not limited to the described example as long as there is no dependency.

[0162] In this embodiment, an example is shown in which a specific frequency component is extracted using an analog filter (i.e., the filter 23 and the BPF 36). However, it is also possible to extract a specific frequency component using a digital filter. In this case, the A / D conversion unit (i.e., the A / D conversion unit 25 and the A / D conversion unit 37) is placed before the digital filter. Furthermore, when a digital filter is used, digital signal processing (at least one of digital filter processing, post-processing, or calculation of a stimulation index) may be performed by the host unit 40 instead of the light sensor unit 20 or the sound sensor unit 30.

[0163] In the present embodiment, an example has been shown in which a performance confirmation screen is displayed on the display 61 of the gateway terminal 50. However, the sensor device 10 may be provided with an output device such as a display, and the sensor device 10 may present the stimulation index or the stimulation performance to the user via the output device (for example, display on a display).

[0164] The sensor device 10 may measure the modulation degree or depth of the amplitude modulation applied to a specific light stimulus or a specific sound stimulus, and add it as an element of the stimulation index. The sensor device 10 may also measure the color or brightness of the light constituting the specific light stimulus or the specific sound stimulus, or the pitch or volume of the sound, and add it as an element of the stimulation index. The sensor device 10 may generate the stimulation index (which may include correction) using other indices (e.g., acceleration, a user's bio-indicator (heart rate, blood pressure, brain wave, pulse wave, or activity level, etc.), a user's gaze). The other indices may be measured by the sensor device 10 or by another device (e.g., a wearable device).

[0165] The sensor device 10 may include various charging means. For example, the sensor device 10 may be configured to be capable of solar charging, vibration power generation, wireless charging, or the like. This allows the sensor device 10 to continue measurement without interruption.

[0166] In the above description, the frequency corresponding to gamma waves is mainly assumed to be 35 Hz or more and 45 Hz or less. However, the present invention is not limited to this, and any numerical range that affects the induction or synchronization of gamma waves in the brain of a listener can be assumed as the frequency corresponding to gamma waves. For example, the frequency corresponding to gamma waves may be assumed to be 25 Hz or more and 140 Hz or less. For example, the frequency may change over time, and a frequency less than 35 Hz or a frequency higher than 45 Hz may be temporarily allowed as the frequency.

[0167] Although the embodiment of the present invention has been described in detail above, the scope of the present invention is not limited to the above embodiment. Furthermore, the above embodiment can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above embodiment and the modified examples can be combined.

[0168] (7) Additional Notes The matters described in the embodiment and the modified examples are supplemented below.

[0169] (Appendix 1) A means for detecting an external stimulus signal (21, 31, S110); A means (23, 36, S112) for extracting a target component whose intensity changes at a specific period from an external stimulus signal; A means for generating an index relating to the amount of a specific external stimulus based on the target component (S114); A sensor device (10) comprising:

[0170] (Appendix 2) The indicator of the amount of specific external stimuli represents the amount of visual and / or auditory stimuli whose intensity changes in a specific period. 2. The sensor device of claim 1.

[0171] (Appendix 3) The external stimulus signal is a sound detection signal obtained by collecting sound, The means for extracting the target component is A means (33, S111) for extracting high-frequency components from the external stimulus signal, the high-frequency components being higher than a frequency threshold determined to be higher than a frequency corresponding to a specific period; A means for detecting an envelope of a waveform of a high frequency component (34, S111); and a means (36, S112) for extracting a target component by performing a frequency filter process using a frequency band corresponding to a specific period as a pass band after detecting the envelope. 3. The sensor device according to claim 1 or 2.

[0172] (Appendix 4) The external stimulus signal is a light detection signal obtained by receiving light, The means for extracting the target component is The apparatus further includes a means (23, S112) for extracting a target component by performing a frequency filter process using a frequency band corresponding to a specific period as a pass band after detecting an external stimulus signal. 2. The sensor device of claim 1.

[0173] (Appendix 5) The means for extracting the target component further includes a means for correcting the external stimulus signal based on human visual and / or auditory characteristics. 5. The sensor device according to claim 3 or 4.

[0174] (Appendix 6) The device further includes means for obtaining a device input signal for controlling the stimulation output by the stimulation output device; The means for generating the indicator generates the indicator further based on the device input signal. 6. The sensor device according to claim 1,

[0175] (Appendix 7) The method further includes a means for outputting an index (S115). 7. The sensor device according to claim 1,

[0176] (Appendix 8) The means for outputting the index outputs the index to a display device (50) that displays information based on the index on a display unit (61). 8. The sensor device of claim 7.

[0177] (Appendix 9) The means for outputting the indicator outputs the indicator to an external device that controls the stimulus output device (80). 9. The sensor device according to claim 7 or 8.

[0178] (Appendix 10) A means for detecting a state of a user or a sensor device; a means for controlling at least one of the means so as to reduce power consumption of the means when a specific condition is satisfied as a result of the detection of the situation; 10. The sensor device according to claim 1, further comprising:

[0179] (Appendix 11) The method further includes a means (S114) for generating another index representing the amount of visual and / or auditory stimulation of a frequency band independent of a specific period based on the external stimulation signal. 11. The sensor device according to claim 1.

[0180] (Appendix 12) Computer (40, 50, 70) A step (S112) of extracting a target component whose intensity changes at a specific period from the external stimulus signal detected by the sensor device; generating an index relating to the amount of a particular external stimulus based on the target component (S114); A method for performing.

[0181] (Appendix 13) Computer (40, 50, 70), A means for extracting a target component whose intensity changes at a specific period from an external stimulus signal detected by the sensor device (S112); A means for generating an index relating to the amount of a particular external stimulus based on the target component (S114). A program that functions as a

[0182] (Appendix 14) A system (1, 2) including a sensor device (10) and a display device (50), The sensor device is A means for detecting an external stimulus signal (21, 31, S110); A means (23, 36, S112) for extracting a target component whose intensity changes at a specific period from an external stimulus signal; A means for generating an index relating to the amount of a specific external stimulus based on the target component (S114); and a means (S115) for outputting the indicator to a display device; The display device includes a means (S153) for displaying information based on the indicators acquired from the sensor device. system. [Explanation of symbols]

[0183] 1: Information processing system 2: Information processing system 10: Sensor device 20: Optical sensor section 21: Light receiving part 22: Amplification section 23: Filter 24: Smoothing section 25: A / D conversion section 26: Transmission section 30: Sound sensor unit 31: Microphone 32: A-weighting filter 33:HPF 34: Envelope detector 35: Smoothing section 36 :BPF 37: A / D conversion section 38: Transmission section 40: Host section 41:Storage device 42: Processor 43: Input / Output Interface 44: Communication interface 50: Gateway terminal 51:Storage device 52: Processor 53: Input / Output Interface 54: Communication interface 61: Display 70: Server 71 :Storage device 72: Processor 73: Input / Output Interface 74: Communication interface 80: Stimulation output device

Claims

1. A means for detecting an external stimulus signal; A means for extracting a target component whose intensity changes at a specific period from the external stimulus signal; A means for generating an index relating to the amount of a specific external stimulus based on the target component; A sensor device comprising:

2. The index represents the amount of visual and / or auditory stimulation whose intensity changes in the specific period. The sensor device according to claim 1 .

3. The external stimulus signal is a sound detection signal obtained by collecting sound, The means for extracting the target component includes: a means for extracting, from the external stimulus signal, a high-frequency component having a frequency higher than a frequency threshold value that is set higher than a frequency corresponding to the specific period; means for detecting an envelope of the waveform of the high frequency component; and a means for extracting the target component by performing a frequency filter process using a frequency band corresponding to the specific period as a pass band after detecting the envelope. The sensor device according to claim 1 .

4. the external stimulus signal is a light detection signal obtained by receiving light, The means for extracting the target component includes: a means for extracting the target component by performing a frequency filter process using a frequency band corresponding to the specific period as a pass band after detecting the external stimulus signal, The sensor device according to claim 1 .

5. The means for extracting the target component further includes a means for correcting the external stimulus signal based on human visual or auditory characteristics. The sensor device according to claim 3 or 4.

6. The device further includes means for obtaining a device input signal for controlling the stimulation output by the stimulation output device; and generating the indicator based on the device input signal. The sensor device according to claim 1 .

7. The method further comprises: The sensor device according to claim 1 .

8. The means for outputting the index outputs the index to a display device that displays information based on the index on a display unit. The sensor device according to claim 7.

9. The means for outputting the indicator outputs the indicator to an external device that controls the stimulus output device. The sensor device according to claim 7.

10. A means for detecting a state of a user or the sensor device; a means for controlling at least one of the means so as to reduce power consumption of the at least one of the means when a specific condition is satisfied as a result of the detection of the situation; The sensor device of claim 1 further comprising:

11. The method further comprises: generating, based on the external stimulus signal, another index representing the amount of visual and / or auditory stimulation of the frequency band independent of the specific cycle; The sensor device according to claim 1 .

12. The computer A step of extracting a target component whose intensity changes at a specific period from an external stimulus signal detected by the sensor device; generating an index relating to the amount of a particular extraneous stimulus based on the component of interest; A method for performing.

13. Computer, A means for extracting a target component whose intensity changes at a specific period from an external stimulus signal detected by the sensor device; means for generating an index relating to the amount of a particular external stimulus based on said target component; A program that functions as a

14. A system including a sensor device and a display device, The sensor device includes: A means for detecting an external stimulus signal; A means for extracting a target component whose intensity changes at a specific period from the external stimulus signal; A means for generating an index relating to the amount of a specific external stimulus based on the target component; and means for outputting the indicator to the display device; The display device includes a means for displaying information based on the index acquired from the sensor device. system.

Images