31 results about "Auditory sense" patented technology

The invention discloses an emotion analysis method and system based on multi-mode electroencephalogram eye movement fusion. An emotional induction stimulation sequence is alternately or synchronously displayed through a stimulation presentation module according to preset time sequences such as 5-second vision and 3-second auditory sense, a 64 conductive electrode cap (10-20 system layout, the sampling rate is larger than or equal to 1000 Hz) is triggered to collect electroencephalogram data of a prefrontal lobe, a temporal lobe and the like, and meanwhile eye movement data are obtained through an infrared pupil tracking technology (the sampling frequency is larger than or equal to 120 Hz). 0.5-70 Hz band-pass filtering and ICA artifact removal processing are carried out on the electroencephalogram data, smooth interpolation and Kalman filtering optimization are carried out on the eye movement data, and then electroencephalogram alpha / beta / gamma wave power spectrums, eye movement pupil change rates and other characteristics are extracted respectively. A Transform model based on an attention mechanism is adopted, deep fusion of electroencephalogram eye movement features is realized through feature embedding and multi-head self-attention calculation, and emotion recognition accuracy greater than or equal to 85% is achieved through confusion matrix optimization and five-fold cross validation in combination with an SVM or DNN classifier.

The invention provides an industrial robot self-adaptive grabbing method based on multi-modal sensing, which comprises the following steps of: 1, acquiring multi-modal data of an object and an environment through a multi-modal sensing module; the multi-mode sensing module comprises at least two sensing modules of a visual sensing unit, a touch sensing unit, a force sensing unit and an auditory sensing unit; 2, preprocessing and feature extraction are carried out on the multi-modal data, feature information of different modals is fused through a multi-modal fusion algorithm, and comprehensive object description information is generated; 3, generating an optimal grabbing strategy based on the comprehensive object description information; wherein the grabbing strategy comprises the position and posture of a grabbing point, a grabbing path and grabbing force; and fourthly, the industrial robot executes the optimal grabbing strategy, the first step to the third step are repeated, and the grabbing strategy is adjusted in a self-adaptive mode till grabbing is completed. Stable and efficient grabbing can be achieved.

The invention discloses a massage quantization glove based on multi-signal fusion and a real-time feedback control system thereof. The massage quantization glove comprises a glove body, a double-layer differential sensing unit, a perturbation excitation unit, a motion detection unit, a signal processing and fusion unit and a feedback interaction unit. The double-layer differential sensing unit is composed of an outer-layer pressure sensing film, an isolation elastic layer and an inner-layer pressure sensing film and is used for collecting overall contact force and differential response signals. The perturbation excitation unit applies low-amplitude disturbance in the massage process, so that soft tissue viscoelasticity characteristics are extracted; the motion detection unit collects hand motion information and performs inertia compensation; the signal processing and fusion unit is used for denoising and analyzing the multi-source signal to generate a dose index and a hardness grade; and the feedback interaction unit prompts an operator through visual sense, auditory sense or tactile sense. Real-time quantification and feedback of massage dosage are realized, tissue hardness change can be reflected, excessive massage is avoided, curative effect consistency is improved, and massage operation standardization is promoted.

The invention belongs to the technical field of medical instrument control, and particularly discloses a single-line digital audio output control system of high-frequency surgical equipment, which comprises the steps of constructing a multi-dimensional parameter fused state perception and semantic audio feedback mechanism, accurately identifying the working mode, the power level and the output stability of the equipment through auditory sense, and controlling the output of the high-frequency surgical equipment according to the state perception and semantic audio feedback mechanism. The operation burden and the misjudgment risk in a complex operation environment are effectively reduced; transmission of audio, data and a power supply is integrated by adopting a single-line digital audio bus, so that the internal structure and the electromagnetic compatibility of equipment are optimized fundamentally; by establishing a set of self-adaptive safety closed loop from communication quality monitoring to power and audio cooperative control, the health condition of a communication link can be actively monitored, and when it is detected that the communication quality is reduced, protective measures such as power reduction and safety alarm are automatically triggered, and the potential control failure risk is eliminated in the bud.

The utility model discloses a creative plush pendant with a sound box, which comprises a sound box body wrapped in a plush piece to form the creative and novel plush pendant, a user can touch the soft plush with fingers while enjoying music and relaxing, and the plush pendant is convenient to use. Various super-unwanted and cute cartoon patterns designed on the panel can be seen, three relaxation feelings of auditory sense, tactile sense and visual sense are brought to a user, the emotion is effectively soothed, the mood is stabilized, the user feels comfortable, depression is relieved, and very high emotion value is provided for the user; when going out, the clothes hanger can be hung on a bag and is convenient to carry.

The invention discloses a robot control method based on multi-modal perception and related equipment thereof, and belongs to the technical field of robots. According to the method, multi-modal sensing, hierarchical fusion processing, path planning and reinforcement learning decision collaborative mechanisms are introduced in the robot control process, so that the robot can realize more comprehensive and reliable environment cognition and autonomous control in a complex, dynamic and uncertain environment. Through carrying out synchronization and fusion processing on heterogeneous sensing information such as visual sense, auditory sense, tactile sense and force sense, richer environment information is obtained; through key feature extraction and evidence theory fusion, a relatively consistent environment state evaluation result can be formed when multi-source information has differences or conflicts. Planning a global optimal path through path planning in combination with environmental cost constraint, kinematics constraint and a risk assessment model; through continuous training and optimization of a motion control strategy, the control strategy can be adaptively updated according to operation data.

The embodiment of the invention discloses a speech enhancement method and device in magnetic resonance imaging and a magnetic resonance imaging system. The method comprises the following steps: acquiring a time domain sound signal in an MR scanning room in real time; converting the time domain sound signal into a frequency domain to obtain a frequency domain sound signal; inputting the frequency domain sound signal into a band-pass filter of which the filtering bandwidth is equal to the filtering bandwidth of human auditory sense, and inputting the frequency domain sound signal after band-pass filtering into a first artificial intelligence module for noise elimination to obtain a first frequency domain clean sound signal; and converting the frequency domain first clean sound signal from the frequency domain to the time domain to obtain a time domain clean sound signal. According to the embodiment of the invention, the voice quality of internal communication in MR imaging is improved.

The utility model belongs to the field of landscape devices, and particularly relates to an interactive landscape device based on five-sense experience, which comprises a base, two sides of the front side of the top of the base are fixedly connected with a rotating frame and a fixed box respectively, and the top of the fixed box is fixedly connected with a control seat. A touch screen and a control key are fixedly connected to the two sides of the front surface of the control seat correspondingly, and three aromatherapy boxes are fixedly connected to the bottom of an inner cavity of the fixed box from left to right in sequence; through the display screen, a user can conveniently know the landscape through vision, through a model installed on the limiting sleeve, the user can conveniently know the landscape through touch, through aromatherapy stored in the aromatherapy box, the user can conveniently know the landscape through smell, and through the loudspeaker, sound can be played, so that the user can conveniently know the landscape through auditory sense; the special food is stored in the food placing box, so that a user can conveniently know the landscape through the taste sense, and people can more comprehensively know the scenic spot condition through five senses by adopting multiple modes.

The invention relates to the field of man-machine interaction, in particular to a method for enhancing user space perception in augmented reality virtual pet interaction, which comprises the following steps executed in sequence: S1, constructing a space reference; s2, the multi-mode perception feedback stage comprises intelligent scheduling of auditory sense and tactile sense of the virtual pet; s3, the virtual pet behavior parameter control stage comprises the following steps: S31, taking the bearing plane as a motion constraint area of a virtual pet, performing reachability judgment on a target position, and when the target position exceeds the motion constraint area or falls into an unreachable area, executing the step S3; limiting the target position in the motion constraint area or projecting the target position to a nearest reachable point of a boundary; s32, when the walking speed, running speed, acceleration or single-frame displacement of the virtual pet reaches a preset upper limit, judging that the virtual pet is abnormal, and performing abnormality processing; intelligent scheduling is carried out in auditory sense and tactile sense, and the consistency of multi-mode feedback and visual sense in time sequence is ensured.

The invention discloses a tunnel traffic accident emergency escape unmanned aerial vehicle cooperative guidance system and method, and belongs to the technical field of tunnel safety emergency. The system comprises an unmanned aerial vehicle nest unit which is internally provided with an ejection mechanism and accommodates a plurality of foldable unmanned aerial vehicles, a guiding unmanned aerial vehicle which carries an SLAM navigator, a thermal imager, a projection lamp and an emergency material putting device, and a communication relay unmanned aerial vehicle which constructs a Mesh + optical communication redundant link. According to the control method, path planning is dynamically optimized based on a reinforcement learning algorithm, and visual sense-tactile sense-auditory sense multichannel guidance is realized in combination with UWB positioning and the adaptive projection lamp. According to the invention, the sensing precision of the complex environment is improved through multi-sensor fusion positioning, the communication delay is reduced through cooperation of the dual-frequency Mesh network and optical communication, the evacuation efficiency is improved through interaction of dynamic projection and the AR terminal, the problems of real-time positioning, communication coverage and accurate guidance in a tunnel fire scene are effectively solved, and the success rate of emergency rescue is remarkably improved.

The application discloses a small infant neural development state analysis method and system, and belongs to the technical field of computer vision, and comprises the following steps: S1, data collection preparation; S2, whole body active motion data collection; S3, local evoked motion data collection; S4, multi-motion feature extraction and fusion decision-making. On the basis of whole body spontaneous motion data collection and analysis, the application adds local motion data collection and analysis induced by visual and auditory senses, obtains multi-modal behavioral characteristics, and improves clinical classification accuracy through late fusion decision-making of modal characteristics.

The invention discloses an audio-visual integrated sensing system, and the system comprises a sensing module which responds to an excitation signal so as to emit a detection sound wave signal, and is used for receiving a reflection sound wave signal and a sound source sound wave signal at the same time; the signal processing module is connected with the sensing module and comprises a first filter circuit and a second filter circuit, the first filter circuit is used for extracting imaging sound wave signals in the reflected sound wave signals and the sound source sound wave signals, and the second filter circuit is used for extracting positioning sound wave signals in the reflected sound wave signals and the sound source sound wave signals; and the data processing module is used for acquiring environment structure information based on the imaging sound wave signal, acquiring sound source position information based on the positioning sound wave signal, fusing the environment structure information and the sound source position information and outputting a target three-dimensional image. According to the invention, a single sensing system is used for replacing a visual sensing system and an auditory sensing system which are separated from each other, and the system has a dual sensing function of generating an environment structure and a dynamic sound source in a three-dimensional space.

The invention discloses an interactive English word spelling training device and training method, and belongs to the technical field of English learning tools, the interactive English word spelling training device comprises a display screen located in the middle of a body and divided into an upper area for displaying Chinese and a lower area for displaying English words, and the lower area comprises a plurality of target letter areas; each target letter area is used for displaying a letter, the letter slideway mechanisms are symmetrically arranged on the left side and the right side of the display screen, each letter slideway mechanism comprises 13 independent letter slideways which are arranged side by side, and a tail end testing area is arranged on one side, close to the display screen, of each letter slideway; when it is judged that the combined word is consistent with the target word, the control module prompts correctly, and if incorrect, the prompt is wrong. According to the invention, the entity letter blocks are slid, through multi-channel stimulation of tactile sense, visual sense and auditory sense, the memory depth of a learner on the composition and sequence of word letters can be effectively deepened, and the interestingness is increased.

The utility model relates to the technical field of generator air cooling systems, and provides a cross-core type columnar CT plugging device which comprises a threading pipe, a lock catch assembly and a plugging mechanism. By arranging the insulating plates and sleeving the two insulating plates on the outer side of the through core of the straight-through type columnar current transformer, holes are effectively blocked, the air leakage hidden danger of an air cooling system of a generator is eliminated, the cooling efficiency of the generator is improved, the service life of equipment is prolonged, and after the air leakage problem is eliminated, noise and vibration in a main open chamber of the generator can be remarkably reduced; damage to auditory sense of personnel is reduced, interference signal transmission is avoided, loosening and abrasion of electrical fastening parts are prevented, operation hidden dangers are reduced, meanwhile, sand grains entering the air cooling air chamber are reduced, and the surfaces of generator fan blades and stator windings are prevented from being impacted and damaged by the sand grains. The epoxy resin insulating plate has good insulating performance and mechanical strength, and the service life of the generator is prolonged. And meanwhile, the epoxy resin insulating plate is short in customization period and simple and convenient in process.

The invention relates to the field of intelligent medical treatment, in particular to a cloud side-end collaborative diabetes intelligent medicine box management system and a compliance optimization method, and the system comprises a terminal sensing layer, an edge cognitive layer and a cloud intelligent layer. The terminal sensing layer acquires data through an environment self-adaptive multi-dimensional sensor module and has a temperature and humidity compensation function; the edge cognitive layer generates a medication time window adjustment instruction and a medication reminding strategy based on a multi-dimensional health state model, and is provided with an offline emergency system; the cloud intelligent layer is responsible for data encryption storage and analysis processing; the multi-mode man-machine interaction module sends prompts through visual sense, auditory sense and tactile sense according to the medication prompting strategy; according to the method, high-precision identification and dosage monitoring of the medicine are realized, the problem of false compliance is solved, and the medication effect is improved by dynamically optimizing the medication time window.

According to the rotator cuff injury rehabilitation training system and method, Kinect equipment is used for achieving high-precision motion capture, and the accuracy of motion data is ensured. Real-time action comparison and feedback are achieved through a Unity platform, and a patient is helped to correct wrong actions in time. According to the rehabilitation progress of the patient, the training difficulty and the standard action are dynamically adjusted, and a personalized rehabilitation scheme is provided. And various feedback modes such as visual sense and auditory sense are combined, so that the intuition and effectiveness of feedback are improved.

The invention discloses a material detection image defect enhancement method based on multi-light source complementation, and the method comprises the steps: collecting recognition parameters, carrying out the processing of a ternary mapping model, and outputting a noise feature prediction value and a multi-light source initial parameter; optimizing the initial parameters of the multiple light sources to obtain optimized parameters, then adjusting the multiple light sources, and collecting a noise-containing image of the to-be-detected material through a detection camera; inputting the noise feature predicted value, the optimization parameter and the noise-containing image into a preset conditional GAN anti-noise model with light source constraint, and generating a defect enhanced image; and when the parameter optimization criterion is not met, the optimization parameters are adjusted, the steps are repeated after a new noise-containing image is collected, a defect enhancement image is output until the parameter optimization criterion is met, and the defect enhancement image with obvious and accurate characteristics is generated by coordinating multi-light-source parameter adjustment and introducing a condition GAN. By introducing an artificial intelligence function library and computer visual and auditory sense to carry out model training reinforcement, the accuracy of subsequent defect identification can be greatly improved.

The utility model discloses / relates to a digital barrier-free motion composition and decomposition demonstrator. The technical scheme has the following key points: 1, a motor is used for transmission, and a 3D printing pen enables a motion synthesis and decomposition track to be visualized and touchable, so that students can conveniently perceive and understand the motion track and direction, establish a motion synthesis and decomposition concept and qualitatively explore; 2, a digital display speed regulator is used for speed regulation, a sensor and screen reading software are used for measuring a resultant displacement inclination angle, and quantitative exploration is performed; the main purpose of the utility model is as follows: 1, the defects that the phenomenon is not visual enough, the angle cannot be identified and the quantitative exploration cannot be performed in the demonstration experiment of the third section of wax block in the second and fifth chapters are overcome; 2, vision and defect compensation are replaced by tactile sense and auditory sense, so that the problems that blind people cannot perceive motion synthesis decomposition experiment phenomena and object motion trails and cannot measure resultant displacement inclination angles are solved; 3, visual experiment teaching, qualitative and quantitative combination, barrier-free digital experiment and meaningful learning are realized.

Provided is a driver assistance system or the like that makes it possible to assist a driver in taking a driving behavior more effectively by stimulating the auditory sense of the driver without executing complicated processing. A management server 20 repeatedly executes a behavior data acquisition process including acquiring behavior data of the driver based on a sound effect and a sound effect output control process including outputting the sound effect into the vehicle 1 while changing an output condition for outputting the sound effect into the vehicle 1. When the result of these processes satisfies a setting condition set in advance, the management server 20 executes an identification process including identifying the output condition corresponding to the result as an optimal output condition.

The present application provides an audio previewing method, an apparatus and a storage medium. The method plays, on a target audio file set interface, an audio preview clip of at least one audio file in a target audio file set in response to a previewing request of previewing the target audio file set without entering a target audio file set detailed interface, so that a user can quickly preview the target audio file set through auditory sense, and the user can preview the at least one audio file in the target audio file set at a time, which is simple in operation. In addition, embodiments of the present application further display, on the target audio file set interface, information of an audio file corresponding to the audio preview clip that is currently played during previewing, such as name and / or singer.

The invention discloses a blind child orientation perception multi-sensory VR training system and method, and relates to the crossing field of auxiliary technologies and human-computer interaction. The blind child orientation perception multi-sensory VR training system comprises a walking blanket, a VR training module and a VR training module, wherein the surface of the walking blanket is provided with pressure feedback modules which are arranged in a cross-shaped array; the surface of the circuit board is provided with telescopic convex blocks arranged in a rectangular array, and the combination of the lifting states of the telescopic convex blocks forms a tactile path; detection modules arranged in a rectangular array are arranged on the surface of the sensing plate, a vibration module is integrated in each detection module, and the sensing plate further comprises a plurality of markers representing real scene elements; the marker is magnetically attracted to any detection module and is identified by the detection module which is magnetically attracted and matched with the detection module; and the processing control unit is in communication connection with the walking blanket, the route board and the sensing board. The method has the advantages that through dynamic fusion of touch (bump path + vibration feedback) + auditory sense + motion sense (walking input), the defect of sensory splitting existing in traditional VR training is overcome, and the spatial cognition integrity of blind children is improved.

The invention discloses a multi-modal feedback-based anti-falling VR training system and method for the aged with osteoporosis, and relates to the technical field of VR virtual reality. The system comprises a safe VR training scene library, a multi-modal biomechanics and cognitive state real-time monitoring network, an immersive multi-modal real-time feedback mechanism and a self-adaptive difficulty adjustment module based on user performance. The safety type VR training scene library simulates daily falling risk scenes of old people, the multi-mode biomechanics and cognitive state real-time monitoring network collects and analyzes data such as motion balance of a user through hardware and software, and an immersive multi-mode real-time feedback mechanism guides the user to perform multi-aspect training from visual sense, auditory sense and tactile sense. According to the invention, customized training can be provided for the user in a safe environment, and the anti-tumble ability of the elderly can be improved while the training enthusiasm of the elderly user is improved, so that the risk that the elderly is injured due to tumble is reduced.

The invention relates to the field of artificial intelligence education, and discloses a question generation method based on artificial intelligence and an intelligent system.The method is used for the intelligent system, interaction between the intelligent system and a user is achieved through questions.The method comprises the steps that S1, the front-end language gradient level of the user is obtained through the intelligent system; s2, extracting visual, dynamic and auditory questions from the original question gradient set based on the front-end language gradient level; s3, adjusting the question state in the original question gradient set according to the response of the user to the visual, dynamic and auditory questions; and S4, reproducing visual, dynamic and auditory questions through the intelligent system according to the rule of the forgetting curve. Existing AI language learning software has technical bottlenecks, for example, the feedback learning process of overseas users is relatively flat, and the language level is difficult to make significant progress in a short time; according to the method, comprehensive enhancement of vision, kinesthetic sense and auditory sense can be realized through visual, dynamic and auditory topics, so that the time required by a user for learning a new language is remarkably shortened.

The utility model discloses a cage box special for a behavioral mouse, and relates to the technical field of mouse behavioral research. The mouse cage box special for behavioral research comprises a cage box body with the top capable of being opened and closed, and a partition plate which is detachably connected with the cage box body and divides the inner cavity of the cage box body into two mouse activity areas is arranged in the inner cavity of the cage box body. One or more interaction holes for interaction of mice are formed in the partition plate, and a multifunctional isolation plate detachably connected with the partition plate is arranged in the partition plate; a feeding trough matched with the mouse activity area is further arranged in the inner cavity of the cage box, and a water drinking mechanism matched with the mouse activity area is further arranged at one end of the cage box; the top of the cage box is further provided with an air supply nozzle and an exhaust nozzle which are communicated with an inner cavity of the cage box. The partition plate is arranged in the inner cavity of the cage box to divide the inner cavity of the cage box into the two mouse activity areas, meanwhile, the interaction hole for mouse interaction is formed in the partition plate, and the multifunctional partition plate can seal the interaction hole so as to isolate visual sense and / or auditory sense and / or tactile sense of the mouse. Therefore, the behavioristics of the mouse after partial sense organs are isolated can be observed.

We provide the system. [Solution] A means for receiving data acquired from multiple moving objects in real time and performing analysis to detect anomalies, Means for transmitting the analyzed anomaly data to a device for conveying it to the visual and auditory senses of the front-end user, A means for sharing detected anomaly patterns among intelligent devices mounted on multiple mobile vehicles and for autonomous learning, A system that includes this.

The invention discloses a digital sound watermark processing method and device based on echo hiding and electronic equipment, and relates to the technical field of digital watermarking. According to the core scheme of the digital sound watermark processing method based on echo hiding, a first audio signal is segmented through duration, then the energy of each segment is calculated, watermarks are embedded into the segments with high energy through an echo hiding method, and watermarks are not embedded into the segments with low energy. In this way, the shielding effect of human auditory sense is utilized, that is, the strong signal can cover the adjacent weak signal, so that the imperceptibility after the watermark is embedded is improved while the robustness of the watermark is ensured, that is, the relatively high audio subjective quality is kept. Meanwhile, an effective way is provided for controlling the embedding capacity of the watermark.

The invention discloses a head-mounted display-based high-terrorism psychological baseline assessment method for electric power high-altitude operation personnel, which comprises the following steps of: presenting a virtual reality high-altitude operation scene to a subject through a head-mounted display to induce a high-terrorism reaction, and synchronously acquiring an electroencephalogram signal and subjective psychological assessment data; the collected original electroencephalogram signals are preprocessed, wherein the preprocessing comprises detrending, band-pass filtering, artifact removal and frequency band division processing; and correspondingly storing the preprocessed electroencephalogram data, the subjective psychological assessment scale score of the subject and the basic information. By collecting and analyzing objective physiological signals such as electroencephalogram and combining screened core features, the deviation of traditional subjective questionnaire evaluation is overcome, quantitative evaluation of the height fear psychological state is achieved, the special aerial work scene of the power industry is highly restored through the VR technology, multi-sensory simulation (visual sense, auditory sense and tactile sense) is integrated, and the high-altitude-fear psychological state evaluation method is suitable for high-altitude-fear psychological state evaluation and high-altitude-fear psychological state evaluation. The real height fear response can be induced more effectively and safely, and the ecological effectiveness of evaluation is improved.

A memory consolidation controller includes: an acquisition unit configured to acquire brain activity information indicating a state of brain activity of a subject; a determination unit configured to determine a sleep level indicating a depth of sleep of the subject and determine an activity state in a predetermined region of the subject's brain based on the acquired brain activity information; and a reproduction control unit configured to cause a reproduction device to reproduce a content that stimulates an auditory sense of the subject based on a determination result of the determination unit.

The invention relates to the technical field of medical instruments, in particular to an insulin pen with a voice broadcast function, a dose detection sensor is used for accurately identifying and counting changes of dose units, and a microcontroller is used for receiving and processing dose change signals transmitted by the dose detection sensor. The voice synthesizing and playing unit is used for storing preset voice segments, a microphone is installed on one side of the pen body, voice information synthesized by the voice synthesizing and playing unit is played through the microphone, the power source is used for supplying power to the electronic module, and the user operation unit comprises a playing key, a volume adjusting button and an on-off key. The insulin pen aims to overcome the defect that an existing insulin pen depends on auditory sense to identify weak click sound and visually check scales, clear and loud voice broadcast is used for replacing the weak click sound to serve as a main dose feedback mode, the reliability and identifiability of auditory feedback are remarkably improved, and the insulin pen is particularly beneficial to elderly users with hearing loss.

The utility model discloses a combined sound system, which comprises a first audio playing unit and a second audio playing unit, and sound waves emitted by the first audio playing unit are medium-high frequency sound waves processed by high-pass filtering; the sound waves emitted by the second audio playing unit are low-frequency sound waves after low-pass filtering processing. Through the design, an audio signal emitted by sound source equipment can be received by the two playing units and is accurately divided into two frequency bands by the two playing units, and the two frequency bands are respectively processed and played by the different playing units, so that the first audio playing unit is only used for replaying middle and high pitches; the second audio playing unit is only used for playing bass, and the first audio playing unit and the second audio playing unit are fused into a complete sound in auditory sense, so that an audience can obtain a complete audio signal, a three-dimensional surround sound effect can be realized, bass performance can be considered, and the audience is ensured to have relatively good sound playback experience.