103 results about "Auditory feedback" patented technology

The invention discloses an interactive virtual reality generation method, and belongs to the technical field of virtual reality, and the method comprises the steps: collecting the spatial position and motion data of a user through a pose sensor and a somatosensory sensor, carrying out the three-dimensional point cloud reconstruction and interaction plane parameter extraction through an edge calculation processor, and calling a matched virtual object model to generate an initial scene. A dynamic prediction model is loaded to predict influence parameters of user actions on a scene, scene evolution is calculated in real time in combination with a digital twin engine, and a result is transmitted to a multi-mode feedback module to generate visual, tactile and auditory feedback instructions. And the scene dynamic adjustment module is triggered to adjust the physical attribute parameters by monitoring the bio-electricity signal in real time. According to the method, geometric constraint consistency and semantic reasonable matching of a virtual scene and a real environment are realized through multi-source sensor data fusion and edge calculation, user actions are dynamically responded by combining space-time prediction and a digital twinning technology, scene physical attributes are adaptively adjusted on the basis of bio-electricity signals, and multi-modal feedback cooperation is assisted, so that the user experience is improved. And the reality, immersion and user comfort of virtual reality interaction are obviously improved.

The invention discloses a self-adaptive adjustment nerve electrophysiology monitoring device for an orthopedic tumor operation, and belongs to the technical field of medical equipment. The system comprises a signal acquisition module, a signal feature extraction module, a self-adaptive adjustment control module and an intraoperative feedback early warning module, the signal feature extraction module carries out multi-angle feature extraction on neural signals and accurately identifies changes of neural states in a complex signal environment, and the self-adaptive adjustment control module dynamically adjusts monitoring and stimulation strategies according to changes of real-time neural signals in an operation, compares pre-operation baseline signals with the real-time signals in the operation, and determines whether the neural states are changed or not according to the pre-operation baseline signals and the real-time signals in the operation. The change trend of the nerve state is accurately judged, whether the nerve signal is in the normal physiological fluctuation range or not is evaluated, the intra-operation feedback early warning module converts the nerve signal into visual and auditory feedback, the perception ability of an operator to the nerve state is improved, the nerve injury risk is dynamically evaluated, and the operation safety is improved. And according to the risk level, different levels of early warning mechanisms are triggered, and an operator is suggested to adjust an operation strategy.

The invention provides a rehabilitation training data mining system and method based on deep reinforcement learning, and the system comprises an intelligent cognition and parameter mining module which is provided with a deep reinforcement learning rehabilitation training model and a rehabilitation database, and the rehabilitation database is used for training the deep reinforcement learning rehabilitation training model; the evaluation and analysis module is used for evaluating and analyzing various physiological data collected by the patient in the rehabilitation training period to obtain initial training parameters; inputting the initial training parameters into the trained deep reinforcement learning rehabilitation training model to obtain optimal rehabilitation training parameters; the man-machine interaction module is provided with a control module, the control module receives the optimal rehabilitation training parameters and generates control signals to the visual and auditory feedback module and the rehabilitation training module, and the intelligent rehabilitation training system aims at improving the rehabilitation training effect and personal experience through intelligent means.

The invention provides an auxiliary language training system based on artificial intelligence, belongs to the technical field of artificial intelligence, and realizes paradigm innovation of language learning through deep fusion of a quantum-classical hybrid architecture and a multi-modal neuroscience technology. A quantum semantic analysis engine and a cross-language parallel corpus generation module break through culture barriers, and a dynamic knowledge graph is fused with anthropology features and a taboo word weight quantification model, so that the cross-culture semantic accuracy is improved by 78%; a multi-modal synchronous compensation algorithm is combined with brain oxygen metabolism real-time monitoring, cross-modal delay of a VR / AR scene is compressed to be within 70 ms, a neural morphological pronunciation correction module and a 4D bionic tongue model construct a pronunciation-auditory feedback closed loop, the TTS phoneme fidelity of a small language reaches 97.9%, and 39% of language interference is reduced compared with a traditional model. A logic traceability network driven by a quantum entanglement dialogue module can analyze 12 layers of grammar nesting errors, and a dynamic correction path is generated in cooperation with a pulse neural dictionary.

The invention provides an AI-powered speech, language therapy, and language learning system that utilizes Natural Language Processing (NLP), Convolutional Neural Networks (CNNs), and Generative Adversarial Networks (GANs) to deliver personalized, real-time therapy and learning for individuals with speech disorders or those seeking to improve language proficiency. The system analyzes user speech, language comprehension, and facial expressions, providing immediate feedback on pronunciation, fluency, articulation, and sentence structure. A GAN-generated avatar interacts with the user, mimicking human expressions and offering dynamic, engaging sessions. The platform adapts exercises based on user performance using personalized algorithms to ensure continuous progress. Additionally, it securely stores user data in compliance with privacy regulations, making it accessible through web and mobile platforms. This invention improves upon existing speech therapy and language learning solutions by integrating real-time visual and auditory feedback with AI-driven personalization, offering a more immersive and effective experience.

The invention relates to the technical field of data processing, and discloses a gait training method and system based on virtual reality. The method comprises the following steps: acquiring gait motion data in real time through a plurality of inertial measurement sensors, and fusing the gait motion data with whole body depth image data acquired by a depth camera to form a gait feature vector; and a gait analysis model constructed by using a convolutional neural network and a long-short-term memory network is used for recognizing gait parameter abnormity in real time and generating an evaluation report. And according to the evaluation report, a self-adaptive virtual reality training scene is dynamically generated, and instant visual and auditory feedback is provided, so that the individuation and effect of gait training are improved, and the method has a wide clinical application prospect.

A response generation method in which a real-time tutor is integrated into the user's browser to guide an AI engine to generate real-time responses, enabling user interaction with a real-time tutor integrated within a browser extension is disclosed. The method involves receiving user input, which can be text or spoken queries. If the input is audio, it is converted to text. Prompts are then generated based on user input, educational standards, real-time tutor details, educational content from the browser, and internal educational content. These prompts guide the AI engine, which is pre-trained on educational standards, to generate a relevant response. The response is converted to audio using text-to-speech synthesis, aligning with the real-time tutor. The audio is synchronized with the video to create an educational video featuring the real-time tutor. Finally, the real-time generated video is streamed back to the user, enhancing engagement through integrated visual and auditory feedback.

The invention discloses a multimedia memoir generation method and device based on multi-dimensional emotion perception, relates to the technical field of artificial intelligence, can be applied to financial science and technology and medical health business scenarios, and comprises the steps that in the AI interaction process, multi-dimensional emotion related data expressed by user recall is collected in real time; comprehensively analyzing the multi-dimensional emotion related data, and determining a real-time emotion type and emotion intensity of the user; according to the real-time emotion type and the emotion intensity, corresponding visual feedback materials and auditory feedback materials are dynamically and adaptively generated, and an immersive interaction scene is constructed based on the visual feedback materials and the auditory feedback materials; in the immersive interaction scene, intercepting a plurality of audio and video material slices when the emotion of the user reaches a peak value; and integrating the plurality of audio and video material slices and the core content expressed by the user memory to obtain the multimedia memoir of the user. The emotion information of the user in the memory expression process can be effectively captured and fused.

An object of a system according to an embodiment is to accurately identify the pitch of a sound and provide visual and auditory feedback.SOLUTION: A system includes a sound recognition and analysis unit, a visual display unit, and an auditory feedback unit. The sound recognition and analysis unit identifies the pitch of the sound using the generated AI. The visual display unit visually displays the pitch of the sound identified by the sound recognition and analysis unit. The auditory feedback unit aurally feeds back the pitch of the sound specified by the sound recognition and analysis unit.SELECTED DRAWING: Figure 1

The invention discloses a music teaching touch device for blind people, which comprises a supporting seat and a teaching touch seat, and a plurality of dynamic dot matrix seats are arranged on the teaching touch seat in an array. Three rows and two columns of flexible pads are arranged at the top of each dynamic dot matrix base to form a Braille display matrix, and an electromagnetic plunger assembly is arranged below each dynamic dot matrix base to independently drive each dot position to protrude and reset, so that dynamic display of music Braille and graphs is achieved. The bottom of the dynamic dot matrix seat is connected through a silica gel bowl, and a conducting strip is arranged in the bowl and can be in contact with a corresponding conducting material on a circuit board in the teaching touch seat. When a user presses the dynamic dot matrix seat displaying specific notes, pitch sounding of the notes is triggered. According to the invention, the dynamic tactile display function and the pressing input function are integrated, so that refreshing and interactive learning of the braille music score are realized, and a multi-mode feedback closed loop is realized through tactile sense, auditory sense and operation.

The invention discloses an intelligent voice rehabilitation training management system. The system comprises an intra-hospital local area server, a preoperative risk assessment module, an intra-operative neural function assessment module, an acoustic assessment module and an individualized rehabilitation training scheme making module. The system is in butt joint with intraoperative nerve monitoring equipment to collect electromyographic signals in real time, and multi-modal fusion analysis is carried out in combination with preoperative / postoperative acoustic parameters and spectrograms. The system utilizes a deep learning model to predict the noise disorder risk and the recovery trajectory at different time points after the operation; three-dimensional training navigation is constructed based on postoperative time, neurological function parameter changes and vocational voice requirements, a rehabilitation path is dynamically optimized by adopting near-end strategy optimization reinforcement learning, and training intensity and content are adjusted in a closed-loop mode through auditory feedback; closed-loop management of preoperative evaluation, intraoperative monitoring, postoperative evaluation, individualized rehabilitation and follow-up visit optimization is achieved, and the accuracy and timeliness of voice function protection and rehabilitation are improved.

This invention provides a virtual reality method and system for constructing a geometrically perceptible material field based on a large model and driving real-time interactive sound synthesis. The method includes: acquiring geometric data and multi-view observation data of the target object; generating prior material constraint information from a large model and fusing the multi-view data to obtain the material feature field of the target object; generating physical sound assets offline based on the material feature field; acquiring interaction state information during virtual reality scene runtime, mapping it to excitations consistent with geometric position and interaction process, and synthesizing collision and friction sounds, enabling the same object to produce continuously changing and distinguishable sound feedback under different touch positions, sliding paths, and contact areas. This invention achieves real-time synthesis and output of collision and friction sounds by constructing a material feature field bound to the geometric space of the virtual object and driving physical sound assets in conjunction with interaction state information during runtime, thus enhancing the consistency of auditory feedback and immersive experience in virtual reality scenes.

The application discloses a multi-sensory interactive ASD user interaction learning system and an implementation method thereof. The multi-sensory interactive ASD user interaction learning system comprises a table board, a plurality of control modules and a plurality of telescopic pipes with different marks. The plurality of control modules are connected with the plurality of workstations on the table board one by one, and each control module is connected with a corresponding telescopic pipe. The plurality of telescopic pipes are used to be touched by ASD users to be connected with the plurality of control modules. The table board is used to carry the plurality of control modules on the plurality of workstations. The control module is used to carry out audio-visual feedback to complete the interactive learning of the ASD user. The application can control the audio-visual feedback after the control module identifies the corresponding mark of the telescopic pipe, and cooperate with the tactile feedback of the ASD user to the telescopic pipe and the control module, so as to realize the purpose of attracting the attention of the ASD user through multi-sensory interaction stimulation, and further adapt to the diversified learning needs of the ASD user.

The invention discloses a smart television virtual wooden fish emotion regulation system, which realizes emotion regulation of a user through interaction between a virtual wooden fish application and a remote controller, and specifically comprises a remote controller gyroscope sensing module used for capturing rotation angle and acceleration information of the remote controller in a three-dimensional space; the virtual wooden fish application program is built in the smart television and is used for starting an interactive interface of the wooden fish after receiving the signal transmitted by the remote controller; the interaction module is used for simulating the action of knocking the wooden fish through the up-down shaking of the remote controller; the emotion relieving feedback system is used for giving visual feedback and auditory feedback to the user according to the virtual wooden fish application program along with the change of the knocking frequency and strength; the invention further discloses an intelligent television virtual wooden fish emotion adjusting method. The intelligent television virtual wooden fish emotion adjusting method aims at helping the user to relieve emotion fluctuation generated by watching emotion excitation or tension content through the function of the intelligent television.

The present subject matter relates to devices, systems, and methods for use in physical therapy of the pelvic floor and / or for treating pelvic floor dysfunction (PFD) and pelvic pain. The devices, systems, and methods can provide a pelvic floor physical therapy device that includes a handle portion configured to be gripped by a user; a body portion extending from the handle portion; and one or more sensors integrated within the body portion. The one or more sensors can be configured to collect sensor data regarding a position of the pelvic floor physical therapy device with respect to a pelvic floor location or pelvic floor muscle of a user. Visual or auditory feedback can be provided to the user regarding the position of the pelvic floor physical therapy device with respect to the pelvic floor location or pelvic floor muscle to guide a physical therapy treatment session.

Methods and systems for capturing images of an object such as a foot with a handheld mobile device capable of performing depth scanning including providing guidance to the operator of the scanner in the form of one or more of visual, haptic and auditory feedback so as to capture sufficient images of the object that a virtual three-dimensional representation of the object can be generated.

We provide the system. [Solution] Information collection methods for collecting users' biometric data, A signal transmission means for transmitting the aforementioned biometric data to an augmented reality platform, The platform includes a diagnostic means that analyzes the biometric data to evaluate the user's mental state, Activity generation means that generates activities optimized for the user based on the results of the diagnostic means, A presentation means for notifying the user of the generated activity through visual or audio feedback, A feedback collection means collects user responses to the aforementioned activities again using information gathering means and reflects them in subsequent optimization, A system that includes this.

The present invention provides a vehicle U-turn signaling system designed to enhance road safety by clearly communicating a driver's intent to perform a U-turn. Leveraging existing vehicle turn signal infrastructure, the system generates a distinctive blinking pattern visually and temporally different from standard turn signals, ensuring immediate recognition by nearby drivers, pedestrians, or traffic personnel. Implementation methods include updating the vehicle's electronic software or integrating a dual-pattern flasher module, requiring minimal hardware modifications. Activation methods encompass double-clicking the existing turn signal lever, using a dedicated button, a virtual interface, or voice command via the vehicle's voice-assistant system. Dashboard indicators replicate the U-turn signal's unique pattern, featuring optional symbolic or language-specific cues for global use. Additional features include synchronized auditory feedback and optional integration with cameras and proximity sensors for obstacle detection. The system provides a cost-effective and adaptable solution for improved vehicle signaling during complex turning maneuvers.

This application discloses a speech synthesis method, apparatus, device, and storage medium. The method involves analyzing the original text to be synthesized to obtain a phoneme sequence; inputting the phoneme sequence into a configured speech synthesis model to obtain synthesized speech output by the model. The speech synthesis model is a final speech synthesis model after parameter adjustment of the basic speech synthesis model, using the scoring results of multiple candidate speech samples corresponding to the input test text synthesized by the basic speech synthesis model as reward signals. The scoring results of each candidate speech sample conform to the user's auditory perception goals. This application adds user auditory feedback signals (i.e., the scoring results as reward signals) to the training process of the speech synthesis model, guiding the speech synthesis model to optimize model parameters in a direction that better conforms to the user's auditory perception, making the synthesized speech more in line with the user's auditory perception goals and improving the speech synthesis effect.

This utility model relates to a needleless injector body and a needleless injector. The needleless injector body includes a first component and a second component capable of relative movement with respect to the first component. The needleless injector body also includes an auxiliary device having a first feedback component and a second feedback component. The first feedback component is disposed on the first component and moves with it, and the second feedback component is disposed on the second component and moves with it. When the first component and the second component move relative to each other, the first feedback component and the second feedback component interact to provide tactile and / or auditory feedback. The needleless injector includes an injection head and the needleless injector body.

A fitness system operates during a fitness activity of a user to generate a display. The display simulates the performance of the fitness activity by the virtual fitness partner. In particular, the virtual fitness partner is superimposed within images viewed by the user to simulate performance of the fitness activity by the virtual fitness partner while the user is engaged in the activity. Differences in perspective are calculated based on a virtual position of the virtual fitness partner and a measured pace of the user generated based on sensor data from a fitness tracker. The virtual fitness partner can take actions such as generating critical or encouraging visual and / or auditory feedback in response to triggering events, for example, when the user falls behind the virtual fitness partner or takes the lead.

The invention belongs to the technical field of first-aid breathing machines, and particularly relates to a breathing assist device for field operation airway trauma first aid, which comprises a magnetic coded disc guide assembly, a connector assembly, an extrusion fastening assembly, a ratchet type locking assembly, a fixed joint and a main machine, the connector assembly is arranged in the magnetic code disc guiding assembly, and the extrusion fastening assembly is arranged on the magnetic code disc guiding assembly and the connector assembly. Through the quick release system integrating magnetic coding guidance, a mechanical ratchet lock, tactile and auditory feedback and an anti-loosening structure, quick, accurate and reliable connection under blind operation is achieved, and it is ensured that an operator clearly knows the connection state through multi-stage feedback; when the fixed ratchet wheel and the rotary ratchet wheel are in ratchet matched motion, obvious feedback can be generated in auditory sense and tactile sense, and the rotation amplitude when the handle is fastened can be accurately known through the feedback.

The invention discloses a social robot based on pneumatic driving and an interaction system thereof. The social robot comprises a shell, a body software actuator, a head actuator, a hand reinforced fiber actuator, a sensing module and a sound module. According to the social robot, interaction state information between a user and the robot is obtained through the sensing module, the control and drive module can generate rhythm parameters according to the interaction state information, the body software actuator and the head actuator can generate deformation actions synchronous with respiratory rhythm according to the rhythm parameters, and meanwhile, the motion of the user is controlled to be more stable. The sound module can modulate the envelope and intensity of sound output according to the rhythm parameters, so that the tactile feedback and the auditory feedback are consistent in time, the tactile feedback, the sound feedback and the breathing mechanism are combined, in addition, the hand reinforcing fiber actuator can attract a user to interact with the robot, and the user experience is improved. In this way, the user can obtain stable, continuous and perceptible breathing experience without excessive active operation or continuous attention, and pressure can be better relieved for the user.

The embodiment of the invention provides an auditory control method and device of a virtual character, electronic equipment and a storage medium. The method comprises the following steps: determining auditory control parameters of a virtual character; determining a corresponding sound effect set according to the auditory control parameter; and controlling to play the sound effect set. According to the method disclosed by the invention, the game system can dynamically switch different sound effect sets according to the auditory capability state of the virtual character, so that accurate simulation of the hearing range of the virtual character is technically realized. Compared with a traditional method, according to the scheme, a global audio scale does not need to be modified, system resource consumption and implementation complexity are reduced, meanwhile, through fine configuration of the sound effect set, auditory experience in the game is highly consistent with the ability state of the virtual character, the immersion and interaction experience of the game are improved, and user experience is improved. And more real auditory feedback is provided for players.

The invention discloses a rehabilitation training system and method based on brain-computer interaction, and the system comprises an electroencephalogram collection and decoding module, the electroencephalogram collection and decoding module collects electroencephalogram signals and inputs the electroencephalogram signals to an electroencephalogram evaluation module and an electroencephalogram training module, and the electroencephalogram evaluation module calculates an electroencephalogram threshold calculation model and inputs the electroencephalogram threshold calculation model to the electroencephalogram training module; the myoelectricity acquisition and decoding module is used for acquiring electroencephalogram signals and inputting the electroencephalogram signals into the myoelectricity evaluation module; the comprehensive control module controls the robot positioning module to adjust a corresponding position, and after receiving a signal from the electroencephalogram training module or a signal from the myoelectricity evaluation module; and a control signal is generated to control the visual and auditory feedback module, the peripheral magnetic stimulation module and the laser lamp module to work to activate muscles and normal feelings of the painful part so as to block uploading of a pain signal.

This invention discloses a digital skills intelligent learning platform based on multimodal interaction, comprising a multimodal input receiving unit, a cross-modal intent fusion engine, a multidimensional adaptive feedback system, and a digital skills knowledge graph. The platform collects and preprocesses various modal signals from the user through the multimodal input receiving unit; the cross-modal intent fusion engine dynamically allocates modal weights and identifies operational intentions; the multidimensional adaptive feedback system provides corresponding visual, tactile, and auditory feedback based on the user's error rate; and the digital skills knowledge graph generates personalized learning trajectories based on user interaction data. This invention achieves accurate recognition of learning intentions under multimodal interaction, provides an immersive learning experience, and improves the efficiency and user satisfaction of digital skills learning through data-driven personalized learning path planning, effectively solving problems such as single interaction, delayed feedback, and fixed learning paths in traditional digital skills learning.

A fastener assembly for attaching a first component to a second component through a hole in the second component. The assembly includes a fastener fitted into the bore and a neck ring connected to the fastener. The neck ring has two sides and two upper verification arms extend from one side. Two lower verification arms extend from the fastener. When the fastener is inserted, the two sets of arms can be bent. When the fastener is fully inserted, the snap feature on the lower arm end is designed to snap into the mating cutout feature on the upper arm end. This snap action provides auditory feedback to the user to indicate that the fastener is in the correct position.

An auditory feedback system according to the present invention is provided. The auditory feedback system comprises: an acceleration sensor configured to measure the body inclination of a user who walks or exercises while wearing a wireless earphone; and a control unit configured to determine whether the body inclination is greater than or equal to a predetermined angle with respect to a body center line, wherein the control unit can control the wireless earphone to provide a first type of music as first auditory feedback if the body inclination is determined to be in a neutral state of being less than the predetermined angle, and provide a second type of music as second auditory feedback if the body inclination is determined to be in an inclined state of being greater than or equal to the predetermined angle.

The utility model relates to the technical field of number plate, concretely to a tower type magnetic formula can hide parking number plate: including base member, function component and locking mechanism, function component is movably sleeved on the surface of base member, the bottom of base member is provided with the mounting part, the inside of base member is provided with the accommodation cavity, the outer surface of function component is provided with display area, the locking mechanism includes first connecting part and second connecting part. The utility model discloses first connecting part and second connecting part are set up, so that user can realize the quick hiding (contraction state) and display (expansion state) of number information through simple pressing or pulling operation, effectively protect the privacy of car owner, first connecting part and second connecting part are the design of buckle type, have the crisp 'click' sound, provide clear tactile and auditory feedback.

A method for delivering audible feedback to a driver within a cabin of a road vehicle, the vehicle comprising a plurality of wheels and an electric motor, the method comprising determining the torque delivered to at least two wheels of the plurality of wheels; determining a wheel torque distribution for the vehicle based on the determined torques; determining a primary sound location in the sound space in accordance with the wheel torque distribution; and inputting the primary sound location to a spatial audio system, the spatial audio system providing the audible feedback to the vehicle cabin such that the audible feedback is perceived by the driver to be originating from a virtual audio source at the primary sound location.