74 results about "Auditory feedback" patented technology

The invention provides a rehabilitation training data mining system and method based on deep reinforcement learning, and the system comprises an intelligent cognition and parameter mining module which is provided with a deep reinforcement learning rehabilitation training model and a rehabilitation database, and the rehabilitation database is used for training the deep reinforcement learning rehabilitation training model; the evaluation and analysis module is used for evaluating and analyzing various physiological data collected by the patient in the rehabilitation training period to obtain initial training parameters; inputting the initial training parameters into the trained deep reinforcement learning rehabilitation training model to obtain optimal rehabilitation training parameters; the man-machine interaction module is provided with a control module, the control module receives the optimal rehabilitation training parameters and generates control signals to the visual and auditory feedback module and the rehabilitation training module, and the intelligent rehabilitation training system aims at improving the rehabilitation training effect and personal experience through intelligent means.

The invention relates to the technical field of data processing, and discloses a gait training method and system based on virtual reality. The method comprises the following steps: acquiring gait motion data in real time through a plurality of inertial measurement sensors, and fusing the gait motion data with whole body depth image data acquired by a depth camera to form a gait feature vector; and a gait analysis model constructed by using a convolutional neural network and a long-short-term memory network is used for recognizing gait parameter abnormity in real time and generating an evaluation report. And according to the evaluation report, a self-adaptive virtual reality training scene is dynamically generated, and instant visual and auditory feedback is provided, so that the individuation and effect of gait training are improved, and the method has a wide clinical application prospect.

A response generation method in which a real-time tutor is integrated into the user's browser to guide an AI engine to generate real-time responses, enabling user interaction with a real-time tutor integrated within a browser extension is disclosed. The method involves receiving user input, which can be text or spoken queries. If the input is audio, it is converted to text. Prompts are then generated based on user input, educational standards, real-time tutor details, educational content from the browser, and internal educational content. These prompts guide the AI engine, which is pre-trained on educational standards, to generate a relevant response. The response is converted to audio using text-to-speech synthesis, aligning with the real-time tutor. The audio is synchronized with the video to create an educational video featuring the real-time tutor. Finally, the real-time generated video is streamed back to the user, enhancing engagement through integrated visual and auditory feedback.

The invention discloses a multimedia memoir generation method and device based on multi-dimensional emotion perception, relates to the technical field of artificial intelligence, can be applied to financial science and technology and medical health business scenarios, and comprises the steps that in the AI interaction process, multi-dimensional emotion related data expressed by user recall is collected in real time; comprehensively analyzing the multi-dimensional emotion related data, and determining a real-time emotion type and emotion intensity of the user; according to the real-time emotion type and the emotion intensity, corresponding visual feedback materials and auditory feedback materials are dynamically and adaptively generated, and an immersive interaction scene is constructed based on the visual feedback materials and the auditory feedback materials; in the immersive interaction scene, intercepting a plurality of audio and video material slices when the emotion of the user reaches a peak value; and integrating the plurality of audio and video material slices and the core content expressed by the user memory to obtain the multimedia memoir of the user. The emotion information of the user in the memory expression process can be effectively captured and fused.

An object of a system according to an embodiment is to accurately identify the pitch of a sound and provide visual and auditory feedback.SOLUTION: A system includes a sound recognition and analysis unit, a visual display unit, and an auditory feedback unit. The sound recognition and analysis unit identifies the pitch of the sound using the generated AI. The visual display unit visually displays the pitch of the sound identified by the sound recognition and analysis unit. The auditory feedback unit aurally feeds back the pitch of the sound specified by the sound recognition and analysis unit.SELECTED DRAWING: Figure 1

The invention discloses a music teaching touch device for blind people, which comprises a supporting seat and a teaching touch seat, and a plurality of dynamic dot matrix seats are arranged on the teaching touch seat in an array. Three rows and two columns of flexible pads are arranged at the top of each dynamic dot matrix base to form a Braille display matrix, and an electromagnetic plunger assembly is arranged below each dynamic dot matrix base to independently drive each dot position to protrude and reset, so that dynamic display of music Braille and graphs is achieved. The bottom of the dynamic dot matrix seat is connected through a silica gel bowl, and a conducting strip is arranged in the bowl and can be in contact with a corresponding conducting material on a circuit board in the teaching touch seat. When a user presses the dynamic dot matrix seat displaying specific notes, pitch sounding of the notes is triggered. According to the invention, the dynamic tactile display function and the pressing input function are integrated, so that refreshing and interactive learning of the braille music score are realized, and a multi-mode feedback closed loop is realized through tactile sense, auditory sense and operation.

The invention discloses an intelligent voice rehabilitation training management system. The system comprises an intra-hospital local area server, a preoperative risk assessment module, an intra-operative neural function assessment module, an acoustic assessment module and an individualized rehabilitation training scheme making module. The system is in butt joint with intraoperative nerve monitoring equipment to collect electromyographic signals in real time, and multi-modal fusion analysis is carried out in combination with preoperative / postoperative acoustic parameters and spectrograms. The system utilizes a deep learning model to predict the noise disorder risk and the recovery trajectory at different time points after the operation; three-dimensional training navigation is constructed based on postoperative time, neurological function parameter changes and vocational voice requirements, a rehabilitation path is dynamically optimized by adopting near-end strategy optimization reinforcement learning, and training intensity and content are adjusted in a closed-loop mode through auditory feedback; closed-loop management of preoperative evaluation, intraoperative monitoring, postoperative evaluation, individualized rehabilitation and follow-up visit optimization is achieved, and the accuracy and timeliness of voice function protection and rehabilitation are improved.

This invention provides a virtual reality method and system for constructing a geometrically perceptible material field based on a large model and driving real-time interactive sound synthesis. The method includes: acquiring geometric data and multi-view observation data of the target object; generating prior material constraint information from a large model and fusing the multi-view data to obtain the material feature field of the target object; generating physical sound assets offline based on the material feature field; acquiring interaction state information during virtual reality scene runtime, mapping it to excitations consistent with geometric position and interaction process, and synthesizing collision and friction sounds, enabling the same object to produce continuously changing and distinguishable sound feedback under different touch positions, sliding paths, and contact areas. This invention achieves real-time synthesis and output of collision and friction sounds by constructing a material feature field bound to the geometric space of the virtual object and driving physical sound assets in conjunction with interaction state information during runtime, thus enhancing the consistency of auditory feedback and immersive experience in virtual reality scenes.

The application discloses a multi-sensory interactive ASD user interaction learning system and an implementation method thereof. The multi-sensory interactive ASD user interaction learning system comprises a table board, a plurality of control modules and a plurality of telescopic pipes with different marks. The plurality of control modules are connected with the plurality of workstations on the table board one by one, and each control module is connected with a corresponding telescopic pipe. The plurality of telescopic pipes are used to be touched by ASD users to be connected with the plurality of control modules. The table board is used to carry the plurality of control modules on the plurality of workstations. The control module is used to carry out audio-visual feedback to complete the interactive learning of the ASD user. The application can control the audio-visual feedback after the control module identifies the corresponding mark of the telescopic pipe, and cooperate with the tactile feedback of the ASD user to the telescopic pipe and the control module, so as to realize the purpose of attracting the attention of the ASD user through multi-sensory interaction stimulation, and further adapt to the diversified learning needs of the ASD user.

Methods and systems for capturing images of an object such as a foot with a handheld mobile device capable of performing depth scanning including providing guidance to the operator of the scanner in the form of one or more of visual, haptic and auditory feedback so as to capture sufficient images of the object that a virtual three-dimensional representation of the object can be generated.

We provide the system. [Solution] Information collection methods for collecting users' biometric data, A signal transmission means for transmitting the aforementioned biometric data to an augmented reality platform, The platform includes a diagnostic means that analyzes the biometric data to evaluate the user's mental state, Activity generation means that generates activities optimized for the user based on the results of the diagnostic means, A presentation means for notifying the user of the generated activity through visual or audio feedback, A feedback collection means collects user responses to the aforementioned activities again using information gathering means and reflects them in subsequent optimization, A system that includes this.

The present invention provides a vehicle U-turn signaling system designed to enhance road safety by clearly communicating a driver's intent to perform a U-turn. Leveraging existing vehicle turn signal infrastructure, the system generates a distinctive blinking pattern visually and temporally different from standard turn signals, ensuring immediate recognition by nearby drivers, pedestrians, or traffic personnel. Implementation methods include updating the vehicle's electronic software or integrating a dual-pattern flasher module, requiring minimal hardware modifications. Activation methods encompass double-clicking the existing turn signal lever, using a dedicated button, a virtual interface, or voice command via the vehicle's voice-assistant system. Dashboard indicators replicate the U-turn signal's unique pattern, featuring optional symbolic or language-specific cues for global use. Additional features include synchronized auditory feedback and optional integration with cameras and proximity sensors for obstacle detection. The system provides a cost-effective and adaptable solution for improved vehicle signaling during complex turning maneuvers.

This application discloses a speech synthesis method, apparatus, device, and storage medium. The method involves analyzing the original text to be synthesized to obtain a phoneme sequence; inputting the phoneme sequence into a configured speech synthesis model to obtain synthesized speech output by the model. The speech synthesis model is a final speech synthesis model after parameter adjustment of the basic speech synthesis model, using the scoring results of multiple candidate speech samples corresponding to the input test text synthesized by the basic speech synthesis model as reward signals. The scoring results of each candidate speech sample conform to the user's auditory perception goals. This application adds user auditory feedback signals (i.e., the scoring results as reward signals) to the training process of the speech synthesis model, guiding the speech synthesis model to optimize model parameters in a direction that better conforms to the user's auditory perception, making the synthesized speech more in line with the user's auditory perception goals and improving the speech synthesis effect.

This utility model relates to a needleless injector body and a needleless injector. The needleless injector body includes a first component and a second component capable of relative movement with respect to the first component. The needleless injector body also includes an auxiliary device having a first feedback component and a second feedback component. The first feedback component is disposed on the first component and moves with it, and the second feedback component is disposed on the second component and moves with it. When the first component and the second component move relative to each other, the first feedback component and the second feedback component interact to provide tactile and / or auditory feedback. The needleless injector includes an injection head and the needleless injector body.

A fitness system operates during a fitness activity of a user to generate a display. The display simulates the performance of the fitness activity by the virtual fitness partner. In particular, the virtual fitness partner is superimposed within images viewed by the user to simulate performance of the fitness activity by the virtual fitness partner while the user is engaged in the activity. Differences in perspective are calculated based on a virtual position of the virtual fitness partner and a measured pace of the user generated based on sensor data from a fitness tracker. The virtual fitness partner can take actions such as generating critical or encouraging visual and / or auditory feedback in response to triggering events, for example, when the user falls behind the virtual fitness partner or takes the lead.

The invention belongs to the technical field of first-aid breathing machines, and particularly relates to a breathing assist device for field operation airway trauma first aid, which comprises a magnetic coded disc guide assembly, a connector assembly, an extrusion fastening assembly, a ratchet type locking assembly, a fixed joint and a main machine, the connector assembly is arranged in the magnetic code disc guiding assembly, and the extrusion fastening assembly is arranged on the magnetic code disc guiding assembly and the connector assembly. Through the quick release system integrating magnetic coding guidance, a mechanical ratchet lock, tactile and auditory feedback and an anti-loosening structure, quick, accurate and reliable connection under blind operation is achieved, and it is ensured that an operator clearly knows the connection state through multi-stage feedback; when the fixed ratchet wheel and the rotary ratchet wheel are in ratchet matched motion, obvious feedback can be generated in auditory sense and tactile sense, and the rotation amplitude when the handle is fastened can be accurately known through the feedback.

The invention discloses a social robot based on pneumatic driving and an interaction system thereof. The social robot comprises a shell, a body software actuator, a head actuator, a hand reinforced fiber actuator, a sensing module and a sound module. According to the social robot, interaction state information between a user and the robot is obtained through the sensing module, the control and drive module can generate rhythm parameters according to the interaction state information, the body software actuator and the head actuator can generate deformation actions synchronous with respiratory rhythm according to the rhythm parameters, and meanwhile, the motion of the user is controlled to be more stable. The sound module can modulate the envelope and intensity of sound output according to the rhythm parameters, so that the tactile feedback and the auditory feedback are consistent in time, the tactile feedback, the sound feedback and the breathing mechanism are combined, in addition, the hand reinforcing fiber actuator can attract a user to interact with the robot, and the user experience is improved. In this way, the user can obtain stable, continuous and perceptible breathing experience without excessive active operation or continuous attention, and pressure can be better relieved for the user.

The embodiment of the invention provides an auditory control method and device of a virtual character, electronic equipment and a storage medium. The method comprises the following steps: determining auditory control parameters of a virtual character; determining a corresponding sound effect set according to the auditory control parameter; and controlling to play the sound effect set. According to the method disclosed by the invention, the game system can dynamically switch different sound effect sets according to the auditory capability state of the virtual character, so that accurate simulation of the hearing range of the virtual character is technically realized. Compared with a traditional method, according to the scheme, a global audio scale does not need to be modified, system resource consumption and implementation complexity are reduced, meanwhile, through fine configuration of the sound effect set, auditory experience in the game is highly consistent with the ability state of the virtual character, the immersion and interaction experience of the game are improved, and user experience is improved. And more real auditory feedback is provided for players.

The invention discloses a rehabilitation training system and method based on brain-computer interaction, and the system comprises an electroencephalogram collection and decoding module, the electroencephalogram collection and decoding module collects electroencephalogram signals and inputs the electroencephalogram signals to an electroencephalogram evaluation module and an electroencephalogram training module, and the electroencephalogram evaluation module calculates an electroencephalogram threshold calculation model and inputs the electroencephalogram threshold calculation model to the electroencephalogram training module; the myoelectricity acquisition and decoding module is used for acquiring electroencephalogram signals and inputting the electroencephalogram signals into the myoelectricity evaluation module; the comprehensive control module controls the robot positioning module to adjust a corresponding position, and after receiving a signal from the electroencephalogram training module or a signal from the myoelectricity evaluation module; and a control signal is generated to control the visual and auditory feedback module, the peripheral magnetic stimulation module and the laser lamp module to work to activate muscles and normal feelings of the painful part so as to block uploading of a pain signal.

This invention discloses a digital skills intelligent learning platform based on multimodal interaction, comprising a multimodal input receiving unit, a cross-modal intent fusion engine, a multidimensional adaptive feedback system, and a digital skills knowledge graph. The platform collects and preprocesses various modal signals from the user through the multimodal input receiving unit; the cross-modal intent fusion engine dynamically allocates modal weights and identifies operational intentions; the multidimensional adaptive feedback system provides corresponding visual, tactile, and auditory feedback based on the user's error rate; and the digital skills knowledge graph generates personalized learning trajectories based on user interaction data. This invention achieves accurate recognition of learning intentions under multimodal interaction, provides an immersive learning experience, and improves the efficiency and user satisfaction of digital skills learning through data-driven personalized learning path planning, effectively solving problems such as single interaction, delayed feedback, and fixed learning paths in traditional digital skills learning.

A fastener assembly for attaching a first component to a second component through a hole in the second component. The assembly includes a fastener fitted into the bore and a neck ring connected to the fastener. The neck ring has two sides and two upper verification arms extend from one side. Two lower verification arms extend from the fastener. When the fastener is inserted, the two sets of arms can be bent. When the fastener is fully inserted, the snap feature on the lower arm end is designed to snap into the mating cutout feature on the upper arm end. This snap action provides auditory feedback to the user to indicate that the fastener is in the correct position.

The utility model relates to the technical field of number plate, concretely to a tower type magnetic formula can hide parking number plate: including base member, function component and locking mechanism, function component is movably sleeved on the surface of base member, the bottom of base member is provided with the mounting part, the inside of base member is provided with the accommodation cavity, the outer surface of function component is provided with display area, the locking mechanism includes first connecting part and second connecting part. The utility model discloses first connecting part and second connecting part are set up, so that user can realize the quick hiding (contraction state) and display (expansion state) of number information through simple pressing or pulling operation, effectively protect the privacy of car owner, first connecting part and second connecting part are the design of buckle type, have the crisp 'click' sound, provide clear tactile and auditory feedback.

A method for delivering audible feedback to a driver within a cabin of a road vehicle, the vehicle comprising a plurality of wheels and an electric motor, the method comprising determining the torque delivered to at least two wheels of the plurality of wheels; determining a wheel torque distribution for the vehicle based on the determined torques; determining a primary sound location in the sound space in accordance with the wheel torque distribution; and inputting the primary sound location to a spatial audio system, the spatial audio system providing the audible feedback to the vehicle cabin such that the audible feedback is perceived by the driver to be originating from a virtual audio source at the primary sound location.

The invention discloses a target language immersive hearing feedback system based on native language triggering. The system comprises a native language speech input module used for collecting native language speech input by a user and identifying a language corresponding to the native language speech; the semantic analysis module is used for performing sentence segmentation processing, keyword extraction, grammar structure analysis and semantic extraction on the native language speech to obtain an analysis result; the target language semantic mapping module is used for searching for an expression mode of semantic alignment in the target language according to the analysis result to obtain a target language text; the voice synthesis module is used for converting the target language text into a playable audio signal; the auditory feedback module is used for playing the audio signal to a user auditory channel in an ear return mode so as to realize immersive input feedback; and the self-adaptive regulation and control module is used for dynamically adjusting the speech speed, accent, vocabulary difficulty and feedback rhythm of the audio signal based on the user feedback data. The technical problem that the cognitive load is too high when a beginner learns languages is solved.

The invention discloses an internal rotation type quantitative injection pen, relates to the technical field of medical injection instruments, and aims at solving the problems that a knob of an existing injection pen is prone to disengagement, dosage accuracy is insufficient, feedback is fuzzy, and repeated use risks exist. An internal rotation adjusting assembly of the injection pen is assembled in an outer shell, does not have disengagement displacement along a Z axis and does not have axial force in rotation; the double-sounding feedback assembly provides precise auditory feedback in the dose adjustment stage and the injection stage respectively; the memory limiting assembly accumulatively records injection times through a mechanical structure, and the device is locked after preset times are completed; the elastic driving assembly provides stable injection power and is matched with thread transmission to achieve accurate dose control. The operation stability and the dosage accuracy are improved through structural innovation, the repeated use risk is eradicated through a mechanical locking mechanism, the labor-saving design is suitable for various crowds, the precise self-injection device is suitable for precise self-injection of various chronic diseases, and the remarkable clinical application value is achieved.

The utility model discloses a kind of normally open button switch with press feedback function, including bottom shell, static contact, button, waterproof cover, pressboard, dynamic contact component and press feedback component;Press feedback component contains trigger lever, reset elastic member and metal spring, the stem of trigger lever is connected into the spring hole at the bottom of button, reset elastic member is located in spring hole and two ends are respectively connected with spring hole bottom wall and the connecting step of trigger lever, metal spring is located below the effect projection of trigger lever and is abutted with it.The switch can produce the auditory feedback of "tick" sound and the tactile feedback of hand feeling when pressing button through press feedback component, so that user can accurately judge whether operation is effective, avoid repeated pressing or operation not in place, improve operation accuracy and experience, and structure design is reasonable, each component cooperation is stable, guarantee the reliable realization of switch function.

A blood draw device including an introducer and an actuator. The introducer has a proximal end portion, a distal end portion, and an inner volume, and includes a top surface having a first portion of a first length and a second portion of a second length. The first portion may have a smooth surface along the first length and the second portion has a plurality of ridges along the second length. The actuator includes an exterior portion positioned above the top surface and an interior portion positioned within the inner volume, wherein the exterior portion of the actuator includes an engagement member and a downwardly-extending tab projecting below the engagement member such that the downwardly-extending tab of the actuator may contact at least the plurality of ridges of the second portion of the introducer to provide at least one of tactile and audible feedback to a user.

The embodiment of the invention provides an interaction control method and device based on a multi-mode thin film and interaction equipment. The method comprises the steps that selection operation for a target area is detected; a first excitation signal is generated according to the selection operation, the first excitation signal acts on the multi-mode thin film, and a target audio corresponding to a target area is generated; a second excitation signal containing a high-frequency signal is generated according to the selected operation, the second excitation signal acts on the multi-mode thin film, friction force noise of a target area is eliminated, independent tactile feedback is generated, and independent control over auditory feedback and force feedback is achieved while accompanying friction force is eliminated; according to the method, auditory and tactile feedback is decoupled by using a high-frequency signal, multi-mode independent adjustment is realized, and the hearing feedback and the force feedback of an interactive interface can be independently controlled by superposing a preset waveform signal for indicating the force feedback in a first excitation signal under the condition that the hearing feedback and the force feedback are decoupled, so that multi-mode feedback is provided for a user, and the user experience is improved. And user experience is improved.

The invention provides an AI adaptive ADSR envelope dynamic modulation method and system in a spatial audio scene. The method comprises the following steps: acquiring spatial information; inputting the acquired spatial information parameters into a lightweight AI model so as to predict ADSR envelope parameters; according to the ADSR envelope parameter predicted by the lightweight AI model, dynamically generating an ADSR parameter suitable for the current spatial audio scene, and performing real-time amplitude modulation processing on the audio signal; and continuously optimizing the parameter mapping relation of the lightweight AI model through a reinforcement learning network based on user feedback and the change condition of the space environment so as to adjust the ADSR parameter to the preference requirement required by the user. According to the invention, a system based on spatial perception-AI decision-ADSR dynamic modulation-auditory feedback optimization is constructed, and intelligent cooperation of spatial audio ADSR envelope, spatial position, environmental characteristics and user preference is realized, so that friendly experience and immersion of a user to spatial audio are improved.

The utility model discloses an oil cup hanging lug assembly and a range hood, the oil cup hanging lug assembly comprises an oil cup hanging lug, the oil cup hanging lug comprises a hanging lug body and an elastic pressing piece, the hanging lug body is provided with a mounting groove, and one end of the elastic pressing piece is telescopically arranged in the mounting groove; the oil cup comprises an insertion piece, a positioning opening is formed in the insertion piece, the insertion piece is inserted into the mounting groove, one end of the elastic pressing piece is pushed to retract and slide relative to the end of the elastic pressing piece, and when the end of the elastic pressing piece is opposite to the positioning opening, the elastic pressing piece rebounds and penetrates through the positioning opening to be in collision and butt joint with the hanging lug body. According to the oil cup hanger, visual auditory feedback is provided for a user through the clear sound generated when the elastic pressing piece penetrates through the positioning opening and is in collision and abutting connection with the hanger body, the user is helped to judge whether the oil cup is installed in place or not, and the installation strength of the oil cup and the oil cup hanger is improved.