56 results about "Audio feedback" patented technology

A system for capturing, identifying, and processing images and soft biometrics includes an image capture device, a pan and tilt device, a speaker for audio feedback, and a microphone for voice capture, all controlled by a computing device. Image capture is enhanced by detecting image focus, facial recognition matching, detecting the number of subjects and unwanted objects, and checking the cropped image by detecting whether eyes and mouth are open or closed, detecting redeye, detecting background color, detecting lighting conditions, and detecting subject location, pose and expression. Soft biometrics including scars, marks, and tattoos are also identified, cropped and classified.

The invention discloses a piano tuning auxiliary positioning system, belongs to the technical field of musical instrument tuning, and aims to solve the problem of positioning deviation caused by neglecting string tension dynamic evolution and environmental disturbance in the prior art. The system comprises a tuning peg state sensing module, a string tension evolution monitoring module, a central cooperative controller, a man-machine interaction guide module and an audio feedback verification module. Through fusion of triple information of tuning peg angular displacement, tension steady state discrimination and acoustic frequency feedback, staged accurate guidance and dynamic decision are realized. The system rapidly approaches the target in the coarse tuning stage, premature termination is avoided in the fine tuning stage according to the tension steady state, the tuning accuracy is ensured through audio closed-loop verification, and the tuning precision, efficiency and robustness are remarkably improved.

The invention relates to a method for identifying an object target by an agent based on a large model, and the method comprises the steps: constructing an object identification agent TRA which comprises a target detection library module, a function module and a large language model, and the function module comprises a target detection library and an object identification module; performing fine tuning on the TRA by using the fine tuning data set to obtain a fine-tuned TRA; and for a piece of new voice data, the fine-tuned TRA identifies and outputs audio feedback. According to the method, a traditional large model is combined with a small model special for the field, multi-modal data can be processed, a series of instructions can be executed, and therefore the human participation degree in the task execution process is further reduced. The TRA constructed by the large language model subjected to instruction fine tuning can perform object identification and key information analysis processing tasks according to the natural language instruction, the efficiency is high, and the overall effect is ideal.

We provide the system. [Solution] Information collection methods for collecting users' biometric data, A signal transmission means for transmitting the aforementioned biometric data to an augmented reality platform, The platform includes a diagnostic means that analyzes the biometric data to evaluate the user's mental state, Activity generation means that generates activities optimized for the user based on the results of the diagnostic means, A presentation means for notifying the user of the generated activity through visual or audio feedback, A feedback collection means collects user responses to the aforementioned activities again using information gathering means and reflects them in subsequent optimization, A system that includes this.

System (100) for wearable smart glasses that provides improved visual support to visually impaired users, wherein the system (100) comprises: a frame (102) wherein the frame (102) is configured to accommodate electronic components; an image acquisition unit (104), wherein the image acquisition unit (104) is designed to be able to capture visual data in real time under low light conditions and daylight; a processing unit (106) wherein the processing unit (106) is functionally coupled to the image acquisition unit and is configured to execute deep learning models for image enhancement, object detection, extraction of prominent objects and text recognition; an augmented reality module (108) coupled to a processor, wherein the augmented reality module (108) is configured to overlay context-related digital information onto the user's field of vision; an IoT communication interface (110), wherein the IoT communication interface (110) enables real-time connectivity with external devices and cloud services; and an output interface (112), wherein the output interface (112) comprises audio feedback, haptic feedback or a tactile display designed to transmit detected information to the user.

To provide a method, system and non-transitory computer-readable recording medium for audio feedback during a live broadcast.SOLUTION: A method implemented on a computer system includes providing a live broadcast by receiving broadcast content transmitted from an electronic device of a caster, and by streaming the received broadcast content to electronic devices of multiple users through a communication session established between an account of the caster and accounts of the users; receiving audio feedback about the live broadcast from an electronic device of a user during the live broadcast; and delivering the audio feedback to the electronic device of the caster.SELECTED DRAWING: Figure 4

The application provides an audio playing method and device, wherein the audio playing method comprises the following steps: receiving a key control instruction submitted by a user through a key device, analyzing the key control instruction, and obtaining key control information; determining a target key force that matches the key control information, and determining a target audio that matches the target key force; taking the target audio as a response to the key control instruction, and playing the target audio for the user. The application realizes playing of a corresponding target audio according to a key control operation of the user, associates the audio feedback with the key operation of the user directly, enables a key device without pressure sensing to simulate key pressure, plays a target audio that matches the key pressure, and improves user experience.

The invention discloses a multi-modal-based immersive self-adaptive treadmill rehabilitation training method and system, and the method comprises the steps: constructing a multi-modal synchronous data stream through synchronously collecting real-time posture data, surface electromyogram signals and treadmill state data of a user; further analyzing the gait quality, muscle activation and interaction state of the user in real time, and generating a multi-dimensional state vector; based on a preset self-adaptive strategy table, the state vector is compared with an expected threshold value of the current training stage, and a cooperative adjustment instruction aiming at the speed / gradient of the treadmill, the dynamic characteristics of the virtual scene and audio feedback is generated through intelligent decision; finally, closed-loop self-adaptive control is formed through multi-channel real-time feedback execution, and the training stage is automatically transited when conditions are met. According to the method, deep interaction and self-adaptive linkage of the physical training environment and the virtual immersion scene are realized, safer and more personalized rehabilitation training experience rich in sense of participation can be provided, and the accuracy and effect of rehabilitation training are effectively improved.

A system is provided.SOLUTION: The system includes a means for acquiring a voice input of a user, a means for converting the acquired voice into a text, a means for analyzing the text by using a generation AI and generating an appropriate response, a means for converting the generated response into a voice, a means for giving voice feedback to the user, and a means for storing conversation date with the user and using it in the next use.SELECTED DRAWING: Figure 1

The system according to the embodiment aims to enable a visually impaired person to grasp the environment of their current location in a timely manner. [Solution] A system according to an embodiment includes an image acquisition unit, a position acquisition unit, an analysis unit, and a feedback unit. The image acquisition unit acquires image information. The position acquisition unit acquires position information. The analysis unit analyzes the information acquired by the image acquisition unit and the position acquisition unit. The feedback unit provides audio feedback of the information analyzed by the analysis unit.

Electronic devices may be provided that contain flexible displays that are bent to form displays on multiple surfaces of the devices. Bent flexible displays may be bent to form front side displays and edge displays. Edge displays may be separated from front side displays or from other edge displays using patterned housing members, printed or painted masks, or by selectively activating and inactivating display pixels associated with the flexible display. Edge displays may alternately function as virtual buttons, virtual switches, or informational displays that are supplemental to front side displays. Virtual buttons may include transparent button members, lenses, haptic feedback components, audio feedback components, or other components for providing feedback to a user when virtual buttons are activated.

Methods, systems, and devices are described for a wearable device. The augmented reality device may establish a connection with the wearable device, such as directly with the wearable device, or via a user device connected with the wearable device. The augmented reality device may obtain biometric data from a sensor of the wearable device, biometric data of the augmented reality device and a user of the wearable device. An augmented reality device may provide feedback to a user by updating an augmented reality environment, an augmented reality experience, or both. For example, an augmented reality device may provide visual feedback, audio feedback, haptic feedback, or any combination thereof.

The invention relates to the technical field of intelligent glasses, and discloses a video call assistance method and system based on intelligent glasses, and the system comprises the steps: enabling the intelligent glasses to collect the information of an environment in real time, and uploading the information to a cloud platform; the cloud platform performs scene recognition on the received environment information, judges whether the environment is in a complex environment, and triggers a remote assistance request if the environment is in the complex environment; screening the registered volunteers, and scheduling the volunteers to access the assistance task; the volunteer terminal accesses a video stream of the intelligent glasses, and provides navigation or obstacle prompt for a user through a voice instruction or audio feedback; the evaluation module records and analyzes interaction data in real time in the assistance process to generate volunteer service scores; and generating a volunteer score based on the volunteer service score, and counting the volunteer score into a volunteer incentive system. According to the application, intelligent environment identification is realized, volunteer matching optimization is realized, and an interactive behavior quantitative evaluation and service incentive mechanism is assisted.

The invention relates to computing and to multimedia systems and can be used for professionally training vocal performance technique. The claimed voice modification method includes saving sets of parameters, each of which characterizes the notes of a target melody. Simultaneously with the musical accompaniment of the notes of the target melody, the voice signal of a singer is input. Processing is carried out on the singer's voice signal, providing for the creation of a modified frame of an output voice signal of the singer, the notes of the target melody, a contour of the instantaneous fundamental frequency of the singer's voice and an output fundamental frequency contour. The modified frame of the output voice signal is mixed with the musical accompaniment of the target melody and these are output to a speaker. In addition, using a central processor, the notes of the target melody, the contour of the instantaneous fundamental frequency of the singer's voice and the output fundamental frequency contour are output to the screen of a monitor. The method makes it possible to increase temporal resolution in the evaluation of the instantaneous fundamental frequency and to reduce latency in the processing and modification of the singer's voice.

A system and method for monitoring respiratory movements and generating real-time audio feedback reflects a user's breathing pattern. The system includes a respiratory sensor, a signal processor, an audio synthesis unit, a wireless transmitter, and an audio output device. Respiratory signals are captured, filtered, and analyzed to determine inhalation and exhalation phases. The audio synthesis unit produces corresponding sound signals that are dynamically modulated based on the user's breathing intensity and rhythm. The audio output provides a continuous, natural-sounding auditory representation of breathing, which can be used for caregiver reassurance, sleep monitoring, or relaxation purposes. Abnormal events such as breathing cessation or muscle spasms may trigger audio alerts or spoken messages. Processed physiological metrics, including respiratory rate, heart rate, and sleep state, being transmitted to a cloud platform for long-term analysis. The system may also interface with smart lighting or external alerting devices to support hearing-impaired caregivers.

A method includes rendering a virtual widget at a first position in an extended reality (XR) space using a head-mounted display. The method also includes detecting a hand gesture of a user at a second position in the XR space using at least one optical sensor. The second position is between the first position and the optical sensor. The method further includes determining a duration of the hand gesture and a distance between the first and second positions. The method also includes performing a first or second type of action based on the duration and / or the distance. The first type of action corresponds to a system-level control of the virtual widget, and the second type of action corresponds to a content-level control of the virtual widget. In addition, the method includes rendering a visual and / or audio feedback based on at least one of the duration or the distance.

With the introduction of electromechanical input devices and sound-proofed cabins, it has become difficult for operators in a cabin to receive audio feedback from a work implement of a work machine. This hinders fine control of the work implement. Accordingly, disclosed embodiments synthetically re-introduce audio feedback into the cabin. In particular, a controller monitors operational parameters associated with movement of the work implement, executes a sound-generation algorithm to convert those operational parameters into audio (e.g., with different audio layers associated with different components of the work implement), and outputs the audio to the operator (e.g., via at least one speaker) in the cabin.

An electronic device for task guidance is disclosed. The electronic device captures visual information of an environment associated with a user, and determines first information indicative of an object or an individual in the environment, based on the captured visual information. The electronic device receives sensor data from biosensors associated with the user, and determines a subvocalized command of the user based on the received sensor data. The electronic device applies a neural language model on the first information and the subvocalized command, to determine second information indicative of an audio feedback or a haptic feedback for the user. The electronic device renders the determined second information to the user, where the second information includes instructions to guide the user to perform a task associated with the determined subvocalized command.

Electronic devices may be provided that contain flexible displays that are bent to form displays on multiple surfaces of the devices. Bent flexible displays may be bent to form front side displays and edge displays. Edge displays may be separated from front side displays or from other edge displays using patterned housing members, printed or painted masks, or by selectively activating and inactivating display pixels associated with the flexible display. Edge displays may alternately function as virtual buttons, virtual switches, or informational displays that are supplemental to front side displays. Virtual buttons may include transparent button members, lenses, haptic feedback components, audio feedback components, or other components for providing feedback to a user when virtual buttons are activated.

The invention relates to the technical field of wireless audio, and provides a multi-device wireless audio synchronization and sound field expansion method and system. Ultrahigh synchronization precision: through hierarchical clock synchronization and audio feedback calibration, the audio synchronization precision among multiple devices is improved to be within 500 microseconds from 10-50 milliseconds of a traditional scheme, and is far beyond a perception threshold of a human auditory system for synchronization differences; self-adaptive sound field expansion: through a virtual positioning technology, a user can intuitively configure a multi-device space layout, and a system automatically calculates sound channel allocation, delay compensation and frequency equalization parameters to realize immersive sound field experience; a double-link redundancy transmission and dynamic path switching strategy is adopted, and stable connection and synchronization quality are kept in a complex wireless environment.

The invention discloses a multi-input multi-feedback integrated control device which is provided with a main control module, a rocker input module, a keyboard input module, a knob input module, a tactile feedback switching module, a vibration motor feedback module, an electromagnetic valve feedback module and an audio feedback module. A rocker input module, a keyboard input module and a knob input module are used as input assemblies of the equipment, and a vibration motor feedback module, an electromagnetic valve feedback module and an audio feedback module are used as output feedback assemblies of the equipment. And the tactile feedback switching module selects one or more output feedback components according to the main control module or an external control instruction to realize control connection with the main control module, so that free switching of the output feedback components is realized, a multi-channel feedback function can be realized according to an operation scene, and interaction perceptibility and controllability of a user and equipment are improved.

An object of a system according to an embodiment is to realize mutual interference between an AR user and a VR user and enable more natural communication.SOLUTION: A system includes a detection unit, an analysis unit, and a provision unit. The detection unit detects an action of the AR user. The analyzer analyzes the information detected by the detector and provides feedback to the VR user. The provision unit provides visual or audio feedback to the VR user on the basis of the feedback generated by the analysis unit.SELECTED DRAWING: Figure 1

Methods, systems, and devices for a wearable device are described. An extended reality device may establish a connection with a wearable device, such as directly with the wearable device or via a user device connected with the wearable device. The extended reality device may acquire biometric data from sensors of the wearable device, the biometric data for a user of the extended reality device and the wearable device. The extended reality device may provide feedback to the user by updating an extended reality environment, an extended reality experience, or both. For example, the extended reality device may provide visual feedback, audio feedback, haptic feedback, or any combination thereof.

An audio feedback suppression method includes performing a first frequency analysis of an audio signal at a first frequency resolution, performing a second frequency analysis of the audio signal at a second frequency resolution which is higher than the first frequency resolution, and suppressing audio feedback frequencies in the audio signal based on the first frequency analysis and the second frequency analysis.

An amplifier power attenuator utilizes an amplified audio feedback signal from an audio amplifier (which is driving a loudspeaker), along with a user-set impedance and a maximum voltage set-point reflective of the operational parameters of the loudspeaker, to attenuate an audio signal prior to amplification thereby preventing damage to the loudspeaker. The impedance of a variable impedance optocoupler is changed to adjust the attenuation of the audio signal to one of a plurality of predetermined attenuation levels responsive to an error between a voltage level of the feedback signal and the maximum voltage set-point. The error is reflected in a counter value having a linear or non-linear relationship with the error dependent upon a magnitude of the error; the counter value is assessed against a plurality of target values associated with respective ones of the predetermined attenuation levels to identify the attenuation to be applied to the audio signal.

This disclosure provides a sound card switching method, system, electronic device, and storage medium. When an insertion event is detected at the current output interface, it is first determined whether the system was already outputting audio before the insertion event. If audio is already outputting, the sound card device before the insertion event is selected for audio output, preventing switching to the sound card device corresponding to the current output interface. When a removal event is detected at the current output interface, it is first determined whether the current sound card device corresponding to the removal event was outputting audio before the removal event. If no audio is outputting, the sound card device before the removal event is selected for audio output, preventing sound card device switching. This method avoids unwarranted interruptions to ongoing audio playback caused by hot-plugging operations, prioritizing audio continuity and user experience, and has significant advantages, especially in professional application scenarios requiring uninterrupted audio feedback.

An acoustic imaging system can include an acoustic sensing array, an electromagnetic imaging tool, a display, and an audio device. A processor can receive data from the acoustic sensor array and the electromagnetic imaging tool to generate a display image that combines acoustic image data and electromagnetic image data. The system can include an audio device that receives audio output from the processor and outputs an audio feedback signal to a user. The audio feedback signal can represent an acoustic signal from an acoustic scene. The system can provide the display image including acoustic image data to the user, and the user can select an acoustic signal that corresponds to the audio output to provide to the audio device. The audio output and the display image can dynamically change in response to a change in a pointing of the acoustic sensing array, such as by changing a stereo audio output.

A non-transitory computer-readable medium may store instructions readable by a processor for destressing an agent in a contract center. The instructions may cause the processor to run a monitoring and triggering application (“MTA”) to identify a state of stress of the agent. The MTA may run an artificial intelligence machine learning (“MTA AI / ML”) algorithm to identify the state of stress in which a first data stream feature (“first feature”) may have a first emotion of the agent that registers above a first feature threshold that corresponds to the first feature, and a second data stream feature (“second feature”) that is contemporaneous with the first feature may have a second emotion of the agent that is aligned with the first emotion of the agent when the first emotion registers above the first feature threshold and the second emotion, contemporaneous with the first emotion, registers above a second feature threshold.

A method and system for digital learning materials that offer an advanced audio-visual interactive experience tailored for foundation courses, language speaking courses, and similar educational contexts. The core aspect of this invention is the integration of audio-visual elements to enhance the learning experience, students can engage with multimedia resources that combine auditory and visual stimuli. This approach caters to diverse learning preferences and promotes better comprehension and retention. To reinforce learning and gauge comprehension, the system includes various exercises and self-assessment tools like quizzes, interactive puzzles, word games, and speaking exercises for language learners. The exercises are designed to be engaging and interactive, encouraging active participation. A key innovation is the integration of audio prompts and feedback within the exercises. Students may listen to audio instructions and record their answers using a microphone. Similarly, audio feedback is provided immediately after completing an exercise, offering reinforcement and guidance.

A system for acquiring, identifying and processing images and soft biometrics includes an image acquisition device, a pan-tilt device, a speaker for audio feedback, and a microphone for voice acquisition, all of which are controlled by a computing device. Image acquisition is enhanced by detecting image focusing, facial recognition matching, detecting the number of objects and unwanted objects, and checking cropped images, including detecting whether eyes and mouth are open or closed, detecting red eyes, detecting background color, detecting lighting conditions, and detecting the positions, postures and expressions of the objects. Soft biological features are also identified, tailored, and classified, including scars, markers, and tattoos.