96 results about "Audio feedback" patented technology

Method for generating haptic and audio feedback responses starts with processor causing communication interface for communication session to be displayed on first and second user interfaces. Communication interface includes first area and second area. Processor detects first touch input on first user interface and second touch input on second user interface and determines location of first touch input being in first area and location of second touch input being in second area. Processor causes first and second user interfaces to generate first audio feedback response associated with first area and second audio feedback response associated with second area. In response to determining that location of first touch input is updated to second area while the location of the second touch input is in second area, processor causes first and second user interfaces to generate enhanced audio feedback response and enhanced haptic response feedback. Other embodiments are described herein.

A system for controlling unmanned vehicles such as drones, ground vehicles and robots includes multiple human-to-machine interface components to manage interactions efficiently and effectively between humans and robots with respect to control mechanisms (i.e., inputs such as voice-commands or joystick use) and monitoring (i.e., outputs such as camera or other sensor feeds, geolocation overlay, or audio feedbacks). A system according to the principles of the invention includes numerous modalities for control (e.g., voice-control, gesture-control, touch screen, joystick or other hand-held controllers) as well as monitoring (visual screen display, heads-up-display, audio feedbacks, geolocation overlay, haptic feedback, wearable sensor devices). The system is preferably expandable and may include additional modalities in the future, such as eye-tracking as compared to voice or gesture control.

A system for capturing, identifying, and processing images and soft biometrics includes an image capture device, a pan and tilt device, a speaker for audio feedback, and a microphone for voice capture, all controlled by a computing device. Image capture is enhanced by detecting image focus, facial recognition matching, detecting the number of subjects and unwanted objects, and checking the cropped image by detecting whether eyes and mouth are open or closed, detecting redeye, detecting background color, detecting lighting conditions, and detecting subject location, pose and expression. Soft biometrics including scars, marks, and tattoos are also identified, cropped and classified.

Systems and methods for preventing potential audio feedback loops are provided. In an example method, a first client device joins a video conference hosted by a video conference provider, the video conference having multiple participants each using a client device, including the first client device and a second client device. The first client device identifies a potential audio feedback loop between the first client device and the second client device based on contextual information, first information about a first position of the first client device, and second information about a second position of the second client device. The first client device executes a command to prevent the potential audio feedback loop.

A system for capturing, identifying, and processing images and soft biometrics includes an image capture device, a pan and tilt device, a speaker for audio feedback, and a microphone for voice capture, all controlled by a computing device. Image capture is enhanced by detecting image focus, facial recognition matching, detecting the number of subjects and unwanted objects, and checking the cropped image by detecting whether eyes and mouth are open or closed, detecting redeye, detecting background color, detecting lighting conditions, and detecting subject location, pose and expression. Soft biometrics including scars, marks, and tattoos are also identified, cropped and classified.

Method for generating haptic and audio feedback responses starts with processor causing communication interface for communication session to be displayed on first user interface and on a second user interface. Processor detects first touch input on first user interface and second touch input on second user interface. Processor monitors location of the first touch input on the first user interface and location of the second touch input on the second user interface. Processor determines distance between location of first touch input on first user interface and location on first user interface corresponding to location of second touch input on second user interface. In response to determining that the distance is below predetermined threshold, processor causes first user interface and second user interface to generate an initial haptic feedback response and an initial audio feedback response. Other embodiments are described herein.

The invention belongs to the technical field of medical instrument control, and particularly discloses a single-line digital audio output control system of high-frequency surgical equipment, which comprises the steps of constructing a multi-dimensional parameter fused state perception and semantic audio feedback mechanism, accurately identifying the working mode, the power level and the output stability of the equipment through auditory sense, and controlling the output of the high-frequency surgical equipment according to the state perception and semantic audio feedback mechanism. The operation burden and the misjudgment risk in a complex operation environment are effectively reduced; transmission of audio, data and a power supply is integrated by adopting a single-line digital audio bus, so that the internal structure and the electromagnetic compatibility of equipment are optimized fundamentally; by establishing a set of self-adaptive safety closed loop from communication quality monitoring to power and audio cooperative control, the health condition of a communication link can be actively monitored, and when it is detected that the communication quality is reduced, protective measures such as power reduction and safety alarm are automatically triggered, and the potential control failure risk is eliminated in the bud.

A flight simulator virtual instructor training module that interfaces with a home flight simulator is provided. The system and method aims to enhance the flight simulation experience by providing real-time feedback and scoring based on the user's performance, leveraging artificial intelligence to generate context-specific messages and audio feedback. This could potentially improve the user's learning curve and overall flight simulation experience.

Electronic devices may be provided that contain flexible displays that are bent to form displays on multiple surfaces of the devices. Bent flexible displays may be bent to form front side displays and edge displays. Edge displays may be separated from front side displays or from other edge displays using patterned housing members, printed or painted masks, or by selectively activating and inactivating display pixels associated with the flexible display. Edge displays may alternately function as virtual buttons, virtual switches, or informational displays that are supplemental to front side displays. Virtual buttons may include transparent button members, lenses, haptic feedback components, audio feedback components, or other components for providing feedback to a user when virtual buttons are activated.

The invention relates to an intelligent plant interaction system and method based on a natural catalyst and a controller. The system comprises a natural catalyst sensing module which comprises a natural conductive medium serving as a touch sensor, and the natural conductive medium generates a capacitance signal when being touched by a human body; the control module is connected with the natural conducting medium and is used for obtaining a capacitance value of the touch sensor according to the capacitance signal; judging whether the current touch operation is valid or not based on the current capacitance threshold value and the capacitance value; when the current touch operation is effective touch, a display instruction is sent to a visual feedback module, and the touch interval time between the current touch operation and the last effective touch is calculated; and determining an audio feedback mode corresponding to the current touch operation according to the touch interval time, and extracting feedback audio from an audio file set corresponding to the audio feedback mode. By adopting the system, the man-machine interaction effect of the intelligent flowerpot can be improved.

A non-transitory computer-readable medium may store instructions readable by a processor for destressing an agent in a contract center. The instructions may cause the processor to run a monitoring and triggering application (“MTA”) to identify a state of stress of the agent. The MTA may run an artificial intelligence machine learning (“MTA AI / ML”) algorithm to identify the state of stress in which a first data stream feature (“first feature”) may have a first emotion of the agent that registers above a first feature threshold that corresponds to the first feature, and a second data stream feature (“second feature”) that is contemporaneous with the first feature may have a second emotion of the agent that is aligned with the first emotion of the agent when the first emotion registers above the first feature threshold and the second emotion, contemporaneous with the first emotion, registers above a second feature threshold.

The invention discloses a piano tuning auxiliary positioning system, belongs to the technical field of musical instrument tuning, and aims to solve the problem of positioning deviation caused by neglecting string tension dynamic evolution and environmental disturbance in the prior art. The system comprises a tuning peg state sensing module, a string tension evolution monitoring module, a central cooperative controller, a man-machine interaction guide module and an audio feedback verification module. Through fusion of triple information of tuning peg angular displacement, tension steady state discrimination and acoustic frequency feedback, staged accurate guidance and dynamic decision are realized. The system rapidly approaches the target in the coarse tuning stage, premature termination is avoided in the fine tuning stage according to the tension steady state, the tuning accuracy is ensured through audio closed-loop verification, and the tuning precision, efficiency and robustness are remarkably improved.

The invention provides an audio playing method and device, and the method comprises the steps: receiving a key control instruction submitted by a user through key equipment, and analyzing the key control instruction, thereby obtaining key control information. And determining a target key pressing force matched with the key pressing control information, and determining a target audio matched with the target key pressing force. And taking the target audio as a response of the key control instruction, and playing the target audio for the user. The corresponding target audio is played according to the key control operation of the user, and the audio feedback is directly associated with the key operation of the user, so that the key device without pressure induction can simulate the key pressure and play the target audio matched with the key pressure, and the user experience is improved.

The application discloses an audio and video signal extension device and method, a storage medium and a program product, and relates to the technical field of signal processing. The device comprises the following steps: connecting a sending end and a receiving end through a network cable; the sending end comprises a first audio and video signal interface, a first network cable interface and an audio feedback processing module; the receiving end comprises a second network cable interface, a second audio and video signal interface and an audio feedback module; when audio signals are fed back from a target device to a signal source device: the receiving end receives the audio signals fed back by the target device through the second audio and video signal interface, embeds the audio signals in a video frame through the audio feedback module to obtain a composite signal, and feeds back the composite signal to the sending end through the second network cable interface; the sending end receives the composite signal through the first network cable interface, extracts the audio signals from the composite signal through the audio feedback processing module, and outputs the audio signals to the signal source device through the first audio and video signal interface.

The present disclosure generally relates to interacting with audio data via motion input. In some embodiments, methods, devices, and techniques are provided for detecting motion input to interact with audio notifications, providing audio feedback for detected motion gestures, and detecting motion input in a spatial audio arrangement.

The invention relates to a method for identifying an object target by an agent based on a large model, and the method comprises the steps: constructing an object identification agent TRA which comprises a target detection library module, a function module and a large language model, and the function module comprises a target detection library and an object identification module; performing fine tuning on the TRA by using the fine tuning data set to obtain a fine-tuned TRA; and for a piece of new voice data, the fine-tuned TRA identifies and outputs audio feedback. According to the method, a traditional large model is combined with a small model special for the field, multi-modal data can be processed, a series of instructions can be executed, and therefore the human participation degree in the task execution process is further reduced. The TRA constructed by the large language model subjected to instruction fine tuning can perform object identification and key information analysis processing tasks according to the natural language instruction, the efficiency is high, and the overall effect is ideal.

Communication methods, devices, and systems are described for supporting audio menu navigation and option selection via a display device. To support audio menu navigation and option selection via a display device, a communication connection is established between an automated voice menu system and a user device, one or more option selections corresponding to an option menu are determined, a user interface is generated at the user device including an arrangement of elements corresponding to the one or more option selections, input is received from a user via the user interface, and a response is sent from the user device to the automated voice menu system via the communication connection based at least in part on the input received from the user, wherein the response is responsive to audio feedback and indicates a selection of a subset of the determined one or more option selections.

We provide the system. [Solution] Information collection methods for collecting users' biometric data, A signal transmission means for transmitting the aforementioned biometric data to an augmented reality platform, The platform includes a diagnostic means that analyzes the biometric data to evaluate the user's mental state, Activity generation means that generates activities optimized for the user based on the results of the diagnostic means, A presentation means for notifying the user of the generated activity through visual or audio feedback, A feedback collection means collects user responses to the aforementioned activities again using information gathering means and reflects them in subsequent optimization, A system that includes this.

System (100) for wearable smart glasses that provides improved visual support to visually impaired users, wherein the system (100) comprises: a frame (102) wherein the frame (102) is configured to accommodate electronic components; an image acquisition unit (104), wherein the image acquisition unit (104) is designed to be able to capture visual data in real time under low light conditions and daylight; a processing unit (106) wherein the processing unit (106) is functionally coupled to the image acquisition unit and is configured to execute deep learning models for image enhancement, object detection, extraction of prominent objects and text recognition; an augmented reality module (108) coupled to a processor, wherein the augmented reality module (108) is configured to overlay context-related digital information onto the user's field of vision; an IoT communication interface (110), wherein the IoT communication interface (110) enables real-time connectivity with external devices and cloud services; and an output interface (112), wherein the output interface (112) comprises audio feedback, haptic feedback or a tactile display designed to transmit detected information to the user.

To provide a method, system and non-transitory computer-readable recording medium for audio feedback during a live broadcast.SOLUTION: A method implemented on a computer system includes providing a live broadcast by receiving broadcast content transmitted from an electronic device of a caster, and by streaming the received broadcast content to electronic devices of multiple users through a communication session established between an account of the caster and accounts of the users; receiving audio feedback about the live broadcast from an electronic device of a user during the live broadcast; and delivering the audio feedback to the electronic device of the caster.SELECTED DRAWING: Figure 4

The application provides an audio playing method and device, wherein the audio playing method comprises the following steps: receiving a key control instruction submitted by a user through a key device, analyzing the key control instruction, and obtaining key control information; determining a target key force that matches the key control information, and determining a target audio that matches the target key force; taking the target audio as a response to the key control instruction, and playing the target audio for the user. The application realizes playing of a corresponding target audio according to a key control operation of the user, associates the audio feedback with the key operation of the user directly, enables a key device without pressure sensing to simulate key pressure, plays a target audio that matches the key pressure, and improves user experience.

Described herein are examples of hardware-based voice-activated artificial intelligence (AI) systems for versatile task execution which include an input interface, a processing module, a control circuit, a communication module, and an audio device. The input interface may include a microphone configured to receive spoken language input provided by a user in the form of an audio signal and a converter configured to convert the captured audio signal to a digital signal. The processing module may include a central processing unit (CPU) and memory, configured to process the received spoken language input by executing a machine learning algorithm or a natural language processing routine stored in the memory. The control circuit may generate a response or action based on the spoken language input. The communication module may be communicatively linked with an external system. The audio device may be configured to provide a voice-based response or audio feedback to the user.

The invention discloses a multi-modal-based immersive self-adaptive treadmill rehabilitation training method and system, and the method comprises the steps: constructing a multi-modal synchronous data stream through synchronously collecting real-time posture data, surface electromyogram signals and treadmill state data of a user; further analyzing the gait quality, muscle activation and interaction state of the user in real time, and generating a multi-dimensional state vector; based on a preset self-adaptive strategy table, the state vector is compared with an expected threshold value of the current training stage, and a cooperative adjustment instruction aiming at the speed / gradient of the treadmill, the dynamic characteristics of the virtual scene and audio feedback is generated through intelligent decision; finally, closed-loop self-adaptive control is formed through multi-channel real-time feedback execution, and the training stage is automatically transited when conditions are met. According to the method, deep interaction and self-adaptive linkage of the physical training environment and the virtual immersion scene are realized, safer and more personalized rehabilitation training experience rich in sense of participation can be provided, and the accuracy and effect of rehabilitation training are effectively improved.

The application discloses a kind of multimodal sentiment analysis method and system, it is related to sentiment analysis technical field, method includes: to the text unimodal feature, audio unimodal feature and visual unimodal feature of multimodal sentiment data feature extraction are modality feedback interaction, generate text feedback feature, audio feedback feature and visual feedback feature;Text feedback feature, audio feedback feature and visual feedback feature are encoded by language encoder and non-language encoder, determine the mixed encoding feature of text feedback feature and the splicing of audio encoding feature and visual encoding feature;Text encoding feature and mixed encoding feature are used to carry out feature screening interaction, determine text screening feature, mixed screening feature and cross screening feature;Based on text screening feature, mixed screening feature and cross screening feature output sentiment analysis result.Based on the above scheme, it can prevent information mixed and interference between modes, help to improve sentiment analysis reliability.

A system is provided.SOLUTION: The system includes a means for acquiring a voice input of a user, a means for converting the acquired voice into a text, a means for analyzing the text by using a generation AI and generating an appropriate response, a means for converting the generated response into a voice, a means for giving voice feedback to the user, and a means for storing conversation date with the user and using it in the next use.SELECTED DRAWING: Figure 1

The system according to the embodiment aims to enable a visually impaired person to grasp the environment of their current location in a timely manner. [Solution] A system according to an embodiment includes an image acquisition unit, a position acquisition unit, an analysis unit, and a feedback unit. The image acquisition unit acquires image information. The position acquisition unit acquires position information. The analysis unit analyzes the information acquired by the image acquisition unit and the position acquisition unit. The feedback unit provides audio feedback of the information analyzed by the analysis unit.

Electronic devices may be provided that contain flexible displays that are bent to form displays on multiple surfaces of the devices. Bent flexible displays may be bent to form front side displays and edge displays. Edge displays may be separated from front side displays or from other edge displays using patterned housing members, printed or painted masks, or by selectively activating and inactivating display pixels associated with the flexible display. Edge displays may alternately function as virtual buttons, virtual switches, or informational displays that are supplemental to front side displays. Virtual buttons may include transparent button members, lenses, haptic feedback components, audio feedback components, or other components for providing feedback to a user when virtual buttons are activated.

The invention discloses an intelligent blind-assisting glasses system and method for stereoscopic perception of an environment, relates to the field of voice prompt, and solves the problem of lack of accuracy of voice prompt of existing intelligent blind-assisting glasses, and the system comprises a data acquisition module which carries out the radar scanning of an external environment, and obtains environment data; the model construction module is used for processing the environment data, performing three-dimensional space mapping on the environment data to obtain a mapping value, and performing model construction on an external environment according to the mapping value to obtain an environment model; the intelligent judgment module is used for collecting action information of a user of the intelligent blind-assisting glasses, judging obstacles in combination with an environment model according to the action information of the user and carrying out audio feedback on the user; the voice interaction module is used for autonomously setting audio feedback and obtaining different audio feedback according to a setting result of a user; the voice prompt accuracy of the intelligent blind-helping glasses can be effectively improved, and the travel safety of visually impaired people is guaranteed.

Acoustic imaging systems can include an acoustic sensing array, an electromagnetic imaging tool, a display, and an audio device. A processor can receive data from the acoustic sensor array and the electromagnetic imaging tool to generate a display image combining acoustic image data and electromagnetic image data. Systems can include an audio device that receives an audio output from the processor and outputs audio feedback signals to a user. The audio feedback signals can represent acoustic signals from an acoustic scene. Systems can provide a display image to a user including acoustic image data, and a user can select an acoustic signal for which to provide a corresponding audio output to an audio device. Audio outputs and display images can change dynamically in response to a change in pointing of the acoustic sensing array, such as by changing a stereo audio output.