97 results about "Auditory information" patented technology

This paperless book is portable and uses removable ROM devices to provide the visual and aural information displayed in the paperless book. The book can be read in a visual mode, as print, or in an aural mode, as the spoken word corresponding to the print, or in both visual and aural modes. The display mode may be conveniently shifted back and forth between visual and aural, for use, for example, by a counter who uses the book in the aural mode while driving and switches to the visual mode while riding on a train. In addition, the visual display may be manipulated affecting the appearance, for use, for example, by persons with reduced visual acuity. Movies also may be viewed using the paperless book. Finally, portions of the text may be enhanced by additional visual images, music or other sounds.

Provided is a method and apparatus for providing composition information in a digital image processing device whereby composition information of a target object displayed in a live-view screen is provided using auditory information or visual information during photographing in order to induce a composition of the target object to be matched to a predetermined composition for photographing. The apparatus includes a detection unit detecting a composition of an object from a live-view image to be captured, a comparison unit comparing the detected composition with a reference composition, and a control unit performing a control operation to output an auditory alert signal until the detected composition is matched to the reference composition and performing a control operation to output an auditory match signal when the detected composition is matched to the reference composition.

A robot visuoauditory system that makes it possible to process data in real time to track vision and audition for an object, that can integrate visual and auditory information on an object to permit the object to be kept tracked without fail and that makes it possible to process the information in real time to keep tracking the object both visually and auditorily and visualize the real-time processing is disclosed. In the system, the audition module (20) in response to sound signals from microphones extracts pitches therefrom, separate their sound sources from each other and locate sound sources such as to identify a sound source as at least one speaker, thereby extracting an auditory event (28) for each object speaker. The vision module (30) on the basis of an image taken by a camera identifies by face, and locate, each such speaker, thereby extracting a visual event (39) therefor. The motor control module (40) for turning the robot horizontally. extracts a motor event (49) from a rotary position of the motor. The association module (60) for controlling these modules forms from the auditory, visual and motor control events an auditory stream (65) and a visual stream (66) and then associates these streams with each other to form an association stream (67). The attention control module (6) effects attention control designed to make a plan of the course in which to control the drive motor, e.g., upon locating the sound source for the auditory event and locating the face for the visual event, thereby determining the direction in which each speaker lies. The system also includes a display (27, 37, 48, 68) for displaying at least a portion of auditory, visual and motor information. The attention control module (64) servo-controls the robot on the basis of the association stream or streams.

A blind aid device including enabling a blind person to activate the blind aid device; capturing one or more images related to a blind person's surrounding environment; detecting moving objects from the one or more images captured; identifying a finite number of spatial relationships related to the moving objects; analyzing the one or more images within the blind aid device to classify the finite number of spatial relationships related to the moving objects corresponding to predefined moving object data; converting select spatial relationship information related to the one or more analyzed images into audible information; relaying select audible information to the blind person; and notifying the blind person of one or more occurrences predetermined by the blind person as actionable occurrences.

A device includes a visual-feature detecting unit that detects a visual feature of a sound source based on an image and visual information thereof and outputs visually localizing information indicative of at least a direction thereof, an auditory-feature detecting unit that detects an auditory feature of the sound source based on a sound and auditory information of the sound source and outputs auditorily localizing information indicative of at least the direction thereof, and a sound-source detecting unit that detects a position of the sound source based on the visually localizing information and the auditorily localizing information.

The invention describes improved methods and mechanisms for providing secure access to pharmaceutical and supply items in a clinical setting. In one version of the invention, a dispensing unit has an interior housing one or more drawers. Each drawer has one or more storage locations. The fronts of the drawers are covered with one or more locking doors, preventing access to a particular drawer, unless the covering door is unlocked. Indicators are mounted on the side of the enclosure, to guide the user to a drawer covered by an associated unlocked door. The unit further includes indicators on the sides of the drawers, to guide the user to the right storage receptacles or pockets within the drawer. Some pockets may have lids. Some of the lids may have locks. Sensors associated with at least some of the individual pocket lids may be provided to detect the lifting of a lid. Means to automatically detect the entry of a hand or fingers into a pocket may be provided. One or more loudspeakers may be mounted on the unit, to provide auditory guidance and confirmation of correct access, by sounds and voice prompts. One or more video cameras may be mounted on the unit. A processor is mounted in the unit, or, in the case of an auxiliary unit, the auxiliary unit is connected to the processor on the main unit. The processor is connected to receive signals from sensors in the dispensing unit, from the video camera, and to send signals to the indicators, and to send auditory information to loudspeakers which are designed to focus the sound specifically to the user. Modular locking drawers may be mounted in this unit also, dispensing individual doses using a method where the drawer has to be fully closed for each unit dose of medication taken.

An earphone system, apparatus, and method enables a user to simultaneously receive auditory stimuli from an earphone-based source and at least one secondary source thereby enhancing a user's personal safety while listening to earphone-based auditory stimuli. At least one primary earphone device having a loudspeaker is positioned adjacent the user's ear so as to allow aural perception of other, non-earphone-based auditory information or stimuli. In a preferred embodiment, an earphone device is both removably fastened and adjustable relative to underlying support structure so as to more properly direct earphone-based auditory stimuli toward the user's ear.

The invention discloses a micro intelligent vehicle based on visual and auditory information, which relates to the field of automation and comprises an image gathering module, a vehicle interactive module, a central module and a motion execution module. The image gathering module is connected with the central module for gathering video images in the front direction and the back direction of the micro intelligent vehicle and sending the video images to the central module. The vehicle interactive module is connected with the central module for performing information interaction with other vehicles through lamp lights and sirens according to the interactive control information of the central module and transmits the received interaction information to the central module. The central module is used for processing the video images and the interactive information, making driving decisions according to the processing results and further generating motion control information. The motion execution module is connected with the central module and used for achieving speed variation and steering of the micro intelligent vehicle according to motion control information. The micro intelligent vehicle provides forceful support for study experiments of multi-vehicle interaction of intelligent vehicles.

Provided is a method and an apparatus for providing composition information in a digital image processing device whereby composition information of a target object displayed in a live-view screen is provided using auditory information or visual information during photographing in order to induce a composition of the target object to be matched to a predetermined composition for photographing. The apparatus includes a detection unit detecting a composition of an object from a live-view image to be captured, a comparison unit comparing the detected composition with a reference composition, and a control unit performing a control operation to output an auditory alert signal until the detected composition is matched to the reference composition and performing a control operation to output an auditory match signal when the detected composition is matched to the reference composition.

Robotics visual and auditory system is provided which is made capable of accurately conducting the sound source localization of a target by associating a visual and an auditory information with respect to a target. It is provided with an audition module (20), a face module (30), a stereo module (37), a motor control module (40), an association module (50) for generating streams by associating events from said each module (20, 30, 37, and 40), and an attention control module (57) for conducting attention control based on the streams generated by the association module (50), and said association module (50) generates an auditory stream (55) and a visual stream (56) from a auditory event (28) from the auditory module (20), a face event (39) from the face module (30), a stereo event (39a) from the stereo module (37), and a motor event (48) from the motor control module (40), and an association stream (57) which associates said streams, as well as said audition module (20) collects sub-bands having the interaural phase difference (IPD) or the interaural intensity difference (IID) within the preset range by an active direction pass filter (23a) having a pass range which, according to auditory characteristics, becomes minimum in the frontal direction, and larger as the angle becomes wider to the left and right, based on an accurate sound source directional information from the association module (50), and conducts sound source separation by restructuring the wave shape of the sound source.

The invention provides a sound-based method and apparatus for generating an AR content and a storage medium. The method comprises: step 11, acquiring real-time voice data in a current AR environment;S131, determining whether the real-time voice data include a speaker; and if so, converting a speech content of the speaker in the real-time voice data into a text and extracting key semantic information; S132, extracting an artificial non-speaking sound or natural sound in the real-time voice data; S133, locating sound source locations of the speaker and the artificial non-speaking voice or natural sound; S15, carrying out scene matching based on the key semantic information and artificial non-speaking voice or natural sound; and S17, generating an AR content according to the key semantic information, the sound source locations, the scene or a real scene image in the AR environment and displaying the AR content. With the method provided by the invention, the AR content can be dynamicallygenerated based on the input voice and the AR intelligent display of the auditory information can be realized; and thus the convenient and intelligent services and experience can be provided for users.

A mobile communication terminal interacts with a digital hearing aid and a wireless hearing aid uses the mobile communication terminal. When a user having the mobile communication terminal interworking with the digital hearing aid operates the hearing aid, an amplification function suitable for auditory characteristics of the user is performed. That is, when auditory information of the user is sent to the terminal, the terminal adjusts an amplification gain to prevent the acoustic shock by measuring an environmental signal. The terminal computes an environment profile by analyzing the measured environmental signal and auditory information of the user sent from the hearing aid and automatically adjusts a non-linear amplification level according to a user environment by sending the environment profile to the hearing aid.

A space is set substantially in a tropical rain forest type environment to activate a human's essential brain region and realize an environment suitable for the human's brain by arranging a device for setting the tropical rain forest type environment based on characteristics of activating human's essential brain region responsive to tropical rain forest type environment information, in a space such as an urban space, a housing space or other living space. The tropical rain forest type environmental information has higher density and higher complexity than those of urban space type environmental information, and includes at least one of auditory information, visual information, and super perceptual information of aerial vibration. The tropical rain forest type environmental information is comfortable for the human with no excessive stress, and is environmental information for effecting prevention and treatment of diseases due to stress by realizing the environment comfortable for the human's brain.

A device includes a visual-feature detecting unit that detects a visual feature of a sound source based on an image and visual information thereof and outputs visually localizing information indicative of at least a direction thereof, an auditory-feature detecting unit that detects an auditory feature of the sound source based on a sound and auditory information of the sound source and outputs auditorily localizing information indicative of at least the direction thereof, and a sound-source detecting unit that detects a position of the sound source based on the visually localizing information and the auditorily localizing information.

Methods and systems for providing auditory messages for medical devices are provided. One system includes at least one medical device configured to generate a plurality of medical messages and a processor in the at least one medical device configured to generate an auditory signal corresponding to one of the plurality of medical messages. The auditory signal is configured based on a functional relationship linking psychological sound perceptions in a clinical environment to acoustic and musical sound variables.

The invention provides a vision auxiliary method converting vision information to auditory information. The method includes steps of 1, performing image collection, namely, obtaining images of surrounding environment by using a binocular camera; 2, performing target extraction on obtained image information; 3, utilizing an image analyzing method for obtaining a spatial position (4) of an attention target; 4, utilizing a head-related transfer function for generating 3D sound image signals containing spatial position information of the target object. A blind person can recover the spatial information of the attention target through receiving the sound signals. The method can achieve an aim of helping blind persons avoid barriers in way and providing convenience for blind person travel.

A method and system for registering information about a variety of property items either centrally or in distributed fashion enables quick notification of proper authorities when the property item is stolen. The system can invoke police authority networks and / or a private security system network. Various types of information can be stored in a central database accessible over a public network such as the Internet, or locally on a personal credential item, such as a security card carried with the owner / user of the property item. Information types can include descriptive textual information, visual information, and auditory information about the property item and its owner or user. When the item is discovered stolen, the card can be scanned at a variety of participating card reader devices, which can include ATM machines, retail point-of-sale scanners, gas station pumps, and any other properly equipped public / private / commercial devices. In this way, the system of the present invention automates the notification of proper authorities, and / or the public in general via a network, which may be the Internet, of the theft of a particular property item.

A video call method and system may use a two-way transmission of a visual effect or an auditory effect. A server may manage and store content that includes visual information or auditory information as an effect to apply to a video call in association with an effect identifier. A server may receive, during the video call, an effect identifier and may transmit the visual information or audio information associated with the effect identifier to a reception-side electronic device together with a data packet for the video call.

Robotics visual and auditory system is provided which is made capable of accurately conducting the sound source localization of a target by associating a visual and an auditory information with respect to a target. It is provided with an audition module (20), a face module (30), a stereo module (37), a motor control module (40), an association module (50) for generating streams by associating events from said each module (20, 30, 37, and 40), and an attention control module (57) for conducting attention control based on the streams generated by the association module (50), and said association module (50) generates an auditory stream (55) and a visual stream (56) from a auditory event (28) from the auditory module (20), a face event (39) from the face module (30), a stereo event (39a) from the stereo module (37), and a motor event (48) from the motor control module (40), and an association stream (57) which associates said streams, as well as said audition module (20) collects sub-bands having the interaural phase difference (IPD) or the interaural intensity difference (IID) within the preset range by an active direction pass filter (23a) having a pass range which, according to auditory characteristics, becomes minimum in the frontal direction, and larger as the angle becomes wider to the left and right, based on an accurate sound source directional information from the association module (50), and conducts sound source separation by restructuring the wave shape of the sound source.

The present invention relates to a display apparatus and a control method thereof which can provide visual information or auditory information to a user while the display apparatus is being booted, and variously change the information that is provided during the booting process.

A video call method and system may use a two-way transmission of a visual effect or an auditory effect. A server may manage and store content that includes visual information or auditory information as an effect to apply to a video call in association with an effect identifier. A server may receive, during the video call, an effect identifier and may transmit the visual information or audio information associated with the effect identifier to a reception-side electronic device together with a data packet for the video call.

The subject invention leverages spectral “palettes” or representations of an input sequence to provide recognition and / or synthesizing of a class of data. The class can include, but is not limited to, individual events, distributions of events, and / or environments relating to the input sequence. The representations are compressed versions of the data that utilize a substantially smaller amount of system resources to store and / or manipulate. Segments of the palettes are employed to facilitate in reconstruction of an event occurring in the input sequence. This provides an efficient means to recognize events, even when they occur in complex environments. The palettes themselves are constructed or “trained” utilizing any number of data compression techniques such as, for example, epitomes, vector quantization, and / or Huffman codes and the like.

The subject invention leverages spectral “palettes” or representations of an input sequence to provide recognition and / or synthesizing of a class of data. The class can include, but is not limited to, individual events, distributions of events, and / or environments relating to the input sequence. The representations are compressed versions of the data that utilize a substantially smaller amount of system resources to store and / or manipulate. Segments of the palettes are employed to facilitate in reconstruction of an event occurring in the input sequence. This provides an efficient means to recognize events, even when they occur in complex environments. The palettes themselves are constructed or “trained” utilizing any number of data compression techniques such as, for example, epitomes, vector quantization, and / or Huffman codes and the like.

A multimodal intervention method provides instructional media that connects elements of music with non-phonemic components of spoken language to enhance receptive language acquisition and literacy learning in children with various disorders affecting language, particularly children with autism, developmental language disorders, and cochlear implant recipients. The intervention enables children with limited or no language to become meaningfully engaged in multimodal activities that encourage development of auditory cognition and cognition generally without the need for preexisting language. It uses music, to which children are naturally drawn, for exploration of connections between auditory and visual information to help them learn to differentiate and recognize objects by auditory information; compare and categorize this information; memorize and retrieve from memory; and form auditory objects. The method helps to engage both primary and higher order auditory processing simultaneously in the form of play and problem solving, and introduces children to basic reading.

A method of controlling a head mounted display (HMD) according to one embodiment of the present specification includes the steps of outputting visual information via a display unit, outputting auditory information via an audio output unit, detecting a control input touching a first region or a second region of a temple of the HMD, if the control input is detected in the first region, setting the visual information as control target information, if the control input is detected in the second region, setting the auditory information as the control target information, and controlling an output of the set control target information according to an attribute of moving of the control input, which moves in the first region and the second region while maintaining a contact with the temple of the HMD.

The invention discloses a crosswalk identification alarm system based on RFID. The crosswalk identification alarm system based on RFID comprises a RFID reader, a vehicle-mounted display alarm device, an external circularly-polarized antenna, and a road-buried electronic label device. The RFID reader comprises a control unit module, a radio frequency module, an antenna interface, a power supply module 1, and a serial port communication module 1. The vehicle-mounted display alarm device comprises a power supply module 2, a single chip microcomputer, a display screen display screen, an alarm, and a serial port communication module 2. The road-buried electronic label device comprises an electronic label, a PC endurance board, and a silver reflective membrane. The system takes the initiative in acquiring the data of the electronic label close to the crosswalk with a RFID automatic identification method, fast acquires accurate distance between a vehicle and the crosswalk in real time, and provides a motor vehicle driver with positional warning and real-time alarm within effective distance in advance with a liquid crystal screen display and alarm manner. With visual and auditory information feedback, no matter the sight of the driver is shielded or no crosswalk advance identification is provided, the motor vehicle driver may know the effective distance between himself or herself and the crosswalk in order to timely take corresponding measures.