3604 results about "Visual system" patented technology

In accordance with the present disclosure, a system and method for using a remote control to control an electrosurgical instrument, where the remote controlled (RC) electrosurgical instrument has a universal coupling mechanism to allow switching between an interchangeable catalog of diagnostic tools. A controller within the base of the RC electrosurgical instrument identifies the type of disposable tip attached to the base. The controller, then, activates necessary features for use with the identified tip and deactivates any unnecessary features. A surgeon uses a remote with at least one momementum sensor to control the RC electrosurgical instrument 10. The surgeon rotates his hand mimicking movements of a handheld electrosurgical instrument, the movements of which are translated and sent to the RC electrosurgical instrument. The surgeon may use an augmented reality (AR) vision system to assist the surgeon in viewing the surgical site.

A vehicle vision system includes a vehicle having first and second spatially separated image capture sensors. The first image capture device has a first field of view having a first field of view portion at least partially overlapping a field of view portion of a second field of view of the second image capture device. A control receives a first image input from the first image capture sensor and a second image input from the second image capture sensor and generates a composite image synthesized from the first image input and the second image input. A display system displays the composite image.

A vision system for a vehicle includes an imaging device having an imaging sensor, a camera microcontroller, a display device having a display element, a display microcontroller, and at least one user input selectively actuatable by a user. The imaging device communicates an image signal to the display device via a communication link. The display microcontroller affects the image signal in response to the at least one user input. The camera microcontroller monitors the image signal on the communication link and adjusts a function of the imaging device in response to a detection of the affected image signal. The vision system may adjust a display or sensor of the system in conjunction with a distance detecting system.

A method and system for processing captured image information in an interactive video display system. In one embodiment, a special learning condition of a captured camera image is detected. The captured camera image is compared to a normal background model image and to a second background model image, wherein the second background model is learned at a faster rate than the normal background model. A vision image is generated based on the comparisons. In another embodiment, an object in the captured image information that does not move for a predetermined time period is detected. A burn-in image comprising the object is generated, wherein the burn-in image is operable to allow a vision system of the interactive video display system to classify the object as background.

A technique for hiding of data, including watermarks, in human-perceptible images, that is, image host data, is disclosed. In one embodiment a method comprises three steps. In the first step, data to be embedded is inputted. In the case of a watermark, this data is a unique signature, and may be a pseudo-noise (PN) code. In the case of hidden data to be embedded in the host data, this data is the hidden data itself, or the hidden data as spread against the frequency spectrum by a pseudo-noise (PN) code. In the second step, the inputted data is embedded within the host data, in accordance with a perceptual mask of the host data. The perceptual mask determines the optimal locations within the host data to insert the inputted data. In the case of images, these optimal locations are determined by reference to the human visual system. In the third step, the host data, with the embedded data, is further masked by a non-frequency mask. In the case of image data, the non-frequency mask is a spatial mask.

A system and method to facilitate selection and programming of at least one of audio and visual program are disclosed. A first computer is operative to connect to a second computer for filtering through a plurality of audio and / or visual programs based on selection criteria to provide a filtered representation of programs. A program from the filtered representation of programs may be selected at the first computer so as to cause a token indicative of the selected program to be assigned to a recipient operative to receive the token. The recipient may be a user at the first computer, a third computer, or an entertainment appliance. The token represents the selected program with sufficient particularity to program an entertainment system based on the token to record the program represented by the token.

One embodiment is a lighting system associated with a machine vision system. The machine vision system may direct lighting control commands to the lighting system to change the illumination conditions provided to an object. A vision system may also be provided and associated with the machine vision system such that the vision system views and captures an image(s) of the object when lit by the lighting system. The machine vision system may direct the lighting system to change the illumination conditions and then capture the image.

A vehicle viewing system including a camera system for generating a signal corresponding to a scene by integrating light from the scene incident on pixel cells having a variable integration time, a display system for presenting a visual representation of the scene, and a processor system operable to determine the camera system integration time based on brightness levels in the scene. The camera system preferably includes and an input attenuating filter to limit light striking the optical array. The processor system includes an image brightness detector to determine overall image brightness and a display control to determine luminance settings for the display system. The processor system may determine the intensity of the display system based on the brightness of the scene, ambient light levels, and glare on the display. The display system includes a display and a display attenuation filter for limiting the intensity as viewed by the operator.

A panoramic system generally employs a panoramic input component, a processing component, and a panoramic display component. The panoramic input component a panoramic sensor assembly and / or image selectors that can be used on an individual or network basis. The processing component provides various applications such as video capture / control, image stabilization, target / feature selection, image stitching, image mosaicing, 3-D modeling / texture mapping, perspective / distortion correction and interactive game control. The panoramic display component can be embodied as a head mounted display device or system, a portable device, or a room.

A visual tree structure as specified by a program is constructed and maintained by a visual system's user interface thread. As needed, the tree structure is traversed on the UI thread, with changes compiled into change queues. A secondary rendering thread that handles animation and graphical composition takes the content from the change queues, to construct and maintain a condensed visual tree. Static visual subtrees are collapsed, leaving a condensed tree with only animated attributes such as transforms as parent nodes, such that animation data is managed on the secondary thread, with references into the visual tree. When run, the rendering thread processes the change queues, applies changes to the condensed trees, and updates the structure of the animation list as necessary by resampling animated values at their new times. Content in the condensed visual tree is then rendered and composed. Animation and a composition communication protocol are also provided.

A panoramic system comprises means for obtaining a panoramic image, and means for displaying the panoramic image.

Various embodiments of the present invention provide for systems and apparatus directed toward using a contact lens and deflection optics to process display information and non-display information. In one embodiment of the invention, a display panel assembly is provided, comprising: a transparent substrate that permits light to pass through substantially undistorted; a reflector disposed on the transparent substrate; and a display panel aimed toward the reflector and substantially away from a human visual system, wherein the reflector reflects light emitted from the display panel toward the human visual system. The reflector may comprise a narrow band reflector or a polarization reflector.

A lighting system associated with a machine vision system. The machine vision system may direct lighting control commands to the lighting system to change the illumination conditions provided to an object. A vision system may also be provided and associated with the machine vision system such that the vision system views and captures an image(s) of the object when lit by the lighting system. The machine vision system may direct the lighting system to change the illumination conditions and then capture the image.

A vehicle vision system includes a vehicle having first and second spatially separated image capture sensors. The first image capture device has a first field of view having a first field of view portion at least partially overlapping a field of view portion of a second field of view of the second image capture device. A control receives a first image input from the first image capture sensor and a second image input from the second image capture sensor and generates a composite image synthesized from the first image input and the second image input. A display system displays the composite image.

An immersive audio-visual system (and a method) for creating an enhanced interactive and immersive audio-visual environment is disclosed. The immersive audio-visual environment enables participants to enjoy true interactive, immersive audio-visual reality experience in a variety of applications. The immersive audio-visual system comprises an immersive video system, an immersive audio system and an immersive audio-visual production system. The video system creates immersive stereoscopic videos that mix live videos, computer generated graphic images and human interactions with the system. The immersive audio system creates immersive sounds with each sound resource positioned correct with respect to the position of an associated participant in a video scene. The immersive audio-video production system produces an enhanced immersive audio and videos based on the generated immersive stereoscopic videos and immersive sounds. A variety of applications are enabled by the immersive audio-visual production including casino-type interactive gaming system and training system.

Apparatus and methods for encoding sensory input information into patterns of pulses and message multiplexing. In one implementation, the patterns of pulses are polychronous (time-locked by not necessary synchronous), and a retinal prosthetic encodes the input signal into the polychronous patterns for delivery via stimulating electrodes. Different polychronous patterns simultaneously encode different sensory signals; (such as different features of the image), thus providing for message multiplexing. Increasing data transmission capacity allows for a reduction in the number of electrodes required for data transmission. In one implementation, an adaptive feedback mechanism is employed to facilitate encoder operation. In another aspect, a computer vision system is described.

A closed-loop vision system is disclosed that utilizes a concept known as Dynamically Reconfigurable Vision (DRV), which is adaptive image sensing driven by a computer or human operator's response to changing scenery. The system reduces the amount of irrelevant video information sensed and thus achieves more effective bandwidth and computational resource utilization, as compared to traditional vision systems. One or more reconfigurable photodetector arrays sensitive to either visible, infrared or ultraviolet radiation are present in the DRV system. These photodetector arrays feature on-chip means for spatial and temporal data reduction implemented through multiple independently controllable, time-correlated, frequently overlapping windows on the photodetector array that may be programmed according to their size, location, resolution, integration time, and frame rate. All photodetector array windows are dynamically reconfigurable in real time on a frame-by-frame basis. Furthermore, a DRV system is constructed in a client-server architecture in which a vision processor client passes window request command messages to the reconfigurable photodetector array server, which in turn delivers the requested video back to the client processor. The ability to simultaneously reconfigure, integrate, process, and readout multiple photodetector array video windows is an important characteristic of the DRV system.

An immersive audio-visual system (and a method) for creating an enhanced interactive and immersive audio-visual environment is disclosed. The immersive audio-visual environment enables participants to enjoy true interactive, immersive audio-visual reality experience in a variety of applications. The immersive audio-visual system comprises an immersive video system, an immersive audio system and an immersive audio-visual production system. The video system creates immersive stereoscopic videos that mix live videos, computer generated graphic images and human interactions with the system. The immersive audio system creates immersive sounds with each sound resource positioned correct with respect to the position of an associated participant in a video scene. The immersive audio-video production system produces an enhanced immersive audio and videos based on the generated immersive stereoscopic videos and immersive sounds. A variety of applications are enabled by the immersive audio-visual production including casino-type interactive gaming system and training system.

This invention provides a system and method for runtime determination (self-diagnosis) of camera miscalibration (accuracy), typically related to camera extrinsics, based on historical statistics of runtime alignment scores for objects acquired in the scene, which are defined based on matching of observed and expected image data of trained object models. This arrangement avoids a need to cease runtime operation of the vision system and / or stop the production line that is served by the vision system to diagnose if the system's camera(s) remain calibrated. Under the assumption that objects or features inspected by the vision system over time are substantially the same, the vision system accumulates statistics of part alignment results and stores intermediate results to be used as indicator of current system accuracy. For multi-camera vision systems, cross validation is illustratively employed to identify individual problematic cameras. The system and method allows for faster, less-expensive and more-straightforward diagnosis of vision system failures related to deteriorating camera calibration.

A system and method to facilitate selection and programming of at least one of audio and visual program are disclosed. A first computer is operative to connect to a second computer for filtering through a plurality of audio and / or visual programs based on selection criteria to provide a filtered representation of programs. A program from the filtered representation of programs may be selected at the first computer so as to cause a token indicative of the selected program to be assigned to a recipient operative to receive the token. The recipient may be a user at the first computer, a third computer, or an entertainment appliance. The token represents the selected program with sufficient particularity to program an entertainment system based on the token to record the program represented by the token.

The efficient and intuitive presentation, navigation, and selection of available AV information in a graphical user interface (GUI) that is displayed on a display apparatus of an AV system and controlled through user manipulation of a scrolling mechanism of a navigation and selection device of the AV system. Related AV information is organized as items within lists that correspond to various navigable fields of a status bar of the GUI during the GUI interactive mode. A highlighted navigable field of the status bar displays its list of related AV information and the items of the list are scrolled through the navigable field by a user causing the scrolling mechanism to move in a scroll. A different field of the status bar may be selected by the user moving the scrolling mechanism in a lateral movement. Activation of the selection mechanism of the navigation and selection device will cause an AV device of the system to be controlled in accordance with the AV options displayed within the status bar fields at the time the selection mechanism is activated.

Systems and methods are provided through which a model-based vision system for dentistry which assists in diagnosis, treatment planning and surgical simulation. The present invention includes an integrated computer vision system that constructs a three-dimensional (3-D) model of the patient's dental occlusion using an intra-oral video camera. A modified shape from shading technique, using perspective projection and camera calibration, extracts the 3-D information from a sequence of two-dimensional images of the jaw. Data fusion of range data and 3-D registration techniques develop a complete 3-D digital jaw model. Triangulation of the 3-D digital model is then performed, and optionally, a solid 3-D model is reconstructed.

The present invention features a network-based in-store media broadcasting system comprising one or more, and preferably, a plurality of client player devices placed at a plurality of business locations, each of the client player devices being independently supported and in communication with the internal audio / visual system installed in the business location; a customizable broadcast supported on each of the client player devices and comprising informational content thereon (music, advertisements, etc.) that is specific to the particular business location; a central server system comprising one or more central servers in communication with each of the independent client player devices; and a network configuration connecting the client player devices to the central server network to provide an exchange of information between the two. The in-store media broadcasting system also comprises several proprietary software application modules functioning to allow the in-store media broadcasting system to operate. The present invention also features a unique method of doing business to provide in-store media broadcasting to one or more business locations. Not only is the business model capable of providing in-store media broadcasting, but a national radio-advertising platform or network focusing on major retailers and service providers throughout the country is also contemplated. The present invention system and service gives retailers and service providers the ability to broadcast customized music and messaging to their customers. In addition, the radio-advertising network provides a targeted advertising venue for consumer marketing companies and, unlike any other media, allows them to advertise products to select and targeted customers at the point of sale.

The invention relates to an unmanned aerial vehicle autonomous obstacle detection system and method based on binocular vision. The unmanned aerial vehicle autonomous obstacle detection system and method based on the binocular vision are characterized in that the system comprises a binocular visual system, other sensor modules and a flight control system which are mounted on an unmanned aerial vehicle; the method comprises the steps that the binocular visual system acquires visual information of the flight environment of the unmanned aerial vehicle, and obstacle information is obtained through processing; other sensor units acquire state information of the unmanned aerial vehicle; the flight control system receives the obstacle information and the state information of the unmanned aerial vehicle, establishes a flight path and generates a flight control instruction to send to the unmanned aerial vehicle; the unmanned aerial vehicle flies by avoiding obstacles according to the flight control instruction. According to the unmanned aerial vehicle autonomous obstacle detection system and method based on the binocular vision, the vision information is fused with other sensor information, the flight environment information is perceived, flight path control and path planning are conducted to avoid the obstacles, the problem of vision obstacle avoidance of the unmanned aerial vehicle is effectively solved, and the capacity of completing vision obstacle avoidance by means of a vehicle-mounted camera is achieved.

A vision system for a vehicle includes an exterior rearview mirror assembly mounted at an exterior portion of a door of a vehicle, an imaging sensor having a field of view exterior the vehicle and a video display screen operable to display video images captured by the imaging sensor. The video display screen is disposed at an interior portion of the vehicle door at which the exterior rearview mirror assembly is mounted. The exterior rearview mirror assembly and the video display screen may be part of a mirror and display module that is mountable at the vehicle door as a unit. The camera may be disposed at the exterior rearview mirror assembly.

The invention discloses a video behavior identification method based on spatio-temporal fusion characteristics and attention mechanism, The spatio-temporal fusion feature of input video is extracted by convolution neural network Inception V3, and then combining with the attention mechanism of human visual system on the basis of spatio-temporal fusion characteristics, the network can automaticallyallocate weights according to the video content, extract the key frames in the video frame sequence, and identify the behavior from the video as a whole. Thus, the interference of redundant information on the identification is eliminated, and the accuracy of the video behavior identification is improved.

Various embodiments of the present invention provide for systems and apparatuses directed toward using a contact lens and deflection optics to processes display information and non-display information. In one embodiment of the invention, a contact lens assembly is provided, comprising: a substrate including optical path optics and configured to receive a display information optical path emitted from a display and a non-display information optical path not emitted from the display. The optical path optics of the substrate is configured to be partially deflective such that the non-display information optical path is transmitted to a human visual system without deflection, and the display information optical path is transmitted to the human visual system with deflection.

This invention is a game platform for the assessment and / or treatment of disorders of binocular vision, such as amblyopia. The game content is devised to maximize the possible therapeutic effects by leveraging advanced research in opthalmology, as well as advanced display technology to render images independently to each eye. In particular, the game content engages both eyes at different levels of difficulty, forcing an amblyopic eye to work harder to regain its performance in the visual system. The invention herein described provides a mobile device, capable of interaction with an eye care specialist, for the assessment / treatment of binocular vision using innovative mechanisms for ensuring proper use thereof.