1547 results about "Visual system" patented technology

In accordance with the present disclosure, a system and method for using a remote control to control an electrosurgical instrument, where the remote controlled (RC) electrosurgical instrument has a universal coupling mechanism to allow switching between an interchangeable catalog of diagnostic tools. A controller within the base of the RC electrosurgical instrument identifies the type of disposable tip attached to the base. The controller, then, activates necessary features for use with the identified tip and deactivates any unnecessary features. A surgeon uses a remote with at least one momementum sensor to control the RC electrosurgical instrument 10. The surgeon rotates his hand mimicking movements of a handheld electrosurgical instrument, the movements of which are translated and sent to the RC electrosurgical instrument. The surgeon may use an augmented reality (AR) vision system to assist the surgeon in viewing the surgical site.

A vehicle vision system includes a vehicle having first and second spatially separated image capture sensors. The first image capture device has a first field of view having a first field of view portion at least partially overlapping a field of view portion of a second field of view of the second image capture device. A control receives a first image input from the first image capture sensor and a second image input from the second image capture sensor and generates a composite image synthesized from the first image input and the second image input. A display system displays the composite image.

A technique for hiding of data, including watermarks, in human-perceptible images, that is, image host data, is disclosed. In one embodiment a method comprises three steps. In the first step, data to be embedded is inputted. In the case of a watermark, this data is a unique signature, and may be a pseudo-noise (PN) code. In the case of hidden data to be embedded in the host data, this data is the hidden data itself, or the hidden data as spread against the frequency spectrum by a pseudo-noise (PN) code. In the second step, the inputted data is embedded within the host data, in accordance with a perceptual mask of the host data. The perceptual mask determines the optimal locations within the host data to insert the inputted data. In the case of images, these optimal locations are determined by reference to the human visual system. In the third step, the host data, with the embedded data, is further masked by a non-frequency mask. In the case of image data, the non-frequency mask is a spatial mask.

A system and method to facilitate selection and programming of at least one of audio and visual program are disclosed. A first computer is operative to connect to a second computer for filtering through a plurality of audio and/or visual programs based on selection criteria to provide a filtered representation of programs. A program from the filtered representation of programs may be selected at the first computer so as to cause a token indicative of the selected program to be assigned to a recipient operative to receive the token. The recipient may be a user at the first computer, a third computer, or an entertainment appliance. The token represents the selected program with sufficient particularity to program an entertainment system based on the token to record the program represented by the token.

A visual tree structure as specified by a program is constructed and maintained by a visual system's user interface thread. As needed, the tree structure is traversed on the UI thread, with changes compiled into change queues. A secondary rendering thread that handles animation and graphical composition takes the content from the change queues, to construct and maintain a condensed visual tree. Static visual subtrees are collapsed, leaving a condensed tree with only animated attributes such as transforms as parent nodes, such that animation data is managed on the secondary thread, with references into the visual tree. When run, the rendering thread processes the change queues, applies changes to the condensed trees, and updates the structure of the animation list as necessary by resampling animated values at their new times. Content in the condensed visual tree is then rendered and composed. Animation and a composition communication protocol are also provided.

Various embodiments of the present invention provide for systems and apparatus directed toward using a contact lens and deflection optics to process display information and non-display information. In one embodiment of the invention, a display panel assembly is provided, comprising: a transparent substrate that permits light to pass through substantially undistorted; a reflector disposed on the transparent substrate; and a display panel aimed toward the reflector and substantially away from a human visual system, wherein the reflector reflects light emitted from the display panel toward the human visual system. The reflector may comprise a narrow band reflector or a polarization reflector.

Apparatus and methods for encoding sensory input information into patterns of pulses and message multiplexing. In one implementation, the patterns of pulses are polychronous (time-locked by not necessary synchronous), and a retinal prosthetic encodes the input signal into the polychronous patterns for delivery via stimulating electrodes. Different polychronous patterns simultaneously encode different sensory signals; (such as different features of the image), thus providing for message multiplexing. Increasing data transmission capacity allows for a reduction in the number of electrodes required for data transmission. In one implementation, an adaptive feedback mechanism is employed to facilitate encoder operation. In another aspect, a computer vision system is described.

This invention provides a system and method for runtime determination (self-diagnosis) of camera miscalibration (accuracy), typically related to camera extrinsics, based on historical statistics of runtime alignment scores for objects acquired in the scene, which are defined based on matching of observed and expected image data of trained object models. This arrangement avoids a need to cease runtime operation of the vision system and/or stop the production line that is served by the vision system to diagnose if the system's camera(s) remain calibrated. Under the assumption that objects or features inspected by the vision system over time are substantially the same, the vision system accumulates statistics of part alignment results and stores intermediate results to be used as indicator of current system accuracy. For multi-camera vision systems, cross validation is illustratively employed to identify individual problematic cameras. The system and method allows for faster, less-expensive and more-straightforward diagnosis of vision system failures related to deteriorating camera calibration.

The efficient and intuitive presentation, navigation, and selection of available AV information in a graphical user interface (GUI) that is displayed on a display apparatus of an AV system and controlled through user manipulation of a scrolling mechanism of a navigation and selection device of the AV system. Related AV information is organized as items within lists that correspond to various navigable fields of a status bar of the GUI during the GUI interactive mode. A highlighted navigable field of the status bar displays its list of related AV information and the items of the list are scrolled through the navigable field by a user causing the scrolling mechanism to move in a scroll. A different field of the status bar may be selected by the user moving the scrolling mechanism in a lateral movement. Activation of the selection mechanism of the navigation and selection device will cause an AV device of the system to be controlled in accordance with the AV options displayed within the status bar fields at the time the selection mechanism is activated.

A vision system for a vehicle includes an exterior rearview mirror assembly mounted at an exterior portion of a door of a vehicle, an imaging sensor having a field of view exterior the vehicle and a video display screen operable to display video images captured by the imaging sensor. The video display screen is disposed at an interior portion of the vehicle door at which the exterior rearview mirror assembly is mounted. The exterior rearview mirror assembly and the video display screen may be part of a mirror and display module that is mountable at the vehicle door as a unit. The camera may be disposed at the exterior rearview mirror assembly.

The invention discloses a video behavior identification method based on spatio-temporal fusion characteristics and attention mechanism, The spatio-temporal fusion feature of input video is extracted by convolution neural network Inception V3, and then combining with the attention mechanism of human visual system on the basis of spatio-temporal fusion characteristics, the network can automaticallyallocate weights according to the video content, extract the key frames in the video frame sequence, and identify the behavior from the video as a whole. Thus, the interference of redundant information on the identification is eliminated, and the accuracy of the video behavior identification is improved.

This invention is a game platform for the assessment and/or treatment of disorders of binocular vision, such as amblyopia. The game content is devised to maximize the possible therapeutic effects by leveraging advanced research in opthalmology, as well as advanced display technology to render images independently to each eye. In particular, the game content engages both eyes at different levels of difficulty, forcing an amblyopic eye to work harder to regain its performance in the visual system. The invention herein described provides a mobile device, capable of interaction with an eye care specialist, for the assessment/treatment of binocular vision using innovative mechanisms for ensuring proper use thereof.

A camera or vision system for establishing a composite image for displaying in a vehicle includes a first camera and a second camera and a controller. Each camera has a respective field of view that overlaps partially with the respective field of view of the other camera. Each camera has a respective imager for generating a respective preliminary digital image. The cameras together have a combined field of view. The controller is programmed to generate a final composite digital image that corresponds to a selected digital representation of the combined field of view of the cameras by using a remapping table to remap selected pixels from each of the preliminary digital images into selected positions of the final composite digital image. A plurality of methods for establishing a composite image are also provided.

The present invention features an enterprise media distribution system or network-based in-store media broadcasting system comprising one or more, and preferably, a plurality of business chains, each business chain comprising a plurality of business locations; a media distribution platform or framework comprising one or more client player devices placed at each business location, each of the client player devices being independently supported and in communication with an internal audio/visual system installed and existing within in the respective business locations; independent customizable media broadcasts supported on each of the client player devices and comprising audio, visual, and/or informational media content thereon that may be specific to each of the particular business locations in which the client player device(s) is/are located; a chain network having at least one chain server, such as updating and caching servers, for servicing each respective business chain, said chain server in communication with each client player device in the respective business chain; a central server system comprising one or more central servers in communication with each of the chain servers in each business chain; a network configuration connecting each client player device to the chain servers to provide an exchange of information between the two; and a network configuration connecting the chain servers to the central server system to provide an exchange of information between the two.

This invention provides a system and method for determining and controlling focal distance in a lens assembly of a vision system camera using an integral calibration assembly that provides the camera's image sensor with optical information that is relative to focal distance while enabling runtime images of a scene to be acquired along the image axis. The lens assembly includes a variable lens located along an optical axis that provides a variable focus setting. The calibration assembly generates a projected pattern of light that variably projects upon the camera sensor based upon the focus setting of the variable lens. That is, the appearance and/or position of the pattern varies based upon the focus setting of the variable lens. This enables a focus process to determine the current focal length of the lens assembly based upon predetermined calibration information stored in association with a vision system processor running the focus process.

A surround surveillance system mounted on a mobile body for surveying surroundings around the mobile body includes an omniazimuth visual system, the omniazimuth visual system includes at least one omniazimuth visual sensor including an optical system capable of obtaining an image with an omniazimuth view field area therearound and capable of central projection transformation of the image into an optical image, and an imaging section including an imaging lens for converting the optical image obtained by the optical system into image data, an image processor for transforming the image data into at least one of panoramic image data and perspective image data, a display section for displaying one of a panoramic image corresponding to the panoramic image data and a perspective image corresponding to the perspective image data and a display control section for controlling the display section.

An immersive audio-visual system (and a method) for creating an enhanced interactive and immersive audio-visual environment is disclosed. The immersive audio-visual environment enables participants to enjoy true interactive, immersive audio-visual reality experience in a variety of applications. The immersive audio-visual system comprises an immersive video system, an immersive audio system and an immersive audio-visual production system. The video system creates immersive stereoscopic videos that mix live videos, computer generated graphic images and human interactions with the system. The immersive audio system creates immersive sounds with each sound resource positioned correct with respect to the position of an associated participant in a video scene. The immersive audio-video production system produces an enhanced immersive audio and videos based on the generated immersive stereoscopic videos and immersive sounds. A variety of applications are enabled by the immersive audio-visual production including casino-type interactive gaming system and training system.

Various embodiments relate to systems and methods for simultaneously switching input image streams to output devices, while providing optional image processing functions on the image streams. Certain embodiments may provide vision systems and methods suitable for use in vehicles, particularly windowless vehicles, such as armored ground vehicles, submerged watercraft, and spacecraft. Some embodiments may enable sharing of image streams (e.g., with one or more other vehicles), generation of panoramic views (e.g., from various camera feeds), intelligent encoding of image streams, and implementation of security features based on image streams.

A method for adaptive quantization of video frames based on bit rate prediction that includes increasing quantization in sectors of a video frame where coding artifacts would be less noticeable to the human visual system and decreasing quantization in sectors where coding artifacts would be more noticeable to the human visual system. In one embodiment the method reverts to uniform quantization for video frames in which adaptive quantization would require extra bits.

The invention discloses a workpiece apparent defect detection method based on machine vision. Firstly, a visual system is used for guiding a robot, the pose of a target workpiece is precisely positioned according to a template matching algorithm based on a gray value, and then workpiece apparent defect detection is carried out and comprises the steps that firstly, a workpiece image is acquired and pretreated through median filtering; secondly, the target workpiece is divided through a global threshold value, and workpiece pose correction is carried out; thirdly, burr interference of the edge of the workpiece is removed through mathematical morphology open operation; fourthly, notches, material sticking, cracking, indentation, needle eyes, scratches and foaming apparent defects are detected. The method solves the problems that the artificial detection speed is slow, the efficiency is low and precision is poor; the problems that according to current vision detection, defect types are singular, the imaging quality is poor, and the false drop rate is high are solved, and the automation degree of precise workpiece production and product quality are improved.

A system and method for using a remote control to control an electrosurgical instrument, where the remote control includes at least one momentum sensor. As the surgeon rotates their hand mimicking movements of a handheld electrosurgical instrument, the movements are translated and sent to the remote controlled (RC) electrosurgical instrument. The surgeon uses an augmented reality (AR) vision system to assist the surgeon in viewing the surgical site. Additionally, the surgeon can teach other doctors how to perform the surgery by sending haptic feedback to slave controllers. Also, the surgeon can transfer control back and forth between the master and slave controller to allow a learning surgeon to perform the surgery, but still allow the surgeon to gain control of the surgery whenever needed. Also, the surgeon could be located at a remote location and perform the surgery with the assistance of the AR vision system.

The present invention provides a system and method for simplifying and accelerating the process of prototyping, real-world simulation, and implementation of virtually any task performance system or device, thereby dramatically reducing the design-to-implementation cycle time and expense. The inventive system includes a development system that provides a user, with visual tools to interactively and dynamically partition a previously designed visual system model of the task performance system or device, and then interactively or automatically assign the partitions to corresponding selectable target components, to produce a prototyped system ready for conversion to executable form suitable for implementation. The inventive system and method can also be readily used to automatically generate any instruction sets that are necessary for implementing the prototyped task performance system in actual target components of one or more emulation and/or production target systems. A novel automatic executable program code generation process that can be advantageously utilized is also provided in accordance with the present invention. Finally, the present invention may optionally include a data handling device that enables real-time monitoring and management of a remote target system from one or more user systems, as well as a set of tools for designing interactive visual instrument panels for that purpose.

A vision system for a vehicle that identifies and classifies objects (targets) located proximate a vehicle. The system comprises a sensor array that produces imagery that is processed to generate depth maps of the scene proximate a vehicle. The depth maps are processed and compared to pre-rendered templates of target objects that could appear proximate the vehicle. A target list is produced by matching the pre-rendered templates to the depth map imagery. The system processes the target list to produce target size and classification estimates. The target is then tracked as it moves near a vehicle and the target position, classification and velocity are determined. This information can be used in a number of ways. For example, the target information may be displayed to the driver, the information may be used for an obstacle avoidance system that adjusts the trajectory or other parameters of the vehicle to safely avoid the obstacle. The orientation and/or configuration of the vehicle may be adapted to mitigate damage resulting from an imminent collision, or the driver may be warned of an impending collision.

The majority of applications for head mounted display (HMD) users, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc. yield a conflicting set of tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Further, individual users' needs vary as do their needs with the general task at-hand, visual focus, and various regions-of-interest within their field of view. To address these issues, it is necessary to provide a high performance optical system, eyepiece design, and system features which overcome these limitations.

A binocular endoscope operation visual system mainly comprises a binocular endoscope, an image server and an endoscope stereo display unit. Two ways of clear abdominal cavity image video signals are obtained by the binocular endoscope, two ways of video streams enter a memory of an image processing server or a video memory by a two-way image capture card, and a left-way image and a right-way image which are processed are respectively displayed in a left displayer and a right displayer. By a flat mirror, the contents of the left displayer and the right displayer respectively enter the left eye and the right eye of an observer, thereby the stereo effect is realized. The binocular endoscope operation visual system is suitable for the circumstance of a medical surgical endoscope operation, can completely satisfy the stereoscopic vision requirement of a laparoscope operation of a minimally invasive operation robot, realizes the binocular stereoscopic vision real-time display in the laparoscope operation, has reliable performance, simple structure and high commercialization level, and adapts the germfree circumstances of the operation.

A vehicular camera includes a lens, a printed circuit board and an imager. The lens has a plurality of optical element and is disposed at a lens holder. The imager is disposed at the printed circuit board. The adhesive is initially curable in an initial radiation curing process that comprises exposure to UV light, and initially-cured adhesive is further curable to a further cured strength in a secondary thermal curing process. The adhesive is initially cured via the initial radiation curing process after the lens is brought into focus with the imager and is optically center-aligned therewith. The initially-cured adhesive, as cured via the initial radiation curing process, holds the lens optically center-aligned and in focus with the imager. After the initial radiation curing process, the lens holder, adhesively attached to one of the printed circuit board and the holding element, is moved to the secondary thermal curing process.

The invention discloses a robot grasping pose estimation method based on an object recognition depth learning model, which relates to the technical field of computer vision. The method is based on anRGBD camera and depth learning. The method comprises the following steps: S1, camera parameter calibration and hand-eye calibration being carried out; S2, training an object detection object model; S3, establishing a three-dimensional point cloud template library of the target object; 4, identifying the types and position of each article in the area to be grasped; 5, fusing two-dimensional and three-dimensional vision information and obtaining a point cloud of a specific target object; 6, completing the pose estimation of the target object; S7: adopting an error avoidance algorithm based on sample accumulation to avoid errors; S8: Steps S4 to S7 being continuously repeated by the vision system in the process of moving the robot end toward the target object, so as to realize iterative optimization of the pose estimation of the target object. The algorithm of the invention utilizes a target detection YOLO model to carry out early-stage fast target detection, reduces the calculation amount of three-dimensional point cloud segmentation and matching, and improves the operation efficiency and accuracy.

The invention provides a simulation method and device of a digital twin system of an industrial robot. The simulation device comprises the industrial robot, a vision perception unit and a computer, wherein the vision perception unit is arranged at the tail end of the robot and is composed of a camera and a wire structure light emitter; an industrial robot simulation system is established, the robot is modeled, and three instructions are analyzed and run; a target three-dimensional measurement model of a robot visual system is acquired by using a wire structure optical geometric triangular method; a motion instruction is determined for the working task of the robot, virtual simulation is carried out through the computer, and reachable points and collision point detection are carried out; and the robot is actually used for identifying a target object through the visual perception unit, and the actual movement of the robot is driven. The simulation device is safe and reliable in virtual simulation, abnormal operation possibly in actual operation is avoided, the visual perception unit is used for identifying the target object through three-dimensional visual technology, the self-adaptive capacity of the robot to the field environment is improved, and flexibility and intelligence are enhanced.

A compact, inexpensive, real-time device for computing dense stereo range and motion field images, which are fundamental measurements supporting a wide range of computer vision systems that interact with the real world, where objects move through three-dimensional space includes a novel algorithm for image-to-image comparison that requires less storage and fewer operations than other algorithms. A combination of standard, low-cost and low-power components are programmed to perform algorithm and performs realtime stereo and motion analysis on passive video images, including image capture, digitization, stereo and/or motion processing, and transmission of results.

Methods (450, 750) are disclosed for embedding a watermark into an image (400, 700). The watermark comprises at least one basis pattern. A real part of the basis pattern(s) (410, 710) is added to the image (400, 700) to form a watermarked image (420, 730). The basis pattern(s) has scale and rotation invariant properties. The pattern(s) is preferably added to the image at a low intensity to make the pattern(s) invisible or imperceptible to the human visual system under normal viewing conditions. Methods (800, 900) are also disclosed for detecting a watermark from a watermarked image (810, 910). The watermark image (810, 910) is correlated with the basis pattern to provide a result image (830, 950). Peaks in the result image (830, 950) correspond with positions where the basis pattern was detected in the watermarked image (830, 950)