1602 results about "Vision based" patented technology

A mental-model elicitation process and apparatus, called the Mental-Model Elicitation Device (MMED) is described. The MMED is used to give rise to more effective end-user mental-modeling activities that require executive function and working memory functionality. The method and apparatus is visual analysis based, allowing visual and other sensory representations to be given to thoughts, attitudes, and interpretations of a user about a given visualization of a mental-model, or aggregations of such visualizations and their respective blending. Other configurations of the apparatus and steps of the process may be created without departing from the spirit of the invention as disclosed.

The invention discloses a dynamic target tracking and positioning method of an unmanned plane based on vision, and belongs to the navigation field of the unmanned planes. The dynamic target tracking and positioning method comprises the following steps of: carrying out video processing, dynamic target detecting and image tracking; carrying out cloud deck servo control; establishing a corresponding relationship between a target in the image and a target in the real environment, and further measuring the distance between a camera and a dynamic target to complete precise positioning of the dynamic target; and enabling an unmanned plane control system to fly by automatically tracking the dynamic target on the ground. The dynamic target tracking and positioning method of the unmanned plane based on the vision can automatically realize the movement target detecting, image tracking and optical axis automatic deflecting without the full participation of the people, so that the dynamic target is always displayed at the center of an image-forming plane; and the distance between the unmanned plane and the dynamic target is measured in real time according to an established model on the basis of obtaining the height information of the unmanned plane. Therefore, the positioning of the dynamic target is realized; closed-loop control is formed by using the positioned dynamic target as a feedback signal, so that the tracking flight of the unmanned plane is guided.

Methods of applying adaptive social computing systems are disclosed. The social computing systems include capabilities to generate adaptive recommendations and representations of social networks derived, at least in part, from inferences of the preferences and interests of system users based on a plurality of usage behaviors, spanning a plurality of usage behavior categories. The behavioral categories include system navigation behaviors, content referencing behaviors, collaborative behaviors, and the monitoring of physical location and changes in location. Privacy control functions and compensatory functions related to insincere usage behaviors can be applied. Adaptive recommendation delivery can take the form of visual-based or audio-based formats.

Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. Exemplary arrangements utilize the camera portions of such devices to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

A system comprising at least one light source in a movable hand-held device, at least one light detector that detects light from said light source, and a control unit that receives data from the at least one light detector. The control unit determines the position of the hand-held device in at least two-dimensions from the data from the at least one light detector and translates the position to control a feature on a display.

Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Technologies involving portable devices, such as smartphones and tablet computers, are disclosed. One arrangement enables a creator of content to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another uses the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

An adaptive recommendation system and a mobile adaptive recommendation system are disclosed. The adaptive recommendation system and the mobile adaptive recommendation system include algorithms for monitoring user usage behaviors across a plurality of usage behavior categories associated with a computer-based system, and generating recommendations based on inferences on user preferences and interests. Privacy control functions and compensatory functions related to insincere usage behaviors can be applied. Adaptive recommendation delivery can take the form of visual-based or audio-based formats.

A method of manipulating a time based stream of information through use of a user interface to generate a presentation is provided in which a processing system is employed. The methods use references to a selected time based stream of information as editing tools. The user interface has functionality to display only a single time line for aligning reference elements to visual time based stream of information. The references may include a variety of edit features that enhance the presentation. Some mechanisms for moving the reference elements on the user interface are drag and drop and/or cut and paste procedures. Other aspects of the present invention relating to the processing system providing convenient user interface and editing tools for use in authoring a presentation of a time based stream of information are also described.

An enhanced object tracking system for tracking and controlling access to a plurality of objects such as keys is disclosed. The object tracking system implements many improvements including automated user identification using biometric data extracted from the user with a minimum of user interaction, tracking of objects both inside and outside their storage units, the locking of objects within slots of their storage unit to guard against illicit removal and return of keys and to insure random slot rotation, image and visual based inventory verification methodologies, and tracking of objects during times when they are checked out of the system. The result is an intelligent object tracking system with automated control functions and high reliability.

In a real time food production management system and method, real time data about consumers inside or in the vicinity of a food outlet and an amount of prepared food available to serve and/or an amount of food being prepared is electronically generated. Based on the real time data, a demand for an amount of food to be ordered by the consumers in a specified interval immediately succeeding the generation of the real time data is electronically predicted. In addition, at least one of the following is electronically determined based on the real time data: a predicted amount of additional food requiring preparation; the time at least one prepared food product has been available; a length of time that a cooked food component has been cooked; and an amount of a food component, a condiment and/or a topping resides in a food product assembly buffer.

A method designed to include a number of features which facilitate fast and accurate reading of text documents. The design of these features is based on research in the fields of visual perception, ergonomics, and usability. The method applies this research to create software which provides various assisted-reading modes.

A system, method, and computer program product for providing a user with a virtual environment in which the user can perform guided activities and receive feedback are described. The user is provided with guidance to perform certain movements. The user's movements are captured in an image stream. The image stream is analyzed to estimate the user's movements, which is tracked by a user-specific human model. Biomechanical quantities such as center of pressure and muscle forces are calculated based on the tracked movements. Feedback such as the biomechanical quantities and differences between the guided movements and the captured actual movements are provided to the user.

The invention discloses a positioning method and system based on visual inertial navigation information fusion. The method comprises steps as follows: acquired sensor information is preprocessed, wherein the sensor information comprises an RGB image and depth image information of a depth vision sensor and IMU (inertial measurement unit) data; external parameters of a system which the depth visionsensor and an IMU belong to are acquired; the pre-processed sensor information and external parameters are processed with an IMU pre-integration model and a depth camera model, and pose information isacquired; the pose information is corrected on the basis of a loop detection mode, and the corrected globally uniform pose information is acquired. The method has good robustness in the positioning process and the positioning accuracy is improved.

The invention discloses a binocular stereo vision based intelligent three-dimensional human face rebuilding method and a system; the method comprises: preprocessing operations including image normalization, brightness normalization and image correction are carried out to a human face image; a human face area in the human face image which is preprocessed is obtained and human face characteristic points are extracted; the object is rebuilt by projection matrix, so as to obtain internal and external parameters of a vidicon; based on the human face characteristic points, gray level cross-correlation matching operators are expanded to color information, and a parallax image generated by stereo matching is calculated according to information including polar line restraining, human face area restraining and human face geometric conditions; a three-dimensional coordinate of a human face spatial hashing point cloud is calculated according to the vidicon calibration result and the parallax image generated by stereo matching, so as to generate a three-dimensional human face model. By adopting the steps, more smooth and vivid three-dimensional human face model is rebuilt in the invention.

Methods and arrangements involving portable devices are disclosed. One arrangement enables a content creator to select software with which that content should be rendered—assuring continuity between artistic intention and delivery. Another arrangement utilizes the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

The present invention provides a method for real-time tracking of moving flexible surfaces and an image guided surgical robotic system using this tracking method. A vision system acquires an image of the moving flexible surface and identifies and tracks visual features at different times. The method involves computing both rigid and stretching transformations based on the changing positions of the visual features which are then used to track any area of interest on the moving flexible surface as it evolves over time. A robotic surgical system using this real-time tracking is disclosed.

A safety monitoring system for a workspace area. The workspace area related to a region having automated moveable equipment. A plurality of vision-based imaging devices capturing time-synchronized image data of the workspace area. Each vision-based imaging device repeatedly capturing a time synchronized image of the workspace area from a respective viewpoint that is substantially different from the other respective vision-based imaging devices. A visual processing unit for analyzing the time-synchronized image data. The visual processing unit processes the captured image data for identifying a human from a non-human object within the workspace area. The visual processing unit further determining potential interactions between a human and the automated moveable equipment. The visual processing unit further generating control signals for enabling dynamic reconfiguration of the automated moveable equipment based on the potential interactions between the human and the automated moveable equipment in the workspace area.

The invention is directed to a tracking system for tracking the use of an object on a work piece within a predetermined work space comprising a target, at least one video imaging source and a computer. The target is attached to the object and calibrated to derive an “Object Tracking Point”. Each target has a predetermined address space and a predetermined anchor. At least one video imaging source is arranged such that the work piece is within the field of view. Each video imaging source is adapted to record images within its field of view. The computer is for receiving the images from each video imaging source and comparing the images with the predetermined anchor and the predetermined address, calculating the location of the target and the tool attached thereto in the work space relative to the work piece.

Adaptive vision-based vehicle detection methods, taking into account the lighting context of the images are disclosed. The methods categorize the scenes according to their lighting conditions and switch between specialized classifiers for different scene contexts. Four categories of lighting conditions have been identified using a clustering algorithm in the space of image histograms: Daylight, Low Light, Night, and Saturation. Trained classifiers are used for both Daylight and Low Light categories, and a tail-light detector is used for the Night category. Improved detection performance by using the provided context-adaptive methods is demonstrated. A night time detector is also disclosed.

The invention relates generally to the control and landing of unmanned aerial vehicles. More specifically, the invention relates to systems, methods, devices, and computer readable media for landing unmanned aerial vehicles using sensor input and image processing techniques.

The invention belongs to the field of intelligent automobile road detection and relates to a method for detecting road information and identifying forward vehicles based on vision. The method comprises image preprocessing, lane line characteristic parameter extraction, region-of-interest segmentation and vehicle outline identification. According to the method for detecting the road information and identifying the forward vehicles based on vision, the complexity of computation is simplified by extracting the regions of interest, filtering out background regions and reducing the processing scope; the processing result of each frame of image is obtained through fixed computation times by use of a line-by-line retrieval method, and differing from the characteristic, namely linear fitting on each bright spot, of Hough conversion, the method has outstanding advantages in algorithm instantaneity; the instantaneity of the Robinson direction model operator is improved, and an intermediate variable is set to reduce the computation times of each pixel point. The regions of interest are screened and judged by use of an information entropy and a vehicle tail symmetry characteristic in the target region, and therefore, the omission factor and the false drop rate of the algorithm are reduced.

Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. One arrangement enables a creator of content to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another arrangement utilizes the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

An apparatus for determining the refraction of a patient's eye includes a wavefront measurement device that determines aberrations in a return beam from the patient's eye viewing a target through a corrective test lens in the apparatus. The wavefront measurement device preferably outputs an display representative of the quality of vision afforded the patient through the test lens. The display may be, e.g., a representation of a Snellen chart convolved with the optical characteristics of the patient's vision, an overall quality of vision scale, or the optical contrast function, all of which are based on the wavefront measurements of the patient's eye. The examiner may use the display information to conduct a refraction examination or other vision tests without the subjective response from the patient.

A flight deck display system for an aircraft or other vehicle includes a first data source of visual feature data that is indicative of visual features of a location of interest, a second data source of flight data for the aircraft, a processor architecture, and a display element. The processor architecture is operatively coupled to the first data source and to the second data source, and it is configured to process the visual feature data, process the flight data, and, based upon the visual feature data and the flight data, generate image rendering display commands. The display element receives the image rendering display commands and, in response thereto, renders a dynamic graphical representation of the location of interest using the visual feature data. The dynamic graphical representation of the location conveys an amount of visible detail that varies as a function of the flight data.

A method for displaying a captured image on a display device. A real image is captured by a vision-based imaging device. A virtual image is generated from the captured real image based on a mapping by a processor. The mapping utilizes a virtual camera model with a non-planar imaging surface. Projecting the virtual image formed on the non-planar image surface of the virtual camera model to the display device.

A vision-based hand movement recognition system and method thereof are disclosed. In embodiment, a hand posture is recognized according to consecutive hand images first. If the hand posture matches a start posture, the system then separates the consecutive hand images into multiple image groups and calculates motion vectors of these image groups. The distributions of these motion vectors are compared with multiple three-dimensional motion vector histogram equalizations to determine a corresponding movement for each image group. For example, the corresponding movement can be a left moving action, a right moving action, an up moving action or a down moving action. Finally, the combination of these corresponding movements is defined as a gesture, and an instruction mapped to this gesture is then executed.

The invention discloses a panoramic map database acquisition system and a vision-based user location positioning and navigating method. A user shoots surrounding symbolic images by a mobile phone, and self-location positioning and live-action map navigation can be completed through image feature identification and rectification, so that a novel navigation mode which is accurate in positioning and fresh in experience is provided. The system and the method have a more obvious effect when used in indoor environment. Besides, the panoramic map navigation manner is adopted, accordingly, the most visual live-action navigation experience is provided for the user, and the user experience can be greatly improved.

The invention relates to a three-dimensional wire frame structure method and system fusing a binocular camera and IMU positioning. On the basis of binocular vision, the invention initializes and fusesinertial measurement information by using a divide-and-conquer strategy, implements tracking, positioning and drawing, and can robustly run in indoor and outdoor environments and complex motion conditions. On the basis of accurate positioning, 3D wireframe reconstruction and iterative optimization are carried out based on the posture of the key frame. Linear segments are matched by local featuresand spatial geometric constraints and back-projected into three-dimensional space. Through the angle and distance constraints, the straight line segments are divided into different sets. Based on thegrouping results, the fitting region is determined and the straight line segments are merged. Finally, a 3-D wireframe structure is output. The invention fuses multi-source information to improve thestability and robustness of the system on the traditional vision-based positioning and mapping method. At the same time, line information is added to the key frame to sparsely express the structuralcharacteristics of the three-dimensional environment, which improves the computational efficiency.

The invention relates to a system and a method for grinding an industrial robot on the basis of visual information. In the system, the image of a workpiece is collected by a video camera; the workpiece is positioned by computer recognition; the movement locus points of a mechanical arm from the current position to a fetching position are planned on line to control the mechanical arm to fetch the workpiece; and then, the revolving speed and the revolving direction of an abrasive belt are controlled by a preset operation step of grinding so as to control the industrial robot to move the workpiece to an appointed position and gesture for grinding and polishing the workpiece. In the system, the video camera collects the image of the workpiece in real time; the workpiece is identified and positioned by the computer to control the mechanical arm to fetch the workpiece; the movement of the industrial robot and the running state of a grinder in the workpiece grinding operation are controlled; the data end of a computer is connected with the data end of the control cabinet of the industrial robot; output locus points controls the industrial robot to move; and the data end of the computer is connected with the data end of the grinder to control the grinder to start and stop and control the revolving speed and the revolving direction of the abrasive belt.