162 results about "Visual task" patented technology

An illuminating device coupled with sensors or an image acquisition device and a logical controller allows illumination intensity and spectrum to be varied according to changing user needs. The system provides illumination to areas according to the principles of correct lighting practice for the optimal performance of visual tasks in the most efficient, cost effective manner. Aspects of the invention include: lighting fixtures which adapt to ambient lighting, movement, visual tasks being performed, and environmental and personal conditions affecting illumination requirements at any given instant. Lighting fixtures having spatial distribution of spectrum and intensity, providing both “background” room lighting, and “task” lighting.

An imaging method includes obtaining an image with a first field of view and first effective resolution and the analyzing the image with a visual attention algorithm to one identify one or more areas of interest in the first field of view. A subsequent image is then obtained for each area of interest with a second field of view and a second effective resolution, the second field of view being smaller than the first field of view and the second effective resolution being greater than the first effective resolution.

The invention discloses a deformable convolutional neural network-based infrared image object identification method. The method comprises the steps of constructing a training set and a test set; establishing a convolutional neural network architecture; adding a softmax classifier to the last layer, and setting an objective function; performing sampling by adopting a convolution kernel of linear ornonlinear deformation; performing pooling operation in a pooling layer by adopting a rule block sampling-based ROI pooling method which is the best in the industry at present; setting learning rate parameters according to experience; and easily performing standard back propagation end-to-end training, thereby obtaining a deformable convolutional neural network. An experiment proves that the spatial geometric deformation learning capability is introduced in the convolutional neural network, so that an identification task of an image with spatial deformation is better finished; the geometric transformation modeling capability of the convolutional neural network and the effectiveness of target detection and visual task identification are improved; and dense geometric deformation in space issuccessfully learnt.

The invention relates to a single-image super-resolution reconstruction algorithm based on a multi-scale residual error learning network. In recent years, the convolutional neural network is widely applied to many visual tasks, and particularly, remarkable results are obtained in the field of single-image super-resolution reconstruction. Similarly, multi-scale feature extraction also achieves consistent performance improvement in the field. However, in the prior art, multi-scale features are extracted in a layered mode mostly, and with the increase of the depth and width of a network, the calculation complexity and the consumption of a memory can be greatly improved. In order to solve the problem, the invention provides a compact multi-scale residual error learning network, i.e., representing multi-scale characteristics in a residual error block. The model is composed of a feature extraction block, a multi-scale information block and a reconstruction block. In addition, due to the factthat the number of network layers is small and group convolution is used, the network has the advantage of being high in execution speed. Experimental results show that the method is superior to an existing method in time and performance.

The invention provides a method for recognizing a collaborative target in an SAR (Synthetic Aperture Radar) image based on a visual attention mechanism. The method comprises the following steps of: establishing the scale spatial presentation of an SAR image; extracting a low-layer visual feature map, carrying out semantic translation on a visual task, translating the visual task, decomposing the visual feature map, calculating the weight of each visual feature map, and generating a visual task saliency map relevant to the visual task; selecting a salient target region in the SAR image by utilizing the visual task saliency map to realize the separation of a foreground and a background of the target region in the SAR image; learning samples of various known prototype targets through a collaborative learning algorithm to obtain features and feature spaces of the known prototype targets and generate a known prototype target knowledge base; and recognizing collaboration of targets in the salient target region: recognizing the targets in the salient target region of the selected SAR image based on the known prototype target knowledge base by utilizing a collaboration pattern recognition order parameter dynamic iteration process.

A method of providing artificial vision to a visually-impaired user implanted with a visual prosthesis. The method includes configuring, in response to selection information received from the user, a smart prosthesis to perform at least one function of a plurality of functions in order to facilitate performance of a visual task. The method further includes extracting, from an input image signal generated in response to optical input representative of a scene, item information relating to at least one item within the scene relevant to the visual task. The smart prosthesis then generates image data corresponding to an abstract representation of the scene wherein the abstract representation includes a representation of the at least one item. Pixel information based upon the image data is then provided to the visual prosthesis.

The invention discloses a scene graph generation method, which is characterized in that three different levels of semantic tasks of object detection, visual relationship detection and image region description are mutually connected, and the visual tasks of different semantic levels of scene understanding are jointly solved in an end-to-end mode. Firstly, an object, a visual relationship and imageregion description are aligned with a feature information transfer graph according to spatial features and semantic connection of the object, the visual relationship and the image region description,and then feature information is transferred to three different levels of semantic tasks through the feature information transfer graph so as to achieve simultaneous iterative updating of semantic features. According to the method, object detection and visual relation detection are realized by utilizing semantic feature connection of different levels of scene images so as to generate scene images corresponding to the scene images; and the main region of the scene image is subjected to image description by using a natural language, Meanwhile, the image region description is used as a supervisionmethod for scene image generation so as to improve the accuracy of scene image generation.

The invention discloses a distributed asynchronous task scheduling system based on Airflow and a working method of the distributed asynchronous task scheduling system. The system comprises an interface calling module API Server, a task construction and distribution module Caster, an Airflow scheduling platform and a data storage module DB. The interface calling module is used for calling an API Server; the task construction distribution module Caster is used for rendering a task script; the Airflow scheduling platform comprises a task scheduling module Seduler, a task execution unit Worker Node, a task execution unit management module Flower, a distributed task queue Cell and a visual task scheduling management interface WebServer; and the data storage module DB is connected with the taskconstruction distribution module Caster and the Airflow scheduling platform and used for storing data logs generated in the operation process of the task construction distribution module Caster and the Airflow scheduling platform. According to the invention, the availability, flexibility and fault tolerance of the system can be effectively improved, and the load balance of the system is ensured.

The invention relates to a low-illumination image enhancement method based on an attention mechanism and multi-level feature fusion, and the method comprises the following steps: carrying out the processing of a low-illumination image at an input end, and outputting a four-channel feature map; using a convolutional layer based on an attention mechanism as a feature extraction module and for extracting basic features as low-level features; fusing the low-level features with the corresponding high-level features and the deepest feature of the convolutional layer, and obtaining a final feature map after deconvolution; and outputting the mapping to restore the final feature map into the RGB picture. According to the invention, multi-level features of the deep convolutional neural network model are fully utilized. Different levels of features are fused, different weights are given to a feature channel through a channel attention mechanism, better feature representation is obtained, the image processing accuracy is improved, a high-quality image is obtained, and the method can be widely applied to the technical field of computer low-level visual tasks.

Disclosed is a visual and spatial programming system for robot navigation and robot-IoT task authoring. Programmable mobile robots serve as binding agents to link stationary IoT devices and perform collaborative tasks. Three key elements of robot task planning (human-robot-IoT) are coherently connected with one single smartphone device. Users can perform visual task authoring in an analogous manner to the real tasks that they would like the robot to perform with using an augmented reality interface. The mobile device mediates interactions between the user, robot(s), and IoT device-oriented tasks, guiding the path planning execution with Simultaneous Localization and Mapping (SLAM) to enable robust room-scale navigation and interactive task authoring.

The invention discloses a domain self-adaptive deep learning method, which comprises the following steps of: carrying out rotation transformation on a target domain image to obtain a self-supervised learning training sample set; And carrying out joint training on the converted self-supervised learning training sample set and the source domain training sample set to obtain a domain adaptive deep learning model used for a visual task on a target domain. According to the method, a target domain sample does not need to be labeled, the feature representation of the target domain can be effectivelylearned, and the performance of a computer vision task on the target domain is improved. The invention further discloses a domain self-adaptive deep learning readable storage medium which also has theabove beneficial effects.

Techniques related to computer vision tasks are discussed. Such techniques include applying a pretrained non-linear transform and pretrained details boosting factor to generate an enhanced image from an input image and reducing the bit depth of the enhanced image prior to applying a pretrained computer vision network to perform the computer vision task.

A method for determining at least one optical conception parameter for a progressive ophthalmic lens intended to equip a frame of a wearer, depending on the visual behavior of the latter. The method comprises the following steps: a) collecting a plurality of behavioral measurements relating to a plurality of gaze directions and/or positions of the wearer during a visual task; b) statistically processing said plurality of behavioral measurements in order to determine a zone of use of the area of an eyeglass fitted in said frame, said zone of use being representative of a statistical spatial distribution of said plurality of behavioral measurements; and c) determining at least one optical conception parameter for said progressive ophthalmic lens depending on a spatial extent and/or position of the zone of use.

The invention relates to a depth feature representation method based on multiple stacked auto-encoding. Feature expressions of different hierarchical structures of a target object are acquired through constructing stacked auto-encoding networks of different structures. A shallow-layer (the number of hidden layers is smaller) neural network structure is constructed, a back-propagation method is adopted to train network parameters to enable a neural network to achieve the optimal structure, and outputs, namely the feature expressions, of a second layer of the network are acquired; more deeply hierarchical network structures are respectively established, network parameters are trained according to a similar manner, and thus outputs (the feature expressions) of corresponding layers are acquired; and fusion and selection are carried out on the above-mentioned obtained features according to a manner of feature combination and selection to acquire a hierarchical feature representation that characterizes a target. Therefore, corresponding visual tasks (image classification, identification and detection) are carried out.

The invention provides a regulating system and a regulating method for light environment. The system comprises a data collecting unit, a control unit and a data processing unit, wherein the data collecting unit is used for collecting parameters of an individual and environmental parameters around the individual; the control unit is used for adjusting the light environment around the individual; the data processing unit is connected with the data collecting unit and the control unit, is used for generating and sending configuration parameters to the control unit according to the collected parameters of the individual and the environmental parameters, and the control unit adjusts the light environment according to the configuration parameters. According to the system and the method providedby the invention, the physical environment in which a light environment user is located and various representative physiological and psychological indexes of the individual are monitored in real time,then various light environment parameters of the environment are regulated in real time, so that the compatibility among the illumination, physique, visual tasks and the like is enhanced, and the real-time healthy light environment which is most suitable for individual physiological and psychological conditions of the user is obtained.

The invention relates to a remote sensing image ground object target detection method and system, and the method comprises the steps: inputting a to-be-detected remote sensing image to a pre-trained detection network, and obtaining an initial ground object target detection result, outputted by the pre-trained detection network, of the to-be-detected remote sensing image; screening the initial ground object target detection result by using a non-maximum suppression algorithm to obtain a final ground object target detection result of the to-be-detected remote sensing image; according to the technical scheme provided by the invention, the problem of small object detection in a complex remote sensing scene is effectively solved, attention is dynamically distributed to objects of different scales, and an effective technology is provided for subsequent computer vision tasks including but not limited to remote sensing image target detection.

The invention discloses a fall detection method based on an hourglass convolution automatic coding neural network, and the method comprises the following steps: inputting a collected image into the trained hourglass convolution automatic coding neural network, and judging whether a target falls or not; wherein the hourglass convolution automatic coding neural network comprises an hourglass convolution encoder and a classifier; wherein the hourglass convolution encoder is obtained by replacing a convolution layer in the convolution automatic encoder with an hourglass unit, namely an hourglass convolution layer; and the hourglass convolution encoder comprising three hourglass convolution layers and three pooling layers. According to the invention, the convolution layer in the convolution automatic encoder is replaced by the hourglass unit, so that in a complex visual task, when the hourglass convolution automatic encoder neural network is used to extract the multi-scale features of the video image, the intermediate features with richer information can be obtained, and the accuracy of fall detection is improved.

Methods and systems for occlusion detection include detecting a set of foreground object masks in an image, including a mask of a visible portion of a foreground object and a mask of the foreground object that includes at least one occluded portion, using a machine learning model. A set of background object masks is detected in the image, including a mask of a visible portion of a background object and a mask of the background object that includes at least one occluded portion, using the machine learning model. The set of foreground object masks and the set of background object masks are merged using semantic merging. A computer vision task is performed that accounts for the at least one occluded portion of at least one object of the merged set.

The invention discloses a pixel-level image segmentation system based on a multi-modal spectral image. A plurality of visible light cameras and a thermal imaging sensor form a camera array, and the visible light cameras are built into a multi-modal camera array group to form a multi-modal information source; a graphic acquisition card is connected with the multi-modal information source and an acquisition workstation, and stores the acquired image data in the acquisition workstation; and a server carries out registration and post-processing on the graphic data in the acquisition workstation. The invention further discloses a pixel-level image segmentation method based on the multi-modal spectral image. A single-modal image segmentation algorithm is expanded into multi-modal input, and themulti-modal feature images are fused in a network intermediate layer, so that the precision of the Mask-RCNN image segmentation algorithm is improved. And meanwhile, a set of multi-modal spectral image acquisition system is constructed, can be used for constructing a multi-modal data set, is applied to related machine vision tasks such as target detection, image segmentation and semantic segmentation, and has a practical application prospect.

The invention provides a device capable of providing a simulated spatial disorientation scene for a subject and meanwhile recording the eye movement condition of the subject. The eye movement measurement device mainly comprises a head-mounted display device for providing a visual task for the subject, an eye movement tracking module for recording the eye movement condition of the subject in real time, a vestibule electrical simulation device for changing an input signal of a semicircular canal of a vestibule organ of a human body and providing vestibule electrical simulation for the subject and a control computer for controlling the simulation manner, the simulation current mode, the strength and the simulation time of the vestibule electrical simulation device, controlling the visual task displayed by the head-mounted display device, displaying relevant parameters in real time and recording the eye movement data transmitted back by the eye movement tracking module in real time. By means of the device, the visual task and the vestibule electrical simulation can be exerted on the subject at the same time, and meanwhile the eye movement condition of the subject is recorded; and in this way, a researcher can investigate the eye movement condition when the vestibule task and the visual task are exerted on the subject at the same time, meanwhile the burden of equipment installation and set is lowered for the researcher, the good eye movement experiment condition is provided, and research on the spatial disorientation is facilitated.