6 results about "Self supervision" patented technology

The invention discloses an artificial intelligence robot control system fused with a world model architecture, and the system comprises a control main system which comprises a shared multi-mode backbone network module, a strategy head, and a world model head. A visual encoder, an ontology perception encoder, a text encoder and multi-mode fusion are integrated in the shared multi-mode backbone network module, and the strategy head is used for generating a current action instruction. According to the method, a self-supervision signal provided by a world model is used as an additional training constraint, the dependence on large-scale teaching data is reduced, and a strategy head generates actions based on representation rich in physical dynamic information, so that the device has the advantages that the decision is more stable when facing environmental noise or uncertainty; error accumulation in a long-range task is remarkably reduced, and compared with a traditional open-loop strategy model, the method has the advantage that the generalization ability of training out-of-distribution scenes is remarkably improved.

An apparatus to facilitate learning reliable keypoints in situ with introspective self-supervision is disclosed. The apparatus includes one or more processors to provide a view-overlapped keyframe pair from a pose graph that is generated by a visual simultaneous localization and mapping (VSLAM) process executed by the one or more processors; determine a keypoint match from the view-overlapped keyframe pair based on a keypoint detection and matching process, the keypoint match corresponding to a keypoint; calculate an inverse reliability score based on matched pixels corresponding to the keypoint match in the view-overlapped keyframe pair; identify a supervision signal associated with the keypoint match, the supervision signal comprising a keypoint reliability score of the keypoint based on a final pose output of the VSLAM process; and train a keypoint detection neural network using the keypoint match, the inverse reliability score, and the keypoint reliability score.

Methods and systems disclosed herein relate generally to systems and methods for generating visual relationship graphs that identify relationships between objects depicted in an image. A vision-language application uses transformer encoders to generate a graph structure, in which the graph structure represents a dependency between a first region and a second region of an image. The dependency indicates that a contextual representation of the first region was derived, at least in part, by processing the second region. The contextual representation identifies a predicted identity of an image object depicted in the first region. The predicted identity is determined at least in part by identifying a relationship between the first region and other data objects associated with various modalities.

This invention discloses a self-supervised point cloud upsampling method and system based on adversarial learning, comprising the following steps: data acquisition; hybrid geometry-aware downsampling, combining random sampling and farthest point sampling to construct self-supervised pairs conforming to real-world distribution; initial upsampling, achieving global-local feature balance through three-stage iterative refinement; further upsampling, repeating the initial upsampling process within intermediate point clouds and introducing uniformity loss statistics; a detail module, extracting multi-scale geometric features stepwise through three dynamically updated EdgeConv layers and employing a GAN-based adversarial training strategy to output a fine point cloud; a detail-aware discriminator, receiving the predicted fine point cloud and the corresponding ground real point cloud as input, reshaping them into a form suitable for convolutional layers; and point cloud reconstruction, regressing the 3D point cloud shape from the point cloud feature information. Applying this invention can improve the quality and efficiency of high-precision reconstruction for different scenes.

The application provides a spatial transcriptome double self-supervision clustering analysis method and system, relates to the field of bioinformatics, and performs pretreatment on spatial transcriptome data to be analyzed to obtain sample data composed of gene expression data, cell image features and an adjacency matrix; the sample data is input into a trained double self-supervision model to perform clustering, and the clustering distribution of the sample data is obtained; according to the clustering distribution, a cell label is obtained as a final recognized cell type; the double self-supervision is self-supervision training of a linear autoencoder and training of a global target distribution supervised graph convolutional neural network encoder; through self-supervision training of the linear autoencoder and training of the global target distribution supervised graph convolutional neural network encoder, the training effect of the encoder is improved in a double self-supervision manner, and efficient and accurate classification and recognition of spatial transcriptome cells are realized.