Supercharge Your Innovation With Domain-Expert AI Agents!

Systems and methods for unifying statistical models for different data modalities

A technique of statistical models and modalities, applied in the field of systems and methods for integrating statistical models of different data modalities

Pending Publication Date: 2020-12-22
QUANTUM SI
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, it is more challenging to train and use statistical machine learning models that can effectively utilize data from multiple different data modalities

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for unifying statistical models for different data modalities
  • Systems and methods for unifying statistical models for different data modalities
  • Systems and methods for unifying statistical models for different data modalities

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048]A statistical model configured to receive data from multiple modalities, take it as input, and process it may be referred to as a multi-modal statistical model. The inventor developed a new type of multi-modal statistical model by developing a novel technique for integrating multiple separate statistical models (each model is designed to process data in different corresponding modalities) to generate multi-modal statistical models. Modal statistical model. The techniques described herein can be used to integrate multiple deep learning models trained for different modalities and / or any other suitable type of statistical model. The technique developed by the inventor solves the shortcomings of the traditional technique for building multi-modal statistical models. By solving these shortcomings, the inventors have developed techniques for improving traditional machine learning systems and computer techniques for implementing them.

[0049]Traditional machine learning techniques used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Techniques for performing a prediction task using a multi-modal statistical model configured to receive input data from multiple modalities including input data from a first modality and input data from a second modality different from the first modality. The techniques include: obtaining information specifying the multi-modal statistical model including values of parameters of each of multiple components of the multi-modal statistical model, the multiple components including first and second encoders for processing input data for the first and second modalities, respectively, first and secondmodality embeddings, a joint-modality representation, and a predictor; obtaining first input data for the first data modality; providing the first input data to the first encoder to generate a firstfeature vector; identifying a second feature vector using the joint-modality representation, the first modality embedding and the first feature vector; and generating a prediction for the prediction task using the predictor and the second feature vector.

Description

[0001]Cross references to related applications[0002]This application requires U.S. Provisional Patent Application No. 62 / 671,068 (titled “Systems and Methods for Multi-Modal Prediction May 14,” filed on May 14, 2019, pursuant to Section 119(e) of Section 35 of the United States Code. 2018") and the priority of U.S. Provisional Patent Application No. 62 / 678,074 (titled "Systems and Methods for Unifying Statistical Models for Different Data Modalities May 30, 2018") filed on May 30, 2018, the entire contents of which are respectively Incorporated herein by reference.Background technique[0003]Machine learning techniques are usually applied to problems where data from multiple modalities is available. Different acquisition frameworks can be used to collect data, and each acquisition framework can be characterized by a corresponding data source, data type, data collection technology, sensor, and / or environment. The data associated with one modality can be collected by using an acquisitio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/084G06N3/088G06N3/045G06N3/044G16H30/40G16H50/70G06F18/2155G06F18/2411G06N3/04G06N3/08
Inventor 乔纳森·M·罗思伯格乌穆特·伊瑟迈克尔·梅耶
Owner QUANTUM SI
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com