32 results about "Image query" patented technology

Systems, methods, and non-transitory computer-readable media implements related image search and image modification processes using various search engines and a consolidated graphical user interface. For instance, one or more embodiments involve receiving an input digital image and search input and further modify the input digital image using the image search results retrieved in response to the search input. In some cases, the search input includes a multi-modal search input having multiple queries (e.g., an image query and a text query), and one or more embodiments involve retrieving the image search results utilizing a weighted combination of the queries. Some implementations involve generating an input embedding for the search input (e.g., the multi-modal search input) and retrieving the image search results using the input embedding.

The invention belongs to the field of intelligent rail transit and computer vision, and provides a three-dimensional target detection and rail line identification method based on multi-modal fusion. According to the method, camera images, laser radar point cloud voxel features and point cloud features are extracted through deep learning, image query and point cloud query are generated according to an image query generator and a point cloud query generator, a unified query input detection head is formed through clustering fusion, and a target detection result is output. Meanwhile, a unified query generator is designed to generate a track line sensing query, and after fusion, a track line detection head is input to output a track line detection result. According to the method, multi-mode complementary information is effectively utilized, a coordinate system is unified to avoid conversion errors, and target detection and track line identification in a long-distance range in front of the track locomotive are realized by adopting a sparse query method.

This invention discloses a method and system for real-time monitoring and prediction of carbon intensity, belonging to the field of carbon emission monitoring technology. The method acquires and processes electricity-related data such as installed capacity and real-time load of each province hourly through an ETL data channel; it draws a map of China based on ECharts, dividing it into five color-level intervals according to carbon intensity values: 0-300, 301-500, 501-700, 701-900, and 901-1200 gCO2 / kWh; responding to user clicks on provinces, it displays detailed data for each province through indicator cards, circular progress charts, and one-sided bar charts; it calls a pre-trained STFCI hybrid model to predict carbon intensity hourly for the next 24 hours. This model integrates a 2-layer 128-neuron LSTM unit with an XGBoost unit with 100 trees and a learning rate of 0.1, outputting predicted values ​​after feature concatenation and a fully connected layer; the prediction results are displayed as a bar chart, marking customizable low-carbon threshold lines, highlighting low-carbon periods, and generating electricity consumption suggestions. The corresponding system includes a data interface, database, visualization, prediction, and WeChat service modules. The database adopts an InfluxDB+MySQL combined architecture, and the WeChat service module supports mobile text and image queries. The STFCI model of this invention has an average absolute error of only 12.3 gCO2 / kWh, significantly improving prediction accuracy, realizing hourly real-time monitoring and multi-dimensional visualization of carbon intensity, and providing precise decision support for power dispatching and energy conservation and emission reduction when combined with mobile services.

This application discloses a cross-modal representation learning and retrieval method and system for grain production, relating to the field of agricultural informatization. The method includes: performing multi-granularity semantic alignment on image-text pairs in the grain production process based on a bidirectional guided image-text fusion network to obtain semantically segmented images; performing image spatial decoupling and temporal enhancement on video-text pairs in the grain production process based on global semantic guidance to obtain structured semantic image features; constructing a text feature library and an image feature library; determining a transmission plan matrix based on the modality of the data to be retrieved; generating query features for the data to be retrieved based on the transmission plan matrix; and outputting text query results or image query results using a similarity measurement method based on the query features, text feature library, and image feature library. This application enables deep fusion of cross-modal features, improves the accuracy of image-text semantic matching, and achieves fast and accurate matching and retrieval between images and text.

The embodiment of the invention provides an image query method and device, equipment and a storage medium. The method comprises the following steps: determining a first group of images matched with a text query item from a first image set; determining a fused image feature by fusing a group of image features corresponding to the first group of images; and based on the fused image features, determining a second group of images from the second image set as a query result for the text query item. According to the embodiment of the invention, image query is carried out based on richer and more accurate fusion image features of the feature information, and the accuracy of image query can be effectively improved.

The application discloses a specific picture recognition method based on multi-modal, relates to the field of specific picture recognition, and comprises two parts of feature information extraction of pictures and texts and a specific picture matching strategy of FH-LANet, adopts an image matching idea to extract features of pictures through a multi-modal feature extraction network FH-LANet model, selects a specific picture as a query library picture, the query feature is not a single modal picture feature, but a text feature, similarity calculation is carried out by using the features of the input picture and the query feature, threshold judgment is then carried out, the matched picture and filtered text are matched again, noise data is filtered out, the picture that does not match the query picture is secondarily matched with the query text, and finally, the recognition result of the picture is obtained, and the specific picture in the mass pictures can be accurately found out.

The embodiment of the invention relates to a medical image query and comparison system. The system comprises an image database, a query server and a plurality of first clients, and the query server is respectively connected with the image database and each first client. The image database is used for storing a plurality of image data records. The query server is used for performing multi-dimensional query on the image database based on the multi-dimensional query configuration sent by the first client; the first client is used for generating multi-dimensional query configuration, sending the multi-dimensional query configuration to the query server, displaying a query list according to server feedback data, generating a multi-selection target set according to a selection result of a user on the query list, and registering and aligning all images of the multi-selection target set; and the synchronous operation module is used for carrying out synchronous operation on loading images in other image areas according to operation actions of a user in any image area. On the basis of the method, the query operation can be simplified, the query efficiency is improved, the big data value is improved, and the operation convenience of multi-image comparison is improved.

The invention is suitable for the technical field of computer application, and provides a vehicle part chart query method and device, electronic equipment and a storage medium, the method comprises the following steps: in response to a chart query instruction triggered by a user, determining first named entity information corresponding to the chart query instruction; performing vector coding processing on the first named entity information to generate a chart query vector corresponding to the first named entity information; according to the chart query vector and a preset chart vector library, determining a target component chart corresponding to the chart query instruction; and sending the target part chart to the user. Therefore, the named entity information in the user chart query instruction is extracted, the image query vector is generated according to the named entity information, and the component chart corresponding to the chart query instruction is queried through the image query vector, so that the component chart query efficiency and accuracy are improved, and the automobile maintenance efficiency and accuracy are improved.

The embodiment of the invention discloses a city management case image recognition method and system based on a multi-modal large model. According to the embodiment of the invention, an image-text pair is constructed by collecting city management images and text data, description is generated for the images by using the multi-modal large model, and a text embedding model is finely adjusted to improve the image-text semantic alignment capability. According to the embodiment of the invention, text or image query can be accepted, the advantages of sparse retrieval and dense retrieval are combined through a mixed retrieval strategy, related information is accurately retrieved, and finally, deep reasoning is carried out by utilizing a multi-modal large model. The problems that image-text semantics are not fully aligned and the retrieval precision is insufficient are effectively solved, and the accuracy and reliability of complex image recognition in a city management scene are remarkably improved.

The invention provides a picture processing method and device, equipment, a medium and a product, and relates to the technical field of data processing, and the specific technical scheme is as follows: in a system switching process of a target server and a historical server, the historical server transmits first structured information of a historical picture to the target server, and the target server transmits the first structured information of the historical picture to the target server in each piece of index information; and taking the index information matched with the picture query condition as target index information, and sending the target index information to the terminal. And the terminal queries the target query picture in a historical server or a target server based on the target index information. According to the method, the historical picture does not need to be transmitted, only the first structured information needs to be transmitted, the data size of the first structured information is smaller than that of the historical picture, the data transmission time in the system switching process is saved, the data transmission efficiency in the system switching process is improved, and then the system switching efficiency is improved; and the target server can execute the picture query service as soon as possible.

The utility model discloses image inquiry equipment which comprises a base, a lifting device, a connecting arm and an imaging device. The lifting device is arranged on one side of the base in the first direction and can move in the first direction. The connecting arm is rotatably arranged at the end, away from the base, of the lifting device. The imaging device can rotate around the joint of the connecting arm and the imaging device in the first direction, the imaging device comprises a shell, a display screen and an imaging lens, the display screen and the imaging lens are both arranged on the shell, and signal light emitted by the display screen is projected on the imaging lens; and the signal light passes through the imaging lens to form a floating real image which is in mirror symmetry with the display screen in the air. According to the image inquiry equipment, the height and / or inclination of the imaging device are / is suitable for observation of medical staff and operation requirements of floating real images, the physical fatigue of the medical staff is reduced, and the film reading efficiency and accuracy of the medical staff adopting the image inquiry equipment are improved.

A method performed by an electronic device according to one embodiment may include: an operation of obtaining a text query corresponding to an image query output by a trained first model by inputting an image query into a trained first model; an operation of obtaining one or more images as a first search result for an image query and one or more texts as a second search result for a text query from a database; a set of candidate images determined according to the first search result and the second search result; an operation of obtaining a multimodal score for a set of candidate images output by a trained second model by inputting an image query and a text query into a trained second model; and an operation of determining one or more target images from a set of candidate images based on a multimodal score for a set of candidate images.

The application provides an image detection method and device, electronic equipment and storage medium, comprising: collecting an image to be processed; using a pre-trained image encoder to extract features of the image to be processed to obtain target image features; inputting training set text features and the target image features into a pre-trained contrast network to perform feature matching calculation to obtain a target image query result value; performing similarity calculation on the target image features and training set image features to generate a target similarity matrix; performing nonlinear mapping calculation on labels and the target similarity matrix based on first target hyperparameters to generate a target similarity query result value; performing weighted calculation on the target image query result value and the target similarity query result value based on second target hyperparameters to obtain a target classification result value; and the target classification result value is used to indicate a detection result of the image to be processed. Thus, the application can be more conveniently and quickly applied to various different application environments.

Systems and methods for unimodal visual search can include obtaining an image query, processing the image query to generate an intent determination, determining a particular prompt based on the intent determination, determining a plurality of search results, and processing the particular prompt, the image query, and at least a subset of the plurality of search results to generate a model-generated response. A generation model can render different responses based on different prompts related to different intents.

The application discloses a kind of image extraction model construction, image query and video generation method, device, the method includes obtaining all video frame images in video library;Each of all video frame images is carried out encoding processing, and first video frame image encoding sample set is obtained;Each of all video frame images is carried out data enhancement processing, and the image after enhancement is encoded to obtain second video frame image encoding sample set;First video frame image encoding sample set, second video frame image encoding sample set are input into pre-trained image extraction model and are trained, so that image extraction model can accurately extract the feature of video frame, improve the accuracy of video frame image matching.

This invention discloses a multimodal planetary landform semantic retrieval method, system, terminal device, and medium, belonging to the field of semantic retrieval technology. The method includes: acquiring planetary remote sensing images and corresponding original descriptive texts and performing semantic processing to construct an image-text pair dataset; constructing a visual-language model with a two-stream neural network architecture and training it through contrastive learning to achieve alignment of visual and geological semantic features; segmenting the full-scale remote sensing image of the target planet into multi-resolution tiles, extracting feature vectors, and constructing a vector index library with associated geographic coordinates; receiving text and / or image query requests, encoding them into query vectors, matching them against the index library, and outputting the matching results. This invention overcomes the data and semantic gap and closed-set limitations of existing technologies, achieving zero-sample open-vocabulary retrieval and planetary-level second-level response, supporting multimodal queries and process-oriented analysis, and contributing to the discovery of rare landforms and planetary geological science research.

The invention relates to the field of remote sensing big data cleaning, and discloses a remote sensing image cataloguing data time error cleaning method and system, and the method comprises the steps: sequentially obtaining the related information of each image cataloguing data based on a remote sensing image cataloguing database; if the value obtained by subtracting the product metadata file modification time from the scene cataloguing time is larger than a set threshold value, the scene cataloguing time has errors, and the scene cataloguing time serves as the product metadata file modification time; and carrying out start time and end time error judgment and correction on the scene score push-broom mode and the area array mode to which the scene score push-broom mode and the area array mode belong. According to the method, the data accuracy in the remote sensing image query and service process is improved, and technical support can be provided for large-scale remote sensing image cataloguing data cleaning.

The application provides a blockchain-based non-fungible token image query method and system, which can be used in the technical field of blockchain. The method comprises the following steps: receiving an image query request sent by a client of a target user; obtaining a right relationship table corresponding to the image query request from a blockchain; querying a target image file corresponding to the right relationship table from an interstellar file system; the target image file comprises a combined image file obtained by combining non-fungible token image files in a plurality of storage nodes of the interstellar file system, and the combined image file is stored in a unique corresponding main storage node and a backup storage node, wherein the main storage node and the backup storage node are storage nodes in the interstellar file system. The application can realize the combination and centralized storage of a plurality of non-fungible token images, thereby improving the efficiency of non-fungible token image query.

The invention discloses an image query method, device and equipment and a storage medium, and relates to the technical field of image processing.The method comprises the steps that trap door query information sent by a query user is received, and the trap door query information is determined by the query user based on a query image and a user token; determining the similarity between the trap door query information and the encrypted index information of each image, and determining target encrypted index information according to each similarity; and determining an encrypted query result according to the target encrypted index information, and sending the encrypted query result to the query user, so that the query user determines a query result by decrypting the encrypted query result. According to the technical scheme, the user behavior association risk caused by trap door repetition in the prior art is solved, the non-linkability of trap doors in a multi-user scene is ensured, and the problem of cross privacy leakage in the multi-user scene is avoided.

The invention discloses an image selection method and device for model training, equipment and a storage medium, and relates to the field of image detection. Receiving a new material image, extracting corresponding image source information, and extracting attribute information of a defect image for training a defect model from the image source information; the attribute information is used for extracting images meeting defect model training conditions from a defect material library; generating an image query instruction based on the selected target attribute information, and searching and returning a target defect map from the defect material library in an index manner; and constructing and generating a defect training set based on the target defect map. According to the scheme, the adaptive defect image is automatically screened by receiving the new material image, extracting the attribute information, generating the query instruction, indexing the target defect image and constructing the training set, and the method has the advantages that the adaptive defect image can be automatically and efficiently screened for the new material, so that the model training period is shortened, and the production efficiency is improved.

This application discloses an image storage method, an image retrieval method, and related apparatus, relating to the field of image processing. The image storage method includes: acquiring an image set; clustering the images in the image set into buckets according to image features to obtain a bucket set; performing video encoding on the images in each bucket of the bucket set to obtain a video sequence for each bucket in the bucket set; restoring and decoding the frames in the video sequence to obtain decoded frames; if the image feature similarity between the decoded frame and the original image is less than a first threshold, then after adjusting the video encoding parameters, returning to video encoding the images in each bucket of the bucket set, until the loop termination condition is met, so that the target video sequence of each bucket in the bucket set is obtained and stored at the end of the loop. This application considers image query needs when storing the image set. While encoding the image set into video after clustering, it achieves high-fidelity compressed storage through frame decoding and similarity comparison, reducing storage costs and management burden.

This application discloses an object query method and apparatus, comprising: obtaining retrieval text corresponding to the object to be queried; determining object attribute features corresponding to the object to be queried based on the retrieval text; obtaining a target query pattern determined based on the object attribute features and / or multimodal latent space features corresponding to the retrieval text based on the degree of matching between the object attribute features and attribute tags in a target attribute feature set; and using the target query pattern to query a target image database to obtain target image query results that match the object to be queried. This application improves the accuracy of object query by performing object query based on object attribute features and corresponding multimodal latent space features.

The embodiments of the present disclosure provide an information processing method and apparatus, as well as a product query method and apparatus. The information processing method includes: obtaining image-text query information comprising image query information and text query information, and determining an information attribute type corresponding to the image-text query information; identifying the image query information and the text query information within the image-text query information, and constructing image-text fusion information based on the image query information and the text query information; performing object retrieval for the image query information, the text query information, and the image-text fusion information respectively to obtain an image-retrieved object, a text-retrieved object, and an image-text retrieved object; ranking the image-retrieved object, the text-retrieved object, and the image-text retrieved object according to the information attribute type, and determining a target object corresponding to the image-text query information based on a ranking result.

A method for search and retrieval of subsurface data of a geological region includes receiving input data related to the geological region. The method also includes generating a plurality of seismic data-text pairs based on the input data. The method also includes training an intelligence model based on the plurality of seismic data-text pairs. The method also includes generating a database using the intelligence model. The method also includes receiving an input query including a seismic data query, a text query, an image query, or a combination thereof. The method also includes generating an output from the database using the intelligence model and based on the input query.

This application provides an image management method, the method comprising: receiving a request instruction sent by a user terminal, wherein the request instruction includes: geographic location information corresponding to the content of an image to be displayed; obtaining a service identifier for each image to be displayed corresponding to the geographic location information from a pre-stored correspondence between image service identifiers and location information, wherein at least two images to be displayed have different service identifiers; and obtaining and sending the image to be displayed corresponding to the service identifier to the user terminal for display. Since the number of images corresponding to each service is small, efficient online image query and browsing can be achieved.

This specification discloses a data processing method, apparatus, storage medium, and electronic device. The method includes: acquiring a query request; determining the query data and query type in the query request; if the query type is an image query or a text-image query, generating a multi-dimensional vector corresponding to the query data; performing dimensionality reduction processing on the multi-dimensional vector to obtain a query vector corresponding to the query data; performing a matching retrieval in a pre-created corpus vector set based on the query vector; determining the vector matching result corresponding to the query vector; identifying the vector matching result to obtain a target vector matching result; generating an answer result corresponding to the query data based on the target vector matching result; and outputting the answer result. Using this specification, image queries and text-image queries are implemented, and the efficiency and accuracy of responding to and answering query requests are improved.

This application discloses a joint training method for an image encoder and a text encoder based on contrastive learning, an image query method, a health status assessment method, and an apparatus, relating to the field of medical image understanding. The method includes: inputting various 3D multimodal brain MRI images and various Chinese medical reports into an image encoder model and a text encoder model respectively, obtaining one-dimensional image vectors and one-dimensional text vectors; calculating the loss for the current iteration using a fusion loss function based on the image-text similarity matrix, the text-image similarity matrix, and the semantic similarity matrix, and optimizing the parameters of the image encoder model and the text encoder model; and obtaining the trained image encoder model and text encoder model when the iteration termination condition is met. This application achieves downstream tasks such as zero-shot classification of images and text and cross-modal mutual retrieval.

The invention discloses a receipt image processing method and device. Relates to the field of financial science and technology, and the method comprises the steps: obtaining an original document image, carrying out the mask processing of the original document image, and obtaining a decrypted document image, the original document image being an image generated after a target user handles a financial service; obtaining N pieces of financial information associated with the financial service, encrypting the N pieces of financial information to obtain N pieces of encrypted financial data, and embedding the N pieces of encrypted financial data into the decrypted document image to obtain a encrypted document image, N being a positive integer; and receiving an image query request sent by the client, and sending the secret-carrying document image to the client according to the image query request. According to the method and the device, the technical problem that the privacy protection effect is poor when privacy protection is carried out on the user information of the target user who handles the financial service in the prior art is solved.

The invention discloses a picture storage method, a picture retrieval method and related devices, and relates to the field of image processing, and the picture storage method comprises the following steps: obtaining a picture set, carrying out clustering and bucking on pictures in the picture set according to picture features to obtain a bucket set, and carrying out video coding on the picture in each bucket in the bucket set to obtain a video coded picture; and obtaining a video sequence of each bucket in the bucket set, performing recovery decoding on frames in the video sequences to obtain a decoded frame, and if the picture feature similarity between the decoded frame and the original picture is smaller than a first threshold value, returning to perform video coding on the picture in each bucket in the bucket set after the video coding parameters are adjusted until a cycle end condition is reached, and if the picture feature similarity between the decoded frame and the original picture is smaller than the first threshold value, returning to perform video coding on the picture in each bucket in the bucket set. And obtaining a target video sequence of each bucket in the bucket set at the end of the circulation, and storing the target video sequence. According to the method, the picture query requirement is considered when the picture set is stored, the picture set is encoded into the video after being clustered, meanwhile, high-fidelity compression storage is achieved through frame decoding and similarity comparison, and the storage cost and the management burden are reduced.

The invention discloses a data processing method which comprises the following steps: acquiring a query request which comprises image query and / or text query; based on image query in the query request, extracting image features in the query request through an image feature extraction strategy to obtain an image feature vector; based on text query in the query request, semantic features in the query request are extracted through a language model, and semantic feature vectors are obtained; the feature similarity between the image feature vector and the semantic feature vector is determined, retrieval is carried out based on the feature similarity, and a corresponding retrieval result is output; the retrieval result comprises image features and / or text features which represent the query request.