341 results about "Multimedia information" patented technology

The invention discloses a video content semantic understanding and text description generation method based on deep learning, and relates to the technical field of multimedia information processing.The method comprises the steps that the semantic similarity of a text and a video frame is calculated through a CLIP model, related key frames are selected, and features are aggregated; respectively extracting audio, visual and semantic features; aligning different modal features by using self-attention, unifying dimensions of the LSTM, and then splicing and fusing; attention weights are calculated at a video level, a frame level and a channel level, and key information expression is enhanced; swin Transform encodes fusion features, and LSTM (Long Short Term Memory) decodes step by step to generate natural language description; and a text-video index database is constructed, and rapid retrieval is realized based on semantic similarity. According to the method, the mapping relation between the video features and the natural language is learned end to end through the deep learning model, dependence on a fixed template can be eliminated, and semantic description with various sentence patterns and coherent logic is generated.

The invention discloses an intelligent assistant system application interaction method based on a personal knowledge base, and relates to the technical field of large models, and the method comprises the steps: capturing multi-dimensional data of an application scene through multimedia information, so as to construct a more comprehensive prompt word engineering template; secondly, optimizing the cue word engineering template by accessing and utilizing personalized information closely related to the user in a pre-constructed personal knowledge base, and further performing scene optimization, entity optimization and multimedia recognition optimization, so that the cue words generated by the system can be ensured to better meet the actual requirements and context of the user; according to the method, more accurate and effective input is provided for subsequent large model processing, so that the intention of the user can be more accurately understood, diversified requirements of different users can be better met, response is made according to personalized information of the user, and the accuracy and efficiency of application interaction are improved.

The application belongs to the technical field of multimedia information processing, and discloses a kind of monitoring video key frame extraction method, system, medium, equipment and terminal, collect original video stream data, original video stream data is decomposed into image frame set;Image frame set obtained by decomposition is sampled, and the image frame result set obtained by sampling is filtered;The image frame set after filtering is adaptively clustered, and the result after clustering is collected to form a video abstract.In order to better utilize the memory space of storage medium and let the user better quickly browse the general content of original video stream, the application provides a key frame screening algorithm for original video stream by sampling, filtering and clustering.The key frame extraction method of the application screens out similar frames, redundant frames and fuzzy frames in original video stream through key frame screening algorithm for original video data, forms a video abstract storage of a section of original video, thereby greatly reduces the occupied storage space.

The invention relates to the technical field of multimedia, in particular to a multimedia information display method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying a personal homepage of a target account; when the personal homepage comprises a work published by the target account, displaying a thumbnail icon corresponding to a multimedia information set in a surrounding area of the work, the multimedia information set comprising multimedia information interacting with the target account; and in response to a trigger operation for the thumbnail icon, displaying the multimedia information in the multimedia information set. According to the method and the device, the operation path of checking the multimedia information interacted with the target account by the target account can be reduced, and the operation difficulty of checking the multimedia information interacted with the target account by the target account is reduced, so that the use experience of the target account is improved.

The invention provides a man-machine interaction method and system in an emergency scene. The method comprises the following steps: analyzing received multimedia information of a first-aid requester to obtain a first-aid situation perception model; according to the first-aid situation perception model, performing selection processing on a possible first-aid response strategy by using a deep reinforcement learning algorithm, and analyzing a relationship between a symptom and a possible cause of disease of the requester in combination with a medical knowledge map technology to generate a first-aid guidance scheme; based on the first-aid guidance scheme, performing real-time optimization processing on a rescue path through a traffic flow prediction algorithm, dynamically adjusting a driving route of a rescue vehicle in combination with road condition information collected by the Internet of Things technology, and generating an optimal rescue path and a latest rescue progress notification; and by using the optimal rescue path and the latest rescue progress notice, performing visualization processing on the first-aid operation process, and generating intuitive visual guidance. According to the technical scheme provided by the invention, the first-aid response speed, accuracy and effectiveness are remarkably improved.

The invention discloses a train fault state detection method and system based on artificial intelligence, and relates to the technical field of train fault state detection. The method comprises the steps that multiple types of sensors are arranged at key parts of a train, state data such as temperature, vibration, electricity, energy consumption and noise are collected in real time, local receiving, preprocessing and wireless uploading of the data are achieved by means of a mobile terminal, and a cloud platform conducts multi-dimensional analysis and fault recognition through an artificial intelligence algorithm on the basis of a health assessment model. According to the train fault diagnosis system and method, health indexes and early warning information are generated and pushed to operation and maintenance personnel in real time, the system supports overhaul process recording and multimedia information uploading, information archiving and analysis tracing are achieved, the accuracy and response efficiency of train fault diagnosis are remarkably improved, the operation and maintenance cost is reduced, and the safety and intelligent level of a railway system are enhanced.

The invention discloses an audio deep forgery detection method and device, a terminal and a storage medium, and relates to the technical field of multimedia information security and artificial intelligence, and the method comprises the steps: constructing an audio deep forgery detection network model; according to the training set, performing decoupling stage training on an audio deep counterfeiting detection network model, and determining an initial training network model; performing meta-learning on the initial training network model according to the training set, and determining a target training network model; and obtaining a to-be-detected audio, inputting the to-be-detected audio into the target training network model, and determining an audio category corresponding to the to-be-detected audio. According to the method, meta-learning is adopted in the training stage of the audio deep forgery detection network model to force the audio deep forgery detection network model to learn general knowledge with higher generalization, so that the problem of poor detection performance caused by model overfitting in the face of an unknown vocoder and a natural scene in the prior art can be effectively solved.

Systems and methods for document processing that can process and understand the layout, text size, text style, and multimedia of a document can generate more accurate and informed document representations. The layout of a document paired with text size and style can indicate what portions of a document are possibly more important, and the understanding of that importance can help with understanding of the document. Systems and methods utilizing a hierarchical framework that processes the block-level and the document-level of a document can capitalize on these indicators to generate a better document representation.

The present invention relates to an intelligent operation and maintenance system based on an AI big model and RPA, which relates to the field of data processing. The system receives user input information in response to an RPA robot, performs semantic matching through an AI semantic model, and obtains consulting questions; processes the consulting questions through an answer material library, and matches a number of historical answers; performs centralized weight distribution on the several historical answers to obtain a number of centralized weights; processes the consulting questions through a question and answer log, and performs answer frequency weight distribution on the several historical answers to obtain a number of frequency weights; optimizes the several historical answers according to the several centralized weights and the several frequency weights, obtains a target answer, and feeds back the target answer to the RPA robot to reply to the user, thereby solving the technical problems that the intelligent operation and maintenance system is difficult to effectively handle complex and non-standardized user questions, the answer matching algorithm has low adaptability, and the multimedia information processing capability is limited.

Disclosed in the present application are an interaction method and apparatus, an electronic device and a readable medium. The method comprises: in response to a page display operation, displaying a target page, wherein the target page comprises a first region and a second region, the first region being used for displaying multimedia information that corresponds to a first account, and the second region being used for displaying attribute information of at least one recommended object that corresponds to a second account, and resource attribute information that corresponds to a candidate object set; and in response to an interaction operation for the candidate object set, performing preset interaction processing, which corresponds to the interaction operation, on a candidate object in the candidate object set.

The invention relates to the technical field of multimedia information processing, and discloses a dynamic display adjusting method and system for multimedia interactive display, and the method comprises the steps: obtaining user real-time interaction data, user role attributes, content type preferences and historical interaction data, and generating real-time interest distribution points according to the user real-time interaction data, the user role attributes, the content type preferences and the historical interaction data; predicting a user behavior in combination with historical interaction data, and generating a pre-loaded content triggering condition; generating a preloaded content set by integrating the preloaded content triggering condition, the user role attribute and the content type preference; acquiring physical parameters of equipment, and constructing a coordinate matrix and a transformation matrix of cross-equipment content presentation; the content is distributed to the target device through the transformation matrix, and finally the display content is dynamically adjusted according to the real-time interaction data. The problem that in the multimedia interactive display technology, the content cannot be smoothly presented in real time during multi-screen switching is solved, seamless connection of the content during multi-screen switching is achieved, and real-time smoothness of multi-screen switching is ensured.

The invention relates to an intelligent operation and maintenance system based on an AI large model and RPA, and relates to the field of data processing. User input information is received in response to an RPA robot, semantic matching is performed through an AI semantic model, and a consultation question is obtained; processing the consultation question through an answer material library, and matching a plurality of historical answers; performing centralized weight distribution on the plurality of historical answers to obtain a plurality of centralized weights; processing the consultation question through a question and answer log, and performing answer frequency weight distribution on the plurality of historical answers to obtain a plurality of frequency weights; the historical answers are optimized according to the concentrated weights and the frequency weights, target answers are obtained and fed back to the RPA robot to reply users, and the problems that an intelligent operation and maintenance system is difficult to effectively process complex and non-standardized user problems, the answer matching algorithm is low in adaptability, and the user experience is poor are solved. And the multimedia information processing capability is limited.

The invention provides an information recommendation method and device, electronic equipment and a storage medium. The method comprises the steps that an information aggregation interface of a target object is displayed, and the information aggregation interface comprises at least one piece of multimedia information related to the target object; in response to a selection operation for the at least one piece of multimedia information, the selected multimedia information is played in a playing interface, and the playing interface comprises an interaction control; and in response to a trigger operation for the interaction control, displaying recommendation information and at least one interaction event with the target object. Through the method and the device, the attraction of the recommended information can be increased, so that the acceptability of the user for the recommended information and the user experience are improved.

The invention provides an interaction method and device, equipment and a storage medium, and relates to the technical field of computers. The method comprises: in response to a preset trigger instruction, displaying multimedia information corresponding to a first media identifier in a media display area of a preset page, and displaying a target object set in an object display area of the preset page, the target object set being determined based on an object corresponding to a candidate media identifier in an identifier aggregation area, and in response to a switching instruction aiming at a candidate media identifier in the identifier aggregation area, determining the candidate media identifier aiming at the switching instruction as a second media identifier, and switching the multimedia information displayed in the media display area from the multimedia information corresponding to the first media identifier to the multimedia information corresponding to the second media identifier. By adopting the technical scheme, the information viewing convenience and the information switching efficiency can be improved.

The present disclosure provides a video-based interaction method, apparatus, and device, and a storage medium. The method comprises: displaying a video playback page; in response to a display trigger operation for a target function page acting on the video playback page, displaying the target function page; and displaying a preset video playback window on the target function page, and, on the basis of playback progress information of a first video, continuing to play the first video in the preset video playback window, the preset video playback window supporting switching and playback of a video on the basis of a multimedia information stream.

The invention discloses an interaction method and device, electronic equipment and a readable medium, in response to a page display operation, a target page is displayed, the target page comprises a first area and a second area, the first area is used for displaying multimedia information corresponding to a first account, and the second area is used for displaying multimedia information corresponding to a second account. The second area is used for displaying attribute information of at least one recommendation object corresponding to the second account and resource attribute information corresponding to the candidate object set; and in response to an interaction operation on the candidate object set, performing preset interaction processing corresponding to the interaction operation on the candidate objects in the candidate object set. In this way, the user can know the resource attribute information of the candidate object set of the currently selected recommendation object and perform interactive operation while watching the multimedia information, and the use experience of the user in the industry of instant retail is improved.

Embodiments of the present disclosure provide an interaction method and apparatus, an electronic device, a readable storage medium and a program product. The interaction method comprises: displaying a multimedia display page, wherein multimedia information displayed by the multimedia display page is first multimedia information corresponding to a target object; in response to an interaction operation for the multimedia display page, displaying an object aggregation page, wherein the object aggregation page comprises object attribute information corresponding to the target object and recommendation information corresponding to the target object, and the recommendation information is used for acquiring object attribute information of a recommended object corresponding to the target object; and in response to a trigger operation for the object attribute information corresponding to the target object or the recommendation information corresponding to the target object, displaying second multimedia information corresponding to the recommended object, wherein the second multimedia information corresponding to the recommended object comprises the object attribute information of the recommended object.

The present application relates to the technical field of computers. Disclosed are a network asset mapping method and apparatus, and a storage medium and an electronic device. In the method, a device receives at least one piece of response information sent by a target station on the basis of a network asset request, wherein the at least one piece of response information includes station service information of the target station and multimedia information borne on the target station, the multimedia information at least including text information and image information; and then the device extracts, from the text information, target entity information of a target entity to which the target station belongs, extracts, from the image information, external application information of an external application associated with the target station, and associates the extracted entity object information and external application information and the obtained station service information as network asset information of the target station, so as to obtain a corresponding target mapping result. By means of the present application, multi-dimensional mining of network asset information of a target station is realized, thereby improving the accuracy and comprehensiveness of network asset mapping.

The invention belongs to the field of multimedia information intelligent processing and classification application, and relates to a multimedia field label information labeling method based on TSK rule migration. The method comprises three parts of label set division, rule migration modeling and multi-label classification. The method comprises the following steps: firstly, constructing a label separation mechanism according to label distribution characteristics of multimedia multi-label data, and dividing a label set into conventional labels and scarce labels; secondly, constructing a rule migration TSK fuzzy system; the system comprises a combined If-part and a migration-driven ten-part, not only can realize feature-label reasoning modeling, but also can establish relevance between conventional labels and scarce labels according to label distribution differences. And finally, on the basis of RT-TSK-FS, a multi-label classification method based on rule migration is provided, and sharing and supplement of knowledge among different labels are realized through a rule migration mechanism, so that the prediction performance of multimedia label information is improved.

The present invention discloses a video information hiding method, system, device, and medium based on inter-block pairing. The method comprises: obtaining encoded H.264 video data and obtaining coefficients of all 4×4 luminance blocks in the H.264 video data; sorting all 4×4 luminance blocks according to the absolute values ​​of their DC coefficients; pairing the AC coefficients from the second to the last digit in adjacent luminance blocks to obtain coefficient pairs; shifting the luminance blocks accordingly based on the coefficient pairs, the data to be embedded, and a two-dimensional histogram transfer map; and placing the embedded 4×4 luminance blocks into the encoded H.264 video data in their original order. The present invention uses inter-block pairing to modify the luminance blocks in the video data according to the embedded data, thereby embedding hidden data and effectively reducing the impact on video quality and the increase in video file size. The present invention can be widely applied in the field of multimedia information security technology.

The invention relates to the technical field of data processing, in particular to a support resource allocation method and device, electronic equipment and a storage medium, and the method comprises the steps: firstly determining each piece of target multimedia information owned by an information holding object, and determining the total amount of support resources configured for the information holding object in an initial support period; for each piece of target multimedia information, obtaining a first analysis result representing that the historical support resource quantity changes along with the historical support coefficient, and a second analysis result representing that the historical push income changes along with the historical support coefficient; and furthermore, according to the total support resource amount, in combination with each first analysis result and each second analysis result, obtaining a target support resource amount and a target support coefficient corresponding to each piece of target multimedia information when the total push income of each piece of target multimedia information meets a preset condition. In this way, the rationality of supporting resource allocation is improved, and the effective utilization rate of supporting resources is guaranteed.

The invention provides a multimedia playing control method, device and system, electronic equipment and a storage medium, and the method comprises the steps: receiving a playing request of a second player under the condition that a first player is playing, and playing the playing request of the second player on an audio playing page of the second player; playing the multimedia information which is being played by the first player in a silent manner through the floating window; detecting whether the second player releases the audio focus or not; and under the condition that the second player releases the audio focus, the multimedia information which is being played by the first player is played through the floating window. According to the invention, after the second player stops playing, the audio playing of the floating window can be automatically recovered.

The invention discloses an entity model shooting illumination processing method and system based on an intelligent light field, and the method comprises the steps: obtaining a light-emitting parameter used for controlling a light-emitting device, and the light-emitting parameter is determined according to the environment illumination in first multimedia information provided in advance; sending the light-emitting parameters of the light-emitting equipment to the light-emitting equipment; wherein the degree that the ambient light generated after the light emitting device emits light according to the light emitting parameters is close to the ambient light in the first multimedia information meets a preset condition; and after the light-emitting equipment emits light according to the light-emitting parameters, controlling shooting equipment to shoot. According to the method and the device, a light illuminator does not need to repeatedly input different light-emitting parameters for testing, so that the problem of low efficiency caused by continuous debugging mainly depending on the light illuminator when the light is adjusted according to the multimedia information in the prior art is solved, and the efficiency of light adjustment during shooting is improved.

This disclosure provides a method, apparatus, electronic device, and storage medium for displaying multimedia data, belonging to the field of multimedia technology. The method includes: acquiring a multimedia information stream; based on the multimedia information stream, when playing multimedia data in a playback interface, displaying a navigation component in the playback interface according to a display style corresponding to the feature information of the multimedia data, the navigation component being used for playback control. This method matches the display style of the navigation component to the feature information of the multimedia data, so that the navigation component is no longer a uniform, universal form. The presentation of the navigation component is adapted to the characteristics of the multimedia data and dynamically adjusted with the content. This not only ensures the basic implementation of playback control functions but also improves the coordination of the playback interface, balancing ease of operation and immersive viewing, presenting higher quality visual effects, ensuring the overall playback and interactive experience, and improving playback efficiency.

1. The name of the design product: multimedia information terminal. 2. The use of the design product: the screen of the multimedia information terminal connected with various host computers. 3. The design points of the design product: the shape. 4. The picture or photo that can best show the design points: the perspective view 2. 5. The bottom surface of the design product is the part that is not easy to see or cannot be seen during use, so the bottom view is omitted.

1. The name of the design product: smart glasses. 2. The use of the design product: for the wearer to perceive multimedia information, and can be used for navigation by visually impaired people. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.

The present invention provides a multimedia information recommendation method, apparatus, program product, device and medium, the method comprising: obtaining first object feedback data for target multimedia information, and predicting a first score corresponding to each first sub-object feedback data based on the first object feedback data; determining a fusion weight parameter corresponding to each first sub-object feedback data through a multi-objective weight search network based on the first object feature data of the object to be recommended; and fusing the first score corresponding to each first sub-object feedback data based on the fusion weight parameter corresponding to each first sub-object feedback data to obtain a second score of the target multimedia information, thereby using the second score of the target multimedia information to recommend multimedia information to the object to be recommended, thereby achieving more accurate recommendation, and at the same time, the hardware overhead required by the multi-objective weight search network is smaller.

The present disclosure provides a multimedia interface generation method, device, equipment and medium, which realizes one-key generation of a multimedia interface based on a multimedia list screenshot. The method comprises: obtaining a multimedia list screenshot and performing multimedia information identification to obtain related information of a multimedia in the multimedia list screenshot; determining similar multimedia interfaces of the multimedia list screenshot from a multimedia database according to the obtained related information of the multimedia, and obtaining cover information and multimedia description information of each similar multimedia interface; and generating a target multimedia interface according to the cover information and the multimedia description information of the similar multimedia interfaces.

1. Name of the Design Product: Vehicle Instrument (HX3). 2. Use of the Design Product: Used for displaying vehicle driving data and multimedia information. 3. Design Key Points of the Design Product: Lies in the shape. 4. Picture or Photograph that Best Illustrates the Design Key Points: Perspective View 1.

The invention provides a method for classifying multimedia information, which comprises the following steps of: processing the multimedia information to be classified through an LFMIL model to obtain a predicted output vector of a label, comparing the predicted output vector of the label with a set classification threshold to obtain a predicted label vector of the multimedia information, and classifying the predicted label vector of the multimedia information through the LFMIL model. And classifying the multimedia information based on the predicted label vector. By constructing the LFMIL model, the feature reasoning information of common tags can be effectively utilized, and the prediction performance of scarce tags is promoted to be improved, so that relatively high classification precision is kept in multi-tag tasks of different multimedia data sets, and the purpose of improving the classification precision is achieved.