81 results about "Multimedia streams" patented technology

The present disclosure provides a neural network-based security defense method for encrypted multimedia data, including: adding implicit digital watermark information to original encrypted multimedia traffic to obtain watermark encrypted multimedia traffic; determining a first feature sequence of the watermark encrypted multimedia traffic; based on the first feature sequence and a second feature sequence of the original encrypted multimedia traffic, determining a correlation coefficient between the first feature sequence and the second feature sequence; and if the correlation coefficient indicates that a negative correlation between the first feature sequence and the second feature sequence satisfies a preset condition, performing training based on the first feature sequence and the second feature sequence to obtain a target neural network, where the target neural network is configured to identify whether there is implicit digital watermark information in encrypted multimedia traffic to be detected.

Summaries of broadcasts of live events are generated based on intensities of audio signals captured during the live events. Streams of multimedia including video signals and audio signals are captured by one or more cameras. The video signals are processed to identify specific activities of interest (e.g., plays of a sporting event) during the live event. Audio signals captured concurrently with the video signals are processed to determine their respective intensities or other acoustic characteristics. The activities of interest are ranked based on intensities of the audio signals. A multimedia stream representing a summary of a media program and includes the highest-ranking video signals and corresponding audio signals is generated and transmitted to one or more devices of viewers.

The invention is suitable for the technical field of intelligent terminals, and provides a media stream quality parameter balancing method and device, terminal equipment and a storage medium, and the method comprises the steps: obtaining end-to-end transmission performance data of a transmitting end and a receiving end; determining a bearable total code rate of the system according to the end-to-end transmission performance data and a preset network state evaluation model; calculating a target total code rate and a minimum tolerated total code rate based on the target code rate and the minimum tolerated code rate of each media stream configured by the application layer; determining a coordination code rate of each media stream according to the bearable total code rate, the target total code rate and the minimum tolerable total code rate; and according to the performance fluctuation information of the sending end and the receiving end and the coordination code rate, dynamically adjusting the execution code rate of each media stream in a balanced manner. According to the scheme, multimedia stream quality parameters can be effectively balanced and optimized, and the overall transmission efficiency of the media stream is improved while the quality of the media stream is guaranteed.

The invention relates to the technical field of data acquisition, and particularly discloses a business product live broadcast stream data acquisition method and system, and the method comprises the steps: obtaining a plurality of groups of live broadcast source data in a business live broadcast scene, and enabling each group of live broadcast source data to comprise multimedia stream data, user operation data, transaction flow data and supply chain state data; acquiring differential data acquisition period information according to the live broadcast source data; acquiring a multi-batch data sample set according to the differential data acquisition period information; integrating and analyzing the multiple batches of data sample sets to obtain a data acquisition quality evaluation value; and acquiring a data acquisition judgment value according to the data acquisition quality evaluation value. By comprehensively collecting multi-source data such as multimedia stream, user operation, transaction flow and supply chain state, the market trend and user requirements can be accurately grasped, differential data collection is achieved, and collection efficiency and quality are improved.

Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: examining foreground voice data of a multimedia stream that includes a video stream data and an audio stream; identifying in dependence on the examining an open time window that is absent of foreground voice data; processing, in dependence on the identifying, media stream data of multimedia stream; generating, in dependence on the processing, a text string for deployment in the open time window, wherein the text string describes content of the video stream; converting the text string into a synthesized voice segment; and adapting the audio stream data so that the synthesized voice segment is included in the audio stream and time bounded within the open time window.

A system for virtually broadcasting from within a virtual environment, comprising a server computer system. The system implements a data exchange management module configured to manage data exchange between client devices and at least one virtual environment comprising a virtual broadcasting camera positioned within the virtual environment and configured to capture multimedia streams of a virtual multimedia streams source from within the virtual environment. The system is configured to receive live feed data captured by at least one camera from at least one client device and broadcast the multimedia streams to the client device based on data exchange management. The broadcasted multimedia streams are configured to be displayed to corresponding user graphical representations generated from a user live data feed from at least one client device. The data exchange management comprises analyzing the incoming multimedia streams and assessing the forwarding of outbound multimedia streams based on the analyzing.

A method, an apparatus, and a readable storage medium for processing a media stream. The media stream may conform to the DASH standard or the CMAF standard. The method may include processing an Addressable Resource Index (ARI) event associated with the 5G media stream, the ARI event including at least one of an inband event sent with a first media slice in a content set, the content set including one or more media slices, or a Media Presentation Description (MPD) event, the ARI event carrying configuration information of the one or more media slices in the content set.

A method, apparatus, and computer program product for trickplay in HTTP live streaming (HLS), includes: establishing a connection to a content source; receiving a piece of content from a content source as a multimedia stream, wherein the multimedia stream comprises a digital living network alliance stream; converting the multimedia stream into a client stream that comprises a HLS stream, the HLS stream including a manifest file containing a plurality of transport stream packets; storing a pre-determined number of the plurality of transport stream packets in a temporary storage; outputting the client stream to a media player; receiving a first trickplay request from the media player, the first trickplay request being a pause request; in response to the first trickplay request: pausing the client stream; transmitting a signal keeping the connection to the content source alive and the multimedia stream active; and storing the multimedia stream in the temporary storage.

This invention provides a method, computer program, and computing device for detecting and identifying drilling positions and sequences. The method includes: acquiring and decoding a multimedia stream from a camera device to obtain current color image data; performing mold recognition and segmentation on the current color image data to obtain the current mold type and mold outline region; determining whether the current mold is correctly placed based on the mold outline region; performing drilling segmentation on the current color image data to obtain current operation data, the current operation data including the center point coordinates of each drill hole and the drilling sequence during the current operation; and determining whether the drilling positions and drilling sequences are correct based on the current operation data. According to the technical solution of this invention, the correctness of the drilling position and drilling sequence can be automatically detected during drilling operations, and a real-time alarm can be triggered when an error in the drilling position or drilling sequence occurs.

A method of multimodal multimedia processing for at least one wearable device comprising an image sensor and at least one processor. The method includes in response to the image sensor being turned on, obtaining a first measurement of at least one of a physiological parameter of an individual or an environmental parameter captured by the at least one wearable device in a vicinity of the individual; determining whether a triggering event has occurred based on the first measurement, the triggering event associated with generating tagging information based on the first measurement using a machine learning model adapted to run on the at least one processor; and in response to determining that the triggering event has occurred, editing a selected clip from a multimedia stream currently being captured by the image sensor to include the tagging information generated based on the first measurement at a corresponding timestamp.

A system for virtually broadcasting from within a virtual environment, comprising a server computer system. The system implements a data exchange management module configured to manage data exchange between client devices and at least one virtual environment comprising a virtual broadcasting camera positioned within the virtual environment and configured to capture multimedia streams of a virtual multimedia streams source from within the virtual environment. The system is configured to receive live feed data captured by at least one camera from at least one client device and broadcast the multimedia streams to the client device based on data exchange management. The broadcasted multimedia streams are configured to be displayed to corresponding user graphical representations generated from a user live data feed from at least one client device. The data exchange management comprises analyzing the incoming multimedia streams and assessing the forwarding of outbound multimedia streams based on the analyzing.

In a vehicle, a computer can receive a first content data including a first graphical component and a first audio stream and a second content data including a second graphical component and a second audio stream, and select a first audio output mode for the first audio stream and a second audio output mode for the second audio stream based on a priority determination that includes a priority of the first set of content data and / or a priority of the second set of content data, wherein the priority determination is based on a vehicle state.

The invention relates to the technical field of network live broadcast, and provides a live broadcast room interface switching method and system, a readable storage medium and computer equipment, and the method comprises the steps: an anchor client sends a live broadcast multimedia stream to a live broadcast server; the anchor client receives a trigger instruction of a mode switching control in an interface of the live broadcast room, sends a game live broadcast switching request to the live broadcast server, and sends a game live broadcast stream subscription request to the game server; the live broadcast server receives a game live broadcast switching request sent by the anchor client, obtains a game multimedia stream, and sends a game live broadcast switching instruction and a first media stream to the client of the live broadcast room; the client of the live broadcast room receives the game live broadcast switching instruction, and the multimedia live broadcast mode of the live broadcast room is switched to the game live broadcast mode; and the client of the live broadcast room receives and displays the first media stream in the interface of the corresponding live broadcast room. Therefore, the live broadcast convenience of the anchor can be improved, and the audio-visual experience of audiences can be effectively improved.

The present application provides a multimedia stream processing method, device, storage medium and program product, which are applied to various scenarios such as cloud technology and artificial intelligence; the multimedia stream processing method includes: receiving a multimedia stream to be decoded sent by a server device, and obtaining at least one event trigger moment corresponding to the multimedia stream to be decoded, where the at least one event trigger moment is obtained by adjusting at least one event marking moment based on stream time change information, and the stream time change information refers to the time change before and after the encoding of the multimedia stream, and each event marking moment refers to an event moment in the multimedia stream before encoding; decoding the multimedia stream to be decoded and playing the multimedia stream to be played; when the multimedia stream to be played reaches a target event trigger moment, performing a specified process corresponding to the target event trigger moment, where the target event trigger moment is any one of the at least one event trigger moment. Through the present application, the accuracy of triggering the specified process can be improved.

The present application relates to a method for operating a multimedia system in which a key sequence is encoded into a multimedia stream in order to generate a modified multimedia stream, the key sequence comprising a predefined sequence of numbers. The modified multimedia stream with the encoded key sequence is transmitted to a remote processing entity for remote processing of the modified multimedia stream, and the multimedia stream is received from the remote processing entity. It is determined whether the received multimedia stream includes the encoded key sequence, where in response to determining that the received multimedia stream does not include the encoded key sequence, the multimedia system uses a locally processed multimedia stream that is locally processed within the multimedia system for output of the multimedia system.

A method of controlling energy consumed by a multimedia streaming application executed in a multimedia streaming system, the method comprising: receiving (358), at an end-user device, a message including information representative of energy consumed by at least one node of the multimedia streaming system when applying at least one process on content having a first profile delivered by the multimedia streaming application prior to delivering the content having the first profile to the end-user device; and requesting (359), at the end-user device, content having a second profile based on the received information representative of the energy consumed by the at least one node.

The invention relates to a video processing method and device, electronic equipment, a storage medium and a product, and relates to the technical field of multimedia. The video processing method comprises: analyzing a first video file to obtain a plurality of tracks in the first video file, the last one or more frames of the first video file being invalid frames, the plurality of tracks at least comprising a track of a specified type and an audio track, and the track of the specified type comprising a video track; generating a second video file according to the track of the specified type in the first video file; and synthesizing the audio file and the second video file into a multimedia stream.

The invention relates to a method for grouping peers, comprising the following steps carried out by a server: receiving (200) a grouping request transmitted by a requesting peer; searching (202) a plurality of previously constituted peer groups of the peer-to-peer network for at least one candidate group that fulfils the following conditions: the candidate group comprises at least one peer having a segment of a multimedia stream that is included within a temporal neighbourhood of a subsequent segment and comprises at least one peer fulfilling a condition of proximity with the requesting peer; if at least one candidate group was found during the search, adding (208) the peer to a selected group, the selected group being a candidate group that was found during the search; and commanding (210) that the requesting peer is sent data that enables the requesting peer to establish connections with the other peers belonging to the selected group.

The invention relates to the technical field of network live broadcast, and provides a direct broadcast room explanation content generation method and system, a readable storage medium and equipment, and the method comprises the steps: obtaining a first media stream of a direct broadcast room, and the content of the first media stream comprises the content of a live broadcast multimedia stream and the content of a game multimedia stream; acquiring a live broadcast interaction information hotspot of the live broadcast room according to the interaction information of the live broadcast room; and acquiring game state information of an anchor client corresponding to the live broadcast interaction hot spot in the game multimedia stream according to the live broadcast interaction information hot spot, generating corresponding game commentary content according to the acquired game state information, and enabling the client of the live broadcast room to correspondingly play the game commentary content. Therefore, the technical scheme of the application can effectively improve the pertinence and interactivity of the explanation content, so that the explanation content better fits the actual interests and tendencies of audiences in the live broadcast room, and the watching experience of the user in the live broadcast scene is optimized.

The invention relates to the technical field of network live broadcast, and provides a live broadcast picture display method and system of a live broadcast room, a readable storage medium and computer equipment, and the method comprises the steps that a first anchor client sends a first live broadcast multimedia stream to a live broadcast server; a first anchor client receives a trigger instruction of a mode switching control in an interface of a live broadcast room, and sends a game live broadcast switching request and a corresponding first game multimedia stream to a live broadcast server; the live broadcast server receives the first game multimedia stream after passing the game live broadcast switching request, and sends a game live broadcast switching instruction and the first game multimedia stream to audience clients in the live broadcast room; and the audience client receives the game live broadcast switching instruction, switches the live broadcast room from the multimedia live broadcast mode to the game live broadcast mode, and displays the first media stream in the interface of the corresponding live broadcast room. Therefore, the live broadcast convenience of the anchor can be improved, and the audio-visual experience of audiences can be effectively improved.

The invention relates to a call establishment method and device, communication equipment, a storage medium and a program product. The method comprises the following steps: an augmented call SDK in a first terminal receives an augmented reality AR call establishment request sent by a first application in the first terminal; based on the AR call establishment request, performing signaling interaction with an enhanced call SDK in the second terminal to establish a network multimedia system data channel IMSDC with a first application in the second terminal, and then obtaining video call window data to render a video call window in a call interface; and controlling a camera in the first terminal to be turned on so as to obtain AR data, wherein the AR data comprises frame data output by the camera; and based on the AR data, rendering a call interface, and sending a multimedia stream to an enhanced call SDK in the second terminal through the IMSDC, so that the enhanced call SDK in the second terminal sends the multimedia stream to a first application in the second terminal. By adopting the method, the establishment of the AR call can be efficiently realized.

One example method bridging video conference connections includes joining, using a client device, a video conference using a first network interface, the video conference including a plurality of participants; determining a need for a second network interface; connecting to the video conference using the second network interface simultaneously with the first network interface; assigning a first multimedia stream to the first network interface and a second multimedia stream to the second network interface; and using the first and second network interfaces to transmit or receive the first and second multimedia streams.

In a vehicle, a computer can receive a first set of content data, which includes a first graphic component and a first audio stream, and a second set of content data, which includes a second graphic component and a second audio stream, and select a first audio output mode for the first audio stream and a second audio output mode for the second audio stream based on a priority determination that includes a priority of the first set of content data and / or a priority of the second set of content data, the priority determination being based on a vehicle state.

A method for video compression in an extended reality (XR) environment by an electronic device, may include: separating at least one first feature from a multimedia stream; separating at least one second feature from the multimedia stream; applying a first compression to the at least one first feature to generate at least one compressed first feature; applying a second compression to the at least one second feature to generate at least one compressed second feature; generating a loss mapping matrix for the first compression, and the second compression; generating a compressed multimedia stream including the at least one compressed first feature, the at least one compressed second feature, and the loss mapping matrix; and transmitting the compressed multimedia stream to another electronic device.

The present disclosure relates to the technical field of multimedia, and relates to a video processing method and apparatus, an electronic device, a storage medium, and a product. The video processing method comprises: parsing a first video file to obtain a plurality of tracks in the first video file, the last one or more frames of the first video file being invalid frames, the plurality of tracks at least comprising a specified type of track and an audio track, and the specified type of track comprising a video track; generating a second video file on the basis of the specified type of track in the first video file; and synthesizing the audio file and the second video file into a multimedia stream.

Disclosed is a method of multimodal multimedia processing for at least one wearable device including an image sensor and at least one processor. The method includes: in response to the image sensor being turned on, obtaining a first measurement of at least one of a physiological parameter of an individual or an environmental parameter in a vicinity of the individual captured by the at least one wearable device; determining whether a triggering event has occurred based on the first measurement, the triggering event being associated with generating tagging information based on the first measurement using a machine learning model adapted to run on the at least one processor; and in response to determining that the triggering event has occurred, editing a selected clip from a multimedia stream currently being captured by the image sensor to include the tagging information generated based on the first measurement at a corresponding timestamp.

Embodiments of the present disclosure provide a livestreaming room interface processing method and device, and a storage medium. The method comprises: acquiring, by a first client, first multimedia stream data of a second client participating in co-streaming in any target type of livestreaming room and second multimedia stream data of the first client; acquiring a seat layout configuration parameter of the target type of livestreaming room and data to be displayed; and on the basis of the seat layout configuration parameter, displaying, in a livestreaming room interface, the first multimedia stream data, the second multimedia stream data, and an interface element corresponding to the target type of livestreaming room, and displaying, in the interface element, the data to be displayed. The embodiments of the present disclosure provide a general layout method for any target type of livestreaming room interface, and the layout and display of various pieces of multimedia stream data in the livestreaming room interface and related interface elements of various types of livestreaming rooms are controlled by means of a seat layout configuration parameter, thereby achieving a more flexible livestreaming room interface layout, reducing the development costs of the livestreaming room interface, and improving the development efficiency.

Embodiments of the present disclosure provide a chorusing method and device, and a storage medium. The method comprises: by means of a first non-chorus role client participating in livestreaming interactive connection, caching received multimedia stream data of chorus role clients among clients participating in livestreaming interactive connection other than said first non-chorus role client; and on the basis of time information comprised in the multimedia stream data of the chorus role clients, aligning the multimedia stream data of the chorus role clients and then playing back the multimedia stream data. By caching and aligning the multimedia stream data of the chorus role clients on the non-chorus role client participating in interactive connection, it can be ensured that a chorusing effect is presented on said non-chorus role client, thereby satisfying a multi-person chorusing requirement in a livestreaming room, and improving the connection experience in the livestreaming room; moreover, since only the multimedia stream data of the chorus role clients is processed, normal real-time interaction between the non-chorus role clients can also be carried out on this basis, and is not affect by chorusing.

The embodiment of the invention provides a chorus method and device and a storage medium. The method comprises the following steps: receiving chorus multimedia stream data in a chat room; decoding and playing each frame of the singing multimedia data of the singing multimedia stream data in sequence; collecting and processing the current frame of auxiliary singing multimedia data in the auxiliary singing following process; and determining a second timestamp corresponding to the current frame of the auxiliary singing multimedia data according to the first timestamp in the currently decoded frame of the collar multimedia data and a preset delay time, and adding the second timestamp to the current frame of the auxiliary singing multimedia data, and transmitting the sub-singing multimedia stream data to other clients except the sub-singing role client participating in live broadcast microphone connection through the sub-singing multimedia stream data. According to the method and the device, the second timestamp which is as close as possible to the real timestamp of the current frame of sub-singing multimedia data can be determined, so that the accuracy of adding the timestamps is improved, the terrace multimedia stream data and the sub-singing multimedia stream data can be better aligned according to the timestamps, and the chorus effect is ensured.