Media resource rendering method, device and system

Abstract

The invention relates to the technical field of meta universe, in particular to a media resource rendering method, device and system. The method comprises the steps of sending rendering demand information to a server under the condition that it is determined that a terminal renders media resources of a target large screen in a meta universe; receiving a rendering protocol message and a first rendering result sent by the server for the rendering demand information, the rendering protocol message comprising a first media resource, and the first rendering result being a result obtained by the server performing media resource rendering according to a rendering strategy determined by the media resource type and the first network quality information of the terminal; calling a rendering component corresponding to the media resource type to render the first media resource to obtain a second rendering result; and performing superposition processing on the second rendering result and the first rendering result, and obtaining and displaying a third rendering result on the target large screen. According to the invention, the definition of media resource display can be improved, and the convenience of media resource rendering is improved.

Description

Technical Field

[0001] This disclosure relates to the field of metaverse technology, and more particularly to a method, apparatus and system for rendering media resources. Background Technology

[0002] Metaverse, as an important carrier of the digital economy, is widely used in areas such as virtual shopping, social interaction, and immersive experiences. Among them, the Metaverse Meeting and Exhibition Center product is a cloud-based Metaverse product that provides online virtual meeting and exhibition solutions for various users. For example, in meetings, information can be displayed on a large screen, but improving the clarity and ease of information display becomes a key focus. Summary of the Invention

[0003] This disclosure provides a media resource rendering method, apparatus, and system, which can improve the clarity of media resource display and enhance the convenience of media resource rendering. The technical solution of this disclosure is as follows: According to a first aspect of the present disclosure, a media resource rendering method is provided, applied to a terminal, comprising: If it is determined that the terminal is rendering media resources for the target large screen in the metaverse, then the rendering request information is sent to the server. The server receives a rendering protocol message and a first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the first network quality information of the terminal. The rendering component corresponding to the media resource type is invoked to render the first media resource, thereby obtaining a second rendering result; The second rendering result and the first rendering result are overlaid to obtain and display a third rendering result on the target large screen.

[0004] According to some embodiments, the method further includes: Obtain the attention information corresponding to the target large screen; Obtain the second network quality information corresponding to the terminal; If the information of interest meets the information requirements, but the second network quality information does not meet the quality requirements, it is determined that the terminal renders the media resources.

[0005] According to some embodiments, obtaining the attention information corresponding to the target large screen includes at least one of the following: The duration of mouse hover over the target large screen on the terminal is obtained; Obtain the selection information corresponding to the target large screen.

[0006] According to some embodiments, the step of calling the rendering component corresponding to the media resource type to render the first media resource and obtain a second rendering result includes at least one of the following: If the data type in the rendering protocol message is an address data type, a first media resource is requested from the media target service address, and the rendering component of the address data type is invoked to render the first media resource to obtain a second rendering result; If the data type in the rendering protocol message is binary code, the binary code is decoded, the decoded bytecode is converted into an image, and the rendering component of the image is called to render the image to obtain a second rendering result.

[0007] According to a second aspect of the present disclosure, a media resource rendering method is provided, applied to a server, comprising: The receiving terminal sends rendering request information, wherein the rendering request information is sent by the terminal when it determines that it will render media resources of the target large screen in the metaverse; Based on the media resource type and the first network quality information of the terminal, obtain the rendering strategy corresponding to the rendering requirement information; The second media resource is rendered using the aforementioned rendering strategy to obtain the first rendering result; Send a rendering protocol message and the first rendering result to the terminal, wherein the rendering protocol message includes a first media resource, and the rendering protocol message is used to instruct the terminal to call the rendering component corresponding to the media resource type to render the first media resource, obtain a second rendering result, and overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen.

[0008] According to some embodiments, sending the first rendering result to the terminal includes: Using the first streaming bitrate, the first rendering result is sent to the terminal; During the process of sending the first rendering result, the average latency and packet loss rate are obtained; Based on the average latency and the packet loss rate, the first push stream bitrate is adjusted to obtain the second push stream bitrate; Using the second streaming bitrate, the first rendering result is continued to be sent to the terminal.

[0009] According to some embodiments, the method further includes: If it is determined that the terminal obtains the meta-rendering bitstream and the media resource bitstream, the bandwidth pressure information corresponding to the terminal is obtained; When the bandwidth pressure is greater than the pressure threshold, the second push stream bitrate is reduced, and the first rendering result is sent to the terminal using the third bitstream.

[0010] According to some embodiments, rendering the second media resource using the rendering strategy to obtain a first rendering result includes at least one of the following: If the second media resource includes an image, the second media resource is compressed into binary code, and the binary code is used as the first rendering result. If the second media resource includes images and video files, the second media resource is obtained from the CDN address corresponding to the second media resource, and the second media resource is rendered to obtain a first rendering result; If the second media resource includes a live stream, the live stream is obtained from the live stream address, and the live stream is rendered to obtain a first rendering result; When the second media resource includes a live stream, keyframe data corresponding to the live stream is obtained based on at least one of the interface information and network quality information corresponding to the live stream, and the keyframe data is rendered to obtain a first rendering result.

[0011] According to a third aspect of the present disclosure, a media resource rendering apparatus is provided, comprising: The information sending unit is used to send rendering request information to the server when it is determined that the terminal is rendering media resources of the target large screen in the metaverse. The message receiving unit is used to receive the rendering protocol message and the first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes the first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the first network quality information of the terminal. The resource rendering unit is used to call the rendering component corresponding to the media resource type to render the first media resource and obtain the second rendering result; The result overlay unit is used to overlay the second rendering result and the first rendering result to obtain and display the third rendering result on the target large screen.

[0012] According to a fourth aspect of the present disclosure, a media resource rendering apparatus is provided, comprising: An information receiving unit is used to receive rendering request information sent by a terminal, wherein the rendering request information is sent by the terminal when it determines that it will render media resources of a target large screen in the metaverse; The strategy acquisition unit is used to acquire a rendering strategy corresponding to the rendering requirement information based on the media resource type and the first network quality information of the terminal. The result acquisition unit is used to render the second media resource using the rendering strategy and obtain the first rendering result. The message sending unit is used to send a rendering protocol message and the first rendering result to the terminal. The rendering protocol message includes a first media resource. The rendering protocol message is used to instruct the terminal to call a rendering component corresponding to the media resource type to render the first media resource, obtain a second rendering result, and overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen.

[0013] According to a fifth aspect of the present disclosure, a terminal is provided, comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the media resource rendering method described in any one of the preceding aspects.

[0014] According to a sixth aspect of the present disclosure, a server is provided, comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the media resource rendering method described in any one of the preceding aspects.

[0015] According to a seventh aspect of the present disclosure, a media resource rendering system is provided, comprising: a terminal and a server, wherein the terminal is configured to implement the media resource rendering method as described in any of the preceding aspects, and the server is configured to implement the media resource rendering method as described in any of the preceding aspects.

[0016] According to an eighth aspect of the present disclosure, a storage medium is provided that, when instructions in the storage medium are executed by a processor of a network device, enables the network device to perform the media resource rendering method described in any of the preceding aspects.

[0017] According to a ninth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the method described in any one of the preceding aspects.

[0018] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects: In some or related embodiments, when it is determined that the terminal is rendering media resources for a target large screen in the metaverse, rendering request information is sent to the server; a rendering protocol message and a first rendering result are received from the server in response to the rendering request information, wherein the rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to a rendering strategy determined by the server based on the media resource type and the terminal's first network quality information; a rendering component corresponding to the media resource type is invoked to render the first media resource to obtain a second rendering result; the second rendering result and the first rendering result are superimposed to obtain and display a third rendering result on the target large screen. Therefore, in cloud rendering, the terminal can use its own components for independent rendering and superimpose the rendering result onto the server's rendering result. This can reduce the streaming bitrate when only the server renders, reduce the situation where media resources are not clearly visible when the network quality does not meet the requirements, and improve the clarity of media resource display. At the same time, the rendering strategy can be determined according to the media resource type and network quality information, and the terminal can directly execute the corresponding rendering strategy without the need for additional client installation, thus improving the convenience of media resource rendering.

[0019] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0020] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0021] Figure 1 This is a background flowchart illustrating a media resource rendering method according to an exemplary embodiment; Figure 2 This is a flowchart illustrating a media resource rendering method according to an exemplary embodiment; Figure 3 This is an example schematic diagram illustrating a protocol header for rendering a protocol message according to an exemplary embodiment; Figure 4 This is a flowchart illustrating another media resource rendering method according to an exemplary embodiment; Figure 5 This is an example schematic diagram illustrating the determination of a rendering strategy according to an exemplary embodiment; Figure 6 This is a block diagram illustrating a media resource rendering apparatus according to an exemplary embodiment; Figure 7This is a block diagram illustrating another media resource rendering apparatus according to an exemplary embodiment; Figure 8 This is a block diagram illustrating a network device according to an exemplary embodiment. Detailed Implementation

[0022] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0023] This disclosure provides media resource rendering methods, apparatus, and systems. In some embodiments, the terms "media resource rendering method" and "information processing method" and "communication method" can be used interchangeably; the terms "media resource rendering apparatus" and "information processing apparatus" and "communication apparatus" can be used interchangeably; and the terms "information processing system" and "communication system" can be used interchangeably.

[0024] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0025] In each of the disclosed embodiments, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of the embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0026] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0027] In this disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular or a plural expression.

[0028] In the embodiments disclosed herein, "multiple" refers to two or more.

[0029] In some embodiments, the terms “at least one of,” “one or more,” “a plurality of,” and “multiple” may be used interchangeably.

[0030] The prefixes "first," "second," etc., used in the embodiments of this disclosure are merely for distinguishing different descriptive objects and do not impose restrictions on the position, order, priority, quantity, or content of the descriptive objects. The description of the descriptive objects is found in the claims or the context of the embodiments, and the use of prefixes should not constitute unnecessary restrictions. For example, if the descriptive object is a "field," the ordinal numbers preceding "field" in "first field" and "second field" do not restrict the position or order of the "fields." "First" and "second" do not restrict whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the descriptive object is a "level," the ordinal numbers preceding "level" in "first level" and "second level" do not restrict the priority between "levels." Furthermore, the number of descriptive objects is not limited by ordinal numbers and can be one or more. For example, in "first device," the number of "devices" can be one or more. Furthermore, the objects modified by different prefixes can be the same or different. For example, if the object being described is "device", then "first device" and "second device" can be the same device or different devices, and their types can be the same or different. Similarly, if the object being described is "information", then "first information" and "second information" can be the same information or different information, and their content can be the same or different.

[0031] In some embodiments, "terminal" or "terminal device" may be referred to as "user equipment (UE)," "user terminal," "mobile station (MS)," "mobile terminal (MT)," "subscriber station," "mobile unit," "subscriber unit," "wireless unit," "remote unit," "mobile device," "wireless device," "wireless communication device," "remote device," "mobile subscriber station," "access terminal," "mobile terminal," "wireless terminal," "remote terminal," "handset," "user agent," "mobile client," "client," etc.

[0032] In some embodiments, data, information, etc., may be obtained with the user's consent.

[0033] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0034] According to some embodiments, Figure 1 This is a background flowchart illustrating a media resource rendering method according to an exemplary embodiment, such as... Figure 1 As shown, the large-screen media rendering process is as follows: 1. The client runs in the cloud. The large screen in the client requests media resources from the streaming media service. If the resource is an image or document, it is converted into a sticker and then overlaid on the large screen to complete the rendering.

[0035] 2. If the requested resource is a video or a live stream, the video must first be converted into individual frames of images, and then into individual textures to complete the video rendering.

[0036] 3. The client encodes the rendering result of the entire scene into a video stream and pushes it to the cloud gaming streaming service.

[0037] 4. The user terminal pulls the rendered video stream from the cloud gaming streaming service through the browser terminal to achieve synchronization of the cloud-rendered screen.

[0038] Therefore, when rendering is entirely done in the cloud, the terminal can retrieve the rendering results from the cloud, essentially functioning as a video player. This model places high demands on the terminal's network, requiring at least 20Mbps of bandwidth. When the user's terminal network conditions are poor, the video bitrate is low, resulting in a blurry overall image, making the information on the large screen even more difficult to see. However, in the metaverse conference and exhibition scenario, the large screen is the most important information medium; users often only focus on the content displayed on the large screen, paying more attention to it than the 3D scene itself.

[0039] In some implementations, a combined edge-cloud rendering approach can be used: the user terminal needs to install a client, but the terminal does not render the entire scene; instead, it distributes some rendering work to a remote location. The terminal then merges the edge-cloud rendering results to present the overall rendering effect. This solution fully utilizes the terminal's rendering capabilities while reducing network transmission pressure. This design requires significant modifications to traditional rendering engines and a radical overhaul of game development models, necessitating consideration of rendering task splitting and result merging. Crucially, this solution cannot use a pure browser / server (B / S) model; users still need to install a client, making media resource rendering less convenient.

[0040] Figure 2 This is a flowchart illustrating a media resource rendering method according to an exemplary embodiment, such as... Figure 2 As shown, this media resource rendering method can be used in the Metaverse Conference and Exhibition scene, including the following steps: In step S11, if it is determined that the terminal is rendering media resources of the target large screen in the metaverse, the rendering request information is sent to the server. According to some embodiments, the execution subject of this disclosure may be, for example, a terminal. This terminal does not specifically refer to a particular fixed terminal. For example, when the terminal identifier corresponding to the terminal changes, the terminal may also change accordingly. For example, when the terminal structure changes, the terminal may also change accordingly. Furthermore, the name of the terminal is not limited. For example, the terminal may also be called a user terminal, user equipment, etc.

[0041] In some embodiments, the cloud universe can be, for example, an emerging virtual space that can be used for metaverse meetings.

[0042] According to some embodiments, the large screen may be, for example, a screen used for information display in a metaverse conference. This large screen does not specifically refer to a fixed screen. For example, the large screen may change accordingly when its size changes. In some embodiments, the large screen may also be referred to as a screen, a large display, etc.

[0043] In some embodiments, the media resource may be, for example, a resource to be displayed. This media resource does not specifically refer to a single, fixed resource. For example, when the memory size corresponding to the media resource changes, the media resource may also change accordingly. Similarly, when the resource type corresponding to the media resource changes, the media resource may also change accordingly.

[0044] In some embodiments, rendering requirement information may be, for example, information generated by the terminal to instruct the terminal to render media resources. This rendering requirement information does not specifically refer to any fixed information. For example, when the time point at which the rendering requirement information is generated changes, the rendering requirement information may also change accordingly. For example, when the judgment method corresponding to the rendering requirement information changes, the rendering requirement information may also change accordingly. The judgment method may, for example, be used to indicate whether to generate rendering requirement information.

[0045] According to some embodiments, the server may be, for example, a server that renders the images displayed on a large screen. The server may also be referred to as a network device, the cloud, etc.

[0046] In some embodiments, the terminal can determine whether it meets the conditions for rendering media resources for the target large screen in the metaverse. If the terminal determines that it needs to render media resources for the target large screen in the metaverse, it sends rendering request information to the server.

[0047] However, there are no restrictions on the method for determining the rendering of media resources on the target large screen in the metaverse by the terminal.

[0048] According to some embodiments, the method further includes: Obtain the attention information corresponding to the target large screen; Obtain the second network quality information corresponding to the terminal; If the information being monitored meets the requirements, but the second network quality information does not meet the quality requirements, then the terminal is determined to render the media resources. Therefore, determining whether the terminal should render media resources based on both the information being monitored and the network quality information can improve the efficiency of media resource rendering.

[0049] According to some embodiments, obtaining attention information corresponding to a target large screen includes at least one of the following: Obtain the duration for which the terminal's mouse hovers over the target large screen; Obtain the selection information corresponding to the target large screen.

[0050] In some embodiments, the target large screen can be, for example, one of the large screens in a set of large screens to be rendered. The target large screen does not specifically refer to a single fixed large screen. For example, the target large screen can change accordingly when the set of large screens changes or when the received selection command changes.

[0051] In some embodiments, network quality information can be used to indicate the current network condition. The second network quality information is used to indicate the terminal's current network status. This second network quality information does not specifically refer to any fixed information. For example, when the packet loss rate changes or the latency information changes, the second network quality information may also change accordingly. The "second" in the second network quality information is used to distinguish it from other network quality information.

[0052] According to some embodiments, when a terminal determines that it is rendering media resources for a target large screen in the metaverse, it may do so by determining that the user's focus is on the target large screen and that the terminal's network quality information does not meet quality requirements. Specifically, the terminal's network quality information not meeting quality requirements may be, for example, that the resolution of the image displayed on the target large screen is less than a resolution threshold.

[0053] According to some embodiments, the selection information corresponding to the target large screen can be used to indicate information for selecting the target large screen, and the selection information includes, but is not limited to, click information, voice information, and timing information.

[0054] In some embodiments, obtaining attention information corresponding to the target large screen includes obtaining the duration of the terminal's mouse hovering over the target large screen, and obtaining click information on the target large screen.

[0055] Among them, the information to be concerned with meets the information requirements, such as the duration of the terminal's mouse hovering on the target large screen being greater than the duration threshold.

[0056] Among these, the information to be focused on meets the information requirements, such as detecting click information on the target large screen.

[0057] According to some embodiments, when determining whether the current terminal is performing independent rendering of media resources, the determination criterion may be, for example, formula (1): V = (Hovered>5s || Clicked)&&TU <TH(1) Among them, Hovered>5s means that the mouse hovers on the target large screen for more than 5 seconds; Clicked indicates that the target screen has received a click message; TU represents the maximum streaming bitrate supported by the terminal; TH is a constant representing the 4K high-definition bitrate threshold; for example, it could be 40 Mbps. V is a boolean value; true means to perform independent rendering, and false means not to trigger independent rendering.

[0058] In step S12, the server receives a rendering protocol message and a first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the terminal's first network quality information. According to some embodiments, the rendering protocol message may be, for example, a message sent by the server to the terminal to instruct the terminal to perform independent rendering. This rendering protocol message does not specifically refer to a single, fixed message. For example, when the information carried by the rendering protocol message changes, the rendering protocol message may also change accordingly. For example, when the sending time of the rendering protocol message changes, the rendering protocol message may also change accordingly.

[0059] In some embodiments, the first rendering result may be the result obtained by the server rendering the media resource. The "first" in the first rendering result is used to distinguish it from other rendering results and does not specifically refer to a particular fixed rendering result.

[0060] According to some embodiments, the media resource may be, for example, a resource to be rendered. The first media resource may be, for example, a resource used to instruct the terminal to render it separately. The "first" in the first media resource is used to distinguish it from other media resources and does not specifically refer to a particular fixed resource. For example, when the number of images or the content of the images corresponding to the first media resource changes, the first media resource may also change accordingly.

[0061] In some embodiments, the first rendering result is the result obtained by the server rendering the media resource according to a rendering strategy determined by the server based on the media resource type and the terminal's first network quality information. This first rendering result does not refer to a specific fixed result. For example, when the rendering strategy determined by the server changes, the first rendering result may also change accordingly.

[0062] According to some embodiments, a rendering protocol message and a first rendering result sent by a server in response to rendering requirement information can be received. The rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource using a rendering strategy determined by the server based on the media resource type and the terminal's first network quality information. Specifically, upon receiving the rendering protocol message, the message can be parsed to obtain the first media resource.

[0063] According to some embodiments, the protocol header of the rendered protocol message can be, for example, as follows: Figure 3 As shown, the protocol header of a rendered protocol message may include, for example, the following information: 1. The width and height of the large screen can be used as a reference for the terminal to set the size of the rendering components; 2. Media resource types: JPG, MP4, WebRTC, RTSP, HLS, etc. The terminal calls different rendering components based on the different media resource types. The terminal can be, for example, a browser, and can be accessed via HTML5 tags (such as...). and <video>The terminal uses native components (such as ImageView and VideoView) and JavaScript APIs (such as Canvas and WebRTC) to render images, videos, and live streams. The terminal could be an Android terminal, which can use native components (such as UIImageView and AVPlayer) to handle multimedia content. Alternatively, it could be an iOS terminal, which can utilize native components (such as UIImageView and AVPlayer) to handle images, videos, and live streams. 3. Data types: CDN address, live stream address, binary code.

[0064] In step S13, the rendering component corresponding to the media resource type is invoked to render the first media resource, and a second rendering result is obtained; In some embodiments, the rendering component may be, for example, a component used to render a first media resource. This rendering component does not specifically refer to a single, fixed component. For example, the rendering component may also be referred to as a collection of components. For example, the rendering component may change accordingly when the type of the corresponding component changes. For example, the rendering component may change accordingly when the type of the media resource changes.

[0065] According to some embodiments, the second rendering result may be, for example, a result obtained by independent rendering on the terminal. The "second" in this second rendering result is used to distinguish it from the other rendering results.

[0066] According to some embodiments, a rendering component corresponding to the media resource type is invoked to render the first media resource to obtain a second rendering result, including at least one of the following: If the data type in the rendering protocol message is an address data type, the first media resource is requested from the media target service address, and the rendering component of the address data type is called to render the first media resource to obtain the second rendering result; When the data type in the rendering protocol message is binary code, the binary code is decoded, the decoded bytecode is converted into an image, and the image rendering component is called to render the image, obtaining the second rendering result. Therefore, different rendering methods can be used according to different data types, improving the accuracy of media resource rendering.

[0067] In some embodiments, the rendering protocol message also includes protocol data line information. For example, rendering can be performed based on the data type recorded in the protocol header. For instance, if the data type is an address data type, the data line records the URL address, and the terminal can directly request media resources from the media target service address and call the corresponding component for rendering.

[0068] If the data type is binary code, the data row records the base64 encoded string information of the binary code. The terminal can perform data decoding, convert the decoded bytecode into an image, and call the corresponding component for rendering.

[0069] In step S14, the second rendering result and the first rendering result are overlaid to obtain and display the third rendering result on the target large screen.

[0070] According to some embodiments, the third rendering result may be, for example, the result obtained by superimposing the second rendering result onto the first rendering result. The "third" in the third rendering result is used to distinguish it from the other rendering results and does not specifically refer to a particular fixed result.

[0071] According to some embodiments, for example, the result of terminal-independent rendering can be superimposed on cloud-rendered video. For instance, browser Canvas-1 renders the overall cloud screen, while browser Canvas-2 renders the large-screen media independently. In this case, the display level of Canvas-2 is higher than that of Canvas-1.

[0072] In some or related embodiments, when it is determined that the terminal is rendering media resources for a target large screen in the metaverse, rendering request information is sent to the server; a rendering protocol message and a first rendering result are received from the server in response to the rendering request information, wherein the rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to a rendering strategy determined by the server based on the media resource type and the terminal's first network quality information; a rendering component corresponding to the media resource type is invoked to render the first media resource to obtain a second rendering result; the second rendering result and the first rendering result are overlaid to obtain and display a third rendering result on the target large screen. Therefore, in cloud rendering, the terminal can use its own components to render independently and overlay the rendering result onto the server's rendering result. This can reduce the streaming bitrate when only the server renders, reduce the situation where media resources are not clearly visible when the network quality does not meet the requirements, and improve the clarity of media resource display. At the same time, the rendering strategy can be determined according to the media resource type and network quality information, and the terminal can directly execute the corresponding rendering strategy without the need for additional client installation, thus improving the convenience of media resource rendering.

[0073] Figure 4 This is a flowchart illustrating another media resource rendering method according to an exemplary embodiment, such as... Figure 4 As shown, this media resource rendering method can be used in media resource rendering scenarios, and includes the following steps: In step S21, the rendering request information sent by the terminal is received, wherein the rendering request information is sent by the terminal when it determines that the terminal will render the media resources of the target large screen in the metaverse. The relevant descriptions can be as described above, and will not be repeated here.

[0074] According to some embodiments, the execution entity server of this disclosure may also be referred to as a network device. The name of the server is not limited. For example, the server may also be referred to as the cloud, a server cluster, etc.

[0075] In step S22, a rendering strategy corresponding to the rendering requirement information is obtained based on the media resource type and the terminal's first network quality information. The relevant descriptions can be as described above, and will not be repeated here.

[0076] According to some embodiments, the rendering strategy may be, for example, a strategy determined by the server as to how the terminal should render. For instance, the rendering strategy may also change accordingly when the media resource type or network quality information changes.

[0077] In some embodiments, a rendering strategy corresponding to the rendering requirement information is obtained based on the media resource type and the terminal's first network quality information.

[0078] Specifically, a rendering strategy corresponding to the rendering requirements can be obtained based on at least one of the media resource type and the terminal's first network quality information.

[0079] In step S23, the second media resource is rendered using a rendering strategy to obtain the first rendering result; The relevant descriptions can be as described above, and will not be repeated here.

[0080] According to some embodiments, a rendering strategy is used to render the second media resource to obtain a first rendering result, including at least one of the following: In the case where the second media resource includes images, the second media resource is compressed into binary code, and the binary code is used as the first rendering result; When the second media resource includes image and video files, the second media resource is obtained from the CDN address corresponding to the second media resource, and the second media resource is rendered to obtain the first rendering result; When the second media resource includes a live stream, the live stream is obtained from the live stream address and rendered to obtain the first rendering result. When the second media resource includes a live stream, the keyframe data corresponding to the live stream is obtained based on at least one of the interface information and network quality information corresponding to the live stream, and the keyframe data is rendered to obtain the first rendering result.

[0081] According to some embodiments, Figure 5 This is an example schematic diagram illustrating the determination of a rendering strategy according to an exemplary embodiment, such as... Figure 5 As shown, for example, the following rendering strategies may be included: 1. The server host compresses the large-screen media data into binary code and sends the compressed code to the terminal. After receiving the data, the terminal decodes and renders it. This rendering strategy is suitable for rendering scenarios of image posters. 2. The server host informs the browser of the CDN address of the current media, and controls the browser to directly pull the media data from the CDN service for rendering. This rendering strategy is applicable to image or video files. 3. The server host synchronizes the current live stream address to the browser, and controls the browser to directly pull the live stream from the live stream server for rendering. This rendering strategy can be used for RTSP, RTMP live stream resources, and desktop shared live streams. 4. The server host periodically synchronizes the latest keyframe data of the current live stream to the browser, controlling the browser to render the current frame. This rendering strategy is suitable for live streams where the degree of change in the image is less than a threshold. For example, this could include a maintenance and support dashboard where the image has some latency but performs well under poor network conditions.

[0082] In step S24, a rendering protocol message and a first rendering result are sent to the terminal. The rendering protocol message includes a first media resource. The rendering protocol message is used to instruct the terminal to call the rendering component corresponding to the media resource type to render the first media resource, obtain a second rendering result, and overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen.

[0083] The relevant descriptions can be as described above, and will not be repeated here.

[0084] According to some embodiments, the large screen displaying user A may be showing a PPT document shared by user B. If the network quality information of the terminal where user A is located meets the quality requirements, and the maximum supported streaming bitrate TU > 15Mbps, then the server host synchronizes the Web RTC address of the shared stream to the connected browser. If the terminal network quality information does not meet the quality requirements, then the server host periodically compresses the keyframes of the retrieved Web RTC shared stream into binary code and synchronizes the binary code to the terminal. For example, the period could be every 2 seconds.

[0085] According to some embodiments, sending the first rendering result to the terminal includes: Using the first streaming bitrate, send the first rendering result to the terminal; During the sending of the first rendering result, the average latency and packet loss rate are obtained; Based on the average latency and packet loss rate, the first push bitrate is adjusted to obtain the second push bitrate; The second streaming bitrate is used to continue sending the first rendering result to the terminal. Therefore, the streaming bitrate can be adjusted to improve the convenience of rendering information transmission.

[0086] According to some embodiments, the streaming bitrate may be, for example, the bitrate required by the server to send rendering protocol messages to the terminal. The first streaming bitrate may be, for example, the initial bitrate for sending rendering protocol messages. The first streaming bitrate may be determined according to a bitrate setting instruction, or it may be determined according to the currently transmitted data, or it may be determined according to historical streaming bitrates; this disclosure does not limit this.

[0087] In some embodiments, the delivery of the first rendering result may include, for example, the following: 1. Push the rendered image to the terminal at a first push bitrate, such as 40Mbps; 2. Average delay measurement, for example, can be measured using formula (2): Y_avg=SUM(Y_i) / N(2) Where SUM is the accumulation function, Y_i is the i-th measurement value, and N is the number of measurements. 3. Packet loss rate measurement, for example, can be measured using formula (3): D=L / T(3) Where L is the number of lost frames and T is the total number of frames; 4. Bitrate adjustment: If the average latency Y_avg is greater than the threshold (YF=0.2), or the packet loss rate D is greater than the threshold (DF=0.4), the push stream bitrate is reduced. The adjustment strategy may include reducing it by 10% each time, re-executing the first step, and changing the bitrate to 36Mbps, that is, the second push stream bitrate is 36Mbps. 5. If the average latency Y_avg and packet loss rate D are both less than their minimum thresholds (YF, DF), then record the current push bitrate (TU) as the optimal push bitrate for the current terminal under this network quality information.

[0088] According to some embodiments, the method further includes: Given that the terminal obtains the meta-rendering bitstream and the media resource bitstream, obtain the corresponding bandwidth pressure information of the terminal; When bandwidth pressure exceeds a threshold, the second streaming bitrate is reduced, and the third bitrate is used to send the first rendering result to the terminal. Therefore, the service cloud rendering bitrate can be reduced, freeing up some bandwidth and improving the independent rendering quality of the terminal.

[0089] In some embodiments, reducing the second push rate may include, for example, lowering the average delay threshold YF and the average packet loss rate threshold DF, reducing them to 1 / 3 of their original values.

[0090] In some embodiments, reducing the second streaming bitrate may include automatically adapting to a lower bitrate after lowering the threshold, thus freeing up more bandwidth for independent rendering by the terminal.

[0091] In one or related embodiments, a rendering request information sent by a receiving terminal is received, wherein the rendering request information is sent when the terminal determines that it needs to render media resources of a target large screen in the metaverse; a rendering strategy corresponding to the rendering request information is obtained based on the media resource type and the terminal's first network quality information; the rendering strategy is used to render the second media resource to obtain a first rendering result; a rendering protocol message and the first rendering result are sent to the terminal, wherein the rendering protocol message includes the first media resource, and the rendering protocol message is used to instruct the terminal to call the rendering component corresponding to the media resource type to render the first media resource to obtain a second rendering result, and the second rendering result and the first rendering result are superimposed to obtain and display a third rendering result on the target large screen. Therefore, in cloud rendering, the corresponding rendering strategy can be determined based on the information sent by the terminal, improving the accuracy of the rendering strategy determination. This allows the terminal to independently use its own components for rendering and overlay the rendering results onto the server's rendering results. This can reduce the streaming bitrate when only server rendering is used, reduce the situation where media resources are not clearly visible when network quality does not meet the requirements, and improve the clarity of media resource display. At the same time, the rendering strategy can be determined based on the media resource type and network quality information, improving the convenience of media resource rendering.

[0092] A block diagram of a media resource rendering apparatus is shown according to an exemplary embodiment. (Refer to...) Figure 6 The device 600 includes: The information sending unit 601 is used to send rendering request information to the server when it is determined that the terminal is rendering media resources of the target large screen in the metaverse. The message receiving unit 602 is used to receive the rendering protocol message and the first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes the first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the terminal's first network quality information. The resource rendering unit 603 is used to call the rendering component corresponding to the media resource type to render the first media resource and obtain the second rendering result; The result overlay unit 604 is used to overlay the second rendering result and the first rendering result to obtain and display the third rendering result on the target large screen.

[0093] According to some embodiments, the information sending unit 601 is further configured to: Obtain the attention information corresponding to the target large screen; Obtain the second network quality information corresponding to the terminal; If the information being monitored meets the information requirements, but the second network quality information does not meet the quality requirements, then the terminal is determined to render the media resources.

[0094] According to some embodiments, when the information sending unit 601 is used to obtain the attention information corresponding to the target large screen, it is specifically used for at least one of the following: Obtain the duration for which the terminal's mouse hovers over the target large screen; Obtain the selection information corresponding to the target large screen.

[0095] According to some embodiments, the resource rendering unit 603, when calling a rendering component corresponding to the media resource type to render the first media resource and obtain a second rendering result, is specifically used for at least one of the following: If the data type in the rendering protocol message is an address data type, the first media resource is requested from the media target service address, and the rendering component of the address data type is called to render the first media resource to obtain the second rendering result; If the data type in the rendering protocol message is binary code, the binary code is decoded, the decoded bytecode is converted into an image, and the image rendering component is called to render the image to obtain the second rendering result.

[0096] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0097] In some or related embodiments, an information sending unit is used to send rendering request information to the server when it is determined that the terminal is rendering media resources for a target large screen in the metaverse; a message receiving unit is used to receive a rendering protocol message and a first rendering result sent by the server in response to the rendering request information, wherein the rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to a rendering strategy determined by the server based on the media resource type and the terminal's first network quality information; a resource rendering unit is used to call the rendering component corresponding to the media resource type to render the first media resource and obtain a second rendering result; a result overlay unit is used to overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen. Therefore, in cloud rendering, the terminal can use its own components to render independently and overlay the rendering result onto the server's rendering result. This can reduce the streaming bitrate when rendering only by the server, reduce the situation where media resources are not clearly visible when the network quality does not meet the requirements, and improve the clarity of media resource display. At the same time, the rendering strategy can be determined according to the media resource type and network quality information, and the terminal can directly execute the corresponding rendering strategy without the need for additional client installation, thus improving the convenience of media resource rendering.

[0098] A block diagram of another media resource rendering apparatus illustrated according to an exemplary embodiment. (Refer to...) Figure 7 The device 700 includes: The information receiving unit 701 is used to receive rendering request information sent by the terminal, wherein the rendering request information is sent by the terminal when it determines that it will render media resources of the target large screen in the metaverse. The strategy acquisition unit 702 is used to acquire the rendering strategy corresponding to the rendering requirement information based on the media resource type and the terminal's first network quality information. The result acquisition unit 703 is used to render the second media resource using a rendering strategy and obtain the first rendering result; The message sending unit 704 is used to send a rendering protocol message and a first rendering result to the terminal. The rendering protocol message includes a first media resource. The rendering protocol message is used to instruct the terminal to call the rendering component corresponding to the media resource type to render the first media resource, obtain a second rendering result, and overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen.

[0099] According to some embodiments, when sending the first rendering result to the terminal, the message sending unit 704 is specifically used for: Using the first streaming bitrate, send the first rendering result to the terminal; During the sending of the first rendering result, the average latency and packet loss rate are obtained; Based on the average latency and packet loss rate, the first push bitrate is adjusted to obtain the second push bitrate; Using the second streaming bitrate, continue sending the first rendering result to the terminal.

[0100] According to some embodiments, the message sending unit 704 is further specifically used for: Given that the terminal obtains the meta-rendering bitstream and the media resource bitstream, obtain the corresponding bandwidth pressure information of the terminal; When the bandwidth pressure exceeds the pressure threshold, the second push stream bitrate is reduced, and the third bitstream is used to send the first rendering result to the terminal.

[0101] According to some embodiments, the message sending unit 704 is used to render the second media resource using a rendering strategy, and when obtaining the first rendering result, it is specifically used for at least one of the following: In the case where the second media resource includes images, the second media resource is compressed into binary code, and the binary code is used as the first rendering result; When the second media resource includes image and video files, the second media resource is obtained from the CDN address corresponding to the second media resource, and the second media resource is rendered to obtain the first rendering result; When the second media resource includes a live stream, the live stream is obtained from the live stream address and rendered to obtain the first rendering result. When the second media resource includes a live stream, the keyframe data corresponding to the live stream is obtained based on at least one of the interface information and network quality information corresponding to the live stream, and the keyframe data is rendered to obtain the first rendering result.

[0102] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0103] According to some embodiments, this disclosure also provides a media resource rendering system, including: a terminal and a server, wherein the terminal is configured to implement the media resource rendering method described in any one of the preceding aspects, and the server is configured to implement the media resource rendering method described in any one of the preceding aspects.

[0104] Figure 8 This is a block diagram of a network device 800 provided in an embodiment of this disclosure. For example, the network device 800 can be provided as a network device. See also... Figure 8 The network device 800 includes a processing component 822, which further includes at least one processor, and memory resources represented by memory 832 for storing instructions, such as application programs, that can be executed by the processing component 822. The application programs stored in memory 832 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 822 is configured to execute instructions to perform any of the methods described above applied to the network device.

[0105] Network device 800 may also include a power supply component 827 configured to perform power management of network device 800, a wired or wireless network interface 850 configured to connect network device 800 to a network, and an input / output (I / O) interface 858. Network device 800 can operate on an operating system stored in memory 832, such as Windows Server™, Mac OS X™, Unix™, Linux™, Free BSD™, or similar.

[0106] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0107] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0108] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0109] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0110] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet, and blockchain networks.

[0111] Computer systems can include clients and servers. Clients and servers are generally geographically separated and typically interact via communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. A server can be a cloud server, also known as a cloud computing server or cloud host, a hosting product within the cloud computing service system that addresses the shortcomings of traditional physical hosts and VPS (Virtual Private Server) services, such as high management difficulty and weak business scalability. Servers can also be servers for distributed systems or servers incorporating blockchain technology.

[0112] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0113] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.< / video>

Claims

1. A method for rendering media resources, characterized in that, Applied to terminals, including: If it is determined that the terminal is rendering media resources for the target large screen in the metaverse, then the rendering request information is sent to the server. The server receives a rendering protocol message and a first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes a first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the first network quality information of the terminal. The rendering component corresponding to the media resource type is invoked to render the first media resource, thereby obtaining a second rendering result; The second rendering result and the first rendering result are overlaid to obtain and display a third rendering result on the target large screen.

2. The method according to claim 1, characterized in that, The method further includes: Obtain the attention information corresponding to the target large screen; Obtain the second network quality information corresponding to the terminal; If the information of interest meets the information requirements, but the second network quality information does not meet the quality requirements, it is determined that the terminal renders the media resources.

3. The method according to claim 2, characterized in that, The acquisition of attention information corresponding to the target large screen includes at least one of the following: The duration of mouse hover over the target large screen on the terminal is obtained; Obtain the selection information corresponding to the target large screen.

4. The method according to claim 1, characterized in that, The invocation of the rendering component corresponding to the media resource type to render the first media resource and obtain a second rendering result includes at least one of the following: If the data type in the rendering protocol message is an address data type, a first media resource is requested from the media target service address, and the rendering component of the address data type is invoked to render the first media resource to obtain a second rendering result; If the data type in the rendering protocol message is binary code, the binary code is decoded, the decoded bytecode is converted into an image, and the rendering component of the image is called to render the image to obtain a second rendering result.

5. A method for rendering media resources, characterized in that, Applied to servers, including: The receiving terminal sends rendering request information, wherein the rendering request information is sent by the terminal when it determines that it will render media resources of the target large screen in the metaverse; Based on the media resource type and the first network quality information of the terminal, obtain the rendering strategy corresponding to the rendering requirement information; The second media resource is rendered using the aforementioned rendering strategy to obtain the first rendering result; Send a rendering protocol message and the first rendering result to the terminal, wherein the rendering protocol message includes a first media resource, and the rendering protocol message is used to instruct the terminal to call the rendering component corresponding to the media resource type to render the first media resource, obtain a second rendering result, and overlay the second rendering result and the first rendering result to obtain and display a third rendering result on the target large screen.

6. The method according to claim 5, characterized in that, Sending the first rendering result to the terminal includes: Using the first streaming bitrate, the first rendering result is sent to the terminal; During the process of sending the first rendering result, the average latency and packet loss rate are obtained; Based on the average latency and the packet loss rate, the first push stream bitrate is adjusted to obtain the second push stream bitrate; Using the second streaming bitrate, the first rendering result is continued to be sent to the terminal.

7. The method according to claim 6, characterized in that, The method further includes: If it is determined that the terminal obtains the meta-rendering bitstream and the media resource bitstream, the bandwidth pressure information corresponding to the terminal is obtained; When the bandwidth pressure is greater than the pressure threshold, the second push stream bitrate is reduced, and the first rendering result is sent to the terminal using the third bitstream.

8. The method according to claim 5, characterized in that, The rendering of the second media resource using the rendering strategy to obtain a first rendering result includes at least one of the following: If the second media resource includes an image, the second media resource is compressed into binary code, and the binary code is used as the first rendering result. If the second media resource includes images and video files, the second media resource is obtained from the CDN address corresponding to the second media resource, and the second media resource is rendered to obtain a first rendering result; If the second media resource includes a live stream, the live stream is obtained from the live stream address, and the live stream is rendered to obtain a first rendering result; When the second media resource includes a live stream, keyframe data corresponding to the live stream is obtained based on at least one of the interface information and network quality information corresponding to the live stream, and the keyframe data is rendered to obtain a first rendering result.

9. A media resource rendering device, characterized in that, include: The information sending unit is used to send rendering request information to the server when it is determined that the terminal is rendering media resources of the target large screen in the metaverse. The message receiving unit is used to receive the rendering protocol message and the first rendering result sent by the server in response to the rendering requirement information. The rendering protocol message includes the first media resource, and the first rendering result is the result obtained by the server rendering the media resource according to the rendering strategy determined by the server based on the media resource type and the first network quality information of the terminal. The resource rendering unit is used to call the rendering component corresponding to the media resource type to render the first media resource and obtain the second rendering result; The result overlay unit is used to overlay the second rendering result and the first rendering result to obtain and display the third rendering result on the target large screen.

10. A media resource rendering system, characterized in that, include: A terminal and a server, wherein the terminal is configured to implement the media resource rendering method according to claims 1 to 4, and the server is configured to implement the media resource rendering method according to any one of claims 5 to 8.

Images