Multimedia communication method, communication device, and storage medium

Abstract

Embodiments of the present disclosure provide a multimedia communication method, a communication device, and a storage medium. The multimedia communication method executed by a first user equipment (UE) comprises: sending a first message to a network device, the first message being used for requesting data of a graphic object; receiving a second message sent by the network device, the second message comprising data of the graphic object, and the graphic object being used for multimedia communication based on the graphic object.

Description

Multimedia communication method, communication device and storage medium Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to a multimedia communication method, communication equipment, and storage medium. Background Art

[0002] Multimedia communication refers to a communication method that can simultaneously provide multiple media information, such as audio, images, sensor data, and text, within a single communication process. Multimedia communication improves communication quality and user experience. Typical multimedia communications include, but are not limited to, Internet Protocol Multimedia Subsystem (IMS) communications. This is a communication collaboration that uses a standards-independent IP system to achieve the convergence and interconnection of voice and data networks.

[0003] Summary of the Invention

[0004] Embodiments of the present disclosure provide a multimedia communication method, a communication device, and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a multimedia communication method is provided, wherein the method is performed by a first user equipment (UE), and the method includes: sending a first message to a network device; the first message is used to request data of a graphic object; receiving a second message sent by the network device; the second message includes the data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

[0006] According to a second aspect of an embodiment of the present disclosure, a multimedia communication method is provided, which is executed by a network device and includes: receiving a first message sent by a first UE; the first message is used to request data of a graphic object; sending a second message to the first UE, the second message including the data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

[0007] According to a third aspect of an embodiment of the present disclosure, a method for processing multimedia communication based on a graphic object is provided, wherein the method is performed by a second user equipment UE, and the method includes:

[0008] receiving a third message sent by the first UE; the third message being used by the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or the third message being used by the first UE to negotiate with the second UE a communication parameter for multimedia communication based on graphic objects;

[0009] According to the third message, a fourth message is sent to the first UE; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines a second parameter for participating in multimedia communication based on graphic objects.

[0010] According to a fourth aspect of an embodiment of the present disclosure, a first UE is provided, the first UE including: a sending module configured to send a first message to a network device; the first message is used to request data of a graphic object;

[0011] The receiving module is configured to receive a second message sent by the network device; the second message includes data of the graphic object; and the graphic object is used for multimedia communication based on the graphic object.

[0012] According to a fifth aspect of an embodiment of the present disclosure, a network device is provided, wherein the network device includes:

[0013] A receiving module configured to receive a first message sent by a first UE, wherein the first message is used to request data of a graphic object;

[0014] The sending module is configured to send a second message to the first UE, where the second message includes data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

[0015] According to a sixth aspect of an embodiment of the present disclosure, a second user equipment UE is provided, wherein the second UE includes:

[0016] a receiving module configured to receive a third message sent by the first UE; the third message is used by the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or the third message is used by the first UE to negotiate communication parameters of multimedia communication based on graphic objects with the second UE;

[0017] A sending module is configured to send a fourth message to the first UE according to the third message; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines a second parameter for participating in multimedia communication based on graphic objects.

[0018] According to a seventh aspect of an embodiment of the present disclosure, a multimedia communication method is provided, wherein the method is performed by a communication system, the communication system including at least: a user equipment UE and a network element; the method includes:

[0019] The UE sends a first message to the network element; the first message is used to request data of the graphic object;

[0020] The network element receives a first message sent by a first UE; the first message is used to request data of a graphic object, and sends a second message to the first UE, where the second message includes the data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

[0021] According to an eighth aspect of an embodiment of the present disclosure, a communication device is provided, wherein the communication device includes: one or more processors; wherein the processor is used to call instructions so that the communication device executes the multimedia communication method provided by any technical solution of the aforementioned first to third aspects.

[0022] According to a ninth aspect of an embodiment of the present disclosure, a storage medium is provided, wherein the storage medium stores instructions, which, when executed on a communication device, enable the communication device to execute the multimedia communication method provided in any of the first to third aspects.

[0023] The technical solution provided by the embodiment of the present disclosure is based on the above solution. The first UE can request data of the graphic object from the network device, so that the first UE can obtain data support for multimedia communication based on the graphic object, so that the multimedia object based on the graphic object can be successfully executed.

[0024] It should be understood that the foregoing general description and the following detailed description are merely exemplary and explanatory and are not restrictive of the embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the embodiments of the present disclosure.

[0026] FIG1A is a schematic diagram showing an architecture of a communication system according to an exemplary embodiment;

[0027] FIG1B is a schematic diagram showing augmented reality (AR) communication according to an exemplary embodiment;

[0028] FIG2 is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0029] FIG3A is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0030] FIG3B is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0031] FIG3C is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0032] FIG4 is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0033] FIG5 is a schematic flow chart showing a multimedia communication method according to an exemplary embodiment;

[0034] FIG6A is a schematic structural diagram of a first UE according to an exemplary embodiment;

[0035] FIG6B is a schematic structural diagram of a network device according to an exemplary embodiment;

[0036] FIG6C is a schematic structural diagram of a second UE according to an exemplary embodiment;

[0037] FIG7A is a schematic structural diagram of a communication device according to an exemplary embodiment;

[0038] FIG7B is a schematic structural diagram of a chip according to an exemplary embodiment. DETAILED DESCRIPTION

[0039] Embodiments of the present disclosure provide a multimedia communication method, a communication device, and a storage medium.

[0040] A first aspect provides a multimedia communication method, which is executed by a first user equipment UE and includes: sending a first message to a network device (exemplarily, the network device can also be referred to as a network element); the first message is used to request data of a graphic object; receiving a second message sent by the network device; the second message includes data; and a graphic object, which is used for multimedia communication based on the graphic object.

[0041] Based on the above solution, the first UE can request the data of the graphic object from the network device, so that the first UE can obtain data support for multimedia communication based on the graphic object, so that the multimedia object based on the graphic object can be successfully executed.

[0042] In some embodiments of the first aspect, sending the first message to the network device includes: determining to initiate multimedia communication based on graphic objects, and sending the first message to the network device.

[0043] Based on the above solution, when it is determined to initiate multimedia communication based on graphic objects, a first message is sent to the network device, so that the UE requests data of the graphic objects from the network device when needed.

[0044] In some embodiments of the first aspect, determining to initiate multimedia communication based on a graphic object and sending a first message to a network device includes: determining to initiate multimedia communication based on a graphic object and the first UE does not store data of the graphic object, and sending the first message to the network device.

[0045] Based on the above scheme, if the first UE does not store the data of the graphic object locally, it sends a first message to the network device to request data based on the graphic object. That is, when the UE stores the data of the graphic object locally, it does not need to request the network device, thereby reducing unnecessary data requests for the graphic object and thus reducing network overhead.

[0046] In some embodiments of the first aspect, the method further includes: sending a third message to the second UE, the third message being used for the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or, the third message being used for the first UE to negotiate communication parameters of multimedia communication based on graphic objects with the second UE.

[0047] Based on the above solution, the first UE can determine to participate in the graphic object-based multimedia communication or negotiate the communication parameters of the graphic object-based multimedia communication with the second UE through the third message.

[0048] In some embodiments of the first aspect, the third message includes: a first parameter provided by the first UE; and the first parameter is used for multimedia communication based on graphic objects.

[0049] Based on the above solution, the first UE carries the first parameter in the third message, and can complete the negotiation of communication parameters of graphic object-based multimedia communication with the second UE with a minimum number of messages.

[0050] In some embodiments of the first aspect, the first parameter includes at least one of the following: a first object identifier, the first object identifier is used to indicate the first object selected by the first UE; the first object is one of the graphic objects pointed to by the data; first mode information, the first mode information is used to indicate the communication mode of the graphic object-based multimedia communication supported by the first UE; or, the first mode information is used to indicate the communication mode of the graphic object-based multimedia communication selected by the first UE; the first indication is used to indicate whether the first UE supports single-ended graphic object-based multimedia communication.

[0051] Based on the above solution, a specific implementation of the first parameter is given. The above first object identifier, first mode information and first indication can all be optional contents of the first parameter. The first parameter can be flexibly set as needed later.

[0052] In some embodiments of the first aspect, the method further includes: receiving a fourth message sent by the second UE; the fourth message is used by the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines a second parameter for participating in multimedia communication based on graphic objects.

[0053] Based on the above solution, the first UE can implement communication parameter negotiation of multimedia communication based on graphic objects by receiving the fourth message, which has the characteristic of simple implementation.

[0054] In some embodiments of the first aspect, the second parameter includes at least one of the following: a second indication for indicating whether the second UE participates in dual-end graphic object-based multimedia communication; a second object identifier for indicating the second object selected by the second UE; the second object is one of the graphic objects pointed to by the data; second mode information for indicating the communication mode of the graphic object-based multimedia communication supported by the first UE; or, second mode information for indicating the communication mode of the graphic object-based multimedia communication selected by the second UE.

[0055] Based on the above solution, a specific implementation of the second parameter is given. The above second object identifier, second mode information and second indication can all be optional contents of the second parameter. The first parameter can be flexibly set as needed later.

[0056] In some embodiments of the first aspect, the communication modes of multimedia communication based on graphic objects include: a first mode; in the first mode, the first UE sends a first video generated based on the graphic object to the second UE and / or the second UE sends a second video based on the graphic object to the first UE; a second mode; in the second mode, the first UE sends first data to the second UE and / or the second UE sends second data to the first UE; the first data is used by the second UE to generate a third video based on the graphic object selected by the first UE; the second data is used by the first UE to generate a fourth video based on the graphic object selected by the second UE.

[0057] The above scheme provides two optional communication modes for multimedia communication based on graphic objects, which can be selected according to needs during specific implementation.

[0058] In some embodiments of the first aspect, the data of the graphic object includes at least one of the following: visual data of the graphic object; an identification of the graphic object; and control data, the control data being used to control the presentation of the graphic object.

[0059] The data of the graphic object is limited based on the above solution, and the specific implementation is not limited to the above example and can be flexibly set as needed.

[0060] In some embodiments of the first aspect, receiving the second message sent by the network device includes: receiving the second message sent by the network device after successfully authenticating the first UE.

[0061] Based on the above solution, it is defined that the first UE authentication is performed by sending the second message, thereby achieving security protection for data distribution based on graphic objects.

[0062] The second aspect provides a multimedia communication method, which is executed by a network device and includes: receiving a first message sent by a first UE; the first message is used to request data of a graphic object; sending a second message to the first UE, the second message including data; a graphic object, used for multimedia communication based on the graphic object.

[0063] In some embodiments of the second aspect, the method further includes: authenticating the first UE; and sending a second message to the first UE, including: if the first UE is authenticated, sending the second message to the first UE.

[0064] In some embodiments of the second aspect, the data of the graphic object includes at least one of the following: visual data of the graphic object; an identification of the graphic object; and control data, the control data being used to control the presentation of the graphic object.

[0065] The third aspect provides a method for processing multimedia communication based on graphic objects, which is executed by a second user equipment UE, and the method includes: receiving a third message sent by a first UE; the third message is used by the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or, the third message is used by the first UE to negotiate with the second UE the communication parameters of multimedia communication based on graphic objects; according to the third message, a fourth message is sent to the first UE; the fourth message is used by the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or, the second UE determines the second parameters for participating in multimedia communication based on graphic objects.

[0066] In some embodiments of the second aspect, the first parameter includes at least one of the following: a first object identifier, the first object identifier being used to indicate a first object selected by the first UE; the first object being one of the graphic objects pointed to by the data;

[0067] First mode information, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects selected by the first UE;

[0068] The first indication is used to indicate whether the first UE supports single-ended graphic object-based multimedia communication.

[0069] In some embodiments of the third aspect, the second parameter includes at least one of the following:

[0070] A second indication, used to indicate whether the second UE participates in the dual-end graphic object-based multimedia communication;

[0071] A second object identifier, used to indicate a second object selected by the second UE; the second object is one of the graphic objects pointed to by the data;

[0072] The second mode information is used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or the second mode information is used to indicate a communication mode of multimedia communication based on graphic objects selected by the second UE.

[0073] In some embodiments of the third aspect, the communication mode of the graphic object-based multimedia communication includes:

[0074] First mode; In the first mode, the first UE sends a first video generated based on the graphic object to the second UE and / or the second UE sends a second video based on the graphic object to the first UE;

[0075] Second mode; in the second mode, the first UE sends the first data to the second UE and / or the second UE sends the second data to the first UE; the first data is used by the second UE to generate a third video based on the graphic object selected by the first UE; the second data is used by the first UE to generate a fourth video based on the graphic object selected by the second UE.

[0076] The fourth aspect provides a first user equipment UE, the first UE including: a sending module, configured to send a first message to a network device; the first message is used to request data of a graphic object; a receiving module, configured to receive a second message sent by the network device; the second message includes data; a graphic object, used for multimedia communication based on a graphic object.

[0077] The fifth aspect provides a network device, wherein the network device includes: a receiving module, configured to receive a first message sent by a first UE; the first message is used to request data of a graphic object; a sending module, configured to send a second message to the first UE, the second message including data; a graphic object, used for multimedia communication based on the graphic object.

[0078] The sixth aspect provides a second user equipment UE, wherein the second UE includes: a receiving module, configured to receive a third message sent by the first UE; the third message is used for the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or, the third message is used for the first UE to negotiate with the second UE the communication parameters of multimedia communication based on graphic objects; a sending module, configured to send a fourth message to the first UE according to the third message; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or, the second UE determines the second parameters for participating in multimedia communication based on graphic objects.

[0079] In a seventh aspect, an embodiment of the present disclosure provides a communication device, the communication device comprising: one or more processors; wherein the processor is used to call instructions so that the communication device executes the multimedia communication method described in the optional implementation methods of the first to third aspects.

[0080] In an eighth aspect, an embodiment of the present disclosure provides a storage medium, wherein the storage medium stores instructions, which, when the instructions are executed on a communication device, enable the communication device to execute the multimedia communication method described in the optional implementation methods of the first to third aspects.

[0081] In a ninth aspect, an embodiment of the present disclosure provides a program product. When the program product is executed by a communication device, the communication device executes the multimedia communication method described in the optional implementation of the first to third aspects.

[0082] In a tenth aspect, an embodiment of the present disclosure provides a computer program, which, when executed on a computer, enables the computer to execute the multimedia communication method described in the optional implementation of the first to third aspects.

[0083] In an eleventh aspect, an embodiment of the present disclosure provides a multimedia communication method, which is performed by a communication system, the communication system including at least: a user equipment UE and a network element; the method including:

[0084] The UE sends a first message to the network element; the first message is used to request data of the graphic object;

[0085] The network element receives a first message sent by a UE; the first message is used to request data of a graphic object, and sends a second message to the UE, where the second message includes the data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

[0086] In some embodiments of the eleventh aspect, the UE includes a first UE and a second UE; and the method further includes:

[0087] The first UE sends a third message to the second UE, where the third message is used by the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or the third message is used by the first UE to negotiate with the second UE on communication parameters of multimedia communication based on graphic objects; the second UE sends a fourth message to the first UE based on the third message; the fourth message is used by the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines second parameters for participating in multimedia communication based on graphic objects.

[0088] It is understandable that the above-mentioned terminals, network devices, communication systems, program products, and computer programs are all used to execute the methods provided by the embodiments of the present disclosure. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods and will not be repeated here.

[0089] The embodiments of the present disclosure propose a multimedia communication method, communication equipment, communication system and storage medium. The embodiments of the present disclosure are not exhaustive, but are only illustrative of some embodiments, and are not intended to be a specific limitation on the scope of protection of the present disclosure. In the absence of contradiction, each step in a certain embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a certain embodiment can also be implemented as an independent embodiment, and the order of the steps in a certain embodiment can be arbitrarily exchanged. In addition, the optional implementation methods in a certain embodiment can be arbitrarily combined; in addition, the embodiments can be arbitrarily combined. For example, some or all steps of different embodiments can be arbitrarily combined, and a certain embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0090] In each embodiment of the present disclosure, unless otherwise specified or provided for by logic, the terms and / or descriptions between the embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form a new embodiment based on their inherent logical relationships.

[0091] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure.

[0092] In the embodiments of the present disclosure, unless otherwise specified, elements expressed in the singular, such as "a", "an", "the", "the", "the", etc., can mean "one and only one", or "one or more", "at least one", etc. For example, when using articles such as "a", "an", "the" in English in translation, the noun following the article can be understood as a singular expression or a plural expression.

[0093] In the embodiments of the present disclosure, “plurality” refers to two or more.

[0094] In some embodiments, the terms "at least one," "one or more," "a plurality of," "multiple," etc. may be used interchangeably.

[0095] In some embodiments, descriptions such as "at least one of A and B," "A and / or B," "in one case A, in another case B," or "in one case A, in another case B" may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed); and in some embodiments, A and B (both A and B are executed). The same applies when there are more branches such as A, B, and C.

[0096] In some embodiments, "A or B" and other descriptions may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed). The above is also applicable when there are more branches such as A, B, C, etc.

[0097] The prefixes such as "first" and "second" in the embodiments of the present disclosure are only used to distinguish different description objects and do not constitute any restriction on the position, order, priority, quantity or content of the description objects. For the statement of the description object, please refer to the description in the context of the claims or embodiments, and no unnecessary restriction should be constituted due to the use of prefixes. For example, if the description object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields". "First" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the description object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of description objects is not limited by the ordinal number and can be one or more. Taking "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the description object is "device", then the "first device" and the "second device" can be the same device or different devices, and their types can be the same or different. For another example, if the description object is "information", then the "first category of information" and the "second category of information" can be the same information or different information, and their contents can be the same or different.

[0098] In some embodiments, “including A,” “comprising A,” “used to indicate A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0099] In some embodiments, terms such as "...", "determine...", "in the case of...", "at the time of...", "when...", "if...", "if...", etc. can be used interchangeably.

[0100] In some embodiments, terms such as "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not less than", and "above" can be replaced with each other, and terms such as "less than", "less than or equal to", "not greater than", "less than", "less than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", and "below" can be replaced with each other.

[0101] In some embodiments, devices, etc. can be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. Terms such as "device", "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", and "subject" can be used interchangeably.

[0102] In some embodiments, "network" can be interpreted as devices included in the network (eg, access network equipment, core network equipment, etc.).

[0103] In some embodiments, the terms "access network device (AN device)", "radio access network device (RAN device)", "base station (BS)", "radio base station" "fixed station", "node", "access point", "transmission point (TP)", "reception point (RP)", "transmission / reception point (TRP)", "panel", "antenna panel", "antenna array", "cell", "macro cell", "small cell", "femto cell", "pico cell", "sector", "cell group", "serving cell", "carrier", "component carrier", "bandwidth part (BWP)" and the like may be used interchangeably.

[0104] In some embodiments, the terms "terminal", "terminal device", "user equipment (UE)", "user terminal", "mobile station (MS)", "mobile terminal (MT)", subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, etc. can be used interchangeably.

[0105] In some embodiments, the access network device, the core network device, or the network device can be replaced by a terminal. For example, the various embodiments of the present disclosure can also be applied to a structure in which the communication between the access network device, the core network device, or the network device and the terminal is replaced by communication between multiple terminals (for example, device-to-device (D2D), vehicle-to-everything (V2X), etc.). In this case, it is also possible to set the structure in which the terminal has all or part of the functions of the access network device. In addition, terms such as "uplink" and "downlink" can also be replaced by terms corresponding to communication between terminals (for example, "side"). For example, uplink channels, downlink channels, etc. can be replaced by side channels, and uplinks, downlinks, etc. can be replaced by side links.

[0106] In some embodiments, the terminal may be replaced by an access network device, a core network device, or a network device. In this case, the access network device, the core network device, or the network device may have a structure that has all or part of the functions of the terminal.

[0107] In some embodiments, obtaining data, information, etc. may comply with the laws and regulations of the country where the data is obtained.

[0108] In some embodiments, data, information, etc. may be obtained with the user's consent.

[0109] In addition, each element, each row, or each column in the table of the embodiment of the present disclosure can be implemented as an independent embodiment, and the combination of any elements, any rows, and any columns can also be implemented as an independent embodiment.

[0110] FIG1A is a schematic diagram showing the architecture of a communication system according to an embodiment of the present disclosure.

[0111] As shown in Figure 1A, a communication system 100 includes a terminal 101 and a network device 102. The network device 102 may include an access network device and / or a core network device.

[0112] In some embodiments, the terminal 101 includes, for example, a mobile phone, a wearable device, an Internet of Things device, a car with communication function, a smart car, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, and at least one of a wireless terminal device in a smart home, but is not limited thereto.

[0113] In some embodiments, the terminal is also referred to as User Equipment (UE).

[0114] In some embodiments, the access network device may be, for example, a node or device that accesses a terminal to a wireless network. The access network device may include an evolved NodeB (eNB), a next generation evolved NodeB (ng-eNB), a next generation NodeB (gNB), a node B (NB), a home node B (HNB), a home evolved nodeB (HeNB), a wireless backhaul device, a radio network controller (RNC), a base station controller (BSC), a base transceiver station (BTS), a base band unit (BBU), a mobile switching center, a base station in a 6G communication system, an open base station (Open RAN), a cloud base station (Cloud RAN), a base station in other communication systems, and at least one of an access node in a Wi-Fi system, but is not limited thereto.

[0115] In some embodiments, the technical solution of the present disclosure can be applied to the Open RAN architecture. In this case, the interfaces between or within the access network devices involved in the embodiments of the present disclosure can be transformed into internal interfaces of the Open RAN, and the processes and information interactions between these internal interfaces can be implemented through software or programs.

[0116] In some embodiments, the access network device can be composed of a centralized unit (CU) and a distributed unit (DU), where the CU can also be called a control unit. The CU-DU structure can be used to split the protocol layer of the access network device, with the functions of some protocol layers centrally controlled by the CU, and the functions of the remaining part or all of the protocol layers distributed in the DU, which is centrally controlled by the CU, but is not limited to this.

[0117] In some embodiments, the core network device may be a single device including a first network element, or may be a plurality of devices or a group of devices, each including a first network element. The network element may be virtual or physical. The core network may include, for example, at least one of an Evolved Packet Core (EPC), a 5G Core Network (5GCN), and a Next Generation Core (NGC).

[0118] It can be understood that the communication system described in the embodiment of the present disclosure is for the purpose of more clearly illustrating the technical solution of the embodiment of the present disclosure, and does not constitute a limitation on the technical solution provided by the embodiment of the present disclosure. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by the embodiment of the present disclosure is also applicable to similar technical problems.

[0119] The following embodiments of the present disclosure may be applied to the communication system 100 shown in FIG1A , or a portion thereof, but are not limited thereto. The entities shown in FIG1A are illustrative only. The communication system may include all or part of the entities shown in FIG1A , or may include other entities other than those shown in FIG1A . The number and form of the entities may be arbitrary. The connection relationship between the entities is illustrative only. The entities may be connected or disconnected, and the connection may be in any manner, including direct or indirect, wired or wireless.

[0120] The embodiments of the present disclosure can be applied to Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), future radio access (FRA), new radio access technology (RAT), new radio (NR), new radio access (NX), future generation radio access (FX), Global System for Mobile communications (GSM (registered trademark)), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, Ultra-WideBand (UWB), Bluetooth (registered trademark), Public Land Mobile Network (PLMN) networks, Device-to-Device (D2D) systems, Machine-to-Machine (M2M) systems, Internet of Things (IoT) systems, Vehicle-to-Everything (V2X) systems, systems using configuration methods for other resources, and next-generation systems based on and extending these systems. Furthermore, multiple systems may be combined (for example, LTE and NR).

[0121] FIG1B is an exemplary flowchart of a multimedia communication method provided in an embodiment of the present application.

[0122] 1: IMS session establishment, including: establishing a bootsrap data channel. Exemplarily, UE-A initiates an IMS communication session with UE-B, including but not limited to establishing a bootsrap data channel.

[0123] 2: Establishing an application data channel for UE-A and UE-B and / or, for example, UE-A upgrades IMS communication to experience AR functionality. Exemplarily, UE-A sends a re-INVITE, which may include: a media descriptor. The media descriptor is used to indicate the use of AR functionality. Exemplarily, the media descriptor indicates the implementation of end-to-end AR communication. For example, AR communication is implemented based on the Real-time Transport Protocol (RTP) and / or the application data channel.

[0124] The UE can perform AR rendering based on the AR data of the local application. Of course, the UE can also request AR data from the peer end or AR server.

[0125] 3: AR data capture, rendering, and encoding by UE-A, for example, UE-A acquires AR data, performs AR rendering, and encodes an AR media stream. The AR media stream may include a video stream and / or an audio stream.

[0126] 4: UE-A sends the rendered video / audio data based on RTP, for example, sending an AR media stream to the peer end based on the established media connection.

[0127] 5: UE-B sends AR data to UE-A. For example, UE-A receives AR media stream from the peer end based on the established media connection.

[0128] 6: AR data decoding, rendering, and display. For example, UE-A decodes the AR media stream and performs local rendering and display of the AR media stream.

[0129] In some cases, multimedia communication based on graphical objects can be a further enhancement of AR communication. Alternatively, AR communication may not actually support multimedia communication based on graphical objects. Therefore, a technical solution is needed to further support multimedia communication based on graphical objects. For example, by enhancing the IMS architecture, interfaces, and communication processes, IMS can support multimedia communication based on graphical objects.

[0130] In the embodiment of the present application, the graphic object may also be referred to as an avatar, an image, a virtual object, or a character.

[0131] Exemplarily, the following aspects of IMS are enhanced to support multimedia communications based on graphic objects:

[0132] Define and identify the context of multimedia communication based on graphic objects between two or more user devices; study the identification of multimedia communication based on graphic objects in IMS, for example, the identification can be used to identify the graphic object or the user of the graphic object; study how to implement the presentation, storage and access of graphic objects, etc. Authentication, authorization and / or privacy protection when accessing IMS, etc.; study how to implement service and / or capability negotiation between user equipment (UE) and IMS. Conversion, transcoding and rendering of services here, etc.; study how to implement conversion and transcoding between multimedia telephone sessions and multimedia communication based on graphic objects, etc.; study how to enable conversion and / or transcoding between voice and gestures and multimedia communication based on graphic objects; study how to enable UE to perform video rendering of multimedia objects of graphic objects based on data provided by the network.

[0133] Graphic object-based multimedia communication has numerous scenarios, including but not limited to situations where users are uncomfortable or unwilling to reveal their true appearance. For example, user B is reading a book while wearing AR glasses before bed. The display on her glasses shows an incoming call from user A. User B is already late in her bedroom. User B does not want to reveal private information such as her bedtime routine and / or room layout, but still wants to answer the call. User B can decide to treat this call as a graphic object-based call. After the call is initiated, user A's phone displays pre-recorded 3D images of user B wearing various outfits. User B can also choose to use a full-body or head-only image. Sensors on user B's glasses detect her head movement, and her 3D image animates accordingly. As the conversation continues, user B needs to remove her glasses to use handset mode. This transition is seamless and user A is unaware of it, as user B's character is now animated using the phone's motion sensors. From user A's perspective, she still appears to be fully engaged in the call.

[0134] As shown in FIG2 , an embodiment of the present disclosure provides a multimedia communication method, which is executed by a communication system. The method may include:

[0135] S2101: The first UE sends a first message to a network device.

[0136] In some embodiments, the first message is used to request data of a graphic object. Exemplarily, the first message may be a request message specifically used to request data of a graphic object.

[0137] In some embodiments, the first message may be an initiation message for initiating multimedia communication based on graphic objects. In this case, the first message can be used by the first UE to initiate multimedia communication based on graphic objects on the one hand, and on the other hand, can be used by the first UE to request graphic object data from the network device.

[0138] In some embodiments, the network device may include but is not limited to a core network device.

[0139] In some embodiments, the core network device may be a Data Channel Signaling Function (DSCF). The DSCF may be used to provide control logic for data channels. For example, the DSCF may manage data channel resources and provide event management for IMS sessions based on data channels. IMS sessions herein may include, but are not limited to, IMS session establishment events, termination events, resumption events, or termination events.

[0140] In some embodiments, the core network device may be a Multimedia Resource Function (MRF) or a Media Function (MF). For the description of the MRF and / or MF herein, please refer to the relevant description of IMS.

[0141] In some embodiments, the network device may also be an application function (AF). The AF may be located in the core network or outside the trusted domain of the core network. For example, the AF may be one or more application servers (AS) provided by a third party.

[0142] In some embodiments, the data of the graphic object includes at least one of the following: visual data of the graphic object; identification control data of the graphic object, and control data for controlling the presentation of the graphic object.

[0143] Exemplarily, the visual data may include at least image data.In some embodiments, the data of the graphic object may include at least image data of the graphic object.

[0144] In some embodiments, the graphic object may be a virtual object, such as an anime portrait, a 3D object obtained by 3D modeling, or an image object obtained based on a user's photo. The graphic object may include a head graphic object and / or a full-body graphic object. Different image objects may have different identifiers. The identifier of the image object may be referred to as an object identifier.

[0145] In some embodiments, if the graphic object is used to simulate a person's labels and movements, the visual data of the graphic object may include multiple images of the same visual effect with different labels. For example, an expressionless image, and images of different expressions such as crying, laughing, angry, furious, depressed, or happy. The data of a graphic object simulating human movement may include images of walking, standing, sitting, running, jumping, etc.

[0146] In other embodiments, the data of the graphic object may include an image of the object, and the data of the graphic object may also include key points on the face or limbs (e.g., corresponding to joints of the human skeleton). When generating a video for multimedia communication, the video can be generated using an artificial intelligence (AI) model such as a neural network by controlling these key points.

[0147] The control data may include: a control model and / or control instructions for controlling the image object to present different expressions, different actions or different states based on the visual data of the image object.

[0148] In some embodiments, when the first UE determines to initiate multimedia communication based on graphic objects, the first UE sends a first message to the network device.

[0149] In some embodiments, the first UE sends a first message to the network device when installing an application or software toolkit for graphic object-based multimedia communication or signing up for graphic object-based multimedia communication.

[0150] In some embodiments, the first message may include, but is not limited to, at least one of the following: identification information of the first UE, a request indication, and a communication indication.

[0151] Identification information of the first UE, for example, the identification information of the first UE may include an application layer identifier and / or a non-application layer identifier, where the non-application layer identifier may include, but is not limited to, a Subscription Permanent Identifier (SUPI). A request indication indicating a request for data of a graphic object; a communication indication indicating a request to initiate multimedia communication based on the graphic object.

[0152] In some embodiments, a first message is sent to a network device after determining that multimedia communication based on a graphic object is being initiated and the first UE does not store the graphic object data. In this case, the first UE will request the graphic object data from the network device only if the first UE does not locally store the graphic object data. This saves the operation of requesting the graphic object data from the network device and reduces the network overhead associated with transmitting the graphic object data. Assuming that in this scenario, if the first message is an initiation request message for initiating multimedia communication based on a graphic object, and if the first UE does not need to request the graphic object data, the initiation request message may include an indicator indicating whether the graphic object data is being requested.

[0153] In some embodiments, the first UE determines to initiate multimedia communication based on a graphic object and the first UE locally stores data of the graphic object, and determines that there is no need to request the data of the graphic object from the network device.

[0154] In some embodiments, when it is determined that multimedia communication based on a graphic object is to be initiated and the first UE has stored data of the graphic object, the first UE may also send a first message to the network device.

[0155] S2102: The network device authenticates the first UE.

[0156] In some embodiments, the network device authenticates the first UE including but not limited to one of the following: whether the first UE has the authority to conduct multimedia communication based on graphic objects; whether the first UE has the authority to participate in the type of multimedia communication based on graphic objects requested by the first UE; whether the first UE has the authority to actively initiate multimedia communication based on graphic objects; whether the first UE has the authority to passively respond to multimedia communication based on graphic objects.

[0157] Whether the first UE has the authority for multimedia communication based on graphic objects may refer to, for example, determining whether it has the authority for multimedia communication based on graphic objects based on the subscription data of the first UE, or whether the user of the first UE is authenticated to activate multimedia communication based on graphic objects.

[0158] Whether the first UE has the authority to participate in the type of graphic object-based multimedia communication requested by the first UE may refer to, for example, that the type of graphic object-based multimedia communication may include: single-ended graphic object-based multimedia communication, dual-ended graphic object-based multimedia communication, and multi-ended graphic object-based multimedia communication. Exemplarily, the first UE requests to conduct single-ended graphic object-based multimedia communication, and the authentication of the first UE by the network device here may include: determining whether the first UE has signed a contract for single-ended graphic object-based multimedia communication. Also exemplarily, the first UE requests to conduct dual-ended graphic object-based multimedia communication, and the authentication of the first UE by the network device here may include: determining whether the first UE has signed a contract for dual-ended graphic object-based multimedia communication.

[0159] S2103: The network device sends a second message to the first UE.

[0160] In some embodiments, the first UE has permission, and the network device sends the second message to the first UE.

[0161] In some embodiments, the first UE passes authentication, and the network device sends a second message to the first UE.

[0162] In some embodiments, if the first UE does not have permission or fails authentication, the network device does not send the second message to the first UE. For example, if the first UE does not have permission or fails authentication, the network device sends a rejection message or a failure message to the first UE. In some embodiments, the rejection message or failure message may include a reason for the rejection or failure. The rejection message is used to instruct the network device to reject the graphic object-based multimedia communication of the first UE. The failure message may indicate that the graphic object-based multimedia communication of the first UE has failed.

[0163] In some embodiments, the first message is an initiation request message for requesting multimedia communication based on graphic objects, and the second message may be a response message for multimedia communication based on graphic objects.

[0164] In some embodiments, the first message is not a request message for initiating multimedia communication based on graphic objects but any other message requesting data of graphic objects, and the second message may be a feedback message for multimedia communication based on graphic objects.

[0165] It is worth noting that S2101 to S2103 may be implemented in combination, and the first UE may not immediately initiate multimedia communication based on the graphic object after obtaining the graphic object data. For example, the first UE may respond to multimedia communication based on the graphic object initiated by another UE based on the graphic object data obtained in S2101 to S2103.

[0166] S2104: The first UE sends a third message to the second network device.

[0167] In some embodiments, the third message is used by the second UE to determine whether to participate in the graphic object-based multimedia communication.

[0168] In some embodiments, the third message is used for the first UE to negotiate with the second UE on communication parameters of multimedia communication based on graphic objects.

[0169] In some embodiments, the third message includes: a first parameter provided by the first UE.

[0170] It is worth noting that the first parameter may be optional content of the third message. For example, the third message may be an invitation message for initiating multimedia communication based on graphic objects, in which case the third message may include an invitation indicator.

[0171] In some embodiments, the first parameter is used for multimedia communication based on graphic objects. The first parameter may be the communication parameter negotiated by the first UE and the second UE.

[0172] In some embodiments, the first parameter includes at least one of the following: a first object identifier, first mode information, a first indication, and first mode information.

[0173] The first object identifier is used to indicate the first object selected by the first UE; the first object is one of the graphic objects pointed to by the data. The first mode information is used to indicate the communication mode of multimedia communication based on graphic objects supported by the first UE; or the first mode information is used to indicate the communication mode of multimedia communication based on graphic objects selected by the first UE. Exemplarily, the first mode information may indicate the communication mode of multimedia communication based on graphic objects supported, selected, or desired by the first UE. The first indication is used to indicate whether the first UE supports single-ended multimedia communication based on graphic objects.

[0174] For example, the graphic object indicated by the first object identifier may be a target object selected by the first UE from a plurality of candidate graphics. Different graphic objects may have different visual effects.

[0175] In some embodiments, the first object identifier may also be replaced by a first object index.

[0176] It is worth noting that the first object identifier may be an optional parameter in the first parameter. For example, when the first UE sends the first video generated by itself to the second UE, the second UE does not need to know the first object selected by the first UE.

[0177] In some embodiments, the first mode information may include a mode identifier or a mode index.

[0178] In some embodiments, the communication mode of the graphic object-based multimedia communication includes a first mode and a second mode.

[0179] Exemplarily, in the first mode, the first UE sends a first video generated based on the graphic object to the second UE and / or the second UE sends a second video based on the graphic object to the first UE.

[0180] In the first mode, the first UE generates a first video based on a graphic object and sends it to the other end (second UE). The second UE can then directly display the first video received by the first UE without generating the first video by the second UE itself. In this case, the operation of the second UE is relatively simple.

[0181] Exemplarily, in the second mode, the first UE sends first data to the second UE and / or the second UE sends second data to the first UE; the first data is used by the second UE to generate a third video based on a graphic object selected by the first UE; and the second data is used by the first UE to generate a fourth video based on a graphic object selected by the second UE.

[0182] In the second mode, the first UE sends the identifier of the first object selected by itself to the second UE, and sends the first data to the second UE. The second UE controls the video generated by the expression and / or action of the first object based on the second data.

[0183] In some embodiments, the first mode information may be an optional parameter in the first parameter. For example, when the first mode information is omitted, it may be assumed that the first UE uses the first mode or the second mode.

[0184] In some embodiments, the first indication may be used to indicate at least one of the following: the first UE supports single-end multimedia communication based on graphic objects at its own end; the first UE supports single-end multimedia communication based on graphic objects at the other end; the first UE supports dual-end multimedia communication based on graphic objects.

[0185] In some embodiments, the third message may include: one or more lists, wherein the lists carry descriptors or indexes of communication parameters supported, selected or desired by the first UE.

[0186] In some embodiments, the first indication may be an optional parameter in the first parameter. If the first indication is omitted, it may be assumed that the first UE requests to initiate dual-end graphic object-based multimedia communication. Alternatively, if the first indication is omitted, it may be assumed that the first UE supports either single-end graphic object-based multimedia communication or dual-end graphic object-based multimedia communication.

[0187] S2105: The second UE sends a fourth message to the first UE.

[0188] In some embodiments, the fourth message is used by the second UE to indicate whether to participate in graphic object-based multimedia communication.

[0189] In some embodiments, the second UE determines a second parameter for participating in the graphic object based multimedia communication.

[0190] It is worth noting that the second parameter may be optional content of the fourth message. For example, the fourth message is a response message to the third message. The response message may be a confirmation response message or a denial response message. The confirmation response message may indicate that the second UE has confirmed participation in or support for the graphic object-based multimedia communication initiated by the first UE. The denial response message may indicate that the second UE has confirmed not participation in or support for the graphic object-based multimedia communication initiated by the first UE.

[0191] Exemplarily, the confirmation message may carry the second parameter. If the yes / no acknowledgement message sent by the second UE does not carry the second parameter.

[0192] In some embodiments, the second parameter includes at least one of the following: a second indication, a second object identifier, and second mode information.

[0193] The second indication is used to indicate whether the second UE participates in dual-end graphical object-based multimedia communication. The second object identifier is used to indicate a second object selected by the second UE; the second object is one of the graphical objects pointed to by the data. The second mode information is used to indicate a communication mode for graphical object-based multimedia communication supported by the first UE; or the second mode information is used to indicate a communication mode for graphical object-based multimedia communication selected by the second UE.

[0194] The second indication here may correspond to the aforementioned first indication. For example, the first UE initiates multimedia communication based on graphic objects, but the second UE may determine whether it participates in multimedia communication based on graphic objects. For example, the first UE supports single-ended multimedia communication based on graphic objects, and the user of the second UE is currently unwilling to conduct multimedia communication based on graphic objects. In this case, the second UE may include itself supporting the single-ended multimedia communication based on graphic objects of the first UE, and the user of the second UE conducts multimedia communication with its true appearance, or, the second UE user may not be recorded nor any video related to the user of the second UE may be provided.

[0195] The second object identifier here may correspond to the aforementioned first object identifier and may be replaced by the index of the second object.

[0196] The second mode information may correspond to the first mode information, and may be a mode identifier and / or a mode index, etc.

[0197] Likewise, the communication mode indicated by the second mode information may be the aforementioned first mode and / or second mode.

[0198] Similarly, the second indication may be an optional component of the second parameter. For example, if the second indication is not carried, it may be assumed that the second UE supports the type of graphic object-based multimedia communication supported, selected, or desired by the first UE. The types of graphic object-based multimedia communication may include: single-ended graphic object-based multimedia communication and / or dual-ended graphic object-based multimedia communication. For another example, if the second indication is omitted, it may be assumed that the second UE supports any type of graphic object-based multimedia communication.

[0199] The second mode information may be an optional parameter in the second parameter. For example, if the second mode information is omitted, it may be considered that the second UE supports the communication mode supported, selected, or desired by the first UE. For another example, if the second mode information is omitted, it may be considered that the second UE supports various communication modes.

[0200] The second object identifier may be an optional parameter in the second parameter. If the first mode is used for graphic-based multimedia communication, the second object identifier may not be sent to the first UE. In this case, the second object identifier may also be omitted.

[0201] After completing the communication parameter determination of the multimedia communication based on the graphic object, the first UE and the second UE can formally start the multimedia communication based on the graphic object. Specifically, the first UE captures the expression and / or action and other information of the first user, and then generates a first video based on the captured expression and / or action and other information of the first user in combination with the first object. Alternatively, the first data is generated based on the captured expression and / or action of the first user. For example, the first data can be a control instruction for controlling the movement of the first object generated according to the control information. The first UE can display the first video generated by itself on the local end, and can also receive the second video or second data from the second UE and display the second video. Alternatively, a fourth video is generated and displayed based on the second data and the second object.

[0202] It is worth noting that if the first UE and / or the second UE has the data of the graphic object stored locally, the operation of requesting the data of the graphic object from the network device can be omitted, or can be continued.

[0203] As shown in FIG3A , an embodiment of the present disclosure provides a multimedia communication method, which is performed by a UE. The method may include:

[0204] S3101: Send the first message.

[0205] In some embodiments, the UE may be a UE that initiates multimedia communication based on graphic objects, and may also be a UE that accepts multimedia communication requests based on graphic objects from other UEs.

[0206] In some embodiments, the UE sends a first message to the network device.

[0207] In some embodiments, the first message is used to request data for a graphics object.

[0208] In some embodiments, the optional embodiments of S3101 can refer to S2101 of the corresponding embodiment of Figure 2.

[0209] In some embodiments, the network device may be a core network device and / or AF, etc. For details, please refer to the description of the corresponding embodiment in Figure 2.

[0210] S3102: Receive the second message.

[0211] In some embodiments, the UE receives a second message sent by the network device.

[0212] In some embodiments, the second message includes data; a graphic object for graphic object-based multimedia communication.

[0213] In some embodiments, the relevant description of the second message can be found in the embodiment corresponding to FIG2 , which will not be repeated here.

[0214] As shown in FIG3B , an embodiment of the present disclosure provides a multimedia communication method, which is performed by a first UE. The method may include:

[0215] S3201: Send the third message.

[0216] In some embodiments, the first UE sends a third message to the network device and / or the second UE.

[0217] In some embodiments, the third message is used for the second UE to determine whether to participate in the graphic object-based multimedia communication, and / or the third message is used for the first UE to negotiate with the second UE on communication parameters of the graphic object-based multimedia communication.

[0218] Exemplarily, the third message includes: a first parameter provided by the first UE; and the first parameter is used for multimedia communication based on graphic objects.

[0219] In some embodiments, the first parameter includes at least one of the following:

[0220] A first object identifier, where the first object identifier is used to indicate a first object selected by the first UE; the first object is one of the graphic objects pointed to by the data;

[0221] First mode information, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects selected by the first UE;

[0222] The first indication is used to indicate whether the first UE supports single-ended graphic object-based multimedia communication.

[0223] In some embodiments, the optional embodiments of S3201 can refer to any optional embodiment of S2104 of the corresponding embodiment of Figure 2.

[0224] S3202: Receive the fourth message.

[0225] In some embodiments, the first UE receives a fourth message returned by the second UE and / or the network device.

[0226] In some embodiments, the fourth message is used for the second UE to indicate whether to participate in the graphic object-based multimedia communication, and / or the second UE determines a second parameter for participating in the graphic object-based multimedia communication.

[0227] It is worth noting that: for the related description of the fourth message, please refer to the embodiment corresponding to FIG2 .

[0228] In some embodiments, the first UE may further execute S3101 and S3102 as shown in FIG3A before executing S3201 and S3202. If the first UE stores the data of the graphic object locally, the first UE may also omit S3101 and S3102.

[0229] As shown in FIG3C , an embodiment of the present disclosure provides a multimedia communication method, which is performed by a second UE. The method may include:

[0230] S3301: Receive the third message.

[0231] In some embodiments, the second UE and the first UE may be opposite-end UEs performing multimedia communication based on graphic objects.

[0232] In some embodiments, the second UE receives the third message from the first UE or the network device. For example, the second UE receives the third message from the first UE based on an established end-to-end data channel. In another example, the second UE receives the third message from the first UE forwarded by the network device. The data channel includes but is not limited to a guided data channel.

[0233] In some embodiments, the third message is used for the second UE to determine whether to participate in the graphic object-based multimedia communication, and / or the third message is used for the first UE to negotiate with the second UE on communication parameters of the graphic object-based multimedia communication.

[0234] In some embodiments, the relevant description of the third message can be found in the embodiment corresponding to Figure 2.

[0235] S3302: Send the fourth message.

[0236] In some embodiments, the second UE may send the fourth message to the first UE, or the second UE may forward or transparently transmit the fourth message to the first UE via a network device. For example, the second UE may send the fourth message to the first UE based on an end-to-end data channel established between the second UE and the first UE.

[0237] In some embodiments, the fourth message is used for the second UE to indicate whether to participate in the graphic object-based multimedia communication, and / or the second UE determines a second parameter for participating in the graphic object-based multimedia communication.

[0238] In some embodiments, the second parameter includes at least one of the following:

[0239] A second indication, used to indicate whether the second UE participates in the dual-end graphic object-based multimedia communication;

[0240] A second object identifier, used to indicate a second object selected by the second UE; the second object is one of the graphic objects pointed to by the data;

[0241] The second mode information is used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or the second mode information is used to indicate a communication mode of multimedia communication based on graphic objects selected by the second UE.

[0242] It is worth noting that: the optional method of S3302 can refer to the optional embodiment of S2105 corresponding to the embodiment of Figure 2.

[0243] In some embodiments, the second UE, as the UE accepting the invitation for multimedia communication based on graphic objects, will also execute S3101 and S3102 as shown in FIG3A before executing S3301 and S3302. If the second UE stores the graphic object data locally, the second UE may also omit S3101 and S3102.

[0244] As shown in FIG4 , an embodiment of the present disclosure provides a multimedia communication method, which is performed by a network device. The method may include:

[0245] S4101: Receive the first message.

[0246] In some embodiments, the network device may be a core network device.

[0247] In some embodiments, the core network device may be a Data Channel Signaling Function (DSCF). The DSCF may be used to provide control logic for data channels. For example, the DSCF may manage data channel resources and provide event management for IMS sessions based on data channels. IMS sessions herein may include, but are not limited to, IMS session establishment events, termination events, resumption events, or termination events.

[0248] In some embodiments, the core network device may be a Multimedia Resource Function (MRF) or a Media Function (MF). For the description of the MRF and / or MF herein, please refer to the relevant description of IMS.

[0249] In some embodiments, the network device may also be an application function (AF). The AF may be located in the core network or outside the trusted domain of the core network. For example, the AF may be one or more application servers (AS) provided by a third party.

[0250] In some embodiments, a UE and / or a first message sent by a UE is received, and the UE may include the aforementioned first UE and / or second UE.

[0251] Exemplarily, the first message may include identification information of the UE and / or an indicator requesting multimedia communication based on graphic objects, etc.

[0252] In some embodiments, the first message is used to request data for a graphics object.

[0253] In some embodiments, the first message is used to request data for a graphics object.

[0254] For example, the first message may be a request message specifically used to request data of a graphic object.

[0255] As another example, the first message may be an initiation message for initiating multimedia communication based on graphic objects. In this case, the first message can be used by the first UE to initiate multimedia communication based on graphic objects on the one hand, and on the other hand, can be used by the first UE to request data of graphic objects from the network device.

[0256] In some embodiments, the data of the graphic object includes at least one of the following:

[0257] visual data of graphic objects;

[0258] Identification of graphic objects;

[0259] Control data, which is used to control the rendering of graphic objects.

[0260] It is worth noting that the message content of the first message can be found in the embodiment corresponding to FIG2 .

[0261] S4102: Authenticate the UE.

[0262] In some embodiments, the authentication of the UE by the network device here can refer to the authentication of the first UE in S2102 in the embodiment corresponding to FIG. 2 .

[0263] Whether the UE has permission for multimedia communication based on graphic objects; for example, determining whether the UE has permission for multimedia communication based on graphic objects based on the UE's subscription data, or whether the UE user has been authenticated to activate multimedia communication based on graphic objects;

[0264] Whether the UE has permission to participate in the type of graphic object-based multimedia communication requested by the UE, for example, the type of graphic object-based multimedia communication may include: single-end graphic object-based multimedia communication, dual-end graphic object-based multimedia communication, and multi-end graphic object-based multimedia communication;

[0265] Whether the UE has the authority to actively initiate multimedia communication based on graphic objects;

[0266] Whether the UE has the authority to passively respond to multimedia communications based on graphic objects.

[0267] S4103: Send the second message.

[0268] In some embodiments, the second message includes data of a graphic object, which can be used for graphic object-based multimedia communication between UEs.

[0269] In some embodiments, the first UE has permission, and the network device sends the second message to the first UE.

[0270] In some embodiments, the first UE passes authentication, and the network device sends a second message to the first UE.

[0271] In some embodiments, if the first UE does not have permission or fails authentication, the network device does not send the second message to the first UE. For example, if the first UE does not have permission or fails authentication, the network device sends a rejection message or a failure message to the first UE. In some embodiments, the rejection message or failure message may include a reason for the rejection or failure. The rejection message is used to instruct the network device to reject the graphic object-based multimedia communication of the first UE. The failure message may indicate that the graphic object-based multimedia communication of the first UE has failed.

[0272] In some embodiments, the first message is an initiation request message for requesting multimedia communication based on graphic objects, and the second message may be a response message for multimedia communication based on graphic objects.

[0273] In some embodiments, the first message is not a request message for initiating multimedia communication based on graphic objects but any other message requesting data of graphic objects, and the second message may be a feedback message for multimedia communication based on graphic objects.

[0274] It is worth noting that: the optional implementation manner of the network device sending the second message here can refer to any optional implementation manner of S2103 in the embodiment corresponding to FIG. 2 .

[0275] It is worth noting that step S4102 may be an optional step. For example, data based on a graphic object may be provided to the UE without authenticating the UE. For example, free public graphic object data provided by an application provider may be provided to the UE for trial use or free use for multimedia communications. For another example, step S4101 may also be an optional step. The network device may proactively send graphic object data to the UE periodically or based on a trigger event. In this case, the UE does not need to send a first message to request the graphic object data.

[0276] In some embodiments, the network device also manages multimedia communications based on graphic objects between UEs, for example, participating in establishing data channels, signaling forwarding and / or transparent transmission, etc.

[0277] The present disclosure provides a multimedia communication based on graphic objects. The following example uses avatar communication as an example of multimedia communication based on graphic objects. The present disclosure introduces an avatar application server. The application server can provide an avatar object (i.e., an avatar presentation) to an authenticated user. The authenticated user then performs avatar object communication based on the avatar object.

[0278] As shown in FIG5 , an embodiment of the present disclosure provides an Avatar communication that may include:

[0279] Step 1: An IMS audio or video session is established. For example, UE-A initiates IMS communication with UE-B. This IMS communication may involve voice and / or video communication. UE-A and the network to which UE-A is connected represent the source end, while UE-B and the network to which UE-B is connected represent the destination end.

[0280] Step 2: Determine to request Avatar communication. For example, UE-A determines to request Avatar communication based on user triggering.

[0281] Step 3: Establish a bootstrap data channel.

[0282] Step 4: UE-A downloads the requested Avatar object based on the established data channel. For example, UE-A obtains the data of the Avatar object from the Avatar application server based on the established data channel (for example, the guided data channel).

[0283] Step 5: UE-B downloads the requested Avatar object based on the established data channel. For example, UE-B obtains the data of the Avatar object from the Avatar application server based on the established data channel (for example, the guided data channel).

[0284] Step 6: Exchange re-INVITE messages, video / audio invitations, SDP invitations for avatar communication, responses to video / audio invitations, and responses to avatar communication. For example, UE-A sends a re-INVITE message to the IMS application service (AS). The re-INVITE message may include a Session Description Protocol (SDP) offer for avatar communication. The SDP offer may include the identifier of the avatar object and the data channel control policy to be used. The data channel control policy may also serve as a type of control data.

[0285] Upon receiving UE-A's re-invite message, UE-B sends a confirmation response (e.g., 200 OK) to UE-A. Information sent along with the confirmation response may also include audio and / or video information and an SDP response for avatar communication. The confirmation response may be a confirmation of SDP-based multimedia communication. The SDP response for avatar communication may be a response indicating whether to conduct avatar communication based on SDP.

[0286] Step 7: Avatar data rendering and encoding. For example, UE-A initiates the capture, rendering, and encoding of avatar data, and sends the encoded avatar data to UE-B. The avatar may include, but is not limited to, the aforementioned first video and / or first data. Simultaneously, UE-A also sends rendered video / audio data over RTP.

[0287] Step 8: Avatar data decoding, rendering, and display. For example, UE-B receives the encoded Avatar data, decodes it, and displays it.

[0288] Step 9: Avatar data capture, rendering, and encoding. For example, UE-B performs similar operations as UE-A in step 7 and sends the encoded Avatar data to UE-A. At the same time, UE-B also sends video / audio rendering data based on RTP.

[0289] Step 10: Avatar data capture, rendering, and encoding. For example, UE-A performs similar operations as UE-B performs in step 8.

[0290] Exemplarily, a method executed by an Avatar application server and used by a UE to perform Avatar communication may include:

[0291] Receive a request to download an Avatar object.

[0292] After the UE successfully passes the authentication or verification, the Avatar object and the identifier of the Avatar object are sent to the UE.

[0293] Exemplarily, a method executed by a UE and used by the UE to perform Avatar communication may include:

[0294] Download the Avatar object from the Avatar application server;

[0295] Send a re-invite message to the opposite UE, where the re-invite message may include: an SDP proposal for Avatar communication.

[0296] Receive a response message returned by the peer UE. The response message may include a confirmation (200 OK) message and / or a negative response message.

[0297] or,

[0298] The local UE receives the re-invite message sent by the opposite UE, where the re-invite message may include: an SDP proposal for Avatar communication.

[0299] Return a response message to the peer UE.

[0300] The local end determines to conduct Avatar communication, and the local UE captures, renders, and encodes the Avatar data; sends the Avatar data to the remote UE; and receives the Avatar data from the remote UE;

[0301] Decode and display the peer's Avatar data.

[0302] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or may be arbitrarily combined with the optional implementations of other embodiments.

[0303] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or may be arbitrarily combined with the optional implementations of other embodiments.

[0304] The embodiments of the present disclosure also provide an apparatus for implementing any of the above methods. For example, an apparatus is provided, comprising units or modules for implementing each step performed by a terminal in any of the above methods. For another example, another apparatus is provided, comprising units or modules for implementing each step performed by a network device (e.g., an access network device or a core network device) in any of the above methods.

[0305] It should be understood that the division of the various units or modules in the above devices is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a physical entity, or they may be physically separated. In addition, the units or modules in the device may be implemented in the form of a processor calling software: for example, the device includes a processor, the processor is connected to a memory, and the memory stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or implement the functions of the various units or modules of the above devices, wherein the processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor, and the memory is a memory within the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units or modules can be realized by designing the hardware circuits. The above-mentioned hardware circuits can be understood as one or more processors; for example, in one implementation, the above-mentioned hardware circuit is an application-specific integrated circuit (ASIC), which realizes the functions of some or all of the above units or modules by designing the logical relationship of the components in the circuit; for example, in another implementation, the above-mentioned hardware circuit can be realized by a programmable logic device (PLD). Taking a field programmable gate array (FPGA) as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by configuring the configuration file, thereby realizing the functions of some or all of the above units or modules. All units or modules of the above devices can be realized in the form of software called by the processor, or in the form of hardware circuits, or in part by the form of software called by the processor, and the rest by hardware circuits.

[0306] In the embodiments of the present disclosure, a processor is a circuit with signal processing capabilities. In one implementation, the processor may be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the above-mentioned hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DLP), or a computer programmable logic device (CLP). Unit, DPU) etc.

[0307] As shown in FIG6A , an embodiment of the present disclosure provides a first UE, wherein the first UE includes:

[0308] The sending module 6101 is configured to send a first message to the network device; the first message is used to request data of the graphic object;

[0309] The receiving module 6102 is configured to receive a second message sent by the network device; the second message includes data; and a graphic object used for multimedia communication based on the graphic object.

[0310] In some embodiments, the processing module may be used by the first UE to execute steps related to information processing in any multimedia communication method.

[0311] In some embodiments, the first UE may further include: a sending module and / or a receiving module.

[0312] In some embodiments, the sending module and / or the receiving module may correspond to a network interface and / or a transceiver antenna of the first UE.

[0313] In some embodiments, the sending module may be used by the first UE to perform steps related to information sending in any multimedia communication method.

[0314] In some embodiments, the receiving module may be used by the first UE to perform steps related to information sending in any multimedia communication method.

[0315] In some embodiments, the sending module is configured to determine to initiate multimedia communication based on a graphic object, and to send a first message to the network device.

[0316] In some embodiments, the processing module is configured to determine that multimedia communication based on a graphic object is initiated and the first UE does not store data of the graphic object, and to send a first message to the network device.

[0317] In some embodiments, the sending module is configured to send a third message to the second UE, the third message being used for the second UE to determine whether to participate in multimedia communication based on graphic objects, and / or the third message being used for the first UE to negotiate communication parameters of multimedia communication based on graphic objects with the second UE.

[0318] In some embodiments, the third message includes: a first parameter provided by the first UE; and the first parameter is used for multimedia communication based on graphic objects.

[0319] In some embodiments, the first parameter includes at least one of the following:

[0320] A first object identifier, where the first object identifier is used to indicate a first object selected by the first UE; the first object is one of the graphic objects pointed to by the data;

[0321] First mode information, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects selected by the first UE;

[0322] The first indication is used to indicate whether the first UE supports single-ended graphic object-based multimedia communication.

[0323] In some embodiments, the receiving module is configured to receive a fourth message sent by the second UE; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines a second parameter for participating in multimedia communication based on graphic objects.

[0324] In some embodiments, the second parameter includes at least one of the following:

[0325] A second indication, used to indicate whether the second UE participates in the dual-end graphic object-based multimedia communication;

[0326] A second object identifier, used to indicate a second object selected by the second UE; the second object is one of the graphic objects pointed to by the data;

[0327] The second mode information is used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or the second mode information is used to indicate a communication mode of multimedia communication based on graphic objects selected by the second UE.

[0328] In some embodiments, the communication mode of the graphic object-based multimedia communication includes:

[0329] First mode; In the first mode, the first UE sends a first video generated based on the graphic object to the second UE and / or the second UE sends a second video based on the graphic object to the first UE;

[0330] Second mode; in the second mode, the first UE sends the first data to the second UE and / or the second UE sends the second data to the first UE; the first data is used by the second UE to generate a third video based on the graphic object selected by the first UE; the second data is used by the first UE to generate a fourth video based on the graphic object selected by the second UE.

[0331] In some embodiments, the data of the graphic object includes at least one of the following:

[0332] visual data of graphic objects;

[0333] Identification of graphic objects;

[0334] Control data, which is used to control the rendering of graphic objects.

[0335] In some embodiments, receiving a second message sent by the network device includes:

[0336] A second message is sent by the receiving network device after the first UE is successfully authenticated.

[0337] As shown in FIG6B , an embodiment of the present disclosure provides a network device, wherein the network device includes:

[0338] The receiving module 6201 is configured to receive a first message sent by a first UE, where the first message is used to request data of a graphic object;

[0339] The sending module 6202 is configured to send a second message to the first UE, where the second message includes data and a graphic object for multimedia communication based on the graphic object.

[0340] In some embodiments, the processing module may be configured to execute any steps related to information processing in the multimedia communication method performed by the network device.

[0341] In some embodiments, the network device may further include a receiving module.

[0342] In some embodiments, the sending module and / or the receiving module may correspond to a network interface and / or a transceiver antenna of a network device.

[0343] In some embodiments, the processing module is configured to authenticate the first UE;

[0344] The sending module is configured to send a second message to the first UE after the first UE is authenticated.

[0345] In some embodiments, the data of the graphic object includes at least one of the following:

[0346] visual data of graphic objects;

[0347] Identification of graphic objects;

[0348] Control data, which is used to control the rendering of graphic objects.

[0349] As shown in FIG6C , an embodiment of the present disclosure provides a second UE, including:

[0350] The receiving module 6301 is configured to receive a third message sent by the first UE; the third message is used by the second UE to determine whether to participate in the multimedia communication based on the graphic object, and / or the third message is used by the first UE to negotiate with the second UE a communication parameter for the multimedia communication based on the graphic object;

[0351] The sending module 6302 is configured to send a fourth message to the first UE according to the third message; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on graphic objects, and / or the second UE determines the second parameter for participating in multimedia communication based on graphic objects.

[0352] In some embodiments, the processing module may be used for the second UE to execute steps related to information processing in any multimedia communication method.

[0353] In some embodiments, the second UE may further include: a sending module and / or a receiving module.

[0354] In some embodiments, the sending module and / or the receiving module may correspond to a network interface and / or a transceiver antenna of the second UE.

[0355] In some embodiments, the sending module may be used for the second UE to perform steps related to information sending in any multimedia communication method.

[0356] In some embodiments, the receiving module may be used for the second UE to perform steps related to information sending in any multimedia communication method.

[0357] In some embodiments, the first parameter includes at least one of the following:

[0358] A first object identifier, where the first object identifier is used to indicate a first object selected by the first UE; the first object is one of the graphic objects pointed to by the data;

[0359] First mode information, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or, the first mode information being used to indicate a communication mode of multimedia communication based on graphic objects selected by the first UE;

[0360] The first indication is used to indicate whether the first UE supports single-ended graphic object-based multimedia communication.

[0361] In some embodiments, the second parameter includes at least one of the following:

[0362] A second indication, used to indicate whether the second UE participates in the dual-end graphic object-based multimedia communication;

[0363] A second object identifier, used to indicate a second object selected by the second UE; the second object is one of the graphic objects pointed to by the data;

[0364] The second mode information is used to indicate a communication mode of multimedia communication based on graphic objects supported by the first UE; or the second mode information is used to indicate a communication mode of multimedia communication based on graphic objects selected by the second UE.

[0365] In some embodiments, the communication mode of the graphic object-based multimedia communication includes:

[0366] First mode; In the first mode, the first UE sends a first video generated based on the graphic object to the second UE and / or the second UE sends a second video based on the graphic object to the first UE;

[0367] Second mode; in the second mode, the first UE sends the first data to the second UE and / or the second UE sends the second data to the first UE; the first data is used by the second UE to generate a third video based on the graphic object selected by the first UE; the second data is used by the first UE to generate a fourth video based on the graphic object selected by the second UE.

[0368] An embodiment of the present disclosure further provides a communication device, which may include: one or more processors; wherein the processor is used to call instructions to enable the communication device to execute the multimedia communication method that can be implemented in any one of the aforementioned embodiments.

[0369] 7A and / or 7B , the communication device 8100 further includes one or more memories 8102 for storing instructions. Alternatively, all or part of the memories 8102 may be located outside the communication device 8100.

[0370] The communication device may be the aforementioned terminal and network device. In some embodiments, the network device may be a master node and / or an auxiliary node.

[0371] In some embodiments, the communication device 8100 further includes one or more transceivers 8103. When the communication device 8100 includes one or more transceivers 8103, the communication steps such as sending and receiving in the above method are performed by the transceiver 8103, and the other steps are performed by the processor 8101.

[0372] In some embodiments, a transceiver may include a receiver and a transmitter, which may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, and transceiver circuit may be used interchangeably; the terms transmitter, transmitting unit, transmitter, and transmitting circuit may be used interchangeably; and the terms receiver, receiving unit, receiver, and receiving circuit may be used interchangeably.

[0373] Optionally, the communication device 8100 further includes one or more interface circuits 8104, which are connected to the memory 8102. The interface circuits 8104 can be used to receive signals from the memory 8102 or other devices, and can be used to send signals to the memory 8102 or other devices. For example, the interface circuits 8104 can read instructions stored in the memory 8102 and send the instructions to the processor 8101.

[0374] The communication device 8100 described in the above embodiment may be a network device or a terminal, but the scope of the communication device 8100 described in the present disclosure is not limited thereto, and the structure of the communication device 8100 may not be limited by FIG. 7A. The communication device may be an independent device or may be part of a larger device. For example, the communication device may be: (1) an independent integrated circuit IC, or a chip, or a chip system or subsystem; (2) a collection of one or more ICs, optionally, the above IC collection may also include a storage component for storing data and programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, a terminal device, an intelligent terminal device, a cellular phone, a wireless device, a handheld device, a mobile unit, an in-vehicle device, a network device, a cloud device, an artificial intelligence device, etc.; (6) others, etc.

[0375] 7B is a schematic diagram of the structure of a chip 8200 provided in an embodiment of the present disclosure. If the communication device 8100 can be a chip or a chip system, please refer to the schematic diagram of the structure of the chip 8200 shown in FIG7B , but the present disclosure is not limited thereto.

[0376] The chip 8200 includes one or more processors 8201 , and the processor 8201 is used to call instructions so that the chip 8200 executes any of the above multimedia communication methods.

[0377] In some embodiments, chip 8200 further includes one or more interface circuits 8202, which are connected to memory 8203. Interface circuit 8202 can be used to receive signals from memory 8203 or other devices, and can be used to send signals to memory 8203 or other devices. For example, interface circuit 8202 can read instructions stored in memory 8203 and send the instructions to processor 8201. Optionally, the terms interface circuit, interface, transceiver pin, and transceiver are interchangeable.

[0378] In some embodiments, the chip 8200 further includes one or more memories 8203 for storing instructions. Alternatively, all or part of the memories 8203 may be located outside the chip 8200.

[0379] The present disclosure also provides a storage medium having instructions stored thereon, which, when executed on the communication device 8100, causes the communication device 8100 to execute any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but may also be a storage medium readable by other devices. Optionally, the storage medium may be a non-transitory storage medium, but may also be a transient storage medium.

[0380] The present disclosure further provides a program product, which, when executed by the communication device 8100, enables the communication device 8100 to perform any of the above multimedia communication methods. Optionally, the program product is a computer program product.

[0381] The present disclosure also provides a computer program, which, when executed on a computer, enables the computer to execute any one of the above multimedia communication methods.

[0382] Other embodiments of the presently disclosed embodiments will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the presently disclosed embodiments that follow the general principles of the presently disclosed embodiments and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered as exemplary only, with the true scope and spirit of the presently disclosed embodiments being indicated by the following claims.

[0383] It should be understood that the embodiments of the present disclosure are not limited to the precise structures described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the embodiments of the present disclosure is limited only by the appended claims.

Claims

1. A multimedia communication method, wherein, Performed by a first user equipment UE, the method includes: Sending a first message to a network element; the first message is used to request data of a graphical object; Receiving a second message sent by the network element; the second message includes data of the graphical object; the graphical object is used for multimedia communication based on the graphical object.

2. The method according to claim 1, wherein, The sending the first message to the network element includes: Determining to initiate multimedia communication based on a graphical object and sending the first message to the network element.

3. The method according to claim 2, wherein, The determining to initiate multimedia communication based on the graphical object and sending the first message to the network element includes: Determining to initiate multimedia communication based on a graphical object and the first UE does not store data of the graphical object, and sending the first message to the network element.

4. The method according to claim 2 or 3, wherein, The method further includes: Sending a third message to a second UE, the third message is used for the second UE to determine whether to participate in multimedia communication based on a graphical object, and / or, the third message is used for the first UE to negotiate communication parameters of multimedia communication based on a graphical object with the second UE.

5. The method according to claim 4, wherein, The third message includes: a first parameter provided by the first UE; the first parameter is used for the multimedia communication based on the graphical object.

6. The method according to claim 5, wherein The first parameter includes at least one of the following: A first object identifier, the first object identifier is used to indicate a first object selected by the first UE; the first object is one of the graphical objects pointed to by the data; First mode information, the first mode information is used to indicate a communication mode of multimedia communication based on a graphical object supported by the first UE; or, the first mode information is used to indicate a communication mode of multimedia communication based on a graphical object selected by the first UE; A first indication, used to indicate whether the first UE supports single - end multimedia communication based on a graphical object.

7. The method according to any one of claims 4 to 6, wherein The method further includes: Receiving a fourth message sent by the second UE; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on a graphical object, and / or, the second UE determines a second parameter for participating in multimedia communication based on a graphical object.

8. The method according to claim 7, wherein, The second parameter includes at least one of the following: A second indication, used to indicate whether the second UE participates in double - end multimedia communication based on a graphical object; A second object identifier, used to indicate a second object selected by the second UE; the second object is one of the graphical objects pointed to by the data; Second mode information, used to indicate a communication mode of multimedia communication based on a graphical object supported by the first UE; or, the second mode information is used to indicate a communication mode of multimedia communication based on a graphical object selected by the second UE.

9. The method according to any one of claims 6 to 8, wherein, The communication mode of multimedia communication based on a graphical object includes: A first mode; in the first mode, the first UE sends a first video generated based on a graphical object to the second UE and / or the second UE sends a second video based on the graphical object to the first UE; Second mode; in the second mode, the first UE sends first data to the second UE and / or the second UE sends second data to the first UE; the first data is used for the second UE to generate a third video based on the graphic object selected by the first UE; the second data is used for the first UE to generate a fourth video based on the graphic object selected by the second UE.

10. The method according to any one of claims 1 to 9, wherein The data of the graphic object includes at least one of the following: Visual data of the graphic object; The identifier of the graphic object; Control data, which is used to control the presentation of the graphic object.

11. The method according to any one of claims 1 to 10, wherein, Receiving the second message sent by the network element includes: Receiving the second message sent by the network element after authenticating the first UE successfully.

12. A multimedia communication method, wherein, Executed by a network element, the method includes: Receiving a first message sent by a first UE; the first message is used to request the data of the graphic object; Sending a second message to the first UE, the second message includes the data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

13. The method according to claim 12, wherein, The method further includes: Authenticating the first UE; Sending the second message to the first UE includes: After the first UE is authenticated successfully, sending a second message to the first UE.

14. The method according to claim 12 or 13, wherein The data of the graphic object includes at least one of the following: Visual data of the graphic object; The identifier of the graphic object; Control data, which is used to control the presentation of the graphic object.

15. A multimedia communication processing method based on graphic objects, wherein, Executed by a second user equipment UE, the method includes: Receiving a third message sent by a first UE; the third message is used for the second UE to determine whether to participate in multimedia communication based on the graphic object, and / or, the third message is used for the first UE and the second UE to negotiate the communication parameters of the multimedia communication based on the graphic object; According to the third message, sending a fourth message to the first UE; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on the graphic object, and / or, the second UE determines the second parameters for participating in the multimedia communication based on the graphic object.

16. The method according to claim 15, wherein, The first parameter includes at least one of the following: The first object identifier, which is used to indicate the first object selected by the first UE; the first object is one of the graphic objects pointed to by the data; The first mode information, which is used to indicate the communication mode of the multimedia communication based on the graphic object supported by the first UE; or, the first mode information, which is used to indicate the communication mode of the multimedia communication based on the graphic object selected by the first UE; The first indication, which is used to indicate whether the first UE supports single-end multimedia communication based on the graphic object.

17. The method according to claim 15 or 16, wherein, The second parameter includes at least one of the following: The second indication, which is used to indicate whether the second UE participates in double-end multimedia communication based on the graphic object; The second object identifier, which is used to indicate the second object selected by the second UE; the second object is one of the graphic objects pointed to by the data; Second mode information, for indicating the communication mode of the multimedia communication based on graphic objects supported by the first UE; or, the second mode information, for indicating the communication mode of the multimedia communication based on graphic objects selected by the second UE.

18. The method according to claim 16 or 17, wherein The communication modes of the multimedia communication based on graphic objects include: The first mode; in the first mode, the first UE sends a first video generated based on graphic objects to the second UE and / or the second UE sends a second video generated based on graphic objects to the first UE; The second mode; in the second mode, the first UE sends first data to the second UE and / or the second UE sends second data to the first UE; the first data is used for the second UE to generate a third video based on the graphic objects selected by the first UE; the second data is used for the first UE to generate a fourth video based on the graphic objects selected by the second UE.

19. A first user equipment (UE), the first UE includes: A sending module, configured to send a first message to a network element; The first message is used to request data of graphic objects; A receiving module, configured to receive a second message sent by the network element; The second message includes the data of the graphic objects; The graphic objects are used for multimedia communication based on graphic objects.

20. A network element, wherein, The network element includes: A receiving module, configured to receive the first message sent by the first UE; the first message is used to request data of graphic objects; A sending module, configured to send a second message to the first UE, the second message includes the data of the graphic objects; the graphic objects are used for multimedia communication based on graphic objects.

21. A second user equipment UE, wherein, The second UE includes: A receiving module, configured to receive a third message sent by the first UE; the third message is used for the second UE to determine whether to participate in the multimedia communication based on graphic objects, and / or, the third message is used for the first UE and the second UE to negotiate the communication parameters of the multimedia communication based on graphic objects; A sending module, configured to send a fourth message to the first UE according to the third message; the fourth message is used for the second UE to indicate whether to participate in the multimedia communication based on graphic objects, and / or, the second UE determines the second parameters for participating in the multimedia communication based on graphic objects.

22. A communication device, wherein, The communication device includes: One or more processors; Wherein, the processor is used to call instructions to cause the communication device to execute the multimedia communication method described in any one of claims 1 to 11, 12 to 14 and / or claims 15 to 18.

23. A storage medium, wherein, The storage medium stores instructions, when the instructions run on the communication device, causing the communication device to execute the multimedia communication method described in any one of claims 1 to 11, 12 to 14 and / or claims 15 to 18.

24. A multimedia communication method, wherein, Executed by a communication system, the communication system at least includes: a user equipment (UE) and a network element; the method includes: The UE sends a first message to the network element; the first message is used to request data of graphic objects; The network element receives the first message sent by the UE and sends a second message to the UE, where the second message includes data of the graphic object; the graphic object is used for multimedia communication based on the graphic object.

25. The method according to claim 24, wherein The UE includes a first UE and a second UE; the method further includes: The first UE sends a third message to the second UE, where the third message is used for the second UE to determine whether to participate in multimedia communication based on the graphic object, and / or, the third message is used for the first UE to negotiate communication parameters of multimedia communication based on the graphic object with the second UE; the second UE sends a fourth message to the first UE according to the third message; the fourth message is used for the second UE to indicate whether to participate in multimedia communication based on the graphic object, and / or, the second UE determines a second parameter for participating in multimedia communication based on the graphic object.

Images