Data processing method and apparatus

By introducing data processing methods into the DVB system, the terminal can obtain virtual image service information from the service list server and access these services, solving the problem that the existing DVB standard does not support digital human services, and realizing the effect of providing digital human services through the DVB system.

WO2025066963A9PCT designated stage expired Publication Date: 2025-05-08HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/119214
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-28
Filing Date
2024-09-14
Publication Date
2025-05-08

AI Technical Summary

Technical Problem

The existing DVB standards do not support digital human services, and DVB-I does not support the discovery of digital human services, resulting in the inability to provide digital human services through the DVB system.

Method used

By introducing a data processing method in the DVB system, the terminal obtains the service information of the virtual image service from the service list server, and accesses the virtual image service based on the service information, so as to realize that the terminal can obtain the service of the virtual image service. The specific steps include obtaining a business list, accessing a virtual avatar service, configuring the virtual avatar service type, instance information and associated application information in the business information to support terminal access to the virtual avatar service.

Benefits of technology

It realizes the service that supports digital human business through the DVB system, and the terminal can access and receive virtual image services normally, meeting the needs of digital human business.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024119214_08052025_PF_FP_ABST
    Figure CN2024119214_08052025_PF_FP_ABST
Patent Text Reader

Abstract

The embodiments of the present application relate to the technical field of communications. Provided are a data processing method and apparatus. A terminal can acquire a service list from a service list server, wherein the service list comprises service information of a virtual image service; and then the terminal can access the virtual image service on the basis of the service information. By using the method provided in the present application, the virtual image service can be acquired by means of DVB, and thus the service experience of a user can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Data processing method and device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 28, 2023, with application number 202311285270.7 and application name “A Data Processing Method and Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The embodiments of the present application relate to the field of communication technologies, and in particular to a data processing method and apparatus. Background Art

[0004] Digital Humans (or Meta Humans) are digitized humanoids created using digital technology, closely resembling human forms. They transcend physical boundaries to provide anthropomorphic services, and possess characteristics of hyper-realism and strong interactivity, making them a future development trend.

[0005] Digital Video Broadcasting (DVB) is a series of internationally recognized open standards for digital television maintained by the DVB project. DVB standards provide a complete set of digital television system specifications applicable to different media. Digital Video Broadcasting-Internet (DVB-I) is a DVB-developed mechanism for discovering services over the Internet and then acquiring them through various transmission methods. Existing DVB does not support digital human services, and no solution has yet been provided for how to provide these services through DVB.

[0006] Summary of the Invention

[0007] The present application provides a data processing method and apparatus for providing a digital human service via DVB.

[0008] In a first aspect, the present application provides a data processing method, which can be applied to a terminal, which can be understood as a mobile phone, a computer, a set-top box, etc. In a DVB system, the terminal is equivalent to a DVB-Client. This is only an example and does not specifically limit the form of the terminal. The method is performed as follows:

[0009] Obtain a service list including service information of the virtual image service; and access the virtual image service according to the service information.

[0010] It should be noted that the virtual image service in this application can be understood as a digital human service, a virtual pet service, a virtual space service, and the like, and this application does not specifically limit this. The service list server in this application can be understood as a service list server of a DVB system, and can also be understood as a server of other service systems, and this is not specifically limited here.

[0011] In this application, the terminal can obtain the service information of the virtual image service from the service list server of the DVB system, and request the virtual image service from the device associated with the virtual image service person according to the service information, thereby achieving the purpose of accessing the virtual image service. In this way, the terminal can obtain the virtual image service.

[0012] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0013] In this application, the service type indication information of the virtual image service can be a digital human, a cartoon digital human, etc. This is only for illustrative purposes and is not a specific limitation. The service instance information of the virtual image service can indicate the access address information of the virtual image service, etc. The associated application information of the virtual image service can be the application information that the terminal needs to install, and only after the installation of this application can the virtual image service be accessed. By configuring the service type indication information of the virtual image service, the service instance information of the virtual image service, and the associated application information of the virtual image service in the service information, this application can ensure that the DVB system supports the virtual image service, so that the terminal can access the virtual image service and receive the service of the virtual image service.

[0014] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0015] In the present application, when the service instance information includes uplink transmission parameters and the uplink transmission parameters include the destination address information of the uplink data, the terminal can learn the address for sending the virtual image service request, that is, the destination address of the uplink data, and send the virtual image service request to the service provider through the destination address of the uplink data, so that the service provider can generate a virtual image according to the virtual image service request.

[0016] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0017] In this application, by configuring the transmission protocol supported by the uplink data in the uplink transmission parameters, it is possible to know which protocol is used to transmit the virtual image service request data. By configuring the media types supported by the virtual image service request data in the uplink transmission parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image service request data.

[0018] In an optional manner, the service instance information includes not only the above-mentioned uplink transmission parameters but also service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0019] In this application, when the service instance information includes uplink transmission parameters and service access parameters, the terminal can obtain the download address of the virtual image, that is, the address of the service data for accessing the virtual image service, and send a virtual image acquisition request to the service provider through the address of the service data for accessing the virtual image service, so that the service provider generates the virtual image and returns to the address of the service data for accessing the virtual image service.

[0020] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0021] In the present application, when the service instance information includes service access parameters (the service access parameters are understood as access parameters for two-way communication, that is, parameters that support both the transmission of virtual image request data and the downloading of virtual image service data), the terminal can obtain the address for sending the virtual image service request and the download address of the virtual image, and send a virtual image acquisition request to the service provider through the address of the service data for accessing the virtual image service, so that the service provider generates the virtual image and returns to the address of the service data for accessing the virtual image service.

[0022] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0023] In this application, when the business information includes business instance information and associated application information of the virtual image business, the terminal can send a request to obtain the virtual image business to the business provider based on the application associated with the virtual image business, and then determine the download address of the virtual image through the business access parameters in the business instance information, and request to obtain the virtual image based on the download address.

[0024] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0025] In this application, by configuring the transmission protocol supported by the business data in the business access parameters, you can know which protocol is used to transmit the virtual image business request data. By configuring the media types supported by the business data in the business access parameters, such as audio, video, text, etc., you can know which media type of data is used to transmit the virtual image business.

[0026] In an optional manner, accessing the virtual image service according to the service information includes: the terminal sending a first message according to the service information, where the first message is used to request the virtual image service; and receiving a response message to the first message.

[0027] In the present application, the terminal can learn the address for sending the virtual image service request based on the service information, and the terminal can send a first message to the address to request the virtual image service, thereby obtaining the service of the virtual image service.

[0028] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0029] Among them, the user identifier can be understood as the user identifier of the DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client. This is only an example. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. User preference information is usually information collected based on the user's historical operating habits or parameters set by the user. For example, when a user likes to watch live sports, the Digital Human Server can recommend a digital human wearing sportswear. The type of virtual image selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc., and can also be sign language. This is only an example and does not specifically limit the above request message.

[0030] In an optional manner, the terminal further sends a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; and receives a response message to the second message.

[0031] In the present application, the terminal can learn the address for sending the virtual image service request based on the service information, and the terminal can send a second message to the address to interact with the virtual image generated by the service requester.

[0032] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0033] In an optional manner, the terminal further receives first service data of the virtual image service, where the first service data is service data generated by the virtual image service server according to the first message; and performs service playback according to the first service data.

[0034] In an optional manner, the terminal further sends a third message to the address information of the service data for accessing the virtual image service; and receives a response message to the third message, wherein the response message includes the first service data.

[0035] In an optional manner, the terminal also sends a fourth message to the address information of the business data for accessing the virtual image business; receives a response message to the fourth message, the response message to the fourth message including the media presentation description file of the virtual image business; and requests the first business data according to the media presentation description file.

[0036] In an optional manner, the terminal further receives second service data of the virtual image service, where the second service data is service data generated by the virtual image service server according to the second message; and performs service playback according to the second service data.

[0037] In an optional manner, the terminal further sends a third message to the address information of the service data for accessing the virtual image service; and receives a response message to the third message, wherein the response message includes the second service data.

[0038] In an optional manner, the terminal also sends a fourth message to the address information of the business data for accessing the virtual image business; receives a response message to the fourth message, the response message to the fourth message including the media presentation description file of the virtual image business; and requests second business data according to the media presentation description file.

[0039] In an optional manner, when the service information includes application information associated with the virtual image service, the terminal further activates the application associated with the virtual image service.

[0040] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0041] In a second aspect, the present application provides a data processing method, which is applied to a first server. The first server may be a manufacturer of a virtual image service, or an operator, etc. In a DVB system, the first server is equivalent to a content / service provider(s). This is merely an example and does not specifically limit the form of the first server. The method is performed as follows:

[0042] Receive first information, where the first information is used to request a virtual image service; generate first service data of the virtual image service according to the first information; and provide the first service data.

[0043] In the present application, after receiving the first information, the service provider generates first service data of the virtual image service according to the first information and provides first media data, thereby providing the service of the virtual image service.

[0044] In an optional manner, the first information includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0045] In an optional manner, the service provider further configures a service list of the service list server, where the service list includes service information of the virtual image service.

[0046] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0047] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0048] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0049] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0050] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0051] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0052] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0053] In an optional manner, the first server further receives second information, the second information including user expression information; generates second business data of the virtual image business according to the second information; and provides second media data.

[0054] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0055] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0056] In a third aspect, the present application provides a data processing method that can be executed through data interaction between a terminal, a first service server, and other devices. The terminal can be understood as a mobile phone, a computer, a set-top box, etc. In the DVB system, the terminal is equivalent to a DVB-Client (client), which is only illustrative here. The service provider can be a manufacturer of a virtual image service or an operator, etc. In the DVB system, the service provider is equivalent to a Content / Service provider(s) (content / service provider), which is only illustrative here. Execution is as follows:

[0057] The terminal obtains a service list from a service list server, where the service list includes service information of the virtual image service; the terminal sends a first message to the first server of the virtual image service based on the service information, where the first message is used to request the virtual image service; the first server generates first service data of the virtual image service based on the first information; the first server provides the first service data to the terminal; the terminal plays the service based on the first service data.

[0058] In an optional manner, the first server provides first business data to the terminal, including: the first server saves the first business data, wherein the first address for saving the first business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal; the terminal obtains the first business data from the first address.

[0059] In an optional manner, the terminal obtains the first business data from the first address, including: the terminal sends a third message according to the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the first business data.

[0060] In an optional manner, the first server provides first business data, including: the first server saves a media presentation file generated when the first business data is fragmented, wherein the second address of the media presentation file corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal, and the first server also saves the fragments of the first business data, wherein the third address of the fragments saving the first business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including the media presentation description file; the terminal requests the first business data based on the media presentation description file.

[0061] In an optional manner, the first server provides first business data, including: the first server saves the first business data, wherein the fourth address of saving the first business data corresponds to address information of business data for accessing a virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0062] In an optional manner, the terminal sends second information to the first server based on the business information, wherein the second information includes user expression information collected by the terminal; the first server generates second business data of the virtual image business based on the second information; the first server provides the second business data to the terminal; and the terminal plays the business based on the second business data.

[0063] In an optional manner, the first server provides second business data to the terminal, including: the first server saves the second business data, wherein the first address of saving the second business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal; the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the second business data.

[0064] In an optional manner, the first server provides second business data, including: the first server saves a media presentation file generated when the second business data is fragmented, wherein the second address of the media presentation file corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal, and the first server also saves the fragments of the second business data, wherein the third address of the fragments storing the second business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including the media presentation description file; the terminal requests the second business data based on the media presentation description file.

[0065] In an optional manner, the first server provides the second business data, including: the first server saves the second business data, wherein the fourth address of saving the second business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; the address information of the business data for accessing the virtual image business sends the second business data to the terminal.

[0066] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0067] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0068] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0069] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0070] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0071] In an optional manner, when the service information includes application information associated with the virtual image service, an application associated with the virtual image service installed in the terminal is activated.

[0072] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0073] In a fourth aspect, the present application provides a data processing device, comprising a transceiver unit and a processing unit;

[0074] The transceiver unit is used to obtain a service list from a service list server, where the service list includes service information of the virtual image service; and the processing unit is used to access the virtual image service according to the service information.

[0075] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0076] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0077] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0078] In an optional manner, the service instance information includes not only the above-mentioned uplink transmission parameters but also service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0079] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0080] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0081] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0082] In an optional manner, the transceiver unit is specifically configured to send a first message according to the service information, where the first message is used to request a virtual image service; and receive a response message to the first message.

[0083] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0084] In an optional manner, the transceiver unit is further used to send a second message based on the business information, where the second message is used for real-time interaction with the virtual image business, wherein the second message includes received user expression information; and receives a response message to the second message.

[0085] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0086] In an optional manner, the transceiver unit is further used to receive first business data of the virtual image business, where the first business data is business data generated by the virtual image business server according to the first message; the processing unit is further used to play the business according to the first business data.

[0087] In an optional manner, the transceiver unit is further configured to send a third message to the address information of the service data for accessing the virtual image service; and receive a response message to the third message, wherein the response message includes the first service data.

[0088] In an optional manner, the transceiver unit is further used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, and the response message to the fourth message includes a media presentation description file of the virtual image business; and the processing unit is further used to request the first business data according to the media presentation description file.

[0089] In an optional manner, the transceiver unit is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the second message; the processing unit is further used to play the business according to the second business data.

[0090] In an optional manner, the transceiver unit is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the first message; the processing unit is further used to play the business according to the second business data.

[0091] In an optional manner, the transceiver unit is further configured to send a third message to the address information of the service data for accessing the virtual image service; and receive a response message to the third message, wherein the response message includes the second service data.

[0092] In an optional manner, the transceiver unit is further used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, and the response message to the fourth message includes a media presentation description file of the virtual image business; and the processing unit is further used to request second business data according to the media presentation description file.

[0093] In an optional manner, when the service information includes application information associated with the virtual image service, the processing unit is further configured to activate an application associated with the virtual image service.

[0094] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0095] In a fifth aspect, the present application provides a data processing device, comprising a transceiver unit and a processing unit;

[0096] The transceiver unit is used to receive a first message, the first message is used to request a virtual image service; the processing unit is used to generate first service data of the virtual image service according to the first message; the transceiver unit is also used to provide the first service data.

[0097] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0098] In an optional manner, the processing unit is further configured to configure a service list of the service list server, where the service list includes service information of the virtual image service.

[0099] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0100] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0101] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0102] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0103] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0104] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0105] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0106] In an optional manner, the transceiver unit is further used to receive a second message, the second message includes user expression information, the user expression information is used for real-time interaction with the virtual image service, wherein the second message includes the received user expression information; the processing unit is further used to generate second business data of the virtual image service based on the second message; the transceiver unit is also used to provide second business data.

[0107] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0108] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0109] In a sixth aspect, an embodiment of the present application provides a communication system, which includes the terminal and network device in the above-mentioned first aspect.

[0110] In a seventh aspect, the present application provides a chip system, which includes a processor and may also include a memory, for implementing the method described in any possible design of the first aspect. The chip system can be composed of a chip or can include a chip and other discrete devices.

[0111] In an eighth aspect, the present application also provides a computer-readable storage medium, in which computer-readable instructions are stored. When the computer-readable instructions are executed on a computer, the computer executes a method as in any possible design in the first aspect.

[0112] In a ninth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the methods of the various embodiments of the first aspect described above.

[0113] For the technical effects that can be achieved in the above-mentioned second to ninth aspects, please refer to the description of the technical effects that can be achieved by the corresponding possible design schemes in the above-mentioned first aspect, and this application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0114] FIG1A shows a schematic diagram of a DVB system architecture;

[0115] FIG1B shows a schematic diagram of a system architecture applicable to the present application;

[0116] FIG2A shows a schematic flow chart of a data processing method provided by the present application;

[0117] FIG2B shows a flow chart of a data processing method provided by the present application;

[0118] FIG3 shows a flow chart of a data processing method provided by the present application;

[0119] FIG4 shows a flow chart of a data processing method provided by the present application;

[0120] FIG5 shows a flow chart of a data processing method provided by the present application;

[0121] FIG6 shows a flow chart of a data processing method provided by the present application;

[0122] FIG7 shows a flow chart of a data processing method provided by the present application;

[0123] FIG8 shows a schematic structural diagram of a data processing device provided by the present application;

[0124] FIG9 shows a schematic structural diagram of another data processing device provided in an embodiment of the present application;

[0125] FIG10 shows a schematic structural diagram of another data processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0126] In order to make the purpose, technical solutions and advantages of this application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The specific operating methods in the method embodiments can also be applied to the device embodiments or system embodiments. In the description of this application, unless otherwise specified, "multiple" means two or more. Therefore, the implementation of the device and method can refer to each other, and the repeated parts will not be repeated.

[0127] Figure 1A shows a DVB system architecture, which includes DVB-I Client, Service List Server(s), Content / Service provider(s), MPD Server(s), Stream Server(s), Content Guide Server(s), Service List registry, and Playlist Server(s).

[0128] The DVB-I Client is a client-side functional network element that supports DVB-I service discovery. The DVB-I Client can be integrated into various terminal devices such as mobile phones, tablets, laptops, PDAs, mobile internet devices (MIDs), virtual reality (VR) devices, augmented reality (AR) devices, smart TVs, set-top boxes, etc. The Service List Server(s) is a server that provides service lists to the DVB-I Client. The Content / Service Provider(s) is an organization that provides DVB-I services. The MPD Server(s) is a server that provides DASH MPD files. The Stream Server(s) is a server that provides DASH media segments to the DVB-I Client. The Content Guide Server(s) is a server that provides content guide data to the DVB-I Client. The Service List Registry is a server that provides the Service List Server address to the DVB-I Client. The Playlist Server(s) is a server that provides playlists of content items to the DVB-I Client.

[0129] The Content / Service provider(s) sends the available Service List to the Service List Server. The Service List Server registers the Service List access entry address (URL) to the Service List Registry. When the DVB-I client wants to discover a service, the DVB-I client obtains the Service List access entry address from the Service List registry through the address of the Service List Registry. DVB-I then queries the Service List through the access entry address. The Service List includes information about one or more Services. Each Service can include one or more Service Instances that provide the service. If the service is through the associated application service capability, the Service information includes the associated application information (Linked Application).

[0130] In this application, business data is also referred to as media data or media files, including audio, video, text, etc.

[0131] Figure 1B shows a system architecture diagram applicable to the present application. This architecture includes: a terminal, a virtual image service server (i.e., a first server), and a second server. The second server is used to establish a transmission bridge between the terminal and the virtual image service server, and can transmit user identification, user expression information, etc., which is not specifically limited here. In actual application, there may be N second servers, where N is a positive integer. For example, the second servers may include an uplink server, a downlink server, and an application server. The uplink server is used to forward uplink data (user identification, user expression information, etc.) sent by the terminal to the virtual image service server. The downlink server is used to receive virtual images (i.e., service data) generated by the virtual image service server and forward them to the terminal. The application server is used to forward uplink data (user identification, user expression information, etc.) sent by the terminal to the virtual image service server. The type and function of the second server are not specifically limited here. In actual application, they can be configured according to the specific application situation. The virtual image service can be understood as a digital human service, a virtual space, a virtual animal service, etc., and the virtual image service is not specifically limited here. In addition, the virtual image service server is used to provide the virtual image service, and can be jointly set up with the second server or separately set up with the second server. This application does not specifically limit this.

[0132] The existing DVB standard does not support digital human services, and DVB-I does not support the discovery of digital human services. However, digital services are currently a future development trend. Based on this, this application provides a data processing method to enable the discovery of digital human services through DVB-I. Referring to Figure 2A, this method can be implemented through interaction between a terminal (i.e., a DVB-Client), a service list server (i.e., a Service List Server(s)), and a first server (i.e., a Content / Service provider(s), which can also be an operator, etc., not specifically limited here). Of course, in actual application, other devices may also be involved, which are not specifically limited here. The method is implemented as follows:

[0133] First, the terminal needs to obtain a service list, which can be obtained from a service list server or from other terminals. For example, if terminal A has already obtained and stored the service list, terminal B can request the service list from terminal A. Of course, in actual applications, the terminal may also obtain the service list through other means, which is not specifically limited in this application. Figure 2A takes the example of a terminal obtaining a service list from a service list server as an example.

[0134] In step 201A, the terminal sends a request message to the service list server. The request message is used to request a service list (ie, a list including Service information).

[0135] Specifically, when the terminal resides on the DVB-I Client, it can obtain the service information access entry address from the Service List Registry through the address of the Service List Registry, and then query the service information through the access entry address. In addition, the terminal can also obtain the service information access entry address through configuration.

[0136] The service list in step 201A includes service information for the avatar service. This service information may indicate the service type (e.g., obtaining a digital human), access method (access address, protocol), service provider, etc., and is not specifically limited here. This service information can be configured by the content / service provider based on the service attributes of the avatar service it provides. Content / service providers can configure this service information manually offline or interactively with the service list server, and is not specifically limited here.

[0137] Optionally, the service information includes at least one of the following: service type information indicating the avatar service, service instance information of the avatar service, and associated application information of the avatar service. In specific implementations, a new field can be added to the Service List to indicate this, or a reused field can be used for indication, which is not specifically limited in this application.

[0138] Among them, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human. The instance information of the virtual image service indicates the access address information of the virtual image service, such as the uplink data transmission address, the downlink data (i.e., service data) download address, the address for two-way transmission, etc. The associated application information of the virtual image service, such as if the virtual image service is a digital human service, then the application information associated with the virtual image service can be a digital human application, and the terminal can install the digital human application and access the digital human service based on the application server of the digital human application, etc. The present application can ensure that the DVB system supports the virtual image service by configuring the service type indication information of the virtual image service, the service instance information of the virtual image service, and the associated application information of the virtual image service in the service information, so that the terminal can access the virtual image service and receive the service of the virtual image service.

[0139] Step 202A: The service list server returns the service list to the terminal.

[0140] Step 203A: The terminal accesses the virtual image service provided by the first server according to the service information.

[0141] Next, we will explain how the terminal accesses the virtual image service when the service information includes different information in different situations.

[0142] Case 1: The service information includes virtual image service instance information, and the service instance information includes uplink transmission parameters, and the uplink transmission parameters include destination address information of uplink data.

[0143] The terminal can determine the destination address information of the uplink data based on the uplink transmission parameters. In this example, the destination address information of the uplink data is an uplink server. The terminal sends a first message to the uplink server to request a virtual avatar service. The first message may include information such as a user identifier, a device identifier, user preference information, the user-selected virtual avatar type, and the user-selected language. The user identifier can be understood as the user identifier of the DVB-I client, which can identify the DVB-I client's identity information, network access information, etc. This is merely an example. The device identifier is the identifier or IP address of the device where the DVB-I client resides. User preference information is typically information collected based on the user's historical operating habits or user-set parameters. For example, if a user prefers to watch live sports broadcasts, the Digital Human Server may recommend a digital human wearing sportswear. The user-selected virtual avatar type can be a cartoon-like digital human, for example. The user-selected language can be Chinese, English, Korean, or even sign language. This is merely an example and does not specifically limit the request message.

[0144] The uplink server sends the first message to the digital human server and returns the downlink data download address to the terminal. Since the service instance information does not include the downlink data download address, the downlink data download address is dynamically generated by the uplink server. The uplink server can reply a response message to the terminal, which may include the downlink data download address. The digital human server can feed back the generated digital human video to the downlink data download address. The terminal can request service data such as the digital human video from the download address, thereby realizing access to the digital human service.

[0145] In actual applications, the uplink transmission parameters may also include the transmission protocols supported by the uplink data and the media types supported by the uplink data. By configuring the transmission protocols supported by the uplink data in the uplink transmission parameters, it is possible to determine which protocol to use, for example, to transmit the avatar service request data. By configuring the media types supported by the avatar service request data in the uplink transmission parameters, for example, audio, video, and text, it is possible to determine which media type to use to transmit the avatar service request data.

[0146] In addition, it should be noted that the above-mentioned uplink server can be set up together with the digital human server, or can be set up separately from the digital human server, and this application does not specifically limit this.

[0147] Case 2: The service information includes virtual image service instance information, which includes uplink transmission parameters and service access parameters. The uplink transmission parameters include destination address information of uplink data, and the service access parameters include address information of service data for accessing the virtual image service.

[0148] The terminal can determine the destination address information of the uplink data based on the uplink transmission parameters. In this example, the destination address information of the uplink data is an uplink server. The terminal sends a first message to the uplink server to request the avatar service. The first message may include information such as the user identifier, device identifier, user preference information, user-selected avatar type, and user-selected language. This can be understood by referring to the above scenario 1 and will not be further described here.

[0149] The uplink server sends the first message to the digital human server and returns the downlink data download address to the terminal. Since the business instance information includes the address information of the business data for accessing the virtual image business (i.e., the download address of the downlink data), the digital human server can feedback the generated digital human media file to the address of the business data for accessing the virtual image business. The terminal can request the digital human media file and other business data from the address of the business data for accessing the virtual image business, thereby realizing access to the digital human business.

[0150] In actual application, the uplink transmission parameters may also include the transmission protocol supported by the uplink data and the media type supported by the uplink data. By configuring the transmission protocol supported by the uplink data in the uplink transmission parameters, it is possible to know which protocol is used to transmit the virtual image service request data. By configuring the media type supported by the virtual image service request data, such as audio, video, text, etc., in the uplink transmission parameters, it is possible to know which media type of data is used to transmit the virtual image service request data. The service access parameters also include the transmission protocol supported by the service data, and / or the media type supported by the service data. In this application, by configuring the transmission protocol supported by the service data in the service access parameters, it is possible to know which protocol is used, such as to transmit the virtual image service request data. By configuring the media type supported by the service data, such as audio, video, text, etc., in the service access parameters, it is possible to know which media type of data is used to transmit the virtual image service.

[0151] In addition, it should be noted that the above-mentioned uplink server and the address of the business data for accessing the virtual image business can be set up together with the digital human server, or can be set up separately from the digital human server, and this application does not specifically limit this.

[0152] Case 3: The service information includes virtual image service instance information. The service instance information also includes service access parameters. The service access parameters include address information for accessing service data of the virtual image service.

[0153] The terminal can determine the destination address information of the uplink and downlink data based on the service access parameters (the service access parameters are understood as access parameters for two-way communication, that is, parameters that support both avatar data transmission requests and downloading of avatar service data). The terminal sends a first message to the address of the service data for accessing the avatar service. The first message is used to request the avatar service. The first message may include information such as the user identifier, device identifier, user preference information, user-selected avatar type, and user-selected language. This can be understood by referring to the above situation 1 and will not be repeated here.

[0154] The address of the business data for accessing the virtual image service sends the first message to the digital human server. The digital human server can feedback the generated digital human media file to the address of the business data for accessing the virtual image service. The terminal can request business data such as digital human video from the address of the business data for accessing the virtual image service, thereby realizing access to the digital human service.

[0155] In actual applications, the service access parameters also include the transmission protocols supported by the service data and / or the media types supported by the service data. In this application, by configuring the transmission protocols supported by the service data in the service access parameters, it is possible to know which protocol to use, for example, to transmit the virtual image service request data. By configuring the media types supported by the service data in the service access parameters, such as audio, video, text, etc., it is possible to know which media type to use for data transmission of the virtual image service.

[0156] In addition, it should be noted that the address of the business data for accessing the virtual image business can be set together with the digital human server or separately from the digital human server, and this application does not specifically limit this.

[0157] Case 4: When the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0158] The terminal can activate an application associated with the avatar service installed on the terminal, namely, the Digital Human application, and then send a first message to the application server. This first message is used to request the avatar service. The first message may include information such as the user identifier, device identifier, user preference information, user-selected avatar type, and user-selected language. This can be understood by referring to the above scenario 1 and will not be elaborated here.

[0159] The application server sends the first message to the digital human server and returns the address of the business data for accessing the virtual image service to the terminal. The digital human server can feedback the generated digital human media file to the address of the business data for accessing the virtual image service. The terminal can request business data such as digital human video from the address of the business data for accessing the virtual image service, thereby realizing access to the digital human service.

[0160] In actual applications, the service access parameters also include the transmission protocols supported by the service data and / or the media types supported by the service data. In this application, by configuring the transmission protocols supported by the service data in the service access parameters, it is possible to know which protocol to use, for example, to transmit the virtual image service request data. By configuring the media types supported by the service data in the service access parameters, such as audio, video, text, etc., it is possible to know which media type to use for data transmission of the virtual image service.

[0161] In addition, it should be noted that the above-mentioned application server and the address of the business data for accessing the virtual image business can be set up together with the digital human server, or can be set up separately from the digital human server. This application does not specifically limit this.

[0162] Case 5: Business information includes related application information of virtual image business

[0163] The terminal can activate an application associated with the avatar service installed on the terminal, namely, the Digital Human application, and then send a first message to the application server. This first message is used to request the avatar service. The first message may include information such as the user ID, device ID, user preference information, user-selected avatar type, and user-selected language. This can be understood by referring to the above scenario 1 and will not be further explained here.

[0164] The application server sends the first message to the digital human server, and the digital human server can feed back the generated digital human media file to the application server. The terminal can request business data such as digital human video from the application server, thereby accessing the digital human business.

[0165] In addition, it should be noted that the above-mentioned application server can be set up together with the digital human server, or it can be set up separately from the digital human server, and this application does not specifically limit this.

[0166] For the above cases 1, 2 and 4, the response message to the first message may be the address of the service data for accessing the virtual image service, or may include other information not specifically limited here. For the above cases 3 and 5, there may be no response message to the first message.

[0167] The above-mentioned digital human server can send the digital human media file generated according to the first message as the first service data to the terminal, so that the terminal can perform service playback according to the first service data.

[0168] Furthermore, it should be noted that in Cases 1 through 5 above, although the virtual image service is obtained, in actual use, the user may also interact with the virtual image service in real time, such as requesting a digital human to provide a tourist guide of a certain area. Based on this, the terminal can also send a second message to achieve real-time interaction with the virtual image service. The second message includes user expression information collected by the terminal; the user expression information includes at least one of the following: audio information, video information, and text information. For Cases 1 and 2 above, the second message can be sent by the terminal to the uplink server. For Case 3, the second message can be sent by the terminal to the address for accessing the service data of the virtual image service. For Cases 4 and 5, the second message can be sent by the terminal to the application server. This application does not elaborate on each of these. The response message to the second message is equivalent to the response message to the first message and is not further described here. The digital human server can send the digital human media file generated based on the second message as second service data to the terminal, so that the terminal can play the service based on the second service data.

[0169] In addition, the terminal may send a third message to the address information for accessing the service data of the virtual image service; receive a response message to the third message, the response message including the first service data or the second service data. The terminal may also send a fourth message to the address information for accessing the service data of the virtual image service; receive a response message to the fourth message, the response message including a media presentation description file, such as an MPD file, for the virtual image service; and the terminal requests the first service data or the second service data based on the media presentation description file.

[0170] In addition, it should be noted that in actual application, the digital human server may not receive any message from the terminal. The digital human server can directly generate a digital human and push it to the terminal. In actual application, this application does not specifically limit this.

[0171] In this application, the terminal can obtain the service information of the virtual image service from the service list server of the DVB system, and request the virtual image service from the device associated with the virtual image service person according to the service information, thereby achieving the purpose of accessing the virtual image service. In this way, the terminal can obtain the virtual image service.

[0172] Referring to FIG. 2B , the process can be performed through interaction between a terminal (i.e., a DVB-Client), a service list server (i.e., a Service List Server(s)), and a first server (i.e., a Content / Service provider(s), which may also be an operator, etc., not specifically limited here). In actual application, other devices may also be involved, which are not specifically limited here. The process is performed as follows:

[0173] Step 201B: The terminal obtains a service list from a service list server. The service list includes service information of the virtual image service.

[0174] This can be understood by referring to the above step 201A, and will not be explained in detail here.

[0175] Step 202B: The terminal sends first information to the first server of the virtual image service according to the service information, where the first information is used to request the virtual image service.

[0176] It should be noted that the content of the first information is the same as the content contained in the first message in Figure 2A above. Since the terminal and the first server may not interact directly, a second server may be required as an intermediary. Therefore, the terminal may send the first message to the second server, which then processes the message and sends it to the first server. The two messages are different, but the information carried by the two messages is the same, which are user identification, device identification, user preference information, user-selected virtual image type, user-selected language and other information.

[0177] Step 203B: The first server generates first business data of the virtual image business according to the first information.

[0178] Step 204B: The first server provides first service data to the terminal.

[0179] In an optional manner, the first server may save the first business data, wherein the first address for saving the first business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal (such as the second server for transmitting business data, or a location in the first service which is not specifically limited here); the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the first business data.

[0180] In an optional manner, the first server may save a media presentation file generated when the first business data is fragmented, wherein the second address of the media presentation file corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal. The first server also saves the fragments of the first business data, wherein the third address of the fragments for saving the first business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, and the response message includes a media presentation description file; the terminal requests the first business data based on the media presentation description file.

[0181] In an optional manner, the first server may save the first business data, wherein the fourth address of saving the first business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0182] Step 205B: The terminal plays the service according to the first service data.

[0183] The above steps 202B to 205B can be understood as the processing flow of the avatar service request stage. After obtaining the avatar service, the user may interact with the avatar in real time, such as through text, video, audio, etc., which can be performed through the following steps:

[0184] Step 206B: The terminal sends second information to the first server of the virtual image service according to the service information, wherein the second information includes the user expression information collected by the terminal.

[0185] It should be noted that the content of the second information is the same as the content contained in the second message in Figure 2A above. Since the terminal and the first server may not interact directly, the second server may be required as an intermediary. Therefore, the terminal may send the second message to the second server, which is then processed by the second server and sent to the first server. The two messages are different, but the information carried by the two messages is the same, which is user identification, device identification, user preference information, user-selected virtual image type, user-selected language and other information.

[0186] Step 207B: The first server generates second service data of the virtual image service according to the second information.

[0187] Step 208B: The first server provides the second service data to the terminal.

[0188] In an optional manner, the first server may save the second business data, wherein the first address for saving the second business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal (such as the second server for transmitting business data, or a location in the first service, which is not specifically limited here); the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the second business data.

[0189] In an optional manner, the first server may save a media presentation file generated when the second business data is fragmented, wherein the second address of the media presentation file corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal. The first server also saves the fragments of the second business data, wherein the third address of the fragments for saving the second business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including the media presentation description file; the terminal requests the second business data based on the media presentation description file.

[0190] In an optional manner, the first server may save the second business data, wherein the fourth address of saving the second business data corresponds to the address information of the business data for accessing the virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0191] Step 209B: The terminal plays the service according to the second service data.

[0192] In order to better illustrate the solution of this application, the following four specific examples are used to illustrate the solution, which are executed as follows:

[0193] In Example 1, a DVB-I client obtains service type information and service instance information for a virtual avatar service from a service list. Based on the service instance information, the client exchanges user selection and user expression information with an uplink server. The uplink server then transmits the user selection and user expression information to the virtual avatar service server. The virtual avatar service server generates media data associated with the virtual avatar service and feeds it back to the DVB-I client.

[0194] Specifically, Figure 3 illustrates the data interaction between a DVB-I client, a Service List Server, a Stream Server, an MPD Server, a Playlist Server, an Uplink Server, and a Digital Human Server. When adaptive bitrate is used to send media data, the Stream Server stores media segment information for the avatar service, such as video segments and audio segments. Video segments can be understood as time-based segments or image-frame-based segments of a video; audio segments can be understood as audio-frame-based segments of an audio segment. The MPD Server stores MPD file information corresponding to the media segments, which contains the addresses of the media segments. The MPD Server address template can be indicated by: https: / / cdn.example.com / digitalhuman_$userid / dash / manifes.mpd or https: / / cdn.example.com / digitalhuman_$ipaddress / dash / manifes.mpd. In the above-mentioned MPD Server address template, $userid and $ipaddress can be replaced with the user identifier and the IP address of the DVB-I Client. This application is only used for illustrative purposes and does not specifically limit the form of the MPD Server address template. When progressive download is adopted, the Playlist Server is used to store media data of the virtual image service. The Uplink Server is the destination address of the uplink data. When other streaming media formats send media data, the Stream Server sends the media data while receiving the uplink data. Digital Human Server is the address of the virtual image service provider, and Digital Human Server belongs to the Service Provider. In specific implementation, the above servers can be set up together or separately. Figure 3 takes the virtual image service as a digital human as an example for illustration.

[0195] Step 300: Configure the service list.

[0196] In an optional embodiment, the Service Provider is manually configured offline, such as by configuring the service list through a Digital Human Server. In another optional embodiment, the Service Provider management function interacts with the Service List Server to configure the service list. This application does not specifically limit how to configure the service list.

[0197] Table 1 below shows a list of services applicable to this first embodiment, where Service Type indicates that the avatar service is a digital human. Furthermore, the avatar service can be 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, or sign language digital human. Service Genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (i.e., service instance information) include supported digital human types, uplink transmission parameters, and service access parameters (i.e., the download address for the service data). The Digital Human Type parameter indicates the digital human service type supported by the Service Instance and can be a further refinement of Service Type, such as 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, sign language digital human, etc. UplinkDeliveryParameters includes at least one of the following information: the destination address URI of the uplink data, the transmission protocol supported by the uplink data (e.g., HTTP, SRT, RTMP, WebSocket, etc.), and the media type supported by the uplink data, such as video, voice, or text. (Information not provided can be determined by standardized definition or configuration) Service access parameters include the access address information of the digital human's service data (the address of the MPD file on the MDP Server (adaptive bitrate transmission) or the address of the media file on the Playlist Server (progressive transmission)), the transmission protocol supported by the service data, and the service data download delay information (such as waiting 100 milliseconds to download the service data after sending the uplink data).

[0198] Table 1

[0199] Step 301: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0200] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information based on the service type information, without having to feed all service lists back to the DVB-I Client. This approach can improve data processing efficiency.

[0201] Step 302: The Service list server returns a response message to the DVB-I client.

[0202] If the request message in step 301 does not include a service type, the response message includes the service list information configured in step 300 ; if the request message in step 301 includes a service type, the hard response message includes the service list information corresponding to the service type in step 301 .

[0203] Step 303: The DVB-I Client presents user prompt information according to the service list information.

[0204] Specifically, the user prompt information can prompt the user to select a specific virtual image service, such as "Please select a virtual image service type", or can prompt the user to select a specific service type of a virtual image service, such as "Welcome to use the digital human service, please select the digital human service type 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human, etc. This is only an example and not a specific limitation.

[0205] Step 304: The DVB-I Client sends a request message to the Uplink Server according to the destination address URI of the uplink data and the supported transmission protocol.

[0206] Optionally, the request message includes one or more of a user identifier, a device identifier, user preference information, a user-selected avatar type, and a user-selected language. The user identifier can be understood as the user identifier of the DVB-I Client, which can identify the DVB-I Client's identity information, network access information, etc., and is provided for illustrative purposes only. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. User preference information is typically collected based on the user's historical operating habits or user-set parameters. For example, if a user prefers to watch live sports broadcasts, the Digital Human Server may recommend a digital human wearing sportswear. The user-selected avatar type can be a cartoon-like digital human, for example. The user-selected language can be Chinese, English, Korean, etc., and can also be sign language. This is provided for illustrative purposes only and does not specifically limit the request message. If the user selects sign language, the media type is generally video or text.

[0207] Step 305: The Uplink Server returns a response message to the DVB-I Client. Optionally, the response message includes download address information of the digital human's service data.

[0208] If the service list information does not include the download address information URI of the digital human's service data and the MPD Server address template, the Uplink Server can dynamically generate a URI and feed the dynamically generated URI as the download address of the digital human's service data to the DVB-I Client.

[0209] Step 306: The Uplink Server sends a message to the Digital Human Server.

[0210] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 304. If a URI is dynamically generated in step 305, the message also includes the URI.

[0211] Step 307: The Digital Human Server generates a digital human image media file based on the received information.

[0212] Specifically, the Digital Human Server can determine whether to authorize the generation of a customized digital human image based on the user's contract information. For example, if user A has signed a contract with a carrier for the use of digital human services, or if user A has signed a contract with a digital human service provider for the use of digital human services, the Digital Human Server can determine authorization to generate a customized digital human image based on user A's contract information. Furthermore, the Digital Human Server can generate a digital human image that meets the user's preferences based on the user's preferences. For example, if the user likes anime, a cartoon-like digital human image can be generated.

[0213] In step 308, if the service data download adopts the adaptive bit rate mode, the Digital Human Server segments the media file and generates an MPD file, and then sends the MPD file to the MPD Server.

[0214] The address of the MPD in the MPD Server is the URI carried in the message sent in step 306 above.

[0215] In step 309, the Digital Human Server sends the generated media file segments to the Stream Server, and the saved addresses are the addresses described in the MPD file.

[0216] Step 310: The DVB-I Client sends a request to the MPD server to obtain the MPD file. Optionally, the DVB-I Client can determine the time to send the request based on the service data download delay information.

[0217] Step 311: The DVB-I Client sends a request to the Stream Server according to the MPD file to obtain media file segments.

[0218] Step 312: The DVB-I Client plays the acquired media segments.

[0219] In addition, it should be noted that if the service data is downloaded progressively, the Digital Human Server can directly generate media files and send them to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-I Client sends a request message to the Playlist Server to obtain service data.

[0220] The following steps will be repeated until the user ends the Digital Human service.

[0221] Step 313: The DVB-I Client collects user expression information.

[0222] The user expression information includes at least one of the following: audio information, video information, and text information. The device hosting the DVB-I Client may use a camera or microphone to capture the user expression information. Optionally, the DVB-I Client may locally analyze the user input and convert the user's audio and video information into text information as the user's expression information.

[0223] Step 314: The DVB-I Client sends the collected user expression information to the Uplink Server.

[0224] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0225] In step 315 , the Uplink Server sends the received user expression information to the Digital Human Server.

[0226] In step 316, if the received data is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0227] After performing semantic analysis, the Digital Human Server generates a response text (requiring support from a large language model). This response text drives the Digital Human model to generate media files. If the media data is sent using adaptive bitrate, the Digital Human Server segments the media file.

[0228] In step 317 , if the MPD file is in the timeline format, the Digital Human Server sends the updated MPD file to the MPD file.

[0229] If the MPD file is in Template format, step 317 does not need to be executed.

[0230] In step 318, the Digital Human Server sends the media segments to the Stream Server.

[0231] In step 319, if the MPD file is in the timeline format, the DVB-I Client requests the MPD Server for an updated MPD file, and the MPD Server returns the updated MPD file.

[0232] If the MPD file is in Template format, step 319 does not need to be executed.

[0233] Step 320: The DVB-I Client sends a request message to the Stream Server to obtain media segments according to the MPD file.

[0234] Step 321: The DVB-I Client plays the acquired media segments.

[0235] In addition, it should be noted that if the service data is downloaded progressively, the Digital Human Server can directly generate the Digital Human media file and send it to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-I Client sends a request message to the Playlist Server to obtain the service data.

[0236] In a second embodiment, a DVB-I client obtains service type information, service instance information, and application information associated with the avatar service from a service list. DVB-I activates the application associated with the avatar service. The application exchanges user selection information and user expression information with an application server, which then transmits the user selection information and user expression information to the avatar service server. The avatar service server generates media data associated with the avatar service and provides it to the DVB-I client.

[0237] Specifically, Figure 4 illustrates the data interaction between a DVB-I client, a Service List Server, a Stream Server, a Playlist Server, an MPD Server, an Application Server, and a Digital Human Server. When adaptive bitrate is used to send media data, the Stream Server stores media segment information for the avatar service, such as video segments and audio segments. Video segments can be understood as multiple segments of a video divided by time or by image frames; audio segments can be understood as multiple segments of an audio segment divided by audio frames. The MPD Server stores MPD file information corresponding to the media segments, which contains the addresses of the media segments. The MPD Server address template can be indicated by: https: / / cdn.example.com / digitalhuman_$userid / dash / manifes.mpd or https: / / cdn.example.com / digitalhuman_$ipaddress / dash / manifes.mpd. In the above-mentioned MPD Server address template, $userid and $ipaddress can be replaced with the user identifier and the IP address of the DVB-I Client. This application is only used for illustrative purposes and does not specifically limit the form of the MPD Server address template. When progressive download is adopted, the Playlist Server is used to store media data for the virtual image service. In addition, the address template of the media data is https: / / cdn.example.com / digitalhuman_$userid / dash / , or https: / / cdn.example.com / digitalhuman_$ipaddress / dash. The Uplink Server is the destination address of the uplink data. When other streaming media formats send media data, the UL / DL Stream Server sends the media data while receiving the uplink data. The Digital Human Server is the address of the virtual image service provider, and the Digital Human Server belongs to the Service Provider. In specific implementation, the Uplin Server and the Digital Human Server can be set up together or separately. The Application Server is the destination address of the uplink data. Figure 4 uses the virtual image service of a digital human as an example for explanation.

[0238] Step 400: Configure the service list.

[0239] In an optional embodiment, the Service Provider is manually configured offline, such as by configuring the service list through a Digital Human Server. In another optional embodiment, the Service Provider management function interacts with the Service List Server to configure the service list. This application does not specifically limit how to configure the service list.

[0240] Table 2 below shows a list of services applicable to the second embodiment, in which Service Type indicates that the virtual image service is a digital human. Further, the virtual image service can be indicated as a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, or a sign language digital human. The service genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (that is, service instance information) include supported digital human types and service access parameters. The Digital human type parameter indicates the indication information of the digital human service type supported by the Service Instance, such as a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, or a sign language digital human. Linked Application indicates the associated application information of the virtual image service, such as an application that supports digital humans, which only supports uplink data transmission. The service access parameters include the download address information of the digital human's service data (the address of the MPD file on the MDP Server (adaptive bitrate transmission) or the address of the media file on the Playlist Server (progressive transmission)), the transmission protocols supported by the service data (such as HTTP, SRT, RTMP, WebSocket, etc.), and the service data download delay information (such as waiting 100 milliseconds to download the service data after sending the uplink data).

[0241] Table 2

[0242] Step 401: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0243] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information based on the service type information, without having to feed all service lists back to the DVB-I Client. This approach can improve data processing efficiency.

[0244] Step 402: The Service list server returns a response message to the DVB-I client.

[0245] If the request message in step 401 does not include a service type, the response message includes the service list information configured in step 400; if the request message in step 401 includes a service type, the hard response message includes the service list information corresponding to the service type in step 401.

[0246] Step 403: The DVB-I Client presents user prompt information according to the service list information.

[0247] This can be understood by referring to the above step 303 and will not be described in detail here.

[0248] Step 404: The DVB-I Client activates the associated digital human application.

[0249] Step 405: The DVB-I Client sends a request message to the Application Server.

[0250] The information in the request message may be determined by referring to the above step 304, which will not be described in detail here.

[0251] Step 406: The Application Server returns a response message to the DVB-I Client. Optionally, the response message includes download address information of the digital human's service data.

[0252] If the service list information does not include the URI for downloading the digital person's service data, i.e., the address template of the MPD file on the MPD Server or the address template of the media file on the Playlist Server, the Application Server can dynamically generate a URI and feed the dynamically generated URI back to the DVB-I Client as the download address for the digital person's service data.

[0253] Step 407: The Application Server sends a message to the Digital Human Server.

[0254] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 405. If a URI is dynamically generated in step 406, the message also includes the URI.

[0255] Step 408: The Digital Human Server generates a media file of the digital human image based on the received information.

[0256] Specifically, the Digital Human Server can determine whether to authorize the generation of a customized Digital Human image based on the user's contract information. For example, if User A has signed a contract with a carrier for the use of Digital Human services, or if User A has signed a contract with a Digital Human service provider for the use of Digital Human services, the Digital Human Server can determine authorization to generate a customized Digital Human image based on User A's contract information. Furthermore, the Digital Human Server can generate a Digital Human image that meets the user's preferences based on the user's preferences. For example, if the user likes anime, a cartoon Digital Human image can be generated.

[0257] In step 409, if the service data download adopts the adaptive bit rate mode, the Digital Human Server segments the generated media file and generates an MPD file, and the Digital Human Server sends the MPD file to the MPD Server.

[0258] The address where the MPD file is stored is the URI carried in the message sent in step 407.

[0259] In step 410, the Digital Human Server sends the generated media segments to the Stream Server, and the saved address is the address described in the MPD file.

[0260] Step 411: The DVB-I Client sends a request to the MPD server to obtain the MPD file.

[0261] Step 412: The DVB-I Client sends a request to the Stream Server according to the MPD file to obtain media file segments.

[0262] Step 413: The DVB-I Client plays the acquired media segments.

[0263] In addition, it should be noted that if the service data download method is progressive, the Digital Human Server can directly generate the Digital Human media file and send it to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-I Client sends a request message to the Playlist Server to obtain the service data.

[0264] The following steps will be repeated until the user ends the Digital Human service.

[0265] Step 414: The Digital Human application collects user expression information.

[0266] The user's expression information includes at least one of the following: audio information, video information, and text information. The DVB-I Client can capture the user's expression information using a camera or microphone via a resident device. Optionally, the Digital Human application can analyze the user's input locally and convert the user's expression information into text.

[0267] In step 415, the Digital Human application sends the collected user expression information to the Application Server.

[0268] Of course, the digital human application can also decide whether to convert user expression information into text based on the current network conditions.

[0269] In step 416, the Digital Human application sends the received user expression information to the Digital Human Server.

[0270] In step 417, if the received data is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0271] After performing semantic analysis, the Digital Human Server generates a response text (requiring support from a large language model). This response text drives the Digital Human model to generate media files. If adaptive bitrate is used to send business data, the media files are segmented.

[0272] In step 418, if the MPD file is in the timeline format, the Digital Human Server sends the updated MPD file to the MPD server.

[0273] If the MPD file is in Template format, step 418 does not need to be executed.

[0274] Step 419: The Digital Human Server sends the media segments to the Stream Server.

[0275] In step 420, if the MPD file is in the timeline format, the DVB-I Client requests the updated MPD file from the MPD Server, and the MPD Server returns the updated MPD file.

[0276] If the MPD file is in Template format, step 420 does not need to be executed.

[0277] Step 421: The DVB-I Client sends a request message to the Stream Server to obtain media segments according to the MPD file.

[0278] Step 422: The DVB-I Client plays the acquired media segments.

[0279] In addition, it should be noted that if the service data download method is progressive, the Digital Human Server can directly generate the Digital Human media file and send it to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-I Client sends a request message to the Playlist Server to obtain the service data.

[0280] In a third embodiment, a DVB-I client obtains service type information and service instance information for a virtual avatar service from a service list. Based on the service instance information, the client exchanges user selection information and user expression information with an uplink and downlink server (a server supporting bidirectional communication). The uplink and downlink servers then transmit the user selection information and user expression information to the virtual avatar service server. The virtual avatar service server generates media data associated with the virtual avatar service and provides it to the DVB-I client.

[0281] Specifically, Figure 5 illustrates the data exchange between a DVB-I client, a Service List Server, a UL / DL Stream Server, and a Digital Human Server. The UL / DL Stream Server mediates message exchange between the DVB-I client and the Digital Human Server. The Digital Human Server is the address of the avatar service provider, and the Digital Human Server belongs to the Service Provider. Figure 5 uses a digital human as an example.

[0282] Step 500: Configure the service list.

[0283] In an optional embodiment, the Service Provider is manually configured offline, such as by configuring the service list through a Digital Human Server. In another optional embodiment, the Service Provider management function interacts with the Service List Server to configure the service list. This application does not specifically limit how to configure the service list.

[0284] Table 3 below shows a list of services applicable to this embodiment three, where Service Type indicates that the virtual image service is a digital human, and the service genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (that is, service instance information) include supported digital human types and bidirectional transmission parameters (that is, service access parameters, understood here as bidirectional communication access parameters). The Digital human type parameter represents the indication information of the digital human service type supported by the Service Instance, such as 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, sign language digital human, etc. BidirectionalDeliveryParameters includes bidirectional transmission parameters, the destination address URI of the uplink and downlink data, supported transmission protocols (such as HTTP, SRT, RTMP, WebSocket, etc.) and supported media types, including video, voice or text.

[0285] Table 3

[0286] Step 501: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0287] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information based on the service type information, without having to feed all service lists back to the DVB-I Client. This approach can improve data processing efficiency.

[0288] Step 502: The Service list server returns a response message to the DVB-I client.

[0289] If the request message in step 501 does not include a service type, the response message includes the service list information configured in step 500; if the request message in step 501 includes a service type, the hard response message includes the service list information corresponding to the service type in step 501.

[0290] Step 503: The DVB-I Client presents user prompt information according to the service list information.

[0291] Specifically, the user prompt information can prompt the user to select a specific virtual image service, such as "Please select a virtual image service type", or it can prompt the user to select a specific service type of a virtual image service, such as "Welcome to the digital human service, please select the digital human service type 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human, etc." This is only an example and not a specific limitation.

[0292] Step 504: The DVB-I Client sends a request message to the UL / DL Server according to the access address information of the service data and the supported transmission protocol.

[0293] Optionally, the request message includes a user identifier, a device identifier, user preference information, a user-selected avatar type, and a user-selected language. The user identifier can be understood as the identifier of the DVB-I Client, which can identify the DVB-I Client's identity information, network access information, etc. This is merely an example. User preference information is typically collected based on the user's historical operating habits. For example, if a user likes to watch live sports broadcasts, the Digital Human Server can recommend a digital human wearing sportswear. The user-selected avatar type can be a cartoon-like digital human, etc. The user-selected language can be Chinese, English, Korean, etc. This is merely an example and does not specifically limit the request message.

[0294] Step 505: The UL / DL Stream Server sends a message to the Digital Human Server.

[0295] This message includes the information received from the DVB-I Client, ie, the content of the request message in step 504 .

[0296] Step 506: The Digital Human Server generates a digital human image media file (such as a video) based on the received information.

[0297] Specifically, the Digital Human Server can determine whether to authorize the generation of a customized digital human image based on the user's contract information. For example, if user A has signed a contract with a carrier for the use of digital human services, or if user A has signed a contract with a digital human service provider for the use of digital human services, the Digital Human Server can determine authorization to generate a customized digital human image based on user A's contract information. Furthermore, the Digital Human Server can generate a digital human image that meets the user's preferences based on the user's preferences. For example, if the user likes anime, a cartoon-like digital human image can be generated.

[0298] In step 507, the Digital Human Server sends the generated digital human image media file to the UL / DL Stream Server.

[0299] Step 508: The UL / DL Stream Server sends the digital human image media file (eg, video) to the DVB-I Client.

[0300] Step 509: The DVB-I Client plays the acquired digital human image media file.

[0301] The following steps will be repeated until the user ends the Digital Human service.

[0302] Step 510: The user interacts with the DVB-I Client through user expression information.

[0303] The user's expression information includes at least one of the following: audio information, video information, and text information. The DVB-I Client can use a camera or microphone to capture the user's expression information. The DVB-I Client can analyze the user input locally and convert the user's expression information into text.

[0304] Step 511: The DVB-I Client sends the converted text of the collected user expression information to the UL / DL Stream Server.

[0305] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0306] In step 512, the UL / DL Stream Server sends the received user expression information to the Digital Human Server.

[0307] In step 513, if the received data is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0308] After performing semantic analysis, the Digital Human Server generates a response text (which requires support from a large language model). The response text drives the Digital Human model, generates media files, and performs media segmentation.

[0309] Step 514: The Digital Human Server sends the generated media file (eg, video) to the UL / DL Stream Server.

[0310] Specifically, the media file can be understood as a media file associated with the user's expression information. For example, if the user's expression information is to obtain an explanation of a certain scenic spot, the media file can be a video of the digital human obtained in step 509 explaining the scenic spot. If the user's expression information is to obtain a cartoon-like digital human, if the digital human obtained in step 509 is not a cartoon-like digital human, the digital human in step 509 can be re-dressed or otherwise processed based on the user's expression information to generate a cartoon-like digital human.

[0311] Step 515: The UL / DL Stream Server sends the generated media file (eg, video) to the DVB-I Client.

[0312] Step 516: The DVB-I Client plays the received media file (eg, video).

[0313] In a fourth embodiment, a DVB-I client obtains service type information indicating a virtual avatar service and the application associated with the virtual avatar service from a service list. DVB-I activates the application associated with the virtual avatar service. The application exchanges user selection and user expression information with an application server, which then transmits the user selection and user expression information to the virtual avatar service server. The virtual avatar service server generates media data related to the virtual avatar service and feeds it back to the DVB-I client.

[0314] Specifically, please refer to Figure 6 for an explanation, which uses the data interaction between the DVB-I client, Service List Server, Application Server, and Digital Human Server as an example. The Digital Human Server belongs to the Service Provider. Figure 6 uses the virtual image service of Digital Human as an example to illustrate.

[0315] Step 600: Configure the service list.

[0316] In an optional embodiment, the Service Provider is manually configured offline, such as by configuring the service list through a Digital Human Server. In another optional embodiment, the Service Provider management function interacts with the Service List Server to configure the service list. This application does not specifically limit how to configure the service list.

[0317] Table 4 below shows a list of services applicable to this fourth embodiment. The Service Type indicates that the avatar service is a digital human. Furthermore, the avatar service can be 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, or sign language digital human. The Service Genre indicates the service type of the digital human, such as sightseeing and dining. The Linked Application indicates the associated application information of the avatar service, such as an application that supports digital humans and supports uplink data transmission and the acquisition and playback of service data.

[0318] Table 4

[0319] Step 601: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0320] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information based on the service type information, without having to feed all service lists back to the DVB-I Client. This approach can improve data processing efficiency.

[0321] Step 602: The Service list server returns a response message to the DVB-I client.

[0322] If the request message in step 601 includes a service type, the response message includes service list information corresponding to the service type in step 601 .

[0323] Step 603: The DVB-I Client presents user prompt information according to the service list information.

[0324] This can be understood by referring to the above step 303 and will not be described in detail here.

[0325] Step 604: The DVB-I Client activates the associated digital human application.

[0326] Step 605: The DVB-I Client sends a request message to the Application Server.

[0327] The information in the request message may be determined by referring to the above step 304, which will not be described in detail here.

[0328] Step 606: The Application Server sends a message to the Digital Human Server.

[0329] This message includes the information received from the DVB-I Client, ie, the content of the request message in step 605 .

[0330] Step 607: The Digital Human Server generates a digital human image media file based on the received information.

[0331] Specifically, the Digital Human Server can determine whether to authorize the generation of a customized digital human image based on the user's contract information. For example, if user A has signed a contract with a carrier for the use of digital human services, or if user A has signed a contract with a digital human service provider for the use of digital human services, the Digital Human Server can determine authorization to generate a customized digital human image based on user A's contract information. Furthermore, the Digital Human Server can generate a digital human image that meets the user's preferences based on the user's preferences. For example, if the user likes anime, a cartoon-like digital human image can be generated.

[0332] Step 608: The Digital Human Server sends the generated digital human image media file to the Application Server.

[0333] Step 609: The Application Server sends the digital human image media file to the application.

[0334] Step 610: The application plays the digital human image media file.

[0335] The following steps will be repeated until the user ends the Digital Human service.

[0336] Step 611: The Digital Human application collects the user's expression information.

[0337] The user's expression information includes at least one of the following: audio information, video information, and text information. The DVB-I Client can use a camera or microphone to capture the user's expression information. The Digital Human application can analyze the user input locally and convert the user's expression information into text.

[0338] In step 612, the Digital Human application sends the text converted from the collected user expression information to the Application Server.

[0339] Of course, the digital human application can also decide whether to convert user expression information into text based on the current network conditions.

[0340] In step 613, the Application Server sends the received user expression information to the Digital Human Server.

[0341] In step 614, if the received data is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0342] After performing semantic analysis, the Digital Human Server generates a reply text (which requires support from a large language model). The reply text drives the Digital Human model and generates media files.

[0343] Step 615: The Digital Human Server sends the generated media file to the Application Server.

[0344] Specifically, the media file can be understood as a media file associated with the user's expression information. For example, if the user's expression information is to obtain an explanation of a certain scenic spot, the video can be a video of the digital human obtained in step 610 explaining the scenic spot. If the user's expression information is to obtain a cartoon-like digital human, if the digital human obtained in step 610 is not a cartoon-like digital human, the digital human in step 610 can be re-dressed or otherwise processed based on the user's expression information to generate a cartoon-like digital human.

[0345] Step 616: The Application Server sends the generated media file to the application.

[0346] Step 617: The application plays the received media file.

[0347] In Example 5, a DVB-I client obtains service type information and service instance information for a virtual avatar service from a service list. Based on the service instance information, the client exchanges user selection and user expression information with an uplink server. The uplink server then transmits the user selection and user expression information to the virtual avatar service server. The virtual avatar service server generates media data related to the virtual avatar service and feeds it back to the DVB-I client.

[0348] Specifically, please refer to Figure 7 for understanding, which uses the data interaction among the DVB-I client, Service List Server, Uplink Server, Downlink Server, and Digital Human Server as an example. Figure 7 uses the virtual image service of Digital Human as an example for explanation.

[0349] Step 700: Configure the service list.

[0350] In an optional embodiment, the Service Provider is manually configured offline, such as by configuring the service list through a Digital Human Server. In another optional embodiment, the Service Provider management function interacts with the Service List Server to configure the service list. This application does not specifically limit how to configure the service list.

[0351] Table 5 below shows a list of services applicable to this fifth embodiment, where the Service Type indicates that the avatar service is a digital human. Furthermore, the Service Type can be further refined to indicate avatar services such as 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, or sign language digital human. The Service Genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (i.e., service instance information) include supported digital human types, uplink transmission parameters, and service access parameters (i.e., the download address for the service data). If the Service Type only indicates digital human, the Digital Human Type parameter indicates the digital human service type supported by the Service Instance and can be a further refinement of the Service Type, such as 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, sign language digital human, etc. UplinkDeliveryParameters includes at least one of the following information: the destination address URI of the uplink data, the transmission protocols supported by the uplink data (e.g., HTTP, SRT, RTMP, WebSocket, etc.), and the media types supported by the uplink data, such as video, voice, or text. (If this information is not provided, it can be determined by standardized definitions or configuration.) Service access parameters include the access address information for the digital human's service data (a template for the downstream streaming address, such as https: / / cdn.example.com / digitalhuman_$userid / RTMP / ) and the transmission protocols supported by the service data. The ContentAttribute indicates the languages ​​supported by the digital human service, such as Chinese, English, and Chinese Sign Language.

[0352] Table 5

[0353] Step 701: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0354] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information based on the service type information, without having to feed all service lists back to the DVB-I Client. This approach can improve data processing efficiency.

[0355] Step 702: The service list server returns a response message to the DVB-I client, the response message including a service list including the service information in Table 1.

[0356] If the request message in step 701 includes a service type, the hard answer message only includes the service list information corresponding to the service type in step 701 .

[0357] Step 703: The DVB-I Client presents information of each service included in the service list to the user according to the service list.

[0358] Specifically, the information presented may prompt the user to select a specific avatar service, such as the avatar service type, service provider, and genre of the avatar service. Specifically, the avatar service types may include 2D digital humans, 3D digital humans, cartoon digital humans, real-life digital humans, customized digital humans, and sign language digital humans, etc. These are merely illustrative and not limiting.

[0359] Step 704: The DVB-I Client sends a request message to the Uplink Server according to the destination address URI of the uplink data and the supported transmission protocol.

[0360] Optionally, the request message includes one or more of a user identifier, a device identifier, user preference information, a user-selected virtual image type, and a user-selected language. The user identifier can be understood as the user identifier of the DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client. This is merely an example. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. User preference information is typically information collected based on the user's historical operating habits or user-set parameters. For example, if a user likes to watch live sports broadcasts, the Digital Human Server can recommend a digital human wearing sportswear. The user-selected virtual image type can be a cartoon digital human, etc. The user-selected language can be Chinese, English, Korean, etc., and can also be Chinese sign language. This is merely an example and does not specifically limit the request message.

[0361] Step 705: The Uplink Server returns a response message to the DVB-I Client. Optionally, the response message includes access address information of the digital human's service data.

[0362] If the service list information does not include the access address information URI and address template of the digital person's service data, the Uplink Server can dynamically generate a URI and feed the dynamically generated URI back to the DVB-I Client as the download address of the digital person's service data.

[0363] Step 706: The DVB-I Client sends a request message to the Downlink Server according to the address template or the address information received in the response message to establish a persistent transmission connection.

[0364] Step 707: Downlink Server returns a response message to DVB-I Client.

[0365] Step 708: The Uplink Server sends a message to the Digital Human Server.

[0366] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 304. In addition, the message also includes the address confirmed according to the address template or the address URI generated in step 705.

[0367] Step 709: The Digital Human Server generates a digital human image media file based on the received information.

[0368] Specifically, the Digital Human Server can determine whether to authorize the generation of a customized digital human image based on the user's contract information. For example, if user A has signed a contract with a carrier for the use of digital human services, or if user A has signed a contract with a digital human service provider for the use of digital human services, the Digital Human Server can determine authorization to generate a customized digital human image based on user A's contract information. Furthermore, the Digital Human Server can generate a digital human image that meets the user's preferences based on the user's preferences. For example, if the user likes anime, a cartoon-like digital human image can be generated.

[0369] Step 710: The Digital Human Server sends the media file to the Downlink Server. The message also includes the received address information.

[0370] In step 711, the Downlink Server determines a connection to be established based on the address information, and sends the media file to the DVB-I Client through the connection.

[0371] Step 712: The DVB-I Client plays the acquired media segments.

[0372] The following steps will be repeated until the user ends the Digital Human service.

[0373] Step 713: The DVB-I Client collects user expression information.

[0374] The user expression information includes at least one of the following: audio information, video information, and text information. The device hosting the DVB-I Client may use a camera or microphone to capture the user expression information. Optionally, the DVB-I Client may locally analyze the user input and convert the user's audio and video information into text information as the user's expression information.

[0375] Step 714: The DVB-I Client sends the collected user expression information to the Uplink Server.

[0376] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0377] Step 715: The Uplink Server sends the received user expression information to the Digital Human Server.

[0378] In step 716, the Digital Human Server generates a media file based on the expression information. If the received information is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0379] After performing semantic analysis, the Digital Human Server generates a reply text (which requires support from a large language model). The reply text drives the Digital Human model and generates media files.

[0380] Step 717: The Digital Human Server sends the media file to the Downlink Server.

[0381] Step 718: The Downlink Server sends the media file to the DVB-I Client through the established connection.

[0382] Step 719: The DVB-I Client plays the acquired media file.

[0383] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of device interaction. It is understandable that, in order to implement the above functions, each device may include a hardware structure and / or software module that performs each function. Those skilled in the art should easily appreciate that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0384] In the embodiments of the present application, the functional units of the device can be divided according to the above method examples. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional units.

[0385] In the case of adopting an integrated unit, Figure 8 shows a possible exemplary block diagram of the data processing device involved in the embodiments of the present application. As shown in Figure 8, the data processing device 800 may include: a processing unit 801 and a transceiver unit 802. The processing unit 801 is used to control and manage the actions of the data processing device 800. The transceiver unit 802 is used to support communication between the data processing device 800 and other devices. Optionally, the transceiver unit 802 may include a receiving unit and / or a sending unit, which are used to perform receiving and sending operations respectively. Optionally, the data processing device 800 may also include a storage unit for storing program code and / or data of the data processing device 800. The transceiver unit can be called an input / output unit, a communication unit, etc., and the transceiver unit can be a transceiver; the processing unit can be a processor. When the data processing device is a module (such as a chip) in a communication device, the transceiver unit can be an input / output interface, an input / output circuit, or an input / output pin, etc., and can also be called an interface, a communication interface, or an interface circuit, etc.; the processing unit can be a processor, a processing circuit, or a logic circuit, etc. Specifically, the device may be the aforementioned terminal and the first server of the service provider, etc.

[0386] In one embodiment, the data processing device is a terminal, wherein the transceiver unit 802 is used to obtain a service list including service information of a virtual image service; and the processing unit 801 is used to access the virtual image service according to the service information.

[0387] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0388] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0389] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0390] In an optional manner, the service instance information includes not only the above-mentioned uplink transmission parameters but also service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0391] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0392] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0393] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0394] In an optional manner, the transceiver unit 802 is specifically configured to send a first message according to the service information, where the first message is used to request a virtual image service; and receive a response message to the first message.

[0395] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0396] In an optional manner, the transceiver unit 802 is further configured to send a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; and receive a response message to the second message.

[0397] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0398] In an optional manner, the transceiver unit 802 is further used to receive first business data of the virtual image business, where the first business data is business data generated by the virtual image business server according to the first message; the processing unit 801 is further used to play the business according to the first business data.

[0399] In an optional manner, the transceiver unit 802 is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the second message; the processing unit 801 is further used to play the business according to the second business data.

[0400] In an optional manner, the transceiver unit 802 is further configured to send a third message to the address information of the service data for accessing the virtual image service; and receive a response message to the third message, wherein the response message includes the first service data.

[0401] In an optional manner, the transceiver unit 802 is further used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, and the response message to the fourth message includes a media presentation description file of the virtual image business; the processing unit 801 is further used to request the first business data according to the media presentation description file.

[0402] In an optional manner, when the service information includes application information associated with the avatar service, the processing unit 801 is further configured to activate an application associated with the avatar service.

[0403] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0404] In one embodiment, the data processing device is a first server, wherein the transceiver unit 802 is used to receive first information, and the first information is used to request a virtual image service; the processing unit 801 is used to generate first business data of the virtual image service based on the first information; the transceiver unit 802 is also used to provide the first business data.

[0405] In an optional manner, the first information includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

[0406] In an optional manner, the processing unit 801 is further configured to configure a service list of the service list server, where the service list includes service information of the virtual image service.

[0407] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0408] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0409] In an optional manner, the uplink transmission parameter further includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0410] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0411] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0412] In an optional manner, when the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0413] In an optional manner, the service access parameter further includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0414] In an optional manner, the transceiver unit 802 is further used to receive second information, the second information including user expression information collected by the terminal; the processing unit 801 is further used to generate second business data of the virtual image business based on the second information; the transceiver unit 802 is further used to provide second business data.

[0415] In an optional manner, the user expression information includes at least one of the following information: audio information, video information, and text information.

[0416] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0417] As shown in Figure 9, this application also provides a data processing device 900. The data processing device 900 can be a chip or a chip system. The data processing device can be located in a device involved in any of the above method embodiments, such as a terminal, a service provider, etc., to perform the corresponding actions of the device.

[0418] Optionally, the chip system may consist of the chip, or may include the chip and other discrete devices.

[0419] The data processing device 900 includes a processor 910 .

[0420] The processor 910 is configured to execute the computer program stored in the memory 920 to implement the actions of each device in any of the above method embodiments.

[0421] The data processing device 900 may further include a memory 920 for storing computer programs.

[0422] Optionally, the memory 920 and the processor 910 are coupled. Coupling is an indirect coupling or communication connection between devices, units, or modules, and can be electrical, mechanical, or other forms, for information exchange between the devices, units, or modules. Optionally, the memory 920 and the processor 910 are integrated.

[0423] The processor 910 and the memory 920 may be one or more and are not limited.

[0424] Optionally, in actual applications, the data processing device 900 may or may not include a transceiver 930, as illustrated by a dashed box in the figure. The data processing device 900 can exchange information with other devices via the transceiver 930. The transceiver 930 can be a circuit, a bus, a transceiver, or any other device capable of exchanging information.

[0425] In a possible implementation, the data processing device 900 may be the first satellite or ground equipment in the implementation of the above methods.

[0426] The specific connection medium between the transceiver 930, processor 910, and memory 920 is not limited in the embodiments of the present application. In FIG. 9 , the memory 920, processor 910, and transceiver 930 are connected via a bus. The bus is represented by a bold line in FIG. The connection between other components is for illustrative purposes only and is not intended to be limiting. Buses can be classified as address buses, data buses, control buses, and the like. For ease of illustration, FIG. 9 uses only one bold line, but this does not imply that there is only one bus or type of bus. In the embodiments of the present application, the processor can be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly executed by a hardware processor or by a combination of hardware and software modules within the processor.

[0427] In an embodiment of the present application, the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or a volatile memory (volatile memory), such as a random-access memory (RAM). The memory may also be any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory in an embodiment of the present application may also be a circuit or any other device that can implement a storage function, for storing computer programs, program instructions and / or data.

[0428] Based on the above embodiments, referring to FIG10 , an embodiment of the present application further provides another data processing device 1000, including: an interface circuit 1010 and a logic circuit 1020; the interface circuit 1010 can be understood as an input and output interface, which can be used to execute the receiving and sending steps of each device in any of the above method embodiments; the logic circuit 1020 can be used to run code or instructions to execute the method executed by each device in any of the above embodiments, which will not be repeated.

[0429] Based on the above embodiments, embodiments of the present application further provide a computer-readable storage medium storing instructions that, when executed, cause the method executed by each device in any of the above method embodiments to be implemented. The computer-readable storage medium may include any medium capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory, a random access memory, a magnetic disk, or an optical disk.

[0430] Based on the above embodiments, an embodiment of the present application provides a communication system, which includes the terminal and service provider mentioned in any of the above method embodiments, and can be used to execute the method executed by each device in any of the above method embodiments.

[0431] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, compact disc read-only memory (CD-ROM), optical storage, etc.) containing computer-usable program code.

[0432] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0433] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0434] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

Claims

1. A data processing method, applied to a terminal, characterized in that: include: Obtaining a service list, wherein the service list includes service information of a virtual image service; The virtual image service is accessed according to the service information.

2. The method according to claim 1, characterized in that The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

3. The method according to claim 2, characterized in that When the service information includes the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

4. The method according to claim 3, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

5. The method according to claim 2, characterized in that: When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

6. The method according to claim 2, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information for accessing service data of the virtual image service.

7. The method according to any one of claims 1 to 6, characterized in that: The accessing the virtual image service according to the service information includes: Sending a first message according to the service information, where the first message is used to request the virtual image service; A response message to the first message is received.

8. The method according to claim 7, characterized in that The first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

9. The method according to any one of claims 2 to 8, characterized in that: Also includes: Sending a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; A response message to the second message is received.

10. The method according to claim 7 or 8, characterized in that: Also includes: receiving first service data of the virtual image service, where the first service data is service data generated by the virtual image service server according to the first message; The service is played according to the first service data.

11. The method according to claim 9, characterized in that Also includes: receiving second service data of the virtual image service, where the second service data is service data generated by the virtual image service server according to the second message; The service is played according to the second service data.

12. The method according to claim 10, characterized in that Also includes: Sending a third message to the address information of the service data for accessing the virtual image service; A response message to the third message is received, wherein the response message includes the first service data.

13. The method according to claim 10, characterized in that Also includes: Sending a fourth message to the address information of the service data for accessing the virtual image service; receiving a response message to the fourth message, wherein the response message to the fourth message includes a media presentation description file of the virtual image service; The first service data is requested according to the media presentation description file.

14. The method according to claim 2 or 6, characterized in that: When the service information includes associated application information of the virtual image service, the method further includes: Activate an associated application of the virtual image service.

15. A data processing method, applied to a first server, characterized in that: include: receiving first information, wherein the first information is used to request a virtual image service; generating first business data of the virtual image business according to the first information; The first service data is provided.

16. The method according to claim 15, characterized in that The first information includes at least one of the following information: user identification, device identification, user preference information, a virtual image type selected by the user, and a language selected by the user.

17. The method according to claim 15 or 16, characterized in that Also includes: A service list of the service list server is configured, wherein the service list includes service information of the virtual image service.

18. The method according to claim 17, characterized in that The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

19. The method according to claim 18, characterized in that When the service information is the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

20. The method according to claim 19, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

21. The method according to claim 18, characterized in that When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

22. The method according to claim 18, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information for accessing service data of the virtual image service.

23. The method according to claim 15, characterized in that Also includes: receiving second information, wherein the second information includes user expression information collected by the terminal; generating second business data of the virtual image business according to the second information; The second service data is provided.

24. A data processing method, characterized in that: include: The terminal obtains a service list from the service list server, wherein the service list includes service information of the virtual image service; The terminal sends first information to a first server of the virtual image service according to the service information, wherein the first information is used to request the virtual image service; The first server generates first service data of the virtual image service according to the first information; The first server provides the first service data to the terminal; The terminal plays a service according to the first service data.

25. The method according to claim 24, characterized in that Also includes: The terminal sends second information to the first server according to the service information, wherein the second information includes user expression information collected by the terminal; The first server generates second service data of the virtual image service according to the second information; The first server provides the second service data to the terminal; The terminal plays the service according to the second service data.

26. The method according to claim 24, characterized in that The first server providing the first service data to the terminal includes: The first server stores the first service data, wherein a first address storing the first service data corresponds to address information of the service data for accessing the virtual image service acquired by the terminal; The terminal obtains the first service data from the first address.

27. The method according to claim 26, characterized in that The terminal acquiring the first service data from the first address includes: The terminal sends a third message according to the address information of the service data for accessing the virtual image service; The terminal receives a response message to the third message, where the response message includes the first service data.

28. The method according to claim 24, characterized in that The first server provides the first service data, including: The first server stores a media presentation file generated when the first service data is segmented, wherein the second address of the media presentation file corresponds to the address information of the service data for accessing the virtual image service acquired by the terminal, and the first server Also saving the slice of the first business data, wherein the third address of the slice saving the first business data corresponds to the address described in the media presentation file; The method further comprises: The terminal sends a fourth message according to the address information of the service data for accessing the virtual image service; The terminal receives a response message to the fourth message, wherein the response message includes the media presentation description file; The terminal requests the first service data according to the media presentation description file.

29. The method according to any one of claims 24 to 28, characterized in that: The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

30. The method according to claim 29, characterized in that When the service information includes the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

31. The method according to claim 30, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information of the service data for accessing the virtual image service.

32. The method according to claim 29, characterized in that When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

33. The method according to claim 29, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information of the service data for accessing the virtual image service.

34. The method according to claim 29 or 33, characterized in that When the service information includes associated application information of the virtual image service, the method further includes: Activate an associated application of the virtual image service installed on the terminal.

35. The method according to any one of claims 24 to 34, characterized in that: The first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

36. A communication device, characterized in that: include: at least one processor and memory; The memory is used to store computer programs or instructions; The at least one processor is configured to execute the computer program or instructions so that the method according to any one of claims 1 to 35 is performed.

37. A chip system, characterized in that: The chip system comprises: a processing circuit; the processing circuit is coupled to a storage medium; The processing circuit is used to execute part or all of the computer programs or instructions in the storage medium, and when the part or all of the computer programs or instructions are executed, it is used to implement the method as described in any one of claims 1-35.

38. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed by a computer, the method according to any one of claims 1 to 35 is executed.

39. A computer program product comprising a computer program or instructions, characterized in that When it is run on a computer, the method described in any one of claims 1 to 35 is executed.