Data processing method and device

Abstract

The embodiment of the invention provides a data processing method and device, and relates to the technical field of communication. A terminal can obtain a service list from a service list server, and the service list comprises service information of a virtual image service; and then the terminal can access the virtual image service according to the service information. By adopting the method provided by the invention, the virtual image service can be obtained through the DVB, and the service experience of the user can be further improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular, to a data processing method and device. Background Art

[0002] Digital Human (Digital Human / Meta Human) is a digital human image close to human image created by digital technology. Digital Human breaks the physical boundaries to provide anthropomorphic services, and has the characteristics of hyper-realism and strong interaction, which is the future development trend.

[0003] Digital video broadcasting (DVB) is a series of internationally recognized open standards for digital television maintained by the DVB project. The DVB standard provides a complete set of digital television system specifications applicable to different media. Digital video broadcasting-internet (DVB-I) is a mechanism developed by DVB to obtain services through various transmission methods after discovering services through the Internet. The existing DVB does not support digital human services, and no solution has been provided on how to provide digital human services through DVB. Summary of the invention

[0004] The present application provides a data processing method and device to provide a digital human service through DVB.

[0005] In a first aspect, the present application provides a data processing method, which can be applied to a terminal, which can be understood as a mobile phone, a computer, a set-top box, etc. In a DVB system, the terminal is equivalent to a DVB-Client (client), which is only exemplified here and does not specifically limit the form of the terminal, and is executed as follows:

[0006] A service list is obtained, the service list including service information of the virtual image service; and the virtual image service is accessed according to the service information.

[0007] It should be noted that the virtual image service in this application can be understood as a digital human service, a virtual pet service, a virtual space service, etc., and this application does not specifically limit this. The service list server in this application can be understood as a service list server of a DVB system, and can also be understood as a server of other service systems, and this is not specifically limited here.

[0008] In this application, the terminal can obtain the service information of the virtual image service from the service list server of the DVB system, and request the virtual image service from the device associated with the virtual image service person according to the service information, thereby achieving the purpose of accessing the virtual image service. In this way, the terminal can obtain the virtual image service.

[0009] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0010] In the present application, the service type indication information of the virtual image service can be a digital person, a cartoon digital person, etc., which is only illustrative and not specifically limited. The service instance information of the virtual image service can indicate the access address information of the virtual image service, etc. The associated application information of the virtual image service can be the application information that the terminal needs to install, and the virtual image service can be accessed based on the installation of the application. The present application can ensure that the DVB system supports the virtual image service by configuring the service type indication information of the virtual image service, the service instance information of the virtual image service, and the associated application information of the virtual image service in the service information, so that the terminal can access the virtual image service and receive the service of the virtual image service.

[0011] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0012] In the present application, when the service instance information includes uplink transmission parameters and the uplink transmission parameters include the destination address information of the uplink data, the terminal can learn the address for sending the virtual image service request, that is, the destination address of the uplink data, and send the virtual image service request to the service provider through the destination address of the uplink data, so that the service provider can generate a virtual image according to the virtual image service request.

[0013] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0014] In the present application, by configuring the transmission protocol supported by the uplink data in the uplink transmission parameters, it is possible to know which protocol is used to transmit the virtual image service request data. By configuring the media types supported by the virtual image service request data in the uplink transmission parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image service request data.

[0015] In an optional manner, the service instance information includes service access parameters in addition to the above-mentioned uplink transmission parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0016] In the present application, when the service instance information includes uplink transmission parameters and service access parameters, the terminal can obtain the download address of the virtual image, that is, the address of the service data for accessing the virtual image service, and send a virtual image acquisition request to the service provider through the address of the service data for accessing the virtual image service, so that the service provider generates the virtual image and returns to the address of the service data for accessing the virtual image service.

[0017] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0018] In the present application, when the service instance information includes a service access parameter (the service access parameter is understood as an access parameter for two-way communication, that is, a parameter that supports both the transmission of virtual image request data and the downloading of virtual image service data), the terminal can obtain the address for sending the virtual image service request and the download address of the virtual image, and send a virtual image acquisition request to the service provider through the address of the service data for accessing the virtual image service, so that the service provider generates the virtual image and returns to the address of the service data for accessing the virtual image service.

[0019] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0020] In the present application, when the service information includes service instance information and associated application information of the virtual image service, the terminal can send a request to obtain the virtual image service to the service provider based on the application associated with the virtual image service, and then determine the download address of the virtual image through the service access parameters in the service instance information, and request to obtain the virtual image based on the download address.

[0021] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0022] In this application, by configuring the transmission protocol supported by the business data in the business access parameters, it is possible to know which protocol is used to transmit the virtual image business request data. By configuring the media types supported by the business data in the business access parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image business.

[0023] In an optional manner, accessing a virtual image service according to service information includes: a terminal sending a first message according to the service information, the first message being used to request the virtual image service; and receiving a response message to the first message.

[0024] In the present application, the terminal can learn the address for sending the virtual image service request based on the service information, and the terminal can send a first message to the address to request the virtual image service, thereby obtaining the service of the virtual image service.

[0025] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

[0026] Among them, the user identifier can be understood as the user identifier of the DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client, and is only exemplified here. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. User preference information is usually information collected based on the user's historical operating habits or parameters set by the user. For example, when the user likes to watch live sports, the Digital Human Server can recommend a digital human wearing sportswear. The type of virtual image selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc., and can also be sign language. This is only an illustrative description, and the above request message is not specifically limited.

[0027] In an optional manner, the terminal further sends a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; and receives a response message to the second message.

[0028] In the present application, the terminal can learn the address for sending the virtual image service request based on the service information, and the terminal can send a second message to the address to interact with the virtual image generated by the service requester.

[0029] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0030] In an optional manner, the terminal further receives first service data of the virtual image service, where the first service data is service data generated by the virtual image service server according to the first message; and performs service playback according to the first service data.

[0031] In an optional manner, the terminal further sends a third message to the address information of the service data for accessing the virtual image service; and receives a response message to the third message, wherein the response message includes the first service data.

[0032] In an optional manner, the terminal also sends a fourth message to the address information of the business data for accessing the virtual image business; receives a response message to the fourth message, the response message to the fourth message includes a media presentation description file of the virtual image business; and requests the first business data according to the media presentation description file.

[0033] In an optional manner, the terminal further receives second service data of the virtual image service, where the second service data is service data generated by the virtual image service server according to the second message; and the service is played according to the second service data.

[0034] In an optional manner, the terminal further sends a third message to the address information of the service data for accessing the virtual image service; and receives a response message to the third message, wherein the response message includes the second service data.

[0035] In an optional manner, the terminal also sends a fourth message to the address information of the service data for accessing the virtual image service; receives a response message to the fourth message, the response message to the fourth message includes a media presentation description file of the virtual image service; and requests second service data according to the media presentation description file.

[0036] In an optional manner, when the service information includes application information associated with the virtual image service, the terminal also activates the application associated with the virtual image service.

[0037] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0038] In a second aspect, the present application provides a data processing method, which is applied to a first server, and the first server may be a manufacturer of a virtual image service, or an operator, etc. In a DVB system, the first server is equivalent to a Content / Service provider(s), which is only exemplified herein and does not specifically limit the form of the first server, and is executed as follows:

[0039] Receive first information, where the first information is used to request a virtual image service; generate first service data of the virtual image service according to the first information; and provide the first service data.

[0040] In the present application, after receiving the first information, the service provider generates first service data of the virtual image service according to the first information and provides first media data, thereby providing the service of the virtual image service.

[0041] In an optional manner, the first information includes at least one of the following information: user identification, device identification, user preference information, a virtual image type selected by the user, and a language selected by the user.

[0042] In an optional manner, the service provider further configures a service list of the service list server, and the service list includes service information of the virtual image service.

[0043] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0044] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0045] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0046] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0047] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0048] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0049] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0050] In an optional manner, the first server further receives second information, the second information including user expression information; generates second business data of the virtual image business according to the second information; and provides second media data.

[0051] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0052] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0053] In the third aspect, the present application provides a data processing method, which can be executed through data interaction between a terminal, a first service server and other devices. The terminal can be understood as a mobile phone, a computer, a set-top box, etc. In the DVB system, the terminal is equivalent to a DVB-Client (client), which is only exemplified here. The service provider can be a manufacturer of a virtual image service, or an operator, etc. In the DVB system, the service provider is equivalent to Content / Serviceprovider(s) (content / service provider), which is only exemplified here. Execution is as follows:

[0054] The terminal obtains a service list from a service list server, where the service list includes service information of a virtual image service; the terminal sends first information to a first server of the virtual image service according to the service information, where the first information is used to request the virtual image service; the first server generates first service data of the virtual image service according to the first information; the first server provides the first service data to the terminal; the terminal plays the service according to the first service data.

[0055] In an optional manner, the first server provides first business data to the terminal, including: the first server saves the first business data, wherein a first address for saving the first business data corresponds to address information of business data for accessing a virtual image business obtained by the terminal; and the terminal obtains the first business data from the first address.

[0056] In an optional manner, the terminal obtains the first business data from the first address, including: the terminal sends a third message according to the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the first business data.

[0057] In an optional manner, a first server provides first business data, including: the first server saves a media presentation file generated when the first business data is segmented, wherein a second address of the media presentation file corresponds to address information of business data for accessing a virtual image business obtained by a terminal, and the first server also saves the segment of the first business data, wherein a third address of the segment storing the first business data corresponds to an address described in the media presentation file; the terminal sends a fourth message according to the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including a media presentation description file; and the terminal requests the first business data according to the media presentation description file.

[0058] In an optional manner, a first server provides first business data, including: the first server saves the first business data, wherein a fourth address for saving the first business data corresponds to address information of business data for accessing a virtual image business obtained by a terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0059] In an optional manner, the terminal sends second information to the first server based on business information, wherein the second information includes user expression information collected by the terminal; the first server generates second business data of the virtual image business based on the second information; the first server provides the second business data to the terminal; and the terminal plays the business based on the second business data.

[0060] In an optional manner, the first server provides second business data to the terminal, including: the first server saves the second business data, wherein a first address for saving the second business data corresponds to address information of business data for accessing a virtual image business obtained by the terminal; the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the second business data.

[0061] In an optional manner, the first server provides second business data, including: the first server saves a media presentation file generated when the second business data is segmented, wherein the second address of the media presentation file corresponds to address information of business data for accessing a virtual image business obtained by a terminal, and the first server also saves the segment of the second business data, wherein the third address of the segment storing the second business data corresponds to the address described in the media presentation file; the terminal sends a fourth message according to the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including a media presentation description file; the terminal requests the second business data according to the media presentation description file.

[0062] In an optional manner, the first server provides second business data, including: the first server saves the second business data, wherein a fourth address for saving the second business data corresponds to address information of business data for accessing a virtual image business obtained by a terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends the second business data to the terminal.

[0063] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0064] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0065] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0066] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0067] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0068] In an optional manner, when the service information includes application information associated with the virtual image service, an application associated with the virtual image service installed in the terminal is activated.

[0069] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

[0070] In a fourth aspect, the present application provides a data processing device, comprising a transceiver unit and a processing unit;

[0071] The transceiver unit is used to obtain a service list from a service list server, wherein the service list includes service information of the virtual image service; and the processing unit is used to access the virtual image service according to the service information.

[0072] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0073] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0074] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0075] In an optional manner, the service instance information includes service access parameters in addition to the above-mentioned uplink transmission parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0076] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0077] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0078] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0079] In an optional manner, the transceiver unit is specifically configured to send a first message according to the service information, where the first message is used to request a virtual image service; and receive a response message to the first message.

[0080] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

[0081] In an optional manner, the transceiver unit is further used to send a second message based on the business information, the second message is used for real-time interaction with the virtual image business, wherein the second message includes received user expression information; and receive a response message to the second message.

[0082] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0083] In an optional manner, the transceiver unit is further used to receive first business data of the virtual image business, where the first business data is business data generated by the virtual image business server according to the first message; the processing unit is further used to play the business according to the first business data.

[0084] In an optional manner, the transceiver unit is further used to send a third message to the address information of the business data for accessing the virtual image business; and receive a response message to the third message, wherein the response message includes the first business data.

[0085] In an optional manner, the transceiver unit is further used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, and the response message to the fourth message includes a media presentation description file of the virtual image business; and the processing unit is further used to request the first business data according to the media presentation description file.

[0086] In an optional manner, the transceiver unit is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the second message; the processing unit is further used to play the business according to the second business data.

[0087] In an optional manner, the transceiver unit is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the first message; the processing unit is further used to play the business according to the second business data.

[0088] In an optional manner, the transceiver unit is further used to send a third message to the address information of the business data for accessing the virtual image business; and receive a response message to the third message, wherein the response message includes the second business data.

[0089] In an optional manner, the transceiver unit is further used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, the response message to the fourth message includes a media presentation description file of the virtual image business; and the processing unit is further used to request second business data according to the media presentation description file.

[0090] In an optional manner, when the service information includes application information associated with the virtual image service, the processing unit is further configured to activate an application associated with the virtual image service.

[0091] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0092] In a fifth aspect, the present application provides a data processing device, comprising a transceiver unit and a processing unit;

[0093] The transceiver unit is used to receive a first message, the first message is used to request a virtual image service; the processing unit is used to generate first service data of the virtual image service according to the first message; the transceiver unit is also used to provide the first service data.

[0094] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

[0095] In an optional manner, the processing unit is further used to configure a service list of the service list server, where the service list includes service information of the virtual image service.

[0096] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0097] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0098] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0099] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0100] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0101] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0102] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0103] In an optional manner, the transceiver unit is further used to receive a second message, the second message includes user expression information, the user expression information is used for real-time interaction with the virtual image service, wherein the second message includes the received user expression information; the processing unit is further used to generate second business data of the virtual image service according to the second message; the transceiver unit is further used to provide second business data.

[0104] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0105] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0106] In a sixth aspect, an embodiment of the present application provides a communication system, which includes the terminal and network device in the above-mentioned first aspect.

[0107] In a seventh aspect, the present application provides a chip system, which includes a processor and may also include a memory, for implementing the method described in any possible design in the first aspect. The chip system may be composed of a chip, or may include a chip and other discrete devices.

[0108] In an eighth aspect, the present application further provides a computer-readable storage medium, in which computer-readable instructions are stored. When the computer-readable instructions are executed on a computer, the computer executes a method in any possible design as in the first aspect.

[0109] In a ninth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the methods of the various embodiments of the first aspect described above.

[0110] For the technical effects that can be achieved in the above-mentioned second to ninth aspects, please refer to the description of the technical effects that can be achieved by the corresponding possible design schemes in the above-mentioned first aspect, and this application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0111] Figure 1A A schematic diagram of a DVB system architecture is shown;

[0112] Figure 1B A schematic diagram showing a system architecture applicable to the present application is shown;

[0113] Figure 2A A schematic diagram of a data processing method provided by the present application is shown;

[0114] Figure 2B A schematic diagram of a data processing method provided by the present application is shown;

[0115] Figure 3 A schematic diagram of a data processing method provided by the present application is shown;

[0116] Figure 4 A schematic diagram of a data processing method provided by the present application is shown;

[0117] Figure 5 A schematic diagram of a data processing method provided by the present application is shown;

[0118] Figure 6 A schematic diagram of a data processing method provided by the present application is shown;

[0119] Figure 7 A schematic diagram of a data processing method provided by the present application is shown;

[0120] Figure 8 A schematic diagram of the structure of a data processing device provided by the present application is shown;

[0121] Fig. 9 A schematic diagram showing the structure of another data processing device provided in an embodiment of the present application is shown;

[0122] Fig.10 A schematic diagram of the structure of another data processing device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0123] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The specific operating method in the method embodiment can also be applied to the device embodiment or system embodiment. Among them, in the description of the present application, unless otherwise specified, the meaning of "multiple" is two or more. Therefore, the implementation of the device and the method can refer to each other, and the repetitions will not be repeated.

[0124] Figure 1A A DVB system architecture is shown, which includes DVB-I Client, Service List Server(s), Content / Service provider(s), MPD Server(s), Stream Server(s), Content Guide Server(s), Service List registry, and Playlist Server(s).

[0125] Among them, DVB-I Client is a client functional network element that supports DVB-I service discovery. DVB-I Client can be integrated in various terminal devices such as mobile phones, tablets, laptops, PDAs, mobile internet devices (MID), virtual reality (VR) devices, augmented reality (AR) devices, smart TVs, set-top boxes, etc. Service List Server(s) is a server that provides service lists to DVB-I Client. Content / Service provider(s) is an organization that provides DVB-I services. MPD Server(s) is a server that provides DASH MPD files. Stream Server(s) is a server that provides DASH media segments to DVB-I Client. Content Guide Server(s) is a server that provides content guide data to DVB-I Client. Service List registry is a server that provides the Service List Server address to DVB-I Client. Playlist Server(s): is a server that provides playlists of content items to DVB-I Client.

[0126] Content / Service provider(s) sends the available Service List to Service List Server. Service List Server registers the Service List access entry address (URL) to Service List Registry. When the DVB-I client wants to discover the Service, the DVB-I client obtains the Service List access entry address from the Service List registry through the address of the Service List Registry. DVB-I then queries the Service List through the access entry address. The Service List includes information about one or more Services. Each Service may include one or more Service Instances that provide the service. If the service is through the associated application service capability, the Service information includes the associated application information (Linked Application).

[0127] In this application, business data is also referred to as media data or media files, including audio, video, text, etc.

[0128] Figure 1B The system architecture diagram applicable to the present application is shown, and the architecture includes: a terminal, a virtual image service server (i.e., a first server) and a second server, wherein the second server is used to build a transmission bridge between the terminal and the virtual image service server, and can transmit user identification, user expression information, etc., which is not specifically limited here. In actual application, there may be N second servers, where N is a positive integer. For example, the second server is an uplink server, a downlink server and an application server. The uplink server is used to forward the uplink data (user identification, user expression information, etc.) sent by the terminal to the virtual image service server, the downlink server is used to receive the virtual image (i.e., service data) generated from the virtual image service server and forward it to the terminal, and the application server is used to forward the uplink data (user identification, user expression information, etc.) sent by the terminal to the virtual image service server, etc. The type and function of the second server are not specifically limited here, and in actual application, it can be configured according to the specific application situation. Among them, the virtual image service can be understood as a digital human service, a virtual space, a virtual animal service, etc., and the virtual image service is not specifically limited here. In addition, the virtual image service server is used to provide the virtual image service, and may be co-located with the second server, or may be separately located from the second server, which is not specifically limited in the present application.

[0129] The existing DVB standard does not support the digital human service, and DVB-I does not support the discovery of the digital human service. However, digital services are already the future development trend. Based on this, this application provides a data processing method so that the digital human service can be discovered through DVB-I. Figure 2A , can be executed through the interaction between the terminal (ie, DVB-Client), the service list server (ie, Service List Server(s)), and the first server (ie, Content / Service provider(s), which may also be an operator, etc., not specifically limited here). Of course, in actual application, other devices may also be involved, which are not specifically limited here, and are executed as follows:

[0130] First, the terminal needs to obtain the service list, which can be obtained from the service list server or from other terminals. For example, terminal A has obtained and stored the service list, and terminal B can request the service list from terminal A. Of course, in actual applications, the terminal may also obtain the service list in other ways, which are not specifically limited in this application. Figure 2A Take the example of a terminal obtaining a service list from a service list server for explanation.

[0131] Step 201A: The terminal sends a request message to the service list server. The request message is used to request a service list (ie, a list including Service information).

[0132] Specifically, when the terminal resides in the DVB-I Client, it can obtain the Service information access entry address from the Service List Registry through the address of the Service List Registry, and then query the Service information through the access entry address. In addition, the terminal can also obtain the Service information access entry address through configuration.

[0133] The service list in step 201A includes service information of the virtual image service, which may indicate the service type (such as obtaining a digital person service), access form (access address, protocol), service provider, etc. of the virtual image service, which is not specifically limited here. The service information may be configured by the content / service provider according to the service attributes of the virtual image service provided by the content / service provider, which may be manually configured offline or interactively configured with the service list server, which is not specifically limited here.

[0134] Optionally, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service. In specific implementation, a new field can be added to the Service List to indicate, or a field can be reused to indicate, which is not specifically limited in this application.

[0135] Among them, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human. The instance information of the virtual image service indicates the access address information of the virtual image service, such as the uplink data transmission address, the downlink data (that is, the service data) download address, the address for two-way transmission, etc. The associated application information of the virtual image service, such as the virtual image service is a digital human service, then the application information associated with the virtual image service can be a digital human application, the terminal can install the digital human application, and access the digital human service based on the application server of the digital human application, etc. The present application can ensure that the DVB system supports the virtual image service by configuring the service type indication information of the virtual image service, the service instance information of the virtual image service, and the associated application information of the virtual image service in the service information, so that the terminal can access the virtual image service and receive the service of the virtual image service.

[0136] Step 202A: The service list server returns the service list to the terminal.

[0137] Step 203A: The terminal accesses the virtual image service provided by the first server according to the service information.

[0138] Next, the following describes how the terminal specifically accesses the virtual image service when the service information includes different information.

[0139] Case 1 , the service information includes virtual image service instance information, the service instance information includes uplink transmission parameters, and the uplink transmission parameters include destination address information of uplink data.

[0140] The terminal can determine the destination address information of the uplink data according to the uplink transmission parameter. Here, the destination address information of the uplink data is taken as an example of the uplink server. The terminal sends a first message to the uplink server to determine that the first message is sent. The first message is used to request a virtual image service. The first message may include information such as a user identifier, a device identifier, user preference information, a virtual image type selected by the user, and a language selected by the user. Among them, the user identifier can be understood as a user identifier of a DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client. This is only an example. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. The user preference information is usually information collected based on the user's historical operating habits or parameters set by the user. For example, when a user likes to watch sports live broadcasts, the DigitalHuman Server can recommend a digital human wearing sportswear. The virtual image type selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc., and can also be sign language. This is only an example, and the above request message is not specifically limited.

[0141] The uplink server sends the first message to the digital human server and returns the downlink data download address to the terminal. Since the service instance information does not include the downlink data download address, the downlink data download address is dynamically generated by the uplink server. The uplink server can reply a response message to the terminal, and the response message may include the downlink data download address. The digital human server can feed back the generated digital human video to the downlink data download address, and the terminal can request the digital human video and other service data from the download address, thereby realizing access to the digital human service.

[0142] In actual application, the uplink transmission parameters may also include the transmission protocol supported by the uplink data and the media type supported by the uplink data. By configuring the transmission protocol supported by the uplink data in the uplink transmission parameters, it is possible to know which protocol is used, such as to transmit the virtual image service request data. By configuring the media type supported by the virtual image service request data in the uplink transmission parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image service request data.

[0143] In addition, it should be noted that the above-mentioned uplink server can be co-located with the digital human server or separately located from the digital human server, and this application does not specifically limit this.

[0144] Case 2: The service information includes virtual image service instance information, and the service instance information includes uplink transmission parameters and service access parameters. The uplink transmission parameters include destination address information of uplink data, and the service access parameters include address information of service data for accessing the virtual image service.

[0145] The terminal can determine the destination address information of the uplink data according to the uplink transmission parameter. Here, the destination address information of the uplink data is taken as an example of an uplink server. The terminal sends a first message to the uplink server to request a virtual image service. The first message may include information such as a user identifier, a device identifier, user preference information, a virtual image type selected by the user, and a language selected by the user. This can be understood by referring to the above situation 1 and will not be described in detail.

[0146] The uplink server sends the first message to the digital human server and returns the downlink data download address to the terminal. Since the business instance information includes the address information of the business data for accessing the virtual image business (i.e., the download address of the downlink data), the digital human server can feed back the generated digital human media file to the address of the business data for accessing the virtual image business. The terminal can request the digital human media file and other business data from the address of the business data for accessing the virtual image business, thereby realizing the access to the digital human business.

[0147] In actual application, the uplink transmission parameters may also include the transmission protocols supported by the uplink data, and the media types supported by the uplink data. By configuring the transmission protocols supported by the uplink data in the uplink transmission parameters, it is possible to know which protocol is used to transmit the virtual image service request data. By configuring the media types supported by the virtual image service request data in the uplink transmission parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image service request data. The service access parameters also include the transmission protocols supported by the service data, and / or the media types supported by the service data. In the present application, by configuring the transmission protocols supported by the service data in the service access parameters, it is possible to know which protocol is used, such as to transmit the virtual image service request data. By configuring the media types supported by the service data in the service access parameters, such as audio, video, text, etc., it is possible to know which media type of data is used to transmit the virtual image service.

[0148] In addition, it should be noted that the above-mentioned uplink server and the address of the business data for accessing the virtual image business can be set up together with the digital human server, or can be set up separately from the digital human server, and this application does not specifically limit this.

[0149] Case 3: The service information includes virtual image service instance information. The service instance information also includes service access parameters. The service access parameters include address information of service data for accessing the virtual image service.

[0150] The terminal can determine the destination address information of the uplink and downlink data according to the service access parameter (the service access parameter is understood as the access parameter of two-way communication, that is, the parameter that supports both the transmission of virtual image request data and the download of virtual image service data), and the terminal sends a first message to the address of the service data of the access virtual image service, and the first message is used to request the virtual image service. The first message may include information such as user identification, device identification, user preference information, user selected virtual image type and user selected language. It can be understood by referring to the above situation 1 and will not be repeated here.

[0151] The address of the business data for accessing the virtual image service sends the first message to the digital human server, and the digital human server can feedback the generated digital human media file to the address of the business data for accessing the virtual image service. The terminal can request business data such as digital human video from the address of the business data for accessing the virtual image service, thereby realizing access to the digital human service.

[0152] In actual application, the service access parameters also include the transmission protocol supported by the service data, and / or the media type supported by the service data. In this application, by configuring the transmission protocol supported by the service data in the service access parameters, it is possible to know which protocol is used, such as transmitting the virtual image service request data, and by configuring the media type supported by the service data in the service access parameters, such as audio, video, text, etc., it is possible to know which media type is used for data transmission of the virtual image service.

[0153] In addition, it should be noted that the address of the business data for accessing the above-mentioned virtual image business can be set together with the digital human server, or can be set separately from the digital human server, and this application does not specifically limit this.

[0154] Situation 4: When the service information includes service instance information and associated application information of the avatar service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the avatar service.

[0155] The terminal can activate the application associated with the virtual image service installed in the terminal, that is, the digital human application, and then send a first message to the application server. The first message is used to request the virtual image service. The first message may include information such as user identification, device identification, user preference information, user-selected virtual image type, and user-selected language. This can be understood by referring to the above situation 1 and will not be repeated here.

[0156] The application server sends the first message to the digital human server and returns the address of the business data for accessing the virtual image service to the terminal. The digital human server can feed back the generated digital human media file to the address of the business data for accessing the virtual image service. The terminal can request business data such as digital human video from the address of the business data for accessing the virtual image service, thereby realizing access to the digital human service.

[0157] In actual application, the service access parameters also include the transmission protocol supported by the service data, and / or the media type supported by the service data. In this application, by configuring the transmission protocol supported by the service data in the service access parameters, it is possible to know which protocol is used, such as transmitting the virtual image service request data, and by configuring the media type supported by the service data in the service access parameters, such as audio, video, text, etc., it is possible to know which media type is used for data transmission of the virtual image service.

[0158] In addition, it should be noted that the above-mentioned application server and the address of the business data for accessing the virtual image business can be co-located with the digital human server or separately from the digital human server, and this application does not specifically limit this.

[0159] Case 5: Business information includes the associated application information of the virtual image business

[0160] The terminal can activate the application associated with the virtual image service installed in the terminal, that is, the digital human application, and then send a first message to the application server. The first message is used to request the virtual image service. The first message may include information such as user identification, device identification, user preference information, user-selected virtual image type, and user-selected language. This can be understood by referring to the above situation 1 and will not be repeated here.

[0161] The application server sends the first message to the digital human server, and the digital human server can feed back the generated digital human media file to the application server. The terminal can request service data such as digital human video from the application server, thereby accessing the digital human service.

[0162] In addition, it should be noted that the above-mentioned application server can be jointly set up with the digital human server or separately set up with the digital human server, and this application does not specifically limit this.

[0163] For the above cases 1, 2 and 4, the response message of the first message may be the address of the service data for accessing the virtual image service, and may also include other information which is not specifically limited here. For the above cases 3 and 5, there may be no response message of the first message.

[0164] The digital human server may send the digital human media file generated according to the first message as the first service data to the terminal, so that the terminal can perform service playback according to the first service data.

[0165] In addition, it should be noted that in the above cases 1 to 5, although the virtual image service is obtained, in actual application, the user may still interact with the virtual image service in real time, such as hoping that the digital human can provide a tourist explanation of a certain area, etc. Based on this, the terminal can also send a second message to achieve real-time interaction with the virtual image service, wherein the second message includes the user expression information collected by the terminal; the user expression information includes at least one of the following information: audio information, video information and text information. For the above cases 1 and 2, the second message can be sent by the terminal to the uplink server, for case 3, the second message can be sent by the terminal to the address of the service data for accessing the virtual image service, and for cases 4 and 5, the second message can be sent by the terminal to the application server. This application will not be described one by one here. Among them, the response message of the second message can be understood as the response message of the first message, and will not be repeated here. The digital human server can send the digital human media file generated according to the second message as the second service data to the terminal, so that the terminal can play the service according to the second service data.

[0166] In addition, the terminal may send a third message to the address information of the service data of the virtual image service, and receive a response message to the third message, wherein the response message includes the first service data or the second service data. The terminal may also send a fourth message to the address information of the service data of the virtual image service, and receive a response message to the fourth message, wherein the response message includes a media presentation description file of the virtual image service, such as an MPD file, and the terminal requests the first service data or the second service data according to the media presentation description file.

[0167] In addition, it should be noted that in actual application, the digital human server may not receive any message from the terminal. The digital human server can directly generate a digital human and push it to the terminal. In actual application, this application does not specifically limit this.

[0168] In this application, the terminal can obtain the service information of the virtual image service from the service list server of the DVB system, and request the virtual image service from the device associated with the virtual image service person according to the service information, thereby achieving the purpose of accessing the virtual image service. In this way, the terminal can obtain the virtual image service.

[0169] See also Figure 2B, can be executed through the interaction between the terminal (ie, DVB-Client), the service list server (ie, Service List Server(s)), and the first server (ie, Content / Service provider(s), which may also be an operator, etc., not specifically limited here). Of course, in actual application, other devices may also be involved, which are not specifically limited here, and are executed as follows:

[0170] Step 201B: the terminal obtains a service list from a service list server, where the service list includes service information of the virtual image service.

[0171] This can be understood by referring to the above-mentioned step 201A and step 201B, and will not be elaborated here.

[0172] Step 202B: The terminal sends first information to a first server of the virtual image service according to the service information, where the first information is used to request the virtual image service.

[0173] It should be noted that the content of the first information is the same as the above Figure 2A The content of the first message is the same. Since the terminal and the first server may not interact directly, a second server may be required as an intermediary. Therefore, the terminal may send the first message to the second server, which is then processed by the second server and sent to the first server. The two messages are different, but the information carried in the two messages is the same, which are user identification, device identification, user preference information, user-selected virtual image type, user-selected language and other information.

[0174] Step 203B: The first server generates first business data of the virtual image business according to the first information.

[0175] Step 204B: The first server provides first service data to the terminal.

[0176] In an optional manner, the first server may save the first business data, wherein the first address for saving the first business data corresponds to address information of business data for accessing the virtual image business obtained by the terminal (such as a second server for transmitting business data, or a location in the first service which is not specifically limited here); the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the first business data.

[0177] In an optional manner, the first server may save a media presentation file generated when the first business data is segmented, wherein the second address of the media presentation file corresponds to address information of business data for accessing a virtual image business obtained by the terminal, and the first server further saves the segment of the first business data, wherein the third address of the segment for saving the first business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including a media presentation description file; the terminal requests the first business data based on the media presentation description file.

[0178] In an optional manner, the first server may save the first business data, wherein the fourth address of saving the first business data corresponds to address information of business data for accessing the virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0179] Step 205B: The terminal plays the service according to the first service data.

[0180] The above steps 202B to 205B can be understood as the processing flow of the virtual image service request stage. After obtaining the virtual image service, the user may interact with the virtual image in real time, such as through text, video, audio, etc., which can be performed through the following steps:

[0181] Step 206B: The terminal sends second information to the first server of the virtual image service according to the service information, wherein the second information includes the user expression information collected by the terminal.

[0182] It should be noted that the content of the second information is the same as the above Figure 2A The content of the second message is the same. Since the terminal and the first server may not interact directly, the second server may be required to act as an intermediary. Therefore, the terminal may send the second message to the second server, which is then processed by the second server and sent to the first server. The two messages are different, but the information carried in the two messages is the same, which are user identification, device identification, user preference information, user-selected virtual image type, user-selected language and other information.

[0183] Step 207B: The first server generates second business data of the virtual image business according to the second information.

[0184] Step 208B: The first server provides the second service data to the terminal.

[0185] In an optional manner, the first server may save the second business data, wherein the first address for saving the second business data corresponds to address information of business data for accessing the virtual image business obtained by the terminal (such as a second server for transmitting business data, or a location in the first service which is not specifically limited here); the terminal sends a third message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the third message, and the response message includes the second business data.

[0186] In an optional manner, the first server may save a media presentation file generated when slicing the second business data, wherein the second address of the media presentation file corresponds to address information of business data for accessing the virtual image business obtained by the terminal, and the first server further saves the slices of the second business data, wherein the third address of the slices storing the second business data corresponds to the address described in the media presentation file; the terminal sends a fourth message based on the address information of the business data for accessing the virtual image business; the terminal receives a response message to the fourth message, the response message including a media presentation description file; the terminal requests the second business data based on the media presentation description file.

[0187] In an optional manner, the first server may save the second business data, wherein the fourth address for saving the second business data corresponds to address information of business data for accessing the virtual image business obtained by the terminal; the address information of the business data for accessing the virtual image business determines the terminal; and the address information of the business data for accessing the virtual image business sends a business data to the terminal.

[0188] Step 209B: The terminal plays the service according to the second service data.

[0189] In order to better illustrate the solution of the present application, the following four specific examples are used to illustrate the implementation as follows:

[0190] Embodiment 1: A DVB-I client obtains service type indication information of a virtual image service and service instance information of the virtual image service through a service list. According to the service instance information of the virtual image service, data is exchanged with an uplink server for user selection information and user expression information, and then the user selection information and user expression information are transmitted to a server of the virtual image service through the uplink server. The server of the virtual image service generates media data associated with the virtual image service and feeds it back to the DVB-I client.

[0191] For details, see Figure 3To understand, take the data interaction of DVB-I client, Service List Server, StreamServer, MPD Server, Playlist Server, Uplink Server, and Digital Human Server as an example to illustrate, where, when the media data is sent in an adaptive bit rate mode, the Stream Server is used to store the media segmentation information of the virtual image service, such as: video segmentation, audio segmentation, etc. If it is a video segmentation, it can be understood as a video divided into multiple segments according to time, and it can also be understood as a video divided into multiple segments according to image frames; if it is an audio segmentation, it can be understood as a segment of audio divided into multiple segments according to audio frames, and the MPD Server stores the MPD file information corresponding to the media segmentation, and the address of the media segmentation is described in the MPD file. Among them, the MPD Server address template can be indicated by the following methods: https: / / cdn.example.com / digitalhuman_$userid / dash / manifes.mpd, or https: / / cdn.example.com / digitalhuman_$ipaddress / dash / manifes.mpd. In the above MPD Server address template, $userid and $ipaddress can be replaced with the user identifier and the IP address of the DVB-IClient. This application is only used for illustrative purposes and does not specifically limit the form of the MPD Server address template. When progressive download is adopted, the Playlist Server is used to store media data of the virtual image service. The Uplink Server is the destination address of the uplink data. When other streaming media formats send media data, the StreamServer sends the media data while receiving the uplink data. Digital Human Server is the address of the virtual image service provider, and Digital Human Server belongs to the Service Provider. In specific implementation, the above servers can be set up together or separately. Figure 3 Let’s take the virtual image business of digital human as an example.

[0192] Step 300, configure the service list.

[0193] In an optional embodiment, the Service Provider is manually configured offline, such as configuring the service list through the DigitalHuman Server. In another optional embodiment, the Service provider management function interacts with the Service list server to configure the service list. This application does not specifically limit how to configure the service list.

[0194] Table 1 below shows a list of services applicable to the first embodiment, wherein Service Type indicates that the virtual image service is a digital human, and further, the virtual image service may be indicated as a 2D digital human, a 3D digital human, a cartoon digital human, a real digital human, a customized digital human, or a sign language digital human. Service genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (i.e., service instance information) include supported digital human types, uplink transmission parameters, and service access parameters (i.e., the download address of the service data). The Digital human type parameter indicates the indication information of the digital human service type supported by the Service Instance, which may be a further refinement of the Service Type, such as a 2D digital human, a 3D digital human, a cartoon digital human, a real digital human, a customized digital human, or a sign language digital human. UplinkDeliveryParameters includes at least one of the following information: the destination address URI of the uplink data, the transmission protocol supported by the uplink data (such as HTTP, SRT, RTMP, WebSocket, etc.), and the media type supported by the uplink data, such as video, voice, or text. (Information not provided may be determined by standardized definition or configuration) Service access parameters include access address information of digital human's service data (MPD file at MDP Server address (adaptive bit rate transmission) or media file at Playlist Server address (progressive transmission)), transmission protocol supported by service data, and service data download delay information (such as waiting 100 milliseconds to download service data after sending uplink data).

[0195] Table 1

[0196]

[0197] Step 301: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0198] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information according to the service type information, without feeding back all service lists to the DVB-I Client, which can improve data processing efficiency.

[0199] Step 302: The Service list server returns a response message to the DVB-I client.

[0200] If the request message in step 301 does not include the service type, the response message includes the service list information configured in step 300; if the request message in step 301 includes the service type, the hard answer message includes the service list information corresponding to the service type in step 301.

[0201] Step 303: The DVB-I Client presents user prompt information according to the service list information.

[0202] Specifically, the user prompt information can prompt the user to select a specific virtual image service, such as please select a virtual image service type, and can also prompt the user to select a service type of a specific virtual image service, such as welcome to use the digital human service, please select the digital human service type 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human, etc. This is only an illustrative explanation and is not specifically limited.

[0203] Step 304: The DVB-I Client sends a request message to the Uplink Server according to the destination address URI of the uplink data and the supported transmission protocol.

[0204] Optionally, the request message includes one or more information of a user identifier, a device identifier, user preference information, a virtual image type selected by the user, and a language selected by the user. The user identifier can be understood as a user identifier of a DVB-I Client, which can identify the identity information, network access information, etc. of a DVB-I Client, and is only exemplified here. The device identifier is an identifier or an IP address of a device where a DVB-I Client resides. User preference information is usually information collected based on the user's historical operating habits or parameters set by the user. For example, if a user likes to watch sports live broadcasts, the Digital Human Server can recommend a digital human wearing sportswear. The type of virtual image selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc., and can also be sign language. This is only an exemplified description, and the above request message is not specifically limited. If the user selects sign language, the media type is generally video or text.

[0205] Step 305: The Uplink Server returns a response message to the DVB-I Client. Optionally, the response message includes download address information of the service data of the digital human.

[0206] If the service list information does not include the download address information URI of the digital person's service data and the MPDServer address template, the Uplink Server can dynamically generate a URI and feed the dynamically generated URI back to the DVB-IClient as the download address of the digital person's service data.

[0207] Step 306: The Uplink Server sends a message to the Digital Human Server.

[0208] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 304. If a URI is dynamically generated in step 305, the message also includes the URI.

[0209] Step 307: The Digital Human Server generates a digital human image media file according to the received information.

[0210] Specifically, Digital Human Server can determine whether to authorize the generation of customized digital human images based on the user's contract information. For example, if user A has signed a contract with the operator for the use of digital human services, or user A has signed a contract with the digital human service provider for the use of digital human services, then Digital Human Server can determine whether to authorize the generation of customized digital human images based on the contract information of user A. In addition, Digital Human Server can generate digital human images that meet the user's preferences based on the user's preference information. For example, if the user likes anime, a cartoon-like digital human can be generated.

[0211] Step 308: If the service data download adopts the adaptive bit rate method, the Digital Human Server segments the media file and generates an MPD file, and the Digital Human Server sends the MPD file to the MPD Server.

[0212] The address of the MPD in the MPD Server is the URI carried in the message sent in the above step 306.

[0213] Step 309: The Digital Human Server sends the generated media file segments to the Stream Server, and the saved address is the address described in the MPD file.

[0214] Step 310: The DVB-I Client sends a request to the MPD server to obtain the MPD file. Optionally, the DVB-I Client may determine the time to send the request according to the service data download delay information.

[0215] Step 311: The DVB-I Client sends a request to the Stream Server according to the MPD file to obtain media file segments.

[0216] Step 312: The DVB-I Client plays the acquired media segments.

[0217] In addition, it should be noted that if the service data is downloaded in a progressive manner, the Digital Human Server can directly generate media files and send the generated media files to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-IClient sends a request message to the Playlist Server to obtain service data.

[0218] The following steps will be repeated until the user ends the Digital Human service.

[0219] Step 313: The DVB-I Client collects user expression information.

[0220] The user expression information includes at least one of the following information: audio information, video information, and text information. The device where the DVB-I Client resides may use a camera or a microphone to collect the user expression information. Optionally, the DVB-I Client may convert the user's audio information and video information into text information as the user's expression information based on local analysis of the user input.

[0221] Step 314: The DVB-I Client sends the collected user expression information to the Uplink Server.

[0222] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0223] Step 315: Uplink Server sends the received user expression information to Digital Human Server.

[0224] Step 316: If the received message is a video or voice, the Digital Human Server will analyze it and convert it into text.

[0225] After the Digital Human Server performs semantic analysis, it generates a reply text (which requires the support of a large language model). The reply text drives the Digital Human model to generate a media file. If the media data is sent in an adaptive bitrate mode, the Digital Human Server will segment the media file.

[0226] Step 317: If the MPD file is in the timeline format, the Digital Human Server sends the updated MPD file to the MPD file.

[0227] If the MPD file is in Template format, step 317 does not need to be executed.

[0228] Step 318: The Digital Human Server sends the media segments to the Stream Server.

[0229] Step 319: If the MPD file is in the timeline format, the DVB-I Client requests the MPD Server for an updated MPD file, and the MPD Server returns the updated MPD file.

[0230] If the MPD file is in Template format, step 319 does not need to be executed.

[0231] Step 320: The DVB-I Client sends a request message to the Stream Server to obtain media segments according to the MPD file.

[0232] Step 321: The DVB-I Client plays the acquired media segments.

[0233] In addition, it should be noted that if the service data is downloaded in a progressive manner, the Digital Human Server can directly generate the digital human media file and send the media file to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-I Client sends a request message to the Playlist Server to obtain the service data.

[0234] Embodiment 2: A DVB-I client obtains service type indication information, service instance information, and associated application information of a virtual image service through a service list. DVB-I activates an application associated with the virtual image service. The application exchanges user selection information and user expression information with an application server, and then transmits the user selection information and user expression information to a server of the virtual image service through the application server. The server of the virtual image service generates media data associated with the virtual image service and provides it to the DVB-I client.

[0235] For details, see Figure 4To understand, take the data interaction of DVB-I client, Service List Server, StreamServer, Playlist Server, MPD Server, Application Server, Digital Human Server as an example to illustrate, where, when the media data is sent in an adaptive bit rate mode, Stream Server is used to store the media segmentation information of the virtual image service, such as: video segmentation, audio segmentation, etc. If it is a video segmentation, it can be understood as a video divided into multiple segments according to time, and it can also be understood as a video divided into multiple segments according to image frames; if it is an audio segmentation, it can be understood as a segment of audio divided into multiple segments according to audio frames, and MPD Server stores the MPD file information corresponding to the media segmentation, and the address of the media segmentation is described in the MPD file. Among them, the MPD Server address template can be indicated by the following methods: https: / / cdn.example.com / digitalhuman_$userid / dash / manifes.mpd, or https: / / cdn.example.com / digitalhuman_$ipaddress / dash / manifes.mpd. In the above-mentioned MPD Server address template, $userid and $ipaddress can be replaced with the user identifier and the IP address of the DVB-IClient. This application is only used as an example and does not specifically limit the form of the MPD Server address template. When downloading in a progressive manner, the Playlist Server is used to store media data for virtual image services. In addition, the address template of the media data is https: / / cdn.example.com / digitalhuman_$userid / dash / , or https: / / cdn.example.com / digitalhuman_$ipaddress / dash. Uplink Server is the destination address of the uplink data. When other streaming media formats send media data, the UL / DL Stream Server sends the media data while receiving the uplink data. Digital Human Server is the address of the virtual image service provider, and DigitalHuman Server belongs to the Service Provider. In specific implementation, Uplin Server and Digital HumanServer can be set up together or separately. Application Server is the destination address of the uplink data. Figure 4 Let’s take the virtual image business of digital human as an example.

[0236] Step 400, configure the service list.

[0237] In an optional embodiment, the Service Provider is manually configured offline, such as configuring the service list through the DigitalHuman Server. In another optional embodiment, the Service provider management function interacts with the Service list server to configure the service list. This application does not specifically limit how to configure the service list.

[0238] The following Table 2 shows a list of services applicable to the second embodiment, wherein Service Type indicates that the virtual image service is a digital human. Further, the virtual image service may be indicated as a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, or a sign language digital human. Service genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (that is, service instance information) include supported digital human types and service access parameters. The Digital human type parameter indicates the indication information of the digital human service type supported by the Service Instance, such as a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, or a sign language digital human. Linked Application indicates the associated application information of the virtual image service, such as an application that supports digital humans, which only supports uplink data transmission. The service access parameters include the download address information of the digital human's service data (the address of the MPD file in the MDP Server (adaptive bit rate transmission) or the address of the media file in the Playlist Server (progressive transmission)), the transmission protocol supported by the service data (such as HTTP, SRT, RTMP, WebSocket, etc.) and the service data download delay information (such as waiting 100 milliseconds to download the service data after sending the uplink data).

[0239] Table 2

[0240]

[0241] Step 401: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0242] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information according to the service type information, without feeding back all service lists to the DVB-I Client, which can improve data processing efficiency.

[0243] Step 402: The Service list server returns a response message to the DVB-I client.

[0244] If the request message in step 401 does not include the service type, the response message includes the service list information configured in step 400; if the request message in step 401 includes the service type, the hard answer message includes the service list information corresponding to the service type in step 401.

[0245] Step 403: The DVB-I Client presents user prompt information according to the service list information.

[0246] This can be understood by referring to the above step 303 and will not be described in detail here.

[0247] Step 404: The DVB-I Client activates the associated digital human application.

[0248] Step 405: The DVB-I Client sends a request message to the Application Server.

[0249] The information in the request message may be determined by referring to the above step 304, which will not be described in detail here.

[0250] Step 406: The Application Server returns a response message to the DVB-I Client. Optionally, the response message includes download address information of the digital human's service data.

[0251] If the service list information does not include the download address information URI of the digital person's service data, that is, the address template of the MPD file on the MPD Server or the address template of the media file on the Playlist Server, the ApplicationServer can dynamically generate a URI and feed the dynamically generated URI back to the DVB-I Client as the download address of the digital person's service data.

[0252] Step 407: The Application Server sends a message to the Digital Human Server.

[0253] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 405. If a URI is dynamically generated in step 406, the message also includes the URI.

[0254] Step 408: The Digital Human Server generates a media file of the digital human image according to the received information.

[0255] Specifically, Digital Human Server can determine whether to authorize the generation of customized digital human images based on the user's contract information. For example, if user A has signed a contract with the operator for the use of digital human services, or user A has signed a contract with the digital human service provider for the use of digital human services, then Digital Human Server can determine whether to authorize the generation of customized digital human images based on the contract information of user A. In addition, Digital Human Server can generate digital human images that meet the user's preferences based on the user's preference information. For example, if the user likes anime, a cartoon-like digital human can be generated.

[0256] Step 409: If the service data download adopts the adaptive bit rate mode, the Digital Human Server segments the generated media file and generates an MPD file, and the Digital Human Server sends the MPD file to the MPD Server.

[0257] The address where the MPD file is saved is the URI carried in the message sent in step 407 above.

[0258] Step 410: The Digital Human Server sends the generated media segments to the Stream Server, and the saved address is the address described in the MPD file.

[0259] Step 411: The DVB-I Client sends a request to the MPD server to obtain the MPD file.

[0260] Step 412: The DVB-I Client sends a request to the Stream Server according to the MPD file to obtain media file segments.

[0261] Step 413: The DVB-I Client plays the acquired media segments.

[0262] In addition, it should be noted that if the service data is downloaded in a progressive manner, the Digital Human Server can directly generate a digital human media file and send the media file to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-IClient sends a request message to the Playlist Server to obtain the service data.

[0263] The following steps will be repeated until the user ends the Digital Human service.

[0264] Step 414: The Digital Human application collects user expression information.

[0265] The user expression information includes at least one of the following information: audio information, video information and text information. The DVB-I Client can collect the user expression information through a resident device using a camera or a microphone. Optionally, the digital human application can convert the user expression information into text based on local analysis of user input.

[0266] Step 415: The Digital Human Application sends the collected user expression information to the Application Server.

[0267] Of course, the digital human application can also decide whether to convert user expression information into text based on the current network conditions.

[0268] Step 416: The Digital Human Application sends the received user expression information to the Digital Human Server.

[0269] Step 417: If the received message is a video or voice, the Digital Human Server will analyze it and convert it into text.

[0270] After the Digital Human Server performs semantic analysis, it generates a reply text (which requires the support of a large language model). The reply text drives the digital human model to generate a media file. If the adaptive bit rate method is used to send business data, the media file is segmented.

[0271] Step 418: If the MPD file is in the timeline format, the Digital Human Server sends the updated MPD file to the MPD server.

[0272] If the MPD file is in Template format, step 418 does not need to be executed.

[0273] Step 419: The Digital Human Server sends the media segments to the Stream Server.

[0274] Step 420: If the MPD file is in the timeline format, the DVB-I Client requests the MPD Server for an updated MPD file, and the MPD Server returns the updated MPD file.

[0275] If the MPD file is in Template format, step 420 does not need to be executed.

[0276] Step 421: The DVB-I Client sends a request message to the Stream Server to obtain media segments according to the MPD file.

[0277] Step 422: The DVB-I Client plays the acquired media segments.

[0278] In addition, it should be noted that if the service data is downloaded in a progressive manner, the Digital Human Server can directly generate a digital human media file and send the media file to the Playlist Server, saving the address as a dynamically generated URI or a previously issued address template. The DVB-IClient sends a request message to the Playlist Server to obtain the service data.

[0279] Embodiment 3: The DVB-I client obtains the service type indication information and service instance information of the virtual image service through the service list. According to the service instance information of the virtual image service, the DVB-I client exchanges data with the uplink and downlink servers (servers supporting two-way communication) to obtain user selection information and user expression information, and then transmits the user selection information and user expression information to the server of the virtual image service through the uplink and downlink servers. The server of the virtual image service generates media data associated with the virtual image service and provides it to the DVB-I client.

[0280] For details, see Figure 5 To understand, we take the data interaction between DVB-I client, Service List Server, UL / DL Stream Server, and Digital Human Server as an example, where UL / DL StreamServer is the medium for message interaction between DVB-I client and Digital Human Server. Digital HumanServer is the address of the virtual image service provider, and Digital Human Server belongs to Service Provider. Figure 5 Let’s take the virtual image business of digital human as an example.

[0281] Step 500, configure the service list.

[0282] In an optional embodiment, the Service Provider is manually configured offline, such as configuring the service list through the DigitalHuman Server. In another optional embodiment, the Service provider management function interacts with the Service list server to configure the service list. This application does not specifically limit how to configure the service list.

[0283] The following Table 3 shows a list of services applicable to the third embodiment, where Service Type indicates that the virtual image service is a digital human, and the service genre indicates the service type of the digital human, such as sightseeing, food, etc. ServiceInstances (that is, service instance information) include supported digital human types and bidirectional transmission parameters (that is, service access parameters, understood here as bidirectional communication access parameters). The Digital human type parameter represents the indication information of the digital human service type supported by the Service Instance, such as 2D digital human, 3D digital human, cartoon digital human, real-life digital human, customized digital human, sign language digital human, etc. BidirectionalDeliveryParameters includes bidirectional transmission parameters, the destination address URI of the uplink and downlink data, supported transmission protocols (such as HTTP, SRT, RTMP, WebSocket, etc.) and supported media types, including video, voice or text.

[0284] Table 3

[0285]

[0286] Step 501: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0287] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information according to the service type information, without feeding back all service lists to the DVB-I Client, which can improve data processing efficiency.

[0288] Step 502: The Service list server returns a response message to the DVB-I client.

[0289] If the request message in step 501 does not include the service type, the response message includes the service list information configured in step 500; if the request message in step 501 includes the service type, the hard answer message includes the service list information corresponding to the service type in step 501.

[0290] Step 503: The DVB-I Client presents user prompt information according to the service list information.

[0291] Specifically, the user prompt information can prompt the user to select a specific virtual image service, such as please select a virtual image service type, and can also prompt the user to select a service type of a specific virtual image service, such as welcome to use the digital human service, please select the digital human service type 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human, etc. This is only an illustrative explanation and is not specifically limited.

[0292] Step 504: The DVB-I Client sends a request message to the UL / DL Server according to the access address information of the service data and the supported transmission protocol.

[0293] Optionally, the request message includes a user identifier, a device identifier, user preference information, a virtual image type selected by the user, and a language selected by the user. Among them, the user identifier can be understood as the identifier of the DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client, and is only exemplified here. User preference information is usually information collected based on the user's historical operating habits. For example, if the user likes to watch sports live broadcasts, the Digital HumanServer can recommend a digital human wearing sportswear. The virtual image type selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc. This is only an illustrative description and does not specifically limit the above request message.

[0294] Step 505: UL / DL Stream Sever sends a message to Digital Human Server.

[0295] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 504 .

[0296] Step 506: The Digital Human Server generates a digital human image media file (such as a video) according to the received information.

[0297] Specifically, Digital Human Server can determine whether to authorize the generation of customized digital human images based on the user's contract information. For example, if user A has signed a contract with the operator for the use of digital human services, or user A has signed a contract with the digital human service provider for the use of digital human services, then Digital Human Server can determine whether to authorize the generation of customized digital human images based on the contract information of user A. In addition, Digital Human Server can generate digital human images that meet the user's preferences based on the user's preference information. For example, if the user likes anime, a cartoon-like digital human can be generated.

[0298] Step 507: The Digital Human Server sends the generated digital human image media file to the UL / DL Stream Sever.

[0299] Step 508: UL / DL Stream Sever sends the digital human image media file (eg, video) to the DVB-I Client.

[0300] Step 509: The DVB-I Client plays the acquired digital human image media file.

[0301] The following steps will be repeated until the user ends the Digital Human service.

[0302] Step 510: The user interacts with the DVB-I Client through user expression information.

[0303] The user expression information includes at least one of the following information: audio information, video information and text information. The DVB-I Client may collect the user expression information using a camera or a microphone. The DVB-I Client may convert the user expression information into text based on local analysis of the user input.

[0304] Step 511: The DVB-I Client sends the converted text of the collected user expression information to the UL / DL Stream Sever.

[0305] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0306] Step 512: UL / DL Stream Sever sends the received user expression information to Digital Human Server.

[0307] Step 513: If the received message is a video or voice, the Digital Human Server will analyze it and convert it into text.

[0308] After the Digital Human Server performs semantic analysis, it generates a reply text (which requires the support of a large language model). The reply text drives the digital human model, generates media files, and performs media segmentation.

[0309] Step 514: The Digital Human Server sends the generated media file (eg, video) to the UL / DL Stream Sever.

[0310] Specifically, the media file can be understood as a media file associated with the user's expression information. For example, if the user's expression information is to obtain an explanation of a *** scenic spot, the media file can be a video of the digital person obtained in step 509 explaining the *** scenic spot. If the user's expression information is to obtain a cartoon-like digital person, if the digital person obtained in step 509 is not a cartoon-like digital person, the digital person in step 509 can be dressed up or otherwise processed based on the user's expression information to generate a cartoon-like digital person.

[0311] Step 515: UL / DL Stream Sever sends the generated media file (eg, video) to the DVB-I Client.

[0312] Step 516: The DVB-I Client plays the received media file (eg, video).

[0313] Embodiment 4: A DVB-I client obtains service type indication information of a virtual image service and an application associated with the virtual image service through a service list. DVB-I activates the application associated with the virtual image service. The application exchanges user selection information and user expression information with an application server, and then transmits the user selection information and user expression information to a server of the virtual image service through the application server. The server of the virtual image service generates media data related to the virtual image service and feeds it back to the DVB-I client.

[0314] For details, see Figure 6 To understand, take the data interaction among DVB-I client, Service List Server, Application Server and Digital Human Server as an example to illustrate that Digital HumanServer belongs to Service Provider. Figure 6 Let’s take the virtual image business of digital human as an example.

[0315] Step 600, configure the service list.

[0316] In an optional embodiment, the Service Provider is manually configured offline, such as configuring the service list through the DigitalHuman Server. In another optional embodiment, the Service provider management function interacts with the Service list server to configure the service list. This application does not specifically limit how to configure the service list.

[0317] Table 4 below shows a list of services applicable to the fourth embodiment, wherein Service Type indicates that the virtual image service is a digital human, and further, the virtual image service may be indicated as a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, or a sign language digital human. Service genre indicates the service type of the digital human, such as sightseeing, food, etc. Linked Application indicates the associated application information of the virtual image service, such as an application that supports digital human, and the application supports uplink data transmission and acquisition and playback of service data.

[0318] Table 4

[0319]

[0320] Step 601: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0321] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information according to the service type information, without feeding back all service lists to the DVB-I Client, which can improve data processing efficiency.

[0322] Step 602: The Service list server returns a response message to the DVB-I client.

[0323] If the request message in step 601 includes a service type, the response message includes service list information corresponding to the service type in step 601 .

[0324] Step 603: The DVB-I Client presents user prompt information according to the service list information.

[0325] This can be understood by referring to the above step 303 and will not be described in detail here.

[0326] Step 604: The DVB-I Client activates the associated digital human application.

[0327] Step 605: The DVB-I Client sends a request message to the Application Server.

[0328] The information in the request message may be determined by referring to the above step 304, which will not be described in detail here.

[0329] Step 606: The Application Server sends a message to the Digital Human Server.

[0330] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 605 .

[0331] Step 607: The Digital Human Server generates a digital human image media file according to the received information.

[0332] Specifically, Digital Human Server can determine whether to authorize the generation of customized digital human images based on the user's contract information. For example, if user A has signed a contract with the operator for the use of digital human services, or user A has signed a contract with the digital human service provider for the use of digital human services, then Digital Human Server can determine whether to authorize the generation of customized digital human images based on the contract information of user A. In addition, Digital Human Server can generate digital human images that meet the user's preferences based on the user's preference information. For example, if the user likes anime, a cartoon-like digital human can be generated.

[0333] Step 608: The Digital Human Server sends the generated digital human image media file to the Application Server.

[0334] Step 609: Application Server sends the digital human image media file to the application.

[0335] Step 610: The application plays the digital human image media file.

[0336] The following steps will be repeated until the user ends the Digital Human service.

[0337] Step 611: The Digital Human application collects the user's expression information.

[0338] The user expression information includes at least one of the following information: audio information, video information and text information. The DVB-I Client can collect the user expression information using a camera or a microphone. The digital human application can convert the user expression information into text based on local analysis of the user input.

[0339] Step 612: The Digital Human Application sends the converted text of the collected user expression information to the Application Server.

[0340] Of course, the digital human application can also decide whether to convert user expression information into text based on the current network conditions.

[0341] Step 613: Application Server sends the received user expression information to Digital Human Server.

[0342] Step 614: If the received message is a video or voice, the Digital Human Server will analyze it and convert it into text.

[0343] After the Digital Human Server performs semantic analysis, it generates a reply text (which requires the support of a large language model). The reply text drives the digital human model and generates a media file.

[0344] Step 615: The Digital Human Server sends the generated media file to the Application Server.

[0345] Specifically, the media file can be understood as a media file associated with the user's expression information. For example, if the user's expression information is to obtain an explanation of a *** scenic spot, the video can be a video of the digital person obtained in step 610 explaining the *** scenic spot. If the user's expression information is to obtain a cartoon-like digital person, if the digital person obtained in step 610 is not a cartoon-like digital person, the digital person in step 610 can be dressed up or otherwise processed based on the user's expression information to generate a cartoon-like digital person.

[0346] Step 616: The Application Server sends the generated media file to the application.

[0347] Step 617: The application plays the received media file.

[0348] Embodiment 5: The DVB-I client obtains the service type indication information of the virtual image service and the service instance information of the virtual image service through the service list. According to the service instance information of the virtual image service, the DVB-I client exchanges data with the uplink server for user selection information and user expression information, and then transmits the user selection information and user expression information to the server of the virtual image service through the uplink server. The server of the virtual image service generates media data related to the virtual image service and feeds it back to the DVB-I client.

[0349] For details, see Figure 7 To understand, the data interaction among DVB-I client, Service List Server, Uplink Server, Downlink Server, and Digital Human Server is used as an example to illustrate. Figure 7 Let’s take the virtual image business of digital human as an example.

[0350] Step 700, configure the service list.

[0351] In an optional embodiment, the Service Provider is manually configured offline, such as configuring the service list through the DigitalHuman Server. In another optional embodiment, the Service provider management function interacts with the Service list server to configure the service list. This application does not specifically limit how to configure the service list.

[0352] Table 5 below shows a list of services applicable to the fifth embodiment, wherein Service Type indicates that the virtual image service is a digital human. Further, Service Type can be further refined to indicate that the virtual image service is a 2D digital human, a 3D digital human, a cartoon digital human, a real digital human, a customized digital human, and a sign language digital human. Service genre indicates the service type of the digital human, such as sightseeing, food, etc. Service Instances (i.e., service instance information) include supported digital human types, uplink transmission parameters, and service access parameters (i.e., the download address of the service data). Among them, if Service Type only indicates that it is a digital human, then the Digital human type parameter indicates the indication information of the digital human service type supported by Service Instance, which can be a further refinement of Service Type, such as 2D digital human, 3D digital human, cartoon digital human, real digital human, customized digital human, sign language digital human, etc. UplinkDeliveryParameters includes at least one of the following information: the destination address URI of the uplink data, the transmission protocol supported by the uplink data (such as HTTP, SRT, RTMP, WebSocket, etc.), and the media type supported by the uplink data, such as video, voice or text. (Information not provided can be defined in a standardized manner or determined by configuration) Business access parameters include access address information for digital human business data (template for downstream streaming address, such as https: / / cdn.example.com / digitalhuman_$userid / RTMP / ), the transmission protocol supported by the business data. ContentAttribute indicates the languages ​​supported by the digital human business, such as Chinese, English, Chinese sign language, etc.

[0353] Table 5

[0354]

[0355] Step 701: The DVB-I Client sends a request message to the Service List server, where the request message is used to request to obtain a service list.

[0356] Optionally, the request message carries the requested service type, such as digital human. If the request message carries the requested service type, the Service List server can search for the corresponding service list information according to the service type information, without feeding back all service lists to the DVB-I Client, which can improve data processing efficiency.

[0357] Step 702: The Service list server returns a response message to the DVB-I client, wherein the response message includes a service list, wherein the service list includes the service information in Table 1.

[0358] If the request message in step 701 includes a service type, the hard answer message only includes the service list information corresponding to the service type in step 701 .

[0359] Step 703: The DVB-I Client presents information of each service included in the service list to the user according to the service list.

[0360] Specifically, the information presented may prompt the user to select a specific avatar service, such as the avatar service type, service provider, genre of the avatar service, etc. Specifically, the service type of the avatar service may be a 2D digital human, a 3D digital human, a cartoon digital human, a real-life digital human, a customized digital human, a sign language digital human, etc., which are merely illustrative and not specifically limited.

[0361] Step 704: The DVB-I Client sends a request message to the Uplink Server according to the destination address URI of the uplink data and the supported transmission protocol.

[0362] Optionally, the request message includes one or more information of a user identifier, a device identifier, user preference information, a virtual image type selected by the user, and a language selected by the user. Among them, the user identifier can be understood as the user identifier of the DVB-I Client, which can identify the identity information, network access information, etc. of the DVB-I Client, and is only exemplified here. The device identifier is the identifier or IP address of the device where the DVB-I Client resides. User preference information is usually information collected based on the user's historical operating habits or parameters set by the user. For example, if the user likes to watch sports live broadcasts when watching live broadcasts, the Digital Human Server can recommend a digital human wearing sportswear. The virtual image type selected by the user can be a cartoon digital human, etc. The language selected by the user can be Chinese, English, Korean, etc., and can also be Chinese sign language. This is only an illustrative description, and the above request message is not specifically limited.

[0363] Step 705: The Uplink Server returns a response message to the DVB-I Client. Optionally, the response message includes access address information of the service data of the digital human.

[0364] If the service list information does not include the access address information URI and address template of the digital person's service data, the Uplink Server can dynamically generate a URI and feed the dynamically generated URI back to the DVB-I Client as the download address of the digital person's service data.

[0365] Step 706: The DVB-I Client sends a request message to the Downlink Server according to the address template or the address information received in the response message to establish a long transmission connection.

[0366] Step 707: Downlink Server returns a response message to DVB-I Client

[0367] Step 708: The Uplink Server sends a message to the Digital Human Server.

[0368] The message includes the information received from the DVB-I Client, that is, the content of the request message in step 304. In addition, the message also includes the address confirmed according to the address template or the address URI generated in step 705.

[0369] Step 709: The Digital Human Server generates a digital human image media file according to the received information.

[0370] Specifically, Digital Human Server can determine whether to authorize the generation of customized digital human images based on the user's contract information. For example, if user A has signed a contract with the operator for the use of digital human services, or user A has signed a contract with the digital human service provider for the use of digital human services, then Digital Human Server can determine whether to authorize the generation of customized digital human images based on the contract information of user A. In addition, Digital Human Server can generate digital human images that meet the user's preferences based on the user's preference information. For example, if the user likes anime, a cartoon-like digital human can be generated.

[0371] Step 710: The Digital Human Server sends the media file to the Downlink Server. The message also includes the received address information.

[0372] Step 711: The Downlink Server determines a connection to be established according to the address information, and the Downlink Server sends a media file to the DVB-I Client through the connection.

[0373] Step 712: The DVB-I Client plays the acquired media segments.

[0374] The following steps will be repeated until the user ends the Digital Human service.

[0375] Step 713: The DVB-I Client collects user expression information.

[0376] The user expression information includes at least one of the following information: audio information, video information, and text information. The device where the DVB-I Client resides may use a camera or a microphone to collect the user expression information. Optionally, the DVB-I Client may convert the user's audio information and video information into text information as the user's expression information based on local analysis of the user input.

[0377] Step 714: The DVB-I Client sends the collected user expression information to the Uplink Server.

[0378] Of course, the DVB-I Client can also decide whether to convert the user's expression information into text according to the current network conditions.

[0379] Step 715: Uplink Server sends the received user expression information to Digital Human Server.

[0380] Step 716: The Digital Human Server generates a media file based on the expression information. If the received information is a video or voice, the Digital Human Server analyzes it and converts it into text.

[0381] After the Digital Human Server performs semantic analysis, it generates a reply text (which requires the support of a large language model). The reply text drives the digital human model and generates a media file.

[0382] Step 717: The Digital Human Server sends the media file to the Downlink Server.

[0383] Step 718: The Downlink Server sends the media file to the DVB-I Client through the established connection.

[0384] Step 719: The DVB-I Client plays the acquired media file.

[0385] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of device interaction. It is understandable that, in order to implement the above functions, each device may include a hardware structure and / or software module corresponding to each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0386] The embodiment of the present application can divide the functional units of the device according to the above method example, for example, each functional unit can be divided according to each function, or two or more functions can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0387] In the case of an integrated unit, Figure 8 A possible exemplary block diagram of a data processing device involved in an embodiment of the present application is shown. Figure 8 As shown, the data processing device 800 may include: a processing unit 801 and a transceiver unit 802. The processing unit 801 is used to control and manage the actions of the data processing device 800. The transceiver unit 802 is used to support the communication between the data processing device 800 and other devices. Optionally, the transceiver unit 802 may include a receiving unit and / or a sending unit, which are respectively used to perform receiving and sending operations. Optionally, the data processing device 800 may also include a storage unit for storing the program code and / or data of the data processing device 800. The transceiver unit may be called an input-output unit, a communication unit, etc., and the transceiver unit may be a transceiver; the processing unit may be a processor. When the data processing device is a module (such as a chip) in a communication device, the transceiver unit may be an input-output interface, an input-output circuit or an input-output pin, etc., and may also be called an interface, a communication interface or an interface circuit, etc.; the processing unit may be a processor, a processing circuit or a logic circuit, etc. Specifically, the device may be the above-mentioned terminal and the first server of the service provider, etc.

[0388] In one embodiment, the data processing device is a terminal, wherein the transceiver unit 802 is used to obtain a service list including service information of a virtual image service; and the processing unit 801 is used to access the virtual image service according to the service information.

[0389] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0390] In an optional manner, when the service information includes service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0391] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0392] In an optional manner, the service instance information includes service access parameters in addition to the above-mentioned uplink transmission parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0393] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0394] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0395] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0396] In an optional manner, the transceiver unit 802 is specifically configured to send a first message according to the service information, where the first message is used to request a virtual image service; and receive a response message to the first message.

[0397] In an optional manner, the first message includes at least one of the following information: user identification, device identification, user preference information, the type of avatar selected by the user, and the language selected by the user.

[0398] In an optional manner, the transceiver unit 802 is further configured to send a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; and receive a response message to the second message.

[0399] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0400] In an optional manner, the transceiver unit 802 is further used to receive first business data of the virtual image business, where the first business data is business data generated by the virtual image business server according to the first message; the processing unit 801 is further used to play the business according to the first business data.

[0401] In an optional manner, the transceiver unit 802 is further used to receive second business data of the virtual image business, where the second business data is business data generated by the virtual image business server according to the second message; the processing unit 801 is further used to play the business according to the second business data.

[0402] In an optional manner, the transceiver unit 802 is further configured to send a third message to the address information of the service data for accessing the virtual image service; and receive a response message to the third message, wherein the response message includes the first service data.

[0403] In an optional manner, the transceiver unit 802 is also used to send a fourth message to the address information of the business data for accessing the virtual image business; receive a response message to the fourth message, and the response message to the fourth message includes a media presentation description file of the virtual image business; the processing unit 801 is also used to request the first business data according to the media presentation description file.

[0404] In an optional manner, when the service information includes application information associated with the virtual image service, the processing unit 801 is further configured to activate an application associated with the virtual image service.

[0405] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0406] In one embodiment, the data processing device is a first server, wherein the transceiver unit 802 is used to receive first information, the first information is used to request a virtual image service; the processing unit 801 is used to generate first business data of the virtual image service according to the first information; the transceiver unit 802 is also used to provide the first business data.

[0407] In an optional manner, the first information includes at least one of the following information: user identification, device identification, user preference information, a virtual image type selected by the user, and a language selected by the user.

[0408] In an optional manner, the processing unit 801 is further used to configure a service list of the service list server, where the service list includes service information of the virtual image service.

[0409] In an optional manner, the service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

[0410] In an optional manner, when the service information is service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

[0411] In an optional manner, the uplink transmission parameter also includes a transmission protocol supported by the uplink data and / or a media type supported by the uplink data.

[0412] In an optional manner, the service instance information further includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0413] In an optional manner, when the service information includes service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0414] In an optional manner, when the service information includes service instance information and associated application information of the virtual image service, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

[0415] In an optional manner, the service access parameter also includes a transmission protocol supported by the service data and / or a media type supported by the service data.

[0416] In an optional manner, the transceiver unit 802 is also used to receive second information, the second information includes user expression information collected by the terminal; the processing unit 801 is also used to generate second business data of the virtual image business based on the second information; the transceiver unit 802 is also used to provide second business data.

[0417] In an optional manner, the user expression information includes at least one of the following information: audio information, video information and text information.

[0418] In an optional manner, the service type indication information includes at least one of the following indication information: digital human, 2D digital human, 3D digital human, cartoon image digital human, real-life image digital human, customized digital human, sign language digital human.

[0419] like Fig. 9As shown, a data processing device 900 is also provided in the present application. The data processing device 900 may be a chip or a chip system. The data processing device may be located in a device involved in any of the above method embodiments, such as a terminal, a service provider, etc., to perform actions corresponding to the device.

[0420] Optionally, the chip system may consist of the chip, or may include the chip and other discrete devices.

[0421] The data processing device 900 includes a processor 910 .

[0422] The processor 910 is used to execute the computer program stored in the memory 920 to implement the actions of each device in any of the above method embodiments.

[0423] The data processing device 900 may further include a memory 920 for storing computer programs.

[0424] Optionally, the memory 920 is coupled to the processor 910. Coupling is an indirect coupling or communication connection between devices, units or modules, which can be electrical, mechanical or other forms, and is used for information exchange between devices, units or modules. Optionally, the memory 920 is integrated with the processor 910.

[0425] The processor 910 and the memory 920 may be one or more and are not limited.

[0426] Optionally, in practical applications, the data processing device 900 may include a transceiver 930, or may not include the transceiver 930, which is illustrated by a dotted box in the figure. The data processing device 900 may exchange information with other devices through the transceiver 930. The transceiver 930 may be a circuit, a bus, a transceiver, or any other device that can be used for information exchange.

[0427] In a possible implementation, the data processing device 900 may be the first satellite or ground equipment in the implementation of the above methods.

[0428] The specific connection medium between the transceiver 930, the processor 910 and the memory 920 is not limited in the embodiment of the present application. Fig. 9 The memory 920, the processor 910 and the transceiver 930 are connected by a bus. Fig. 9 The connections between the other components are shown in bold lines, which are only for illustration and are not intended to be limiting. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9Only one thick line is used to represent it, but it does not mean that there is only one bus or one type of bus. In the embodiment of the present application, the processor can be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the methods, steps and logic block diagrams disclosed in the embodiment of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware processor for execution, or can be executed by a combination of hardware and software modules in the processor.

[0429] In the embodiment of the present application, the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or a volatile memory (volatile memory), such as a random-access memory (RAM). The memory may also be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory in the embodiment of the present application may also be a circuit or any other device that can implement a storage function, for storing computer programs, program instructions and / or data.

[0430] Based on the above embodiments, see Fig.10 The embodiment of the present application also provides another data processing device 1000, including: an interface circuit 1010 and a logic circuit 1020; the interface circuit 1010 can be understood as an input and output interface, which can be used to execute the sending and receiving steps of each device in any of the above method embodiments; the logic circuit 1020 can be used to run codes or instructions to execute the method executed by each device in any of the above embodiments, which will not be repeated.

[0431] Based on the above embodiments, the embodiments of the present application further provide a computer-readable storage medium, which stores instructions. When the instructions are executed, the method executed by each device in any of the above method embodiments is implemented. The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk, and other media that can store program codes.

[0432] Based on the above embodiments, an embodiment of the present application provides a communication system, which includes the terminal and service provider mentioned in any of the above method embodiments, and can be used to execute the method executed by each device in any of the above method embodiments.

[0433] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, compact disc read-only memory (CD-ROM), optical storage, etc.) containing computer-usable program codes.

[0434] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0435] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0436] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

Claims

1. A data processing method, applied to a terminal, characterized in that: include: Acquire a service list, wherein the service list includes service information of a virtual image service; The virtual image service is accessed according to the service information.

2. The method according to claim 1, characterized in that The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

3. The method according to claim 2, characterized in that When the service information includes the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

4. The method according to claim 3, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

5. The method according to claim 2, characterized in that: When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

6. The method according to claim 2, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information for accessing service data of the virtual image service.

7. The method according to any one of claims 1 to 6, characterized in that: The accessing the virtual image service according to the service information includes: Sending a first message according to the service information, where the first message is used to request the virtual image service; A response message to the first message is received.

8. The method according to claim 7, characterized in that The first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

9. The method according to any one of claims 2 to 8, characterized in that: Also includes: Sending a second message according to the service information, wherein the second message includes the user expression information collected by the terminal; A response message to the second message is received.

10. The method according to claim 7 or 8, characterized in that: Also includes: receiving first service data of the virtual image service, where the first service data is service data generated by the virtual image service server according to the first message; The service is played according to the first service data.

11. The method according to claim 9, characterized in that Also includes: receiving second service data of the virtual image service, where the second service data is service data generated by the virtual image service server according to the second message; The service is played according to the second service data.

12. The method according to claim 10, characterized in that Also includes: Sending a third message to the address information of the service data for accessing the virtual image service; A response message to the third message is received, wherein the response message includes the first service data.

13. The method according to claim 10, characterized in that Also includes: Sending a fourth message to the address information of the service data for accessing the virtual image service; receiving a response message to the fourth message, wherein the response message to the fourth message includes a media presentation description file of the virtual image service; The first service data is requested according to the media presentation description file.

14. The method according to claim 2 or 6, characterized in that: When the service information includes associated application information of the virtual image service, the method further includes: Activate an associated application of the virtual image service.

15. A data processing method, applied to a first server, characterized in that: include: receiving first information, wherein the first information is used to request a virtual image service; generating first business data of the virtual image business according to the first information; The first service data is provided.

16. The method according to claim 15, characterized in that The first information includes at least one of the following information: user identification, device identification, user preference information, a virtual image type selected by the user, and a language selected by the user.

17. The method according to claim 15 or 16, characterized in that Also includes: A service list of the service list server is configured, wherein the service list includes service information of the virtual image service.

18. The method according to claim 17, characterized in that The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

19. The method according to claim 18, characterized in that When the service information is the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

20. The method according to claim 19, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

21. The method according to claim 18, characterized in that When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

22. The method according to claim 18, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information for accessing service data of the virtual image service.

23. The method according to claim 15, characterized in that Also includes: receiving second information, wherein the second information includes user expression information collected by the terminal; generating second business data of the virtual image business according to the second information; The second service data is provided.

24. A data processing method, characterized in that: include: The terminal obtains a service list from the service list server, wherein the service list includes service information of the virtual image service; The terminal sends first information to a first server of the virtual image service according to the service information, wherein the first information is used to request the virtual image service; The first server generates first service data of the virtual image service according to the first information; The first server provides the first service data to the terminal; The terminal plays a service according to the first service data.

25. The method according to claim 24, characterized in that Also includes: The terminal sends second information to the first server according to the service information, wherein the second information includes user expression information collected by the terminal; The first server generates second service data of the virtual image service according to the second information; The first server provides the second service data to the terminal; The terminal plays the service according to the second service data.

26. The method according to claim 24, characterized in that The first server providing the first service data to the terminal includes: The first server stores the first service data, wherein a first address storing the first service data corresponds to address information of the service data for accessing the virtual image service acquired by the terminal; The terminal obtains the first service data from the first address.

27. The method according to claim 26, characterized in that The terminal acquiring the first service data from the first address includes: The terminal sends a third message according to the address information of the service data for accessing the virtual image service; The terminal receives a response message to the third message, where the response message includes the first service data.

28. The method according to claim 24, characterized in that The first server provides the first service data, including: The first server stores a media presentation file generated when slicing the first business data, wherein a second address of the media presentation file corresponds to address information of business data for accessing the virtual image business acquired by the terminal, and the first server further stores the slicing of the first business data, wherein a third address of the slicing storing the first business data corresponds to an address described in the media presentation file; The method further comprises: The terminal sends a fourth message according to the address information of the service data for accessing the virtual image service; The terminal receives a response message to the fourth message, wherein the response message includes the media presentation description file; The terminal requests the first service data according to the media presentation description file.

29. The method according to any one of claims 24 to 28, characterized in that: The service information includes at least one of the following information: service type indication information of the virtual image service, service instance information of the virtual image service, and associated application information of the virtual image service.

30. The method according to claim 29, characterized in that When the service information includes the service instance information, the service instance information includes uplink transmission parameters, wherein the uplink transmission parameters include destination address information of uplink data.

31. The method according to claim 30, characterized in that The service instance information also includes service access parameters, and the service access parameters include address information of the service data for accessing the virtual image service.

32. The method according to claim 29, characterized in that When the service information includes the service instance information, the service instance information includes service access parameters, and the service access parameters include address information for accessing service data of the virtual image service.

33. The method according to claim 29, characterized in that When the service information includes the service instance information and the associated application information of the virtual image service, the service instance information includes a service access parameter, and the service access parameter includes address information of the service data for accessing the virtual image service.

34. The method according to claim 29 or 33, characterized in that When the service information includes associated application information of the virtual image service, the method further includes: Activate an associated application of the virtual image service installed on the terminal.

35. The method according to any one of claims 24 to 34, characterized in that: The first message includes at least one of the following information: user identification, device identification, user preference information, user-selected avatar type, and user-selected language.

36. A communication device, characterized in that: include: at least one processor and memory; The memory is used to store computer programs or instructions; The at least one processor is configured to execute the computer program or instructions so that the method according to any one of claims 1 to 35 is performed.

37. A chip system, characterized in that: The chip system comprises: a processing circuit; the processing circuit is coupled to a storage medium; The processing circuit is used to execute part or all of the computer programs or instructions in the storage medium, and when the part or all of the computer programs or instructions are executed, it is used to implement the method as described in any one of claims 1-35.

38. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed by a computer, the method according to any one of claims 1 to 35 is executed.

39. A computer program product comprising a computer program or instructions, characterized in that When it is run on a computer, the method described in any one of claims 1 to 35 is executed.

Images