Voice data transmission method, device, equipment, storage medium and product

Abstract

The application provides a voice data transmission method, device, equipment, storage medium and product, and is applied to the field of data transmission. The method is applied to an electronic device, and includes: obtaining control data in a label language format to be transmitted; the control data includes voice broadcast control data; translating the control data in the label language format into control data in a json format according to a pre-defined format specification; and sending the control data in the json format to a user terminal, so that the user terminal translates the control data in the json format into control data in the label language based on the pre-defined format specification, and performs voice broadcast based on the control data in the label language. The pre-defined json format specification is used for describing the label language, the control data in the label language format can be quickly translated into the control data in the json format, so that the control data can be transmitted in the json format, and the transmission speed of the control data in the label language format is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data transmission, and in particular to a voice data transmission method, device, equipment, storage medium and product. BACKGROUND

[0002] With the continuous progress of speech synthesis technology and streaming media technology, the application of synthesized voice and the application of synthesized digital people are also rising. For example, the voice-to-text communication scenario in social software applications, such as digital people in short video applications for synchronous live broadcast reporting, etc.

[0003] Currently, digital people are usually driven by DRML / SSML tag language, and the DRML / SSML tag language cannot be used to transmit data. Therefore, after the server generates control data in the format of the tag language for driving the digital people, the control data in the format of the tag language needs to be parsed into a string, and then the string is sent to the user terminal. The user terminal parses the string to generate control data in the format of the tag language for driving the digital people. Since the control data for driving the digital people may include voice data, the process of parsing the control data including voice data into a string and parsing the string into control data including voice data is complex, resulting in low transmission efficiency of the control data in the format of the tag language. SUMMARY

[0004] The present application provides a voice data transmission method, device, equipment, storage medium and product to solve the problem that the process of parsing control data including voice data into a string and parsing the string into control data including voice data is complex, resulting in low transmission efficiency of the control data in the format of the tag language.

[0005] In a first aspect, the present application provides a voice data transmission method applied to an electronic device, comprising:

[0006] obtaining control data in the format of a tag language to be transmitted; the control data including voice broadcast control data;

[0007] translating the control data in the format of the tag language into control data in the format of json according to a pre-defined format specification;

[0008] sending the control data in the format of json to a user terminal, so that the user terminal translates the control data in the format of json into control data in the format of the tag language according to the pre-defined format specification, and performs voice broadcast based on the control data in the format of the tag language.

[0009] In a second aspect, the present application provides a voice data transmission method applied to a user terminal, comprising:

[0010] acquire the control data in the JSON format sent by the electronic device; the control data in the JSON format is formed by the electronic device translating the control data in the tag language format to be transmitted according to a pre-defined format specification; the control data includes voice broadcast control data;

[0011] translate the control data in the JSON format into the control data in the tag language based on the pre-defined format specification;

[0012] perform voice broadcast based on the control data in the tag language.

[0013] In a third aspect, the present application provides a voice data transmission device applied to an electronic device, comprising:

[0014] an acquisition module, configured to acquire the control data in the tag language format to be transmitted; the control data includes voice broadcast control data;

[0015] a translation module, configured to translate the control data in the tag language format into the control data in the JSON format according to a pre-defined format specification;

[0016] a sending module, configured to send the control data in the JSON format to a user terminal, so that the user terminal translates the control data in the JSON format into the control data in the tag language based on the pre-defined format specification, and performs voice broadcast based on the control data in the tag language.

[0017] In a fourth aspect, the present application provides a voice data transmission device applied to a user terminal, comprising:

[0018] an acquisition module, configured to acquire the control data in the JSON format sent by an electronic device; the control data in the JSON format is formed by the electronic device translating the control data in the tag language format to be transmitted according to a pre-defined format specification; the control data includes voice broadcast control data;

[0019] a translation module, configured to translate the control data in the JSON format into the control data in the tag language based on the pre-defined format specification;

[0020] a control module, configured to perform voice broadcast based on the control data in the tag language.

[0021] In a fifth aspect, the present application provides an electronic device, comprising a processor, and a memory and a transceiver connected in communication with the processor;

[0022] the memory stores computer execution instructions; and the transceiver is configured to transceive data;

[0023] The processor executes the computer-executable instructions stored in the memory to implement the voice data transmission method in the first aspect.

[0024] In a sixth aspect, the present application provides a user terminal comprising: a processor, and a memory and a transceiver connected in communication with the processor;

[0025] The memory stores computer-executable instructions; and the transceiver is configured to transmit and receive data.

[0026] The processor executes the computer-executable instructions stored in the memory to implement the voice data transmission method in the second aspect.

[0027] In a seventh aspect, the present application provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the voice data transmission method in the first or second aspect.

[0028] In an eighth aspect, the present application provides a computer program product comprising computer-executable instructions, which, when executed by a processor, implement the voice data transmission method in the first or second aspect.

[0029] The voice data transmission method, device, equipment, storage medium and product provided by the present application are applied to an electronic device, comprising: obtaining control data in a label language format to be transmitted; the control data comprises voice broadcast control data; translating the control data in the label language format into control data in a json format according to a pre-defined format specification; and sending the control data in the json format to a user terminal, so that the user terminal translates the control data in the json format into control data in the label language according to the pre-defined format specification, and performs voice broadcast based on the control data in the label language. The pre-defined json format specification is used to describe the label language, and the quick translation of the control data in the label language format and the control data in the json format can be realized, so that the control data can be transmitted in the json format, and the transmission speed of the control data in the label language format is improved. BRIEF DESCRIPTION OF DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and serve to explain the principles of the present application together with the specification.

[0031] Figure 1 The application scenario schematic diagram provided for the embodiments of the present application;

[0032] Figure 2 The voice data transmission method flowchart provided for the first embodiment of the present application;

[0033] Figure 3 A flow chart of a voice data transmission method provided for Embodiment Two of the present application;

[0034] Figure 4 A voice data transmission signaling diagram provided for the present application;

[0035] Figure 5 A bottom layer architecture diagram provided for the present application;

[0036] Figure 6 A structural schematic diagram of a voice data transmission device provided for Embodiment Three of the present application;

[0037] Figure 7 A structural schematic diagram of a voice data transmission device provided for Embodiment Four of the present application;

[0038] Figure 8 A structural schematic diagram of an electronic device provided for Embodiment Five of the present application;

[0039] Figure 9 A structural schematic diagram of a user terminal provided for Embodiment Five of the present application.

[0040] The specific embodiments of the present application have been shown through the above-described drawings, and will be described in more detail hereinafter. These drawings and written descriptions are not intended to limit the scope of the present application concept in any way, but to illustrate the present application concept to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0041] The exemplary embodiments will be described in detail herein with reference to the attached drawings. The following description is made with reference to the accompanying drawings in which like reference numerals refer to like elements, and the term "exemplary" is used herein to mean "serving as an example, instance, or illustration." Unless specifically stated otherwise, as apparent from the following descriptions, the embodiments of the present application are not limited to the examples described herein, but can include any combinations of the examples described herein, and any scope of modifications based on the technical concept of the present application.

[0042] The terms "first", "second", and the like are used only for descriptive purposes, and should not be construed as indicating or implying relative importance or an indicated number thereof. In the description of each embodiment below, the meaning of "a plurality of" is two or more, unless otherwise specifically limited.

[0043] First, the prior art related to the present application is described and analyzed in detail.

[0044] Since the control data of the digital person may include voice data, it is necessary to parse the control data in the label language format into a string, and then parse the string into control data including voice data. At present, one way of parsing the string text is as follows: text analysis is performed on the string text to determine text features, then an acoustic model is modeled according to the text features to determine the corresponding mel spectrum, and then a vocoder generates a sequence of voice sampling points according to the mel spectrum, and finally the sampling rate, speech rate, volume and tone of the sequence of voice sampling points are adjusted through post-processing to obtain synthesized voice data. Therefore, the process of parsing the string into control data including voice data is complex, resulting in low transmission efficiency of the control data in the label language format.

[0045] The inventors found in research that the data in the json format can be transmitted, and the json format specification for describing the label language is defined in advance, so that the control data in the label language format can be translated into the control data in the json format by using the format specification, and the control data is transmitted in the json format. After the user terminal receives the control data in the json format, the control data in the json format is translated into the control data in the label language format by using the format specification, so that the digital person can be driven to act.

[0046] Figure 1 The application scenario provided by the embodiments of the present application is shown in FIG. Figure 1 After the electronic device obtains the control data in the label language format to be transmitted, the control data in the label language format is translated into the control data in the json format, and the control data in the json format is sent to the user terminal. After the user terminal receives the control data in the json format, the control data in the json format is translated according to the pre-defined format specification, and the control data in the label language format can be obtained.

[0047] In the technical solution of the present application, the collection, storage, use, processing, transmission, provision and disclosure of the information such as financial data or user data comply with the relevant laws and regulations, and do not violate public order and good customs.

[0048] The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0049] Embodiment one

[0050] Figure 2The voice data transmission method flowchart provided by the embodiment one of the application, the embodiment of the application aims at the problem of low transmission efficiency of control data in the tag language format, and provides a voice data transmission method. The method in the embodiment is applied to a voice data transmission device, which can be located in an electronic device. The electronic device can be various forms of digital computers, such as a laptop computer, a desktop computer, a workstation, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers.

[0051] As shown in Figure 2 , the specific steps of the method are as follows:

[0052] Step S101, obtaining control data in the tag language format to be transmitted.

[0053] The control data includes voice broadcast control data, and the voice broadcast control data includes the content of voice broadcast. The control data can also include action control data.

[0054] In the embodiment of the application, the control data in the tag language format can be used to drive a digital human displayed in a user terminal, for example, to control the digital human to perform actions or voice broadcast. The voice broadcast control data is data used to drive the digital human to perform voice broadcast.

[0055] Step S102, translating the control data in the tag language format into control data in the json format according to a pre-defined format specification.

[0056] The pre-defined format specification is used to describe the tag language in the json format.

[0057] In the embodiment of the application, a set of json format specification schema can be pre-defined to describe the tag language, and the tag language can be DRML tag language or SSML tag language. After obtaining the control data in the tag language format to be transmitted, the control data in the tag language format can be translated into control data in the json format according to the pre-defined format specification.

[0058] Step S103, sending the control data in the json format to the user terminal, so that the user terminal translates the control data in the json format into control data in the tag language according to the pre-defined format specification, and performs voice broadcast based on the control data in the tag language.

[0059] In the embodiment of the application, after the control data in the json format is sent to the user terminal, the user terminal can translate the control data in the json format into control data in the tag language according to the pre-defined format specification, and can drive the digital human to perform voice broadcast by using the control data in the tag language.

[0060] The voice data transmission method provided in the embodiments of the present application obtains control data in a tag language format to be transmitted, translates the control data in the tag language format into control data in a json format according to a pre-defined format specification, sends the control data in the json format to a user terminal, so that the user terminal translates the control data in the json format into control data in the tag language based on the pre-defined format specification, and performs voice broadcasting based on the control data in the tag language. The pre-defined json format specification is used to describe the tag language, and the quick translation of the control data in the tag language format and the control data in the json format can be implemented, so that the control data can be transmitted in the json format, and the transmission speed of the control data in the tag language format is improved.

[0061] On the basis of the above-mentioned embodiments, the step S101 of obtaining the control data in the tag language format to be transmitted further includes:

[0062] The step S201 of obtaining the demand data or the user operation data sent by the user terminal.

[0063] The step S202 of identifying the demand data or the user operation data to determine the response data corresponding to the demand data or the user operation data.

[0064] The step S203 of generating the control data in the tag language format to be transmitted based on the response data.

[0065] The embodiments of the present application do not limit the way of identifying the demand data or the user operation data to determine the response data corresponding to the demand data or the user operation data.

[0066] For example, the data sent by the user terminal is the demand data, the intent recognition can be performed on the demand data, and the corresponding response data is determined based on the result of the intent recognition. The keywords in the demand data can also be extracted, and the corresponding response data is determined based on the keywords.

[0067] For another example, the data sent by the user terminal is the operation data, and the response data corresponding to the user operation data can be determined based on the pre-configured mapping relationship between the operation and the response mode.

[0068] The voice data transmission method provided in the embodiments of the present application obtains the demand data or the user operation data sent by the user terminal, identifies the demand data or the user operation data to determine the response data corresponding to the demand data or the user operation data, and generates the control data in the tag language format to be transmitted based on the response data. The method can be applied in a scene of interaction with a user, the corresponding response mode can be determined based on the operation or the demand of the user, and the control data in the tag language format for controlling the user terminal is generated to perform the corresponding response in the user terminal.

[0069] On the basis of the above embodiment, the embodiment relates to a refinement of an implementation of step S102 of translating the control data in the tag language format into the control data in the json format according to the predefined format specification.

[0070] The tag language format can be a digital human rich text markup language (DRML) format, and before step S102, the json format specification corresponding to the attributes of each tag included in the DRML format can be determined to predefine the json format specification corresponding to the DRML format.

[0071] Exemplarily, the json format specification corresponding to the following tag attributes can be defined, including:

[0072] 1. Tag name (English: name): This attribute is used as a node name / type display. Exemplarily, the tag name can be: speak, phoneme, break. 1) The speak tag can control the process of adding various components for text output and action, and has four basic attributes: subtitle switch, speech speed adjustment, tone adjustment, and volume adjustment. 2) The phoneme tag is used to mark the pronunciation of the text within the tag, and currently supports Chinese pinyin and English phonetic symbols. The pronunciation is given by the py configuration attribute. A single space is used to separate the pinyins. The tag has a basic attribute py for giving the pronunciation of the expression text, and the pinyin is followed by a number representing the tone. 3) The break tag can add a pause in the text, and also supports setting the length of the pause in seconds / milliseconds. The tag has a basic attribute time for setting the duration of the pause.

[0073] The DRML format also includes tags: ue4event and uievent. The ue4event tag is used to describe the action description of the digital human; and the uievent tag is used to describe the intercut content of the digital human, such as the display of inserted content such as images, lists, and documents.

[0074] 2. Tag type (English: type): Type is an enumeration attribute under the type of the Event object tag.

[0075] In cooperation with the ue4event tag and the uievent tag, it can be described that this tag is used to describe what kind of action or insert what kind of scene, for example, inserting an image, a list, a document, etc.

[0076] 3. Tag basic attribute (English: props): Props is a set of inline attribute description information of the tag, and is a key attribute configured for each DRML tag. The basic attributes of the tag content configuration need to be described in it. For example, the subtitle switch under the speak tag, and the py pinyin pronunciation configuration of phoneme.

[0077] 4. Tag subset (English: children): Children is a subset of nodes within a tag, including text and nodes, parsed in the rendering order, used to describe the nested structure within the tag. This attribute currently has no nesting limit and can be set to a maximum of 3 levels of nesting.

[0078] 5. Tag data (data): Data is a collection of independent attributes of an Event object, representing its specific property configuration. This attribute has several special types: news, bar, pie, choice, and addresses. The Event object is a primary tag, primarily the UE4event tag and the UIevent tag.

[0079] 6. Label interaction (action in English): action is the interactive button configuration of the Event object, which can configure the label content of some interactive content.

[0080] The voice data transmission method provided in the embodiments of the present application determines the JSON format specification corresponding to the attributes of each tag included in the DRML format. By pre-defining the JSON format specification corresponding to the DRML format, the method can translate the control data in the tag language format into the control data in the JSON format according to the pre-defined format specification, ensuring that the attributes of each tag can be converted from the DRML format to the JSON format, or vice versa. Specifically, the following steps may be included:

[0081] Step S301: Determine the JSON format specification corresponding to the attribute of each tag in the control data in the tag language format.

[0082] Step S302: Translate the control data in the tag language format into control data in the JSON format according to the JSON format specification corresponding to the attributes of each tag in the control data.

[0083] In the embodiment of the present application, we can parse the attributes of each tag in the control data in the tag language format and determine the corresponding json format specification, so that the control data in the tag language format can be translated into control data in the json format according to the json format specification corresponding to the attributes of each tag in the control data.

[0084] Exemplarily, a piece of control data in the DRML tag language format can be: <speak subtitle-switch="off" speech-rate-adjustment="1" pitch-adjustment="1" volume-adjustment="1">Hello. You can press. The control data in the json format specification corresponding to the attributes of each tag can be converted to: {"tag name": "speak", "tag basic attributes": {"subtitle-switch": "off", "speech-rate-adjustment": "1", "pitch-adjustment": "1", "volume-adjustment": "1"}, "tag subset": ["Hello. You can press."],}.

[0085] Embodiment Two

[0086] Figure 3 A flowchart of a voice data transmission method provided for Embodiment Two of the present application, the present embodiment provides a voice data transmission method to solve the problem of low transmission efficiency of control data in the tag language format. The method in the present embodiment is applied to a voice data transmission device, which can be located in a user terminal. The user terminal can be various forms of digital computers or mobile devices, such as smart terminals, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers.

[0087] As shown in Figure 3 , the specific steps of the method are as follows:

[0088] Step S401, obtaining the control data in the json format sent by the electronic device.

[0089] The control data in the json format is formed by the electronic device translating the control data in the tag language format to be transmitted according to a pre-defined format specification; the control data includes voice broadcast control data.

[0090] Step S402, translating the control data in the json format into control data in the tag language based on the pre-defined format specification.

[0091] The pre-defined format specification is used to describe the tag language in the json format.

[0092] In the present embodiment, a set of json format specification schema can be pre-defined to describe the tag language, which can be the DRML tag language or the SSML tag language. After obtaining the control data in the tag language format to be transmitted, the control data in the json format can be translated into control data in the tag language according to the pre-defined format specification.

[0093] Step S403, voice broadcasting based on the control data in the tag language.

[0094] In this embodiment of the present application, control data in a tag language format can be used to drive a digital human displayed on a user terminal. After obtaining the tag language control data, the tag language control data can be used to control the digital human to perform voice broadcasts and actions. The voice broadcast control data is data used to drive the digital human to perform voice broadcasts.

[0095] Optionally, the control data may further include at least one of the following: display control data, voice broadcast control data; the user terminal may perform display and / or voice broadcast based on the control data of the tag language.

[0096] Specifically, if the control data includes display control data, the user terminal can display based on the control data of the label language; if the control data includes voice broadcast control data, the user terminal can voice broadcast based on the control data of the label language; if the control data includes voice broadcast control data and display control data, the user terminal can display and voice broadcast based on the control data of the label language.

[0097] In the embodiment of the present application, the user terminal can also display and / or voice broadcast the control data based on the tag language, which increases the way of displaying data and improves the user experience.

[0098] The voice data transmission method provided in an embodiment of the present application obtains control data in JSON format sent by an electronic device; the JSON format control data is formed by the electronic device translating the control data in a tag language format to be transmitted according to a predefined format specification; the control data includes: voice broadcast control data; translating the JSON format control data into control data in the tag language based on the predefined format specification; and performing voice broadcast based on the control data in the tag language. The predefined JSON format specification is used to describe the tag language, which can achieve rapid translation of control data in the tag language format and control data in the JSON format, thereby transmitting the control data in the JSON format, thereby improving the transmission speed of the control data in the tag language format.

[0099] Based on the above embodiment, before step S401 of obtaining the control data in json format sent by the electronic device, the following steps are further included:

[0100] Step S501: generating demand data in response to a user's demand for voice input or text input on an interactive interface, or generating user operation data in response to a user's operation on an interactive interface; the demand data is voice data or text data.

[0101] Step S502: Send the demand data or user operation data to the electronic device, so that the electronic device determines the response data corresponding to the demand data or user operation data and generates control data in a tag language format to be transmitted based on the response data.

[0102] In the embodiments of the present application, the user can input the demand in the interactive interface through voice or text, etc., the user terminal can generate demand data based on the demand input by the user and send the demand data to the electronic device, so that the electronic device determines the response to the demand data and generates the control data in the corresponding tag language format. For example, the demand data can be to obtain product information, and the response to the demand data can be to display product information.

[0103] In the embodiments of the present application, the user can also perform interactive operation in the interactive interface, and the user operation data can be generated based on the operation of the user in the interactive interface and sent to the electronic device, so that the electronic device determines the response to the user operation data and generates the control data in the corresponding tag language format, such as thanking in voice, etc. For example, the user operation data can be a like operation, and the response to the user operation data can be to thank in voice, etc.

[0104] The voice data transmission method provided by the embodiments of the present application generates demand data in response to the demand input by the user in the interactive interface or generates user operation data in response to the operation of the user in the interactive interface; the demand data is voice data or text data; the demand data or the user operation data is sent to the electronic device, so that the electronic device determines the corresponding response data of the demand data or the user operation data and generates the control data in the tag language format to be transmitted based on the response data. It can be applied to the scene of interacting with the user, and the corresponding response mode can be determined based on the operation or demand of the user, and the control data in the tag language format for controlling the user terminal is generated, and the corresponding response is performed on the user terminal.

[0105] Optionally, after the display and / or voice broadcast based on the control data in the tag language, it can further include:

[0106] Step S601, in response to the adjustment operation of the user on the display and / or voice broadcast, updating the attribute in the control data in the json format.

[0107] Step S602, translating the updated control data in the json format into the updated control data in the tag language based on the pre-defined format specification.

[0108] Step S603, displaying and / or voice broadcasting based on the updated control data in the tag language.

[0109] Specifically, the way to obtain the attribute of the tag can be: finding the tag in the control data in the json format, obtaining the specified attribute of the tag, and changing the specified attribute of the tag. Optionally, the specified attribute of the tag or the tag can also be deleted.

[0110] For example, the user can say "slow down the speech speed", the speak tag can be obtained, the speech speed adjustment attribute in the tag basic attribute of the speak tag is obtained, and the speech speed adjustment attribute is lowered.

[0111] It should be understood that, since the DRML tag language format does not support modification of the specified attribute, after the user performs the adjustment operation on the display and / or voice broadcast, the user terminal updates the attribute in the control data in the json format to realize the adjustment of the display and / or voice broadcast.

[0112] The voice data transmission method provided by the embodiment of the application updates the attribute in the control data in the json format in response to the adjustment operation of the user on the display and / or voice broadcast, translates the updated control data in the json format into updated control data in the tag language based on the pre-defined format specification, and performs display and / or voice broadcast based on the updated control data in the tag language. Since the control data in the json format can be dynamically configured, it is not necessary to send the adjustment operation data of the user on the display and / or voice broadcast to the electronic device to make the electronic device regenerate the updated control data in the tag language, so that the dynamic configuration of the display and / or voice broadcast can be realized at the user terminal, and the efficiency of adjusting the display and / or voice broadcast configuration is improved.

[0113] The voice data transmission signaling diagram provided by the above embodiment will be described below in combination with a specific example, Figure 4 A voice data transmission signaling diagram provided by the application, as shown in Figure 4 includes the following steps:

[0114] Step S701, the user terminal generates demand data in response to the demand of the user in the interactive interface voice input or text input, and sends the demand data to the electronic device.

[0115] Step S702, the electronic device determines the response data corresponding to the demand data, and generates the control data in the tag language format to be transmitted based on the response data.

[0116] Step S703, the electronic device translates the control data in the tag language format into the control data in the json format according to the pre-defined format specification, and sends the control data in the json format to the user terminal.

[0117] Step S704, the user terminal translates the control data in the json format into the control data in the tag language based on the pre-defined format specification.

[0118] Step S705, voice broadcast is performed based on the control data in the tag language.

[0119] The voice data transmission method provided by the embodiment of the application can realize communication without difference between the front end and the back end, and the data of the two ends can be universal without special processing, and the data can be quickly and dynamically modified and configured through object value, thereby greatly enhancing the flexibility and universality of voice digital person synthesis processing.

[0120] Figure 5 A bottom architecture diagram provided by the application is shown in Figure 5 The application is driven by a digital person based on a DRML / SSML tag language, the digital person bottom layer can encapsulate a data layer, which is used to interface with the application layer and the data interface to realize a complete data driving, and the data layer can pass through the mutual conversion logic between the bottom data API and the DRML. The outermost layer of the data layer can define a digital person driving json format specification schema, and the schema can be used to describe the type of behavior tag of the digital person, so as to realize the mutual conversion between the tag language format and the json format according to the pre-defined format specification schema, and further realize the voice data transmission process based on the json format.

[0121] Embodiment three

[0122] Figure 6 A structure schematic diagram of a voice data transmission device provided by the third embodiment of the application. The voice data transmission device provided by the embodiment of the application can execute the processing flow provided by the voice data transmission method embodiment one. As shown in Figure 6 The voice data transmission device 80 includes an acquisition module 801, a translation module 802 and a sending module 803.

[0123] Specifically, the acquisition module 801 is configured to acquire control data in a tag language format to be transmitted, and the control data includes voice broadcast control data.

[0124] The translation module 802 is configured to translate the control data in the tag language format into control data in a json format according to a pre-defined format specification.

[0125] The sending module 803 is configured to send the control data in the json format to a user terminal, so that the user terminal translates the control data in the json format into control data in the tag language according to the pre-defined format specification, and performs voice broadcast based on the control data in the tag language.

[0126] The device provided by the embodiment of the application can be specifically used to execute the method embodiment provided by the above-mentioned embodiment one, and the specific functions will not be described here.

[0127] Optionally, the obtaining module 80 is specifically configured to: obtain demand data or user operation data sent by the user terminal; the demand data is voice data or text data; identify the demand data or the user operation data to determine response data corresponding to the demand data or the user operation data; and generate the control data in the label language format to be transmitted based on the response data.

[0128] Optionally, the label language format is a digital human rich text markup language (DRML) format, and the voice data transmission apparatus 80 further includes a predefinition module, which is configured to: determine a json format specification corresponding to an attribute of each label included in the DRML format, and predefine the json format specification corresponding to the DRML format.

[0129] Optionally, the translation module 802 is specifically configured to: determine a json format specification corresponding to an attribute of each label in the control data in the label language format; and translate the control data in the label language format into control data in the json format according to the json format specification corresponding to the attribute of each label in the control data.

[0130] The apparatus provided by the embodiments of the present application can be specifically configured to execute the method embodiment I described above, and details are not described herein again.

[0131] Embodiment Four

[0132] Figure 7 A structural schematic diagram of a voice data transmission apparatus provided by the fourth embodiment of the present application is shown in FIG. 4. The voice data transmission apparatus provided by the embodiments of the present application can execute the processing flow provided by the voice data transmission method embodiment II. As shown in FIG. 4, the voice data transmission apparatus 90 includes an obtaining module 901, a translation module 902, and a control module 903. Figure 7

[0133] Specifically, the obtaining module 901 is configured to obtain control data in a json format sent by an electronic device; the control data in the json format is formed by the electronic device translating control data in a label language format to be transmitted according to a pre-defined format specification; and the control data includes voice broadcast control data.

[0134] The translation module 902 is configured to translate the control data in the json format into control data in the label language based on the pre-defined format specification.

[0135] The control module 903 is configured to perform voice broadcast based on the control data in the label language.

[0136] The apparatus provided by the embodiments of the present application can be specifically configured to execute the method embodiment provided by the above embodiment II, and details are not described herein again.

[0137] ​Optionally, the voice data transmission apparatus 90 further comprises a response module; the response module is configured to generate demand data in response to a user demand for voice input or text input on the interactive interface, or generate user operation data in response to a user operation on the interactive interface; the demand data is voice data or text data; and the demand data or the user operation data is sent to the electronic device, so that the electronic device determines response data corresponding to the demand data or the user operation data and generates control data in a label language format to be transmitted based on the response data.

[0138] Optionally, the control data comprises at least one of display control data and voice broadcast control data; and the control module 903 is further configured to perform display and / or voice broadcast based on the control data in the label language.

[0139] Optionally, the voice data transmission apparatus 90 further comprises an adjustment module; the adjustment module is configured to update an attribute in the control data in the json format in response to a user adjustment operation on the display and / or voice broadcast; translate the updated control data in the json format into updated control data in the label language based on a pre-defined format specification; and perform display and / or voice broadcast based on the updated control data in the label language.

[0140] The apparatus provided by the embodiments of the present application can be specifically used to execute the method embodiment two, and specific functions will not be described here again.

[0141] Embodiment five

[0142] Figure 8 The structural schematic diagram of the electronic device provided by the embodiment five of the present application is shown in Figure 8 The present application further provides an electronic device 100, which comprises a processor 1001, and a memory 1002 and a transceiver 1003 connected with the processor 1001 in communication. The memory 1002 stores computer execution instructions; the transceiver 1003 is used for transceiving data; and the processor 1001 executes the computer execution instructions stored in the memory 1002 to realize the method provided by any one of the embodiments of the present application.

[0143] Specifically, the program can include program code, and the program code includes computer execution instructions. The memory 1002 can include a high-speed RAM memory, and can also include a non-volatile memory such as at least one disk memory. The computer execution instructions are stored in the memory 1002 and are configured to be executed by the processor 1001 to realize the method provided by any one of the embodiments of the present application. The related description can be understood by referring to the related description and effects corresponding to the steps in the drawings, which will not be described here in detail.

[0144] In the embodiments of the present application, the memory 1002 and the processor 1001 are connected through a bus. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 only one thick line is used in the figure, but it does not mean that there is only one bus or only one type of bus.

[0145] Figure 9 The structure schematic diagram of the user terminal provided in the fifth embodiment of the present application is shown in FIG. 11. As shown in FIG. 11, the present application further provides a user terminal 110, which comprises a processor 1101, and a memory 1102 and a transceiver 1103 connected with the processor 1101. The memory 1102 stores computer execution instructions; the transceiver 1103 is used for transmitting and receiving data; and the processor 1101 executes the computer execution instructions stored in the memory 1102 to implement the method provided in any one of the embodiments of the present application. Figure 9

[0146] Specifically, the program can include program code, and the program code includes computer execution instructions. The memory 1102 can include a high-speed RAM memory, and can also include a non-volatile memory such as at least one disk memory. The computer execution instructions are stored in the memory 1102 and are configured to be executed by the processor 1101 to implement the method provided in any one of the embodiments of the present application. The related description can be understood by referring to the related description and effects corresponding to the steps in the drawings, and will not be described in detail here.

[0147] In the embodiments of the present application, the memory 1102 and the processor 1101 are connected through a bus. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 9 ​Only one bus or only one type of bus can exist, however.

[0148] The embodiment of the present application further provides a computer readable storage medium, and the computer readable storage medium stores computer execution instructions. When the computer execution instructions are executed by a processor, the computer execution instructions are used for implementing the method provided in any one of the embodiments of the present application.

[0149] The embodiment of the present application further provides a computer program product, and the computer program product includes computer execution instructions. When the computer execution instructions are executed by a processor, the computer execution instructions implement the method provided in any one of the embodiments of the present application.

[0150] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented by other manners. For example, the apparatus embodiment described above is only schematic, for example, the division of the module is only a logical function division, and actual implementation can have another division manner, for example, a plurality of modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interfaces, apparatuses or modules, and can be electrical, mechanical or other forms.

[0151] The module described as a separate component can be or can not be physically separated, and the component displayed as a module can be or can not be a physical module, that is, can be located in one place, or can be distributed to a plurality of network modules. According to actual needs, part or all of the modules can be selected to achieve the purpose of the embodiment scheme.

[0152] In addition, each function module in each embodiment of the present application can be integrated in one processing module, or each module can be physically present alone, or two or more modules can be integrated in one module. The above integrated module can be realized in the form of hardware or in the form of hardware plus software function module.

[0153] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. The program code can be provided to a general purpose computer, a special purpose computer, or other programmable processing or controller device to cause the program code to be executed by the processor or controller, so that the functions / operations specified in the flowchart and / or block diagram are implemented when the program code is executed by the processor or controller. The program code can be executed completely on a machine, partially on a machine, partially on a machine as a separate software package, and partially on a remote machine or server.

[0154] In the context of this application, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0155] Further, although operations are depicted in a particular, sequential order, this should not be understood as requiring or implying that the operations are performed in the order illustrated, or that all illustrated operations are necessary for realizing the desired result. In certain contexts, multitasking and parallel processing can be advantageous. Likewise, the specific sequential order described above need not be adhered to, nor should the features be realized in the particular order given - that is, even though a feature can be described in the context of performing other features, among other implementations, the feature can be realized in the context of the others, or even in the context of a single feature. Furthermore, certain features can be used in combination with one another to realize and achieve one or more benefits, and it will be understood that the ordering of operations presented is merely an example and the length of the operations can be altered to achieve the desired results. Accordingly, the skilled artisan will appreciate that the order of certain operational steps can be changed or even reversed without departing from the scope and spirit of the application.

[0156] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the application be limited only by the scope of the claims, a properly construed, and it is intended that any variations be considered as falling within the scope of the application. The specification and examples given are intended as illustrative only and not in a limiting sense. The true scope and spirit of the application are indicated by the following claims.

[0157] It should be understood that the application is not limited to the precise construction and compositions described above and shown in the accompanying drawings, and various modifications and changes can be effected therein by those skilled in the art without departing from the scope of the application. The scope of the application is limited only by the claims appended hereto.

Claims

1. A voice data transmission method characterized by comprising: The application is applied to an electronic device, comprising: obtaining control data in a label language format to be transmitted; the control data comprises voice broadcast control data; translating the control data in the label language format into control data in a json format according to a predefined format specification; sending the control data in the json format to a user terminal, so that the user terminal translates the control data in the json format into control data in the label language according to the predefined format specification, and performs voice broadcast based on the control data in the label language.

2. The method of claim 1, wherein, The obtaining of the control data in the label language format to be transmitted comprises: obtaining demand data or user operation data sent by the user terminal; the demand data is voice data or text data; identifying the demand data or the user operation data to determine corresponding response data of the demand data or the user operation data; generating the control data in the label language format to be transmitted based on the response data.

3. The method of claim 1, wherein, The label language format is a digital human rich text markup language (DRML) format, and before the translating of the control data in the label language format into the control data in the json format according to the predefined format specification, the method comprises: determining a json format specification corresponding to the attributes of each label included in the DRML format, to define the json format specification corresponding to the DRML format in advance.

4. The method of claim 3, wherein, The translating of the control data in the label language format into the control data in the json format according to the predefined format specification comprises: determining a json format specification corresponding to the attributes of each label in the control data in the label language format; translating the control data in the label language format into the control data in the json format according to the json format specification corresponding to the attributes of each label in the control data.

5. A voice data transmission method characterized by comprising: The application is applied to a user terminal, comprising: obtaining control data in a json format sent by an electronic device; the control data in the json format is formed by the electronic device translating control data in a label language format to be transmitted according to a predefined format specification; the control data comprises voice broadcast control data; translating the control data in the json format into control data in the label language based on the predefined format specification; performing voice broadcast based on the control data in the label language.

6. The method of claim 5, wherein, Before the obtaining of the control data in the json format sent by the electronic device, the method comprises: generating demand data in response to voice input or text input of a user on an interactive interface, or generating user operation data in response to operation of the user on the interactive interface; the demand data is voice data or text data; sending the demand data or the user operation data to the electronic device, so that the electronic device determines corresponding response data of the demand data or the user operation data, and generates control data in a label language format to be transmitted based on the response data.

7. The method of claim 5, wherein, The control data comprises at least one of display control data and voice broadcast control data; the performing of voice broadcast based on the control data in the label language comprises: performing display and / or voice broadcast based on the control data in the label language.

8. The method of claim 7, wherein, After the performing of display and / or voice broadcast based on the control data in the label language, the method comprises: updating an attribute in the control data in the JSON format in response to a user's adjustment operation on the display and / or the voice broadcast; translating the updated control data in the JSON format into updated control data in the label language based on a predefined format specification; displaying and / or voice broadcasting based on the updated control data in the label language.

9. A voice data transmission apparatus characterized by comprising: application to an electronic device, comprising: an acquisition module configured to acquire control data in a label language format to be transmitted, the control data including voice broadcast control data; a translation module configured to translate the control data in the label language format into control data in a JSON format according to a predefined format specification; a sending module configured to send the control data in the JSON format to a user terminal, so that the user terminal translates the control data in the JSON format into control data in the label language based on the predefined format specification, and performs voice broadcasting based on the control data in the label language.

10. A voice data transmission apparatus characterized by comprising: application to a user terminal, comprising: an acquisition module configured to acquire control data in a JSON format sent by an electronic device, the control data in the JSON format being formed by the electronic device translating control data in a label language format to be transmitted according to a predefined format specification, the control data including voice broadcast control data; a translation module configured to translate the control data in the JSON format into control data in the label language based on the predefined format specification; a control module configured to perform voice broadcasting based on the control data in the label language.

11. An electronic device, comprising: comprising: a processor, a memory and a transceiver connected to the processor in communication; the memory stores computer-executable instructions; the transceiver is configured to transmit and receive data; the processor executes the computer-executable instructions stored in the memory to implement the method of any one of claims 1-4.

12. A user terminal, characterized by comprising: a processor, a memory and a transceiver connected to the processor in communication; the memory stores computer-executable instructions; the transceiver is configured to transmit and receive data; the processor executes the computer-executable instructions stored in the memory to implement the method of any one of claims 5-8.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are configured to implement the method of any one of claims 1-4 or 5-8.

14. A computer program product comprising computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a processor, implement the method of any one of claims 1-4 or 5-8.

Images