Speech transcription text editing system, method, device and equipment

Abstract

The present application discloses a speech transcription text editing system, method and device, a webpage text editor, a webpage, a browser, and an electronic device. The system performs speech transcription processing on speech data through a server, sends word element data of the transcribed text to a client, and stores the updated word element data sent by the client; the client wraps the transcribed text through a DOM node of a text dimension, and when playing the speech data, displays a first transcribed text segment corresponding to the playback progress with a first display attribute, and displays an unplayed second transcribed text segment with a second display attribute; updates the word element data according to the editing position information and the editing content information; renders the edited transcribed text according to the updated word element data. This processing method enables the speech transcription text to be displayed using a text node, and the word dimension highlight rendering does not rely on DOM elements; therefore, the online editing performance of long speech transcription text can be effectively improved.

Description

Technical Field

[0001] The present application relates to the field of speech processing technology, and specifically to a speech transcription text editing system, method and device, a web page text editor, a web page, a browser, and an electronic device. Background Art

[0002] The speech transcription system is a speech processing system that can transcribe speech into text. Through this system, meeting minutes can be automatically generated to improve meeting efficiency, give full play to meeting functions, avoid waste of manpower, material and financial resources, reduce meeting costs, and achieve human resource efficiency.

[0003] A typical speech transcription system requires that the speech transcription results can be edited online and that the text corresponding to the currently playing content can be highlighted while the speech is playing, such as Alibaba's cloud listening product. By highlighting the corresponding text while the speech is playing, the relationship between the transcribed text content and the audio playback time can be better associated, and the user can be assisted to focus on the currently playing content, so that the user can check whether the corresponding transcribed text has any problems against the currently playing content. If the transcribed text has any problems, the text can be edited online. At present, rich text editors are mainly used for online editing of speech transcribed text. According to the conventional rich text editor practice, the text corresponding to the currently playing content is highlighted based on the word dimension. In other words, each word in the speech transcribed text needs to be wrapped in an independent DOM element to meet the needs of locating the playback position at any time and highlighting it.

[0004] However, in the process of implementing the present invention, the inventors found that the technical solution has at least the following problems: the current audio recording file upload supports a maximum of several hours of audio, and the corresponding speech-to-text results contain about tens of thousands of words and tens of thousands of words, and each word has an independent DOM element, which will generate a large number of DOM nodes. When the editing operation involves modifying the DOM, a large number of rearrangements will be triggered, and operations such as selecting all and deleting may even cause problems such as browser freeze and no response, making it impossible to have a normal editing experience. For example, a 4-hour audio recording, and its corresponding speech-to-text results contain about 58,000 words and 34,000 words, which will generate more than 34,000 DOM nodes. In summary, in order to ensure that the transcribed text results of long speech can use the online editing function normally, a high-performance editing solution is needed to handle the editing needs of a large number of speech-transcribed texts. Summary of the invention

[0005] The present application provides a speech transcription text editing system to solve the problem of low online editing performance of long speech transcription text in the prior art. The present application also provides a speech transcription text editing method and device, a webpage text editor, a webpage, a browser, and an electronic device.

[0006] The present application provides a speech transcription text editing system, comprising:

[0007] The server is used to perform speech transcription processing on the multimedia data, send word element data of the speech transcription text to the client; store the updated word element data according to the text update request sent by the client;

[0008] The client is used to wrap the transcribed text of multimedia data through the document object model DOM node of the text dimension, display the transcribed text in a web page text editor, and when playing the multimedia data, display the first transcribed text segment corresponding to the playing progress with the first display attribute, and display the unplayed second transcribed text segment with the second display attribute; for the editing operation, update the word element data according to the editing position information and the editing content information; and render the edited transcribed text according to the updated word element data.

[0009] The present application provides a speech transcription text editing method, comprising:

[0010] Performing speech transcription processing on multimedia data;

[0011] Sending word element data of speech transcribed text to a client, so that the client can wrap the transcribed text of multimedia data through a document object model DOM node of a text dimension, display the transcribed text in a webpage text editor, and display a first transcribed text segment corresponding to the playback progress with a first display attribute when playing the multimedia data, and display a second transcribed text segment that has not been played with a second display attribute; for an editing operation, updating the word element data according to editing position information and editing content information; rendering the edited transcribed text according to the updated word element data;

[0012] Stores updated word element data carried in the text update request sent by the client.

[0013] The present application provides a speech transcription text editing method, comprising:

[0014] Wrapping the transcribed text of the multimedia data through the document object model DOM node of the text dimension, displaying the transcribed text in the webpage text editor, and displaying the first transcribed text segment corresponding to the playback progress with the first display attribute when playing the multimedia data, and displaying the unplayed second transcribed text segment with the second display attribute;

[0015] For the editing operation, the word element data is updated according to the editing position information and the editing content information;

[0016] Render the edited transcription text based on the updated word element data.

[0017] Optionally, also include:

[0018] A text update request is sent to the server, wherein the request includes updated word element data.

[0019] Optionally, wrapping the transcribed text of the multimedia data by a document object model DOM node of a text dimension and displaying the transcribed text in a webpage text editor includes:

[0020] splicing the word element data to obtain the transcribed text;

[0021] Wrapping the transcribed text with the DOM node;

[0022] The step of rendering the edited transcribed text according to the updated word element data includes:

[0023] splicing the edited transcribed text according to the updated word element data;

[0024] The content of the DOM node is updated according to the edited transcribed text.

[0025] Optionally, also include:

[0026] If the length of the transcribed text is greater than a length threshold, the transcribed text is divided into a plurality of text segments whose lengths are less than the length threshold, and the transcribed text is wrapped by a plurality of DOM nodes respectively corresponding to the plurality of text segments.

[0027] Optionally, also include:

[0028] If the length of the transcribed text is less than or equal to the length threshold, the transcribed text is wrapped by a DOM node corresponding to the transcribed text.

[0029] Optionally, updating word element data according to the editing position information and the editing content information includes:

[0030] Determine the target word element according to the editing position information and the word element data;

[0031] Update the target word element according to the edited content information.

[0032] Optionally, the editing operation includes: a select-all-delete operation;

[0033] The updating of word element data according to the editing position information and the editing content information includes:

[0034] All word elements are regarded as target word elements;

[0035] Delete all word element data.

[0036] Optionally, the editing operation includes: a word adding operation;

[0037] The updating of word element data according to the editing position information and the editing content information includes:

[0038] Determine the time information of the newly added word element according to the editing position information;

[0039] According to the edited content information, the content information of the newly added word element is determined.

[0040] Optionally, the editing operation includes: a word modification operation;

[0041] The updating of word element data according to the editing position information and the editing content information includes:

[0042] Determine the time information of the target word element according to the editing position information and the word element data;

[0043] According to the edited content information, the content information of the target word element is updated.

[0044] Optionally, also include:

[0045] Disable the browser's default editing operation processing module;

[0046] Determining whether the editing operation is a preset editing operation;

[0047] If the editing operation is a preset editing operation, the word element data is updated according to the editing position information and the editing content information.

[0048] Optionally, the word element includes: word content and time information.

[0049] Optionally, the first display attribute includes: a first font color;

[0050] The second display attribute includes: a second font color;

[0051] The method of displaying a first transcribed text segment corresponding to the playback progress with a first display attribute and displaying a second transcribed text segment that has not been played with a second display attribute includes:

[0052] In the text layer of the editor, displaying the transcribed text in a second font color;

[0053] Determining a size and position of a display area corresponding to the first transcribed text segment;

[0054] Determining the size of a color layer of a third color according to the size, the third color being the color that is mixed with the first font color to obtain the second font color;

[0055] A color layer is superimposed and displayed on the text layer according to the position.

[0056] Optionally, the first display attribute includes: a first font and a first font size;

[0057] The second display attribute includes: a second font and a second font size;

[0058] Displaying the first transcribed text segment in a first font and a first font size through a DOM node corresponding to the first transcribed text segment;

[0059] The method further includes: displaying the second transcribed text segment in a second font and a second font size through a DOM node corresponding to the second transcribed text segment.

[0060] Display text editing progress in an animated way.

[0061] Optionally, also include:

[0062] Determine the edited third transcription text segment;

[0063] Displaying the third transcribed text segment through a DOM node corresponding to the third transcribed text segment;

[0064] The word element data is updated based on the editing position information, the editing content information, and the word element data corresponding to the editable text segment other than the third transcribed text segment.

[0065] Optionally, the edited third transcribed text segment is displayed with a third display attribute.

[0066] Optionally, also include:

[0067] A speech transcription request for multimedia data is sent to a server, so that the server performs speech transcription processing on the multimedia data.

[0068] The present application also provides a speech transcription text editing device, comprising:

[0069] A speech transcription unit, used for performing speech transcription processing on multimedia data;

[0070] A word element sending unit is used to send word element data of speech transcribed text to a client, so that the client can wrap the transcribed text of multimedia data through a document object model DOM node of a text dimension, display the transcribed text in a webpage text editor, and play the multimedia data; for an editing operation, update the word element data according to the editing position information and the editing content information; render the edited transcribed text according to the updated word element data, and display a first transcribed text segment corresponding to the playback progress with a first display attribute, and display a second transcribed text segment that has not been played with a second display attribute;

[0071] The word element updating unit is used to store the updated word element data carried in the text update request sent by the client.

[0072] The present application also provides an electronic device, including:

[0073] Processor; and

[0074] A memory is used to store a program for implementing a speech transcription text editing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: performing speech transcription processing on multimedia data; sending speech transcription text to a client, so that the client can wrap the transcription text of the multimedia data through a document object model DOM node of the text dimension, display the transcription text in a web page text editor, and when playing the multimedia data, display a first transcription text segment corresponding to the playing progress with a first display attribute, and display a second transcription text segment that has not been played with a second display attribute; for an editing operation, updating word element data according to editing position information and editing content information; rendering the edited transcription text according to the updated word element data; and storing the updated word element data carried by a text update request sent by the client.

[0075] The present application also provides a web page text editor that supports online editing of speech transcription text, including:

[0076] A display unit, used for wrapping the transcribed text of the multimedia data through a document object model DOM node of a text dimension, displaying the transcribed text in a webpage text editor, and displaying a first transcribed text segment corresponding to a playback progress with a first display attribute when playing the multimedia data, and displaying a second transcribed text segment that has not been played with a second display attribute;

[0077] An editing unit, for updating the word element data according to the editing position information and the editing content information in response to the editing operation;

[0078] The rendering unit is used to render the edited transcribed text according to the updated word element data.

[0079] The present application also provides an electronic device, including:

[0080] Processor; and

[0081] The memory is used to store a program for implementing a speech transcription text editing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: the transcribed text of multimedia data is wrapped through the document object model DOM node of the text dimension, the transcribed text is displayed in the web page text editor, and when the multimedia data is played, the first transcribed text segment corresponding to the playing progress is displayed with a first display attribute, and the unplayed second transcribed text segment is displayed with a second display attribute; for the editing operation, the word element data is updated according to the editing position information and the editing content information; and the edited transcribed text is rendered according to the updated word element data.

[0082] The application also provides a browser, which is embedded with the above-mentioned web page text editor.

[0083] The present application also provides a web page, including: the above-mentioned web page text editor.

[0084] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the computer-readable storage medium is run on a computer, the computer executes the above-mentioned various methods.

[0085] The present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the above-mentioned various methods.

[0086] Compared with the prior art, this application has the following advantages:

[0087] The speech-to-text editing system provided by the embodiment of the present application performs speech-to-text processing on multimedia data, and sends word element data of the speech-to-text text to the client; stores the updated word element data according to the text update request sent by the client; the client wraps the transcribed text of the multimedia data through the document object model DOM node of the text dimension, displays the transcribed text in the webpage text editor, and displays the first transcribed text segment corresponding to the playback progress with the first display attribute when playing the multimedia data, and displays the unplayed second transcribed text segment with the second display attribute; for the editing operation, updates the word element data according to the editing position information and the editing content information; and updates the word element data according to the editing position information and the editing content information. Updated word element data, rendering the edited transcribed text; this processing method enables the use of text nodes to display speech transcribed text, avoiding the one-to-one relationship between words and DOM elements. The word dimension highlight rendering does not rely on DOM elements, avoiding the performance loss of a large number of DOM creation, operation, and deletion. This not only meets the need to synchronously highlight the copy corresponding to the current playback content when playing a long voice, but also ensures the performance of long text online editing. Long text input and deletion can still respond quickly, and there will be no freezes or pseudo-deaths when editing text while frequently updating the playback time; therefore, the online editing performance of long speech transcribed text can be effectively improved. In addition, this processing method also allows the proxy system to default to input, and the text editor modifies the data structure of the corresponding word element, so there will be no data loss problem. Furthermore, since the word element data is kept up to date, the content can be directly obtained by saving the data, avoiding the problem of JS blocking and slow response caused by long text loops. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] Figure 1 A schematic diagram of the structure of an embodiment of a speech transcription text editing system provided by the present application;

[0089] Figure 2 A schematic diagram of an application scenario of an embodiment of a speech transcription text editing system provided by the present application;

[0090] Figure 3 A schematic diagram of a speech-to-text editing page of an embodiment of a speech-to-text editing system provided by the present application;

[0091] Figure 4 A schematic diagram of device interaction of an embodiment of a speech transcription text editing system provided by the present application;

[0092] Figure 5 A color overlay effect diagram of an embodiment of a speech transcription text editing system provided by the present application;

[0093] Figure 6 A schematic diagram of the rendering levels of an embodiment of a speech transcription text editing system provided by the present application;

[0094] Figure 7 A schematic diagram of the rendering effect of an embodiment of a speech transcription text editing system provided by the present application;

[0095] Figure 8 A schematic diagram of the editing operation processing flow of an embodiment of a speech-to-text editing system provided in the present application. DETAILED DESCRIPTION

[0096] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0097] In the present application, a speech transcription text editing system, method and device, a web page text editor, a web page, a browser, and an electronic device are provided. In the following embodiments, various schemes are described in detail one by one.

[0098] First embodiment

[0099] Please refer to Figure 1 , which is a structural diagram of an embodiment of the speech transcription text editing system of the present application. The system comprises: a server 1 and a client 2.

[0100] The server 1 may be a server deployed on a cloud server, or a server dedicated to speech transcription and transcription text processing, and may be deployed in a data center. The server may be a cluster server or a single server.

[0101] The client 2 includes but is not limited to mobile communication devices, namely, commonly known as mobile phones or smart phones, and also includes terminal devices such as personal computers, PADs, and iPads.

[0102] Please refer to Figure 2 , which is a scene diagram of the speech transcription text editing system of the present application. The server and the client can be connected through a network, such as the client can be connected to the Internet through WIFI, etc. Figure 3As shown, the user plays multimedia data through a browser (such as IE browser, etc.) loaded on the client. While the client is playing the voice through the browser, the transcribed text of the multimedia data provided by the server can be displayed through a web text editor (such as a rich text editor) embedded in the browser, and the copy corresponding to the current playing content can be highlighted (such as highlighted) synchronously, so that the transcribed text content and the audio playing time relationship can be better associated, and the user can be assisted to focus on the current playing content, so that the user can check whether the corresponding transcribed text has any problem with the current playing content. When the user finds that there is a problem with the transcribed text, the text can be edited online through the web text editor.

[0103] Please refer to Figure 4 , which is a device interaction diagram of an embodiment of the speech transcription text editing system of the present application. In this embodiment, the server is used to perform speech transcription processing on multimedia data, and send word element data of the speech transcription text to the client; according to the text update request sent by the client, the updated word element data is stored; the client is used to wrap the transcribed text of the multimedia data through the document object model DOM node of the text dimension, and display the transcribed text in the web page text editor, and when playing the multimedia data, the first transcribed text segment corresponding to the playing progress is displayed with the first display attribute, and the second transcribed text segment that has not been played is displayed with the second display attribute; for the editing operation, the word element data is updated according to the editing position information and the editing content information; according to the updated word element data, the edited transcribed text is rendered.

[0104] The multimedia data may include voice data that can identify the content of speech. The multimedia data may be audio data, such as English speech audio; or video data, such as film and television works.

[0105] In this embodiment, the user uploads his multimedia file to the server, and the server performs speech transcription processing on the multimedia data. When the user wants to edit the transcribed text, the multimedia data can be played through the client, and the speech transcription text editing page sent by the server can be received. The user can edit the transcribed text while listening to the voice through the text editor on the page, and then submit the edited speech transcription text to the server, and the server can update the speech transcription text corresponding to the multimedia data.

[0106] Speech recognition (speech transcription) is a technology that converts speech into text. The input data of the speech recognition algorithm can be speech audio, and the algorithm outputs the recognition result, which is usually a string or a data structure with other additional information (such as a timestamp). In specific implementation, various existing speech recognition algorithms can be used. Since this algorithm belongs to a relatively mature existing technology, it will not be described here.

[0107] In this embodiment, the result of speech transcription processing is word element data, and a speech transcription text of multimedia data includes multiple word elements. A word element may include: word content information and time information. The time information may include: start time and end time. Table 1 shows the word element data of the speech transcription text of this embodiment.

[0108]

[0109]

[0110] Table 1. Word element data of speech transcription text

[0111] As can be seen from Table 1, the speech transcription text data includes not only the text itself, but also the start time and end time of the audio segment corresponding to each transcribed word.

[0112] In this embodiment, the server sends a speech-transcribed text editing webpage to the client, and the webpage may include a webpage text editor (Web editor) and may also include word element data of the speech-transcribed text.

[0113] The web editor refers to a text editor that runs on a browser based on the web and can input content. The web editor can be a rich text editor (RTE), such as CKEditor; it can also be an input box of a form, etc. The rich text web editor is an editor that can support specified styles (such as bold text, foreground color, background color) or insert rich media content (such as pictures, audio, video) for a part of the content based on the usual web editor.

[0114] The difference from the prior art is that, in order to meet the requirements of locating the playback position at any time and highlighting the display, the client provided in the embodiment of the present application does not use an independent DOM element to wrap each word in the transcribed text, but wraps the transcribed text of the multimedia data through the document object model DOM node of the text dimension, and displays the transcribed text in the web page text editor. In other words, the text DOM node in the edit page not only wraps a word, but also wraps a section of text, or even the entire text. This processing method is adopted, so that the number of DOM nodes of the edit page is independent of the number of words, so that the editing operation will hardly involve modifying the DOM, and there will be no problem of triggering a large number of rearrangements when modifying the DOM, even if it is an operation such as selecting all and deleting, it is also possible to have a normal editing experience, and it will not cause the problems such as the browser being suspended and unresponsive.

[0115] In order to ensure a good performance experience for long text editing and prevent performance loss caused by a large amount of DOM rendering, word rendering needs to abandon the one-to-one DOM solution and use text nodes (TextNode) to display text content. The client can be specifically used to splice the transcribed text according to the word element data; and wrap the transcribed text through the DOM node. The data format of the word dimension of the transcribed text with time information (word element data) contains at least basic time information and text, such as start time, end time, and word content. This processing method does not add any additional DOM structure to save the data information of the word element (such as time information), so as to achieve the purpose of lightweight DOM tree and obtain better rendering and update performance.

[0116] In specific implementation, the texts of the words may be concatenated into a long text string to form a sentence or the entire transcribed content, and the long text string may be assigned as the innerHTML of a wrapped DOM element to generate a TextNode node.

[0117] In one example, if the length of the transcribed text is greater than a length threshold, the transcribed text is divided into a plurality of text segments whose lengths are less than the length threshold, and the transcribed text is wrapped by a plurality of DOM nodes corresponding to the plurality of text segments. The length threshold may be a maximum length limit of a TextNode. If the transcribed text is too long, it needs to be divided into several segments, and the length of each segment of text can meet the browser requirement as long as it is less than the length threshold. If the length of the transcribed text is less than or equal to the length threshold, the transcribed text may be wrapped by a DOM node corresponding to the transcribed text, that is, the transcribed text value corresponds to a DOM node.

[0118] It should be noted that in the prior art, each word needs to be wrapped with an independent DOM element, so that each DOM element will include the playback time information of the word; this processing method, on the one hand, makes it possible to use the time information in the DOM element to correctly update the word element corresponding to the editing operation; on the other hand, the time information in the DOM element can be used to achieve the highlighting (such as highlighting) of the playback text (the first transcribed text segment) based on the word dimension display. However, using the system provided by the embodiment of the present application, the DOM node of the text dimension no longer includes the playback time information of the word. In the absence of time information, how to highlight the text corresponding to the current playback content and how to update the word element corresponding to the editing operation become the technical difficulties of this solution. The solutions to these two technical difficulties are explained one by one below.

[0119] First, how to update word elements corresponding to editing operations is described.

[0120] The client provided in the embodiment of the present application is used to update the word element data according to the editing position information and the editing content information for the editing operation; and render the edited transcribed text according to the updated word element data. This processing method is adopted, so that the interface rendering is driven by data rather than the DOM element driving the interface rendering of the word dimension. Among them, "data" is the word element data of the transcribed text. Taking the word dimension as an example, one transcribed text corresponds to a word array, which includes multiple word elements, and each word element (array element) contains at least word content, time information, etc.

[0121] In one example, data-driven rendering can be implemented as follows: looping and concatenating the word contents in all word elements to form a complete long text string (transcribed text), and then using the text as innerHTML content to create a TextNode, which is directly displayed on the interface.

[0122] The editing operations include, but are not limited to: select all and delete operations, add words, modify words, delete words, enter and line feed operations, etc.

[0123] During specific implementation, the default editing operation processing module of the browser may be disabled; and it is determined whether the editing operation is a preset editing operation; if the editing operation is a preset editing operation, the word element data is updated according to the editing position information and the editing content information.

[0124] The editing position information may be determined by the cursor position, such as the position of the fifth word in the third line of the editor. The editing content information may be text change information, such as changing "they" to "they" and so on.

[0125] In specific implementation, the default input events can be edited through the proxy browser for add, delete, and modify operations, and the cursor operation position is obtained using Range to correspond to the data text position, and the corresponding operation type is obtained through the event to modify the corresponding data. After updating the data, the interface is re-rendered to achieve the purpose of data-driven rendering. For example, the editing position is the fifth word in the third line. According to the text length from the starting position of the text to the editing position, and the length of the word content in each word element in chronological order, it can be determined that the position corresponds to the 52nd word element.

[0126] In one example, the editing operation is a select-all delete operation, and the text editor can use all word elements as target word elements and delete all word element data. This processing method can effectively solve the problem of slow editing response when editing long texts, and the browser will directly freeze when performing a select-all operation, resulting in poor performance.

[0127] In one example, the editing operation is a word adding operation, and the text editor can determine the time information of the newly added word element based on the editing position information and the word element data; and determine the content information of the newly added word element based on the editing content information. The editing operation can also be: a word modification operation; the text editor can determine the time information of the target word element based on the editing position information and the word element data; and update the content information of the target word element based on the editing content information. This processing method does not destroy the original DOM structure, so it is easy to restore to the original data structure.

[0128] So far, the implementation method of the word elements corresponding to the update and edit operations has been explained. The following will explain how to highlight the text corresponding to the currently playing content.

[0129] The client is used to render the edited transcribed text according to the updated word element data, and to display the first transcribed text segment corresponding to the playback progress with the first display attribute, and to display the unplayed second transcribed text segment with the second display attribute.

[0130] In one example, the first display attribute includes: a first font color; the second display attribute includes: a second font color; the displaying of the first transcribed text segment corresponding to the playback progress with the first display attribute and the displaying of the unplayed second transcribed text segment with the second display attribute may include the following sub-steps: 1) displaying the transcribed text with the second font color in the text layer of the editor; 2) determining the size and position of the display area corresponding to the first transcribed text segment; 3) determining the size of a color layer of a third color according to the size, the third color being the color of the second font color obtained by mixing with the first font color; 4) displaying the color layer superimposed on the text layer according to the position.

[0131] The system provided in the embodiment of the present application abandons the use of the word-dimensional DOM structure to avoid online editing performance issues, resulting in the inability to set the corresponding style through the word-dimensional DOM node to achieve highlighting the first transcribed text segment. In order to achieve the purpose of highlighting the first transcribed text segment without additional DOM nodes, a two-layer rendering method can be used to meet this requirement.

[0132] In this embodiment, the lower layer is a text layer (text layer), which mainly displays text and its default state. The upper layer is a color overlay layer, which is mainly used to provide a color block (third color) superimposed on the text layer to color the text. The upper layer obtains the top and left positioning area positions and sizes through the area Range where the text needs to be highlighted.

[0133] According to the overlay mixing method of the color mixing mode, take the target color (the final highlighted text color, such as #007cd8) and the base color (the default color when the text is not highlighted, such as #658196) as an example. The overlay mode can be calculated separately according to the RGB channels, and the screen mode (Screen) operation is performed for bright colors, and the multiply mode (Multiply) operation is performed for dark colors.

[0134] In this embodiment, the text color #658196 in the lower text layer is dark, and the text background white #ffffff is light. To achieve the effect of highlighting text #007cd8 and text background #ffffff, the overlay mode formula (where A is the upper layer mixed color, B is the lower layer base color, and C is the target color) is used:

[0135] When B<=128, C=A*B / 255;

[0136] When B>128, C=255-(255-A)*(255-B)

[0137] This can be inferred that the mixed color required for highlighting text is #007acf, and the color overlay effect is as follows Figure 5 As shown, the relationship between the upper and lower levels of the rendering hierarchy is as follows Figure 6 As shown; the mixed presentation effect is as follows Figure 7 As shown in the figure, the white background disappears after mixing, and the highlighted part of the text is the target color after mixing. This processing method can ensure high performance of long text editing while meeting the requirements of corresponding text highlights and audio playback positions, so as to achieve a good experience for online editing of long speech recognition results.

[0138] In another example, the first display attribute includes: a first font and a first font size; the second display attribute includes: a second font and a second font size; the client is specifically used to display the first transcribed text segment in the first font and the first font size through the DOM node corresponding to the first transcribed text segment; and display the second transcribed text segment in the second font and the second font size through the DOM node corresponding to the second transcribed text segment.

[0139] In a specific implementation, at least two DOM nodes are used to wrap the speech transcription text, one of which is a DOM node that wraps the first transcription text segment, and the first font and the first font size can be set through the attributes of the DOM node; the other DOM node is a DOM node that wraps the second transcription text segment, and the second font and the second font size can be set through the attributes of the DOM node. According to the playback progress, the first transcription text segment and the second transcription text segment can be adjusted in real time, and the text content wrapped by the two DOM nodes can be modified accordingly.

[0140] This processing method ensures high performance in long text editing while meeting the requirements of text highlighting (such as font highlighting and font size highlighting) and audio playback position correspondence, thereby achieving a good experience in online editing of longer speech recognition results.

[0141] In one example, the client is further used to send a text update request to the server, the request including updated word element data, so that the server overwrites the original word element data with the updated word element data. With this processing method, when saving text, there is no need to traverse the DOM to obtain the latest data structure, and the saving time can at least save the original long text traversal waiting time.

[0142] Figure 8 The processing flow of the text editor is shown. The text editor first determines whether the user input is valid input, such as whether it is a preset editing operation; if it is valid input, the default operation of the browser must be disabled, such as disabling the browser's own module for processing the select-all delete operation; then, the word element data can be updated according to the editing position information and the editing content information, that is, the data structure of the word element can be modified; next, the word content in all updated word elements can be recirculated and spliced ​​according to the updated word element data to form a complete edited transcription text, and the text node content text is updated according to the text, and the position of the color overlay layer is updated; finally, the browser update is triggered, that is, re-rendering is achieved, and the edited transcription text is directly displayed in the interface.

[0143] In one example, the client can also be used to display the text editing progress in an animated manner. For example, whenever the text editing progress increases by 20%, a corresponding animation effect is displayed to prompt the user of the editing progress.

[0144] In one example, the client can also be used to determine a third transcribed text segment that has been edited; display the third transcribed text segment through a DOM node corresponding to the third transcribed text segment; and update the word element data according to editing position information, editing content information, and word element data corresponding to an editable text segment other than the third transcribed text segment.

[0145] In specific implementation, the client can be specifically used to display the edited third transcribed text segment with a third display attribute. The third display attribute includes but is not limited to: a third font and a third font size.

[0146] For example, if the length of the multimedia data being edited is 1.5 hours, the edited third transcribed text segment (such as the text of the first half hour) can be stored on the server, and the text segment can be wrapped by a DOM node. The font size of this part of the text can be reduced, and the part of the text can be set to be uneditable. This not only reduces the display controls occupied by the text segment, but also reduces the length of the editable transcribed text. Data update processing is performed within the word element data range corresponding to the editable transcribed text, which can improve the word element search and update speed; therefore, the editing performance can be further improved.

[0147] It can be seen from the above embodiments that the speech-to-text editing system provided in the embodiments of the present application performs speech-to-text processing on multimedia data, and sends word element data of the speech-to-text to the client; stores the updated word element data according to the text update request sent by the client; the client wraps the transcribed text of the multimedia data through the document object model DOM node of the text dimension, displays the transcribed text in the web page text editor, and displays the first transcribed text segment corresponding to the playback progress with the first display attribute when playing the multimedia data, and displays the unplayed second transcribed text segment with the second display attribute; for the editing operation, updates the word element data according to the editing position information and the editing content information. According to the updated word element data, the edited transcribed text is rendered; this processing method uses text nodes to display the speech transcribed text, avoiding the one-to-one relationship between words and DOM elements. The word dimension highlight rendering does not rely on DOM elements, avoiding the performance loss of a large number of DOM creation, operation, and deletion. This not only meets the need to highlight the text corresponding to the current playback content when playing a long voice, but also ensures the performance of long text online editing. Long text input and deletion can still respond quickly. When editing text while frequently updating the playback time, there will be no freeze or pseudo-death. Therefore, the online editing performance of long speech transcribed text can be effectively improved. In addition, this processing method also allows the proxy system to default to input, and the text editor modifies the data structure of the corresponding word element, so there will be no data loss problem. Furthermore, since the word element data is kept up to date, the content can be directly obtained by saving the data, avoiding the problem of JS blocking and slow response caused by long text loops.

[0148] Second embodiment

[0149] Corresponding to the above-mentioned speech transcription text editing system, the present application also provides a speech transcription text editing method, the execution subject of the method includes but is not limited to the server. The parts of this embodiment that are the same as the first embodiment are not repeated here, please refer to the corresponding parts in the first embodiment.

[0150] In this embodiment, the method includes the following steps:

[0151] Step 1: Perform speech transcription processing on multimedia data;

[0152] Step 2: sending word element data of the speech transcription text to the client, so that the client can wrap the transcription text of the multimedia data through the document object model DOM node of the text dimension, display the transcription text in the webpage text editor, and when playing the multimedia data, display the first transcription text segment corresponding to the playback progress with the first display attribute, and display the unplayed second transcription text segment with the second display attribute; for the editing operation, updating the word element data according to the editing position information and the editing content information; rendering the edited transcription text according to the updated word element data;

[0153] Step 3: Store the updated word element data carried in the text update request sent by the client.

[0154] Third embodiment

[0155] In the above embodiment, a speech-to-text editing method is provided, and correspondingly, the present application also provides a speech-to-text editing device, which corresponds to the embodiment of the above method.

[0156] The parts of this embodiment that are the same as those of the first embodiment are not repeated here, and please refer to the corresponding parts in the first embodiment. The present application provides a speech transcription text editing device comprising:

[0157] A speech transcription unit, used for performing speech transcription processing on multimedia data;

[0158] A word element sending unit is used to send word element data of speech transcribed text to a client, so that the client can wrap the transcribed text of multimedia data through a document object model DOM node of a text dimension, display the transcribed text in a webpage text editor, and play the multimedia data; for an editing operation, update the word element data according to the editing position information and the editing content information; render the edited transcribed text according to the updated word element data, and display a first transcribed text segment corresponding to the playback progress with a first display attribute, and display a second transcribed text segment that has not been played with a second display attribute;

[0159] The word element updating unit is used to store the updated word element data carried in the text update request sent by the client.

[0160] Fourth embodiment

[0161] The present application also provides an electronic device. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0162] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a speech-to-text editing method, and after the device is powered on and the program of the method is run by the processor, the following steps are performed: performing speech transcription processing on multimedia data; sending speech-transcribed text to a client, so that the client can wrap the transcribed text of the multimedia data through a document object model DOM node of a text dimension, and display the transcribed text in a web page text editor, and when playing the multimedia data, display a first transcribed text segment corresponding to the playback progress with a first display attribute, and display a second transcribed text segment that has not been played with a second display attribute; for an editing operation, updating word element data according to editing position information and editing content information; rendering the edited transcribed text according to the updated word element data; and storing the updated word element data carried in a text update request sent by the client.

[0163] Fifth embodiment

[0164] Corresponding to the above-mentioned speech transcription text editing system, the present application also provides a speech transcription text editing method, the execution subject of the method includes but is not limited to the client. The parts of this embodiment that are the same as the first embodiment are not repeated here, please refer to the corresponding parts in the first embodiment.

[0165] In this embodiment, the speech transcription text editing method includes the following steps:

[0166] Step 1: Wrap the transcribed text of the multimedia data through the document object model DOM node of the text dimension, display the transcribed text in the webpage text editor, and when playing the multimedia data, display the first transcribed text segment corresponding to the playing progress with the first display attribute, and display the unplayed second transcribed text segment with the second display attribute;

[0167] Step 2: for the editing operation, updating the word element data according to the editing position information and the editing content information;

[0168] Step 3: Render the edited transcription text based on the updated word element data.

[0169] In one example, the method may further include the following step: sending a text update request to a server, wherein the request includes updated word element data.

[0170] In one example, wrapping the transcribed text of multimedia data through the document object model DOM node of the text dimension and displaying the transcribed text in the web page text editor may include the following sub-steps: splicing the transcribed text according to the word element data; wrapping the transcribed text through the DOM node; accordingly, step 3 may include the following sub-steps: splicing the edited transcribed text according to the updated word element data; updating the content of the DOM node according to the edited transcribed text.

[0171] In one example, the method may further include the following steps: if the length of the transcribed text is greater than a length threshold, dividing the transcribed text into multiple text segments whose lengths are less than the length threshold, and wrapping the transcribed text with multiple DOM nodes corresponding to the multiple text segments respectively.

[0172] In an example, the method may further include the following step: if the length of the transcribed text is less than or equal to a length threshold, wrapping the transcribed text with a DOM node corresponding to the transcribed text.

[0173] In one example, step 2 may include the following sub-steps: determining a target word element according to the editing position information and the word element data; and updating the target word element according to the editing content information.

[0174] In one example, the editing operation includes: a select-all delete operation; step 2 may include the following sub-steps: taking all word elements as target word elements; deleting all word element data.

[0175] In one example, the editing operation includes: a word adding operation; step 2 may include the following sub-steps: determining time information of the newly added word element based on the editing position information; determining content information of the newly added word element based on the editing content information.

[0176] In one example, the editing operation includes: a word modification operation; step 2 may include the following sub-steps: determining the time information of the target word element based on the editing position information and the word element data; and updating the content information of the target word element based on the editing content information.

[0177] In one example, the method may further include the following steps: disabling the browser's default editing operation processing module; determining whether the editing operation is a preset editing operation; if the editing operation is a preset editing operation, updating the word element data according to the editing position information and the editing content information.

[0178] The word elements include: word content and time information.

[0179] In one example, the method may further include the following steps: the first display attribute includes: a first font color; the second display attribute includes: a second font color; the displaying of a first transcribed text segment corresponding to the playback progress with the first display attribute and the displaying of an unplayed second transcribed text segment with the second display attribute may include the following steps: displaying the transcribed text with a second font color in the text layer of the editor; determining the size and position of a display area corresponding to the first transcribed text segment; determining the size of a color layer of a third color based on the size, the third color being the color of the second font color obtained by mixing with the first font color; and displaying the color layer superimposed on the text layer based on the position.

[0180] In one example, the first display attribute includes: a first font and a first font size; the second display attribute includes: a second font and a second font size; the first transcribed text segment is displayed in the first font and the first font size through the DOM node corresponding to the first transcribed text segment; the second transcribed text segment is displayed in the second font and the second font size through the DOM node corresponding to the second transcribed text segment. In one example, the method may further include the following steps: displaying the text editing progress in an animated manner.

[0181] In one example, the method may further include the following steps: determining a third transcribed text segment that has been edited; displaying the third transcribed text segment through a DOM node corresponding to the third transcribed text segment; and updating the word element data according to editing position information, editing content information, and word element data corresponding to editable text segments other than the third transcribed text segment.

[0182] In one example, the edited third transcribed text segment is displayed with a third display attribute.

[0183] In an example, the method may further include the following step: sending a speech transcription request for the multimedia data to the server, so that the server performs speech transcription processing on the multimedia data.

[0184] Sixth embodiment

[0185] In the above embodiment, a speech transcription text editing method is provided, and correspondingly, the present application also provides a speech transcription text editing device, which can also be called a web page text editor supporting online editing of speech transcription text. The device corresponds to the embodiment of the above method.

[0186] The parts of this embodiment that are the same as those of the first embodiment are not repeated here, and please refer to the corresponding parts in the first embodiment. The present application provides a speech transcription text editing device comprising:

[0187] A display unit, used for wrapping the transcribed text of the multimedia data through a document object model DOM node of a text dimension, displaying the transcribed text in a webpage text editor, and displaying a first transcribed text segment corresponding to a playback progress with a first display attribute when playing the multimedia data, and displaying a second transcribed text segment that has not been played with a second display attribute;

[0188] An editing unit, for updating the word element data according to the editing position information and the editing content information in response to the editing operation;

[0189] The rendering unit is used to render the edited transcribed text according to the updated word element data.

[0190] Seventh embodiment

[0191] The present application also provides an electronic device embodiment. Since the device embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0192] An electronic device of the present embodiment includes: a processor and a memory; the memory is used to store a program for implementing a speech-to-text editing method. After the device is powered on and the program of the method is run by the processor, the following steps are performed: the transcribed text of multimedia data is wrapped by a document object model DOM node of the text dimension, the transcribed text is displayed in a web page text editor, and when the multimedia data is played, a first transcribed text segment corresponding to the playback progress is displayed with a first display attribute, and a second transcribed text segment that has not been played is displayed with a second display attribute; for an editing operation, the word element data is updated according to the editing position information and the editing content information; and the edited transcribed text is rendered according to the updated word element data.

[0193] Eighth embodiment

[0194] In the above-mentioned embodiment, a speech transcription text editing system is provided, and correspondingly, the present application also provides a browser. The device corresponds to the embodiment of the above-mentioned system. The parts of this embodiment that are the same as the first embodiment are not repeated here, and please refer to the corresponding parts in the first embodiment.

[0195] A browser of the present embodiment is embedded with a web page text editor that supports online editing of speech transcription text. The web page text editor supports online editing of speech transcription text in the following manner: through the document object model DOM node of the text dimension, the transcription text of the multimedia data is wrapped, and the transcription text is displayed in the web page text editor, and when the multimedia data is played, the first transcription text segment corresponding to the playback progress is displayed with the first display attribute, and the second transcription text segment that is not played is displayed with the second display attribute; for the editing operation, the word element data is updated according to the editing position information and the editing content information; according to the updated word element data, the edited transcription text is rendered.

[0196] Ninth embodiment

[0197] In the above embodiment, a speech transcription text editing method is provided, and correspondingly, the present application also provides a webpage. The webpage corresponds to the embodiment of the above method. The parts of this embodiment that are the same as the fifth embodiment are not repeated here, please refer to the corresponding parts in the eighth embodiment.

[0198] A web page of the present embodiment includes a web page text editor that supports online editing of speech transcription text. The web page text editor supports online editing of speech transcription text in the following manner: through the document object model DOM node of the text dimension, the transcription text of the multimedia data is wrapped, and the transcription text is displayed in the web page text editor, and when the multimedia data is played, the first transcription text segment corresponding to the playback progress is displayed with the first display attribute, and the second transcription text segment that has not been played is displayed with the second display attribute; for the editing operation, the word element data is updated according to the editing position information and the editing content information; according to the updated word element data, the edited transcription text is rendered.

[0199] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

[0200] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0201] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0202] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0203] 2. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

Claims

1. A speech transcription text editing system, characterized in that: include: The server is used to perform speech transcription processing on the multimedia data, send word element data of the speech transcription text to the client, and the word element includes: word content and time information; according to the text update request sent by the client, store the updated word element data; The client is used to obtain the transcribed text of the multimedia data by splicing according to the word element data; wrap the transcribed text of the multimedia data through the document object model DOM node of the text dimension, display the transcribed text in the web page text editor, and when playing the multimedia data, display the first transcribed text segment corresponding to the playing progress with the first display attribute, and display the unplayed second transcribed text segment with the second display attribute; for the editing operation, update the word element data according to the editing position information and the editing content information; splice the edited transcribed text according to the updated word element data; and update the content of the DOM node according to the edited transcribed text.

2. A speech transcription text editing method, characterized in that: include: Performing speech transcription processing on multimedia data; Send word element data of speech transcribed text to a client, wherein the word element includes: word content and time information, so that the client can splice the transcribed text of multimedia data according to the word element data; wrap the transcribed text of multimedia data through a document object model DOM node of the text dimension, display the transcribed text in a web page text editor, and when playing the multimedia data, display a first transcribed text segment corresponding to the playing progress with a first display attribute, and display a second transcribed text segment that has not been played with a second display attribute; for an editing operation, update the word element data according to the editing position information and the editing content information; splice the edited transcribed text according to the updated word element data; and update the content of the DOM node according to the edited transcribed text; Stores updated word element data carried in the text update request sent by the client.

3. A speech transcription text editing method, characterized in that: include: Obtain word element data of a language transcription text of multimedia data; splicing the word element data to obtain a transcribed text of the multimedia data; Wrapping the transcribed text of the multimedia data through the document object model DOM node of the text dimension, displaying the transcribed text in the webpage text editor, and displaying the first transcribed text segment corresponding to the playback progress with the first display attribute when playing the multimedia data, and displaying the unplayed second transcribed text segment with the second display attribute; For the editing operation, the word element data is updated according to the editing position information and the editing content information, wherein the word element includes: word content and time information; splicing to obtain the edited transcribed text according to the updated word element data; The content of the DOM node is updated according to the edited transcribed text.

4. The method according to claim 3, characterized in that Also includes: If the length of the transcribed text is greater than a length threshold, the transcribed text is divided into a plurality of text segments whose lengths are less than the length threshold, and the transcribed text is wrapped by a plurality of DOM nodes respectively corresponding to the plurality of text segments.

5. The method according to claim 3, characterized in that: Also includes: If the length of the transcribed text is less than or equal to the length threshold, the transcribed text is wrapped by a DOM node corresponding to the transcribed text.

6. The method according to claim 3, characterized in that The updating of word element data according to the editing position information and the editing content information includes: Determine the target word element according to the editing position information and the word element data; Update the target word element according to the edited content information.

7. The method according to claim 3, characterized in that The editing operation includes: a select-all-delete operation; The updating of the word element data according to the editing position information and the editing content information includes: All word elements are regarded as target word elements; Delete all word element data.

8. The method according to claim 3, characterized in that The editing operation includes: word adding operation; The updating of the word element data according to the editing position information and the editing content information includes: Determine the time information of the newly added word element according to the editing position information; According to the edited content information, the content information of the newly added word element is determined.

9. The method according to claim 3, characterized in that: The editing operation includes: word modification operation; The updating of the word element data according to the editing position information and the editing content information includes: Determine the time information of the target word element according to the editing position information and the word element data; According to the edited content information, the content information of the target word element is updated.

10. The method according to claim 3, characterized in that Also includes: Disable the browser's default editing operation processing module; Determining whether the editing operation is a preset editing operation; If the editing operation is a preset editing operation, the word element data is updated according to the editing position information and the editing content information.

11. The method according to claim 3, characterized in that The first display attribute includes: a first font color; The second display attribute includes: a second font color; The method of displaying a first transcribed text segment corresponding to the playback progress with a first display attribute and displaying a second transcribed text segment that has not been played with a second display attribute includes: In the text layer of the editor, displaying the transcribed text in a second font color; Determining a size and position of a display area corresponding to the first transcribed text segment; Determining the size of a color layer of a third color according to the size, the third color being the color that is mixed with the first font color to obtain the second font color; A color layer is superimposed and displayed on the text layer according to the position.

12. The method according to claim 3 or 11, characterized in that: The first display attribute includes: a first font and a first font size; The second display attribute includes: a second font and a second font size; Displaying the first transcribed text segment in a first font and a first font size through a DOM node corresponding to the first transcribed text segment; The second transcribed text segment is displayed in a second font and a second font size through a DOM node corresponding to the second transcribed text segment.

13. The method according to claim 3, characterized in that Also includes: Display text editing progress in an animated way.

14. The method according to claim 3, characterized in that Also includes: Determine the edited third transcription text segment; Displaying the third transcribed text segment through the DOM node corresponding to the third transcribed text segment; The word element data is updated based on the editing position information, the editing content information, and the word element data corresponding to the editable text segment other than the third transcribed text segment.

15. The method according to claim 14, characterized in that The edited third transcription text segment is displayed with the third display attribute.

16. The method according to claim 3, characterized in that Also includes: A text update request is sent to the server, wherein the request includes updated word element data.

17. The method according to claim 3, characterized in that Also includes: A speech transcription request for multimedia data is sent to a server, so that the server performs speech transcription processing on the multimedia data.

18. A speech transcription text editing device, characterized in that: include: A speech transcription unit, used for performing speech transcription processing on multimedia data; A word element sending unit is used to send word element data of speech transcribed text to a client, wherein the word element includes: word content and time information, so that the client can splice the transcribed text of multimedia data according to the word element data; wrap the transcribed text of multimedia data through a document object model DOM node of a text dimension, display the transcribed text in a web page text editor, and when playing the multimedia data, display a first transcribed text segment corresponding to the playing progress with a first display attribute, and display a second transcribed text segment that has not been played with a second display attribute; for an editing operation, update the word element data according to the editing position information and the editing content information; splice the edited transcribed text according to the updated word element data; and update the content of the DOM node according to the edited transcribed text; The word element updating unit is used to store the updated word element data carried in the text update request sent by the client.

19. An electronic device, characterized in that: include: processor; as well as A memory is used to store a program for implementing a speech transcription text editing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: speech transcription processing is performed on multimedia data; speech transcription text is sent to a client so that the client can splice the transcribed text of the multimedia data according to word element data; the transcribed text of the multimedia data is wrapped through a document object model DOM node of a text dimension, and the transcribed text is displayed in a web page text editor, and when playing the multimedia data, a first transcribed text segment corresponding to the playing progress is displayed with a first display attribute, and a second transcribed text segment that has not been played is displayed with a second display attribute; for an editing operation, word element data is updated according to editing position information and editing content information, and the word element includes: word content and time information; splicing the edited transcribed text according to the updated word element data; updating the content of the DOM node according to rendering the edited transcribed text; and storing the updated word element data carried by a text update request sent by the client.

20. A web page text editor that supports online editing of speech-transcribed text, characterized in that: include: A display unit, used to obtain word element data of a language transcription text of multimedia data; splicing the transcribed text of the multimedia data according to the word element data; wrapping the transcribed text of the multimedia data through a document object model DOM node of the text dimension, displaying the transcribed text in a webpage text editor, and displaying a first transcribed text segment corresponding to the playback progress with a first display attribute when playing the multimedia data, and displaying a second transcribed text segment that has not been played with a second display attribute; An editing unit, for updating the word element data according to the editing position information and the editing content information for the editing operation, wherein the word element includes: word content and time information; The rendering unit is used to splice the edited transcribed text according to the updated word element data; and update the content of the DOM node according to the edited transcribed text.

21. An electronic device, characterized in that: include: processor; as well as The memory is used to store a program for implementing a speech transcription text editing method. After the device is powered on and the program of the method is run through the processor, the following steps are performed: word element data of the language transcription text of multimedia data is obtained; according to the word element data, the transcribed text of the multimedia data is spliced; the transcribed text of the multimedia data is wrapped through a document object model DOM node of the text dimension, and the transcribed text is displayed in a web page text editor, and when the multimedia data is played, a first transcribed text segment corresponding to the playing progress is displayed with a first display attribute, and a second transcribed text segment that has not been played is displayed with a second display attribute; for an editing operation, the word element data is updated according to editing position information and editing content information, and the word element includes: word content and time information; according to the updated word element data, the edited transcribed text is spliced; according to the edited transcribed text, the content of the DOM node is updated.

22. A browser, characterized in that: Embed the web page text editor described in claim 20.

23. A web page, characterized in that: include: A web page text editor according to claim 20.

Images