Document content display method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention relates to a document content display method and device, electronic equipment and a storage medium. The method comprises the steps that content display operation executed on a target document is detected; under the condition that the content display operation is detected, judging whether the second terminal is in a networking state or not; under the condition that the second terminal is in the networking state, first target content of the target document obtains far-end picture content based on a coded video stream address, and the far-end picture content is displayed on the first target content; under the condition that the second terminal is not in the networking state, first target content of the target document obtains local picture content based on the coded video stream address, and the local picture content is displayed on the first target content. Therefore, different types of picture contents can be obtained and displayed based on the same coded video stream address, so that the richness of the display mode of the document contents can be improved.

Description

Technical Field

[0001] The present application relates to the field of document processing technology, and in particular to a method, device, electronic device and storage medium for displaying document content. Background Art

[0002] In the related art, documents are an important information carrier, which is widely used in the recording, dissemination, sharing, and display of information. Among them, documents can generally include but are not limited to files in the following formats: doc format, docx format, ppt format, pptx format, etc. In addition, documents can also include offline documents stored locally, or online documents stored in the cloud. By editing the document content, the recording, dissemination, sharing, and display of the document content can be achieved.

[0003] However, the currently displayed document content is usually unable to intuitively display the inserted document attachments, video attachments, etc. As a result, the display mode of the document content is relatively low in richness.

[0004] It can be seen that how to improve the richness of the display method of document content is a technical issue worthy of attention. Summary of the invention

[0005] In view of this, in order to solve some or all of the above-mentioned technical problems, the embodiments of the present application provide a method, device, electronic device and storage medium for displaying document content.

[0006] In a first aspect, an embodiment of the present application provides a method for displaying document content, which is applied to a second terminal, and the method includes:

[0007] detecting a content display operation performed on a target document;

[0008] In case the content display operation is detected, determining whether the second terminal is in a networked state;

[0009] When the second terminal is in the networked state, the first target content of the target document obtains remote screen content based on the encoded video stream address, and displays the remote screen content in the first target content;

[0010] When the second terminal is not in the networking state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content in the first target content.

[0011] In a possible implementation, when the second terminal is in the networked state, the first target content of the target document obtains the remote screen content based on the encoded video stream address, and displays the remote screen content on the first target content, including:

[0012] Parsing the target document to obtain page data and a coded video stream address, wherein the coded video stream data is obtained according to the coded video stream address;

[0013] Deserialize the page data to obtain page elements;

[0014] Decoding the encoded video stream data to obtain multiple frames of remote screen content, display sequence numbers of each frame of remote screen content, and information about the remote screen content;

[0015] Rendering the multiple frames of remote screen content into the page element frame by frame according to the information of the remote screen content and the display sequence number, to obtain first target content including the multiple frames of remote screen content;

[0016] The multiple frames of remote image content are continuously played in the first target content in a rendering order.

[0017] In one possible implementation, the encoded video stream data is formed by encoding the picture content of a signal source acquired remotely, the first target content includes the picture content of the signal source, and the remote picture content played by the first target content is synchronized in real time with the picture content of the signal source played remotely.

[0018] In one possible implementation, the information of the remote screen content includes at least one of the following: the screen content ID of the signal source, the clarity of the screen content of the signal source, the screen content control protocol of the signal source, the control IP and port, the main and auxiliary code streams, whether the public network is open, the public network code stream address, the screen content type of the signal source, and the screen content permissions of the signal source.

[0019] In a possible implementation, when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content on the first target content, including:

[0020] Parsing the target document to obtain page data and a coded video stream address, wherein a unique identification number is obtained according to the coded video stream address;

[0021] Deserialize the page data to obtain page elements;

[0022] Access the unique identification number to obtain the local screen content;

[0023] The local screen content is inserted into the page element, and the local screen content is displayed on the first target content.

[0024] In a possible implementation manner, one unique identification number corresponds to one or more local screen contents;

[0025] In a case where the unique identification number corresponds to a local screen content, displaying the local screen content in the first target content includes: displaying the local screen content in the first target content;

[0026] In the case where one of the unique identification numbers corresponds to a plurality of local screen contents, displaying the local screen content in the first target content includes: displaying screen contents of the plurality of local screen contents alternately, cyclically or periodically in the first target content.

[0027] In one possible implementation, the page elements include at least one of the following: a function area, a navigation area, a design area, a signal source selection area, a status bar, text content and its location information, table content and its location information, picture content and its location information, flow chart content and its location information, local video content and its location information, location information of the first target content, and layout information of the first target content.

[0028] In a possible implementation, before detecting the content display operation performed on the target document, the method further includes:

[0029] The target document is obtained through a USB flash drive, a CD or the Internet.

[0030] In a second aspect, an embodiment of the present application provides a method for displaying document content, which is applied to a first terminal, and the method includes:

[0031] receiving an adding instruction, wherein the adding instruction instructs setting the video stream address in the first target content;

[0032] When the first terminal is in an online state, acquiring remote screen content corresponding to the video stream address, and rendering the remote screen content to the first target content;

[0033] or,

[0034] When the first terminal is not in an online state, obtaining local screen content corresponding to the video stream address, and inserting the local screen content into the first target content;

[0035] The first target content and page elements are integrated to form a target document.

[0036] In a possible implementation manner, integrating the first target content and the page element to form a target document includes:

[0037] Converting the page elements into page data, encoding the remote screen content to obtain encoded video stream data, and fusing the page data and the encoded video stream data into document data;

[0038] or,

[0039] Convert the page elements into page data, and make additional settings for the local screen content, so as to merge the page data and the local screen content into document data;

[0040] The document data constitutes the specific information and content of the target document.

[0041] In a possible implementation, converting the page elements into page data includes:

[0042] The page data is generated by serializing the page elements.

[0043] In a possible implementation, the target document is a layout document or a flow document.

[0044] In a third aspect, an embodiment of the present application provides a device for displaying document content, which is applied to a second terminal, and the device includes:

[0045] A first detection unit, configured to detect a content display operation performed on a target document;

[0046] a determination unit, configured to determine whether the second terminal is in a networked state when the content display operation is detected;

[0047] a first display unit, configured to obtain remote screen content based on the coded video stream address of the first target content of the target document and display the remote screen content on the first target content when the second terminal is in the networked state;

[0048] The second display unit is used for obtaining local screen content based on the encoded video stream address for the first target content of the target document and displaying the local screen content on the first target content when the second terminal is not in the networked state.

[0049] In a possible implementation, when the second terminal is in the networked state, the first target content of the target document obtains the remote screen content based on the encoded video stream address, and displays the remote screen content on the first target content, including:

[0050] Parsing the target document to obtain page data and a coded video stream address, wherein the coded video stream data is obtained according to the coded video stream address;

[0051] Deserialize the page data to obtain page elements;

[0052] Decoding the encoded video stream data to obtain multiple frames of remote screen content, display sequence numbers of each frame of remote screen content, and information about the remote screen content;

[0053] Rendering the multiple frames of remote screen content into the page element frame by frame according to the information of the remote screen content and the display sequence number, to obtain first target content including the multiple frames of remote screen content;

[0054] The multiple frames of remote image content are continuously played in the first target content in a rendering order.

[0055] In one possible implementation, the encoded video stream data is formed by encoding the picture content of a signal source acquired remotely, the first target content includes the picture content of the signal source, and the remote picture content played by the first target content is synchronized in real time with the picture content of the signal source played remotely.

[0056] In one possible implementation, the information of the remote screen content includes at least one of the following: the screen content ID of the signal source, the clarity of the screen content of the signal source, the screen content control protocol of the signal source, the control IP and port, the main and auxiliary code streams, whether the public network is open, the public network code stream address, the screen content type of the signal source, and the screen content permissions of the signal source.

[0057] In a possible implementation, when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content on the first target content, including:

[0058] Parsing the target document to obtain page data and a coded video stream address, wherein a unique identification number is obtained according to the coded video stream address;

[0059] Deserialize the page data to obtain page elements;

[0060] Access the unique identification number to obtain the local screen content;

[0061] The local screen content is inserted into the page element, and the local screen content is displayed on the first target content.

[0062] In a possible implementation manner, one unique identification number corresponds to one or more local screen contents;

[0063] In a case where the unique identification number corresponds to a local screen content, displaying the local screen content in the first target content includes: displaying the local screen content in the first target content;

[0064] In the case where one of the unique identification numbers corresponds to a plurality of local screen contents, displaying the local screen content in the first target content includes: displaying screen contents of the plurality of local screen contents alternately, cyclically or periodically in the first target content.

[0065] In one possible implementation, the page elements include at least one of the following: a function area, a navigation area, a design area, a signal source selection area, a status bar, text content and its location information, table content and its location information, picture content and its location information, flow chart content and its location information, local video content and its location information, location information of the first target content, and layout information of the first target content.

[0066] In a possible implementation, before detecting the content display operation performed on the target document, the device further includes:

[0067] The first acquisition unit is used to acquire the target document through a USB disk, a CD or a network.

[0068] In a fourth aspect, an embodiment of the present application provides a device for displaying document content, which is applied to a first terminal, and the device includes:

[0069] A receiving unit, configured to receive an adding instruction, wherein the adding instruction instructs to set the video stream address in the first target content;

[0070] A second acquisition unit is used to acquire the remote screen content corresponding to the video stream address when the first terminal is in a networked state, and render the remote screen content to the first target content;

[0071] or,

[0072] for obtaining the local screen content corresponding to the video stream address and inserting the local screen content into the first target content when the first terminal is not in an online state;

[0073] The integration unit is used to integrate the first target content and the page elements to form a target document.

[0074] In a possible implementation manner, integrating the first target content and the page element to form a target document includes:

[0075] Converting the page elements into page data, encoding the remote screen content to obtain encoded video stream data, and fusing the page data and the encoded video stream data into document data;

[0076] or,

[0077] Convert the page elements into page data, and make additional settings for the local screen content, so as to merge the page data and the local screen content into document data;

[0078] The document data constitutes the specific information and content of the target document.

[0079] In a possible implementation, converting the page elements into page data includes:

[0080] The page data is generated by serializing the page elements.

[0081] In a possible implementation, the target document is a layout document or a flow document.

[0082] In a fifth aspect, an embodiment of the present application provides an electronic device, including:

[0083] Memory for storing computer programs;

[0084] The processor is used to execute the computer program stored in the memory, and when the computer program is executed, the method of any embodiment of the method for displaying document content of the first aspect or the second aspect of the present application is implemented.

[0085] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method of any embodiment of the method for displaying document content of the first aspect or the second aspect described above is implemented.

[0086] In the seventh aspect, an embodiment of the present application provides a computer program, which includes a computer-readable code. When the computer-readable code is executed on a device, the processor in the device implements a method of any embodiment of the method for displaying document content in the first aspect or the second aspect mentioned above.

[0087] The document content display method provided in the embodiment of the present application can be applied to the second terminal, which can detect the content display operation performed on the target document. After that, when the content display operation is detected, it is determined whether the second terminal is in an online state. Then, when the second terminal is in the online state, the first target content of the target document obtains the remote screen content based on the coded video stream address, and the remote screen content is displayed in the first target content; when the second terminal is not in the online state, the first target content of the target document obtains the local screen content based on the coded video stream address, and the local screen content is displayed in the first target content. In this way, different types of screen content can be obtained and displayed based on the same coded video stream address, so that the richness of the display method of the document content can be improved.

[0088] The method for displaying document content provided by the embodiment of the present application can be applied to a first terminal, which can receive an add instruction, wherein the add instruction indicates to set the video stream address in the first target content, and then, when the first terminal is in an online state, obtain the remote screen content corresponding to the video stream address, and render the remote screen content to the first target content; or, when the first terminal is not in an online state, obtain the local screen content corresponding to the video stream address, insert the local screen content into the first target content, and finally, integrate the first target content and the page element to form a target document. Thus, the video stream address can be set in the first target content of the target document, so that when the first terminal is in an online state, the remote screen content corresponding to the video stream address is rendered to the first target content; when the first terminal is not in an online state, the local screen content corresponding to the video stream address is inserted into the first target content. Thus, the richness of the display method of the document content can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0089] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0090] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0091] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0092] Figure 1 A flowchart of a method for displaying document content provided in an embodiment of the present application;

[0093] Figure 2 A flowchart of another method for displaying document content provided in an embodiment of the present application;

[0094] Figure 3 A schematic diagram of document content display provided in an embodiment of the present application;

[0095] Figure 4 A schematic diagram of another document content display provided in an embodiment of the present application;

[0096] Figure 5 A schematic diagram of the structure of a document content display device provided in an embodiment of the present application;

[0097] Figure 6 A schematic diagram of the structure of another document content display device provided in an embodiment of the present application;

[0098] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0099] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. It should be noted that unless otherwise specifically stated, the relative arrangement of the components and steps, the numerical expressions and the numerical values ​​described in these embodiments do not limit the scope of the present application.

[0100] Those skilled in the art will understand that the terms "first" and "second" in the embodiments of the present application are only used to distinguish between different steps, devices, modules and other objects, and do not represent any specific technical meanings, nor do they indicate the logical order between them.

[0101] It should also be understood that in this embodiment, “plurality” may refer to two or more than two, and “at least one” may refer to one, two or more than two.

[0102] It should also be understood that any component, data or structure mentioned in the embodiments of the present application can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0103] In addition, the term "and / or" in this application is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the associated objects before and after are in an "or" relationship.

[0104] It should also be understood that the description of the various embodiments in this application focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0105] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.

[0106] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the above-mentioned technologies, methods, and equipment should be considered as part of the specification.

[0107] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0108] It should be noted that, in the absence of conflict, the embodiments in this application and the features in the embodiments can be combined with each other. To facilitate the understanding of the embodiments of the present application, the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0109] In order to solve the technical problem of how to improve the richness of the display mode of document content in the prior art, the present application provides a method, device, electronic device and storage medium for displaying document content, which can improve the richness of the display mode of document content.

[0110] Figure 1 A flowchart of a method for displaying document content provided in an embodiment of the present application. The method can be applied to a second terminal. When the second terminal is hardware, it can include but is not limited to: a smart phone, a laptop computer, a desktop computer, a portable computer, etc. In addition, the execution subject of the method can also be software. When the above-mentioned execution subject is software, the method can be implemented as multiple software or software modules, or as a single software or software module. No specific limitation is made here.

[0111] like Figure 1 As shown, the method specifically includes:

[0112] Step 101: Detecting a content display operation performed on a target document.

[0113] In this embodiment, the target document may be any document. As an example, the target document may include but is not limited to files in the following formats: doc format, docx format, ppt format, pptx format, or the target document may also be a file in other formats. In addition, the target document may be set (inserted) as an offline document attachment stored locally, or an online document attachment stored in the cloud.

[0114] The content display operation can be used to display the content of the target document. As an example, the content display operation can be an opening operation on the target document, for example, the opening operation can be implemented by the user by clicking / double-clicking the target document with the mouse.

[0115] Step 102: When the content display operation is detected, determine whether the second terminal is in a networked state.

[0116] In this embodiment, whether the second terminal is in a networked state may be determined by sending a network request, checking a network interface state, and the like.

[0117] Step 103: when the second terminal is in the networked state, the first target content of the target document obtains remote screen content based on the encoded video stream address, and displays the remote screen content in the first target content.

[0118] In this embodiment, the first target content may be content in a target document. When the second terminal is in the networking state, the first target content may include remote screen content acquired based on the coded video stream address.

[0119] The encoded video stream address may be an address of a video stream corresponding to the encoded video stream.

[0120] The remote screen content may be the screen content of the remote terminal of the second terminal. Here, the remote screen content is relative to the local screen content. The local screen content may be the screen content of the local second terminal. The remote screen content may be the screen content not located (stored) in the second terminal.

[0121] Here, when the second terminal is in the networking state, after determining the first target content of the target document, the remote screen content may be displayed in the first target content.

[0122] As an example, the local screen content includes pictures and / or videos in the file downloaded locally by the second terminal. At the same first target content, the local screen content, remote screen content, unique identification number and encoded video stream address have a corresponding relationship. Among them, the unique identification number is the corresponding picture, video, etc. in the file downloaded locally; for example, there is an association list associated with the unique identification number locally, and each list stores the correspondence between video stream encoding data, files and unique identification numbers, and the files include pictures, videos, etc. In this way, different types of screen content (local screen content, remote screen content) can be obtained through the same encoded video stream address.

[0123] Step 104: when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content in the first target content.

[0124] In this embodiment, the first target content may be content in a target document. When the second terminal is not in the networked state, the first target content may include local screen content acquired based on the coded video stream address.

[0125] The encoded video stream address may be an address of a video stream corresponding to the encoded video stream.

[0126] The local screen content may be the screen content stored locally in the second terminal. Here, the local screen content is relative to the remote screen content. The local screen content may be the screen content locally in the second terminal. The remote screen content may be the screen content not located locally in the second terminal.

[0127] Here, when the second terminal is not in the networked state, after determining the first target content of the target document, the local screen content may be displayed in the first target content.

[0128] In addition, in some cases, the first terminal, the second terminal and the server can communicate in the following manner:

[0129] The second terminal is connected to the server in communication, and the server is connected to multiple signal sources in communication through a collection device. The second terminal sends a collection instruction to the server; the server receives the collection instruction, and then obtains the second terminal identifier and the target signal source information carried in the collection instruction, and the server sends the second terminal identifier and the target signal source information to the collection device; the collection device receives the second terminal identifier and the target signal source information, and obtains the display interface content of the corresponding signal source according to the target signal source information, and further, the collection device encodes the above display interface content to form an encoded video stream, and further, the collection device sends the encoded video stream and the second terminal identifier to the server; the server then sends the encoded video stream to the terminal device corresponding to the second terminal identifier (i.e., the second terminal) according to the second terminal identifier; the second terminal receives the encoded video stream, and decodes the encoded video stream to obtain the above display interface content, and displays the display interface content on the second terminal. For example, the display interface content is displayed at the first target content of the target document of the second terminal.

[0130] The first terminal and the second terminal may be physically isolated from each other and not connected to the network. Documents that require interactive communication may be transmitted between the first terminal and the second terminal by means of, for example, a USB flash drive or a CD to achieve communication. The first terminal and the second terminal may also be in network communication with each other. Documents that require interactive communication may be transmitted between the first terminal and the second terminal by means of a network to achieve communication.

[0131] In the related art, offline files, offline videos, pictures, photos, etc. can be inserted into a document in the form of attachments. The offline data inserted into the document is displayed in the document with an attachment mark, where the attachment mark is only used to indicate the inserted object, and the attachment mark cannot display the text content of the offline data. If the text content of the offline data needs to be displayed, the user has to manually click on the attachment mark, and then the data corresponding to the attachment mark is opened, and then the text content of the data can be displayed. It should be noted that the modifications, edits, adjustments, etc. made by the user to the text content of the opened data are not recorded and stored in the offline data. Once the user closes the opened data and opens it again, all the modifications, edits, adjustments, etc. made by the user will disappear.

[0132] Through the technical solution of the present application, when the target document of the second terminal is opened, the remote screen content can be played and displayed at the first target content of the target document, or the local screen content can be played and displayed without the user manually triggering the opening of the remote screen content / local screen content. According to the networking status of the second terminal, the remote screen content is adaptively displayed on the first target content, or the local screen content is displayed, presenting a smart page display effect. For example, when the target document is on a networked terminal, its first target content displays the remote screen content, while when the target document is on another non-networked terminal, its first target content displays the local screen content. By acquiring and displaying different types of screen content based on the same encoded video stream address, the richness of the display method of the document content can be improved, and the flexibility of the display of the document content can be increased.

[0133] In addition, the user's editing operation on the corresponding screen content in the first target content will perform the corresponding editing operation on the source screen content of the corresponding screen content, and the editing operation will store the source screen content recorded in the corresponding screen content. That is, after performing the editing operation on the screen content (remote screen content / local screen content), the corresponding screen content is obtained; when the target document is closed and reopened, the first target content of the target document will display the corresponding screen content obtained after the above editing operation.

[0134] In some optional implementations of this embodiment, when the second terminal is in the networked state, the first target content of the target document obtains the remote screen content based on the encoded video stream address, and displays the remote screen content in the first target content, including the following steps:

[0135] The first step is to parse the target document to obtain page data and the encoded video stream address.

[0136] The encoded video stream data may be obtained according to the encoded video stream address.

[0137] Here, the parsing tool may be a multimedia player software, such as Windows Media Player; or may be a multimedia processing platform, such as Final Cut Pro.

[0138] The second step is to perform deserialization processing on the page data to obtain page elements.

[0139] The page elements may include but are not limited to: text, image, audio, and video.

[0140] Here, taking the target document as a PPT presentation document as an example, in the PPT presentation document, the tool for deserializing the page data is the PPT presentation document. Specifically, when a user opens the PPT presentation document, the PPT presentation document reads the serialized data in the file and converts it back to the original page elements for display and editing in the editor.

[0141] For text elements in page elements, the PPT presentation document will parse the serialized text data into editable text objects so that users can modify the text objects, for example, set the format of the text objects, etc.

[0142] For images, shapes, and other drawing elements in page elements, the PPT presentation document will parse the serialized image data or vector data into editable image objects or shape objects so that users can adjust, move, or modify their properties.

[0143] For audio and video elements in page elements, the PPT presentation document will parse the serialized audio data or video data into playable media objects so that users can play and control them in the PPT presentation document.

[0144] These deserialization processes are completed by the algorithm and parser inside the PPT presentation document, and users do not need to do manual operations. The PPT presentation document is responsible for restoring the serialized data into editable and playable page elements to ensure that users can modify and operate them (page elements) in the editor.

[0145] The third step is to decode the encoded video stream data to obtain multiple frames of remote image content, display sequence numbers of each frame of remote image content, and information about the remote image content.

[0146] Here, each time a frame of the signal source picture is acquired, the frame of the signal source picture may be encoded and sent to the second terminal for decoding.

[0147] In the fourth step, the multiple frames of remote screen content are rendered into the page element frame by frame according to the information of the remote screen content and the display sequence number, so as to obtain the first target content including the multiple frames of remote screen content.

[0148] Here, the picture content may be rendered and synthesized using, for example, an open graphics library OpenGL; or, the picture content may be embedded into a page element using a LiveWeb plug-in.

[0149] Specifically, the second terminal can render the multiple frames of remote screen content into the page element frame by frame according to the information of the remote screen content and the display sequence number in the following manner: first, the display order of each frame of the remote screen content can be determined by the display sequence number of each frame of the remote screen content, and then the remote screen content can be rendered into the page element frame by frame according to the display order.

[0150] Rendering page elements usually involves the following steps:

[0151] First, the document data is read and parsed into a Document Object Model (DOM) tree. The DOM tree represents the structure of the page, including various tags and the hierarchical relationships between them.

[0152] After that, the stylesheet is loaded and parsed. For example, the style rules can be matched with the elements in the DOM tree, and the final style applied to each element can be calculated.

[0153] Then, layout calculations are performed: determining the position and size of each element on the page.

[0154] Then, drawing is performed: elements are drawn onto the screen according to the calculated layout. The elements to be drawn may include text, graphics, background, etc.

[0155] Step 5: continuously play the multiple frames of remote image content in the first target content in the order of rendering.

[0156] As an example, see Figure 3 , Figure 3 A schematic diagram of document content display provided in an embodiment of the present application. Figure 3In one page of the target document, remote screen content (screen content located at the upper left corner, lower left corner, and lower right corner of the display page) may be set, and local screen content (screen content located at the upper right corner of the display page, i.e., screenshot attachment, test file attachment) may also be set. In the target document, the multiple frames of remote screen content representing the building may be continuously played in the order of rendering in the first target content (screen content located at the lower right corner of the display page), for example, continuously playing a real-time video of the building. Alternatively, in the target document, the multiple frames of remote screen content corresponding to the PPT presentation document may be continuously played in the order of rendering in the first target content (screen content located at the lower left corner of the display page), for example, continuously switching and playing each page of the PPT presentation document. Among them, the definitions of up, down, left, right, upper left, lower left, upper right, and lower right are as follows: when the display screen is facing the observer, up refers to the top edge of the screen, and the closer to the top of the screen, the higher it is; down is opposite to up, and is the bottom edge of the screen, and the closer to the bottom of the screen, the lower it is; left refers to the edge on the left hand side of the observer when the screen is facing the observer; right refers to the edge on the right hand side of the observer when the screen is facing the observer.

[0157] In addition, the number of first target contents in the target document can be one or more. If the target document contains multiple first target contents, and each first target content is rendered with different remote screen content, multiple different remote screen contents can be displayed in the target document. For example, see Figure 4 , Figure 4 A schematic diagram of another document content display provided in an embodiment of the present application. Figure 4 In the target document, three remote screen contents are displayed, each of which can represent a signal source screen content. In addition, a local screen content is also displayed in the target document, which can represent the screen content with "Click here to enter a title" at the bottom of the display page.

[0158] It can be understood that in the above optional implementation, when the second terminal is in the networked state, multiple frames of remote screen content can be continuously played in the first target content of the target document to play dynamic screen content, and the above dynamic screen content is synchronized with the screen content of the remote screen content source in real time. Thus, the richness of the content displayed in the target document is enriched.

[0159] In some application scenarios of the above-mentioned optional implementation methods, the encoded video stream data is formed by encoding the picture content of the signal source obtained remotely, the first target content includes the picture content of the signal source, and the remote picture content played by the first target content is synchronized in real time with the picture content of the signal source played remotely.

[0160] It can be understood that in the above application scenario, the picture content of the remote signal source can be played synchronously in real time in the target document, thereby achieving real-time display of the picture content of the remote signal source through the target document.

[0161] In some cases of the above application scenarios, the information of the remote screen content includes at least one of the following:

[0162] The picture content ID (Identification) of the signal source, the picture content clarity of the signal source, the picture content control protocol of the signal source, the control IP (Internet Protocol) and port, the main and auxiliary code streams, whether the public network is open, the public network code stream address, the picture content type of the signal source, and the picture content permissions of the signal source.

[0163] It can be understood that when the above-mentioned remote screen content information includes at least one of the above-mentioned contents, multiple frames of remote screen content can be rendered according to the contents included in the remote screen content information, thereby improving the diversity of remote screen content rendering methods.

[0164] In some optional implementations of this embodiment, when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content in the first target content, including the following steps:

[0165] The first step is to parse the target document to obtain page data and the encoded video stream address.

[0166] Among them, the unique identification number can be obtained according to the encoded video stream address.

[0167] Here, the parsing tool may be a multimedia player software, such as Windows Media Player; or may be a multimedia processing platform, such as Final Cut Pro.

[0168] The second step is to perform deserialization processing on the page data to obtain page elements.

[0169] The page elements may include but are not limited to: text, image, audio, and video.

[0170] Here, taking the target document as a PPT presentation document as an example, in the PPT presentation document, the tool for deserializing the page data is the PPT presentation document. Specifically, when a user opens the PPT presentation document, the PPT presentation document reads the serialized data in the file and converts it back to the original page elements for display and editing in the editor.

[0171] For text elements in page elements, the PPT presentation document will parse the serialized text data into editable text objects so that users can modify the text objects, for example, set the format of the text objects, etc.

[0172] For images, shapes, and other drawing elements in page elements, the PPT presentation document will parse the serialized image data or vector data into editable image objects or shape objects so that users can adjust, move, or modify their properties.

[0173] For audio and video elements in page elements, the PPT presentation document will parse the serialized audio data or video data into playable media objects so that users can play and control them in the PPT presentation document.

[0174] These deserialization processes are completed by the algorithm and parser inside the PPT presentation document, and users do not need to do manual operations. The PPT presentation document is responsible for restoring the serialized data into editable and playable page elements to ensure that users can modify and operate them (page elements) in the editor.

[0175] The third step is to access the unique identification number to obtain the local screen content.

[0176] The fourth step is to insert the local screen content into the page element, and display the local screen content on the first target content.

[0177] Here, the picture content may be rendered and synthesized using, for example, an open graphics library OpenGL; or, the picture content may be embedded into a page element using a LiveWeb plug-in.

[0178] It can be understood that in the above optional implementation, when the second terminal is not in the networked state, the local screen content of the second terminal can be displayed in the first target content of the target document.

[0179] In some application scenarios of the above optional implementation manner, one unique identification number corresponds to one or more local screen contents;

[0180] In a case where the unique identification number corresponds to a local screen content, displaying the local screen content in the first target content includes: displaying the local screen content in the first target content; or,

[0181] In the case where one of the unique identification numbers corresponds to a plurality of local screen contents, displaying the local screen content in the first target content includes: displaying screen contents of the plurality of local screen contents alternately, cyclically or periodically in the first target content.

[0182] It can be understood that in the above-mentioned application scenario, when the second terminal is not in the networked state, one or more local screen contents of the second terminal can be displayed in the first target content of the target document. When displaying multiple local screen contents of the second terminal, multiple local screen contents can be displayed alternately, cyclically or periodically, thereby further enriching the display method of the content in the document.

[0183] In some application scenarios of the above optional implementations, the page element includes at least one of the following:

[0184] Function area, navigation area, design area, signal source selection area, status bar, text content and its location information, table content and its location information, picture content and its location information, flow chart content and its location information, local video content and its location information, location information of the first target content, and layout information of the first target content.

[0185] It can be understood that in the above application scenarios, the remote screen content or the local screen content can be rendered according to the page elements of the target document: the location information of the first target content, the layout information of the first target content, and the screen content generated after rendering can be displayed on the first target content, thereby further enriching the richness of the content displayed in the document.

[0186] In some optional implementations of this embodiment, before detecting the content display operation performed on the target document, the target document may also be obtained through a USB disk, an optical disk, or a network.

[0187] Taking copying a target document from a USB flash drive from a first terminal (connected to the Internet) and then copying the target document in the USB flash drive to a second terminal (not connected to the Internet) as an example, the first target content of the target document seen by the user on the first terminal is different from the same first target content of the target document seen by the user on the second terminal. The first target content of the target document on the first terminal can display a real-time video screen, while the first target content of the target document on the second terminal can display a static picture.

[0188] It should be noted that the remote screen content and the local screen content corresponding to the same coded video stream address may be associated with each other or may be unrelated to each other. For example, when the remote screen content and the local screen content are associated with each other, the local screen content may be a frame or multiple frames of pictures previously captured from a signal source (a signal source corresponding to the remote screen content), and the captured frame of pictures is stored locally at the second terminal, and the captured multiple frames of pictures are also stored locally at the second terminal. For another example, when the remote screen content and the local screen content are associated with each other, the local screen content may be a video previously played by the signal source (a signal source corresponding to the remote screen content), and the video is stored locally at the second terminal.

[0189] It can be understood that in the above optional implementations, the target document can be obtained by means of a USB flash drive, a CD, or a network, thereby enabling the target document to be shared.

[0190] The method for displaying document content provided in the embodiment of the present application can detect the content display operation performed on the target document, and then, when the content display operation is detected, it is determined whether the second terminal is in a networked state, and then, when the second terminal is in the networked state, the first target content of the target document obtains the remote screen content based on the coded video stream address, and displays the remote screen content in the first target content; when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the coded video stream address, and displays the local screen content in the first target content. Thus, different types of screen content can be obtained and displayed based on the same coded video stream address, so that the richness of the display mode of the document content can be improved. In addition, in some cases, the real-time signal source content can be displayed as different content in different environments: when connected to the network, the real-time signal source resource (that is, rtsp (Real Time Streaming Protocol, real-time streaming protocol) stream) is displayed; when not connected to the network, for example, local videos, pictures, etc. are obtained according to the unique identification number. Thus, the second terminal can copy the target document in two environments. Among them, the above two environments refer to the networked environment and the non-networked environment. In an online environment, the remote signal source image can be displayed in real time; in an offline environment, the local image content can be displayed. Relative to the online environment of the terminal carrying the target document, when the terminal is offline, the target document is presented as offline on the terminal.

[0191] Figure 2 A flowchart of another method for displaying document content provided in an embodiment of the present application is shown below. Figure 2 As shown, the method specifically includes:

[0192] Step 201: receiving an adding instruction, wherein the adding instruction instructs to set a video stream address in a first target content.

[0193] In this embodiment, the first target content may be content in a target document to be formed.

[0194] The target document may be any document. As an example, the target document may include, but is not limited to, files in the following formats: doc format, docx format, ppt format, pptx format, or the target document may also be files in other formats. In addition, the target document may include an offline document stored locally, or an online document stored in the cloud.

[0195] The video stream address may be an address of the video stream, and the video stream address may correspond to the remote screen content and the local screen content.

[0196] Step 202: when the first terminal is in a networked state, obtain the remote screen content corresponding to the video stream address, and render the remote screen content to the first target content.

[0197] In this embodiment, when the first terminal is in the networking state, the first terminal can obtain the remote screen content corresponding to the video stream address, and render the remote screen content to the first target content.

[0198] The remote screen content may be the screen content of the signal source that is connected to the first terminal in communication. Here, the screen content of the signal source is relative to the local screen content. The local screen content may be the screen content of the first terminal. The screen content of the signal source may be the screen content that is not located in the first terminal.

[0199] Step 203: when the first terminal is not in an online state, obtain the local screen content corresponding to the video stream address, and insert the local screen content into the first target content.

[0200] In this embodiment, when the first terminal is not in the networking state, the first terminal can obtain the local screen content corresponding to the video stream address, and insert the local screen content into the first target content.

[0201] The local screen content may be the screen content stored locally in the first terminal. Here, the local screen content is relative to the remote screen content. The remote screen content may be the screen content of the signal source connected to the first terminal in communication. The local screen content may be the screen content located locally in the first terminal.

[0202] Step 204: Integrate the first target content and page elements to form a target document.

[0203] In this embodiment, a target document may be formed by integrating the first target content and the page elements.

[0204] In some optional implementations of this embodiment, the following methods may be used to integrate the first target content and page elements to form a target document, including:

[0205] The first step is to convert the page elements into page data when the first terminal is in an online state, encode the remote screen content to obtain encoded video stream data, and merge the page data and the encoded video stream data into document data.

[0206] Alternatively, when the first terminal is not in an online state, the page elements are converted into page data, and additional settings are made to the local screen content, so that the page data and the local screen content are merged into document data.

[0207] In the second step, the document data constitutes the specific information and content of the target document.

[0208] It can be understood that in the above-mentioned optional implementation method, the document data of the target document formed may include page data and encoded video stream data of the remote screen content, or the document data of the target document formed may include page data and local screen content. Thus, when a content display operation performed on the target document is detected, the local screen data (local screen content) or the remote screen data (remote screen content) can be displayed in the first target content of the target document.

[0209] In some application scenarios of the above optional implementations, the page elements may be converted into page data in the following manner: the page data is generated by serializing the page elements.

[0210] Here, the serialization process can be understood as the inverse process of the above-mentioned deserialization process, which will not be repeated here.

[0211] In some optional implementations of this embodiment, the target document is a layout document or a flow document.

[0212] Among them, layout documents are a document format with a fixed page layout and relatively stable content and format. The page presentation effect remains highly consistent across different devices and software, and will not change significantly due to changes in the reading environment. Common layout document formats include PDF (Portable Document Format), CEB (ChineseeBook, Founder Apabi e-book format), etc.

[0213] The layout of streaming documents is adaptively adjusted according to the display device and reading software. The focus is on the coherence and fluency of the content, and the format is relatively flexible. Common streaming document formats include TXT (plain text format), DOCX (Microsoft Word document format), HTML (Hypertext Markup Language), etc.

[0214] It can be understood that in the above optional implementation, different types of screen content can be obtained and displayed in a layout document or a streaming document based on the same encoded video stream address, thereby improving the richness of the display method of the content in the layout document or the streaming document.

[0215] It should be noted that, in addition to the above contents, this embodiment may also include Figure 1 The corresponding technical features described in the corresponding embodiments are realized Figure 1 For details on the technical effects of the method for displaying the document content shown, please refer to Figure 1 For the sake of brevity, the relevant description is not repeated here.

[0216] The method for displaying document content provided by the embodiment of the present application can be applied to a first terminal, which can receive an add instruction, wherein the add instruction indicates to set the video stream address in the first target content, and then, when the first terminal is in an online state, obtain the remote screen content corresponding to the video stream address, and render the remote screen content to the first target content; or, when the first terminal is not in an online state, obtain the local screen content corresponding to the video stream address, insert the local screen content into the first target content, and finally, integrate the first target content and the page element to form a target document. Thus, the video stream address can be set in the first target content of the target document, so that when the first terminal is in an online state, the remote screen content corresponding to the video stream address is rendered to the first target content; when the first terminal is not in an online state, the local screen content corresponding to the video stream address is inserted into the first target content. Thus, the richness of the display method of the document content can be improved.

[0217] Figure 5 A schematic diagram of the structure of a document content display device provided in an embodiment of the present application. The document content display device is applied to a second terminal and specifically includes:

[0218] A first detection unit 401 is used to detect a content display operation performed on a target document;

[0219] A determination unit 402 is configured to determine whether the second terminal is in a networked state when the content display operation is detected;

[0220] A first display unit 403 is configured to obtain remote screen content based on the coded video stream address of the first target content of the target document when the second terminal is in the networked state, and display the remote screen content on the first target content;

[0221] The second display unit 404 is configured to obtain local screen content based on the encoded video stream address for the first target content of the target document and display the local screen content on the first target content when the second terminal is not in the networked state.

[0222] In a possible implementation, when the second terminal is in the networked state, the first target content of the target document obtains the remote screen content based on the encoded video stream address, and displays the remote screen content on the first target content, including:

[0223] Parsing the target document to obtain page data and a coded video stream address, wherein the coded video stream data is obtained according to the coded video stream address;

[0224] Deserialize the page data to obtain page elements;

[0225] Decoding the encoded video stream data to obtain multiple frames of remote screen content, display sequence numbers of each frame of remote screen content, and information about the remote screen content;

[0226] Rendering the multiple frames of remote screen content into the page element frame by frame according to the information of the remote screen content and the display sequence number, to obtain first target content including the multiple frames of remote screen content;

[0227] The multiple frames of remote image content are continuously played in the first target content in a rendering order.

[0228] In one possible implementation, the encoded video stream data is formed by encoding the picture content of a signal source acquired remotely, the first target content includes the picture content of the signal source, and the remote picture content played by the first target content is synchronized in real time with the picture content of the signal source played remotely.

[0229] In one possible implementation, the information of the remote screen content includes at least one of the following: the screen content ID of the signal source, the clarity of the screen content of the signal source, the screen content control protocol of the signal source, the control IP and port, the main and auxiliary code streams, whether the public network is open, the public network code stream address, the screen content type of the signal source, and the screen content permissions of the signal source.

[0230] In a possible implementation, when the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content on the first target content, including:

[0231] Parsing the target document to obtain page data and a coded video stream address, wherein a unique identification number is obtained according to the coded video stream address;

[0232] Deserialize the page data to obtain page elements;

[0233] Access the unique identification number to obtain the local screen content;

[0234] The local screen content is inserted into the page element, and the local screen content is displayed on the first target content.

[0235] In a possible implementation manner, one unique identification number corresponds to one or more local screen contents;

[0236] In a case where the unique identification number corresponds to a local screen content, displaying the local screen content in the first target content includes: displaying the local screen content in the first target content;

[0237] In the case where one of the unique identification numbers corresponds to a plurality of local screen contents, displaying the local screen content in the first target content includes: displaying screen contents of the plurality of local screen contents alternately, cyclically or periodically in the first target content.

[0238] In one possible implementation, the page elements include at least one of the following: a function area, a navigation area, a design area, a signal source selection area, a status bar, text content and its location information, table content and its location information, picture content and its location information, flow chart content and its location information, local video content and its location information, location information of the first target content, and layout information of the first target content.

[0239] In a possible implementation, before detecting the content display operation performed on the target document, the device further includes:

[0240] The first acquisition unit (not shown in the figure) is used to acquire the target document through a USB flash drive, a CD or a network.

[0241] The document content display device provided in this embodiment may be as follows: Figure 5 The display device of the document content shown in can execute the above Figure 1All the steps of the corresponding document content display method can achieve the technical effect of the document content display method described above. Please refer to the above related description for details. For the sake of brevity, they will not be repeated here.

[0242] Figure 6 A schematic diagram of the structure of another document content display device provided in an embodiment of the present application. The document content display device is applied to a first terminal and specifically includes:

[0243] The receiving unit 411 is configured to receive an adding instruction, wherein the adding instruction indicates to set the video stream address in the first target content;

[0244] A second acquisition unit 412 is configured to acquire, when the first terminal is in an online state, a remote screen content corresponding to the video stream address, and render the remote screen content to the first target content;

[0245] or,

[0246] for obtaining the local screen content corresponding to the video stream address and inserting the local screen content into the first target content when the first terminal is not in an online state;

[0247] The integration unit 413 is used to integrate the first target content and the page elements to form a target document.

[0248] In a possible implementation manner, integrating the first target content and the page element to form a target document includes:

[0249] Converting the page elements into page data, encoding the remote screen content to obtain encoded video stream data, and fusing the page data and the encoded video stream data into document data;

[0250] or,

[0251] Convert the page elements into page data, and make additional settings for the local screen content, so as to merge the page data and the local screen content into document data;

[0252] The document data constitutes the specific information and content of the target document.

[0253] In a possible implementation, converting the page elements into page data includes:

[0254] The page data is generated by serializing the page elements.

[0255] In a possible implementation, the target document is a layout document or a flow document.

[0256] The document content display device provided in this embodiment may be as follows: Figure 6 The display device of the document content shown in can execute the above Figure 2 All the steps of the corresponding method for displaying the content of each document, thereby achieving the technical effect of the method for displaying the content of the document described above, please refer to the above related description for details. For the sake of brevity, they will not be repeated here.

[0257] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, Figure 7 The electronic device 500 shown includes: at least one processor 501, a memory 502, at least one network interface 504 and other user interfaces 503. The various components in the electronic device 500 are coupled together via a bus system 505. It is understood that the bus system 505 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 505 is not shown in FIG. Figure 7 Various buses are labeled as bus system 505 .

[0258] The user interface 503 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0259] It can be understood that the memory 502 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 502 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0260] In some implementations, the memory 502 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 5021 and an application program 5022 .

[0261] Among them, the operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 5022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present application can be included in the application 5022.

[0262] In this embodiment, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application 5022, the processor 501 is used to execute the method steps provided by each method embodiment.

[0263] The method disclosed in the above embodiment of the present application can be applied to the processor 501, or implemented by the processor 501. The processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 501. The above processor 501 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502 and completes the steps of the above method in combination with its hardware.

[0264] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the above functions of the present application, or a combination thereof.

[0265] For software implementation, the technology described above in this article can be implemented by a unit that performs the functions described above in this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0266] The electronic device provided in this embodiment may be Figure 7 The electronic device shown in can execute all steps of the display method of each document content described above, thereby achieving the technical effect of the display method of each document content described above. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0267] The embodiment of the present application also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0268] When one or more programs in the storage medium can be executed by one or more processors, the document content display method executed on the electronic device side can be implemented.

[0269] The processor is used to execute the document content display program stored in the memory to implement the following steps of the document content display method executed on the electronic device side.

[0270] The professionals should also be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0271] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0272] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0273] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for displaying document content, characterized in that: Applied to the second terminal, the method includes: detecting a content display operation performed on a target document; In case the content display operation is detected, determining whether the second terminal is in a networked state; When the second terminal is in the networked state, the first target content of the target document obtains remote screen content based on the encoded video stream address, and displays the remote screen content in the first target content; When the second terminal is not in the networking state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content in the first target content.

2. The method according to claim 1, characterized in that When the second terminal is in the networked state, the first target content of the target document obtains remote screen content based on the encoded video stream address, and displays the remote screen content on the first target content, including: Parsing the target document to obtain page data and a coded video stream address, wherein the coded video stream data is obtained according to the coded video stream address; Deserialize the page data to obtain page elements; Decoding the encoded video stream data to obtain multiple frames of remote screen content, display sequence numbers of each frame of remote screen content, and information about the remote screen content; Rendering the multiple frames of remote screen content into the page element frame by frame according to the information of the remote screen content and the display sequence number, to obtain first target content including the multiple frames of remote screen content; The multiple frames of remote image content are continuously played in the first target content in a rendering order.

3. The method according to claim 2, characterized in that The encoded video stream data is formed by encoding the picture content of the signal source obtained remotely, the first target content includes the picture content of the signal source, and the remote picture content played by the first target content is synchronized in real time with the picture content of the signal source played remotely.

4. The method according to claim 3, characterized in that The information of the remote screen content includes at least one of the following: the screen content ID of the signal source, the picture content clarity of the signal source, the picture content control protocol of the signal source, the control IP and port, the main and auxiliary code streams, whether the public network is open, the public network code stream address, the picture content type of the signal source, and the picture content authority of the signal source.

5. The method according to claim 1, characterized in that When the second terminal is not in the networked state, the first target content of the target document obtains the local screen content based on the encoded video stream address, and displays the local screen content on the first target content, including: Parsing the target document to obtain page data and a coded video stream address, wherein a unique identification number is obtained according to the coded video stream address; Deserialize the page data to obtain page elements; Access the unique identification number to obtain the local screen content; The local screen content is inserted into the page element, and the local screen content is displayed on the first target content.

6. The method according to claim 5, characterized in that One of the unique identification numbers corresponds to one or more of the local screen contents; In a case where the unique identification number corresponds to a local screen content, displaying the local screen content in the first target content includes: displaying the local screen content in the first target content; In the case where one of the unique identification numbers corresponds to a plurality of local screen contents, displaying the local screen content in the first target content includes: displaying screen contents of the plurality of local screen contents alternately, cyclically or periodically in the first target content.

7. The method according to claim 2 or 5, characterized in that: The page elements include at least one of the following: function area, navigation area, design area, signal source selection area, status bar, text content and its location information, table content and its location information, picture content and its location information, flow chart content and its location information, local video content and its location information, location information of the first target content, and layout information of the first target content.

8. The method according to claim 1, characterized in that Before the detecting of the content display operation performed on the target document, the method further includes: The target document is obtained through a USB flash drive, a CD or the Internet.

9. A method for displaying document content, characterized in that: Applied to a first terminal, the method includes: receiving an adding instruction, wherein the adding instruction instructs setting the video stream address in the first target content; When the first terminal is in an online state, acquiring remote screen content corresponding to the video stream address, and rendering the remote screen content to the first target content; or, When the first terminal is not in an online state, obtaining local screen content corresponding to the video stream address, and inserting the local screen content into the first target content; The first target content and page elements are integrated to form a target document.

10. The method according to claim 9, characterized in that The step of integrating the first target content and the page elements to form a target document includes: Converting the page elements into page data, encoding the remote screen content to obtain encoded video stream data, and fusing the page data and the encoded video stream data into document data; or, Convert the page elements into page data, and make additional settings for the local screen content, so as to merge the page data and the local screen content into document data; The document data constitutes the specific information and content of the target document.

11. The method according to claim 10, characterized in that The converting the page elements into page data comprises: The page data is generated by serializing the page elements.

12. The method according to any one of claims 9 to 11, characterized in that: The target document is a layout document or a streaming document.

13. A document content display device, characterized in that: Applied to a second terminal, the device includes: A first detection unit, configured to detect a content display operation performed on a target document; a determination unit, configured to determine whether the second terminal is in a networked state when the content display operation is detected; a first display unit, configured to obtain remote screen content based on the coded video stream address of the first target content of the target document and display the remote screen content on the first target content when the second terminal is in the networked state; The second display unit is used for obtaining local screen content based on the encoded video stream address for the first target content of the target document and displaying the local screen content on the first target content when the second terminal is not in the networked state.

14. A device for displaying document content, characterized in that: Applied to a first terminal, the device includes: A receiving unit, configured to receive an adding instruction, wherein the adding instruction instructs to set the video stream address in the first target content; A second acquisition unit is used to acquire the remote screen content corresponding to the video stream address when the first terminal is in a networked state, and render the remote screen content to the first target content; or, for obtaining the local screen content corresponding to the video stream address and inserting the local screen content into the first target content when the first terminal is not in an online state; The integration unit is used to integrate the first target content and the page elements to form a target document.

15. An electronic device, characterized in that: include: Memory for storing computer programs; A processor is used to execute a computer program stored in the memory, and when the computer program is executed, the method for displaying the document content of any one of claims 1 to 12 is implemented.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for displaying the document content of any one of claims 1 to 12 is implemented.

Images