Document playing control method and device, electronic equipment and computer storage medium

Abstract

The invention provides a document playing control method and device, and relates to the technical fields of document processing, artificial intelligence, natural language processing, computer vision and the like. According to the specific implementation scheme, a to-be-processed document is obtained; analyzing a document page and an initial playing sequence of the document page of the to-be-processed document to obtain a document page analysis result; constructing an initial graph structure based on a document page analysis result; obtaining an operation graph structure based on document playing information input by a user and the initial graph structure; based on the operation graph structure, the to-be-played document and the target playing sequence of the to-be-played document are obtained, and the reliability of playing control of the to-be-played document is improved.

Description

Technical Field

[0001] The present disclosure belongs to the field of computer technology, and particularly relates to natural language processing, operations research, decision science, and other technical fields. In particular, it provides a document playback control method and device, an electronic device, and a computer-readable storage medium. Background Art

[0002] Presentations are widely used information display and communication tools in modern work and learning. However, to obtain new presentations with alternative playback sequences, the traditional approach is to first parse the presentation document. Based on the results of the document parsing, the playback sequence of the parsed results is manually edited and converted into a new presentation and its playback sequence. Document parsing methods include parsing the presentation's underlying XML (Extensible Markup Language) structure or simply mapping the presentation's content to common data structures such as JSON (JavaScript Object Notation). While this document parsing approach can extract basic content, it struggles to effectively express the complex structure and relationships within a PPT and lacks a comprehensive understanding of the presentation's content semantics and visual layout. While this manual editing approach can convert the parsed content into presentations of other styles, it requires manual effort and is prone to errors, resulting in poor playback quality for the new presentation. Summary of the Invention

[0003] The present disclosure provides a document playback control method and device, an electronic device, and a computer-readable storage medium.

[0004] According to a first aspect, a document playback control method is provided, the method comprising: obtaining a document to be processed; parsing the document pages and the initial playback order of the document pages of the document to be processed to obtain a document page parsing result; constructing an initial graph structure based on the document page parsing result; obtaining an operation graph structure based on the document playback information input by the user and the initial graph structure; and obtaining the document to be played and the target playback order of the document to be played based on the operation graph structure.

[0005] According to a second aspect, a document playback control device is provided, which includes: an acquisition unit, configured to acquire a document to be processed; a parsing unit, configured to parse the document pages and the initial playback order of the document pages in the document to be processed, and obtain a document page parsing result; a construction unit, configured to construct an initial graph structure based on the document page parsing result; an operation unit, configured to obtain an operation graph structure based on document playback information and the initial graph structure input by a user; and an acquisition unit, configured to obtain a target document based on the operation graph structure.

[0006] According to a third aspect, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described in any implementation manner of the first aspect.

[0007] According to a fourth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, where the computer instructions are used to cause a computer to execute the method as described in any implementation of the first aspect.

[0008] The document playback control method and device provided by the embodiments of the present disclosure first obtain a document to be processed; secondly, parse the document page and the initial playback order of the document page to be processed to obtain the document page parsing result; thirdly, construct an initial graph structure based on the document page parsing result; thirdly, obtain an operation graph structure based on the document playback information input by the user and the initial graph structure; and finally, obtain the document to be played and the target playback order of the document to be played based on the operation graph structure. Thus, the document to be processed is explicitly converted into an operation graph structure with complex demonstration playback logic through the graph structure, and the operation graph structure is converted into the document to be played and the target playback order required by the user, so that the document to be played can be played according to the target playback order, thereby improving the reliability of the playback control of the document to be played.

[0009] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings are provided to facilitate a better understanding of the present invention and do not constitute a limitation of the present disclosure.

[0011] Figure 1 is a flow chart of an embodiment of a document playback control method according to the present disclosure;

[0012] Figure 2 is a structural diagram of the initial graph structure in the present disclosure;

[0013] Figure 3 It is a structural diagram of an embodiment of the document playback control device disclosed in the present invention;

[0014] Figure 4 3 is a block diagram of an electronic device for implementing the document playback control method according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0015] Unless expressly stated otherwise, throughout the specification and claims, the term "comprise" or variations such as "include" or "comprising", etc., will be understood to include the stated elements or components but not to exclude other elements or other components.

[0016] The technical solutions of the present disclosure are described below through specific examples. It should be understood that one or more steps mentioned in the present disclosure do not exclude the existence of other methods and steps before and after the combination step, or other methods and steps may be inserted between these explicitly mentioned steps. It should also be understood that these examples are only used to illustrate the present disclosure and are not used to limit the scope of the present disclosure. Unless otherwise specified, the numbering of each method step is only for the purpose of identifying each method step, and does not limit the order of arrangement of each method or limit the scope of implementation of the present disclosure. Changes or adjustments in their relative relationships can also be regarded as the scope of implementation of the present disclosure without substantial changes in the technical content.

[0017] The sources of the raw materials and instruments used in the examples are not particularly limited and can be purchased from the market or prepared according to conventional methods known to those skilled in the art.

[0018] Traditional document parsing methods, such as directly parsing the underlying XML structure of a presentation document, or simply mapping its content to a general data structure such as JSON, or API libraries based on specific formats, which provide access to the basic structure of the document (such as pages, shapes, and text boxes), can extract basic content, but it is difficult to effectively express the complex structure and playback logic of the presentation document. Specifically, as a lightweight data exchange format, JSON has an inherent tree-like or key / value pair structure, which has limited capabilities in representing the rich spatial layout relationships (such as overlap, alignment, and combination), logical relationships (such as animation sequences and hyperlink jumps), semantic associations, and style inheritance between pages of a presentation document. This simple data structure cannot support deep, relationship-based queries, intelligent modifications, or complex generation tasks of the presentation document content.

[0019] Furthermore, existing tools often lack a comprehensive understanding of the semantics and visual layout of presentation content, making it difficult to implement intelligent content query, modification, style transfer, and automated generation. Users often need to perform manual operations, which is inefficient and prone to errors.

[0020] In view of the defects in the traditional technology, the present disclosure proposes a document playback control method. Figure 1 A process 100 according to an embodiment of a document playback control method of the present disclosure is shown. The document playback control method includes the following steps:

[0021] Step 101: Obtain the document to be processed.

[0022] In this embodiment, the to-be-processed document is a document to be processed. The to-be-processed document may include multiple document pages arranged in a certain order, and each document page may have corresponding page elements. By dividing the to-be-processed document into two levels: the entire document page and the page elements, the to-be-processed document can be converted into a graph structure. The document type of the to-be-processed document can be one of various types, such as a presentation, a spreadsheet software document, a word processing software document, or a Portable Document Format (PDF). In actual applications, the to-be-processed document can be any of PPT and PDF.

[0023] In this embodiment, the document to be processed can be obtained in a variety of ways. For example, the document to be processed can be a document obtained from a server by an executing entity running an artificial intelligence-based document generation method through real-time communication with the server. Alternatively, the document to be processed can be a document extracted from a database by the executing entity. Alternatively, the document to be processed can be a document uploaded by a user. By processing the document to be processed using the method disclosed herein, the target document desired by the user can be obtained.

[0024] Step 102 : parsing the document pages and the initial playback order of the document pages of the document to be processed to obtain a document page parsing result.

[0025] In this embodiment, the document to be processed has multiple document pages, and the multiple document pages have a corresponding arrangement order. Each document page has corresponding page elements. The page elements are the basic units that make up the page. The page elements can specifically be buttons, display content, images and other units. The page elements include: play elements, wherein the play elements are used to control the playback of the document page of the document to be processed. The playback elements of each document page or between pages have a corresponding relationship. By parsing the document pages and the initial playback order of the document pages, the document to be processed and the playback status of the document to be processed can be effectively identified.

[0026] In this embodiment, the initial playback order is the playback order of the document pages in the pending document. For example, the initial playback order is: play the document pages in the order in which they are arranged, or play the odd-numbered pages first and then the even-numbered pages in the order in which the document pages are arranged. When the pending document or a playback element on the pending document is externally triggered, the pending document can be directly played according to the initial playback order. The initial playback order can be directly obtained from an attribute value of the pending document. If the pending document has a playback function, the initial playback order of the pending document can be determined based on the playback function information.

[0027] In this embodiment, step 102 includes: using an artificial intelligence model that integrates natural language processing and computer vision to parse the document pages and the initial playback order of the document pages of the document to be processed, thereby obtaining a page element parsing result, wherein the page element parsing result includes: all document pages of the document to be processed, the page arrangement order of the document pages, master pages, and layouts; page elements of each document page, including but not limited to text boxes (TextBox), images (Pictures), shapes (Shapes), tables (Tables), charts (Charts), SmartArt graphics, multimedia objects (video / audio), group objects (Groups), etc.; and attributes of each page element, wherein the attributes of each page element include: content attributes, including text content, image content (or its description / label), table data, chart data series and category, etc.; position and geometric attributes, including the precise coordinates (x, y), dimensions (width, height), and rotation angle of the page element on the page; and visual style attributes, including font (name, size, color, bold, italic, etc.), fill color, border style, shape type, transparency, and shadow effects, etc. Structural and relationship properties include the document page to which the page element belongs, its z-order, group relationships (whether it belongs to a group), hyperlink targets, animation effects (type, order, triggering method), and notes. Page element relationships include implicit relationships between page elements, such as spatial proximity, alignment, content relevance (for example, a text description is related to the adjacent chart data), and style similarity / inheritance.

[0028] In this embodiment, when the document to be processed is a PPT or PDF document, the initial page nodes of the PPT or PDF can be generated and sequentially connected according to the physical order when the tool is designed and laid out to obtain the document page parsing result.

[0029] Step 103: construct an initial graph structure based on the document page parsing results.

[0030] In this embodiment, based on the document page parsing results, a graph data structure is constructed to obtain an initial graph structure, which is used to represent the entire document to be processed. The initial graph structure is the core intermediate representation of the present disclosure. Figure 2 As shown, A to F are nodes representing the document pages of the document to be processed in the initial graph structure, and the edges between A to F are used to represent the relationship between each node, which can represent the playback order of the document pages. Figure 2In the example, node E has corresponding relationships with node B, node D, and node F. For example, the playback of any document page in node B, node D, and node F will trigger the playback of node E. Node A only has relationships with node B and node F. The playback of any document page in node B and node F will trigger the playback of node A. Node C only has relationships with node B and node D. The playback of any document page in node B and node D will trigger the playback of node C.

[0031] In this embodiment, the page element parsing results include: all document pages and the initial playback order of document pages, page attributes (such as page order, layout, etc.), page elements, page element attributes, and page element relationships, wherein the page element attributes include the page element's own attributes as well as structure and relationship attributes. The structure and relationship attributes are used to characterize the relationship between the page element and the document page, such as which document page the page element belongs to. The above step 103 includes: determining nodes and node attributes based on all document pages and page elements in the page element parsing results; determining edges and edge attributes based on the page element relationships, initial playback order, and structure and relationship attributes in the page element parsing results; connecting each node with an edge, and adding corresponding attribute information to the edges and nodes based on the attributes and initial playback order of the page elements in the page element parsing results to obtain an initial graph structure.

[0032] In this embodiment, the graph structure can naturally and richly represent the complex relationships (space, style, semantics, interaction, etc.) between elements in the document, overcoming the limitations of simple structures such as JSON. When the documents to be processed are various types of documents, step 103 can support the conversion of the document format to be processed (such as PPT, PDF, etc.) to a unified intermediate initial graph structure, and can generate any supported output format from the initial graph structure, realizing seamless migration and format conversion of document pages and playback logic.

[0033] Step 104: Obtain an operation graph structure based on the document playback information input by the user and the initial graph structure.

[0034] In this embodiment, the operation graph structure is a graph structure derived by combining document playback information input by the user with the structural information of the initial graph structure. The operation graph structure can be used to obtain a document to be played. The document to be played is the document requested by the user. The document format of the document to be played can be the same as or different from the document format to be processed, such as a PPT document to be processed and a PDF document to be played.

[0035] In this embodiment, the document playback information is used to represent the user's playback request for the document. This document playback information may be information for performing add, delete, modify, or query operations on the initial graph structure. By performing add, delete, modify, or query operations on the initial graph structure, an operation graph structure can be obtained. Step 104 includes: parsing the document playback information into graph structure information; and adding nodes or edges to the initial graph structure, deleting nodes or edges from the initial graph structure, modifying nodes or edges from the initial graph structure, or querying nodes or edges from the initial graph structure according to the graph structure information.

[0036] In this embodiment, adding a node or edge to the initial graph structure includes: adding a new node to the initial graph structure, such as adding a new page node to a specified document page node; adding a new edge to the initial graph structure, and establishing a relationship edge between the new page element and the document page.

[0037] In this embodiment, deleting nodes or edges in the initial graph structure includes: deleting document pages in the initial graph structure, such as deleting a document page node or an element node on the page (and processing the associated edges at the same time). Deleting edges, such as removing a relationship on the edges between document page nodes.

[0038] In this embodiment, modifying nodes or edges in the initial graph structure includes: modifying node attributes, such as changing the text content, font size, or color of a document page node; modifying the position of a document page node; and modifying edges, such as changing the page order or hyperlink destination.

[0039] In this embodiment, the nodes or edges in the above-mentioned query initial graph structure include: attribute-based query operations, such as searching for all document page nodes whose font is "Microsoft YaHei". Content-based query operations, such as searching for document page nodes whose content contains specific keywords / synonyms. Relationship-based query operations, such as searching for document page nodes related to the grounding of the playback element of the document page. Complex graph pattern queries, such as searching for document page nodes that "contains title A and chart B, and chart B is below title A". Natural language query interface: users can ask questions in natural language (such as "What is on page 3?", "Which pages mention 'user growth'?"), and the system converts them into graph query statements for execution.

[0040] Step 105: Based on the operation graph structure, obtain the document to be played and the target playing order of the document to be played.

[0041] In this embodiment, after operating on the initial graph structure to obtain an operation graph structure, the operation graph structure or new content generated based on the operation graph structure can be re-rendered into a target format of a to-be-played document and a target playback order for the to-be-played document. The type of the to-be-played document can be the same as that of the to-be-processed document, or it can be a document of a different type than the to-be-processed document. When the to-be-played document and the to-be-processed document are of different types, the to-be-played document generated from the to-be-processed document is a document that has undergone style conversion.

[0042] When the document to be processed is of the same type as the document to be played, in a specific example, the document to be processed is a PPT, and the graph structure information is converted back to a target document in the PPT file format, preserving the content, layout, style, and relationship.

[0043] In this embodiment, the document to be played and the document to be processed can be the same or different; the target playback order is the playback order of the document pages in the document to be played, and the target playback order is also the playback order of the document pages of the document to be played based on the document playback information input by the user. For example, the target playback order can be to play the odd-numbered document pages in the document to be played first, and then play the even-numbered document pages in the document to be played; or the target playback order can be to play the document pages in the document to be played in sequence. Relative to the document to be processed, regardless of whether the document pages of the document to be played have changed, the target playback order is different from the initial playback order.

[0044] In this embodiment, the above-mentioned step 105 includes: inputting the operation graph structure into a pre-trained artificial intelligence model to obtain the document to be played and the target playback order output by the artificial intelligence model, wherein the artificial intelligence model is a model trained through a large number of samples to convert graph structure information into the document corresponding to the graph structure information and the document page sequence in the document, that is, the artificial intelligence model can directly identify the nodes and edges in the operation graph structure, and based on the attributes of the nodes and edges, convert the operation graph structure into the document to be played and the playback order of the document to be played.

[0045] The document playback control method provided by the embodiments of the present disclosure first obtains a document to be processed; secondly, parses the document pages and the initial playback order of the document pages to obtain the document page parsing results; thirdly, constructs an initial graph structure based on the document page parsing results; thirdly, obtains an operation graph structure based on the document playback information input by the user and the initial graph structure; and finally, obtains the document to be played and the target playback order of the document to be played based on the operation graph structure. Thus, the document to be processed is explicitly converted into an operation graph structure with complex demonstration playback logic through the graph structure, and the operation graph structure is converted into the target document required by the user, thereby improving the efficiency of generating the target document.

[0046] Optionally, in some embodiments of the present disclosure, the document playback control method further includes: receiving a document playback instruction from a user; and playing the documents to be played according to a target playback order based on the document playback instruction. In this embodiment, the document playback instruction is an instruction that directly controls the playback of the documents to be played. After receiving the document playback instruction from the user, the documents to be played are directly played according to the target playback order, thereby achieving direct playback of the documents to be played.

[0047] In some optional implementations of the present disclosure, the above-mentioned document page and initial playback order parsing of the document to be processed to obtain the document page parsing results include: performing document page level parsing on the document to be processed to obtain page recognition results; performing initial playback order parsing on the document to be processed to obtain playback recognition results; based on the page recognition results and the playback recognition results, determining the page information of each document page, the playback elements in each document page, and the playback sequence number of the document page controlled by the playback element; based on the page information, the playback elements, and the playback sequence number, determining the association relationship between the document page and the playback element, and using the page information, the playback elements, and the association relationship as the document page parsing result.

[0048] In this optional implementation, an artificial intelligence model integrated with natural language processing and computer vision can be used to perform document page-level analysis on the document to be processed to obtain page recognition results, wherein the document page-level analysis takes each document page in the document to be processed as the analysis object, and distinguishes the relationship between any two document pages in all document pages in the document to be processed; wherein the page recognition results include: page information of all document pages of the document to be processed, the arrangement order of each document page in all document pages, the layout of each document page, and the relationship between the playback elements in each document page and other document pages in all document pages, such as, only by triggering the playback element of one document page can another document page be displayed, wherein the page information is used for basic information of the document page, such as the identification, name, style, etc. of the document page.

[0049] In this optional implementation, the above-mentioned initial playback order parsing of the document to be processed and obtaining the playback identification result include: identifying the playback element in the document to be processed; obtaining the key attribute of the playback element; determining at least one document page controlled by the playback element and the playback sequence number of each document page in the at least one document page based on the key attribute. It should be noted that the initial playback order of all document pages in the document to be processed is determined through at least one document page and the playback sequence number.

[0050] In this embodiment, the above-mentioned page recognition results include page information of each document page and each playback element, and the playback recognition results include the playback sequence number of the document page controlled by each playback element. Therefore, the page recognition results and the playback recognition results can be used to determine the page information of all document pages corresponding to the document to be processed, the playback elements in all document pages, and the playback sequence number of the document page controlled by each playback element. Based on the playback sequence number and the page information, the association relationship of all document pages in the document to be processed and the playback elements in the document page can be analyzed. Based on the playback elements and the playback sequence number, the association relationship between the playback elements in different document pages can be determined.

[0051] The method for obtaining document page parsing results provided by this optional implementation method performs document page level parsing on the document to be processed to obtain page recognition results; performs initial playback sequence parsing on the document to be processed to obtain playback recognition results; based on the page recognition results and the playback recognition results, determines the page information of each document page, the playback elements in each document page, and the playback sequence number of the document page controlled by the playback element; based on the page information, the playback elements, and the playback sequence number, determines the association relationship between the document page and the playback element, and uses the page information, the playback elements, and the association relationship as the document page parsing result, thereby improving the reliability of the document page parsing result.

[0052] In some optional implementations of the present disclosure, the above-mentioned construction of the initial graph structure based on the document page parsing results includes: determining the nodes and node attributes based on the page information and playback elements in the document page parsing results; determining the edges and edge attributes based on the association relationships in the document page parsing results to obtain the initial graph structure.

[0053] In this optional implementation, the page information is the basic information of the document page. The document page can be determined through the page information. Based on the document page of the document to be processed and the playback element in the document page parsing result, the node in the initial graph structure can be determined, and the node can be used to represent the document page and the playback element; the page information can also be used to determine the overall layout, style and other page attributes of the document page and the display style of the playback element in the document page, the position in the document page and other element attributes, and fill the page attributes and element attributes into the corresponding attribute content of the node to obtain the attributes of the node.

[0054] In this optional implementation, the document page parsing results include associations between document pages (such as a document page is a subpage of another document page, and the other document page can only be displayed by triggering the document page), and associations between document pages and playback elements (such as the relationship of which document page the playback element belongs to, and the playback relationship of which document pages the playback element controls in a certain order). Through the associations in the document page parsing results, the edges between the nodes in the initial graph structure can be determined, and the edges only represent the relationship between the nodes. The attributes of the edges can be specifically determined by the type of association, and the attributes are used to represent the specific relationship of the edges.

[0055] The method for constructing the initial graph structure provided by this optional implementation method determines the nodes and node attributes based on the page information and playback elements in the document page parsing results; determines the edges and edge attributes based on the association relationships in the document page parsing results to obtain the initial graph structure, providing a reliable implementation method for constructing the initial graph structure and improving the reliability of obtaining the initial graph structure.

[0056] In some optional implementations of the present disclosure, the above-mentioned document playback information includes: uploaded documents and migration requirements. Based on the document playback information and the initial graph structure input by the user, obtaining the operation graph structure includes: parsing the uploaded document to obtain the upload parsing result; based on the upload parsing result, constructing the upload graph structure; based on the migration requirements, using the attributes of the nodes in the initial graph structure to replace the attributes of the nodes corresponding to the nodes in the uploaded graph structure, and using the attributes of the edges in the initial graph structure to replace the attributes of the edges corresponding to the edges in the uploaded graph structure, to obtain the operation graph structure.

[0057] In this optional implementation, the uploaded document is a document uploaded by the user, and the migration request is a request to transfer the pending document to the uploaded document. This migration request can be a style conversion request, layout and typesetting request, etc. By using the uploaded document and the migration request, the document style of the pending document can be fully migrated to the uploaded document, achieving layout and typesetting / font style conversion between the two different documents.

[0058] In this optional implementation, the above-mentioned parsing of the uploaded document to obtain the upload parsing results includes: parsing the page information of the document page of the uploaded document to obtain the page information of the document page of the uploaded document and the playback elements in the document page; parsing the document page playback order of the uploaded document to obtain the association relationship between the document pages in the uploaded document, and the association relationship between the document page and the playback elements in the uploaded document, and taking the page information of the document page of the uploaded document, the playback elements in the document page, the association relationship between the document pages, and the association relationship between the document pages in the uploaded document as the upload parsing results.

[0059] In this optional implementation, the process of constructing the uploaded graph structure based on the uploaded parsing results is the same as the process of constructing the initial graph structure, and will not be repeated here.

[0060] In this optional implementation, the migration requirement is used to characterize the need to convert the style and / or layout of the initial graph structure to the uploaded graph structure. To this end, based on the migration requirement, the attributes of the nodes in the initial graph structure are used to replace the attributes of the nodes corresponding to the nodes in the uploaded graph structure, and the attributes of the edges in the initial graph structure are used to replace the attributes of the edges corresponding to the edges in the uploaded graph structure. Based on the requirements in the migration requirement, all the attributes in the nodes and / or edges can be replaced, or some of the attributes in the nodes and / or edges can be replaced.

[0061] This optional implementation provides a method for obtaining an operation graph structure, which parses the uploaded document to obtain an upload parsing result; constructs an upload graph structure based on the upload parsing result; based on the migration requirements, replaces the attributes of the nodes corresponding to the nodes in the uploaded graph structure with the attributes of the nodes in the initial graph structure, and replaces the attributes of the edges corresponding to the edges in the uploaded graph structure with the attributes of the edges in the initial graph structure to obtain an operation graph structure, thereby realizing a conversion process for migrating content to the uploaded graph structure based on the initial graph structure, and providing a reliable implementation method for obtaining the operation graph structure.

[0062] In some optional implementations of the present disclosure, the above-mentioned operation graph structure obtained based on the document playback information and initial graph structure input by the user includes: determining the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes based on the document playback information input by the user; modifying the initial graph structure to obtain the operation graph structure based on the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes.

[0063] In this optional implementation, the above-mentioned document playback information can be natural language description information, which represents the interaction logic through the natural language description information (such as "When you click this button, jump to page 10 and play animation effect 3"), and the system converts it into a modification of the graph structure. Specifically, the document playback information can be the natural language description information obtained directly according to the user's playback order intention, and the page nodes in the initial graph structure are rearranged through the document playback information to generate an operation graph structure. Optionally, the document playback information can also be written into a corresponding custom projection scheme with the help of application extension language and other methods according to the playback order required by the user (multiple sets of custom projection schemes can be supported, and the user selects one of them as the default projection scheme to obtain the document playback information). In this optional implementation, the document to be played is the document that the document to be processed needs to be converted into, and the document playback information is used to characterize the presentation form and playback form of the document to be played that the user expects. The above-mentioned method of determining the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes based on the document playback information input by the user includes: performing page keyword recognition on the document playback information input by the user to determine the document page and document page layout of the document to be played; performing playback sequence keyword recognition on the document playback information input by the user to determine the playback order of all playback sequences; when there are pictures in the document playback information, a deep learning model can be used to recognize the pictures in the document playback information to determine the playback elements in the document page and the document page layout of the document page; a natural language model can also be used to determine the association relationship and key attributes between each document page and the corresponding playback element, wherein the association relationship between the document page and the corresponding playback element refers to the playback element related to the document page. The related playback element can be a playback element located on the document page, or it can be a playback element that controls the document page to be played according to the target playback order. The key attributes can include the main attributes in the attributes of the document page and the main attributes in the attributes of the playback element.

[0064] In this optional implementation, the above-mentioned modification of the initial graph structure based on the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and the key attributes to obtain the operation graph structure includes: querying the nodes in the initial graph structure based on the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and the key attributes to obtain the node query result; querying the playback order in the initial graph structure based on the playback order of all document pages in the document to be played and the playback elements of each document page to obtain the sequence query result; generating new node information or new node attributes of the target node based on the node query result; generating the target playback order of the target node based on the sequence query result, replacing the node information of the target node in the initial graph structure with the new node information, replacing the node attributes of the target node in the initial graph structure with the new node attributes, and replacing the initial playback order of the target node in the initial graph structure with the target playback order to obtain the operation graph structure.

[0065] Optionally, in this optional implementation, the above-mentioned initial graph structure is modified based on the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and the key attributes, to obtain an operation graph structure including: in response to the association relationship of a document page in the document to be played being different from the association relationship of the document page in the document to be processed, removing the edge of the document page in the initial graph structure, adding an edge for the document page in the initial graph structure, and setting the attributes of the edge based on the key attributes of the document page, so that the set attributes represent the association relationship with the document page in the document to be played.

[0066] The method for obtaining the operation graph structure provided by this optional implementation deeply parses the document playback information input by the user, determines the information of the target node in the document to be played, and uses the parsed information to replace the information in the initial graph structure, thereby improving the accuracy of the operation graph structure generation.

[0067] In some optional implementations of the present disclosure, the above-mentioned document playback information includes: document playback sequence information and document layout information. Based on the document playback information input by the user, the playback sequence of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and the key attributes are determined, including: based on the document layout information, all document pages in the document to be played and the page layout of each document page, the playback elements of each document page, the initial relationship and initial attributes between each document page and the corresponding playback element are determined; based on the document playback sequence information, the playback sequence number of each document page in the document to be played is determined; based on the playback sequence number, the initial relationship and initial attributes are modified to obtain the association relationship and key attributes between each document page and the corresponding playback element.

[0068] In this optional implementation, the document playback sequence information represents the information of the target playback sequence. The target playback sequence of the document to be played can be determined through the document playback sequence, and the target playback sequence can be converted into node attributes and recorded in the operation graph structure; the document layout information represents the layout of each document page in the document to be played and the arrangement order of the document pages, and the document layout information can be converted into node attributes and recorded in the operation graph structure.

[0069] In this optional implementation, the initial relationships are the relationships between document pages in the document to be played, determined by document layout information, when no document playback order information is added. For example, the first document page is the parent page of the second document page. The initial attributes are the attributes of the document pages and playback elements of the document to be played, determined by document layout information, when no document playback order information is added.

[0070] In this optional implementation, after determining the playback sequence number of each document page using the document playback sequence information, the actual playback order of each document page can be determined. This is not determined directly based on the layout of the document pages. Modifying the initial relationships and initial attributes mentioned above refers to adding the relationship content and attribute content determined by the playback sequence number to the relationship content of the initial relationships and the attribute content of the initial attributes, thereby obtaining the associated relationships and key attributes.

[0071] This optional implementation provides a method for determining the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes. It comprehensively considers the document playback order and document layout of the played document, determines the association relationship and key attributes between the document pages and playback elements in the played document, and improves the comprehensiveness and reliability of the information obtained.

[0072] In some optional implementations of the present disclosure, the above-mentioned document playback information includes: event information and action information to be added; based on the document playback information and the initial graph structure input by the user, the operation graph structure is obtained, including: based on the event information, determining the event node and the first edge related to the event node; based on the action information, determining the action node and the second edge related to the action node; adding the event node, action node, first edge, and second edge to the initial graph structure to obtain the operation graph structure.

[0073] In this optional implementation, the event information and action information to be added can be obtained through FSM (Finite State Machine) modeling. The process of the user describing the page playback order through natural language is simplified to the update process of the FSM. Event information reflects the conditions or signals that trigger state transitions in the finite state machine. Event information can be external input, timer triggers, or changes in internal system conditions. Action information is the operation performed in a specific state or during a state transition, such as data processing, signal output, etc. The FSM triggers state transitions through event information and executes action information during the transition process.

[0074] In this optional implementation, the state node is the physical page number of the corresponding page node, the starting node is page 1, and the input symbol set is the ID names of the elements in each page that mark the hyperlinks that jump between pages.

[0075] In this optional implementation, the transition function that maps the input symbol and the current state to the next state defines which destination page the hyperlink element in the corresponding page number will jump to.

[0076] In this optional implementation, action information can include maintenance actions and transition actions. In an FSM, state nodes can be broken down into entry / exit / maintenance actions, and transition functions can be mapped to event-triggered transition actions, enabling the transition from FSM logic to an event-driven system. During design, the action binding method should be selected based on the state machine type (such as Mealy or Moore), and the event response logic should be managed through the state transition table. Existing hyperlinks can be updated to redirect to the destination page, and new hyperlink elements can be added to link any two pages.

[0077] In actual applications, if the document to be played is a PPT or PDF, before generating the final PPT / PDF, the playback logic described by the FSM can also be output as a visual mind map, allowing the user to confirm the corresponding event information and action information through the mind map.

[0078] In this optional implementation, the event information to be added is the basic information about the triggering event related to the document to be processed, and the action information to be added is the basic information about the action related to the event in the event information. For example, the event information includes: controlling the conversion of the document to be processed and the initial playback order of the document to be processed to the target playback order of the document to be played and the target playback order of the document to be played by clicking a hyperlink; the hyperlink address information; the name and address of the document to be processed; and the name and address of the document to be played. The action information includes: entering the hyperlink page, clicking the hyperlink, and the URL of the hyperlink.

[0079] In this optional implementation, the first edge is an edge radiating from the event node, such as the first edge includes: an edge from an event node to an event node, an edge from an event node to an action node, and an edge from an event node to a node in the initial graph structure; the above process of determining the event node and the first edge related to the event node based on event information can refer to the process of constructing nodes and edges in the initial graph structure, and will not be repeated here.

[0080] In this optional implementation, the second edge is an edge radiating from the action node, such as the second edge includes: an edge from action node to action node, an edge from event node to action node, and an edge from action node to a node in the initial graph structure; the above process of determining the action node and the second edge related to the action node based on action information can refer to the process of constructing nodes and edges in the initial graph structure, and will not be repeated here.

[0081] In this optional implementation, the event node, action node, first edge, and second edge all carry their own attributes. Based on the content recorded in the attributes, the event node, action node, first edge, and second edge are added to the initial graph structure to obtain the operation graph structure.

[0082] This optional implementation provides a method for obtaining an action graph structure that can explicitly represent complex presentation playback logic, not just sequential playback. Nonlinear navigation paths can be defined by adding event nodes (such as OnClick), action nodes (such as GoToPage and PlayAnimation), and their corresponding first and second edges, improving the comprehensiveness and reliability of the action graph representation.

[0083] In a specific example, a user uploads a document to be processed in PPT format (Input.pptx). The document playback control method runs on an executing entity (hereafter referred to as the system) that generates an initial graph structure, Graph_A. The user provides a command through the user interface or natural language: "On page 2, click the 'Learn More' button to jump to page 8." The system identifies the playback element (the "Learn More" button, which may be located by text or visual location) and the target (page 8, corresponding to page node P8) in the command. The system adds an INTERACTS_WITH edge to Graph_A, from node N_button to node P8 (or an intermediate node representing the jump action), and sets the edge attributes, such as trigger: onClick and target: page 8. During the document generation and conversion phase, the generator reads these INTERACTS_WITH edges and sets corresponding hyperlinks or interactive actions in the generated PPT.

[0084] The document playback control method disclosed herein effectively overcomes the limitations of existing technologies by deeply parsing the document being processed and constructing a powerful graph data structure as an intermediate representation. This solution not only enables complex queries and precise editing of the document's content and structure, but also supports automated generation of documents to be played, style transfer, and the design of complex interactive logic. This significantly improves the intelligence and efficiency of presentation processing and has broad application prospects. Its core concept of a graph-structured intermediate representation also has the potential to be extended to other types of document processing.

[0085] Further references Figure 3 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a document playback control device. Figure 1 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0086] like Figure 3 As shown, the document playback control device 300 provided in this embodiment includes: an acquisition unit 301, a parsing unit 302, a construction unit 303, an operation unit 304, and a obtaining unit 305. Among them, the above-mentioned acquisition unit 301 can be configured to acquire a document to be processed. The above-mentioned parsing unit 302 can be configured to parse the document pages and the initial playback order of the document pages of the document to be processed to obtain the document page parsing results. The above-mentioned construction unit 303 can be configured to construct an initial graph structure based on the document page parsing results. The above-mentioned operation unit 304 can be configured to obtain an operation graph structure based on the document playback information input by the user and the initial graph structure. The above-mentioned obtaining unit 305 can be configured to obtain a target document based on the operation graph structure.

[0087] In this embodiment, the specific processing and technical effects of the acquisition unit 301, the parsing unit 302, the construction unit 303, the operation unit 304, and the obtaining unit 305 in the document playback control device 300 can be referred to respectively. Figure 1 The relevant descriptions of step 101, step 102, step 103, step 104 and step 105 in the corresponding embodiment are not repeated here.

[0088] In some embodiments of the present disclosure, the above-mentioned parsing unit 302 is configured to: perform document page level parsing on the document to be processed to obtain a page identification result; perform initial playback sequence parsing on the document to be processed to obtain a playback identification result; determine the page information of each document page, the playback elements in each document page, and the playback sequence number of the document page controlled by the playback element based on the page identification result and the playback identification result; determine the association relationship between the document page and the playback element based on the page information, the playback element, and the playback sequence number, and use the page information, the playback element, and the association relationship as the document page parsing result.

[0089] In some embodiments of the present disclosure, the above-mentioned construction unit 303 is configured to: determine the nodes and node attributes based on the page information and playback elements in the document page parsing results; determine the edges and edge attributes based on the association relationships in the document page parsing results to obtain the initial graph structure.

[0090] In some embodiments of the present disclosure, the above-mentioned document playback information includes: uploaded documents and migration requirements, and the above-mentioned operation unit 304 is configured to: parse the uploaded document to obtain the upload parsing result; construct the upload graph structure based on the upload parsing result; based on the migration requirements, use the attributes of the nodes in the initial graph structure to replace the attributes of the nodes corresponding to the nodes in the uploaded graph structure, and use the attributes of the edges in the initial graph structure to replace the attributes of the edges corresponding to the edges in the uploaded graph structure to obtain the operation graph structure.

[0091] In some embodiments of the present disclosure, the above-mentioned operation unit 304 is configured to: determine the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes based on the document playback information input by the user; modify the initial graph structure based on the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes to obtain an operation graph structure.

[0092] In some embodiments of the present disclosure, the above-mentioned document playback information includes: document playback sequence information and document layout information, and the above-mentioned operation unit 304 is configured to: determine all document pages in the document to be played and the page layout of each document page, the playback elements of each document page, the initial relationship between each document page and the corresponding playback element, and the initial attributes based on the document layout information; determine the playback sequence number of each document page in the document to be played based on the document playback sequence information; modify the initial relationship and initial attributes based on the playback sequence number to obtain the association relationship and key attributes between each document page and the corresponding playback element.

[0093] In some embodiments of the present disclosure, the above-mentioned document playback information includes: event information and action information to be added; the above-mentioned operation unit 304 is configured to: determine the event node and the first edge related to the event node based on the event information; determine the action node and the second edge related to the action node based on the action information; add the event node, action node, first edge, and second edge to the initial graph structure to obtain the operation graph structure.

[0094] The document playback control device provided by the embodiment of the present disclosure first obtains the document to be processed by the acquisition unit 301; secondly, the parsing unit 302 parses the document page and the initial playback order of the document page to be processed to obtain the document page parsing result; thirdly, the construction unit 303 constructs the initial graph structure based on the document page parsing result; thirdly, the operation unit 304 obtains the operation graph structure based on the document playback information input by the user and the initial graph structure; finally, the acquisition unit 305 obtains the document to be played and the target playback order of the document to be played based on the operation graph structure. Thus, the document to be processed is explicitly converted into an operation graph structure with complex demonstration playback logic through the graph structure, and the operation graph structure is converted into the target document required by the user, thereby improving the efficiency of generating the target document.

[0095] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0096] Figure 4 A schematic block diagram of an example electronic device 400 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their modes are provided for example only and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0097] like Figure 4 As shown, the device 400 includes a computing unit 401, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 402 or a computer program loaded from a storage unit 408 into a random access memory (RAM) 403. Various programs and data required for the operation of the device 400 can also be stored in the RAM 403. The computing unit 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0098] Various components in device 400 are connected to I / O interface 405, including an input unit 406, such as a keyboard, mouse, etc.; an output unit 407, such as various types of displays, speakers, etc.; a storage unit 408, such as a magnetic disk, optical disk, etc.; and a communication unit 409, such as a network card, modem, wireless communication transceiver, etc. Communication unit 409 allows device 400 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0099] The computing unit 401 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of the computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 performs the various methods and processes described above, such as the document playback control method. For example, in some embodiments, the document playback control method can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as the storage unit 408. In some embodiments, part or all of the computer program can be loaded and / or installed on the device 400 via the ROM 402 and / or the communication unit 409. When the computer program is loaded into the RAM 403 and executed by the computing unit 401, one or more steps of the document playback control method described above can be performed. Alternatively, in other embodiments, the computing unit 401 can be configured to perform the document playback control method by any other suitable means (e.g., by means of firmware).

[0100] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0101] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. Such program code can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable document playback control device, so that when the program code is executed by the processor or controller, the modes / operations specified in the flow charts and / or block diagrams are implemented. The program code can be executed entirely on the machine, partially on the machine, as a standalone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0102] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0103] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0104] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0105] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not limited herein.

[0106] The foregoing descriptions of specific exemplary embodiments of the present disclosure are for purposes of illustration and description. These descriptions are not intended to limit the present disclosure to the precise forms disclosed, and it is apparent that many variations and modifications are possible in light of the foregoing teachings. The exemplary embodiments have been selected and described for the purpose of explaining the specific principles of the present disclosure and their practical application, thereby enabling those skilled in the art to realize and utilize a variety of exemplary embodiments of the present disclosure and various options and modifications. The scope of the present disclosure is intended to be defined by the claims and their equivalents.

Claims

1. A document playback control method, the method comprising: Get documents to be processed; Parsing the document pages and the initial playback order of the document pages on the document to be processed to obtain a document page parsing result; Constructing an initial graph structure based on the document page parsing result; Obtaining an operation graph structure based on the document playback information input by the user and the initial graph structure; Based on the operation graph structure, the to-be-played document and the target playing order of the to-be-played document are obtained.

2. The method according to claim 1, wherein The parsing of the document pages and the initial playback order of the document pages on the document to be processed to obtain the document page parsing result includes: Performing document page-level analysis on the document to be processed to obtain a page recognition result; Performing an initial playback sequence analysis on the document to be processed to obtain a playback recognition result; Based on the page recognition result and the playback recognition result, determining page information of each document page, a playback element in each document page, and a playback sequence number of the document page controlled by the playback element; Based on the page information, the play element and the play sequence number, the association relationship between the document page and the play element is determined, and the page information, the play element and the association relationship are used as the document page parsing result.

3. The method according to claim 1, wherein The constructing of the initial graph structure based on the document page parsing result includes: Determine the nodes and their attributes based on the page information and playback elements in the document page parsing results; Based on the association relationships in the document page parsing results, the edges and edge attributes are determined to obtain the initial graph structure.

4. The method according to claim 1, wherein The document playback information includes: uploaded documents and migration requirements. The operation graph structure obtained based on the document playback information input by the user and the initial graph structure includes: Parsing the uploaded document to obtain an upload parsing result; Based on the upload parsing results, construct an upload graph structure; Based on the migration requirements, the attributes of the nodes in the initial graph structure are used to replace the attributes of the nodes corresponding to the nodes in the uploaded graph structure, and the attributes of the edges in the initial graph structure are used to replace the attributes of the edges corresponding to the edges in the uploaded graph structure to obtain the operation graph structure.

5. The method according to claim 1, wherein The obtaining of the operation graph structure based on the document playback information input by the user and the initial graph structure includes: Based on the document playback information input by the user, determining the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes; Based on the playback order of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes, the initial graph structure is modified to obtain an operation graph structure.

6. The method according to claim 5, wherein: The document playback information includes: document playback sequence information and document layout information. The document playback information input by the user determines the playback sequence of all document pages in the document to be played, the document page layout of each document page, the playback elements of each document page, the association relationship between each document page and the corresponding playback element, and key attributes, including: Based on the document layout information, determining all document pages in the document to be played, as well as the page layout of each document page, the play element of each document page, and the initial relationship and initial attributes between each document page and the corresponding play element; Determining the play sequence number of each document page in the to-be-played document based on the document play sequence information; Based on the play sequence number, the initial relationship and initial attributes are modified to obtain the association relationship and key attributes between each document page and the corresponding play element.

7. The method according to claim 1, wherein The document playback information includes: event information and action information to be added; the operation graph structure obtained based on the document playback information input by the user and the initial graph structure includes: Determining an event node and a first edge related to the event node based on the event information; Determining an action node and a second edge related to the action node based on the action information; The event node, the action node, the first edge, and the second edge are added to the initial graph structure to obtain an operation graph structure.

8. A document playback control device, comprising: an acquiring unit, configured to acquire a document to be processed; a parsing unit configured to parse the document pages and the initial playback order of the document pages on the document to be processed, and obtain a document page parsing result; A construction unit configured to construct an initial graph structure based on the document page parsing result; an operating unit configured to obtain an operation graph structure based on document playback information input by a user and the initial graph structure; The obtaining unit is configured to obtain a target document based on the operation graph structure.

9. An electronic device, characterized in that: include: at least one processor; and a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable the computer to execute the method according to any one of claims 1 to 7.

Images