Electronic document editing method and device, computer device and program

Abstract

This application provides a method, apparatus, computer device, and storage medium for editing an electronic document, which are applicable to the technical field of office automation. The method includes the steps of opening a second editing interface for the electronic document on a second client through an insert collaboration portal provided by a first client on a first computer device, where the insert collaboration portal is used to collaborate with the first client to insert a multimedia file into the electronic document; obtaining a multimedia file waiting to be inserted; and inserting the multimedia file into a first insertion position in the second editing interface. This application enables the function of quickly inserting multimedia files with just a few simple steps.

Description

[Technical Field]

[0001] This application claims priority from a Chinese patent application filed with the China Patent Office on May 31, 2021, bearing application number 202110604273.7 and entitled "Method, device, equipment and storage medium for editing electronic documents," the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the technical field of office automation, and in particular to a method and apparatus for editing electronic documents (also called digital documents), and a computer device and program. [Background technology]

[0003] Electronic documents are the most commonly used office applications in everyday office life, such as the word processing program Word, the table processing program Excel, and the presentation file processing program PPT.

[0004] In the process of editing an electronic document using a computer, there is a need to insert an image (also called a photograph or picture) into the electronic document. For example, when a user is taking notes for a class, they need to take a photo of the text content in a textbook and then add it to the notes. In the related art, a user uses a mobile phone (smartphone) to take a photo of the text content in a textbook, and then transmits the photo to a computer via an instant messaging program, a data line, or a local area network synchronization tool. Then, the user uses a file manager on the computer to find the photo and insert it into a specified location in the electronic document by copying and pasting.

[0005] The above method not only requires other transmission programs other than electronic documents, but also many human-machine interaction steps, so the human-machine interaction efficiency of the entire process is low. Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the embodiments of the present application is to provide a method and apparatus for editing an electronic document, a computer device, and a program that allow images to be quickly inserted into an electronic document. [Means for solving the problem]

[0007] According to one aspect of the present application, there is provided a method for editing an electronic document, the method being executed by a second computing device, the method comprising: Opening a second editing interface of the electronic document at a second client via an insert collaboration portal provided by the first client in the first computer device, the insert collaboration portal being used to collaborate with the first client to insert the multimedia file into the electronic document; Retrieve multimedia files waiting to be inserted; and Inserting the multimedia file into a first insertion location in the second editing interface is included.

[0008] According to one aspect of the present application, there is provided a method for editing an electronic document, the method being executed by a first computing device, the method comprising: Displaying a first editing interface for the electronic document to the first client; generating an insert collaboration entry for the electronic document in response to an insert collaboration operation on the first editing interface, the insert collaboration entry being used to collaborate with a second client on a second computing device to insert the multimedia file into the electronic document; and Providing an insert collaboration portal to the second client is included.

[0009] According to another aspect of the present application, there is provided an apparatus for editing an electronic document, the apparatus comprising: an access module for opening a second editing interface of the electronic document at a second client via an insert collaboration portal provided by the first client in the first computing device, the insert collaboration portal being used to collaborate with the first client to insert a multimedia file into the electronic document; an acquisition module for acquiring a multimedia file waiting to be inserted; and An insert module for inserting the multimedia file into the first insert location in the second editing interface is included.

[0010] According to another aspect of the present application, there is provided an apparatus for editing an electronic document, the apparatus comprising: a display module for displaying a first editing interface of the electronic document to the first client; a generating module for generating an insert collaboration entry of the electronic document in response to an insert collaboration operation on the first editing interface, the insert collaboration entry being used to insert a multimedia file in collaboration with a second client on a second computing device; and An output module for providing an insert collaboration portal to a second client is included.

[0011] According to another aspect of the present application, there is provided a computing device, the computing device including a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, at least one program, code set or instruction set being loaded and executed by the processor to implement the method for editing an electronic document as described in the above aspect.

[0012] According to another aspect of the present application, a computer storage medium is provided, the computer-readable storage medium having stored thereon at least one program code, the program code being loaded and executed by a processor to implement the method for editing an electronic document as described in the above aspect.

[0013] According to another aspect of the present application, there is provided a computer program product (or computer program), the computer program product (or computer program) comprising computer instructions stored in a computer-readable storage medium, the computer instructions read by a processor of a computing device from the computer-readable storage medium, and the processor executes the computer instructions, thereby causing the computing device to perform the method for editing an electronic document according to the aspect described above. [Effects of the Invention]

[0014] The advantageous effects brought about by the technical solutions provided in the embodiments of the present application are at least as follows:

[0015] An electronic document is opened at a first client on a first computer device, and at this time, an insert collaboration entry for the electronic document is provided by the first client. The electronic document is synchronized at a second client on a second computer device based on the insert collaboration entry. This allows a multimedia file to be inserted into the electronic document using the second client. For example, a multimedia file collected in real time by the second client using a mobile terminal, or a multimedia file from a local file, can be quickly and accurately inserted into the electronic document being edited by the first client. This allows the ability (function) to quickly insert multimedia files with just a few simple steps. [Brief explanation of the drawings]

[0016] [Figure 1]FIG. 1 illustrates the principle of a method for editing an electronic document provided in one exemplary embodiment of the present application. [Figure 2] FIG. 1 is a diagram illustrating the configuration of a computer system provided in one exemplary embodiment of the present application. [Figure 3] 1 is a flowchart of a method for editing an electronic document provided in one exemplary embodiment of the present application. [Figure 4] FIG. 2 is a diagram illustrating an interface of an electronic document editing method provided in one exemplary embodiment of the present application. [Figure 5] 1 is a flowchart of a method for editing an electronic document provided in one exemplary embodiment of the present application. [Figure 6] 1 is a flowchart of a method for editing an electronic document provided in one exemplary embodiment of the present application. [Figure 7] FIG. 2 is a diagram illustrating an interface of an electronic document editing method provided in one exemplary embodiment of the present application. [Figure 8] FIG. 2 is a diagram illustrating an interface of an electronic document editing method provided in one exemplary embodiment of the present application. [Figure 9] FIG. 2 is a diagram illustrating an interface of an electronic document editing method provided in one exemplary embodiment of the present application. [Figure 10] 1 is a flowchart of a method for editing an electronic document provided in one exemplary embodiment of the present application. [Figure 11] FIG. 10 is a diagram illustrating an interface of an electronic document editing method provided in another exemplary embodiment of the present application. [Figure 12] 1 is a flowchart of a method for editing an electronic document provided in another exemplary embodiment of the present application; [Figure 13] 1 is a flowchart of a method for editing an electronic document provided in another exemplary embodiment of the present application; [Figure 14] 1 is a flowchart of a method for editing an electronic document provided in another exemplary embodiment of the present application; [Figure 15]FIG. 10 is a diagram showing the configuration of an electronic document editing device provided in another exemplary embodiment of the present application. [Figure 16] 1 is a diagram showing the configuration of an electronic document editing device provided in one exemplary embodiment of the present application; [Figure 17] FIG. 2 is a block diagram illustrating the configuration of a terminal provided in one exemplary embodiment of the present application. [Figure 18] FIG. 2 is a block diagram illustrating the configuration of a server provided in one exemplary embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0017] In the process of editing an electronic document on a computer device such as a desktop computer or a notebook computer, a user needs to quickly insert an image into the electronic document. Therefore, this application provides a method for quickly inserting an image into an electronic document. As shown in Figure 1, a user edits an electronic document using a desktop client on a computer device 120. When an image needs to be inserted into the electronic document, the user uses the desktop client to provide an insertion collaboration entrance to a mobile client. The insertion collaboration entrance can be a QR code (also known as a two-dimensional barcode) or a push message.

[0018] A user uses a mobile client on a mobile terminal 140 to access an electronic document through an insert collaboration portal and automatically locate (identify) a target insertion location where a multimedia file needs to be inserted. The user uses the mobile terminal 140 to take a photo or select an image from a local photo album and insert the image into the target insertion location. The image can be automatically synchronized to the desktop client, realizing a quick image insertion function.

[0019] 2 is a block diagram illustrating a computer system 100 provided in one exemplary embodiment of the present application. The computer system 100 includes a computer device 120, a mobile terminal 140, and a server 160.

[0020] A first application that supports editing functions for electronic documents runs on computing device 120. The first application may be a dedicated application, an applet in an app (application), or a web client. Optionally, the first application may also be referred to as a first client. In some examples, computing device 120 may be a computing device with limited or restricted imaging capabilities, such as a desktop computer without a camera head, a desktop computer with a camera head fixed to a display, a notebook computer, etc.

[0021] The computing device 120 is connected to the server 160 by a wireless network and a wired network.

[0022] A second application supporting electronic document editing functions is executed on the mobile terminal 140. The second application may be a dedicated application, an applet in an app (application), or a web client. Optionally, the second application may also be referred to as a second client. In some examples, the mobile terminal 140 may be a computing device with limited or restricted imaging capabilities, such as a desktop computer without a camera head, a desktop computer with a camera head fixed to the display, or a notebook computer. The first application and the second application may be the same or different programs. For example, applications of the same type may be programs developed for different operating systems or different terminal types. For example, the first application may be an application on a desktop operating system, and the second application may be an application, applet, or web program on a mobile operating system. An applet is a program that depends on a parent application, which provides the underlying operating platform. Therefore, applets can be loaded in real time and do not require installation.

[0023] The mobile terminal 140 is connected to the server 160 via a wireless network and a wired network.

[0024] Server 160 may be an independent physical server, a server cluster or a distributed system consisting of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDNs (Content Delivery Networks), big data, and artificial intelligence platforms. Optionally, server 160 includes a collaboration server and a push server. The collaboration server is used to provide document collaboration capabilities (functions) between a first application and a second application. The push server is used to provide push message push capabilities (functions). Note that in the embodiments of this application, "multiple" refers to two or more than two.

[0025] 3 is a flowchart of a method for editing an electronic document provided in one exemplary embodiment of the present application, which is executed by a first computer device, or a first client, or a desktop client. The method includes the following steps:

[0026] Step 302: Display a first editing interface for the electronic document on a first client.

[0027] A process in which a user edits an electronic document using a first client includes displaying on the first client a first editing interface for the electronic document, the electronic document including at least one of a character processing program, a table processing program, a presentation file processing program, a note processing program, and a collection of tables.

[0028] The first editing interface of the first client provides one or more editing functions, which may include, but are not limited to, at least one of a character format (font) function, a paragraph format function, a figure / table insertion function, a multimedia file insertion function, a review function, an electronic document checking function, and a translation function.

[0029] Optionally, all or some of the editing functions of the electronic document support real-time collaboration among multiple terminals. In one example, all of the editing functions of the electronic document support real-time collaboration among multiple terminals, and in another example, some of the editing functions of the electronic document support real-time collaboration among multiple terminals, such as the function of inserting a multimedia file.

[0030] Optionally, the first client is an application that supports editing of electronic documents. The first client executes on a first computing device. In some embodiments, the first computing device is a computing device with limited or restricted imaging capabilities, such as a desktop computer, a notebook computer, or the like.

[0031] Step 304: In response to the insert collaboration operation on the first editing interface, generate an insert collaboration entry for the electronic document, which is used to collaborate with a second client on a second computer device to insert the multimedia file into the electronic document.

[0032] When a multimedia file needs to be inserted into an electronic document, the user can trigger an insert collaboration operation on the first editing interface of the first client, then add the access link of the electronic document to the collaboration entry information of the electronic document, and generate an insert collaboration entry that carries the collaboration entry information. Optionally, an insert collaboration control is displayed on the first editing interface of the first client, and when the user triggers the insert collaboration control using a peripheral device such as a mouse or touch panel, the first client considers that an insert collaboration operation has been received. The triggering methods of the insert collaboration control include, but are not limited to, single click, double click, drag, gesture trigger, voice trigger, etc.

[0033] As shown in FIG. 4 , an insert button 22 is displayed in a first editing interface 20 of an electronic document on a first client. After a user clicks the insert button 22, an insert menu is displayed. The insert menu displays candidate insert options, such as a picture option 24, a table option, a link option, a code segment option, a formula comment option, an electronic signature option, a divider option, and a header and footer option. After a user clicks the picture option 24, a secondary insert menu is displayed, which displays an insert collaboration control 26. Illustratively, the insert collaboration control 26 is a button named "Take a photo or select an image from your mobile phone." After a user clicks the insert collaboration control 26, the first client receives an insert collaboration operation.

[0034] The insert collaboration portal is an access portal generated based on a collaboration link in an electronic document, and includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

[0035] For example, the same user account (also referred to as the "target account") may be logged in to the first client and the second client. Alternatively, two different user accounts may be logged in to the first client and the second client, and both of these user accounts have the right to edit the electronic document.

[0036] Step 306: Provide the second client with an insert collaboration portal.

[0037] If the insert collaboration portal includes an insert collaboration graphic code, the first client provides the insert collaboration portal to the second client by displaying the insert collaboration graphic code. Alternatively, if the insert collaboration portal includes a push message, the first client sends a push message to the second client. Alternatively, if the insert collaboration portal includes a short message, the first client sends a short message to the second computer device, for example, the first client sends a short message to the second computer device based on a telephone number, where the telephone number is a telephone number associated with a user account logged in to the electronic document.

[0038] Alternatively, if the insert collaboration portal includes email information, the first client sends the email information to the second computer device, for example, an email client is running on the second computer device, an email account is logged into the email client, the email account is an account associated with the user account logged into the electronic document, and the first client sends the email information to the email client based on the email account. Alternatively, if the insert collaboration portal includes an instant message, the first client sends an instant message to the second client, for example, the user account logged into the electronic document and the user account logged into the second client are the same user account or associated user accounts, and the first client sends an instant message to the user account on the second client.

[0039] In short, in the method provided by this embodiment, the first client provides an insert collaboration entrance to the second client, and the insert collaboration entrance enables the first client and the second client to synchronize editing of the electronic document, so that the second client can insert a multimedia document into the electronic document. For example, the second client can quickly insert a multimedia file collected in real time using a mobile terminal or a multimedia file from a local file into the electronic document being edited on the first client, thereby realizing the ability to quickly insert a multimedia file with just a few simple steps.

[0040] 5 is a flowchart of an electronic document editing method provided in an exemplary embodiment of the present application, which is executed by a second computer device, a second client, or a mobile client. The method includes the following steps:

[0041] Step 402: Open a second editing interface of the electronic document on the second client through an insert collaboration portal provided by the first client on the first computer device, where the insert collaboration portal is used to collaborate with the first client to insert a multimedia file into the electronic document.

[0042] The second computer device reads collaboration portal information carried in the inserted collaboration portal by the second client, the collaboration portal information including an access link of the electronic document; and opens a second editing interface of the electronic document on the second client based on the access link of the electronic document.

[0043] Optionally, the insert collaboration entrance includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

[0044] The collaboration entry information may be read in any one of the following ways.

[0045] If the inserted collaboration entry includes an inserted collaboration graphic code, the collaboration entry information carried in the inserted collaboration graphic code is recognized. For example, the second client evokes a camera head and uses the camera head to scan and recognize the inserted collaboration graphic code, thereby obtaining the collaboration entry information carried in the collaboration graphic code.

[0046] If the inserted collaboration entry includes a push message, display the push message and read the collaboration entry information carried in the push message in response to a trigger operation on the push message. For example, the second computing device receives the push message pushed by the first client to the second client, pops up the push message in a pop-up window, and the push message includes an access link for the electronic document. Then, in response to a trigger operation on the push message, read and obtain the access link for the electronic document.

[0047] If the inserted collaboration portal includes a short message, display the short message, and read the collaboration portal information carried in the short message in response to a trigger operation on the short message. For example, the second computer device receives the short message sent by the first client based on a telephone number, which may be a telephone number associated with a user account logged in to the electronic document, and the short message includes an access link for the electronic document, and reads and obtains the access link for the electronic document in response to a trigger operation on the short message.

[0048] If the inserted collaboration portal includes email information, display the email information, and read the collaboration portal information carried in the email information in response to a trigger operation on the email information. For example, the second computer device receives email information sent by the first client based on an email account, where the email account is associated with the user account logged in to the electronic document, and the email information includes an access link for the electronic document. Then, in response to a trigger operation on the email information, read and obtain the access link for the electronic document.

[0049] If the inserted collaboration portal includes an instant message, display the instant message, and read the collaboration portal information carried in the instant message in response to a trigger operation on the instant message. For example, the first client and the second client are the same client running on different computer devices, and the second client receives the instant message sent by the first client and displays the instant message on the conversation interfaces of the first computer device and the second computer device, for example, displaying the instant message on the conversation interfaces of "My Computer" and "My Smartphone", and the instant message includes an access link of an electronic document. In response to a trigger operation on the instant message, read and obtain the access link of the electronic document.

[0050] In the process in which the user edits the electronic document using the second client, a second editing interface for the electronic document is displayed on the second client.

[0051] The second editing interface provides one or more editing functions, including but not limited to at least one of a text formatting function, a paragraph formatting function, a figure / table inserting function, a multimedia file inserting function, a review function, an electronic document checking function, and a translation function.

[0052] In some embodiments, the editing functions on the second editing interface are the same as the editing functions on the first editing interface. In some embodiments, the editing functions on the second editing interface are a subset of the editing functions on the first editing interface.

[0053] Optionally, all or some of the editing functions of the electronic document support real-time collaboration among multiple terminals. In one example, all of the editing functions of the electronic document support real-time collaboration among multiple terminals, and in another example, some of the editing functions of the electronic document support real-time collaboration among multiple terminals, such as the function of inserting a multimedia file.

[0054] Optionally, the second client is an application that supports editing of electronic documents. The second client executes on a second computing device or a mobile terminal. In some embodiments, the second computing device is a computing device with greater imaging capabilities than the first computing device, such as a tablet computer or a smartphone, or a computing device with an externally connected camera head.

[0055] For example, the same user account may be logged in to the first client and the second client, or two different user accounts may be logged in to the first client and the second client, and both of these user accounts have the right to edit the electronic document.

[0056] Step 404: Obtain the multimedia files waiting to be inserted.

[0057] The multimedia files include at least one of images, video, and audio.

[0058] The second client acquires the multimedia file waiting to be inserted. For example, if the multimedia file is an image, the second client acquires the image by taking a picture using a camera head or selects an image from local files. For example, if the multimedia file is a video, the second client acquires the video by taking a picture using a camera head or selects a video from local files. For example, if the multimedia file is audio, the second client acquires the audio by recording using a microphone or selects an audio from local files.

[0059] In this embodiment, the source of the multimedia files is not limited, and the second client may also obtain the multimedia files waiting to be inserted by downloading, or by sending a communication message in an instant messaging program.

[0060] Step 406: Insert the multimedia file into the first insertion position in the second editing interface.

[0061] Illustratively, the first insertion location refers to a target insertion location of the multimedia file in the electronic document in the second client.

[0062] The second client inserts the multimedia file into the first insertion position in the second editing interface and displays the multimedia file at the first insertion position, and simultaneously, the multimedia file inserted into the electronic document is synchronized with the first client, and the multimedia file can also be displayed in the first editing interface of the first client.

[0063] In short, in the method provided by this embodiment, based on the insert collaboration entrance provided by the first client in the first computer device, the second computer device can synchronize with the electronic document in the first client through the second client, thereby inserting multimedia files into the electronic document using the second client, for example, multimedia files collected in real time by the second client using a mobile terminal or local files can be quickly inserted into the electronic document being edited by the first client, thereby realizing the ability to quickly insert multimedia files with just a few simple steps.

[0064] <If the inserted collaboration entry is a graphic code> 6 is a flowchart of an electronic document editing method provided in an exemplary embodiment of the present application, which is performed by a first client and a second client collaboration. The method includes the following steps:

[0065] Step 502: A first client displays a first editing interface for an electronic document.

[0066] For the detailed implementation of step 502, please refer to step 302, and the detailed description thereof will be omitted here.

[0067] Step 504: The first client adds the access link, the second insertion position and the pointer (ID) of the electronic document to the collaboration entry information of the electronic document in response to the insert collaboration operation on the first editing interface.

[0068] When a multimedia file needs to be inserted into an electronic document, the user triggers an insert collaboration operation in the first editing interface of the first client. Optionally, an insert collaboration control is displayed in the first editing interface of the first client, and when the user triggers the insert collaboration control using a peripheral device such as a mouse or a touch panel, the first client is deemed to have received the insert collaboration operation. The insert collaboration control can be triggered in various ways, including but not limited to, a single click, a double click, a drag, a gesture trigger, a voice trigger, etc. As shown in FIG. 4 , the user clicks the insert collaboration control 26, and the first client receives the insert collaboration operation.

[0069] Optionally, the first client adds an access link of the electronic document to the collaboration entry information of the electronic document, and / or the first client adds a second insertion position as insertion position information to the collaboration entry information of the electronic document, where the insertion position information is used to indicate the first insertion position in a second editing interface of the multimedia file, and the second editing interface is an interface of the electronic document in the second client, and / or the first client adds an indication mark to the collaboration entry information, where the indication mark is an indication mark for instructing the second client to automatically invoke an insertion menu, i.e., the indication mark is an indication mark for instructing the second client to automatically invoke an insertion menu in the editing interface of the mobile terminal, and / or the first client adds a user account to the collaboration entry information of the electronic document. For example, the user account may be an account logged in to the electronic document.

[0070] The access link of an electronic document is an entrance link for accessing the document content of the electronic document, for example, the document content of the electronic document is stored in a collaboration server, and the document content of the electronic document can be accessed by different computer devices through the entrance link.

[0071] The second insertion position is the real-time position of the editing cursor in the first editing interface of the electronic document, for example, before or after the xxth character of the xxth line of the xxth column in the electronic document. This application does not limit the numerical expression of the second insertion position.

[0072] The user account is a credential for determining access privileges to an electronic document, and may include, for example, a user account logged in to a first client, or may include all user accounts with access and editing privileges.

[0073] Step 506: The first client generates an insert collaboration graphic code that carries collaboration entry information.

[0074] The inserted collaboration graphic code is represented by a barcode or a QR code. For example, if the inserted collaboration graphic code is a QR code, the first client encodes the collaboration entry information in a QR code encoding manner to obtain the inserted collaboration graphic code.

[0075] In some embodiments, the first client generates an insert collaboration graphic code after mapping the collaboration entrance information to a shortened link using a shortened link mapping method, or the first client encrypts the collaboration entrance information to obtain encrypted information, and then generates an insert collaboration graphic code.

[0076] Step 508: The first client displays the inserted collaboration graphic code.

[0077] The first client displays a pop-up window overlaid on the first client's first editing interface of the electronic document, the pop-up window displaying the inserted collaboration graphic code.

[0078] 7, the first client displays the insert collaboration graphic code 28 in the first editing interface of the first client, and the insert collaboration graphic code 28 is displayed in a pop-up window, which further has a close button in the upper right corner.

[0079] In one example, the pop-up window can be closed when a close button is clicked. In another example, after the inserted collaboration graphic code 28 is scanned, the collaboration server sends a scan message to the first client, and the pop-up window can be automatically closed based on the scan notification message.

[0080] Step 510: The second client recognizes the collaboration entry information carried by the inserted collaboration graphic code.

[0081] For example, the inserted collaboration graphic code is a QR code, and the second client recognizes the collaboration entry information carried by the inserted collaboration graphic code.

[0082] In one example, the second client itself has code scanning capability, and the second client scans the inserted collaboration graphic code with the camera head of the mobile terminal, thereby recognizing and obtaining the collaboration entrance information carried by the inserted collaboration graphic code.

[0083] In one example, a user scans the inserted collaboration graphic code using another program on the mobile terminal that has code scanning capabilities, then invokes the execution of a second client through the other program, and then transmits collaboration entry information to the second client through the other program.

[0084] If the collaboration entrance information is represented by a shortened link, the second client must use the shortened link to obtain detailed information about the collaboration entrance information from the collaboration server. If the collaboration entrance information is encrypted, the second client must decrypt the encrypted information before obtaining the collaboration entrance information.

[0085] The collaboration portal information includes an access link for the electronic document, insertion location information, and an instruction indicator. In some embodiments, the insertion location information and instruction indicator may be optional.

[0086] As shown in FIG. 8, the user uses the code scanning function 30 of the second client to perform a code scan on the inserted collaboration graphic code and recognizes the collaboration entry information in the inserted collaboration graphic code.

[0087] Step 512: The second client opens a second editing interface of the electronic document on the second client based on the collaboration entry information.

[0088] The second client opens a second editing interface of the electronic document on the second client according to the access link of the electronic document, for example, the second client obtains the document content of the electronic document according to the access link of the electronic document, and loads and displays the document content of the electronic document, thereby displaying the second editing interface of the electronic document on the second client.

[0089] Optionally, the collaboration entry information further includes a user account, and if the second client or server recognizes that its own user account matches the user account in the collaboration entry information (i.e., they are the same user account), that is, if its own user account has editing authority for the electronic document, it opens a second editing interface of the electronic document in the second client.

[0090] Alternatively, if the user account on the second client is different from the user account on the first client, but the user account on the second client has the right to edit the electronic document, the second client opens a second editing interface on the second client for the electronic document.

[0091] Step 514: The second client displays the first insertion position in the second editing interface of the electronic document.

[0092] The first insertion position is an editing position in the second editing interface where the multimedia file needs to be inserted. The first insertion position in the second editing interface is the same as the second insertion position in the first editing interface. The second insertion position is an insertion position of the multimedia file on the first editing interface, and for example, the second insertion position is a cursor position on the first editing interface of the first client of the electronic document.

[0093] In one possible design, the second client obtains insertion position information from the collaboration entrance information, and the insertion position information is used to indicate a first insertion position, and then the second client displays the first insertion position indicated by the insertion position information in a second editing interface of the electronic document.

[0094] For example, the first insertion position is on the 21st line of the 13th page of the electronic document, and the second client automatically positions and displays the first insertion position based on the insertion position information.

[0095] If the first insertion position is not within the current display range of the editing interface of the mobile terminal, the second client jumps to the first insertion position indicated by the insertion position information and performs display.

[0096] In another possible design, after the second client opens the second editing interface of the electronic document, it synchronizes with the second insertion position based on the user account logged in to the second client, and displays the second insertion position as the first insertion position in the second editing interface of the electronic document.

[0097] When the same user account is logged in to the first client and the second client, the collaboration server synchronizes and saves the second insertion position in the first client, establishing a three-way correspondence between the user account, the electronic document, and the second insertion position. After the second client opens the second editing interface of the electronic document, the second client synchronizes with the second insertion position in the electronic document of the user account logged in to the second client from the collaboration server to obtain the real-time second insertion position. That is, even if the user changes the second insertion position in the first client after generating the insert collaboration graphic code, the second client can synchronize and obtain the real-time second insertion position, ensuring that the second insertion position displayed on the first client and the first insertion position displayed on the second client are the same.

[0098] If different user accounts are logged in to the first client and the second client, and multiple user accounts are collaborating to edit an electronic document, the collaboration server can synchronize and save the second insertion position in the electronic document of each user account, and establish a correspondence relationship between the user account, the electronic document, and the second insertion position. For example, if the same electronic document has three second insertion positions corresponding to user account 1, user account 2, and user account 3, after opening the second editing interface of the electronic document on the second client, based on user account 2 logged in to the second client, the second client can synchronize with the second insertion position in the electronic document of user account 2 from the collaboration server to obtain the real-time second insertion position.

[0099] Step 516: The second client displays the insert menu in the second editing interface of the electronic document.

[0100] 9, for example, the multimedia file is an image, and the insert menu includes at least one of a shooting control 32, a local file selection control 34, and a text extraction control 36. The shooting control 32 is a control for triggering the use of a camera head to take a photo to obtain a captured image, the local file selection control 34 is a control for triggering the use of a file manager to select a local file, for example, using a photo album program to select a local photo in a local photo album, and the text extraction control 36 is a control for recognizing text in a captured image or a local photo.

[0101] In one example, the mobile terminal displays an insert menu in the second editing interface of the second client of the electronic document when the user performs a human-machine interaction operation. In another example, the mobile terminal automatically invokes a display insert menu on the second editing interface of the electronic document when an indication mark is carried in the collaboration entry information.

[0102] Step 518: If the second client has a shooting control in the insertion menu, the second client causes the camera head to shoot the multimedia file waiting to be inserted in response to a trigger operation on the shooting control.

[0103] The trigger operation for the photographing control includes at least one of a click operation, a double click operation, a pressure touch operation, a floating touch operation, a gesture operation, and a voice operation.

[0104] In response to a trigger operation on the photographing control, the second client photographs the multimedia file waiting to be inserted by the camera head.

[0105] Step 520: If the insert menu includes a local file selection control, the second client selects a waiting multimedia file to be inserted from among the local files using the file manager in response to a trigger operation on the selection control.

[0106] The trigger operation for the selection control includes at least one of a click operation, a double click operation, a pressure touch operation, a floating touch operation, a gesture operation, and a voice operation.

[0107] In response to the trigger operation on the selection control, the second client uses a file manager to select a multimedia file to be inserted from among the local files. Illustratively, the second client uses a file manager to display the local files as candidate files. After receiving the user's selection operation, the selected candidate file becomes a multimedia file to be inserted.

[0108] Step 522: The second client inserts the multimedia file into the first insertion position in the second editing interface.

[0109] The second client inserts the multimedia file into the first insertion position of the electronic document and displays it.

[0110] In some embodiments, in response to a trigger operation on the text extraction control, the second client extracts the text content from the inserted multimedia file and inserts the text content into the first insertion position of the electronic document. After inserting the text content into the first insertion position of the electronic document, the inserted multimedia file may remain or may be replaced by the text content.

[0111] In some embodiments, in response to a trigger operation on the text extraction control, the second client extracts text content from the multimedia file that the user has selected but that has not yet been inserted, and inserts the text content into the first insertion position of the electronic document.

[0112] Step 524: The second client synchronizes the electronic document with the inserted multimedia file to the first client.

[0113] The second client synchronizes the electronic document into which the multimedia file has been inserted with the first client through the collaboration server. Exemplarily, the second client synchronizes the multimedia file and the insertion location of the multimedia file with the first client through the collaboration server. Alternatively, the second client synchronizes the access address of the multimedia file and the insertion location of the multimedia file with the first client through the collaboration server. The access address of the multimedia file may be provided after the collaboration server stores the multimedia file.

[0114] Step 526: The first client displays the multimedia file inserted by the second client in the first editing interface of the electronic document.

[0115] After the first client obtains the synchronized multimedia file, it displays the multimedia file inserted by the second client in the first editing interface of the electronic document.

[0116] In short, in the method provided by this embodiment, the first client provides an insertion collaboration entrance to the second client, so that the second client can quickly insert multimedia files collected in real time using a mobile terminal or local files into the electronic document being edited by the first client, thereby realizing the ability to quickly insert multimedia files with just a few simple steps.

[0117] In the method provided by this embodiment, the second client automatically positions and displays the first insertion position, eliminating the need for the user to position the first insertion position using the second client, thereby reducing the user's operation steps and improving the efficiency of human-machine interaction. In particular, by using synchronization technology to obtain the second insertion position, the accuracy of the first insertion position can be ensured even if the first insertion position is changed after the insertion collaboration graphic code is generated.

[0118] In the method provided by this embodiment, the second client can automatically invoke and display the insertion menu, eliminating the need for the user to manually open the insertion menu, thereby reducing the user's operation steps and improving the efficiency of human-machine interaction.

[0119] <If the inserted collaboration entry point is a push message> 10 is a flowchart of an electronic document editing method provided in one exemplary embodiment of the present application, which is performed by a first client and a second client collaboration. The method includes the following steps:

[0120] Step 602: A first client displays a first editing interface for an electronic document.

[0121] Step 604: The first client adds the access link of the electronic document, the second insertion position and the indication mark to the collaboration entry information of the electronic document in response to the insert collaboration operation on the first editing interface.

[0122] For the detailed implementation of steps 602 to 604, please refer to steps 502 to 504, and the detailed description thereof will be omitted here.

[0123] Step 606: The first client generates a push message carrying the collaboration entrance information.

[0124] A push message is a message sent to an application on a mobile device using a push service.

[0125] In some embodiments, the first client generates a push message after mapping the collaboration entrance information to a shortened link in a shortened link mapping manner, or the first client encrypts the collaboration entrance information to obtain encrypted information and then generates a push message.

[0126] Step 608: The first client sends a push message to the second client via the server.

[0127] The first client sends a push message to the second client using the push capability (function) of the push server.

[0128] Optionally, the push message carries a user account, and the first client sends the push message to the second client corresponding to the user account in the push message, or the first client sends the push message to the second client corresponding to a user account that has editing rights for the electronic document.

[0129] Step 610: The second client displays the push message.

[0130] The second client displays the push message after receiving it, or the operating system of the mobile terminal displays the push message in the form of a system message after receiving it.

[0131] Step 612: The second client responds to the trigger operation on the push message by opening a second editing interface of the electronic document based on the collaboration entry information carried in the push message.

[0132] The trigger operation for the push message includes at least one of a click operation, a double click operation, a pressure touch operation, a floating touch operation, a gesture operation, and a voice operation.

[0133] As shown in FIG. 11, when the user clicks on the push message 38, the second client opens a second editing interface of the electronic document at the second client based on the collaboration entry information carried in the push message.

[0134] If the collaboration entrance information is displayed using a shortened link, the second client needs to use the shortened link to obtain detailed information about the collaboration entrance information from the collaboration server. If the collaboration entrance information is encrypted, the second client needs to decrypt the encrypted information before obtaining the collaboration entrance information.

[0135] The collaboration portal information includes an access link for the electronic document, insertion location information, and an instruction indicator. In some embodiments, the insertion location information and instruction indicator may be optional.

[0136] The collaboration entry information includes at least an access link to the electronic document.

[0137] The second client opens a second editing interface of the electronic document on the second client according to the access link of the electronic document. Illustratively, the second client obtains the document content of the electronic document according to the access link of the electronic document, and loads and displays the document content of the electronic document, thereby displaying the second editing interface of the electronic document on the second client.

[0138] Optionally, the collaboration entry information further includes a user account, and if the second client recognizes that its user account matches the user account in the collaboration entry information (i.e., they are the same user account), that is, if its user account has the right to edit the electronic document, the second client opens a second editing interface of the electronic document.

[0139] Alternatively, if the user account on the second client is different from the user account on the first client, but the user account on the second client has the right to edit the electronic document, the second client opens a second editing interface on the second client of the electronic document.

[0140] Step 614: The second client displays the first insertion position in the second editing interface.

[0141] Step 616: The second client displays the insert menu on the second editing interface.

[0142] Step 618: If the second client has a shooting control in the insertion menu, the second client shoots the multimedia file waiting to be inserted by the camera head in response to a trigger operation on the shooting control.

[0143] Step 620: If the insert menu includes a local file selection control, the second client selects a waiting multimedia file to be inserted from among the local files using the file manager in response to a trigger operation on the selection control.

[0144] Step 622: The second client inserts the multimedia file into the first insertion position of the electronic document in the second editing interface of the electronic document.

[0145] Step 624: The second client synchronizes the electronic document with the inserted multimedia file to the first client.

[0146] Step 626: The first client displays the multimedia file inserted by the second client in the first editing interface of the electronic document.

[0147] For the detailed implementation of steps 614 to 626, please refer to steps 514 to 526, and the detailed description thereof will be omitted here.

[0148] In short, in the method provided by this embodiment, the first client provides an insertion collaboration entrance to the second client, so that the second client can quickly insert multimedia files collected in real time using a mobile terminal or local files into the electronic document being edited by the first client, thereby realizing the ability to quickly insert multimedia files with just a few simple steps.

[0149] In the method provided by this embodiment, the second client automatically positions and displays the first insertion position, eliminating the need for the user to position the first insertion position using the second client, thereby reducing the user's operation steps and improving the efficiency of human-machine interaction.

[0150] In the method provided by this embodiment, the second client can automatically invoke and display an insertion menu, eliminating the need for the user to manually open the insertion menu, thereby reducing the user's operation steps and improving the efficiency of human-machine interaction.

[0151] 12, in step 41, a user clicks an image selection button on a first client to trigger a collaboration insertion flow of a multimedia file. The user can trigger the collaboration insertion flow by adopting at least one of the following two methods:

[0152] <Method 1: Collaboration using graphic codes> In step 42, the first client generates a QR code, which is a URL (Uniform Resource Locator) of the electronic document. In step 43, the second client scans the QR code to obtain the access URL of the electronic document. In step 44, the second client analyzes the access URL of the electronic document and positions the first insertion position. After that, the user uses the second client to take a picture and insert the image, or select a local file and insert the image.

[0153] <Method 2: Collaboration via push messages> In step 45, the first client requests the server to send a push message, which carries the access URL of the electronic document. In step 46, the server sends the push message to the second client. In step 43, the second client obtains the access URL of the electronic document from the push message. In step 44, the second client analyzes the access URL of the electronic document and positions the first insertion position. Then, the user uses the second client to take a picture and insert the image, or select a local file and insert the image.

[0154] The above process includes three technologies:

[0155] <1. QR code generation technology> Based on the QR code generation capability, an access link for the electronic document is generated, and the access link further includes at least one of the following parameters: insertion position information, an indicator, and a user account, such as information related to the user account who clicked "Take a photo or select an image from your mobile phone" in the electronic document, and identifier information indicating that an image needs to be selected using a smartphone. The QR code notifies the second client that an image needs to be selected using a smartphone, and also notifies the specific user account that needs to select an image using a smartphone, thereby ensuring the accuracy of the first insertion position when multiple people are working together. After the QR code is generated, it can be scanned by the parent application to directly jump to the second client (e.g., an applet) of the electronic document and analyze the QR code.

[0156] The QR code generation technology is mainly realized based on the QR code (Quick Response Code) library in the second client.

[0157] The second client provides one document node for mounting the final generated QR code and associated document.

[0158] Optionally, the second client first generates a QR code without a program icon, determines the size of the QR code and the area to be occupied by the program icon at the center of the QR code, and then the QR Code library generates a QR code carrying the collaboration entrance information based on the collaboration entrance information in the electronic document.

[0159] After the QR code without a program icon has finished loading, the second client creates a canvas tag in the front end of a browser and draws the QR code on the canvas tag. The second client loads its own program icon and uses the drawing capabilities of the canvas tag to draw the program icon at the center of the QR code. After the program icon has finished loading and drawing, the second client mounts the created canvas tag to a document node provided by the second client, and the browser renders the document node to display the QR code with the program icon.

[0160] 2. Message push technology The first client uses message push technology to push a push message with collaboration entry information instructions to the second client, i.e., at the same time as generating the QR code, the first client also sends the push message to the server, and the server forwards the push message to the second client.

[0161] As shown in Figure 13, in step 51, the first client generates a QR code and simultaneously calls a background interface to transmit notification parameters, thereby triggering the server to perform a message push service. The notification parameters include the parameters in the collaboration entry information. In step 52, the server generates a push message based on the notification parameters and notifies the second client of the push message.

[0162] In step 53, after receiving the push message, the second client notifies the mobile device, and the mobile terminal pops up a pop-up window of the push message and displays the push document. In step 54, the user triggers the pop-up window to wake up the second client, and after being woken up, the second client jumps to the first insertion position in the electronic document based on the retrieved collaboration entry information.

[0163] <3. Link analysis technology> The function is used to determine whether to perform cursor positioning and pop-up display of the insert menu based on parameters such as the access URL, insert position information, indicator, and user account in the collaboration insert information of the electronic document. When it is determined that cursor positioning is required, the cursor position of the second client is synchronized with that of the first client, and the insert menu is automatically popped up and displayed.

[0164] As shown in Figure 14, after the collaboration entry information of the electronic document is acquired in the second editing interface of the second client, the second client analyzes the collaboration entry information, and if the collaboration entry information contains insertion position information, it stores an identifier (flag) x as a variable of the second client, and also stores the user account.

[0165] During the initialization process of the electronic document, the authority module of the electronic document is also initialized, which determines whether the accessing person has the authority to check the electronic document. If not, the accessing person moves to the authority application screen (page) for the electronic document.

[0166] When the user has permission to view or edit the electronic document, the electronic document is initialized as usual, and during the initialization process, the electronic document communicates with the server in the background to obtain information from the room layer (a server-side container for collaboration between different devices), such as the second insertion position messages of all collaborators in the current electronic document, and records them according to the user account.

[0167] After the capture module of the second client is initialized, it can check whether the identifier x is included in the storage variable of the electronic document, and if the identifier x is included, it performs a positioning operation on the first insertion position.

[0168] At this time, the second client reads the previously saved user account and obtains the second insertion position corresponding to the user account from the current cursor information saved during the initialization process. At this time, it determines whether the user account has editing privileges. If not, no operation is performed. If the user account has editing privileges, it moves the cursor of the second client to the first insertion position and activates the editing state of the electronic document. Then, it triggers a click event on the insert menu of the second client, automatically opening the insert menu. The user can then freely select and insert an image from the local images or take a new photo to insert, depending on their needs.

[0169] 15 is a block diagram showing an electronic document editing device provided in one exemplary embodiment of the present application, which includes:

[0170] an access module 720: used to open a second editing interface of an electronic document at a second client through an insert collaboration portal provided by a first client at a first computing device, the insert collaboration portal being used to collaborate with the first client to insert a multimedia file into the electronic document; Acquisition module 740: used to acquire multimedia files waiting to be inserted; and Insert module 760: Used to insert the multimedia file into a first insertion position in the second editing interface.

[0171] In one alternative design of this embodiment, the access module 720 reads collaboration portal information carried by the inserted collaboration portal, where the collaboration portal information includes an access link of the electronic document; and is used to open the second editing interface of the electronic document on the second client based on the access link of the electronic document.

[0172] In one alternative design of this embodiment, the insert collaboration entrance includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

[0173] In one alternative design of this embodiment, the access module 720 recognizes the collaboration entrance information carried by the inserted collaboration graphic code if the inserted collaboration entrance includes the inserted collaboration graphic code; or If the inserted collaboration entrance includes the push message, displaying the push message and, in response to a trigger operation on the push message, reading the collaboration entrance information carried in the push message; or If the inserted collaboration entrance includes the short message, displaying the short message, and reading the collaboration entrance information carried in the short message in response to a trigger operation on the short message; or If the inserted collaboration portal includes the email information, displaying the email information and, in response to a trigger operation on the email information, reading the collaboration portal information carried in the email information; or If the inserted collaboration portal includes the instant message, it is used to display the instant message and, in response to a trigger operation on the instant message, to read the collaboration portal information carried in the instant message.

[0174] According to one optional design of this embodiment, the access module 720 is used to display the first insertion position in the second editing interface of the electronic document after opening the second editing interface of the electronic document on the second client, where the first insertion position is the same as the second insertion position, the second insertion position is the insertion position of the multimedia file on the first editing interface, and the first editing interface is the interface of the electronic document on the first client.

[0175] In one example, the insert collaboration portal carries collaboration portal information, and the access module 720 obtains insert location information from the collaboration portal information, and the insert location information is used to indicate the first insert location; and is used to display the first insert location indicated by the insert location information in the second editing interface of the electronic document.

[0176] In one example, the access module 720 synchronizes the second insertion location based on a user account logged in to the second client, the user account having editing privileges for the electronic document; and is used to display the second insertion location as the first insertion location in the second editing interface of the electronic document.

[0177] In one alternative design of this embodiment, the acquisition module 740 displays an insert menu in the second editing interface of the electronic document, the insert menu including at least one of a capture control and a local file selection control; and is used to capture the multimedia file waiting to be inserted by a camera head in response to a trigger operation on the capture control, or to select the multimedia file waiting to be inserted from among the local files by a file manager in response to a trigger operation on the selection control.

[0178] In one alternative design of this embodiment, the insert collaboration portal carries collaboration portal information, and the acquisition module 740 is used to display the insert menu in the second editing interface of the electronic document when the collaboration portal information carries an indicator, where the indicator is an indicator for instructing the user to automatically invoke the insert menu.

[0179] In one alternative design of this embodiment, the insert menu further includes a text extraction control, and the acquisition module 740 is further used to extract text content in the multimedia file in response to a trigger operation on the text extraction control; and to insert the text content into a first insertion position of the electronic document.

[0180] In one alternative design of this embodiment, the apparatus further comprises:

[0181] Synchronization module 780: Used to synchronize the electronic document with the inserted multimedia file to the first client.

[0182] 16 is a block diagram illustrating an apparatus for editing an electronic document provided in one exemplary embodiment of the present application. The apparatus includes:

[0183] A display module 820 is used to display a first editing interface of the electronic document to the first client; a generating module 840: used to generate an insert collaboration entry for the electronic document in response to an insert collaboration operation on the first editing interface, the insert collaboration entry being used to collaborate with a second client on a second computing device to insert a multimedia file into the electronic document; and Output module 860: used to provide the insert collaboration portal to the second client.

[0184] In one alternative design of this embodiment, the generation module 840 is used to add the access link of the electronic document to the collaboration portal information of the electronic document; and to generate the inserted collaboration portal that carries the collaboration portal information.

[0185] In one alternative design of this embodiment, the insert collaboration entrance includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

[0186] In one alternative design of this embodiment, the insert collaboration portal carries collaboration portal information, and the generating module 840 is used to add a second insert location of the electronic document to the collaboration portal information of the electronic document as insert location information, and the insert location information is used to indicate a first insert location in a second editing interface of the multimedia file, and the second editing interface is an interface in the second client of the electronic document; or It is used to synchronize the second insertion location to the second client based on the target account logged in to the second client, where the second insertion location is the insertion location of the multimedia file in the first editing interface.

[0187] In one alternative design of this embodiment, the insert collaboration portal carries collaboration portal information, and the generation module 840 is used to add an indicator to the collaboration portal information, which is an indicator to instruct the second client to automatically invoke the insert menu.

[0188] In one alternative design of this embodiment, the display module 820 is further used to display the multimedia file inserted by the second client in the first editing interface of the electronic document.

[0189] 17 is a block diagram showing the configuration of a mobile terminal 1700 provided in one exemplary embodiment of the present application. The mobile terminal 1700 is a portable mobile terminal, such as a smartphone, a tablet computer, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer The mobile terminal 1700 may also be referred to as a user device, a mobile terminal, or the like.

[0190] Generally, the mobile terminal 1700 includes a processor 1701 and a memory device 1702 .

[0191] The processor 1701 may include one or more processing cores, for example, a 4-core processor, an 8-core processor, etc. The processor 1701 may include a DSP (Digital Signal Processor). The processor 1701 may be implemented in the form of at least one of hardware such as a GPU (Graphics Processing Unit), a FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1701 may also include a main processor and a coprocessor, where the main processor is a processor that processes data in an active state and is also called a Central Processing Unit (CPU), and the coprocessor is a low-power processor that processes data in a standby state. In some embodiments, the processor 1701 is a GPU (Graphics Processing Unit). The processor 1701 may also include an integrated GPU (Graphical Processing Unit), where the GPU is used to render and draw content that needs to be displayed on the display. In some embodiments, the processor 1701 may further include an artificial intelligence (AI) processor, where the AI processor is used to process computational operations related to machine learning.

[0192] The memory 1702 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1702 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disks, flash memory, etc. In some embodiments, the non-transitory computer-readable storage media in the memory 1702 are used to store at least one instruction that is executed by the processor 1701 to implement the methods provided in the embodiments of the present application.

[0193] In some embodiments, mobile terminal 1700 may optionally further include a peripheral interface 1703 and at least one peripheral device. Specifically, the peripheral device includes at least one of RF circuitry 1704, a touch panel 1705, a camera head assembly 1706, an audio (voice) circuitry 1707, and a power supply 1709.

[0194] Peripheral device interface 1703 is used to connect at least one peripheral device associated with input / output (I / O) to processor 1701 and memory 1702. In some embodiments, processor 1701, memory 1702, and peripheral device interface 1703 may be integrated on the same chip or circuit board, and in some other embodiments, any one or two of processor 1701, memory 1702, and peripheral device interface 1703 may be implemented on a single chip or circuit board, although this embodiment is not limited thereto.

[0195] The RF circuit 1704 receives RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuitry 1704 is used to transmit and receive RF signals. The RF circuitry 1704 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuitry 1704 converts electrical signals into electromagnetic signals for transmission or converts received electromagnetic signals into electrical signals. Optionally, the RF circuitry 1704 includes an antenna system, an RF transceiver, one or more amplifiers, tuners, oscillators, digital signal processors, a codec chipset, a user ID identification module card, etc. The RF circuitry 1704 can communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol may include, but is not limited to, the Internet, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a wireless Wi-Fi (Wireless Fidelity) network. In some embodiments, the RF circuitry 1704 may further include circuitry related to Near Field Communication (NFC), although this application is not limited thereto.

[0196] The touch panel 1705 is used to display a user interface (UI). The UI may include graphics, text, icons, video, and any combination thereof. The touch panel 1705 is also capable of collecting touch signals on or above the surface of the touch panel 1705. The touch signals may be input as control signals to the processor 1701 for processing. The touch panel 1705 may be used to provide virtual buttons and / or a virtual keyboard, also referred to as soft buttons and / or a soft keyboard. In some embodiments, there is one touch panel 1705 and it may be located on the front panel of the mobile terminal 1700. In other embodiments, there are at least two touch panels 1705 and each may be located on a different surface of the mobile terminal 1700 or may be designed to be foldable. In other embodiments, the touch panel 1705 is a flexible display and may be located on a curved or foldable surface of the mobile terminal 1700. Furthermore, the touch panel 1705 may be implemented as a non-rectangular, irregularly shaped panel, i.e., a specially shaped panel. The touch panel 1705 may be made of materials such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), and the like.

[0197] The camera head assembly 1706 is used to capture images or videos. Optionally, the camera head assembly 1706 includes a front camera head and a rear camera head. Typically, the front camera head is used for video calls or selfies, and the rear camera head is used for taking photos or videos. In some embodiments, there are at least two rear camera heads, each of which can be one of a main camera head, a depth-of-field camera head, and a wide-angle camera head. The main camera head and the depth-of-field camera head are combined to realize a background blur function, and the main camera head and the wide-angle camera head are combined to realize a panoramic shooting function and a virtual reality (VR) shooting function. In some embodiments, the camera head assembly 1706 may further include a flash. The flash may be a single color temperature flash or a dual color temperature flash. A dual color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used to compensate for light under different color temperatures.

[0198] The audio circuit 1707 is used to provide an audio interface between the user and the mobile terminal 1700. The audio circuit 1707 may include a microphone and a speaker. The microphone collects sound waves from the user and the environment and converts them into electrical signals that are input to the processor 1701 for processing or to the RF circuit 1704 for voice communication. For purposes of stereophonic pickup or noise reduction, multiple microphones may be installed at different locations on the mobile terminal 1700. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1701 or the RF circuit 1704 into sound waves. The speaker may be a conventional membrane speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals into sound waves that are audible to humans as well as into sound waves that are inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1707 may further include a headphone jack.

[0199] The power source 1709 is used to power each assembly in the mobile terminal 1700. The power source 1709 may be AC, DC, a disposable battery, or a rechargeable battery. When the power source 1709 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery may also be used to support fast charging technology.

[0200] In some embodiments, the mobile terminal 1700 further includes one or more sensors 1710, including, but not limited to, an acceleration sensor 1711, a gyro sensor 1712, a pressure sensor 1713, an optical sensor 1715, and a proximity sensor 1716.

[0201] The acceleration sensor 1711 can detect acceleration on three coordinate axes of a coordinate system established by the mobile terminal 1700. For example, the acceleration sensor 1711 can be used to detect components of gravitational acceleration on three coordinate axes. The processor 1701 can control the touch panel 1705 to display a user interface in landscape or portrait mode based on the gravitational acceleration signals collected by the acceleration sensor 1711. The acceleration sensor 1711 can also be used for games or to collect user movement data.

[0202] The gyro sensor 1712 can detect the orientation and rotation angle of the mobile terminal 1700, and in cooperation with the acceleration sensor 1711, can collect the user's 3D movement relative to the mobile terminal 1700. Based on the data collected by the gyro sensor 1712, the processor 1701 can realize the following functions: motion sensing (e.g., changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0203] The pressure sensor 1713 can be disposed on a side frame of the mobile terminal 1700 and / or below the touch panel 1705. When the pressure sensor 1713 is disposed on the side frame of the mobile terminal 1700, it can detect a grip signal from the user of the mobile terminal 1700 and perform left / right hand recognition or shortcut operations based on the grip signal. When the pressure sensor 1713 is disposed below the touch panel 1705, it can realize control over operable controls on the UI interface based on a user's pressure operation on the touch panel 1705. The operable controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0204] The optical sensor 1715 is used to collect ambient light intensity. In one embodiment, the processor 1701 can control the display brightness of the touch panel 1705 based on the ambient light intensity collected by the optical sensor 1715. Specifically, when the ambient light intensity is high, the display brightness of the touch panel 1705 is increased, and when the ambient light intensity is low, the display brightness of the touch panel 1705 is decreased. In another embodiment, the processor 1701 can further dynamically adjust the shooting parameters of the camera head assembly 1706 based on the ambient light intensity collected by the optical sensor 1715.

[0205] The proximity sensor 1716, also referred to as a distance sensor, is typically provided on the front of the mobile terminal 1700. The proximity sensor 1716 is used to collect the distance between the user and the front of the mobile terminal 1700. In one embodiment, when the proximity sensor 1716 detects that the distance between the user and the front of the mobile terminal 1700 is gradually decreasing, the processor 1701 controls the touch panel 1705 to switch from an on-screen state to an off-screen state, and when the proximity sensor 1716 detects that the distance between the user and the front of the mobile terminal 1700 is gradually increasing, the processor 1701 controls the touch panel 1705 to switch from an off-screen state to an on-screen state.

[0206] As will be appreciated by those skilled in the art, the configuration shown in FIG. 17 is not intended to limit the mobile terminal 1700, and the mobile terminal 1700 may include more or fewer assemblies than those shown, may combine some assemblies, or may employ a different component arrangement.

[0207] FIG. 18 is a diagram showing the configuration of a computer device provided in one embodiment of the present application, which is used to implement the electronic document editing method performed by the computer device provided in the above embodiment. The server 1800 includes a central processing unit (CPU). The server 1800 includes a central processing unit 1801, a system memory 1804 consisting of a random access memory (RAM) 1802 and a read-only memory (ROM) 1803, and a system bus 1805 connected to the system memory 1804 and the central processing unit 1801. The server 1800 further includes a basic input / output system (I / O, Input / Output) 1806 for facilitating information transfer between devices within the computer, an operating system 1813, a mass storage device 1807 for storing applications 1814 and other program modules 1815, etc.

[0208] The basic input / output system 1806 includes a display 1808 for displaying information and an input device 1809, such as a mouse or keyboard, for inputting information by a user. The display 1808 and input device 1809 may all be connected to the central processing unit 1801 by an input / output controller 1810, which is connected to the system bus 1805. The basic input / output system 1806 further includes an input / output controller 1810 for receiving and processing input from a number of other devices, such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 1810 may provide output to a display, a printer, or other type of output device.

[0209] The mass storage device 1807 is connected to the central processing unit 1801 by a mass storage controller (not shown) that is connected to the system bus 1805. The mass storage device 1807 and its associated computer-readable media are used to provide non-volatile storage for the server 1800. That is, the mass storage device 1807 may include, for example, a computer-readable medium (not shown), such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

[0210] Without loss of generality, the computer-readable media may include computer storage media and communication media. Computer storage media includes, for example, volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, and other data. Computer storage media may include RAM, ROM, Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory or other solid-state storage technology, CD-ROM, DVD (Digital Imaging Device), and the like. This includes computer storage media such as video discs (Video Discs) or other optical storage, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will understand that the computer storage media are not limited to these. The system storage 1804 and mass storage device 1807 described above may be collectively referred to as storage devices.

[0211] According to various embodiments of the present application, the server 1800 may further include a remote computer connected to a network, such as the Internet, via a network. That is, the server 1800 may be connected to a network 1812 by a network interface unit 1811 connected to the system bus 1805, or may use the network interface unit 1811 to connect to other types of networks or remote computer systems (not shown).

[0212] The memory further includes one or more programs stored in the memory and configured to be executed by one or more central processing units.

[0213] An embodiment of the present application further provides a computer-readable storage medium having at least one instruction stored therein, the at least one instruction being loaded and executed by a processor to realize the method for editing an electronic document as described in each of the above embodiments.

[0214] According to one aspect of the present application, there is provided a computer program product or computer program, the computer program product or computer program including computer instructions stored in a computer-readable storage medium, a processor of a terminal reading the computer instructions from the computer-readable storage medium, and the processor executing the computer instructions to cause the terminal to perform the method for editing an electronic document provided in various selectable implementation manners of the above-mentioned aspect.

[0215] Although the preferred embodiment of the present application has been described above, the present application is not limited to this embodiment, and any modification to the present application falls within the technical scope of the present application as long as it does not depart from the spirit of the present application.

Claims

1. 1. A method for editing an electronic document executed by a second computing device, comprising: opening a second editing interface of the electronic document at a second client via an insert collaboration portal provided by a first client on a first computing device, the insert collaboration portal being used to collaborate with the first client to insert a multimedia file into the electronic document; displaying a target insertion position in the second editing interface of the electronic document, the target insertion position being an editing position where the multimedia file needs to be inserted in the second editing interface, the target insertion position being the same as a current cursor position, the current cursor position being a cursor position of the electronic document in the first editing interface of the first client; displaying an insert menu in the second editing interface of the electronic document, the insert menu including at least one of a capture control and a local file selection control; a step of capturing the multimedia file waiting to be inserted by a camera head in response to a trigger operation on the capture control, or a step of selecting the multimedia file waiting to be inserted from the local files by a file manager in response to a trigger operation on the selection control; and The method includes inserting the multimedia file into the electronic document at the target insertion location in the second editing interface of the electronic document.

2. 2. The method of claim 1, opening a second editing interface of the electronic document at a second client via an insert collaboration portal provided by a first client on the first computing device; reading collaboration entrance information carried by the insert collaboration entrance, the collaboration entrance information including an access link for the electronic document; and The method includes opening the second editing interface of the electronic document on the second client based on an access link of the electronic document.

3. 3. The method of claim 2, The method, wherein the insert collaboration entrance includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

4. 4. The method of claim 3, The step of reading collaboration entry information carried by the insert collaboration entry includes: If the insert collaboration entry includes the insert collaboration graphic code, recognizing the collaboration entry information carried by the insert collaboration graphic code; or If the inserted collaboration entrance includes the push message, displaying the push message and, in response to a trigger operation on the push message, reading the collaboration entrance information carried in the push message; or If the inserted collaboration entrance includes the short message, displaying the short message, and reading the collaboration entrance information carried in the short message in response to a trigger operation on the short message; or If the inserted collaboration entrance includes the email information, displaying the email information and, in response to a trigger operation on the email information, reading the collaboration entrance information carried in the email information; or If the inserted collaboration entrance includes the instant message, displaying the instant message and reading the collaboration entrance information carried in the instant message in response to a trigger operation on the instant message.

5. 5. The method according to any one of claims 1 to 4, the trigger operation for the photographing control includes at least one of a click operation, a double click operation, a pressure touch operation, a floating touch operation, a gesture operation, and a voice operation; The method, wherein the trigger operation for the selection control includes at least one of a click operation, a double click operation, a pressure touch operation, a floating touch operation, a gesture operation, and a voice operation.

6. 5. The method according to any one of claims 1 to 4, The insert collaboration entry carries collaboration entry information; The method further comprises: obtaining insertion position information from the collaboration entrance information, the insertion position information being used to indicate the target insertion position; displaying the target insertion position in the second editing interface of the electronic document, The method includes displaying the target insertion location indicated by the insertion location information in the second editing interface of the electronic document.

7. 5. The method according to any one of claims 1 to 4, The method further includes: synchronizing the current cursor position based on a target account logged in to the second client, the target account having editing authority for the electronic document; displaying the target insertion position in the second editing interface of the electronic document, The method includes displaying the current cursor position as the target insertion position in the second editing interface of the electronic document.

8. 5. The method according to any one of claims 1 to 4, The insert collaboration entry carries collaboration entry information; displaying an insert menu in the second editing interface of the electronic document, If the collaboration entry information carries an indicator, displaying the insert menu in the second editing interface of the electronic document; The method, wherein the indicator is for indicating automatic invocation of the insert menu.

9. 5. The method according to any one of claims 1 to 4, the insert menu further includes a character extraction control; The method further comprises: extracting text content from the multimedia file in response to a trigger operation on the text extraction control; and The method includes inserting the character content into the electronic document at the target insertion location.

10. 5. The method according to any one of claims 1 to 4, The method further includes synchronizing the electronic document into which the multimedia file is inserted to the first client.

11. 1. A method for editing an electronic document executed by a first computing device, comprising: displaying a first editing interface for the electronic document on a first client; generating an insert collaboration entry for the electronic document in response to an insert collaboration operation on the first editing interface, the insert collaboration entry being used to collaborate with a second client on a second computing device to insert a multimedia file into the electronic document; adding a current cursor position of the electronic document as insertion position information to collaboration entry information of the electronic document, the insertion position information being used to indicate a target insertion position of the multimedia file, the target insertion position being displayed in a second editing interface of the second client, the target insertion position being an editing position in the second editing interface where the multimedia file needs to be inserted, and the target insertion position being the same as the current cursor position; and providing the insert collaboration entrance to the second client; an insert menu is displayed in the second editing interface of the electronic document, the insert menu including at least one of a capture control and a local file selection control; The second client: When a trigger operation is received on the capture control, the camera head captures the multimedia file waiting to be inserted; or When a trigger operation on the selection control is received, the multimedia file waiting to be inserted is selected from the local files by a file manager.

12. 12. The method of claim 11, generating an insert collaboration entry for the electronic document in response to an insert collaboration operation on the first editing interface, adding an access link of the electronic document to collaboration entry information of the electronic document; and generating the inserted collaboration entrance carrying the collaboration entrance information.

13. 13. The method of claim 12, The method, wherein the insert collaboration entrance includes at least one of a graphic code for insert collaboration, a push message for initiating insert collaboration, a short message for initiating insert collaboration, email information for initiating insert collaboration, and an instant message for initiating insert collaboration.

14. 14. The method according to any one of claims 11 to 13, The method further includes synchronizing the current cursor position of the electronic document to the second client based on a target account logged into the second client.

15. 14. The method according to any one of claims 11 to 13, The method further includes adding an instruction indicator to the collaboration entrance information, the instruction indicator being for instructing the second client to automatically invoke an insert menu.

16. 1. An apparatus for editing an electronic document, comprising: an access module, an acquisition module, and an insertion module; the access module opens a second editing interface of the electronic document at a second client via an insert collaboration portal provided by a first client on a first computing device, the insert collaboration portal being used to collaborate with the first client to insert a multimedia file into the electronic document; The access module further displays a target insertion position in the second editing interface of the electronic document, the target insertion position being an editing position in the second editing interface where the multimedia file needs to be inserted, the target insertion position being the same as a current cursor position, and the current cursor position being a cursor position of the electronic document in the first editing interface of the first client; the acquisition module displays an insertion menu in the second editing interface of the electronic document, the insertion menu including at least one of a photographing control and a local file selection control, and photographs the multimedia file to be inserted by a camera head in response to a trigger operation on the photographing control, or selects the multimedia file to be inserted from the local files by a file manager in response to a trigger operation on the selection control; The insertion module inserts the multimedia file into the electronic document at the target insertion location in the second editing interface of the electronic document.

17. 1. An apparatus for editing an electronic document, comprising: a display module, a generation module, and an output module; the display module displays a first editing interface of the electronic document on a first client; the generating module generates an insert collaboration entry for the electronic document in response to an insert collaboration operation on the first editing interface, the insert collaboration entry being used to collaborate with a second client on a second computer device to insert a multimedia file into the electronic document; The generating module further adds a current cursor position of the electronic document as insertion position information to collaboration entry information of the electronic document, the insertion position information is used to indicate a target insertion position of the multimedia file, the target insertion position is displayed in a second editing interface of the second client, the target insertion position is an editing position in the second editing interface where the multimedia file needs to be inserted, and the target insertion position is the same as the current cursor position; the output module provides the insert collaboration entrance to the second client; an insert menu is displayed in the second editing interface of the electronic document, the insert menu including at least one of a capture control and a local file selection control; The second client: When a trigger operation is received on the capture control, the camera head captures the multimedia file waiting to be inserted; or When a trigger operation on the selection control is received, the device selects the multimedia file waiting to be inserted from the local files using a file manager.

18. A computer device comprising: a processor; and a memory coupled to the processor; The storage device stores a computer program, A computing device, wherein the processor is configured to execute the computer program to implement the method of claim 1 or 11.

19. A program for causing a computer to execute the method according to claim 1 or 11.

Images