Document processing method and apparatus, electronic device, and storage medium

Abstract

Embodiments of the present disclosure provide a document processing method and apparatus, an electronic device, and a storage medium. The document processing method, executed by a first device, comprises: if the first device processes a document, determining whether there is a target operation requiring assistance; if there is a target operation, sending a request message to a server, the request message being used for the server to select an alternative device on the basis of capability information of at least one second device, and a target device among the alternative devices being configured to execute the target operation requiring assistance.

Description

Document processing method and device, electronic device and storage medium Technical Field

[0001] The present disclosure relates to, but is not limited to, the field of information technology, and in particular to a document processing method and device, an electronic device, and a storage medium. Background Art

[0002] Electronic devices have document processing functions such as document editing functions, but usually a single device has a limited number of capabilities or its capabilities in some aspects are not strong enough, and the document being edited may have multiple editing requirements.

[0003] However, a single device may not be able to meet editing needs. In this case, the user may need to manually find a suitable device to perform the corresponding operation, then transfer the resulting file to the current editing device, and then insert the operated content into the document being edited through a series of tedious user operations.

[0004] This leads to problems such as low document editing efficiency and cumbersome user operations.

[0005] Summary of the Invention

[0006] The present disclosure provides a document processing method and device, an electronic device, and a storage medium.

[0007] A first aspect of an embodiment of the present disclosure provides a document processing method, which is executed by a first device. The method includes:

[0008] In the case where the first device processes a document, determining whether there is a target operation requiring assistance;

[0009] The request message is used by the server to select an alternative device based on capability information of at least one second device; the target device among the alternative devices is used to perform the target operation that requires assistance.

[0010] A second aspect of the present disclosure provides a document processing method, which is executed by a server. The method includes:

[0011] Receiving a request message sent by the first device; wherein the request message includes operation information of the target operation;

[0012] An alternative device capable of performing the target operation is determined according to the request message and capability information of at least one second device, wherein the target device among the alternative devices is used to assist the first device in performing the target operation.

[0013] A third aspect of the present disclosure provides a document processing device, the device comprising:

[0014] a first determining module, configured to determine whether there is a target operation requiring assistance when the first device processes a document;

[0015] The first sending module is used to send a request message to the server when the target operation exists; wherein the request message is used by the server to select an alternative device based on the capability information of at least one second device; the target device among the alternative devices is used to perform the target operation.

[0016] A fourth aspect of the present disclosure provides a document processing device, the device comprising:

[0017] A second receiving module is configured to receive a request message sent by the first device; wherein the request message includes operation information of the target operation;

[0018] The third determination module is used to determine an alternative device that can perform the target operation based on the request message and capability information of at least one second device, wherein the target device among the alternative devices is used to assist the first device in performing the target operation.

[0019] A fifth aspect of the present disclosure provides an electronic device, including:

[0020] processor;

[0021] a memory for storing processor-executable instructions;

[0022] The processor is configured to implement the document processing method provided by any one of the technical solutions of the first aspect or the second aspect when running the executable instructions.

[0023] A sixth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, which stores an executable program. When the executable program is executed by a processor, it implements the document processing method provided by any one of the solutions in the first or second aspects.

[0024] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0025] When the first device needs assistance from another device to perform a target operation on a document, it will proactively send a request message to the server. Based on the received request message, the server can then identify an alternative device that can assist the first device in performing the target operation. The target device among the alternative devices can then perform the corresponding target operation, thereby reducing the inefficiency and cumbersome operation caused by the user manually using another device to perform the target operation due to the first device's inability to perform the target operation. At the same time, this reduces the problem of poor document processing due to the first device's own poor performance in performing the target operation, thereby improving document processing results.

[0026] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0028] Fig. 1 is a schematic diagram showing the effect of a document processing method according to an exemplary embodiment.

[0029] Fig. 2 is a schematic diagram showing the effect of a document processing method according to an exemplary embodiment.

[0030] Fig. 3 is a schematic flow chart showing a document processing method according to an exemplary embodiment.

[0031] Fig. 4 is a schematic flow chart showing a document processing method according to an exemplary embodiment.

[0032] Fig. 5 is a schematic diagram showing a soft bus according to an exemplary embodiment.

[0033] Fig. 6 is a schematic diagram showing the effect of a document processing method according to an exemplary embodiment.

[0034] Fig. 7 is a schematic diagram showing the effect of a document processing method according to an exemplary embodiment.

[0035] Fig. 8 is a schematic flow chart showing a document processing method according to an exemplary embodiment.

[0036] Fig. 9 is a flowchart illustrating a document processing method according to an exemplary embodiment.

[0037] Fig. 10 is a schematic flow chart showing a document processing method according to an exemplary embodiment.

[0038] Fig. 11 is a flowchart showing a document processing method according to an exemplary embodiment.

[0039] Fig. 12 is a schematic structural diagram of a file processing device according to an exemplary embodiment.

[0040] Fig. 13 is a schematic structural diagram of a file processing device according to an exemplary embodiment.

[0041] Fig. 14 is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0042] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0043] As shown in FIG1 , an embodiment of the present disclosure provides a document processing method, which is executed by a first device and includes:

[0044] S1110: When the first device processes a document, determining whether there is a target operation that requires assistance;

[0045] S1120: If there is a target operation, send a request message to the server; wherein the request message is used by the server to select an alternative device based on capability information of at least one second device, wherein the target device among the alternative devices is used to perform the target operation.

[0046] Exemplarily, the first device herein may be any device that is processing a document, and exemplarily, the first device may be various terminal devices, such as a mobile terminal and / or a fixed terminal.

[0047] In another exemplary embodiment, the first device and the second device may be any device that the user can use. In another exemplary embodiment, the first device and / or the second device may be: a mobile phone, a tablet computer, a wearable device, an in-vehicle device, a smart home device, and / or a smart office device.

[0048] When the first device processes a document, the first device may lack a certain capability or a certain capability is not strong enough, and other devices are needed to assist it in performing the target operation.

[0049] In the disclosed embodiment, if the first device needs other devices to assist in processing a document, it will send a request message to a server. The server can be a cloud server, a local server in the same local area network as the first device, or a server on the first device.

[0050] The request message may include operation information of the target operation, and the operation information may include an operation type and / or operation parameters.

[0051] The operating parameters include but are not limited to indicating at least one of the following:

[0052] Operation object information, indicating the operation object;

[0053] Operation indicator information indicates the evaluation indicators that need to be achieved to perform the target operation. The evaluation indicators may include: image resolution, audio clarity and / or sound loudness of audio information, etc.

[0054] For example, in a scenario where a user's signature is requested to be collected, the operation information includes the signature collection operation (operation type) and signature parameters (operation parameters). The signature parameters can be used to indicate the target device capable of or convenient for collecting signatures, as well as the page parameters of the signature page. The page parameters include, but are not limited to, the link address of the signature page.

[0055] The first device processing the document may include: the first device editing the document, the first device displaying the document, or the first device sharing the document.

[0056] In some embodiments, the server stores capability information of the second device and can assist the first device in performing the above functions with the help of the second device.

[0057] Exemplarily, the second device performs an image acquisition function and inserts the acquired image into a document being processed by the first device.

[0058] The capability information may indicate the software and hardware capabilities of the second device, for example, the capability of capturing high-definition video and / or the capability of capturing voice.

[0059] The server may be an application server or a management server of a soft bus. For example, the application server may be a server of an application currently used by the first device to process documents.

[0060] For example, the document processing application includes but is not limited to a document editing application. Typical document editing applications may include: a WPS application, a word application, a PPT editing application, an Excel editing application, or a Visio editing application.

[0061] The above are merely examples of document editing applications, and specific implementations are not limited to the above examples.

[0062] If the server is an application server, the second device can use the same application as the first device. The second device includes but is not limited to various electronic devices.

[0063] For example, since the application server provides application services for the application, it will know which devices use the application and will obtain in advance the software and hardware capabilities of these electronic devices using the application and / or open up the software and hardware capabilities for sharing with other electronic devices.

[0064] For example, a user has a powerful in-vehicle device that can achieve high-precision positioning, image acquisition, and other functions. This in-vehicle device is also using the corresponding application on the application server. Based on user instructions, the in-vehicle device can be authorized to assist other devices in performing image acquisition operations. The application server will then record the image acquisition capability information of the in-vehicle device.

[0065] For example, the management server can manage multiple devices connected to the same soft bus. This management includes, but is not limited to, registering and deregistering devices connected to the same soft bus, storing capability information for each device, and selecting a target operation to be executed when a device requests assistance from other devices.

[0066] In some embodiments, the capability information may include at least one of the following information:

[0067] First capability information, indicating whether the corresponding second device has a certain capability;

[0068] The second capability information indicates a capability parameter of a capability of the second device. This capability parameter can be used to measure the quality of the operation results that the second device can provide when performing a corresponding operation. For example, if the second device has image acquisition capabilities, the second indication information may indicate the image resolution that the second device can capture.

[0069] The above are merely examples of capability information, and the specific implementation is not limited to the above examples.

[0070] In some embodiments, the candidate device is any device capable of performing the target operation, and the target device is the device selected from the candidate devices for performing the target operation. The target operation may be a configuration operation predefined in the first device, or a document operation that the first device itself is not capable of performing, or a document operation that the first device's own capabilities cannot achieve the desired effect. The above is merely an example of a target operation, and the specific implementation is not limited to this example.

[0071] In one embodiment, the target device is determined by the first device based on the device information of the candidate device provided by the server. In another embodiment, the target device may be directly determined by the server.

[0072] In some embodiments, the first device determines the target device from the alternative devices by itself, which may include: selecting the target device from the alternative devices based on a user selection operation, and / or, prioritizing the selection of an alternative device that has assisted the first device in performing document processing operations as the target device based on the historical selection record of the first device, etc.

[0073] In one embodiment, before sending the request message, the method further includes:

[0074] Determine whether first attribute information of the target operation exists, wherein the first attribute information is used to indicate one or more target attributes that the target device needs to have.

[0075] The first attribute information may be used to indicate one or more device attributes of the target device desired by the first device, or to indirectly determine one or more target modes required by the target device by indicating the attributes of the first device.

[0076] Device attributes may include the device type, the operating mode of the device, and / or attributes of components within the device that perform the target function.

[0077] For example, the target operation is a projection operation, which requires a device with a larger projection screen. Devices with larger projection screens include personal computers or conference room computers. The device type can indicate that the target device is a personal computer (PC).

[0078] For scenarios where the target operation involves audio playback, if the current candidate device is in a call state, selecting this candidate device as the target device may be rejected by the user of the target device, resulting in unsuccessful assistance for the target operation.

[0079] Therefore, based on the working mode of the device, alternative devices that are not convenient for performing the target operation can be screened out.

[0080] For example, the target mode may be an operating mode that the first device expects the target device to operate in, for example, in a projection state or in an audio playback state.

[0081] For example, the first attribute information indicates that the first device itself is currently in conference mode, which means that the first device needs to support target devices in conference mode.

[0082] For another example, if the target operation is a screen projection operation, the first attribute information may also include: screen size information and / or screen resolution information.

[0083] In one embodiment, the request message includes first attribute information; the first attribute information is used for the server to select a target device with target attributes from alternative devices, or for the server to select an alternative device based on capability information and second attribute information of at least one second device.

[0084] For example, the first device may carry the first attribute information in the request message. In this way, the server will directly select an alternative device based on at least one of the operation information of the target operation and the capability information required for the target operation, combined with the first attribute information.

[0085] The operation information may include: operation identification and / or operation type information. The capability information indicates the capability required to perform the target operation.

[0086] If the server determines only an alternative device that can perform the target operation for the first device, the device information returned by the server indicates that the alternative device has the attribute indicated by the first attribute information.

[0087] If the server directly selects a target device for the first device, the target device indicated by the device information returned by the server to the first device has the attributes indicated by the first attribute information.

[0088] In some embodiments, the first attribute information will not be sent to the server. In this case, the server will return the second attribute information at the same time as returning the device information of the candidate device.

[0089] In some embodiments, after sending the request message, the method further includes:

[0090] receiving second attribute information of the candidate device;

[0091] A target device having a target attribute is selected from the candidate devices according to the first attribute information and the second attribute information.

[0092] At this time, the first device can match its own first attribute information with the second attribute information so that the selected target device has the attribute indicated by the first attribute information.

[0093] The first device can directly select the target device from the candidate devices by matching the first attribute information and the second attribute information in the background. In this case, the user does not need to manually determine the target device from the candidate devices.

[0094] For example, when there are multiple alternative devices having the attributes indicated by the first attribute information, the alternative device with the strongest ability to perform the target operation can be selected from the multiple alternative devices as the target device, or the alternative device closest to the first device can be selected from the multiple alternative devices as the target device.

[0095] In some embodiments, selecting a target device having a target attribute from candidate devices according to the first attribute information and the second attribute information includes:

[0096] selecting, from the candidate devices, candidate devices including the target device according to the first attribute information and the second attribute information;

[0097] Display device information of candidate devices;

[0098] A target device is determined from the candidate devices according to a selection operation performed on the device information of the candidate devices.

[0099] In the embodiment of the present disclosure, the first device automatically matches the first attribute information and the second attribute information, and selects a candidate device having the attribute indicated by the first attribute information from the candidate devices.

[0100] The user interface of the first device may display device information of the candidate devices, such as device identification and / or device name. For example, the device information of the candidate devices may be displayed in a dialog box or a device information list, making it easier for the user to select the target device they want.

[0101] 2 , an embodiment of the present disclosure provides a document processing method, which is executed by a first device and includes:

[0102] S1210: When the first device processes a document, determining whether there is a target operation that requires assistance;

[0103] S1220: If the target operation exists, send a request message to the server; wherein the request message is used by the server to select an alternative device based on capability information of at least one second device, wherein the target device among the alternative devices is used to perform the target operation;

[0104] S1230: Receive device information of the candidate device returned by the server;

[0105] S1240: Determine the target device according to the device information of the candidate device.

[0106] 3 , an embodiment of the present disclosure provides a document processing method, which is executed by a first device and includes:

[0107] S1310: When the first device processes a document, determining whether there is a target operation that requires assistance;

[0108] S1320: If a target operation exists, send a request message to the server; wherein the request message is used to select a target device for performing the target operation based on capability information of at least one second device stored in the server;

[0109] S1330: Receive the device information of the target device returned by the server.

[0110] In short, there are many ways for the first device to select the target device from the candidate devices, and the specific implementation is not limited to any of the above methods.

[0111] In one embodiment, when selecting a target device, the first device or the server may select the target device from candidate devices according to a selection policy.

[0112] Selection strategies include but are not limited to at least one of the following:

[0113] Proximity priority strategy;

[0114] Attribution-first strategy;

[0115] Random strategies, etc.

[0116] For example, the proximity priority strategy may include at least one of the following:

[0117] Determine as the target device an alternative device that has the capability of performing the target operation, is closest to the first device, and has a first priority;

[0118] Determine as a target device a candidate device that has the capability of performing the target operation, has a direct transmission channel to the first device, and has a first priority;

[0119] An alternative device that has the ability to perform the target operation, does not have a direct transmission channel with the first device, and has a second priority is determined as the target device.

[0120] The second priority may be lower than the first priority.

[0121] If there are multiple candidate devices with the same priority, further selection may be performed according to other policies, for example, random selection according to a random policy, or selection among candidate devices with the same priority according to the belonging priority.

[0122] For example, if there are multiple candidate devices that have the ability to perform the target operation and are closest to the first device and have a first priority, the candidate device belonging to the same user account can be preferentially selected as the target device according to the attribution priority policy.

[0123] For example, the attribution priority policy may include at least one of the following:

[0124] Determine as a target device a candidate device that has the capability of performing the target operation, belongs to the same user account as the first device, and has a first priority;

[0125] Determine as the target device an alternative device that has the ability to perform the target operation and has a friend or relative account of the user account of the first device and has a second priority; the friend or relative account is a friend account and / or a relative account of the user account of the first device;

[0126] An alternative device that has the ability to perform the target operation, is an unfamiliar account to the user account of the first device, and has a third priority is determined as the target device.

[0127] The first priority is higher than the second priority, and the second priority is higher than the third priority.

[0128] In one embodiment, an alternative device that has the operation capability to perform the target operation and belongs to the same user account as the first device may be determined as the target device.

[0129] In another embodiment, if an alternative device and the first device belong to a friend or relative account and do not have the ability to perform the target operation, another alternative device that has the ability to perform the target operation and belongs to a friend or relative account with the first device is determined as the target device.

[0130] In one embodiment, if all candidate devices capable of executing the target operation are strangers to the user account of the first device, the candidate device capable of executing the target operation and belonging to the stranger account may be determined as the target device.

[0131] The unfamiliar account here is a device that is authorized to assist the first device in performing the target operation.

[0132] In some embodiments, the types of target operations include:

[0133] The first type is used to provide input information for processing documents;

[0134] and / or,

[0135] The second type is used to output document information.

[0136] Exemplarily, the first type is used to provide input information for editing a document;

[0137] For example, the target operations on a document may be divided into a first type and a second type according to whether the target operation is to introduce information into the document editing or to directly output the document.

[0138] For example, the first type may be obtaining input information required to edit a document.

[0139] In one embodiment, part or all of the input information can be used to write a document as part of the document content. In another embodiment, the input information can be verification information used in the process of editing a document.

[0140] When the target operation is of the first type, the second device can obtain input information for editing the document by executing the target operation.

[0141] When the target operation is of the second type, the second device outputs the document by projection, display on a screen, voice output, printing, or the like through execution of the target operation.

[0142] In this way, regardless of whether the first device has input or output capabilities, by communicating with other devices (including communicating directly or indirectly through a server), it can know other devices that assist it in processing documents, thereby achieving better document editing.

[0143] As shown in FIG4 , an embodiment of the present disclosure provides a document processing method, which is executed by a first device. The method includes:

[0144] S1410: When the first device processes a document, determining whether there is a target operation that requires assistance;

[0145] S1420: When the target operation is of the first type, receiving an operation result obtained by the target device executing the target operation;

[0146] S1430: Edit the document according to the operation result.

[0147] Exemplarily, after receiving the operation result, the first device edits the document according to the operation result.

[0148] The operation result may be directly sent by the target device to the first device through a direct transmission channel, or may be forwarded to the first device by the server.

[0149] For example, if the target operation is an image capture operation, the operation result includes the image captured by the target device; at this time, editing the document according to the operation result may include: inserting the image at the cursor position of the document editor when the first device sends the request message, or at the end of the document, or at the current cursor position, or at a specified position.

[0150] Exemplarily, inserting an image at the position where the document editing cursor is located, at the end of the document, or at the current cursor position when the first device sends the request message, or inserting an image at a specified position, may include:

[0151] A picture insertion prompt is displayed on the display interface of the document, and user operations acting on the insertion prompt are detected; when the user operation indicates confirmation of insertion, the image is inserted at the position of the document editing cursor when the first device sends the request message, or the insertion position is determined according to the user operation, and the image is automatically inserted according to the determined insertion position, or the image is directly inserted into the document at the current cursor position or at the end of the document according to the user operation.

[0152] In this way, the user does not need to use the insert function of the document editor to find the storage directory of the image and then insert it into the document, which simplifies the user operation and improves the document editing function of the first device.

[0153] For example, if the image is a signature image, the designated location may be the signature location of the document.

[0154] If the insertion is to the position of the document editing cursor when the first device sends the request message, the first device needs to synchronously record the position of the document editing cursor when sending the request message;

[0155] Similarly, the same method for inserting images can also be applied to link insertion. Such links include, but are not limited to, image links and / or file links. File links include, but are not limited to, links to image files and / or links to audio files.

[0156] In some embodiments, receiving an operation result obtained by the target device performing the target operation includes:

[0157] In a case where a direct transmission channel is established between the target device and the first device, an operation result sent by the target device is received based on the direct transmission channel.

[0158] or,

[0159] In a case where a direct transmission channel is not established between the target device and the first device, an operation result sent by the target device and returned by the server is received.

[0160] The direct transmission channel herein includes but is not limited to: a Bluetooth transmission channel, a WiFi direct transmission channel and / or a direct link (Sidelink, SL) transmission channel, and / or an infrared direct transmission channel, etc.

[0161] If there is a direct transmission channel between the target device and the first device, in order to reduce unnecessary transmission delay and reduce network congestion, the operation result sent by the target device can be directly received based on the direct transmission channel.

[0162] If a direct transmission channel is not established between the target device and the first device, the first device will receive the operation result from the server.

[0163] In this way, regardless of whether a direct transmission channel is established between the first device and the target device or whether a direct transmission channel is established, assistance from the target device can be obtained, thereby achieving better and more convenient editing of the document.

[0164] In some embodiments, the operation results include:

[0165] Image information captured by the target device;

[0166] Electronic signature information collected by the target device;

[0167] Biometric information collected by the target device;

[0168] Audio information collected by the target device.

[0169] For example, when editing a document using a first device such as a desktop computer or laptop, image capture is required. However, while the desktop computer or laptop has image capture capabilities, the image quality is poor. Therefore, the image capture function can be performed with the help of another device. Figure 7 is a schematic diagram of a PC requesting a mobile phone to assist in image capture. The operation information of the target operation can be sent directly to the mobile phone by the first device or forwarded to the mobile phone via a server. The mobile phone then performs image capture and returns the captured image to the PC. After receiving the captured image, the PC automatically inserts the corresponding text into the document.

[0170] For example, a first device, such as a smartwatch or smart bracelet, or a desktop computer, which does not have input hardware for a user's handwritten signature, can use a second device to capture the user's signature information. For example, a mobile phone may have a fingerprint collection module, but a laptop or smartwatch may not have the ability to collect fingerprints. In this case, when the laptop is editing a document, it can request the mobile phone to collect the user's fingerprint. The fingerprint here is only an example of biometric information. In specific implementations, the biometric information may also include other biometric information such as iris information.

[0171] For another example, as shown in Figure 6, when the PC is editing or processing a document, it needs the user's signature. At this time, it can also request a mobile phone or tablet device that can capture the user's touch operations, receive the signature information, and automatically insert the signature information into the corresponding position of the document.

[0172] For example, when editing a document, you need to insert audio information or a link to the audio information. However, the first device does not have the ability to collect the audio information, or the audio information collection effect is poor, or it is not next to the secondary collection target of the audio information. In this case, the first device can use the audio information of the target device.

[0173] For example, when the first device needs to specify a collection target, the location information of the specified location can be written into the request message to facilitate the application server to select the target device according to the location information.

[0174] The above are just examples of target device characteristics, and specific implementations are not limited to the above examples.

[0175] In some embodiments, editing the document according to the operation result includes at least one of the following:

[0176] Insert image information into documents;

[0177] Insert audio information into the document;

[0178] Insert the link address of the audio information into the document;

[0179] Inserting text information corresponding to the audio information into the document;

[0180] Insert electronic signature information into documents;

[0181] Insert electronic signature information into documents;

[0182] In some embodiments, in response to an editing operation of a document by an input module of the first device, it is necessary to verify that the first device has editing authority based on biometric information.

[0183] In an embodiment of the present disclosure, if the target operation is a first type operation, an operation result including input information will be obtained, and the first device receives the input information provided by the target device and directly inserts it into the document.

[0184] For example, image information, audio information, link address of audio information, text information translated from audio information, and electronic signature information are directly inserted into the document.

[0185] In some embodiments, the biometric information may include fingerprint information, iris information, and other biometric information that indicates identity verification, which is inserted into documents such as contracts that require biometric information to indicate identity.

[0186] In other embodiments, the biometric information may also indicate verification of whether the first device has editing authority.

[0187] For example, a first device downloads a document from an application server. Editing the document requires verification of editing permissions, which requires high-level authentication. However, a laptop or desktop computer may not be able to capture fingerprints or irises. In this case, a mobile phone or other device can be used to capture fingerprints. After verification, the first device's central processing unit or application server responds to the first device's input module's permission to edit the document.

[0188] The input module includes but is not limited to: a physical keyboard, a virtual keyboard, a handwriting board or a touch panel.

[0189] The above is just an example of the input module, and the specific implementation is not limited to the above example.

[0190] In one embodiment, the method further comprises:

[0191] In a case where a direct transmission channel is established between the target device and the first device, exchanging information related to the execution of the target operation with the target device based on the direct transmission channel;

[0192] or,

[0193] In the case that a direct transmission channel is not established between the target device and the first device, information required for executing the target operation is exchanged with the target device through the server.

[0194] Since the first device requires the target device to perform the target operation, the first device and the target device need to exchange information related to the target operation.

[0195] In the disclosed embodiments, regardless of whether the target operation is of the first or second type, if a direct transmission channel is established between the first device and the target device, information is exchanged between the first device and the target device via the direct transmission channel to improve response efficiency. If a direct transmission channel is not established between the first device and the target device, information exchanged between the first device and the target device is relayed and / or transparently transmitted through the server.

[0196] In some embodiments, the method further comprises:

[0197] In a case where the type of the target operation is the second type, the document information is sent to the target device.

[0198] When the type of the target operation is the second type, the first device may send the document information to the target device via a direct transmission channel and / or the Internet.

[0199] The document information may be used by the target device to perform at least one of the following:

[0200] The document information can be used to instruct the target device to display, print, edit, project or screen cast, etc.

[0201] Document information may include but is not limited to at least one of the following:

[0202] Document content;

[0203] Document attribute information, such as document identification and / or document attribute information. This document attribute information may include, but is not limited to, at least one of the following: document type information, document hyperlink information, document data volume information, document editor information, document modifier information, and / or document authorization information.

[0204] The document content sent to the target device may be a part of the document content or the entire document content.

[0205] In short, the specific content of the document information depends on the specific implementation and is not limited here.

[0206] In some embodiments, sending the document information to the target device includes:

[0207] In the case where a direct transmission channel is not established between the target device and the first device, the document is sent to the server, wherein the document is forwarded to the target device by the server.

[0208] If a direct transmission channel is not established between the target device and the first device, the document information is sent to the server, and the document information can be forwarded by the server to the target device.

[0209] If the server has already stored the document content, the first device can simply send the document identifier of the document to the server. The document identifier can be carried in the request message or in additional indication information indicating the document.

[0210] In this way, even if there is a direct transmission channel between the first device and the target device, the target device can be discovered and the target operation can be performed with the help of the application server.

[0211] In some embodiments, sending the document information to the target device includes:

[0212] When a direct transmission channel is established between the target device and the first device, receiving device information of the target device returned by the server;

[0213] Based on the device information, the document information is sent to the target device through a direct transmission channel.

[0214] If the server finds that a direct transmission channel has been established between the determined target device and the first device, it can return the device information of the target device to the first device, so that the first device receives the device information sent by the server. The device information may include but is not limited to at least one of the following: the device identifier and / or user account of the target device.

[0215] The device identifier may be: the International Mobile Equipment Identity (IMEI), Internet Protocol (IP) address, MAC address of the target device and / or a channel identifier of a direct transmission channel established between the first device and the target device.

[0216] The user account may be: an account used by the target device to use an application program for application services provided by the server, etc.

[0217] In short, after receiving the device information, the first device can determine the target device that can perform the target operation according to the device information, and request the target device to perform the operation.

[0218] In some embodiments, the method further comprises:

[0219] In the case where the target device and the first device are connected to the same distributed soft bus, it is determined that a direct transmission channel is established between the target device and the first device.

[0220] When a Bluetooth connection is established between the target device and the first device, determining that a direct transmission connection is established between the target device and the first device;

[0221] In a case where a WiFi direct connection is established between the target device and the first device, determining that a direct transmission connection is established between the target device and the first device;

[0222] In a case where an SL link is established between the target device and the first device, it is determined that a direct transmission connection is established between the target device and the first device.

[0223] For example, the soft bus herein may be referred to as a distributed soft bus. The distributed soft bus may perform several functions: discovery, connection, networking / topology management, task bus, and / or data bus.

[0224] Figure 6 is a schematic diagram of multiple devices connected to the same soft bus. For example, the various terminal devices include, but are not limited to, personal computers (PCs), mobile phones, tablet computers (e.g., pads), televisions (TVs), speakers, or other peripherals. The server also stores the capability information of each terminal device.

[0225] When any device processes a document, it generates a corresponding document task. This document task can be completed by one or more document operations. The aforementioned target operation can be one or more of the aforementioned document operations.

[0226] When registering to the softbus, the terminal device can register its own device capabilities with the management server through capability information. When assisting other devices to perform document tasks, the target device can be selected based on device capability matching, active time, and frequency.

[0227] Discovery refers to searching for nearby devices. Connection refers to establishing connections with discovered devices. Networking / topology management refers to managing the network topology of all discovered devices. For example, multiple discovered devices can be organized into a star or mesh network topology. The task bus function is a pathway for transmitting small amounts of data within the established network topology. The data bus function is a pathway for transmitting larger amounts of data.

[0228] If the first device and the second device are connected to the same soft bus, it means that there is a direct transmission channel between the first device and any second device connected to the same soft bus.

[0229] When discovering other devices nearby, one or more communication technologies, such as Bluetooth, infrared, and / or WiFi direct, can be used to establish a point-to-point direct transmission. If two devices are connected to the same soft bus, it means that there is a direct transmission channel between the two devices.

[0230] In some embodiments, the method further comprises:

[0231] Receiving device information of a candidate device returned by the server; wherein the candidate device is a second device capable of performing the target operation;

[0232] Detecting a selection operation of device information acting on a candidate device;

[0233] The target device is determined based on the selected operation.

[0234] If the target device is determined by the first device itself, the first device will receive device information of the candidate devices from the server. In the disclosed embodiment, the device information of the candidate devices will be output, for example, by display or voice output, for the user to select. Based on the user's selection, the first device will simply determine the target device from the candidate devices.

[0235] Furthermore, if there is a direct transmission channel between the target device and the first device, the first device can directly request the target device to perform the target operation after determining the target device. In this case, the first device may or may not inform the target device it has determined.

[0236] If there is no direct transmission channel between the target device and the first device, after the first device determines the target device, the method further includes:

[0237] The device information of the target device is returned to the server. In this way, the server knows the target device determined by the first device and assists the first device in requesting the target device to perform the target operation.

[0238] As shown in FIG8 , an embodiment of the present disclosure provides a document processing method, which is executed by a server and includes:

[0239] S2110: Receive a request message sent by the first device; wherein the request message includes operation information of a target operation;

[0240] S2120: Determine at least one candidate device capable of performing the target operation based on the request message and capability information of at least one second device, wherein the target device among the candidate devices is used to assist the first device in performing the target operation.

[0241] The server may be a management server of a soft bus or an application server of an application program, etc. The application program includes but is not limited to a document editing application, etc.

[0242] The server may be a cloud server deployed in the cloud or a local server in the same local area network as the first device.

[0243] The server can be connected to the first device via a local area network and / or the Internet. The first device can be any terminal device capable of processing documents.

[0244] After receiving the request message, the request message will be parsed. For example, the request message may include at least one of the following:

[0245] Operation information and / or operation parameters of the target operation; the operation information may indicate the target operation. The operation parameters may include evaluation parameters, etc.

[0246] Exemplarily, the operating parameter includes but is not limited to indicating at least one of the following:

[0247] Operation object information, indicating the operation object;

[0248] Operation indicator information indicates the evaluation indicators that need to be achieved to perform the target operation. The evaluation indicators may include: image resolution, audio clarity and / or sound loudness of audio information, etc.

[0249] In other embodiments, the request message may further include capability requirement information of the execution capability required for the target operation, etc.

[0250] In some other embodiments, the request message may also include location information of the first device, etc.

[0251] The server pre-stores the capability information of the second device.

[0252] The capability information may indicate the software and hardware capabilities of the second device, for example, the capability of capturing high-definition video and / or the capability of capturing voice.

[0253] Exemplarily, the second device may submit its own capability information when registering with the server, or the second device may submit its own capability information when logging into an application program that provides application services on the server.

[0254] In summary, the request message may include any information that can help the server determine an alternative device that can perform the target operation.

[0255] In the embodiment of the present disclosure, the second device capable of performing the target operation is determined as the candidate device, and is ultimately determined to be the target device that performs the target operation requested by the first device.

[0256] In the embodiment of the present disclosure, the server at least determines the candidate device. The subsequent further determination of the target device can be performed by the server or by the first device itself, which is not limited here.

[0257] In this way, the server can assist the first device in selecting a target device that can perform the target operation, and the target device can assist the first device in performing document processing, thereby improving the document processing efficiency and document processing capabilities of the first device.

[0258] In some embodiments, the types of target operations include:

[0259] The first type is used to provide input information for editing and other document processing;

[0260] and / or,

[0261] The second type is used to output document information.

[0262] For example, the target operations on a document may be divided into a first type and a second type according to whether the target operation is to introduce information into the document editing or to directly output the document.

[0263] For example, the first type may be obtaining input information required to edit a document.

[0264] In one embodiment, part or all of the input information can be used to write a document as part of the document content. In another embodiment, the input information can be verification information used in the process of editing a document.

[0265] When the target operation is of the first type, the second device can obtain input information for editing the document by executing the target operation.

[0266] When the target operation is of the second type, the second device outputs the document by projection, display on a display screen, or voice output, etc., through the execution of the target operation.

[0267] In this way, regardless of whether the first device has input capability or output capability, through this server-based communication method, it can know other devices that assist it in processing documents, thereby achieving better document editing.

[0268] In some embodiments, the method further comprises:

[0269] When the type of the target operation is the first type, determining whether a direct transmission channel is established between the target device and the first device;

[0270] In a case where a direct transmission channel is established between the target device and the first device, sending first indication information to the target device according to the request message, wherein the first indication information is used to instruct the target device to perform a target operation based on the direct transmission channel;

[0271] In the case that a direct transmission channel is not established between the target device and the first device, a second indication information is sent to the target device according to the request message, wherein the second indication information is used to instruct the target device to perform the target operation and return the operation result of the target operation to the server; the operation result is sent by the server to the first device.

[0272] After determining the target device, the server may determine how to instruct the target device to perform the target operation according to the type of the target operation and whether a direct transmission channel is established between the first device and the target device.

[0273] The direct transmission channel here may include at least one of the following:

[0274] The first device and the target device are connected to the same soft bus;

[0275] A Bluetooth connection is established between the first device and the target device;

[0276] An infrared connection is established between the first device and the target device;

[0277] A WiFi direct connection is established between the first device and the target device;

[0278] An SL link is established between the first device and the target device.

[0279] Through the above solution, regardless of whether a direct transmission channel is established between the first device and the target device, the target device that assists the first device in processing the document can be quickly found, and the document can be further processed in combination with the target operation of the target device.

[0280] In some embodiments, the method further comprises:

[0281] In the presence of the target operation, determining a third device to which the first device is connected or capable of being connected;

[0282] Display device information of a third device;

[0283] If the target operation exists, a request message is sent to the server, including:

[0284] In a case where no device information selection operation for the third device is detected, a request message is sent to the server.

[0285] The first device is currently connected to or has discovered one or more third devices. At this time, the third device can also serve as a target device to assist the first device in performing the target operation. In this case, there is no need to request additional messages from the server.

[0286] Therefore, in the embodiment of the present disclosure, if the first device itself does not find the target device that can perform the target operation, it will request the server, thereby reducing unnecessary information interaction between the first device and the server.

[0287] In some embodiments, the method further comprises:

[0288] In a case where the second device information selection operation acting on the third device is detected, a target device for performing the target operation is selected from the third device.

[0289] If it is detected that the third device can be executed, the first device displays the device information of the third device to facilitate the user to select the target device.

[0290] In one embodiment, the request message further includes: first attribute information;

[0291] S2120 may include:

[0292] According to the operation information of the target operation and / or the first attribute information carried in the request message, a candidate device or a target device having the attribute indicated by the first attribute information is selected.

[0293] In another embodiment, the method further comprises:

[0294] When returning the device information of the candidate device to the first device, second attribute information is also returned to the first device, wherein the second attribute information is used by the first device to select a target device having the attribute indicated by the first attribute information in combination with the first attribute information.

[0295] As shown in FIG9 , an embodiment of the present disclosure provides a document processing method, which is executed by a server and includes:

[0296] S2210: Receive a request message sent by the first device; wherein the request message includes operation information of the target operation;

[0297] S2220: Determine, based on the request message and capability information of at least one second device, a candidate device capable of performing the target operation;

[0298] S2230: Send device information of candidate devices to the first device; wherein the target device among the candidate devices is used to assist the first device in performing the target operation.

[0299] In one embodiment, the method further comprises:

[0300] Returning device information of the target device to the first device;

[0301] or,

[0302] The device information of the candidate device is returned to the first device, wherein the device information of the candidate device is used for the first device to select a target device.

[0303] If the server directly selects the target device from the candidate devices, it will return the device information of the target device to the first device.

[0304] Alternatively, the server only selects candidate devices for the first device and returns the device information of the candidate devices to the first device, so that the first device can select the target device based on the device information of the candidate devices.

[0305] In some embodiments, the method further includes: receiving device information of the target device returned by the first device based on the device information.

[0306] In other embodiments, after the first device determines the target device from the candidate devices, it may not inform the server.

[0307] As shown in FIG10 , an embodiment of the present disclosure provides a document processing method, which is executed by a server and includes:

[0308] S2310: Receive a request message sent by the first device; wherein the request message includes operation information of a target operation;

[0309] S2320: Determine, based on the request message and capability information of at least one second device, at least one candidate device capable of performing the target operation, wherein the target device among the candidate devices is configured to assist the first device in performing the target operation;

[0310] S2330: Determine a target device for performing the target operation from candidate devices according to preset information.

[0311] According to the request message and the capability information of at least one second device, a candidate device capable of performing the target operation is determined; and according to preset information, a target device for performing the target operation is determined.

[0312] The preset information is information that can be used to select a target device from the second device in addition to the request message and the capability information.

[0313] The preset information may include at least one of the following:

[0314] Status information of the second device, for example, the status information may indicate at least one of the following: a network connection status of the second device, a type of network to which the second device is connected, a load rate of the second device, whether the second device is running a target application, and / or a health status of the second device;

[0315] The attribution information of the second device, for example, the user account bound to the second device, or the accounts of relatives and friends of the user account bound to the second device;

[0316] Location information of the second device, for example, the location information may include but is not limited to: longitude and latitude information of the second device;

[0317] Information about the degree of matching between the capabilities provided by the second device and the capabilities required to perform the target operation.

[0318] The above are merely examples of preset information, and the specific implementation is not limited to the above examples.

[0319] In short, no matter which method is used, the target device is selected from the alternative devices.

[0320] In one embodiment, the method further comprises:

[0321] According to the preset information, a target device for performing the target operation is determined from the candidate devices.

[0322] The server determines whether there is a second device within the predetermined range that fully possesses the capabilities required for the target operation.

[0323] In some embodiments, the capability information may indicate the device capabilities of each second device, and matching is performed according to the capabilities required for the target operation to obtain the aforementioned matching degree information.

[0324] If the matching degree information indicates a 100% match, the second device with a 100% match is preferably selected as the target device, that is, the second device with a 100% match is determined as the target device. If there are alternative devices, the target device is determined from the alternative devices first. Otherwise, the second device with the highest matching degree is selected as the target device based on the matching degree information.

[0325] The predetermined range may include but is not limited to at least one of the following:

[0326] A device that is bound to the same user account as the first device;

[0327] a device within a preset range from the first device;

[0328] A device that belongs to the same local area network as the first device;

[0329] A device connected to the same soft bus as the first device;

[0330] The user account bound to the first device belongs to a device of a friend or relative account.

[0331] The above are examples of predetermined ranges, and specific implementation is not limited to the above examples.

[0332] In some embodiments, determining a target device for performing a target operation from candidate devices based on preset information includes:

[0333] In the case where there are multiple candidate devices, selecting a target device from the candidate devices that can perform the target operation according to the preset information and the first selection strategy;

[0334] or,

[0335] In the case where there are multiple candidate devices, the device information of the candidate devices is sent to the first device according to the preset information and the second selection strategy, wherein the device information of the candidate devices is used by the first device to select the target device.

[0336] The first type of selection strategy is a selection strategy in which the server selects a target device from candidate devices.

[0337] The second type of selection strategy is a selection strategy in which the first device selects a target device from candidate devices.

[0338] The target objects are selected differently according to the two selection strategies, which is convenient for meeting different target device selection requirements in different scenarios.

[0339] If there are multiple second devices that can completely perform the target operation requested by the request message, it is necessary to further select a target device from the multiple second devices that can perform the target operation based on preset information and the target selection policy used.

[0340] In this way, the second device selected in this manner can not only be a target device that can perform the target operation, but also the most suitable target device can be selected according to the requirements for selecting the target device.

[0341] In some embodiments, selecting the target device from the second device capable of performing the target operation according to the preset information and the first type of selection strategy includes at least one of the following:

[0342] According to the preset information and the closest distance strategy, select the candidate device that is closest to the first device as the target device;

[0343] According to the preset information and the activity status priority policy, a second device that can perform the target operation and whose activity status meets the preset conditions is selected as the target device;

[0344] According to the preset information and the direct transmission channel priority policy, a second device that can perform the target operation and has a direct transmission channel with the first device is selected as the target device.

[0345] The closest distance strategy, the active status priority strategy, and the direct transmission channel priority strategy are all specific examples of the aforementioned first type of selection strategy, and the specific implementation is not limited to the above examples.

[0346] In some embodiments, the method further comprises:

[0347] A first type of selection strategy is selected from a plurality of alternative selection strategies according to a target operation.

[0348] For example, if the target operation is an on-site signature operation, the closest distance strategy can be selected as the first selection strategy. For example, if the target operation is a printing operation, the direct transmission channel priority strategy can be selected as the target selection strategy.

[0349] For another example, if the closest distance selection strategy and / or the direct transmission channel priority strategy are not met, the active status priority strategy may be determined as the first selection strategy.

[0350] The above is only a specific example of determining the first type of strategy, and the specific implementation is not limited to the above example.

[0351] In some embodiments, based on preset information and an activity status priority policy, selecting a second device that can perform the target operation and whose activity status meets preset conditions as the target device includes one of the following:

[0352] According to the preset information and the activity status priority policy, a second device that can perform the target operation and has the highest activity frequency is selected as the target device;

[0353] According to the preset information and the activity status priority policy, a second device that can perform the target operation and is currently active is selected as the target device;

[0354] According to the preset information and the activity status priority policy, the second device that can perform the target operation and is last active is selected as the target device.

[0355] The active state may be: an active state in which the second device uses the soft bus and / or an active state in which the second device uses the target application.

[0356] The target application may be an application for processing documents on the first device, or an application executed by the first device based on a user operation.

[0357] If the active state is an active state of using the target application, then according to the preset information and the activity state priority policy, a second device that can perform the target operation and whose activity state meets the preset conditions is selected as the target device, including one of the following:

[0358] According to the preset information and the activity status priority policy, select a second device that can perform the target operation and uses the target application most frequently as the target device;

[0359] Selecting, based on the preset information and the activity status priority policy, a second device that can perform the target operation and is currently using the target application as the target device;

[0360] According to the preset information and the activity status priority policy, a second device that can perform the target operation and last uses the target application is selected as the target device.

[0361] If the active state is an active state using a soft bus, a second device that can perform the target operation and whose active state meets a preset condition is selected as the target device according to the preset information and the active state priority policy, including one of the following:

[0362] According to the preset information and the activity status priority policy, a second device that can perform the target operation and uses the soft bus most frequently is selected as the target device;

[0363] According to the preset information and the activity status priority policy, a second device that can perform the target operation and is currently using the soft bus is selected as the target device;

[0364] According to the preset information and the activity status priority policy, a second device that can execute the target operation and finally uses the soft bus is selected as the target device.

[0365] For example, if there is no second device currently active, the last active second device is selected as the target device.

[0366] In summary, selecting a target device according to the activity priority strategy can reduce the number of inactive second devices selected as target devices, and can reduce the delay in executing the target operation.

[0367] As shown in FIG11 , an embodiment of the present disclosure provides a document processing method, which is executed by a target device. The method may include:

[0368] S3110: Receive operation information sent by the first device or the server;

[0369] S3120: Execute the target operation according to the operation information.

[0370] Exemplarily, the types of target operations include: a first type for providing input information for document processing such as editing; and / or a second type for outputting document information.

[0371] If the target operation is of the first type, the method further includes providing the target operation result to the first device. For example, the target operation result is sent to the first device via a direct transmission channel; or the target operation result is sent to a server, which then sends the result to the first device.

[0372] In some other embodiments, if the type of the target operation is the second type, the method further includes:

[0373] receiving a document provided by the first device or the server;

[0374] Outputting a document. Here, outputting a document may include, but is not limited to: displaying, printing, editing, projecting, or broadcasting a document.

[0375] When editing documents, operations often require inconvenient equipment. For example, when editing a document using a personal computer (PC) keyboard and mouse, users need to insert a handwritten signature. This can be accomplished by connecting an external handwriting device, writing with a mouse, or reopening the document on their phone, completing the handwriting process, and then sending it back to the PC. This can be ineffective or cumbersome. Similarly, if a user needs to temporarily insert a photo while editing a document on a PC, taking photos on a PC is inconvenient, so they typically have to take the photo with their phone, send it to the PC, and then insert it, a cumbersome process.

[0376] In summary, in most current scenarios, if a certain capability of the current device is missing, the task needs to be sent to another device and then sent back to the original device after completion, or an external device needs to be connected to assist in completion.

[0377] When an electronic device processes a document task, the server automatically assigns the nearest active device based on the required capabilities. For example, the server can select devices based on capability matching, proximity, active time, and frequency. Manual device selection is also supported to assist in completing the task. Task results are displayed directly on the original device, eliminating the need for back-and-forth transmission or additional connections, streamlining operations.

[0378] In this process, the convenience and portability of audio and video input on mobile devices, as well as the better presentation experience and playback effects of large-screen devices such as PCs, are utilized to uniformly manage the relevant capabilities of different devices. When any device initiates a task, it can be intelligently called according to the capabilities and effects required by the task, thereby improving document editing effects, processing efficiency and experience.

[0379] The capabilities required for document processing scenarios are fed back to the Softbus server. When a new electronic device is registered on the Softbus, its capabilities are also recorded on the Softbus server. For example, the advantages of electronic devices such as mobile devices lie in their convenient and portable audio and video input capabilities, while the advantages of large-screen devices such as PCs lie in their superior presentation experience and playback quality.

[0380] When an electronic device is processing a document task, it automatically assigns the nearest active device to assist in completing the task based on the required capabilities. Manual device selection is also supported. The server or electronic device selects the target device based on capability matching, distance, activity time, and frequency.

[0381] If a device that assists in completing a task goes offline due to an abnormal situation and is unable to complete the task, other qualified devices can automatically fill in.

[0382] If an electronic device is connected to a peripheral device and has the corresponding capability, it is also recorded in the soft bus to support calling.

[0383] The capabilities required for document processing are fed back to the Softbus server. When a user registers a new electronic device on the Softbus, the device's capabilities are also recorded on the Softbus. For example, the advantages of mobile devices lie in their convenient and portable audio and video input capabilities; large-screen devices like PCs offer a superior presentation experience and playback quality.

[0384] When processing a document task, the system automatically assigns the nearest active device to assist in completing the task based on the capabilities required for the task. It also supports manual selection of devices to complete the document task, that is, the target device for completing the document task is determined based on the user's selection.

[0385] If a device that assists in completing a task goes offline due to an abnormal situation and is unable to complete the task, other qualified devices can automatically fill in.

[0386] If an electronic device is connected to a peripheral device and has the corresponding capabilities, it will also be recorded in the soft bus and support calling.

[0387] After a device logs in to an account, it records basic device information on the soft bus, along with its capabilities. This capability information can indicate at least one of the following: the capabilities of connected peripherals, such as a keyboard, mouse, and / or speakers. Devices recorded on the soft bus can be intelligently called up based on the scenario.

[0388] For example, the PC uses the handwriting, photo taking and / or voice capabilities of the mobile terminal to assist in completing the editing of the document.

[0389] Referring to Figure 6, the following uses the PC side calling the mobile side handwriting function as an example to illustrate:

[0390] When editing a document, you need to temporarily insert a handwritten signature or hand-draw to complete complex image annotations, but using a mouse / touchpad to complete handwriting operations is not effective.

[0391] When a user triggers a handwriting-related function, the user's mobile phone handwriting capability is automatically called, and the current signature interface or the hand-drawn picture to be added is presented on the mobile phone.

[0392] After editing is completed, the user clicks OK on the mobile phone, and the signature / hand-drawn image is directly inserted into the original document location on the PC.

[0393] Referring to Figure 7, the following explanation is given using the example of a PC calling a mobile camera:

[0394] To insert a picture or video into a document, you need to take a temporary photo. When the relevant function is triggered, the user's mobile phone camera will be automatically called. After the photo is taken, the user clicks OK on the mobile phone, and the photo / video is automatically inserted into the original document location on the PC.

[0395] The following uses the PC terminal to call the mobile terminal microphone as an example to illustrate:

[0396] Using voice input to recognize text is more efficient during document editing, but PC microphones are not very effective and are restricted by location. Users can use their mobile phone microphone to recognize text during voice input, and the input text will be displayed directly on the PC.

[0397] When the capability is called, it is automatically allocated according to capability matching, distance, active time and frequency. It also supports manual selection of devices to complete document tasks.

[0398] If both phone A and phone B meet the camera call requirements, but phone A is closer and has more power, the soft bus will prioritize phone A. The user can also manually select phone B for shooting as desired.

[0399] When mobile phone B runs out of power or encounters other scenarios that make it impossible to continue to call capabilities, the soft bus will automatically assign mobile phone A to complete the task.

[0400] The following example uses the mobile terminal to call a PC, large screen, and other peripherals to perform operations:

[0401] When users view documents, videos and other content on their mobile phones, the display effect is poor due to the small screen, so they can automatically switch to large-screen devices for playback.

[0402] When audio is involved, peripherals registered on the soft bus, such as speakers, can also be called. The playback here can be just screen projection, rather than sending the file to the large-screen device. In another embodiment, the document can also be sent to the large-screen device and displayed by the large-screen device.

[0403] As shown in FIG12 , an embodiment of the present disclosure provides a document processing device, the device comprising:

[0404] A first determining module 110 is configured to determine whether there is a target operation requiring assistance when the first device processes a document;

[0405] The first sending module 120 is used to send a request message to the server when there is a target operation; wherein the request message is used by the server to select an alternative device based on capability information of at least one second device, wherein the target device among the alternative devices is used to perform the target operation.

[0406] The file processing apparatus may be included in the first device.

[0407] In some embodiments, the first determining module 110 and the first sending module 120 may be program modules; after the program modules are executed by the processor, the above operations can be implemented.

[0408] In other embodiments, the first determination module 110 and the first sending module 120 may be a combination of software and hardware modules; the combination of software and hardware includes but is not limited to programmable arrays; programmable arrays include but are not limited to field programmable arrays and / or complex programmable arrays.

[0409] In some other embodiments, the first determining module 110 and the first sending module 120 may be pure hardware modules; pure hardware modules include but are not limited to application-specific integrated circuits.

[0410] In some embodiments, the apparatus further comprises:

[0411] The determination module is configured to determine whether there is first attribute information of a target operation, wherein the first attribute information is configured to indicate one or more target attributes that a target device needs to possess.

[0412] In some embodiments, the request message includes first attribute information; the first attribute information is used for the server to select a target device with target attributes from alternative devices, or for the server to select an alternative device based on capability information and second attribute information of at least one second device.

[0413] In some embodiments, the apparatus further comprises:

[0414] A first receiving module, configured to receive second attribute information of a candidate device;

[0415] The first selection module is configured to select a target device having a target attribute from the candidate devices according to the first attribute information and the second attribute information.

[0416] In some embodiments, the first selection module is specifically configured to select a candidate device having the target device from the candidate devices based on the first attribute information and the second attribute information;

[0417] The device also includes:

[0418] A display module, used to display device information of candidate devices;

[0419] The first selection module is further specifically configured to determine a target device from the candidate devices according to a selection operation performed on the device information of the candidate devices.

[0420] In some embodiments, the types of target operations include:

[0421] The first type is used to provide input information for processing a document, for example, to provide input information for editing a document;

[0422] and / or,

[0423] The second type is used to output document information.

[0424] In some embodiments, the apparatus further comprises:

[0425] A first receiving module is configured to receive an operation result obtained by a target device performing a target operation when the target operation is of the first type;

[0426] The editing module is used to edit documents based on the operation results.

[0427] In some embodiments, the first receiving module is configured to receive an operation result sent by the target device based on the direct transmission channel when a direct transmission channel is established between the target device and the first device.

[0428] or,

[0429] In a case where a direct transmission channel is not established between the target device and the first device, an operation result sent by the target device and returned by the server is received.

[0430] In some embodiments, the operation results include:

[0431] Image information captured by the target device;

[0432] Electronic signature information collected by the target device;

[0433] Biometric information collected by the target device;

[0434] Audio information collected by the target device;

[0435] In some embodiments, the editing module is specifically configured to perform at least one of the following:

[0436] Insert image information into documents;

[0437] Insert the link address of the audio information into the document;

[0438] Inserting text information corresponding to the audio information into the document;

[0439] Insert electronic signature information into documents;

[0440] When it is verified based on the biometric information that the first device has the editing authority, the input module of the first device responds to the editing operation of the document.

[0441] In some embodiments, the first sending module 120 is further configured to send the document information to the target device when the target operation is of the second type, wherein the document is used for output on the target device.

[0442] In some embodiments, the first sending module 120 is further configured to send the document to the server when no direct transmission channel is established between the target device and the first device, wherein the document is forwarded to the target device by the server.

[0443] In some embodiments, the first sending module 120 is further specifically used to receive device information of the target device returned by the server when a direct transmission channel is established between the target device and the first device; and send document information to the target device through the direct transmission channel based on the device information.

[0444] In some embodiments, the apparatus further comprises:

[0445] The second determining module is configured to determine whether a direct transmission channel is established between the target device and the first device when the target device and the first device are connected to the same soft bus.

[0446] In some embodiments, the first receiving module is further configured to receive device information of a candidate device returned by the server; wherein the candidate device is a second device capable of performing the target operation;

[0447] The device also includes:

[0448] A detection module, configured to detect a selection operation of device information acting on a candidate device;

[0449] The target device module is used to determine the target device according to the selection operation.

[0450] As shown in FIG13 , an embodiment of the present disclosure provides a document processing device, the device comprising:

[0451] The second receiving module 210 is configured to receive a request message sent by the first device; wherein the request message includes operation information of a target operation;

[0452] The third determining module 220 is configured to determine at least one candidate device capable of performing the target operation based on the request message and capability information of at least one second device, wherein the target device among the candidate devices is configured to assist the first device in performing the target operation.

[0453] The file processing device may be included in a server, which includes but is not limited to an application server.

[0454] In some embodiments, the second receiving module 210 and the third determining module 220 may be program modules; after the program modules are executed by the processor, the above operations can be implemented.

[0455] In other embodiments, the second receiving module 210 and the third determining module 220 may be a combination of software and hardware modules; the combination of software and hardware includes but is not limited to programmable arrays; programmable arrays include but are not limited to field programmable arrays and / or complex programmable arrays.

[0456] In some other embodiments, the second receiving module 210 and the third determining module 220 may be pure hardware modules; pure hardware modules include but are not limited to application-specific integrated circuits.

[0457] In some embodiments, the types of target operations include:

[0458] The first type is used to provide input information for editing documents;

[0459] and / or,

[0460] The second type is used to output document information.

[0461] In some embodiments, the apparatus further comprises:

[0462] The third determining module 220 is configured to determine whether a direct transmission channel is established between the target device and the first device when the type of the target operation is the first type;

[0463] The second sending module sends first indication information to the target device according to a request message when a direct transmission channel is established between the target device and the first device, wherein the first indication information is used to instruct the target device to perform the target operation based on the direct transmission channel; or, when no direct transmission channel is established between the target device and the first device, sends second indication information to the target device according to the request message, wherein the second indication information is used to instruct the target device to perform the target operation and return the operation result of the target operation to the server; the operation result is sent by the server to the first device.

[0464] In some embodiments, the third determining module 220 is specifically configured to determine a target device for performing a target operation according to the request message, capability information of at least one second device, and preset information.

[0465] In some embodiments, the third determining module 220 is further configured to determine a target device for performing the target operation from among the candidate devices according to preset information.

[0466] In some embodiments, the third determination module 220 is specifically configured to, when it is determined based on the request message and capability information of at least one second device that there is no alternative device, use as the target device the second device whose execution capability has the highest match with the capability required for the target operation.

[0467] In some embodiments, the third determination module 220 is also used to select a target device from a second device that can perform the target operation according to preset information and a first type of selection strategy when there are multiple alternative devices; or, when there are multiple alternative devices, send device information of the alternative device to the first device according to preset information and a second type of selection strategy, wherein the device information of the alternative device is used by the first device to select the target device.

[0468] The third determining device is further specifically configured to select, according to preset information and a closest distance strategy, an alternative device that is closest to the first device as the target device;

[0469] According to the preset information and the activity status priority policy, a second device that can perform the target operation and whose activity status meets the preset conditions is selected as the target device;

[0470] According to the preset information and the direct transmission channel priority policy, a second device that can perform the target operation and has a direct transmission channel with the first device is selected as the target device.

[0471] In some other embodiments, the third determining module 220 is specifically configured to perform one of the following:

[0472] According to the preset information and the activity status priority policy, a second device that can perform the target operation and has the highest activity frequency is selected as the target device;

[0473] According to the preset information and the activity status priority policy, a second device that can perform the target operation and is currently active is selected as the target device;

[0474] According to the preset information and the activity status priority policy, the second device that can perform the target operation and is last active is selected as the target device.

[0475] In some embodiments, the apparatus further comprises:

[0476] The second receiving module is configured to return device information of the candidate device to the first device, wherein the device information of the candidate device is used for the first device to select a target device; or return device information of the target device to the first device.

[0477] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0478] An embodiment of the present disclosure further provides an electronic device, including:

[0479] processor;

[0480] a memory for storing processor-executable instructions;

[0481] The processor is configured to implement the document processing method of any embodiment of the present disclosure when running the executable instructions.

[0482] The electronic device may be the aforementioned first device or a server. The server may be a cloud server, specifically an application server and / or a management server of a soft bus.

[0483] The memory may include various types of storage media, which are non-transitory computer storage media that can continue to store information after the communication device loses power.

[0484] The processor can be connected to the memory via a bus, etc., and is used to read the executable program stored in the memory, for example, to implement the document processing method shown in any one of Figures 1 to 4 and Figures 6 to 11.

[0485] The present disclosure also provides a computer-readable storage medium storing an executable program, wherein the executable program, when executed by a processor, implements the document processing method of any embodiment of the present disclosure, for example, the document processing method shown in any one of Figures 1 to 4 or Figures 6 to 11.

[0486] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0487] An embodiment of the present disclosure provides an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to: when running the executable instructions, implement the document processing method provided by any one of the aforementioned technical solutions, for example, the document processing method shown in any one of Figures 1 to 4 and Figures 6 to 11.

[0488] As shown in Figure 14, an embodiment of the present disclosure shows a structure of an electronic device. The electronic device may be the aforementioned first device, server, and / or target device.

[0489] For example, the electronic device 900 can be provided as a network-side device. Referring to FIG14 , the electronic device 900 includes a processing component 922, which further includes one or more processors, and a memory resource represented by a memory 932 for storing instructions that can be executed by the processing component 922, such as an application. The application stored in the memory 932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 922 is configured as an executable program to perform any of the aforementioned methods applied to the access device, for example, the document processing method shown in any one of Figures 1 to 4 and Figures 6 to 11.

[0490] The electronic device 900 may further include a power supply component 926 configured to perform power management of the electronic device 900, a wired or wireless network interface 950 configured to connect the electronic device 900 to a network, and an input / output (I / O) interface 958. The electronic device 900 may operate based on an operating system stored in the memory 932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0491] In an exemplary embodiment, an embodiment of the present disclosure provides a computer-readable storage medium, which stores an executable program, wherein when the executable program is executed by a processor, it implements the document processing method provided by any one of the aforementioned technical solutions, for example, executing the document processing method shown in any one of Figures 1 to 4 and Figures 6 to 11.

[0492] The computer-readable storage medium may specifically be: a non-transitory computer-readable storage medium.

[0493] For example, the memory 932 includes an executable program, and the above instructions can be executed by the processing component 922 of the electronic device 900 to complete the above method.

[0494] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0495] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0496] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A document processing method, characterized in that: Executed by a first device, the method includes: In the case where the first device processes a document, determining whether there is a target operation requiring assistance; If the target operation exists, sending a request message to the server; The request message is used by the server to select an alternative device based on capability information of at least one second device; and a target device among the alternative devices is used to perform the target operation.

2. The method according to claim 1, characterized in that Before sending the request message, the method further includes: First attribute information of the target operation is determined, wherein the first attribute information is used to indicate one or more target attributes that the target device needs to possess.

3. The method according to claim 2, characterized in that The request message includes the first attribute information; The first attribute information is used by the server to select the target device having the one or more target attributes from the candidate devices, or is used by the server to select a candidate device based on the first attribute information, capability information of at least one second device, and second attribute information.

4. The method according to claim 2, characterized in that After sending the request message, the method further includes: receiving second attribute information of the candidate device; The target device having the one or more target attributes is selected from the candidate devices according to the first attribute information and the second attribute information.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: receiving the operation result obtained by the target device performing the target operation, and processing the document according to the operation result; or, The document information is sent to the target device, wherein the document information is used by the target device to perform the target operation.

6. The method according to any one of claims 1 to 4, characterized in that The method comprises: In a case where a direct transmission channel is established between the target device and the first device, exchanging information related to the execution of the target operation with the target device based on the direct transmission channel; or, In the case that a direct transmission channel is not established between the target device and the first device, information required for executing the target operation is exchanged between the server and the target device.

7. The method according to any one of claims 1 to 4, characterized in that The method further comprises: In the case where the target operation exists, determining a third device to which the first device is connected or capable of being connected; displaying device information of the third device; The sending of a request message to the server when the target operation exists includes: In a case where no device information selection operation for the third device is detected, sending the request message to the server; or, In a case where a device information selection operation of a third device acting on the third device is detected, a target device for executing the target operation is selected from the third device.

8. A document processing method, characterized in that: Executed by a server, the method includes: Receiving a request message sent by the first device; wherein the request message includes operation information of a target operation on the document; Determine an alternative device capable of performing the target operation according to the request message and capability information of at least one second device, wherein the target device among the alternative devices is used to assist the first device in performing the target operation.

9. The method according to claim 8, characterized in that The method further comprises: Returning device information of the candidate device to the first device, wherein the device information of the candidate device is used for the first device to select a target device; or, Return the device information of the target device to the first device.

10. A document processing device, characterized in that: The device comprises: a first determining module, configured to determine whether there is a target operation requiring assistance when the first device processes a document; The first sending module is used to send a request message to the server when the target operation exists; wherein the request message is used by the server to select an alternative device based on the capability information of at least one second device, wherein the target device among the alternative devices is used to perform the target operation.

11. A document processing device, characterized in that: The device comprises: A second receiving module is configured to receive a request message sent by the first device; wherein the request message includes operation information of a target operation on the document; The third determination module is used to determine an alternative device that can perform the target operation based on the request message and capability information of at least one second device, wherein the target device among the alternative devices is used to assist the first device in performing the target operation.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the document processing method according to any one of claims 1 to 7 or 8 to 9 when running the executable instructions.

13. A computer-readable storage medium, characterized in that The readable storage medium stores an executable program, wherein the executable program, when executed by a processor, implements the document processing method according to any one of claims 1 to 7 or 8 to 9.

Images