Calling method and electronic equipment

By displaying tag operation blocks on the application interface of the terminal device and dynamically calling the functions of other electronic devices, the complex operation problems in the existing technology are solved, user experience and flexibility are improved, and convenient function calls and real-time modifications are achieved.

CN118939144APending Publication Date: 2024-11-12HONOR DEVICE CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202310522265.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

During the recording process of existing terminal devices, it is difficult to simplify operations and weaken the impact on the current application, resulting in poor user experience, especially when calling the functions of other electronic devices, which are complex and inconvenient to operate.

Method used

Provide a call method and electronic device. By displaying tag operation blocks on the application interface, users can click to call the functions of other electronic devices, and update tag information during the call process, realizing the function of dynamically calling other electronic devices, and supporting temporary insertion and drag operations for increased flexibility.

Benefits of technology

It simplifies the operation process, improves the user experience, allows users to easily call the functions of other electronic devices during the recording process, meets the needs of different scenarios, and supports real-time modification and flexible location settings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939144A_ABST
    Figure CN118939144A_ABST
Patent Text Reader

Abstract

The invention provides a calling method and electronic equipment, and the method comprises the steps that the electronic equipment responds to a received user operation, displays a label operation block in an application interface, and calls a specified function of another electronic equipment. In the process of calling the other electronic device, the electronic device can change the tag operation block based on the received user operation, call the other specified function of the other electronic device, and obtain the insertion object obtained by the other electronic device based on the other function. According to the electronic equipment, the insertion object can be displayed at the position of the tag operation block, so that a simple and convenient calling method is provided, calling of other electronic equipment can be realized through simple operation, and content specified by a user can be inserted by calling the other electronic equipment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal devices, and in particular to a calling method and electronic device. Background Art

[0002] With the rapid development of terminal technology, terminals provide more and more functions and more and more application scenarios. For example, during the learning process, users can use the memo software provided by the terminal to take notes in class. During the recording process, users can not only record in text, but also insert photos or pictures to enrich the content of the notes. Summary of the invention

[0003] The present application provides a calling method and an electronic device, which can realize inserting specified content by calling other electronic devices during the recording process, thereby simplifying the operation, weakening the impact on the current application, and improving the user experience.

[0004] In a first aspect, the present application provides a calling method. The method includes: a first electronic device displays a first application interface, wherein the first application interface displays input content and a first option. The first electronic device receives a first operation of a user on the first option. In response to the received first operation, the first electronic device displays a first label operation block on the first application interface, and the first electronic device sends a first calling request to a second electronic device. The first calling request is used to request to call a first target function of the second electronic device. In addition, the first label operation block includes first label information, and the first label information is used to indicate that the first electronic device is calling the first target function of the second electronic device. Then, in the process of the first electronic device calling the first target function of the second electronic device, the first electronic device displays a first label option box in response to a received click operation on the first label operation block, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the first electronic device. In response to the received user click operation on the first calling option, the first electronic device updates the first label information to the second label information, and the first electronic device sends a second calling request to the second electronic device. Among them, the second call request is used to request to call the second target function of the second electronic device, the second tag information is used to indicate that the first electronic device is calling the second target function of the second electronic device, and the first call option belongs to at least one second electronic device call option. Subsequently, the first electronic device receives the first insertion object sent by the second electronic device, wherein the first insertion object is obtained by the second electronic device based on the second target function and sent to the first electronic device. The first electronic device replaces the first tag operation block with the first insertion object. In this way, the user of this application can call other electronic devices (such as the second electronic device) in the process of using the first application through simple operations, such as clicking on the first option. And by calling the specified function of another electronic device, the inserted content that meets the user's needs can be obtained. And, in the process of calling another electronic device, the user can perform corresponding operations on the inserted tag operation block at any time to change the specified function being called, so as to meet different needs in different scenarios.

[0005] In some instances, the first option may be Figure 4 Accordingly, the first target function may be a photo taking function of the second electronic device.

[0006] In some examples, the first electronic device may be a mobile phone, a tablet, a wearable device, a vehicle-mounted device, etc. The second electronic device may also be a mobile phone, a tablet, a wearable device, a vehicle-mounted device, etc.

[0007] In some examples, the inserted object may be a file such as a picture, text, or voice.

[0008] In a possible implementation, the first electronic device replaces the first label operation block with the first insertion object, including: the first electronic device cancels display of the first label operation block. The first electronic device inserts the first insertion object at the original display position of the first label operation block. In this way, the present application uses the first label operation block as a placeholder so that the insertion object can be inserted into the original display position of the label operation block.

[0009] In some instances, the length of the tag operation block is greater than the length of the tag information.

[0010] In some embodiments, the height of the tab bar is less than or equal to the row height.

[0011] In some examples, the original display position of the label operation block refers to the position corresponding to the left edge of the label operation block.

[0012] In a possible implementation, the first label operation block is displayed at the end of the input content. In this way, the first label operation block can be displayed at a default position, that is, at the end of the input content, so that the inserted object displayed subsequently is also displayed at the end of the input content.

[0013] In a possible implementation, the first label operation block is displayed at the position corresponding to the last editing operation on the input content. In this way, the first label operation block can be displayed at a default position, that is, the position corresponding to the last editing operation, so that the subsequently displayed inserted object is also displayed at this position.

[0014] In some instances, the position corresponding to the last editing operation may be the end of the input content.

[0015] In some examples, the position corresponding to the last editing operation may also be any position in the input content.

[0016] In one possible implementation, before the first electronic device receives a first operation on a first option of a first application interface, the method further includes: the first electronic device displays a cursor at the first position in response to receiving a second operation on the first position. The first electronic device displays a first label operation block at the first position of the first application interface, including: inserting the first label operation block at the cursor position. In this way, the user can move the cursor to indicate that the first label operation block is displayed at the cursor position, so that the label operation block is displayed at any user-specified position. Further, the inserted object can be displayed at the position where the label operation block is located, that is, the position specified by the user.

[0017] In some examples, the second operation may be a click operation of the user on the display interface using a finger or a stylus.

[0018] In some examples, the second operation may also be an operation of the user moving a cursor through a mouse or a keyboard.

[0019] In a possible implementation, the first application interface also includes a second option, and the method also includes: the first electronic device displays a second label operation block in the first application interface in response to the third operation received on the second option, and the first electronic device sends a third call request to the second electronic device, and the third call request is used to request to call the third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the first electronic device is calling the third target function of the second electronic device; in the process of the first electronic device calling the third target function of the second electronic device, the first electronic device responds to the received click operation on the second label operation block, and displays a second label option box; wherein the second label option box includes at least one second electronic device call option and at least one device option, and at least one device option is used to indicate at least one device that can be called by the first electronic device, and the at least one device includes the first electronic device. In this way, the electronic device in the present application can support calling one or more functions of another electronic device, and can call the corresponding function according to user needs. In addition, the label operation block can display corresponding prompt information to prompt the user of the function currently being called.

[0020] In a possible implementation, the second label option box also includes a temporary insertion option, and the temporary insertion option is used to indicate the suspension of calling the second electronic device; the method also includes: the first electronic device updates the second label information in response to the received click operation on the temporary insertion option, and the first electronic device sends a stop call request to the second electronic device, and the stop call request is used to indicate the stop of calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; the first electronic device displays the second label option box in response to the received click operation on the second label operation block. In this way, the present application also provides a temporary label insertion method, in which the user can temporarily insert a label to take up a place in the scenario where the user is not sure which object needs to be inserted, so that in the subsequent use process, the corresponding insertion object can be inserted at any time by operating the temporary label.

[0021] In a possible implementation, the method further includes: the first electronic device displays a third label option box in response to the fourth operation received on the first device option; wherein the third label option box includes at least one third electronic device call option and at least one device option, wherein the at least one third electronic device call option is used to indicate at least one function in the third electronic device that can be called by the first electronic device; the first electronic device receives a fifth operation received in response to the second call option, updates the third label information to the fourth label information, and the first electronic device sends a fourth call request to the third electronic device, the fourth call request is used to request to call the fourth target function of the third electronic device; wherein the fourth label information is used to indicate that the first electronic device is calling the fourth target function of the third electronic device, and the second call option belongs to at least one third electronic device call option; the first electronic device receives a second insertion object sent by the third electronic device, wherein the second insertion object is obtained by the third electronic device based on the fourth target function; the first electronic device replaces the second label operation block with the second insertion object. In this way, the user can select the specified option in the label option box at any time by operating the label operation block during use, so that the electronic device can call the specified function of other callable electronic devices, thereby providing a dynamic calling method, realizing the change of the called object and the corresponding function at any time according to different scenarios and different needs.

[0022] In a possible implementation, at least one function in the third electronic device that can be called by the first electronic device is completely or partially different from at least one function in the second electronic device that can be called by the first electronic device. For example, the second electronic device can provide functions such as document scanning and taking pictures, and the third electronic device can provide functions such as taking pictures and handwriting tablets. Different electronic devices can provide the same or different functions.

[0023] In a possible implementation, the third electronic device is the first electronic device. Thus, the calling method in the present application can also be applied to calling a specified function of the local device.

[0024] In a possible implementation, the first interface also includes a third option, and the method also includes: the first electronic device displays a third label operation block on the first application interface in response to the fifth operation received on the third option, and the third label operation block includes third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block. In this way, the present application also provides a temporary label insertion method, in which the user can temporarily insert a label to take up a place in a scenario where the user is not sure which object to insert, so that in the subsequent use process, the corresponding insertion object can be inserted at any time by operating the temporary label.

[0025] In a possible implementation, after the first electronic device displays the first label operation block on the first application interface in response to the first operation, the method further includes: the first electronic device receives a drag operation on the first label operation block; the first electronic device moves the first label operation block from a current position to another position along with the drag operation; the first electronic device replaces the first label operation block with a first insertion object, including: the first electronic device cancels displaying the first label operation block; the first electronic device inserts the first insertion object at another position. In this way, the user can drag the label operation block at any time according to the needs to change the insertion position of the label operation block, and accordingly, the insertion position of the subsequent insertion object will also change according to the user's needs.

[0026] In one possible implementation, after the first electronic device displays the first label operation block on the first application interface in response to the first operation, the method further includes: in the process of the first electronic device calling the first target function of the second electronic device, the first electronic device updates the input content in response to the received sixth operation. In this way, during the implementation of the calling method in the present application, that is, when the electronic device is calling another electronic device, the user can change the input content, that is, the content in the interface, at any time according to needs. Of course, in other embodiments, the user can also perform other operations on the interface, that is, when the electronic device is calling another electronic device, the interface of the application is not locked and can be changed at any time.

[0027] In a second aspect, the present application provides an electronic device. The electronic device includes: one or more processors, a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: displaying a first application interface, in which input content and a first option are displayed; receiving a first operation on the first option; in response to the first operation, displaying a first label operation block in the first application interface, and sending a first call request to a second electronic device, the first call request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the electronic device is calling the first target function of the second electronic device; in the process of calling the first target function of the second electronic device, in response to the received operation on the first label operation block A click operation is performed to display a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device; in response to the received click operation on the first calling option, the first label information is updated to the second label information, and a second calling request is sent to the second electronic device; the second calling request is used to request to call the second target function of the second electronic device, the second label information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first calling option belongs to at least one second electronic device calling option; a first insertion object is received from the second electronic device, wherein the first insertion object is obtained by the second electronic device based on the second target function; and the first label operation block is replaced with the first insertion object.

[0028] In a possible implementation, when the computer program is executed by one or more processors, the electronic device executes the following steps: canceling the display of the first label operation block; and inserting the first insertion object at the original display position of the first label operation block.

[0029] In a possible implementation, the first label operation block is displayed at the end of the input content.

[0030] In a possible implementation, the first label operation block is displayed at a position corresponding to the last editing operation on the input content.

[0031] In one possible implementation, before the electronic device receives a first operation on a first option of a first application interface, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to receiving a second operation on a first position, displaying a cursor at the first position; displaying a first label operation block at the first position of the first application interface, including: inserting the first label operation block at the cursor position.

[0032] In one possible implementation, the first application interface also includes a second option. When the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a third operation received on the second option, a second label operation block is displayed on the first application interface, and a third call request is sent to the second electronic device, the third call request is used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the electronic device is calling the third target function of the second electronic device; in the process of calling the third target function of the second electronic device, in response to a click operation received on the second label operation block, a second label option box is displayed; wherein the second label option box includes at least one second electronic device call option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes an electronic device.

[0033] In one possible implementation, the second label option box also includes a temporary insertion option, which is used to indicate a pause in calling the second electronic device; when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a click operation received on the temporary insertion option, the second label information is updated, and a stop call request is sent to the second electronic device, and the stop call request is used to indicate to stop calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; in response to a click operation received on the second label operation block, the second label option box is displayed.

[0034] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a fourth operation received on a first device option, display a third label option box; wherein the third label option box includes at least one third electronic device call option and at least one device option, wherein the at least one third electronic device call option is used to indicate at least one function in the third electronic device that can be called by the electronic device; receiving a fifth operation received in response to a second call option, updating the third label information to a fourth label information, and sending a fourth call request to the third electronic device, the fourth call request being used to request calling a fourth target function of the third electronic device; wherein the fourth label information is used to indicate that the electronic device is calling a fourth target function of the third electronic device, and the second call option belongs to at least one third electronic device call option; receiving a second insertion object sent by the third electronic device, wherein the second insertion object is obtained by the third electronic device based on the fourth target function; and replacing the second label operation block with the second insertion object.

[0035] In a possible implementation, at least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.

[0036] In a possible implementation manner, the third electronic device is an electronic device.

[0037] In one possible implementation, the first interface also includes a third option. When the computer program is executed by one or more processors, the electronic device performs the following steps: in response to receiving a fifth operation on the third option, displaying a third label operation block on the first application interface, the third label operation block including third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.

[0038] In one possible implementation, after the first electronic device displays the first label operation block on the first application interface in response to the first operation, when the computer program is executed by one or more processors, the electronic device performs the following steps: receiving a drag operation on the first label operation block; moving the first label operation block from a current position to another position along with the drag operation; canceling the display of the first label operation block; and inserting a first insertion object at another position.

[0039] In one possible implementation, the first electronic device responds to the first operation, and after the first label operation block is displayed on the first application interface, when the computer program is executed by one or more processors, the electronic device performs the following steps: in the process of calling the first target function of the second electronic device, in response to the received sixth operation, the input content is updated.

[0040] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0041] In a third aspect, the present application provides a communication system, the system comprising:

[0042] A first electronic device, for:

[0043] Displaying a first application interface, wherein the first application interface displays input content and a first option;

[0044] receiving a first operation on a first option;

[0045] In response to the first operation, a first label operation block is displayed on the first application interface, and a first call request is sent to the second electronic device, the first call request being used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the electronic device is calling the first target function of the second electronic device.

[0046] A second electronic device, for:

[0047] receiving a first call request;

[0048] Based on the first calling request, the first target function is started, and a second application interface corresponding to the first target function is displayed; the second application interface includes at least one object to be inserted obtained by the second electronic device by calling the first target function.

[0049] The first electronic device is also used for:

[0050] In the process of calling the first target function of the second electronic device, in response to receiving a click operation on the first label operation block, displaying a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device;

[0051] In response to a received click operation on a first call option, the first tag information is updated to second tag information, and a second call request is sent to a second electronic device; the second call request is used to request to call a second target function of the second electronic device, and the second tag information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first call option belongs to at least one second electronic device call option.

[0052] The second electronic device is further used for:

[0053] receiving a second call request;

[0054] Based on the second calling request, the calling of the first target function is stopped, the second target function is started, and a third application interface corresponding to the second target function is displayed; the third application interface includes at least one object to be inserted obtained by the second electronic device by calling the second target function;

[0055] In response to the received confirmation operation, the first insertion object is sent to the first electronic device.

[0056] The first electronic device is also used for:

[0057] receiving a first insertion object sent by a second electronic device;

[0058] Replace the first tag operation block with the first insertion object.

[0059] In a possible implementation manner, the first electronic device is specifically configured to:

[0060] Cancel display of the first label operation block;

[0061] A first insertion object is inserted at the original display position of the first tab operation block.

[0062] In a possible implementation, the first label operation block is displayed at the end of the input content.

[0063] In a possible implementation, the first label operation block is displayed at a position corresponding to the last editing operation on the input content.

[0064] In a possible implementation manner, the first electronic device is further configured to:

[0065] In response to receiving a second operation on the first position, displaying a cursor at the first position; displaying a first label operation block at the first position of the first application interface includes: inserting the first label operation block at the position of the cursor.

[0066] In a possible implementation, the first application interface further includes a second option, and the first electronic device is further configured to:

[0067] In response to the received third operation on the second option, displaying a second label operation block on the first application interface, and sending a third call request to the second electronic device, the third call request being used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the electronic device is calling the third target function of the second electronic device;

[0068] A second electronic device, for:

[0069] receiving a third call request;

[0070] Based on the third calling request, the third target function is started, and a third application interface corresponding to the third target function is displayed; the third application interface includes at least one object to be inserted obtained by the second electronic device by calling the third target function.

[0071] The first electronic device is also used for:

[0072] In the process of calling the third target function of the second electronic device, in response to receiving a click operation on the second label operation block, a second label option box is displayed; wherein the second label option box includes at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes an electronic device.

[0073] In a possible implementation, the second label option box further includes a temporary insertion option, and the temporary insertion option is used to indicate to suspend calling the second electronic device; the first electronic device is further used to:

[0074] In response to a received click operation on a temporarily inserted option, the second tag information is updated, and a stop calling request is sent to the second electronic device, the stop calling request being used to instruct to stop calling the second electronic device; wherein the updated second tag information is used to indicate that the second tag operation block is a temporarily inserted tag operation block.

[0075] The second electronic device is further used for:

[0076] receiving a stop call request;

[0077] Based on the stop call request, stop calling the third target function;

[0078] Display the desktop or the most recently displayed application interface;

[0079] The first electronic device is also used for:

[0080] In response to receiving a click operation on the second label operation block, a second label option box is displayed.

[0081] In a possible implementation manner, the first electronic device is further configured to:

[0082] In response to the received fourth operation on the first device option, a third label option box is displayed; wherein the third label option box includes at least one third electronic device calling option and at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the electronic device; receiving a fifth operation in response to the received second calling option, updating the third label information to fourth label information, and sending a fourth calling request to the third electronic device, the fourth calling request is used to request to call a fourth target function of the third electronic device; wherein the fourth label information is used to indicate that the electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option;

[0083] A third electronic device, for:

[0084] receiving a fourth call request;

[0085] Based on the fourth call request, a fourth target function is started, and a fourth application interface corresponding to the fourth target function is displayed; the fourth application interface includes at least one object to be inserted obtained by the third electronic device by calling the fourth target function;

[0086] In response to the received confirmation operation, a second insertion object is sent to the first electronic device.

[0087] The first electronic device is also used for:

[0088] receiving a second insertion object sent by a third electronic device;

[0089] Replace the second label operation block with the second insertion object.

[0090] In a possible implementation, at least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.

[0091] In a possible implementation manner, the third electronic device is the first electronic device.

[0092] In a possible implementation, the first interface further includes a third option, and the first electronic device is further configured to:

[0093] In response to the received fifth operation on the third option, a third label operation block is displayed on the first application interface, the third label operation block includes third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.

[0094] In a possible implementation manner, the first electronic device is further configured to:

[0095] Receive a drag operation on a first label operation block; move the first label operation block from a current position to another position along with the drag operation; cancel display of the first label operation block; and insert a first insertion object at another position.

[0096] In a possible implementation manner, the first electronic device is further configured to:

[0097] In the process of calling the first target function of the second electronic device, the input content is updated in response to the received sixth operation.

[0098] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0099] In a fourth aspect, an embodiment of the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0100] In a fifth aspect, an embodiment of the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0101] In a sixth aspect, an embodiment of the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive a signal, and to control the sending pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0102] Figure 1 is a schematic diagram of the hardware structure of an electronic device shown as an example;

[0103] Figure 2 is a schematic structural diagram of a camera of an electronic device shown as an example;

[0104] Figure 3 A schematic diagram of the software structure of an electronic device is shown as an example;

[0105] Figure 4 is a schematic diagram of an exemplary user interface;

[0106] Figure 5 A schematic diagram of a process for establishing a communication connection for an exemplarily illustrated electronic device;

[0107] Figure 6 A schematic diagram of a process for establishing a communication connection for an exemplarily illustrated electronic device;

[0108] Figure 7a to Figure 7c A schematic diagram of an exemplary user interface;

[0109] Figure 8a to Figure 8c A schematic diagram of an exemplary user interface;

[0110] Figure 9a to Figure 9d A schematic diagram of an exemplary user interface;

[0111] Fig.10a and Fig.10b A schematic diagram of an exemplary user interface;

[0112] Fig.11a and Fig.11bA schematic diagram of an exemplary user interface;

[0113] Figure 12a to Figure 12c A schematic diagram of an exemplary user interface;

[0114] Figure 13a to Figure 13c A schematic diagram of an exemplary user interface;

[0115] Figure 14a to Figure 14e A schematic diagram of an exemplary user interface;

[0116] Fig.15a This is a schematic diagram of a scenario in which a tablet computer calls a camera function of a mobile phone;

[0117] Fig.15b This is a schematic diagram of a scenario in which a notebook computer calls a camera function of a mobile phone;

[0118] Fig.16 Schematic diagram of the structure of the device shown as an example. DETAILED DESCRIPTION

[0119] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0120] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0121] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0122] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0123] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0124] Figure 11 shows a schematic diagram of the structure of the electronic device 100. It should be understood that Figure 1 The illustrated electronic device 100 is merely one example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different configuration of components. Figure 1 The various components shown in the can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits. Figure 1 The electronic device 100 shown may be a mobile phone, a tablet, a wearable device, a computer, a vehicle-mounted device, a smart home device, or other electronic device, and this application does not limit this.

[0125] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0126] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0127] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0128] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0129] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0130] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0131] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0132] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0133] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0134] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0135] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0136] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0137] Exemplarily, the camera 193 may be located at the edge area of ​​the electronic device, may be an under-screen camera, or may be a liftable camera. The camera 193 may include a rear camera and may also include a front camera. The specific position and form of the camera 193 are not limited in the embodiment of the present application. The electronic device 100 may include cameras of one or more focal lengths. For example, cameras of different focal lengths may include a telephoto camera, a wide-angle camera, an ultra-wide-angle camera, or a panoramic camera.

[0138] like Figure 2 FIG. 1 is a schematic diagram showing the position of the camera 193 on a mobile phone when the electronic device 100 is a mobile phone. Figure 2 (1), exemplarily, a front camera is provided on the upper part (near the top edge area) of the display screen of the mobile phone, and the front camera may be one or more. In the embodiment of the present application, the mobile phone includes two front cameras. It should be noted that, Figure 2 The layout of the cameras shown in (1) (such as horizontal arrangement and spacing) is only an illustrative example and is not limited in this application. Figure 2 (2), illustratively, the back of the mobile phone (i.e., the side opposite to the display screen) is provided with one or more rear cameras, for example, Figure 2 The rear camera of the mobile phone in (2) includes five cameras, which can be regarded as a rear camera module or five separate cameras. The five cameras may include but are not limited to: a wide-angle camera, an ultra-wide-angle camera, a panoramic camera, etc., which are not limited in this application.

[0139] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0140] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0141] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0142] Figure 3 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0143] The layered architecture of the electronic device 100 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system includes, from top to bottom, but is not limited to: an application layer, an application framework layer, and a kernel layer.

[0144] The application layer can include a series of application packages.

[0145] like Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, tag, memo, etc. The present application embodiment takes memo as an example for illustration. In other embodiments, the calling method in the present application embodiment can also be applied to any application that provides note-taking (including but not limited to text notes and audio notes, etc.) functions. Optionally, the calling method in the present application embodiment can also be applied to other types of application software, such as drawing, mind mapping, etc., which are not limited in the present application.

[0146] In an embodiment of the present application, a memo (or other third-party note-taking application) can call a tag application to implement the calling method in an embodiment of the present application.

[0147] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0148] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0149] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, Wi-Fi driver, etc.

[0150] Understandably, Figure 3The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0151] Figure 4 Schematic diagram of an exemplary user interface. In the embodiments of the present application, the user uses a memo application as an example for explanation. In other embodiments, the calling method in the embodiments of the present application can also be applied to other applications, such as office applications, or other third-party application software that can provide editing functions, and its implementation method is the same as the memo application exemplified in the embodiments of the present application, and this application will not illustrate them one by one. Of course, in some instances, the calling method in the embodiments of the present application can also be applied to non-note-taking application software, such as drawing software, etc., and this application does not limit it.

[0152] Please refer to Figure 4 (1), the memo application display interface 401 includes but is not limited to: a note content display window and an option control 402, etc. Among them, the note content display window can be used to display the note content, and the note content is not limited to: text content, picture content, voice content, etc., which is not limited in this application.

[0153] Exemplarily, the option control 402 includes multiple option controls, including but not limited to: list options, style options, add option 4021, recording options, and handwriting options. The number and layout of the option controls 402 on the memo application display interface 401 are only illustrative examples. In other embodiments, the option control 402 may include more or fewer option controls, which is not limited in this application.

[0154] Still refer to Figure 4 (1), the user clicks on the add option 4021. In response to the received user operation, the mobile phone (specifically the memo application) calls the label application (hereinafter referred to as the execution subject is the mobile phone, which can actually be the label application, and will not be repeated below) and displays the option display area 403. Please refer to Figure 4 (2), the mobile phone displays the next level of options for adding controls in the option display area 403, including but not limited to: "Select from Gallery" option, "Photo" option, "Document Scan" option, "Card Collection" option, "Table" option, "From PAD" option 4022 and "From Magicbook" option, etc.

[0155] Among them, the "Select from Gallery" option is used to instruct to select a picture from the local gallery and insert it into the current note.

[0156] The "Take Photo" option is used to call the local camera to take a photo and insert the photo into the current note.

[0157] The "Document Scan" option is used to instruct the camera of the local computer to scan a document and insert the scan result into the current note. The scan result may be the result of converting an image (specifically, the text in the image) into text.

[0158] The "Card Collection" option is used to call the local camera to scan the document and insert the scan result into the current note.

[0159] The "Table" option is used to indicate inserting a table.

[0160] The “from PAD” option 4031 and the “from Magicbook” option are used to indicate calling another electronic device (eg, a tablet or a notebook).

[0161] Please refer to Figure 4 (2), assuming that in this example, the user needs to use a nearby tablet to take a photo. The user can click the "From PAD" option 4031. Please refer to Figure 4 (3), in response to the received user operation, the mobile phone displays the next level options of the "From PAD" option 4031 in the option display area 403, including but not limited to: "Select from Gallery" option, "Take Photo" option 4032, "Document Scan" option, etc.

[0162] Among them, the "Select from Gallery" option is used to instruct to select a picture from the gallery of another electronic device (such as a tablet) and insert it into the current note.

[0163] The "Take a photo" option 4032 is used to instruct to call the tablet's camera to take a photo and insert the photo into the current note.

[0164] The "Document Scan" option is used to instruct to use the tablet's camera to scan a document and insert the scan result into the current note. The scan result may be the result of converting a picture (specifically, the text in the picture) into text.

[0165] In the embodiments of this application, only the "Select from Gallery" option, "Photograph" option, and "Document Scan" option are used as examples for explanation. In other embodiments, more options can be set according to actual needs, for example, a "Voice" option can be set to call the microphone of this device or another electronic device and insert the audio collected by the microphone into the current note. The implementation methods can all refer to the calling method in the embodiments of this application, and this application will not give examples one by one.

[0166] Figure 4 The following is the user interface. Figure 5and Figure 6 The communication interaction between the mobile phone and the tablet (ie, PAD) in response to the received user operation is described. Specifically, Figure 5 A schematic diagram of a process for establishing a communication connection for an exemplary electronic device. Figure 5 , including but not limited to the following steps:

[0167] S501, the mobile phone sends a Discovery Request message to the tablet.

[0168] Exemplarily, in response to receiving an operation in which the user clicks on the add option 4021, the mobile phone (specifically, it can be a tag application) registers with the Nearby service, wherein the application's registration with the Nearby service can be understood as the application expects the Nearby service to provide corresponding services to the application during the use of the application. For example, as described above, the use of the tag application requires turning on the WLAN function and the Bluetooth function, which can also be understood as the business capabilities supported by the tag application include the WLAN function and the Bluetooth function. The tag application can register with the Nearby service and request to call the WLAN function and the Bluetooth function during its use.

[0169] Exemplarily, the Nearby service performs a scanning phase. Optionally, the Nearby service may call an underlying module or chip. For example, the Nearby service may call a D2D service so that the D2D service initiates a Bluetooth connection establishment process. Optionally, the D2D service may further call a D2D driver so that the D2D driver controls the Bluetooth chip to broadcast a Discovery Request message in real time or periodically.

[0170] It should be noted that in the embodiments of the present application, Bluetooth communication between devices, such as Bluetooth communication between a tablet and a mobile phone, can be maintained through Bluetooth Low Energy (BLE) or classic Bluetooth, which is not limited in the present application.

[0171] Exemplarily, the Discovery Request message carries device information of the mobile phone. Optionally, the device information includes, but is not limited to: identification information of the mobile phone (eg, device name, device model, Bluetooth address information, etc.), etc., which is not limited in this application.

[0172] S502, the tablet sends a Discovery Response message to the mobile phone.

[0173] Exemplarily, all devices with Bluetooth turned on near the mobile phone can receive the DiscoveryRequest message sent by the mobile phone. In an embodiment of the present application, among the electronic devices that receive the Discovery Request sent by the mobile phone, the electronic device that has the tag application installed and has the same user account (such as Honor account) as the mobile phone can send a DiscoveryResponse message to the mobile phone based on the Bluetooth protocol and the Bluetooth address information of the mobile phone obtained from the Discovery Request message to indicate that a Bluetooth connection is established with the mobile phone.

[0174] For example, there are multiple devices near the mobile phone, including a tablet (PAD), a notebook (Magicbook) and a smart bracelet. Among them, the tablet, notebook and smart bracelet can all receive the Discovery Request sent by the mobile phone. The tablet and notebook are installed with the tag application and have been pre-registered with the Nearby service. Correspondingly, the tablet and notebook obtain the Bluetooth address information of the mobile phone from the DiscoveryRequest message, and send a Discovery Response message to the mobile phone to indicate that a Bluetooth connection is established with the mobile phone. The smart bracelet does not have the tag application installed. Even if it receives the Discovery Request message, it will not reply to the Discovery Response message to the mobile phone. It can also be understood that the smart bracelet will not respond to the detection of the tag application on the mobile phone side.

[0175] Optionally, the Discovery Response message sent by the tablet carries device information of the tablet, and the device information includes but is not limited to: Bluetooth address information of the tablet, identification information of the tablet (such as device name, device model, etc.), etc., which is not limited in this application.

[0176] It should be noted that Figure 5 The interaction between a mobile phone and a tablet is only used for illustration, and in actual use scenarios, more devices may be included. For example, in the embodiment of the present application, a notebook near the mobile phone will also reply a Discovery Response message to the mobile phone.

[0177] The mobile phone receives the Discovery Response message from the tablet and notebook, and can obtain information such as the device name from the DiscoveryResponse message. Taking the tablet as an example, the device name obtained by the mobile phone is "PAD". Figure 4As shown in (2), the mobile phone displays the "From PAD" option in the option display area 403, which can be understood as the tag application searching for the PAD near the mobile phone through the Bluetooth of the mobile phone (or other wireless transmission modules), and the PAD can be called. The device described in the embodiment of the present application being called by another device means that the device has a wireless transmission function, has the same account as the other device, and is set with a tag application.

[0178] S503: The mobile phone sends a Bluetooth connection request message to the tablet.

[0179] For example, Figure 4 As shown in (2), when the mobile phone receives the user clicking the "From PAD" option, it can determine that a wireless connection needs to be established with the PAD to exchange data. Correspondingly, the mobile phone can send a Bluetooth connection request message to the tablet based on the Bluetooth address information of the tablet carried in the Discovery Response message to indicate the establishment of a Bluetooth connection with the tablet. Optionally, the connection request message carries information such as the Bluetooth address information of the tablet and the Bluetooth address information of the tablet, which is not limited in this application.

[0180] S504, the tablet establishes a Bluetooth connection with the mobile phone.

[0181] Exemplarily, after receiving the Bluetooth connection request message sent by the mobile phone, the tablet establishes a Bluetooth connection with the mobile phone.

[0182] It should be noted that in S504, the mobile phone and the tablet can perform multiple Bluetooth signaling interactions to transmit the information required to establish a Bluetooth connection. The specific interaction process can refer to the content in the Bluetooth protocol, and this application will not repeat it.

[0183] S505, the mobile phone and the tablet establish a Wi-Fi connection.

[0184] Exemplarily, after the mobile phone and the tablet establish a Bluetooth connection, the mobile phone and the tablet can exchange data based on the Bluetooth connection. Exemplarily, in an embodiment of the present application, the mobile phone and the tablet can exchange Wi-Fi connection establishment information through the Bluetooth connection, and accordingly, the mobile phone and the tablet can establish a Wi-Fi connection with the other end based on the acquired Wi-Fi connection establishment information. The establishment method of the Wi-Fi connection can refer to the existing technical embodiments, and this application does not limit it.

[0185] For example, Figure 6As shown, the mobile phone establishes a Wi-Fi connection with the tablet, and data can be exchanged based on the Wi-Fi connection. Optionally, in an embodiment of the present application, the tablet's tag application can send the tag functions that the tablet can provide to the mobile phone via the Wi-Fi connection, such as but not limited to: gallery function, camera function and document scanning function. Accordingly, the mobile phone obtains that the PAD can provide gallery function, camera function and document scanning function, which can also be understood as the mobile phone can call the PAD's gallery, camera and document scanning functions. Figure 4 As shown in (3), the mobile phone can display option controls corresponding to the callable functions in the option display area 403, for example, including but not limited to: "Select from Gallery" option, "Take Photo" option and "Document Scan" option.

[0186] Still refer to Figure 4 (3) In this example, the user uses a mobile phone to take notes and then uses the tablet's camera function to take a photo. For example, the user clicks the "take photo" option to indicate that the tablet's camera function is used to take a photo.

[0187] Figure 7a to Figure 7c is a schematic diagram of an exemplary user interface. Figure 7a , the mobile phone responds to the received user operation, cancels the display option display area 403, and displays the label 601 at the current cursor position (assuming that the current cursor position is at the end of the text content). It should be noted that the cursor may be displayed at the end of the text content, or it may be hidden, which is not limited in this application. It should be further noted that the memo is used as an example in the embodiment of the present application for explanation, and the insertion position of the text or other content in the software is based on the cursor. As described above, the method in the embodiment of the present application may also be applied to some other types of software, such as drawing or mind mapping software, which may not have a cursor. In this case, the insertion position of the text or other content (such as the label in the embodiment of the present application) can be set according to the user operation (such as a click operation), which is not limited in this application.

[0188] Exemplarily, the label 601 includes but is not limited to: a calling object 6011 (which may also be referred to as a first inserted object or an added object, etc., which is not limited in this application) and more options 6012. Among them, the calling object 6011 is used to describe the electronic device currently being called and the function being called. For example, in the current scenario, the mobile phone responds to the user clicking the "take a photo" option, and determines that the electronic device being called is a tablet, and the function being called is the tablet's photo function. Correspondingly, the calling object 6011 in the label 601 displayed by the mobile phone shows "Taking photo using "PAD"", which is used to indicate that the mobile phone is calling the tablet's photo function.

[0189] More options 6012 may provide more label functions, and the user may switch the electronic device to be called and / or the function to be called through more options 6012, which will be further described in detail in the following embodiments.

[0190] Exemplarily, the positional relationship between the calling object 6011 and the more options 6012 in the label 601 is only a schematic example and can be set according to actual needs, and this application does not limit it.

[0191] Exemplarily, the style of label 601 is a schematic example and can be set according to actual needs, and this application does not limit it.

[0192] Exemplarily, the height of label 601 may be the same as or different from the height of the text line in the note, and may be set according to actual needs, and this application does not limit it.

[0193] Optionally, the user can set the style of the label (including size, color, border shape, etc.) in the label application, which is not limited in this application.

[0194] Optionally, the label 601 may be highlighted to highlight the location of the label.

[0195] Optionally, the label 601 may be set to be a surrounding type, a tight type, or a surrounding type. The type of the label 601 may be a default type or may be set by the user in the label application, which is not limited in this application.

[0196] Still refer to Figure 7a , the mobile phone should determine that it needs to call the tablet's camera function based on the received user operation. The mobile phone can send a camera call request to the tablet through the Wi-Fi connection between the tablet and the tablet to request to call the tablet's camera. The tablet (specifically the label application in the tablet) responds to the received camera call request and starts the local camera to capture images. The photo preview interface is displayed in the display interface 701 of the tablet. The photo preview interface includes but is not limited to: a photo preview window and a photo button 702 (or photo control). Among them, the photo preview window is used to display the image captured by the camera in real time. The position and size of the photo preview window can be set according to actual needs, and this application does not limit it.

[0197] For example, the user can click the photo button 702 to instruct the tablet to take a photo. Figure 7b In response to the received user operation, the tablet displays content in the display interface 701 including but not limited to: an image 703 (also called a preview image, which is not limited in this application) captured by the camera, a confirmation option 704, and a cancel option 705. In one example, if the user clicks the cancel option 705, the tablet returns to Figure 7aThe photo preview interface shown is to call the camera again to collect the current image. In this example, the user can click the confirmation option 704 to confirm inserting (or adding) the image 703 into the memo application.

[0198] Please refer to Figure 7c In response to the received user clicking confirmation option 704, the tablet sends an image 703 to the mobile phone through the Wi-Fi connection between the mobile phone. Optionally, after sending the image 703, the tablet displays a desktop 706. In other embodiments, after sending the image 703, the tablet may also display an interface displayed before executing the photo-taking action, such as displaying a video application, etc., which is not limited in this application.

[0199] Exemplarily, the label application of the mobile phone receives the image 703 sent by the tablet. The label application can transmit the image 703 to the memo application. The memo application can delete the label 601 and insert the image 703 at the position of the original label 601. Optionally, the insertion position of the image 703 can be based on the position of the left border of the original label 601. In other embodiments, the insertion position of the image 703 can also be the right border or center position of the original label 601, which is not limited in this application.

[0200] It should be noted that if Figure 7c As shown, there is an offset between the origin of image 703 (e.g., the upper left corner of image 703) and the position of original label 601, because the memo application adjusts the insertion position of image 703 according to the size of image 703 to fully display image 703. It can be understood that in this scenario, the insertion position of image 703 can still be considered as the position of original label 601.

[0201] Optionally, the memo application can resize image 703 before inserting it into the note. The specific adjustment strategy can be set according to actual needs and is not limited in this application.

[0202] In one possible implementation, the Wi-Fi connection between the phone and the tablet can continue to be maintained and automatically disconnected after the aging time (which can be set according to actual needs and is not limited in this application) exceeds. In this example, within the aging time, if the user executes Figure 4 If the mobile phone calls the tablet to take photos and other functions again, you can skip the process Figure 5 The connection establishment process shown is to directly perform data interaction based on the current Wi-Fi connection that has not been disconnected.

[0203] In another possible implementation, after the tablet transmits the image 703 to the mobile phone, the tablet may disconnect the Wi-Fi connection with the mobile phone. Figure 4In order to call the tablet to take photos and other functions, the mobile phone and tablet will re-execute Figure 5 The connection establishment process in .

[0204] In this way, a convenient calling method can be provided in the embodiment of the present application, which can determine the position of the object to be inserted by inserting a tag. Moreover, the object to be inserted can be selected by the tag. Furthermore, by inserting a tag, the operation steps when inserting the first object can be effectively simplified, the operation time can be shortened, and the user can be prevented from missing important content due to the first insertion of the object.

[0205] The calling method in the embodiment of the present application can also perform other operations on the application interface to be inserted during the execution of the first insertion object, such as modifying or deleting the note content, adjusting the size or position of the inserted image, etc., which is not limited in the present application.

[0206] The following takes the modification of text content in the process of inserting the first object as an example for explanation. Figure 8a to Figure 8c is a schematic diagram of an exemplary user interface. Figure 8a , the mobile phone calls the tablet's camera function, and the tablet's camera is capturing images, that is, the tablet currently displays the photo preview interface, and the photo preview interface is displaying the image captured by the camera in real time. In this scenario, the user can click anywhere on the memo application interface 401. In response to the received user operation, the mobile phone displays the soft keyboard 802. For example, the user can click the position where the text is to be inserted to move the cursor 801 to the position where the text is to be inserted. For example, Figure 8a For example, after the mobile phone inserts the label 601, the position of the cursor 801 is after the label 601 (that is, after the right frame of the label 601). The user can click the position after the last word in the note. In response to the received user operation, the mobile phone displays the soft keyboard 802 and displays the cursor 801 at the position clicked by the user (for example, the first position) to indicate that the subsequently input text or pictures will be inserted at this position. Among them, the position of the cursor 801 is only an illustrative example, and the user can move the cursor to any position. Optionally, in some instances, the cursor 801 can be hidden and displayed only after the user clicks the interface, in response to the received user operation, the cursor is displayed at the corresponding position, which is not limited in this application.

[0207] Please refer to Figure 8b After the user inputs text, the cursor 801 moves to the currently displayed position. Correspondingly, the label 601 moves backward as the text is input. Figure 8a The first position displayed moves to Figure 8b During this process, the camera of the tablet continues to collect images. Optionally, the images collected by the tablet may be changing, which is not limited in this application.

[0208] For example, the user performs operations such as taking a photo and confirming an image, such as Figure 7a and Figure 7b After the tablet transmits the image to the mobile phone via Wi-Fi connection, the tablet displays the desktop 706. For details, please refer to Figure 7c , I will not go into details here.

[0209] Please refer to Figure 8c , the mobile phone receives the image 703 sent by the tablet, deletes the label 601 (which can also be understood as canceling the display of the label 601), and places the label 601 at the position of the original label 601 (i.e. Figure 8b The second position shown in FIG. 7 shows the image 703. That is, in the embodiment of the present application, the insertion position of the image will move with the position of the label. For example, Figure 8c The position of image 703 in Figure 7c The position of image 703 in is moved down one line.

[0210] It should be noted that the above embodiment is only used as an example of a user modifying the content of a note in real time during the process of capturing an image with a tablet camera. In the embodiment of the present application, the user can modify the content of the note in real time at any step of the call method execution. For example, Figure 7b In the scenario shown, i.e., when the user clicks the photo option and the tablet displays the preview image, the user can also modify the note content. In other words, at any time before the user clicks the confirmation option 704, i.e., before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted image, the user can modify the note content on the mobile phone side.

[0211] In this way, the calling method provided in the embodiment of the present application can also provide a real-time modification solution, so that the user can modify the content of the to-be-inserted interface at any time during the first insertion of the object, that is, the process of calling other devices. In other words, the process of the mobile phone calling other devices will not affect the user's use of other functions of the current application.

[0212] Exemplarily, the label in the embodiment of the present application can also provide more functional options. Figure 9a to Figure 9d is a schematic diagram of an exemplary user interface. Figure 9a , the user can click on more options 6012 in the label 601 to change the first inserted object, including changing the called electronic device and / or changing the called function. Figure 9bExemplarily, in response to receiving an operation in which the user clicks on more options 6012, the mobile phone displays a label option box 901. The label option box 901 includes, but is not limited to, option box 9011 and option box 9012. Among them, option box 9011 includes options corresponding to the callable functions provided by the device currently being called, such as a tablet. Exemplarily, as described above, after the mobile phone establishes a Wi-Fi connection with the tablet, the mobile phone can obtain the callable functions provided by the tablet's label application, such as, but not limited to, camera functions, document scanning functions, and gallery functions. Accordingly, option box 9011 may include, but is not limited to, options corresponding to the corresponding functions provided by the tablet, such as a camera option, a document scanning option, and a selection option from the gallery. In other words, the options it contains are similar to Figure 4 It is the same as in (3) of the present invention, and it can be understood that in the present embodiment, the user can Figure 4 (2) and Figure 4 (3) initially selects the first inserted object (including the called electronic device and / or the called function), after inserting the tag and before the first inserted object, the user can also change the first inserted object through more options 6012.

[0213] Exemplarily, option box 9012 includes but is not limited to options corresponding to other callable devices. For example, the "local" option and the "from Magicbook" option. Optionally, option box 9012 may also include a cancel insertion option, etc. Among them, the "local" option is used to switch the calling device. For example, if the user clicks on the local option, the mobile phone will call the corresponding function of the local device. The specific example will be described below. The "from Magicbook" option is also used to switch the calling device. For example, if the user clicks on this option, the label option box 901 will display the options corresponding to the callable functions that can be provided by the notebook (i.e., Magicbook). The user can delete label 601 by clicking on "Cancel Insert Option". The user can also delete label 601 in other ways. For example, the user clicks on the right side of label 601 to bring up the soft keyboard (such as Figure 8b 802), click the delete control on the soft keyboard, and the mobile phone can delete the label 601 in response to the user's above operation.

[0214] It should be noted that in this example, the mobile phone currently calls the tablet, that is, when the tag is initially inserted, that is, Figure 4 In the scenario shown, the user chooses to call the tablet's camera function. Correspondingly, the option box 9011 will display more functions that the tablet can provide, such as document scanning and other functions. Assuming that the initial insertion tag is Figure 4In the scene shown, the user chooses to call the camera function of the notebook (i.e. Magicbook). Correspondingly, the option box 9011 will display more functions that can be called that Magicbook can provide.

[0215] In this example, the user clicks on the document scanning option in the "From PAD" option in the option box 9011, that is, the user instructs to call the document scanning function of the tablet. It can also be understood that the user instructs to switch the camera function of the currently called tablet to the document scanning function. Please refer to Fig.9c In response to receiving the user's click on the "Document Scan" option, the mobile phone updates the calling object 6011 in the label 601 to "Document Scanning Using "PAD"", to indicate that the currently called device is a tablet, and the called function is the document scanning function of the tablet.

[0216] Exemplarily, the mobile phone sends a document scanning function call request to the tablet to request to call the document scanning function of the tablet. In response to the received document scanning function call request, the tablet cancels the photo taking function, that is, cancels the display of the photo taking preview interface. The tablet continues to call the camera to perform the document scanning function, and the tablet displays the document scanning result in the display interface 902.

[0217] In one possible implementation, the document scanning function provided by the tablet is used to identify the document and its boundaries in the image captured by the camera, and based on the identified boundaries, the image captured by the camera is cropped to obtain an image 903 (referred to as the document image) containing only the document content. Accordingly, the tablet sends the identified document image 903 to the mobile phone. The mobile phone displays the document image 903 in the display interface 902. For specific display methods, please refer to Figure 7c , I will not go into details here. It should be noted that Fig.9c The document scanning results displayed on the tablet are only illustrative examples and are not limited in this application.

[0218] In a possible implementation, the mobile phone can also call the text recognition function of the tablet. The text recognition function provided by the tablet is used to obtain a picture scanned by a camera and recognize the text in the picture (such as optical character recognition (OCR)) to obtain a recognition result and convert the text in the picture into text.

[0219] Exemplarily, the display interface 902 of the tablet may also display a cancel option and a confirmation option. In one example, if the user clicks the cancel option, the tablet re-scans the document, obtains and displays a new document scan result. In this example, the user can click the confirmation option to confirm the insertion of the document scan result obtained by the tablet into the memo application of the mobile phone. In response to the received user operation, the tablet sends the document scan result to the mobile phone via the Wi-Fi connection. In addition, the tablet displays the desktop (the description can be referred to above and will not be repeated here).

[0220] Exemplarily, in response to the received document result, the mobile phone deletes the label 601 and displays the received document scan result at the position of the original label 601. For specific display methods, please refer to Figure 7c Optionally, the memo can directly insert the document scan result at the position of the original label 601. In other embodiments, the memo can insert the document scan result one line above and below the position of the original label 601. This can be set according to actual needs and is not limited in this application.

[0221] Please refer to Figure 9d In this example, the user Figure 9b In response to the user clicking the "Select from Gallery" option, the mobile phone switches the calling object 6011 in the label 601 to "Selecting from "PAD" Gallery", indicating that the currently called device is a tablet, and the called function is the tablet's gallery.

[0222] Exemplarily, the mobile phone sends a request to call the tablet to call the tablet's gallery. The tablet responds to the received request to call the gallery and cancels the photo function (i.e. Figure 9b The operation being executed in the image library is displayed in the display interface 902, and the image library application interface is displayed in the display interface 902. The image library application interface includes but is not limited to at least one picture saved in the tablet (or possibly in the cloud).

[0223] For example, the user can click on the picture to be inserted. In response to the received user operation, the tablet can display the picture confirmation interface. The interface display method can refer to Figure 7b , that is, the interface includes but is not limited to: pictures, cancel options and confirmation options, etc.

[0224] In this example, the user clicks the confirmation option to confirm the insertion of the picture selected by the user. In response to receiving the user's operation of clicking the confirmation option, the tablet sends the picture to the mobile phone. In addition, the tablet displays the desktop (the description can be referred to above and will not be repeated here).

[0225] It should be noted that in Figure 9d On the tablet interface in , users can also select multiple pictures at a time and insert multiple pictures into the phone.

[0226] Exemplarily, in response to the received picture, the mobile phone deletes the label 601 (ie, cancels the display of the label 601), and displays the received picture at the position of the original label 601. For specific display methods, please refer to Figure 7c , I will not go into details here.

[0227] It should be noted that the first insertion object modification scheme in the above embodiments is based on Figure 9b The explanation is based on the example that the tablet camera is in the process of collecting images, and the mobile phone responds to the received user operation to change the called function. In other embodiments, the user confirms the insertion of the picture or text on the tablet, for example, at any time before clicking the confirmation option, that is, before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted picture, the above-mentioned first insertion object change scheme can be executed, and its implementation method is the same as above, and this application will not illustrate it one by one.

[0228] The calling method in the embodiment of the present application also supports the position change of the label, so that the label and the subsequently inserted objects (including but not limited to text, pictures, etc.) are moved to the specified position according to the user's instructions. Fig.10a and Fig.10b is a schematic diagram of an exemplary user interface. Fig.10a (1), the mobile phone currently calls the tablet's camera function, and the tablet's display interface 701 displays a camera preview interface. For a detailed description, please refer to Figure 7b , which will not be described in detail here. For example, the user can long press (or other gestures, which are not limited in this application) label 601 and drag label 601. Please refer to Fig.10a (2), the mobile phone responds to the received long press operation of the user and determines that the user needs to drag the label 601. Then, in response to the received drag operation, the mobile phone moves the label 601 on the interface 401 to follow the user's finger, for example, to Fig.10a The third position shown in (2) (this position is only an illustrative example and is not limited in this application). Exemplarily, while the user is dragging the tag 601, the photo preview interface continues to be displayed in the display interface 701 of the tablet, and the photo preview interface displays the image captured by the camera of the tablet in real time. In other words, while the user is moving the position of the tag 601, the mobile phone keeps calling the tablet's photo function.

[0229] Optionally, during the movement of the tag 601, the note content in the memo interface 401 may change the position of the note content as the tag moves. Fig.10a As shown in (2), the mobile phone responds to the received user operation and changes the tag 601 from Fig.10a Move to the first position shown in (1) Fig.10a In the third position shown in (2), part of the text, such as "Experience, understand what you want, give you what you need" in the figure, moves backward from the original position (i.e., the third position) to behind the right frame of label 601.

[0230] Optionally, as described above, the layout of label 601 can be surrounding, tight, or wraparound, etc. The mobile phone can move other texts accordingly based on the layout of label 601 so that the text content in the note and label 601 are in the specified layout.

[0231] Optionally, in an embodiment of the present application, if the distance (for example, the second length) between the position where the label is inserted and the border of the display window 401 (i.e., the right border of the display window 401) is less than the length of the label 601 (for example, the first length). In one example, the mobile phone can automatically move the label 601 down to the next line. The text or picture and other content behind the label are moved back accordingly. In another example, the mobile phone can shorten the label 601 to less than or equal to the second length. For example, the mobile phone can display the call object 6011 in the label 601 in a thumbnail, which is not limited in this application.

[0232] Please refer to Fig.10b , for example, a user can execute Figure 7a and Figure 7b The operation shown is to instruct the tablet to send image 703 to the mobile phone. In response to the received image 703, the mobile phone deletes label 601 (i.e., cancels the display of label 601), and displays image 703 at the position of the original label 601. Optionally, based on the size of image 703, the memo application moves the origin of image 703 (i.e., the upper left corner of image 703) down one line from the position to be inserted (e.g., the position of the left border of the original label 601), and displays image 703 at this position. In this example, the position of the origin of image 703 and the position to be inserted (e.g., the position of the left border of the original label 601) can both be considered as the insertion position of image 703, and this application does not limit it.

[0233] Exemplarily, in this example, after the memo application inserts the picture 703, the text after the original label 601 is moved back accordingly. Optionally, the text after the original label 601 can also be moved down one line, which is not limited in this application.

[0234] Optionally, similar to the layout of the label, the layout of the picture inserted in the memo application can also be set according to actual needs. In addition, the layout of the text is different according to different picture layouts.

[0235] In this way, the calling method in the embodiment of the present application also supports the position change of the label, so that the label and subsequently inserted objects (including but not limited to text, pictures, etc.) are moved to the specified position according to the user's instructions, further improving the flexibility of the first inserted object and meeting the user's more scenario requirements.

[0236] The calling method in the embodiment of the present application also supports the deletion of the tag 601 at any time. For example, at any time before the tablet sends the first inserted object (including a picture or text, etc.) to the mobile phone, that is, before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted picture, the user can delete the tag to cancel the first inserted object.

[0237] In a possible implementation, the user can delete the tag by using the cursor. Fig.11a is a schematic diagram of an exemplary user interface. Fig.11a (1), after the mobile phone inserts the label 601 in response to the received user operation, the current position of the cursor 1002 is after the right frame of the label 601. Optionally, after the mobile phone displays the label 601, the cursor can be hidden, and the mobile phone displays the soft keyboard in response to the received user operation, that is, after determining that text content needs to be entered, the cursor is displayed again, which is not limited in this application. That is to say, as described above, in some instances, the cursor can be hidden and displayed only after receiving the user's operation of clicking the interface, and the cursor is displayed again, which is not limited in this application.

[0238] For example, the user clicks on any position of the memo application interface 401, and the mobile phone displays a soft keyboard in response to the received user operation. The user can click the delete key on the soft keyboard to delete the content before the cursor 1002. Fig.11a (2), the mobile phone deletes the content before the cursor 1002 in response to the user clicking the delete key, that is, deletes the label 601.

[0239] Please refer to Fig.11a (2), after the mobile phone deletes tag 601, it sends an indication message to the tablet to indicate the cancellation of calling the tablet. In response to the received indication message, the tablet cancels the display of the photo preview interface and displays the desktop 1101 (or the last interface previously displayed). Optionally, the mobile phone can disconnect the Wi-Fi connection with the tablet. In other embodiments, the mobile phone can also maintain the Wi-Fi connection with the tablet and disconnect the Wi-Fi connection with the tablet after a certain period of time (and if the tablet is not called again within a certain period of time).

[0240] In another possible implementation, the user can delete the label 601 by using the cancel insertion option in the option box 901. Fig.11b (1), the user can click on more options 6012 in the label 601. In response to receiving the user's operation of clicking on more options 6012, the mobile phone displays the label option box 901. The description of the label option box 901 can be found above and will not be repeated here.

[0241] For example, the user can click the cancel insertion option in the label option box 901 to indicate to cancel the display of the label 601. Fig.11b (2), the mobile phone deletes the label 601 in response to the received user clicking the cancel insertion option operation. For other descriptions, please refer to Fig.11a , I will not go into details here.

[0242] The calling method in the embodiment of the present application can also provide a temporary insertion solution, which can temporarily mark the location where the first object needs to be inserted by temporarily inserting a label, thereby solving the problem that the user is currently inconvenient to perform other operations. The user can modify the label at any time to insert the corresponding content, thereby continuing to supplement the corresponding content. For example, Figure 12a to Figure 12c is a schematic diagram of an exemplary user interface. Fig.12a (1), combined with Figure 4 (2), after the user clicks on the add option 4021, the mobile phone displays the option display area 403 in response to the received user's click on the add option 4021 operation. The option display area 403 includes but is not limited to the "select from gallery" option, the "photo option", etc., and the specific description can be referred to Figure 4 (2) is not described here. In this example, the option display area 403 may also include an "Insert Tag Only" option to support the user to temporarily insert a tag. The user may click the "Insert Tag Only" option to indicate to temporarily insert a tag.

[0243] Please refer to Fig.12a (2), the mobile phone responds to the received user operation and inserts a tag 1201 at the current cursor position. Optionally, the current cursor position may be at the end of the input text. For a detailed description, please refer to Figure 7a , which will not be described here. Among them, the label 1201 includes but is not limited to: insert label prompt 1201a and more options 1201b. Among them, the insert label prompt 1201a is used to indicate that the current label is temporary. Optionally, the words in the insert label prompt 1201a can also be "temporary label", etc., which can be set according to actual needs and is not limited in this application.

[0244] It should be noted that Fig.12aOnly one temporary tag 1201 is used as an example for illustration. In actual usage scenarios, the mobile phone can insert multiple temporary tags according to user operations, and the positions of the multiple temporary tags are set according to user operations, which is not limited in this application.

[0245] Optionally, the mobile phone can also move the position of the temporary label in response to a received user operation (such as a drag operation). For example, the user can long press label 1201 and drag label 1201 to a specified position. In response to the received long press operation of label 1201, the mobile phone determines that the user needs to move temporary label 1201. Then, in response to the received drag operation, the mobile phone moves the cursor 1201 to label 1201 in the direction of the user's gesture movement, and displays label 1201 at the position before the user raises his hand. The specific implementation method is the same as Fig.10a The same is true in , so I will not repeat it here.

[0246] In another implementation, the tag option box (e.g., tag option box 901) may also include an "insert tag only" option so that the user can cancel the current call operation at any time without deleting the tag, so that the tag can achieve the marking function at the current position, and the user can re-operate the tag at any subsequent time to insert the target object. For example, please refer to Figure 12b , take the example of the mobile phone currently calling the tablet's camera function. For detailed description, please refer to Figure 7a , which will not be described in detail here. Exemplarily, during the process of the mobile phone calling the camera function of the tablet, the user can click on more options 6012 (the relevant description can be referred to above, which will not be described in detail here). In response to the received user operation, the mobile phone displays the label option box 901. Optionally, the option box 9012 in the label option box 901 may include an "Insert label only" option. The description of other controls or options can refer to the relevant content in the above embodiment, which will not be described in detail here.

[0247] Exemplarily, the user clicks the "Only insert label" option in the option box 9012 to indicate that the current label 601 is switched to a temporary label. In response to receiving the user's operation of clicking the "Only insert label" option, the mobile phone cancels the display of the label 601 and displays the temporary label 1201. The display method can refer to Fig.12a , which will not be described here. Optionally, in this example, in response to receiving the user's operation of clicking the "Insert Tag Only" option, the mobile phone can change the call object 6011 in the tag 601 to "Insert Tag Prompt", for example, changing the words "Taking Photo Using "PAD"" to "Insert Tag" to indicate that the current tag is a temporary tag. The tablet can exit the camera interface and return to the desktop or other application interfaces.

[0248] It should be noted that Figure 12b Only Figure 7a In other embodiments, the tablet can execute the following at any time before sending a picture or text result to the mobile phone: Figure 12b The process shown, that is, the user can modify the currently displayed label to a temporary label at any time before confirming the first insertion object.

[0249] Please refer to Fig.12c , exemplarily, the user can click on more options 1201b in the temporary tag 1201 at any time after inserting the temporary tag 1201 to update the inserted object. In response to the received user's operation of clicking on more options 1201b, the mobile phone displays a tag option box 1202, which includes but is not limited to option boxes 1202a and option boxes 1202b. Among them, option box 1202a optionally displays options corresponding to some functions that can be called provided by the local machine (i.e., the mobile phone), for example, but not limited to: "take a photo" option, "document scanning" option, and "select from gallery" option, etc. Option box 1202b includes but is not limited to "from PAD" option, "from Magicbook" option, "only insert tag option" and "cancel insert" option, etc. The user can click on the option in option box 1201a to call the corresponding function of the local machine to insert the corresponding object. Optionally, the user can also click on the "from PAD" option or the "from Magicbook" option in option box 1201b to call the corresponding function of the tablet or notebook to insert the specified object. For example, the user can click the "From PAD" option to indicate to call the corresponding function of the tablet. In response to the received user operation, the mobile phone establishes a Wi-Fi connection with the tablet. The mobile phone can obtain the callable functions provided by the tablet through the Wi-Fi connection. The mobile phone can display the options corresponding to the functions provided by the tablet in the option box 1202a, such as but not limited to the "Photo" option, the "Document Scan" option, and the "Select from Gallery" option, etc. For specific descriptions, please refer to Figure 9b , I will not go into details here.

[0250] Optionally, the user can also delete the temporary tag by deleting it with the cursor or clicking the "Cancel Insert" option. For details, please refer to Fig.11a and Fig.11b The description is not repeated here.

[0251] In the embodiments of the present application, different electronic devices may also provide fewer or more functions than those listed in the embodiments of the present application. When the called device is different, the corresponding callable function list options are different, which may be displayed according to the type and hardware capabilities of the called device. For example, Figure 13a to Figure 13c is a schematic diagram of an exemplary user interface. Fig.13aAfter the mobile phone establishes a Wi-Fi connection with the tablet, some functions provided by the tablet's label application can be obtained through the Wi-Fi connection, such as the tablet can provide a photo taking function, a document scanning function, and a gallery selection function. Optionally, in this example, the tablet's label application is registered with the handwriting application, and the handwriting board application can be called to provide the handwriting function for the mobile phone's label application. Accordingly, the mobile phone can obtain the tablet's handwriting function through the Wi-Fi connection between the tablet. Fig.13a As shown, the user clicks on more options 6012 in label 601, and the mobile phone displays a label option box 1301 in response to the received user operation. The label option box 1301 includes but is not limited to the "photo" option, "document scanning" option and "select from gallery" option corresponding to the photo function, document scanning function and gallery function provided by the tablet, and may also include a "handwriting" option corresponding to the handwriting function. For other undescribed contents, please refer to the relevant contents in the above embodiment, which will not be repeated here.

[0252] For example, the user can click on the "Handwriting" option to indicate to call the handwriting function of the tablet. Fig.13b , illustratively, in response to the received user operation, the mobile phone changes the calling object in label 601 to "Using "PAD" handwriting", to indicate that the electronic device currently called is a tablet, and the called function is the handwriting function of the tablet. The mobile phone sends an indication message to the tablet to indicate the call of the tablet's handwriting function. The tablet receives the indication message sent by the mobile phone via a Wi-Fi connection, and calls the handwriting function of the local device (i.e., the tablet) or other applications with a handwriting function, such as a memo. In the embodiments of the present application, only the memo application is used as an example for illustration. In other embodiments, other applications may also be used, and the present application does not limit this.

[0253] Please continue to refer to Fig.13b The tablet display interface 701 displays a memo application interface. The memo application interface includes but is not limited to: a handwriting input area, a cancel option (also referred to as a return option) and a confirmation option 1302, etc.

[0254] For example, the user may input corresponding content in the handwriting input area of ​​the tablet using a stylus. Fig.13b The input content is only an illustrative example and is not limited in this application.

[0255] After the user completes the input through the stylus pen, he can click the confirmation option 1302. Fig.13c As shown, the tablet generates an image 1303 in response to the received user operation. The image 1303 includes the content input by the user through the stylus. The tablet sends the image 1303 to the mobile phone through the Wi-Fi connection. In addition, the tablet displays the desktop.

[0256] Exemplarily, the mobile phone receives the image 1303 sent by the tablet. The mobile phone deletes the label 601. Furthermore, the mobile phone inserts the image 1303 at the location of the original label 601. The specific insertion method can be referred to above and will not be described here.

[0257] It should be noted that the present application embodiment only takes the handwriting function as an example for illustration. In other embodiments, the called electronic device (such as the tablet in the present application embodiment) can provide more functions, which can be set according to actual needs, and the present application does not limit it.

[0258] It should be further explained that Fig.13a In the example, the user selects the handwriting function from the option box 1301. Figure 4 The option display area 403 in (3) can also display the "Handwriting" option corresponding to the handwriting function provided by the tablet. After the user clicks the "Handwriting" option, the process executed by the mobile phone and the tablet is the same as Figure 13b to Figure 13c The same as in, no further description is given here.

[0259] In the embodiment of the present application, the user can also call the relevant functions of the local machine to insert the specified object during the process of taking notes. Figure 4 As shown in (2), in the embodiment of the present application, the mobile phone displays the options corresponding to the first insertion object that can be provided by the mobile phone, such as but not limited to: "Select from Gallery" option, "Photograph" option, "Document Scan" option, "Card Collection" option, etc. The user can click on the corresponding option to call the corresponding function of the mobile phone to insert the specified object. The mobile phone responds to the received user operation and calls the corresponding function. For specific implementation, please refer to Fig.14a Description in .

[0260] Figure 14a to Figure 14e is a schematic diagram of an exemplary user interface. Fig.14a , exemplarily, the user clicks on more options 6012 in label 601. In response to the received user operation, the mobile phone displays label options 901. The description of each option in label option 901 can be found in Figure 9b , I will not go into details here.

[0261] For example, the user can click the "from this machine" option to indicate to call the relevant functions of this machine. Fig.14b As shown in the figure, during the execution, the mobile phone is calling the tablet's camera function. For a detailed description, please refer to Figure 7a, no further details are given here. In response to the received user operation, the mobile phone displays options corresponding to the functions provided by the mobile phone in option box 9011. For example, the "take a photo" option, the "document scan" option, and the "select from gallery" option. In other words, the options corresponding to the functions provided by the tablet originally displayed in option box 9011 are replaced with options corresponding to the functions provided by the mobile phone. That is, at the top of option box 9011, the words "from this machine" are displayed to indicate that the options displayed in 9011 are all corresponding to the functions provided by the mobile phone.

[0262] Alternatively, if Fig.14c As shown, in response to the user clicking the "From this machine" option, the mobile phone displays option box 1401. In this example, option box 1401 can be considered as the next level option of the "From this machine" option. That is, the mobile phone still displays option box 901, and displays option box 1401 in a position near option box 901 (which can be set according to the position of option box 901 in the interface, and this application does not limit it). The description of option box 1401 can be referred to Fig.14b , I will not go into details here.

[0263] In this example, the user clicks on the "photograph" option, which is used to indicate the calling of the camera function of the machine. Fig.14d As shown, the mobile phone responds to the received user operation and determines that the user instructs to call the camera function of the mobile phone. The mobile phone sends an instruction message to the tablet to instruct to cancel the call to the tablet. The tablet responds to the received instruction message, cancels the call to the local camera, and displays the desktop (it can also display the interface before calling the camera, which is not limited in this application). Optionally, the Wi-Fi connection between the mobile phone and the tablet can be disconnected or maintained, which is not limited in this application.

[0264] Exemplarily, the mobile phone calls the camera of the local phone. The mobile phone displays a photo preview interface 1401. The photo preview interface 1401 includes but is not limited to: a photo preview window and multiple controls. The photo preview window displays the image captured by the camera of the mobile phone. The controls include but are not limited to: a photo control 1402, a lens flip control, etc.

[0265] The user clicks the photo control 1402. Fig.14e As shown in (1), in response to receiving the user's operation of clicking the photo control 1402, the mobile phone displays an image preview interface 1403. The image preview interface 1403 includes but is not limited to: a confirmation option 1404, a cancel option 1405, and an image 1406. Among them, the image 1406 is the image captured by the camera.

[0266] The user can click the confirmation option 1404 to indicate to insert the image 1406. In response to the received user operation, the mobile phone deletes the label 601 and displays the image 1406 at the position of the original label 601. The specific insertion method can be referred to above and will not be repeated here.

[0267] In a possible implementation, the functions that can be called in the embodiment of the present application have already applied for corresponding permissions in advance. In one example, the permissions corresponding to the functions that can be called by the label application are default. For example, during the initialization of the mobile phone, the label application can register the access permissions corresponding to the functions that need to be called with the permission management module, such as the permission to access the camera, the permission to access the gallery, etc. Figure 4 In (1), after the mobile phone responds to the received user's operation of clicking on the add option 4021, the mobile phone can detect the permissions of the tag application. For example, if the mobile phone detects that the tag application has permissions such as access to the camera and access to the gallery, the mobile phone can display the corresponding options in the option display area 403 or the tag option box 901. Optionally, when the tag application of the subsequent mobile phone calls the camera function of the local machine, the mobile phone can detect again whether it has the corresponding access rights, or it can no longer detect after the initial detection of having the corresponding permissions, which is not limited in this application. To give another example, taking a tablet as an example, during the initialization process of the tablet, the access rights corresponding to the function to be called can be registered with the permission management module. Accordingly, in an embodiment of the present application, after the mobile phone and the tablet establish a Wi-Fi connection, the functions that can be called sent by the tablet's tag application to the mobile phone are the functions that the tag application has obtained permissions for. In this example, the user can manually manage (for example, add or cancel) the access rights of the tag application in the settings application. For example, a user can cancel the tablet's tag application's access rights to the camera in the permission management application of the tablet's settings application. When the mobile phone calls the tablet to execute the calling method in the embodiment of the present application, the callable functions sent by the tablet to the mobile phone via the Wi-Fi connection will no longer include the photo function. Correspondingly, the photo-taking options corresponding to the tablet will no longer be displayed in the option display area 403 and the tag option box 901 of the mobile phone. In another example, the tag application of an electronic device (such as a mobile phone or tablet) can display a permission list when it is first started. The permission list may include, but is not limited to, some permissions that can be accessed by the tag application, such as camera access rights, gallery access rights, etc. The user can manually select the access rights corresponding to the tag application.

[0268] In the above embodiments, the example of a mobile phone calling a corresponding function of a tablet is used for explanation. In other embodiments, the method in the embodiment itself can be applied to the scenario where an electronic device such as a tablet, notebook, mobile phone, car-mounted device, etc. calls another electronic device (such as a tablet, notebook, mobile phone, car-mounted device, etc.), and this application does not limit it. For example, Fig.15a This is a schematic diagram of an exemplary scenario of a tablet calling the camera function of a mobile phone. Please refer to Fig.15a The tablet responds to the received user operation (for specific operations, please refer to Figure 4 The description in the above section will not be repeated here), calling the camera function of the mobile phone. A label 1502 is inserted into the memo application interface 1501 of the tablet, and the label 1502 is used to indicate that the "Magic5" is being used to take pictures, that is, the camera function of the mobile phone is being called. In response to the call request of the tablet, the mobile phone displays a photo preview interface 1503, and the photo preview interface 1503 displays the image 1504 captured by the camera of the mobile phone. It should be noted that Fig.15a Only the scene diagram in the calling process is shown. The methods in the above embodiments of this application can be applied to this scene. For other undescribed parts, please refer to the above and will not be repeated here. For another example, when a user uses a notebook to take notes, usually the camera of the notebook is the front camera. In this scene, the user can use the notebook to call the camera of the mobile phone through the method in the embodiment of this application to insert the image captured by the camera of the mobile phone. Fig.15b This is a schematic diagram of an exemplary scenario of a laptop calling the camera function of a mobile phone. Please refer to Fig.15b In response to the received user operation, the notebook calls the camera function of the mobile phone. In this scenario, the user operation may refer to an operation triggered by the user through a mouse or keyboard. In some embodiments, if the display screen of the notebook is a touch screen, the user can also use Figure 4 The notebook uses a similar operation to call the corresponding function of the mobile phone. For example, a label 1506 is inserted into the memo application interface 1505 of the notebook, and the label 1506 is used to indicate that "Magic5" is being used to take pictures, that is, the camera function of the mobile phone is being called. In response to the call request of the notebook, the mobile phone displays a photo preview interface 1503, and the photo preview interface 1503 displays the image 1504 captured by the camera of the mobile phone. For other undescribed parts, please refer to the above, and no further description is given here.

[0269] It is understandable that, in order to realize the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0270] In one example, Fig.16A schematic block diagram of a device 1600 according to an embodiment of the present application is shown. The device 1600 may include: a processor 1601 and a transceiver / transceiver pin 1602 , and optionally, a memory 1603 .

[0271] The components of the device 1600 are coupled together via a bus 1604, wherein the bus 1604 includes a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, all buses are referred to as bus 1604 in the figure.

[0272] Optionally, the memory 1603 may be used for the instructions in the aforementioned method embodiment. The processor 1601 may be used to execute the instructions in the memory 1603, and control the receiving pin to receive a signal, and control the sending pin to send a signal.

[0273] The apparatus 1600 may be the electronic device or a chip of the electronic device in the above method embodiment.

[0274] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0275] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.

[0276] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the method in the above-mentioned embodiment.

[0277] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the chip executes the connection method in the above-mentioned method embodiments.

[0278] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above and will not be repeated here.

[0279] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A calling method, characterized in that: include: The first electronic device displays a first application interface, wherein the first application interface displays input content and a first option; The first electronic device receives a first operation on the first option; The first electronic device displays a first label operation block on the first application interface in response to the first operation, and the first electronic device sends a first call request to the second electronic device, wherein the first call request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the first electronic device is calling the first target function of the second electronic device; In the process of the first electronic device calling the first target function of the second electronic device, the first electronic device displays a first label option box in response to a received click operation on the first label operation block, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the first electronic device; The first electronic device updates the first tag information to second tag information in response to the received click operation on the first calling option, and the first electronic device sends a second calling request to the second electronic device; the second calling request is used to request to call a second target function of the second electronic device, the second tag information is used to indicate that the first electronic device is calling the second target function of the second electronic device, and the first calling option belongs to the at least one second electronic device calling option; The first electronic device receives a first insertion object sent by the second electronic device, wherein the first insertion object is acquired by the second electronic device based on the second target function; The first electronic device replaces the first tag operation block with the first insertion object.

2. The method according to claim 1, characterized in that The first electronic device replaces the first label operation block with the first insertion object, including: The first electronic device cancels display of the first label operation block; The first electronic device inserts the first insertion object at an original display position of the first label operation block.

3. The method according to claim 1, characterized in that The first label operation block is displayed at the end of the input content.

4. The method according to claim 1, characterized in that The first label operation block is displayed at a position corresponding to the last editing operation on the input content.

5. The method according to claim 1, characterized in that Before the first electronic device receives a first operation on a first option of the first application interface, the method further includes: The first electronic device displays a cursor at the first position in response to receiving a second operation on the first position; The first electronic device displays the first label operation block at a first position of the first application interface, including: The first label operation block is inserted at the position of the cursor.

6. The method according to claim 1, characterized in that The first application interface also includes a second option, and the method further includes: The first electronic device displays a second label operation block on the first application interface in response to the received third operation on the second option, and the first electronic device sends a third calling request to the second electronic device, wherein the third calling request is used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the first electronic device is calling the third target function of the second electronic device; During the process of the first electronic device calling the third target function of the second electronic device, the first electronic device displays a second label option box in response to receiving a click operation on the second label operation block; wherein the second label option box includes the at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the first electronic device, and the at least one device includes the first electronic device.

7. The method according to claim 6, characterized in that The second label option box also includes a temporary insertion option, and the temporary insertion option is used to indicate to suspend the calling of the second electronic device; the method also includes: The first electronic device updates the second label information in response to the received click operation on the temporarily inserted option, and the first electronic device sends a stop calling request to the second electronic device, wherein the stop calling request is used to instruct to stop calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; The first electronic device displays the second label option box in response to receiving a click operation on the second label operation block.

8. The method according to claim 6 or 7, characterized in that: The method further comprises: The first electronic device displays a third label option box in response to receiving a fourth operation on the first device option; wherein the third label option box includes at least one third electronic device calling option and the at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the first electronic device; The first electronic device receives a fifth operation in response to the received second calling option, updates the third tag information to fourth tag information, and the first electronic device sends a fourth calling request to the third electronic device, the fourth calling request is used to request to call the fourth target function of the third electronic device; wherein the fourth tag information is used to indicate that the first electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option; The first electronic device receives a second insertion object sent by the third electronic device, wherein the second insertion object is acquired by the third electronic device based on the fourth target function; The first electronic device replaces the second tag operation block with the second insertion object.

9. The method according to claim 8, characterized in that At least one function in the third electronic device that can be called by the first electronic device is completely or partially different from at least one function in the second electronic device that can be called by the first electronic device.

10. The method according to claim 8, characterized in that The third electronic device is the first electronic device.

11. The method according to claim 1, characterized in that: The first interface further includes a third option, and the method further includes: In response to receiving a fifth operation on the third option, the first electronic device displays a third label operation block on the first application interface, where the third label operation block includes third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.

12. The method according to any one of claims 1 to 11, characterized in that: The first electronic device responds to the first operation, after the first application interface displays a first label operation block, the method further includes: The first electronic device receives a drag operation on the first label operation block; The first electronic device moves the first label operation block from a current position to another position along with the drag operation; The first electronic device replaces the first label operation block with the first insertion object, including: The first electronic device cancels display of the first label operation block; The first electronic device is inserted into the first insertion object at the other position.

13. The method according to any one of claims 1 to 12, characterized in that: The first electronic device responds to the first operation, after the first application interface displays a first label operation block, the method further includes: During the process in which the first electronic device calls the first target function of the second electronic device, the first electronic device updates the input content in response to the received sixth operation.

14. An electronic device, characterized in that: include: One or more processors, memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: Displaying a first application interface, wherein the first application interface displays input content and a first option; receiving a first operation on the first option; In response to the first operation, a first label operation block is displayed on the first application interface, and a first calling request is sent to the second electronic device, where the first calling request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, where the first label information is used to indicate that the electronic device is calling the first target function of the second electronic device; In the process of calling the first target function of the second electronic device, in response to receiving a click operation on the first label operation block, displaying a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device; In response to a received click operation on a first calling option, the first tag information is updated to second tag information, and a second calling request is sent to the second electronic device; the second calling request is used to request to call a second target function of the second electronic device, the second tag information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first calling option belongs to the at least one second electronic device calling option; receiving a first insertion object sent by the second electronic device, wherein the first insertion object is acquired by the second electronic device based on the second target function; The first tag operation block is replaced by the first insertion object.

15. The electronic device according to claim 14, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: Cancel displaying the first label operation block; The first insertion object is inserted at the original display position of the first tab operation block.

16. The electronic device according to claim 14, characterized in that: The first label operation block is displayed at the end of the input content.

17. The electronic device according to claim 14, characterized in that: The first label operation block is displayed at a position corresponding to the last editing operation on the input content.

18. The electronic device according to claim 14, characterized in that: Before the electronic device receives a first operation on a first option of the first application interface, when the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to receiving a second operation on a first position, displaying a cursor at the first position; Displaying the first label operation block at a first position of the first application interface includes: The first label operation block is inserted at the position of the cursor.

19. The electronic device according to claim 14, characterized in that: The first application interface further includes a second option, which, when the computer program is executed by the one or more processors, causes the electronic device to perform the following steps: In response to receiving a third operation on the second option, displaying a second label operation block on the first application interface, and sending a third call request to the second electronic device, the third call request being used to request calling a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the electronic device is calling the third target function of the second electronic device; In the process of calling the third target function of the second electronic device, in response to receiving a click operation on the second label operation block, a second label option box is displayed; wherein the second label option box includes the at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes the electronic device.

20. The electronic device according to claim 19, characterized in that: The second label option box also includes a temporary insertion option, and the temporary insertion option is used to indicate to suspend the call to the second electronic device; when the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to the received click operation on the temporarily inserted option, the second tag information is updated, and a stop calling request is sent to the second electronic device, wherein the stop calling request is used to instruct to stop calling the second electronic device; wherein the updated second tag information is used to indicate that the second tag operation block is a temporarily inserted tag operation block; In response to receiving a click operation on the second label operation block, the second label option box is displayed.

21. The electronic device according to claim 19 or 20, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to receiving a fourth operation on the first device option, displaying a third label option box; wherein the third label option box includes at least one third electronic device calling option and the at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the electronic device; receiving a fifth operation in response to the received second calling option, updating the third tag information to fourth tag information, and sending a fourth calling request to the third electronic device, the fourth calling request being used to request calling the fourth target function of the third electronic device; wherein the fourth tag information is used to indicate that the electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option; receiving a second insertion object sent by the third electronic device, wherein the second insertion object is acquired by the third electronic device based on the fourth target function; The second label operation block is replaced by the second insertion object.

22. The electronic device according to claim 21, characterized in that: At least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.

23. The electronic device according to claim 22, characterized in that: The third electronic device is the electronic device.

24. The electronic device according to claim 14, characterized in that: The first interface also includes a third option. When the computer program is executed by the one or more processors, the electronic device performs the following steps: in response to receiving a fifth operation on the third option, displaying a third label operation block on the first application interface, the third label operation block including third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.

25. The electronic device according to any one of claims 14 to 24, characterized in that: In response to the first operation, after the first application interface displays a first label operation block, when the computer program is executed by the one or more processors, the first electronic device causes the electronic device to perform the following steps: receiving a drag operation on the first label operation block; Moving the first label operation block from a current position to another position along with the drag operation; Cancel displaying the first label operation block; The first insertion object is inserted into the other position.

26. The electronic device according to any one of claims 14 to 25, characterized in that: In response to the first operation, after the first application interface displays a first label operation block, when the computer program is executed by the one or more processors, the first electronic device causes the electronic device to perform the following steps: In the process of calling the first target function of the second electronic device, the input content is updated in response to a received sixth operation.

27. A computer storage medium, characterized in that The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 13.

28. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 13.

29. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor, wherein the signal includes a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device executes the method described in any one of claims 1 to 13.

Citation Information

Cited By

  • Call method and electronic device

    EP4679242A1

  • Call method and electronic device

    WO2024230334A1