Call method and electronic device
By displaying the tag operation block on the application interface of the terminal device, users can easily call the functions of other electronic devices, solving the problems of complex operation and poor user experience, and achieving flexible function calls and convenient user experience.
Patent Information
- Application Number
- PCT/CN2024/083197
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-10
- Filing Date
- 2024-03-22
- Publication Date
- 2024-11-14
AI Technical Summary
During the recording process of existing terminal devices, it is difficult to simplify operations and weaken the impact on the current application, resulting in poor user experience, especially when calling the functions of other electronic devices, which are complex and inconvenient to operate.
Provides a call method and electronic device. By displaying tag operation blocks on the application interface, users can click to call the functions of other electronic devices, and update tag information during the call process, realizing dynamic calls and function replacement, and supporting temporary insertion and dragging. Active operation to meet different scenario needs.
It simplifies the operation process, improves the user experience, allows users to easily call the functions of other electronic devices during the recording process, enhances flexibility and convenience, and meets the needs of different scenarios.
Smart Images

Figure CN2024083197_14112024_PF_FP_ABST
Abstract
Description
Calling method and electronic device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on May 10, 2023, with application number 202310522265.7 and application name “Calling Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal devices, and in particular to a calling method and electronic device. Background Art
[0003] With the rapid development of terminal technology, terminals are providing more and more functions and a wider range of application scenarios. For example, during the learning process, users can use the terminal's memo software to take notes in class. During the recording process, users can not only record text, but also insert photos or images to enrich the content of the notes.
[0004] Summary of the Invention
[0005] The present application provides a calling method and electronic device, which can realize inserting specified content by calling other electronic devices during the recording process, simplifying the operation while weakening the impact on the current application and improving the user experience.
[0006] In a first aspect, the present application provides a calling method. The method includes: a first electronic device displays a first application interface, wherein the first application interface displays input content and a first option. The first electronic device receives a first user operation on the first option. In response to the received first operation, the first electronic device displays a first label operation block on the first application interface, and the first electronic device sends a first call request to a second electronic device. The first call request is used to request the call of a first target function of the second electronic device. The first label operation block includes first label information, which indicates that the first electronic device is calling the first target function of the second electronic device. Then, during the process of the first electronic device calling the first target function of the second electronic device, the first electronic device displays a first label option box in response to a click operation on the first label operation block, wherein the first label option box includes at least one second electronic device call option, the at least one second electronic device call option corresponding to at least one function in the second electronic device that can be called by the first electronic device. In response to the user click operation on the first call option, the first electronic device updates the first label information to second label information, and the first electronic device sends a second call request to the second electronic device. Among them, the second call request is used to request to call the second target function of the second electronic device, the second tag information is used to indicate that the first electronic device is calling the second target function of the second electronic device, and the first call option belongs to at least one second electronic device call option. Subsequently, the first electronic device receives the first insertion object sent by the second electronic device, wherein the first insertion object is obtained by the second electronic device based on the second target function and sent to the first electronic device. The first electronic device replaces the first tag operation block with the first insertion object. In this way, the user of this application can call other electronic devices (such as the second electronic device) in the process of using the first application through simple operations, such as clicking on the first option. And by calling the specified function of another electronic device, the inserted content that meets the user's needs can be obtained. And, in the process of calling another electronic device, the user can perform corresponding operations on the inserted tag operation block at any time to change the specified function being called, so as to meet different needs in different scenarios.
[0007] In some examples, the first option may be the “take a photo” option in Figure 4. Accordingly, the first target function may be a photo taking function of the second electronic device.
[0008] In some examples, the first electronic device may be a mobile phone, tablet, wearable device, vehicle-mounted device, etc. The second electronic device may also be a mobile phone, tablet, wearable device, vehicle-mounted device, etc.
[0009] In some instances, the inserted object may be a file such as a picture, text, or voice.
[0010] In one possible implementation, the first electronic device replaces the first tab operation block with the first insertion object, including: the first electronic device cancels display of the first tab operation block. The first electronic device inserts the first insertion object at the original display position of the first tab operation block. In this way, the present application uses the first tab operation block as a placeholder so that the insertion object can be inserted at the original display position of the tab operation block.
[0011] In some instances, the length of the tag operation block is greater than the length of the tag information.
[0012] In some embodiments, the height of the tab block is less than or equal to the row height.
[0013] In some examples, the original display position of the tab operation block refers to the position corresponding to the left edge of the tab operation block.
[0014] In a possible implementation, the first label operation block is displayed at the end of the input content. In this way, the first label operation block can be displayed in a default position, i.e., the end of the input content, so that the subsequent displayed insertion object is also displayed at the end of the input content.
[0015] In one possible implementation, the first label operation block is displayed at the position corresponding to the last editing operation on the input content. In this way, the first label operation block can be displayed at a default position, i.e., the position corresponding to the last editing operation, so that subsequently displayed inserted objects are also displayed at this position.
[0016] In some instances, the position corresponding to the last editing operation may be the end of the input content.
[0017] In some instances, the position corresponding to the last editing operation may also be any position in the input content.
[0018] In one possible implementation, before the first electronic device receives the first operation on the first option of the first application interface, the method further includes: the first electronic device displays a cursor at the first position in response to the received second operation on the first position. The first electronic device displays the first label operation block at the first position of the first application interface, including: inserting the first label operation block at the cursor position. In this way, the user can move the cursor to indicate that the first label operation block is displayed at the cursor position, so that the label operation block is displayed at any user-specified position. It is further enabled that the inserted object can be displayed at the position where the label operation block is located, that is, the position specified by the user.
[0019] In some examples, the second operation may be a click operation of the user on the display interface using a finger or a stylus.
[0020] In some examples, the second operation may also be an operation of moving a cursor by the user using a mouse or keyboard.
[0021] In one possible implementation, the first application interface further includes a second option, and the method further includes: the first electronic device, in response to receiving a third operation on the second option, displays a second label operation block on the first application interface, and the first electronic device sends a third call request to the second electronic device, the third call request being used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, the third label information being used to indicate that the first electronic device is calling the third target function of the second electronic device; during the process of the first electronic device calling the third target function of the second electronic device, the first electronic device, in response to receiving a click operation on the second label operation block, displays a second label option box; wherein the second label option box includes at least one second electronic device call option and at least one device option, the at least one device option being used to indicate at least one device that can be called by the first electronic device, the at least one device including the first electronic device. In this way, the electronic device in the present application can support calling one or more functions of another electronic device and can call corresponding functions according to user needs. In addition, the label operation block can display corresponding prompt information to remind the user of the function currently being called.
[0022] In one possible implementation, the second label option box also includes a temporary insert option, which is used to indicate the suspension of calling the second electronic device; the method also includes: the first electronic device updates the second label information in response to a click operation on the temporary insert option, and the first electronic device sends a stop call request to the second electronic device, which is used to indicate the stop of calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; the first electronic device displays the second label option box in response to a click operation on the second label operation block. In this way, the present application also provides a temporary label insertion method. In scenarios where the user is not sure which object to insert, a label can be temporarily inserted to take up space, so that in subsequent use, the corresponding insertion object can be inserted at any time by operating the temporary label.
[0023] In one possible implementation, the method further includes: the first electronic device, in response to receiving a fourth operation on a first device option, displaying a third label option box; wherein the third label option box includes at least one third electronic device call option and at least one device option, wherein the at least one third electronic device call option indicates at least one function in the third electronic device that can be called by the first electronic device; the first electronic device, in response to receiving a fifth operation on the second call option, updating the third label information to fourth label information, and the first electronic device sending a fourth call request to the third electronic device, the fourth call request requesting to call a fourth target function of the third electronic device; wherein the fourth label information indicates that the first electronic device is calling the fourth target function of the third electronic device, and the second call option belongs to the at least one third electronic device call option; the first electronic device receiving a second inserted object sent by the third electronic device, wherein the second inserted object is obtained by the third electronic device based on the fourth target function; and the first electronic device replacing the second label operation block with the second inserted object. In this way, the user can select a specified option in the label option box at any time by operating the label operation block during use, thereby enabling the electronic device to call a specified function of another callable electronic device, thereby providing a dynamic calling method for changing the called object and corresponding function at any time according to different scenarios and different needs.
[0024] In one possible implementation, at least one function of the third electronic device that can be called by the first electronic device is completely or partially different from at least one function of the second electronic device that can be called by the first electronic device. For example, the second electronic device may provide functions such as document scanning and photography, while the third electronic device may provide functions such as photography and handwriting tablet. Different electronic devices may provide the same or different functions.
[0025] In a possible implementation, the third electronic device is the first electronic device. Thus, the calling method in this application is also applicable to calling a specified function of the local device.
[0026] In one possible implementation, the first interface further includes a third option, and the method further includes: the first electronic device displays a third label operation block on the first application interface in response to receiving a fifth operation on the third option, the third label operation block including third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block. In this way, the present application also provides a method for inserting a temporary label. In scenarios where the user is not sure which object to insert, a label can be temporarily inserted to take up space, so that in subsequent use, the corresponding insertion object can be inserted at any time by operating the temporary label.
[0027] In one possible implementation, after the first electronic device displays a first label operation block on a first application interface in response to a first operation, the method further includes: the first electronic device receiving a drag operation on the first label operation block; the first electronic device moving the first label operation block from a current position to another position in response to the drag operation; and the first electronic device replacing the first label operation block with a first insertion object, including: the first electronic device canceling the display of the first label operation block; and the first electronic device inserting the first insertion object at another position. In this way, the user can drag the label operation block at any time as needed to change the insertion position of the label operation block, and accordingly, the insertion position of subsequent insertion objects will also change as needed.
[0028] In one possible implementation, after the first electronic device displays the first label operation block on the first application interface in response to the first operation, the method further includes: in the process of the first electronic device calling the first target function of the second electronic device, the first electronic device updates the input content in response to the received sixth operation. In this way, during the implementation process of the calling method in this application, that is, when the electronic device is calling another electronic device, the user can change the input content, that is, the content in the interface, at any time according to needs. Of course, in other embodiments, the user can also perform other operations on the interface, that is, when the electronic device is calling another electronic device, the interface of the application is not locked and can be changed at any time.
[0029] In a second aspect, the present application provides an electronic device. The electronic device includes: one or more processors, a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: displaying a first application interface, wherein the first application interface displays input content and a first option; receiving a first operation on the first option; in response to the first operation, displaying a first label operation block on the first application interface, and sending a first call request to a second electronic device, wherein the first call request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the electronic device is calling the first target function of the second electronic device; in the process of calling the first target function of the second electronic device, in response to the received operation on the first label operation block A click operation is performed to display a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device; in response to the received click operation on the first calling option, the first label information is updated to the second label information, and a second calling request is sent to the second electronic device; the second calling request is used to request to call the second target function of the second electronic device, the second label information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first calling option belongs to at least one second electronic device calling option; a first insertion object is received from the second electronic device, wherein the first insertion object is obtained by the second electronic device based on the second target function; and the first label operation block is replaced with the first insertion object.
[0030] In a possible implementation, when the computer program is executed by one or more processors, the electronic device executes the following steps: canceling the display of the first label operation block; and inserting a first insertion object at the original display position of the first label operation block.
[0031] In a possible implementation, the first tag operation block is displayed at the end of the input content.
[0032] In a possible implementation, the first label operation block is displayed at a position corresponding to the last editing operation on the input content.
[0033] In one possible implementation, before the electronic device receives a first operation on a first option of a first application interface, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to receiving a second operation on a first position, displaying a cursor at the first position; displaying a first label operation block at the first position of the first application interface, including: inserting the first label operation block at the cursor position.
[0034] In one possible implementation, the first application interface also includes a second option. When the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a third operation received on the second option, a second label operation block is displayed on the first application interface, and a third call request is sent to the second electronic device, and the third call request is used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the electronic device is calling the third target function of the second electronic device; in the process of calling the third target function of the second electronic device, in response to a click operation received on the second label operation block, a second label option box is displayed; wherein the second label option box includes at least one second electronic device call option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes an electronic device.
[0035] In one possible implementation, the second label option box also includes a temporary insertion option, which is used to indicate a pause in calling the second electronic device; when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a received click operation on the temporary insertion option, the second label information is updated, and a stop call request is sent to the second electronic device, the stop call request is used to indicate a stop in calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; in response to a received click operation on the second label operation block, the second label option box is displayed.
[0036] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: in response to a fourth operation received on a first device option, display a third label option box; wherein the third label option box includes at least one third electronic device call option and at least one device option, wherein the at least one third electronic device call option is used to indicate at least one function in the third electronic device that can be called by the electronic device; receiving a fifth operation received in response to a second call option, updating the third label information to a fourth label information, and sending a fourth call request to the third electronic device, the fourth call request is used to request to call a fourth target function of the third electronic device; wherein the fourth label information is used to indicate that the electronic device is calling the fourth target function of the third electronic device, and the second call option belongs to at least one third electronic device call option; receiving a second insertion object sent by the third electronic device, wherein the second insertion object is obtained by the third electronic device based on the fourth target function; replacing the second label operation block with the second insertion object.
[0037] In a possible implementation, at least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.
[0038] In a possible implementation, the third electronic device is an electronic device.
[0039] In one possible implementation, the first interface also includes a third option. When the computer program is executed by one or more processors, the electronic device performs the following steps: in response to receiving a fifth operation on the third option, displaying a third label operation block on the first application interface, the third label operation block includes third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.
[0040] In one possible implementation, the first electronic device responds to the first operation, and after the first label operation block is displayed on the first application interface, when the computer program is executed by one or more processors, the electronic device performs the following steps: receiving a drag operation on the first label operation block; moving the first label operation block from the current position to another position along with the drag operation; canceling the display of the first label operation block; and inserting a first insertion object at another position.
[0041] In one possible implementation, the first electronic device responds to the first operation and, after displaying the first label operation block on the first application interface, when the computer program is executed by one or more processors, causes the electronic device to perform the following steps: in the process of calling the first target function of the second electronic device, in response to the received sixth operation, updating the input content.
[0042] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0043] In a third aspect, the present application provides a communication system, the system comprising:
[0044] A first electronic device, for:
[0045] Displaying a first application interface, wherein the first application interface displays input content and a first option;
[0046] receiving a first operation on a first option;
[0047] In response to the first operation, a first label operation block is displayed on the first application interface, and a first call request is sent to the second electronic device, where the first call request is used to request to call the first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the electronic device is calling the first target function of the second electronic device.
[0048] A second electronic device, configured to:
[0049] receiving a first call request;
[0050] Based on the first call request, the first target function is started, and a second application interface corresponding to the first target function is displayed; the second application interface includes at least one object to be inserted obtained by the second electronic device by calling the first target function.
[0051] The first electronic device is further used for:
[0052] In the process of calling the first target function of the second electronic device, in response to receiving a click operation on the first label operation block, displaying a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device;
[0053] In response to a click operation received on the first call option, the first tag information is updated to the second tag information, and a second call request is sent to the second electronic device; the second call request is used to request to call the second target function of the second electronic device, and the second tag information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first call option belongs to at least one second electronic device call option.
[0054] The second electronic device is further configured to:
[0055] receiving a second call request;
[0056] Based on the second call request, stopping calling the first target function and starting the second target function, and displaying a third application interface corresponding to the second target function; the third application interface includes at least one object to be inserted obtained by the second electronic device by calling the second target function;
[0057] In response to the received confirmation operation, the first insertion object is sent to the first electronic device.
[0058] The first electronic device is further used for:
[0059] receiving a first insertion object sent by a second electronic device;
[0060] Replace the first tag action block with the first insertion object.
[0061] In a possible implementation, the first electronic device is specifically configured to:
[0062] Cancel display of the first label operation block;
[0063] A first insertion object is inserted at the original display position of the first tab operation block.
[0064] In a possible implementation, the first tag operation block is displayed at the end of the input content.
[0065] In a possible implementation, the first label operation block is displayed at a position corresponding to the last editing operation on the input content.
[0066] In a possible implementation, the first electronic device is further configured to:
[0067] In response to receiving the second operation on the first position, displaying a cursor at the first position; displaying a first label operation block at the first position of the first application interface includes: inserting the first label operation block at the position of the cursor.
[0068] In a possible implementation, the first application interface further includes a second option, and the first electronic device is further configured to:
[0069] In response to receiving a third operation on the second option, displaying a second label operation block on the first application interface, and sending a third call request to the second electronic device, the third call request being used to request calling a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the electronic device is calling the third target function of the second electronic device;
[0070] A second electronic device, configured to:
[0071] receiving a third call request;
[0072] Based on the third call request, the third target function is started, and a third application interface corresponding to the third target function is displayed; the third application interface includes at least one object to be inserted obtained by the second electronic device by calling the third target function.
[0073] The first electronic device is further used for:
[0074] In the process of calling the third target function of the second electronic device, in response to receiving a click operation on the second label operation block, a second label option box is displayed; wherein, the second label option box includes at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes an electronic device.
[0075] In a possible implementation, the second label option box further includes a temporary insertion option, which is used to indicate to suspend calling the second electronic device; the first electronic device is further configured to:
[0076] In response to a click operation received on the temporarily inserted option, the second tag information is updated, and a stop call request is sent to the second electronic device, where the stop call request is used to instruct to stop calling the second electronic device; wherein the updated second tag information is used to indicate that the second tag operation block is a temporarily inserted tag operation block.
[0077] The second electronic device is further configured to:
[0078] Receive a stop call request;
[0079] Based on the stop call request, stop calling the third target function;
[0080] Display the desktop or the most recently displayed application interface;
[0081] The first electronic device is further used for:
[0082] In response to receiving a click operation on the second label operation block, a second label option box is displayed.
[0083] In a possible implementation, the first electronic device is further configured to:
[0084] In response to the received fourth operation on the first device option, a third label option box is displayed; wherein the third label option box includes at least one third electronic device calling option and at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the electronic device; in response to the received fifth operation on the second calling option, the third label information is updated to fourth label information, and a fourth calling request is sent to the third electronic device, the fourth calling request is used to request to call a fourth target function of the third electronic device; wherein the fourth label information is used to indicate that the electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option;
[0085] The third electronic device is used for:
[0086] receiving a fourth call request;
[0087] Based on the fourth call request, starting a fourth target function and displaying a fourth application interface corresponding to the fourth target function; the fourth application interface includes at least one to-be-inserted object obtained by the third electronic device by calling the fourth target function;
[0088] In response to the received confirmation operation, the second insertion object is sent to the first electronic device.
[0089] The first electronic device is further used for:
[0090] receiving a second insertion object sent by a third electronic device;
[0091] Replace the second tag action block with the second insertion object.
[0092] In a possible implementation, at least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.
[0093] In a possible implementation, the third electronic device is the first electronic device.
[0094] In a possible implementation, the first interface further includes a third option, and the first electronic device is further configured to:
[0095] In response to receiving the fifth operation on the third option, a third label operation block is displayed on the first application interface, where the third label operation block includes third label information, where the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.
[0096] In a possible implementation, the first electronic device is further configured to:
[0097] Receive a drag operation on a first label operation block; move the first label operation block from a current position to another position along with the drag operation; cancel display of the first label operation block; and insert a first insertion object at another position.
[0098] In a possible implementation, the first electronic device is further configured to:
[0099] In the process of calling the first target function of the second electronic device, the input content is updated in response to the received sixth operation.
[0100] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0101] In a fourth aspect, an embodiment of the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.
[0102] In a fifth aspect, an embodiment of the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.
[0103] In a sixth aspect, embodiments of the present application provide a chip comprising a processing circuit and transceiver pins. The transceiver pins and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the first aspect or any possible implementation of the first aspect to control the receive pin to receive a signal and to control the transmit pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS
[0104] FIG1 is a schematic diagram showing a hardware structure of an electronic device;
[0105] FIG2 is a schematic structural diagram of a camera of an electronic device;
[0106] FIG3 is a schematic diagram illustrating a software structure of an electronic device;
[0107] FIG4 is a schematic diagram of an exemplary user interface;
[0108] FIG5 is a schematic diagram illustrating an exemplary process of establishing a communication connection for an electronic device;
[0109] FIG6 is a schematic diagram illustrating an exemplary process of establishing a communication connection for an electronic device;
[0110] 7a to 7c are schematic diagrams of exemplary user interfaces;
[0111] 8a to 8c are schematic diagrams of exemplary user interfaces;
[0112] Figures 9a to 9d are schematic diagrams of exemplary user interfaces;
[0113] FIG10a and FIG10b are schematic diagrams of exemplary user interfaces;
[0114] FIG11a and FIG11b are schematic diagrams of exemplary user interfaces;
[0115] 12a to 12c are schematic diagrams of exemplary user interfaces;
[0116] 13a to 13c are schematic diagrams of exemplary user interfaces;
[0117] 14a to 14e are schematic diagrams of exemplary user interfaces;
[0118] FIG15a is a schematic diagram showing an exemplary scenario in which a tablet computer invokes the camera function of a mobile phone;
[0119] FIG15 b is a schematic diagram showing an exemplary scenario in which a laptop invokes the camera function of a mobile phone;
[0120] FIG16 is a schematic structural diagram of an exemplary device. DETAILED DESCRIPTION
[0121] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application.
[0122] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0123] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.
[0124] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0125] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.
[0126] FIG1 shows a schematic diagram of the structure of an electronic device 100. It should be understood that the electronic device 100 shown in FIG1 is only an example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in FIG1 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits. Exemplarily, the electronic device 100 shown in FIG1 can be an electronic device such as a mobile phone, a tablet, a wearable device, a computer, a vehicle-mounted device, a smart home device, etc., which is not limited in this application.
[0127] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0128] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0129] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0130] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0131] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0132] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0133] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0134] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with the network and other devices through wireless communication technology.
[0135] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0136] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0137] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0138] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0139] Exemplarily, the camera 193 may be located in the edge area of the electronic device, may be an under-screen camera, or may be a liftable camera. The camera 193 may include a rear camera or a front camera. The embodiment of the present application does not limit the specific position and form of the camera 193. The electronic device 100 may include cameras with one or more focal lengths. For example, cameras with different focal lengths may include a telephoto camera, a wide-angle camera, an ultra-wide-angle camera, or a panoramic camera.
[0140] As shown in FIG2 , when the electronic device 100 is a mobile phone, the position diagram of the camera 193 on the mobile phone is shown. Please refer to FIG2 (1). For example, a front camera is provided on the upper part of the display screen of the mobile phone (near the top edge area). The front camera can be one or more. In the embodiment of the present application, the mobile phone includes two front cameras. It should be noted that the layout of the cameras shown in FIG2 (1) (such as horizontal arrangement and spacing) is only an illustrative example and is not limited in this application. Please refer to FIG2 (2). For example, one or more rear cameras are provided on the back of the mobile phone (i.e., the side opposite to the display screen). For example, the rear camera of the mobile phone in FIG2 (2) includes 5 cameras. The 5 cameras can be regarded as a rear camera module or as 5 separate cameras. Among them, the 5 cameras can include but are not limited to: a wide-angle camera, an ultra-wide-angle camera, a panoramic camera, etc., which are not limited in this application.
[0141] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0142] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0143] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0144] FIG3 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0145] The layered architecture of electronic device 100 divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other via software interfaces. In some embodiments, the Android system includes, from top to bottom, but is not limited to: an application layer, an application framework layer, and a kernel layer.
[0146] The application layer can include a series of application packages.
[0147] As shown in Figure 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, tag, memo, etc. In the embodiment of the present application, the memo is used as an example for illustration. In other embodiments, the calling method in the embodiment of the present application can also be applied to any application that provides note-taking (including but not limited to text notes and audio notes, etc.) functions. Optionally, the calling method in the embodiment of the present application can also be applied to other types of application software, such as drawing, mind mapping, etc., which is not limited in the present application.
[0148] In an embodiment of the present application, a memo (or other third-party note application) can call a tag application to implement the calling method in an embodiment of the present application.
[0149] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0150] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[0151] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, sensor drivers, Wi-Fi drivers, etc.
[0152] It is understood that the layers in the software structure shown in FIG3 and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, and this application does not limit this.
[0153] Figure 4 is a schematic diagram of an exemplary user interface. In the embodiment of the present application, the user uses a memo application as an example for explanation. In other embodiments, the calling method in the embodiment of the present application can also be applied to other applications, such as office applications, or other third-party application software that can provide editing functions. The implementation method is the same as the memo application exemplified in the embodiment of the present application, and this application will not illustrate them one by one. Of course, in some instances, the calling method in the embodiment of the present application can also be applied to non-note application software, such as drawing software, etc., and this application does not limit it.
[0154] Referring to (1) of FIG4 , the memo application display interface 401 includes but is not limited to: a note content display window and an option control 402. The note content display window can be used to display note content, which includes but is not limited to: text content, image content, voice content, etc., and this application does not limit this.
[0155] Illustratively, option controls 402 include multiple option controls, including but not limited to: a list option, a style option, an add option 4021, a recording option, and a handwriting option. The number and layout of option controls 402 on memo application display interface 401 are merely illustrative examples. In other embodiments, option controls 402 may include more or fewer option controls, and this application does not limit this.
[0156] Still referring to (1) of FIG4 , the user clicks on the add option 4021. In response to the received user operation, the mobile phone (specifically, the memo application) calls the label application (hereinafter referred to as the execution subject is the mobile phone, which can actually be the label application and will not be repeated below) and displays the option display area 403. Referring to (2) of FIG4 , the mobile phone displays the next level of options for adding controls in the option display area 403, including but not limited to: "Select from Gallery" option, "Photo" option, "Document Scan" option, "Card Collection" option, "Table" option, "From PAD" option 4022 and "From Magicbook" option, etc.
[0157] Among them, the "Select from Gallery" option is used to instruct to select a picture from the local gallery and insert it into the current note.
[0158] The "Take a photo" option is used to call the local camera to take a photo and insert the photo into the current note.
[0159] The "Document Scan" option is used to instruct the device to use its camera to scan a document and insert the scan result into the current note. The scan result can be the result of converting an image (specifically, the text in the image) into text.
[0160] The "Card Collection" option is used to call the local camera to scan the document and insert the scan result into the current note.
[0161] The "Table" option is used to indicate inserting a table.
[0162] The “from PAD” option 4031 and the “from Magicbook” option are used to indicate calling another electronic device (eg, a tablet or a notebook).
[0163] Referring to FIG4 (2), it is assumed that in this example, the user needs to take a photo using a nearby tablet. The user can click on the "From PAD" option 4031. Referring to FIG4 (3), in response to the received user operation, the mobile phone displays the next level of options of the "From PAD" option 4031 in the option display area 403, including but not limited to the "Select from Gallery" option, the "Take a Photo" option 4032, the "Document Scan" option, etc.
[0164] Among them, the "Select from Gallery" option is used to instruct to select a picture from the gallery of another electronic device (such as a tablet) and insert it into the current note.
[0165] The "Take a photo" option 4032 is used to instruct the tablet's camera to take a photo and insert the photo into the current note.
[0166] The "Document Scan" option is used to instruct the tablet's camera to scan a document and insert the scan result into the current note. The scan result can be the result of converting an image (specifically, the text in the image) into text.
[0167] In the embodiments of this application, only the "Select from Gallery" option, the "Photo" option, and the "Document Scan" option are used as examples for illustration. In other embodiments, more options can be set according to actual needs. For example, a "Voice" option can be set to call the microphone of this device or another electronic device and insert the audio collected by the microphone into the current note. The implementation methods of these methods can all refer to the calling methods in the embodiments of this application, and this application will not further illustrate them one by one.
[0168] FIG4 shows the user's operation interface. The following describes the communication interaction between the mobile phone and the tablet (i.e., PAD) in response to the received user operation in conjunction with FIG5 and FIG6. Specifically, FIG5 is a schematic diagram of an exemplary process of establishing a communication connection between an electronic device. Please refer to FIG5, including but not limited to the following steps:
[0169] S501: The mobile phone sends a Discovery Request message to the tablet.
[0170] Exemplarily, in response to the user clicking the add option 4021, the mobile phone (specifically, the tag application) registers with the Nearby (proximity discovery) service. The application's registration with the Nearby service can be understood as the application expecting the Nearby service to provide corresponding services for the application during the use of the application. For example, as mentioned above, the use of the tag application requires turning on the WLAN function and the Bluetooth function. It can also be understood that the business capabilities supported by the tag application include the WLAN function and the Bluetooth function. The tag application can register with the Nearby service and request to call the WLAN function and the Bluetooth function during its use.
[0171] Illustratively, the Nearby service performs a scanning phase. Alternatively, the Nearby service can invoke an underlying module or chip. For example, the Nearby service can invoke a D2D service to cause the D2D service to initiate a Bluetooth connection establishment process. Alternatively, the D2D service can further invoke a D2D driver to control the Bluetooth chip to broadcast Discovery Request messages in real time or periodically.
[0172] It should be noted that in the embodiments of the present application, Bluetooth communication between devices, such as Bluetooth communication between a tablet and a mobile phone, can be maintained through Bluetooth Low Energy (BLE) or classic Bluetooth, which is not limited in this application.
[0173] Exemplarily, the Discovery Request message carries the device information of the mobile phone. Optionally, the device information includes but is not limited to: identification information of the mobile phone (such as device name, device model, Bluetooth address information, etc.), etc., which is not limited in this application.
[0174] S502: The tablet sends a Discovery Response message to the mobile phone.
[0175] For example, any device with Bluetooth enabled near the phone can receive the Discovery Request message sent by the phone. In an embodiment of the present application, among the electronic devices that receive the Discovery Request sent by the phone, the electronic device that has the tag application installed and has the same user account as the phone (for example, a Honor account) can send a Discovery Response message to the phone based on the Bluetooth protocol and the Bluetooth address information of the phone obtained from the Discovery Request message to instruct the phone to establish a Bluetooth connection with the phone.
[0176] For example, there are multiple devices near a mobile phone, including a tablet (PAD), a notebook (Magicbook), and a smart bracelet. Among them, the tablet, notebook, and smart bracelet can all receive the Discovery Request sent by the mobile phone. The tablet and notebook are installed with the tag application and have been pre-registered with the Nearby service. Accordingly, the tablet and notebook obtain the Bluetooth address information of the mobile phone from the Discovery Request message and send a Discovery Response message to the mobile phone to indicate that a Bluetooth connection has been established with the mobile phone. The smart bracelet does not have the tag application installed. Even if it receives the Discovery Request message, it will not reply with a Discovery Response message to the mobile phone. It can also be understood that the smart bracelet will not respond to the detection of the tag application on the mobile phone side.
[0177] Optionally, the Discovery Response message sent by the tablet carries the device information of the tablet, including but not limited to: the Bluetooth address information of the tablet, the identification information of the tablet (such as the device name, device model, etc.), etc., which is not limited in this application.
[0178] It should be noted that Figure 5 only illustrates the interaction between a mobile phone and a tablet. In actual use scenarios, more devices may be included. For example, in this embodiment of the application, a laptop near the mobile phone will also reply to the mobile phone with a Discovery Response message.
[0179] The mobile phone receives the Discovery Response message from the tablet and the notebook, and can obtain the device name and other information from the Discovery Response message. Taking the tablet as an example, the mobile phone obtains the device name of the tablet as "PAD", as shown in (2) of Figure 4. The mobile phone displays the "From PAD" option in the option display area 403. This option can be understood as the tag application searching for the PAD near the mobile phone through the Bluetooth of the mobile phone (or other wireless transmission modules), and the PAD can be called. The device described in the embodiment of the present application being called by another device means that the device has a wireless transmission function, has the same account as the other device, and is set with a tag application.
[0180] S503: The mobile phone sends a Bluetooth connection request message to the tablet.
[0181] For example, as shown in (2) of FIG4 , when the mobile phone receives a signal from the user that the user clicks the “From PAD” option, it may determine that a wireless connection needs to be established with the PAD to exchange data. Accordingly, the mobile phone may send a Bluetooth connection request message to the tablet based on the tablet's Bluetooth address information carried in the Discovery Response message, indicating that a Bluetooth connection is established with the tablet. Optionally, the connection request message may carry information such as the tablet's Bluetooth address information and the tablet's Bluetooth address information, which is not limited in this application.
[0182] S504: The tablet establishes a Bluetooth connection with the mobile phone.
[0183] Exemplarily, after receiving the Bluetooth connection request message sent by the mobile phone, the tablet establishes a Bluetooth connection with the mobile phone.
[0184] It should be noted that in S504, the mobile phone and the tablet can perform multiple Bluetooth signaling interactions to transmit the information required to establish a Bluetooth connection. The specific interaction process can refer to the content in the Bluetooth protocol, and this application will not repeat it.
[0185] S505: The mobile phone establishes a Wi-Fi connection with the tablet.
[0186] For example, after a mobile phone and a tablet establish a Bluetooth connection, the mobile phone and the tablet can exchange data based on the Bluetooth connection. For example, in an embodiment of the present application, the mobile phone and the tablet can exchange Wi-Fi connection establishment information via the Bluetooth connection. Correspondingly, the mobile phone and the tablet can establish a Wi-Fi connection with the other end based on the obtained Wi-Fi connection establishment information. The method for establishing a Wi-Fi connection can refer to the existing technical embodiments and is not limited in this application.
[0187] For example, as shown in FIG6 , a mobile phone establishes a Wi-Fi connection with a tablet, and data interaction can be performed based on the Wi-Fi connection. Optionally, in an embodiment of the present application, the tablet's tag application can send tag functions that the tablet can provide to the mobile phone via the Wi-Fi connection, such as but not limited to: gallery function, photo function, and document scanning function. Accordingly, the mobile phone obtains that the PAD can provide gallery function, photo function, and document scanning function, which can also be understood as the mobile phone being able to call the PAD's gallery, photo, and document scanning functions. As shown in (3) of FIG4 , the mobile phone can display option controls corresponding to the callable functions in the option display area 403, such as but not limited to: "Select from gallery" option, "photo" option, and "document scanning" option.
[0188] Still referring to (3) of Figure 4, in this example, a user uses a mobile phone to take notes and then uses the tablet's camera function to take a photo. For example, the user clicks the "take photo" option to instruct the tablet to take a photo.
[0189] Figures 7a to 7c are schematic diagrams of user interfaces shown as examples. Referring to Figure 7a, in response to the received user operation, the mobile phone cancels the display option display area 403 and displays a label 601 at the current cursor position (assuming that the current cursor position is at the end of the text content). It should be noted that the cursor may be displayed at the end of the text content or may be hidden, and this application does not limit this. It should be further noted that in the embodiment of the present application, a memo is used as an example for explanation, and the insertion position of the text or other content in the software is based on the cursor. As mentioned above, the method in the embodiment of the present application may also be applied to some other types of software, such as drawing or mind mapping software, which may not have a cursor. In this case, the insertion position of the text or other content (such as the label in the embodiment of the present application) can be set according to the user operation (such as a click operation), and this application does not limit this.
[0190] Exemplarily, the label 601 includes but is not limited to: a calling object 6011 (which may also be referred to as a first inserted object or an added object, etc., which is not limited in this application) and more options 6012. Among them, the calling object 6011 is used to describe the electronic device currently being called and the function being called. For example, in the current scenario, the mobile phone responds to the user clicking the "take a photo" option, and determines that the electronic device being called is a tablet, and the function being called is the tablet's photo function. Accordingly, the calling object 6011 in the label 601 displayed by the mobile phone shows "Taking photo using "PAD"", which is used to indicate that the mobile phone is calling the tablet's photo function.
[0191] More options 6012 may provide more label functions, and the user may switch the electronic device and / or function to be called through more options 6012, which will be further described in detail in the following embodiments.
[0192] For example, the positional relationship between the calling object 6011 and the more options 6012 in the label 601 is only an illustrative example and can be set according to actual needs, and this application does not limit it.
[0193] For example, the style of label 601 is a schematic example and can be set according to actual needs, and this application does not limit it.
[0194] For example, the height of label 601 may be the same as or different from the height of the text line in the note, and may be set according to actual needs, which is not limited in this application.
[0195] Optionally, the user can set the style of the label (including size, color, border shape, etc.) in the label application, which is not limited in this application.
[0196] Optionally, the label 601 may be highlighted to highlight the location of the label.
[0197] Optionally, the label 601 can be set to a four-sided type, a tight type or a surrounding type. The plate type of the label 601 can be a default type or can be set by the user in the label application, and this application does not limit it.
[0198] Still referring to Figure 7a, the mobile phone should determine that it needs to call the tablet's camera function based on the received user operation. The mobile phone can send a camera call request to the tablet through the Wi-Fi connection between the mobile phone and the tablet to request to call the tablet's camera. The tablet (specifically, the tag application in the tablet) responds to the received camera call request and starts the local camera to capture images. The photo preview interface is displayed in the display interface 701 of the tablet. The photo preview interface includes but is not limited to: a photo preview window and a photo button 702 (or photo control). Among them, the photo preview window is used to display the image captured by the camera in real time. The position and size of the photo preview window can be set according to actual needs, and this application does not limit it.
[0199] For example, the user can click the photo button 702 to instruct the tablet to take a photo. Referring to Figure 7b, in response to the received user operation, the tablet displays content in the display interface 701, including but not limited to: an image 703 captured by the camera (also referred to as a preview image, not limited in this application), a confirmation option 704, and a cancel option 705. In one example, if the user clicks the cancel option 705, the tablet returns to the photo preview interface shown in Figure 7a, i.e., the camera is called again to capture the current image. In this example, the user can click the confirmation option 704 to confirm the insertion (or addition) of the image 703 into the memo application.
[0200] Referring to Figure 7c, in response to the user clicking on the confirmation option 704, the tablet sends an image 703 to the phone via the Wi-Fi connection between the tablet and the phone. Optionally, after sending the image 703, the tablet displays the desktop 706. In other embodiments, after sending the image 703, the tablet may also display the interface displayed before the photo was taken, such as a video application, but this application is not limited thereto.
[0201] For example, the phone's label application receives image 703 sent by the tablet. The label application can transmit image 703 to the memo application. The memo application can delete label 601 and insert image 703 in the original label 601's place. Optionally, the insertion position of image 703 can be based on the position of the left border of the original label 601. In other embodiments, the insertion position of image 703 can also be based on the right border or the center of the original label 601, which is not limited in this application.
[0202] It should be noted that, as shown in Figure 7c, there is an offset between the origin of image 703 (e.g., the upper left corner of image 703) and the position of original label 601. This is because the memo application adjusts the insertion position of image 703 based on the size of image 703 to fully display image 703. It can be understood that in this scenario, the insertion position of image 703 can still be considered to be the position of original label 601.
[0203] Optionally, the memo application can resize the image 703 before inserting it into the note. The specific adjustment strategy can be set according to actual needs and is not limited in this application.
[0204] In one possible implementation, the Wi-Fi connection between the phone and tablet can continue to be maintained and automatically disconnected after the aging time (which can be set according to actual needs and is not limited by this application) exceeds. In this example, within the aging time, if the user executes the process in Figure 4 again, that is, the phone calls the tablet to perform functions such as taking a photo again, the connection establishment process shown in Figure 5 can be skipped, and data exchange can be carried out directly based on the current Wi-Fi connection that has not been disconnected.
[0205] In another possible implementation, the tablet can disconnect from the mobile phone after transmitting the image 703. In this example, if the user executes the process in Figure 4 again to call the tablet to perform functions such as taking a photo, the mobile phone and tablet will re-execute the connection establishment process in Figure 5.
[0206] Thus, embodiments of the present application provide a convenient calling method that uses a tag insertion method to determine the location of the object to be inserted. Furthermore, the tag allows the object to be selected. Furthermore, by inserting tags, the operation steps for the first object insertion are effectively simplified, shortening the operation time and preventing the user from missing important content due to the first object insertion.
[0207] The calling method in the embodiment of the present application can also perform other operations on the application interface to be inserted during the process of executing the first insertion object, such as modifying or deleting the note content, adjusting the size or position of the inserted image, etc., which is not limited in this application.
[0208] The following example illustrates modifying text content during the first object insertion process. Figures 8a to 8c are schematic diagrams of exemplary user interfaces. Referring to Figure 8a, a mobile phone invokes the tablet's camera function, and the tablet's camera is capturing an image. That is, the tablet currently displays the photo preview interface, which displays the real-time image captured by the camera. In this scenario, the user can tap anywhere on the memo application interface 401. In response to the user action, the mobile phone displays a soft keyboard 802. For example, the user can tap the desired insertion location to move the cursor 801 to the location where the text is to be inserted. For example, using Figure 8a, after the mobile phone inserts label 601, the cursor 801 is positioned after label 601 (i.e., after the right border of label 601). The user taps a location after the last text in the note. In response to the user action, the mobile phone displays the soft keyboard 802 and displays the cursor 801 at the location the user tapped (e.g., the first location), indicating that the subsequent text or image will be inserted at that location. The position of cursor 801 is for illustrative purposes only; the user can move the cursor to any location. Optionally, in some instances, the cursor 801 may be hidden and displayed only after the user clicks on the interface, in response to the received user operation, the cursor is displayed at the corresponding position, which is not limited in this application.
[0209] Referring to Figure 8b , after the user enters text, cursor 801 moves to the currently displayed position. Correspondingly, label 601 moves backward as the text is entered. That is, it moves from the first position shown in Figure 8a to the second position shown in Figure 8b . During this process, the tablet's camera continuously captures images. Optionally, the images captured by the tablet may change, which is not limited in this application.
[0210] For example, the user performs operations such as taking a photo and confirming an image, as shown in Figures 7a and 7b. After the tablet transmits the image to the mobile phone via Wi-Fi, the tablet displays desktop 706. For a detailed description, please refer to Figure 7c and will not be repeated here.
[0211] Referring to Figure 8c , the phone receives image 703 sent from the tablet, deletes label 601 (which can also be understood as un-displaying label 601), and displays image 703 in the original location of label 601 (i.e., the second location shown in Figure 8b ). In other words, in this embodiment of the present application, the image insertion position moves with the position of the label. For example, the position of image 703 in Figure 8c is shifted down one row compared to the position of image 703 in Figure 7c .
[0212] It should be noted that the above embodiment is only described by taking the process of the tablet camera capturing images and the user modifying the note content in real time as an example. In the embodiment of the present application, the user can modify the note content in real time when calling any step of the method execution. For example, in the scenario shown in Figure 7b, that is, when the user clicks the photo option and the tablet displays the preview image, the user can also modify the note content. In other words, at any moment before the user clicks the confirmation option 704, that is, before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted picture, the user can modify the note content on the mobile phone side.
[0213] In this way, the calling method provided in the embodiment of the present application can also provide a real-time modification solution, so that the user can modify the content of the interface to be inserted at any time during the first insertion of the object, that is, the process of calling other devices. In other words, the process of the mobile phone calling other devices will not affect the user's use of other functions of the current application.
[0214] For example, the label in the embodiments of the present application can also provide more functional options. Figures 9a to 9d are schematic diagrams of exemplary user interfaces. Referring to Figure 9a, a user can click on the More option 6012 in label 601 to change the first inserted object, including changing the invoked electronic device and / or changing the invoked function. Referring to Figure 9b, for example, in response to receiving a user click on the More option 6012, the mobile phone displays a label option box 901. Label option box 901 includes, but is not limited to, option box 9011 and option box 9012. Option box 9011 includes options corresponding to the available functions provided by the currently invoked device, such as a tablet. For example, as described above, after the mobile phone establishes a Wi-Fi connection with the tablet, the mobile phone can access the available functions provided by the tablet's label application, including, but not limited to, taking a photo, scanning a document, and selecting from a gallery. Accordingly, option box 9011 may include, but is not limited to, options corresponding to the corresponding functions provided by the tablet, such as taking a photo, scanning a document, and selecting from a gallery. That is to say, the options it contains are the same as those in (3) of Figure 4. It can be understood that in the embodiment of the present application, the user can preliminarily select the first insertion object (including the called electronic device and / or the called function) through (2) and (3) of Figure 4. After inserting the label and before the first insertion object, the user can also change the first insertion object through more options 6012.
[0215] Exemplarily, the option box 9012 includes but is not limited to options corresponding to other callable devices. For example, the "Local" option and the "From Magicbook" option. Optionally, the option box 9012 may also include a cancel insertion option, etc. Among them, the "Local" option is used to switch the calling device. For example, if the user clicks on the local option, the mobile phone will call the corresponding function of the local device. The specific example will be described below. The "From Magicbook" option is also used to switch the calling device. For example, if the user clicks on this option, the label option box 901 will display options corresponding to the callable functions that can be provided by the notebook (i.e., Magicbook). The user can delete the label 601 by clicking on the "Cancel Insert Option". The user can also delete the label 601 in other ways. For example, the user clicks on the position to the right of the label 601 to call out the soft keyboard (802 as shown in Figure 8b), and clicks on the delete control on the soft keyboard. The mobile phone can delete the label 601 in response to the user's above operation.
[0216] It should be noted that in this example, the mobile phone is currently calling the tablet, that is, in the initial insertion tag, that is, in the scenario shown in Figure 4, the user chose to call the tablet's photo-taking function. Accordingly, the option box 9011 will display more functions that the tablet can provide, such as options corresponding to functions such as document scanning. Assume that in the initial insertion tag, that is, in the scenario shown in Figure 4, the user chose to call the notebook (i.e., Magicbook)'s photo-taking function. Accordingly, the option box 9011 will display more functions that Magicbook can provide.
[0217] In this example, the user clicks on the document scanning option in the "From PAD" option in option box 9011, i.e., the user instructs to invoke the tablet's document scanning function. This can also be understood as the user instructing to switch the currently invoked tablet's camera function to the document scanning function. Referring to Figure 9c, in response to receiving the user's click on the "Document Scan" option, the mobile phone updates the invoked object 6011 in label 601 to "Using "PAD" Document Scanning", indicating that the currently invoked device is the tablet and the invoked function is the tablet's document scanning function.
[0218] For example, the mobile phone sends a document scanning function call request to the tablet, requesting the tablet to use the document scanning function. In response to the received document scanning function call request, the tablet cancels the photo taking function, i.e., cancels the display of the photo taking preview interface. The tablet continues to use the camera to perform the document scanning function, and the tablet displays the document scan results on the display interface 902.
[0219] In one possible implementation, the document scanning function provided by the tablet is used to identify the document and its boundaries in the image captured by the camera, and based on the identified boundaries, the image captured by the camera is cropped to obtain an image 903 (referred to as the document image) containing only the document content. Accordingly, the tablet sends the identified document image 903 to the mobile phone. The mobile phone displays the document image 903 in the display interface 902. The specific display method can be referred to Figure 7c, which will not be repeated here. It should be noted that the document scanning result displayed by the tablet in Figure 9c is only an illustrative example and is not limited by this application.
[0220] In one possible implementation, the mobile phone can also call the text recognition function of the tablet. The text recognition function provided by the tablet is used to obtain a picture scanned by the camera and recognize the text in the picture (for example, optical character recognition (OCR)) to obtain a recognition result and convert the text in the picture into text.
[0221] For example, the tablet's display interface 902 may also display a cancel option and a confirm option. In one example, if the user clicks the cancel option, the tablet re-scans the document, obtains, and displays new document scan results. In this example, the user can click the confirm option to confirm the insertion of the document scan results obtained by the tablet into the phone's memo app. In response to the received user operation, the tablet sends the document scan results to the phone via a Wi-Fi connection. Furthermore, the tablet displays the desktop (described above and not repeated here).
[0222] Exemplarily, in response to receiving the document result, the mobile phone deletes label 601 and displays the received document scan result in the original label 601's location. The specific display method can be seen in Figure 7c and will not be described in detail here. Optionally, the memo can be inserted directly into the document scan result in the original label 601's location. In other embodiments, the memo can be inserted into the document scan result one line above or below the original label 601's location. This configuration can be adjusted based on actual needs and is not limited by this application.
[0223] Referring to Figure 9d , in this example, the user clicks the "Select from Gallery" option in option box 9011 in Figure 9b , instructing the mobile phone to call the tablet's gallery application. This can also be understood as the user instructing to switch the currently called tablet's camera function to call the tablet's gallery. In response to receiving the user's click on the "Select from Gallery" option, the mobile phone switches the call object 6011 in label 601 to "Selecting from "PAD" Gallery" to indicate that the currently called device is the tablet and the called function is the tablet's gallery.
[0224] For example, the mobile phone sends a request to the tablet to call the tablet's gallery. In response to the received request, the tablet cancels the photo function (i.e., the operation currently being executed in Figure 9b) and displays the gallery application interface on display interface 902. The gallery application interface includes, but is not limited to, at least one image stored on the tablet (or possibly in the cloud).
[0225] For example, the user can click on the picture to be inserted. In response to the received user operation, the tablet can display a picture confirmation interface, the interface display method of which can be referred to in FIG7b, that is, the interface includes but is not limited to: picture, cancel option and confirmation option.
[0226] In this example, the user clicks the confirmation option to confirm the insertion of the user-selected picture. In response to receiving the user's click to confirm the option, the tablet sends the picture to the mobile phone. In addition, the tablet displays the desktop (the description can be found above and will not be repeated here).
[0227] It should be noted that, on the tablet interface in FIG9 d , the user can also select multiple pictures at a time and insert multiple pictures into the mobile phone.
[0228] For example, in response to the received picture, the mobile phone deletes the label 601 (ie, cancels the display of the label 601) and displays the received picture at the location of the original label 601. The specific display method can be seen in FIG7c and will not be described in detail here.
[0229] It should be noted that the first insertion object modification scheme in the above embodiments is based on Figure 9b, which illustrates the example of a mobile phone modifying a function in response to a received user operation while the tablet's camera is capturing an image. In other embodiments, the first insertion object modification scheme described above can be executed at any time when the user confirms the insertion of an image or text on the tablet, such as before clicking the confirmation option, that is, before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted image. The implementation method is the same as above, and this application will not further illustrate each example one by one.
[0230] The calling method in the embodiment of the present application also supports the position change of the label, so that the label and the subsequently inserted objects (including but not limited to text, pictures, etc.) are moved to the specified position according to the user's instructions. The following is an explanation with a specific example. Figures 10a and 10b are schematic diagrams of user interfaces shown as examples. Please refer to (1) of Figure 10a. The mobile phone currently calls the tablet's photo function, and the photo preview interface is displayed in the tablet's display interface 701. For a specific description, please refer to Figure 7b and will not be repeated here. For example, the user can long press (or other gestures, which are not limited in this application) the label 601 and drag the label 601. Please refer to (2) of Figure 10a. In response to the received long press operation of the user, the mobile phone determines that the user needs to drag the label 601. Then, in response to the received drag operation, the mobile phone moves the label 601 on the interface 401 following the user's finger, for example, to the third position shown in (2) of Figure 10a (this position is only a schematic example and is not limited in this application). For example, while the user is dragging the tab 601, the tablet's display interface 701 continues to display a photo preview interface, and the photo preview interface displays the image captured in real time by the tablet's camera. In other words, while the user is moving the tab 601, the phone keeps invoking the tablet's photo function.
[0231] Optionally, during the movement of the label 601, the note content in the memo interface 401 may change its position as the label moves. For example, as shown in (2) of FIG10a , in response to the received user operation, the mobile phone moves the label 601 from the first position shown in (1) of FIG10a to the third position shown in (2) of FIG10a , and part of the text, such as “Experience, understand what you want, give you what you need” in the figure, moves backward from the original position (i.e., the third position) to behind the right border of the label 601.
[0232] Optionally, as described above, the layout of label 601 can be four-sided, tight, and surrounding, etc. The mobile phone can move other texts accordingly based on the layout of label 601 so that the text content in the note and label 601 are in the specified layout.
[0233] Optionally, in an embodiment of the present application, if the distance between the position where the label is inserted and the border of the display window 401 (i.e., the right border of the display window 401) (for example, the second length) is less than the length of the label 601 (for example, the first length). In one example, the mobile phone can automatically move the label 601 down to the next line. The text or picture and other content behind the label are moved back accordingly. In another example, the mobile phone can shorten the label 601 to less than or equal to the second length. For example, the mobile phone can display the call object 6011 in the label 601 in a thumbnail, which is not limited in this application.
[0234] Please refer to Figure 10b. For example, the user can perform the operations shown in Figures 7a and 7b to instruct the tablet to send image 703 to the mobile phone. In response to the received image 703, the mobile phone deletes the label 601 (i.e., cancels the display of label 601) and displays the image 703 at the position of the original label 601. Optionally, based on the size of the image 703, the memo application moves the origin of the image 703 (i.e., the upper left corner of the image 703) down one line from the position to be inserted (e.g., the position of the left border of the original label 601) and displays the image 703 at this position. In this example, the position of the origin of the image 703 and the position to be inserted (e.g., the position of the left border of the original label 601) can both be considered as the insertion position of the image 703, and this application does not limit this.
[0235] For example, in this example, after the memo application inserts the picture 703, the text after the original label 601 is moved back accordingly. Optionally, the text after the original label 601 can also be moved down one line, which is not limited in this application.
[0236] Optionally, similar to the layout of labels, the layout of pictures inserted in the memo application can also be set according to actual needs. Moreover, the layout of text will be different depending on the picture layout.
[0237] In this way, the calling method in the embodiment of the present application also supports the position change of the label, so that the label and subsequently inserted objects (including but not limited to text, pictures, etc.) are moved to the specified position according to the user's instructions, further improving the flexibility of the first inserted object and meeting the user's more scenario needs.
[0238] The calling method in the embodiment of the present application also supports deleting the tag 601 at any time. For example, at any time before the tablet sends the first inserted object (including a picture or text, etc.) to the mobile phone, that is, before the tablet sends the image to the mobile phone, which can also be understood as before the mobile phone displays the inserted image, the user can delete the tag to cancel the first inserted object.
[0239] In one possible implementation, the user can delete the label through the cursor. Figure 11a is an exemplary user interface diagram. Please refer to (1) of Figure 11a. After the mobile phone inserts the label 601 in response to the received user operation, the current position of the cursor 1002 is after the right border of the label 601. Optionally, after the mobile phone displays the label 601, the cursor can be hidden. After the mobile phone displays the soft keyboard in response to the received user operation, that is, after determining that text content needs to be entered, the cursor is displayed again. This application does not limit this. That is to say, as described above, in some instances, the cursor can be hidden and displayed, and the cursor is only displayed after receiving the user's click operation on the interface. This application does not limit this.
[0240] For example, the user clicks anywhere on the memo application interface 401, and the mobile phone displays a soft keyboard in response to the received user operation. The user can click the delete key on the soft keyboard to delete the content before the cursor 1002. Referring to (2) of Figure 11a, the mobile phone deletes the content before the cursor 1002 in response to the received user operation of clicking the delete key, that is, deletes the label 601.
[0241] Please refer to (2) of Figure 11a. After the mobile phone deletes the tag 601, it sends an instruction message to the tablet to instruct the cancellation of calling the tablet. In response to the received instruction message, the tablet cancels the display of the photo preview interface and displays the desktop 1101 (or the last interface displayed previously). Optionally, the mobile phone can disconnect the Wi-Fi connection with the tablet. In other embodiments, the mobile phone can also maintain the Wi-Fi connection with the tablet and disconnect the Wi-Fi connection with the tablet after a certain period of time (and if the tablet is not called again within a certain period of time).
[0242] In another possible implementation, the user can delete the label 601 by selecting the Cancel Insert option in the option box 901. Referring to (1) of FIG11B , the user can click the More option 6012 in the label 601. In response to receiving the user's click on the More option 6012, the mobile phone displays the label option box 901. The description of the label option box 901 can be found above and will not be repeated here.
[0243] For example, the user can click the Cancel Insert option in the label option box 901 to indicate that the display of label 601 is canceled. Referring to FIG11b (2), the mobile phone deletes label 601 in response to receiving the user's click on the Cancel Insert option. For other descriptions, please refer to FIG11a and will not be repeated here.
[0244] The calling method in the embodiment of the present application can also provide a temporary insertion solution, which can temporarily mark the location where the first object needs to be inserted by temporarily inserting a label, thereby solving the problem that the user is currently inconvenient to perform other operations. The user can modify the label at any time in the future to insert the corresponding content, thereby continuing to supplement the corresponding content. For example, Figures 12a to 12c are schematic diagrams of user interfaces shown as examples. Please refer to (1) of Figure 12a, combined with (2) of Figure 4, after the user clicks on the add option 4021, the mobile phone displays the option display area 403 in response to the user's operation of clicking on the add option 4021. The option display area 403 includes but is not limited to the "Select from Gallery" option, the "Photographing option", etc., and the specific description can be referred to (2) of Figure 4, which will not be repeated here. In this example, the option display area 403 can also include an "Insert Label Only" option to support the user to temporarily insert a label. The user can click on the "Insert Label Only" option to indicate the temporary insertion of a label.
[0245] Please refer to (2) of Figure 12a. In response to the received user operation, the mobile phone inserts a label 1201 at the current cursor position. Optionally, the current position of the cursor may be at the end of the text that has been entered. For a specific description, please refer to Figure 7a and will not be repeated here. Among them, the label 1201 includes but is not limited to: an insert label prompt 1201a and more options 1201b. Among them, the insert label prompt 1201a is used to indicate that the current label is a temporary label. Optionally, the words in the insert label prompt 1201a may also be "temporary label", etc., which can be set according to actual needs and is not limited in this application.
[0246] It should be noted that Figure 12a only takes the temporary insertion of one tag 1201 as an example for illustration. In actual usage scenarios, the mobile phone can insert multiple temporary tags according to user operations, and the positions of the multiple temporary tags are set according to user operations, which is not limited in this application.
[0247] Optionally, the mobile phone can also move the position of the temporary label in response to a received user operation (such as a drag operation). For example, the user can long press label 1201 and drag label 1201 to a specified position. In response to the received long press operation of label 1201, the mobile phone determines that the user needs to move the temporary label 1201. Then, in response to the received drag operation, the mobile phone moves the cursor 1201 to label 1201 in the direction of the user gesture, and displays label 1201 at the position before the user raises his hand. The specific implementation method is similar to that in Figure 10a and will not be repeated here.
[0248] In another implementation, the label option box (e.g., label option box 901) may also include an "Insert label only" option, so that the user can cancel the current call operation at any time, but the label is not deleted, so that the label can achieve a marking effect at the current location, and the user can re-operate the label at any subsequent time to insert the target object. For example, please refer to Figure 12b, and take the mobile phone currently calling the tablet's camera function as an example for explanation. The specific description can be referred to Figure 7a, which will not be repeated here. Exemplarily, during the process of the mobile phone calling the tablet's camera function, the user can click on more options 6012 (the relevant description can be referred to above, which will not be repeated here). In response to the received user operation, the mobile phone displays the label option box 901. Optionally, the option box 9012 in the label option box 901 may include an "Insert label only" option. The description of other controls or options can refer to the relevant content in the above embodiment, which will not be repeated here.
[0249] Exemplarily, the user clicks on the "Insert tag only" option in the option box 9012 to indicate that the current tag 601 is switched to a temporary tag. In response to the user clicking on the "Insert tag only" option, the mobile phone cancels the display of tag 601 and displays a temporary tag 1201. The display method can refer to Figure 12a and will not be described here. Optionally, in this example, in response to the user clicking on the "Insert tag only" option, the mobile phone can change the call object 6011 in the tag 601 to "Insert tag prompt", for example, changing the words "Taking a photo with "PAD"" to "Insert tag" to indicate that the current tag is a temporary tag. The tablet can exit the camera interface and return to the desktop or other application interface.
[0250] It should be noted that Figure 12b only uses the scenario in Figure 7a as an example. In other embodiments, the process shown in Figure 12b can be executed at any time before the tablet sends results such as pictures or text to the mobile phone. That is, the user can modify the currently displayed label to a temporary label at any time before confirming the first inserted object.
[0251] Referring to Figure 12c, illustratively, after inserting temporary tag 1201, the user can click on "More" option 1201b in temporary tag 1201 at any time to update the inserted object. In response to receiving the user's click on "More" option 1201b, the mobile phone displays a tag option box 1202, which includes, but is not limited to, option boxes 1202a and 1202b. Option box 1202a optionally displays options corresponding to some available functions provided by the mobile phone (i.e., the mobile phone), including, but not limited to, "Photo Capture," "Document Scan," and "Select from Gallery." Option box 1202b includes, but is not limited to, "From PAD," "From Magicbook," "Insert Tag Only," and "Cancel Insert." The user can click on an option in option box 1201a to invoke the corresponding function on the mobile phone, thereby inserting the corresponding object. Optionally, the user can also click the "From PAD" option or the "From Magicbook" option in the option box 1201b to call the corresponding function of the tablet or notebook to insert the specified object. For example, the user can click the "From PAD" option to indicate the call of the corresponding function of the tablet. In response to the received user operation, the mobile phone establishes a Wi-Fi connection with the tablet. The mobile phone can obtain the callable functions provided by the tablet through the Wi-Fi connection. The mobile phone can display options corresponding to the functions provided by the tablet in the option box 1202a, such as but not limited to the "Take a photo" option, the "Document Scan" option, and the "Select from Gallery" option. For a specific description, please refer to Figure 9b, which will not be repeated here.
[0252] Optionally, the user can also delete the temporary label by using the cursor or clicking the "Cancel Insert" option. The specific method can be found in the description of Figures 11a and 11b, which will not be repeated here.
[0253] In the embodiments of the present application, different electronic devices may also provide fewer or more functions than those listed in the embodiments of the present application. When the called devices are different, the corresponding callable function list options are different, which can be specifically displayed according to the type and hardware capabilities of the called devices. For example, Figures 13a to 13c are schematic diagrams of user interfaces shown as examples. Referring to Figure 13a, after the mobile phone establishes a Wi-Fi connection with the tablet, some functions provided by the tablet's label application can be obtained through the Wi-Fi connection, such as the tablet can provide a photo taking function, a document scanning function, and a gallery selection function. Optionally, in this example, the tablet's label application is registered with the handwriting application, and a handwriting board application can be called to provide a handwriting function for the mobile phone's label application. Accordingly, the mobile phone can obtain the handwriting function provided by the tablet through the Wi-Fi connection between the mobile phone and the tablet. As shown in Figure 13a, the user clicks on the more options 6012 in the label 601, and the mobile phone displays the label option box 1301 in response to the received user operation. The tab option box 1301 includes, but is not limited to, the "Photo" option, "Document Scan" option, and "Select from Gallery" option corresponding to the tablet's photo function, document scanning function, and gallery function, respectively, and may also include a "Handwriting" option corresponding to the handwriting function. For other undescribed contents, please refer to the relevant contents in the above embodiment and will not be repeated here.
[0254] Exemplarily, the user can click on the "Handwriting" option to indicate that the handwriting function of the tablet is being called. Please refer to Figure 13b. Exemplarily, in response to the received user operation, the mobile phone changes the calling object in label 601 to "Using "PAD" Handwriting" to indicate that the electronic device currently called is a tablet, and the function called is the handwriting function of the tablet. The mobile phone sends an indication message to the tablet to indicate the call of the handwriting function of the tablet. The tablet receives the indication message sent by the mobile phone via a Wi-Fi connection, and calls the handwriting function of the local machine (i.e., the tablet) or other applications with a handwriting function, such as a memo. In the embodiment of this application, only the memo application is used as an example for illustration. In other embodiments, it can also be other applications, and this application does not limit it.
[0255] 13b, the tablet's display interface 701 displays a memo application interface, which includes but is not limited to a handwriting input area, a cancel option (also known as a return option), and a confirmation option 1302.
[0256] For example, the user can input corresponding content in the handwriting input area of the tablet using a stylus. The input content in FIG13b is only an illustrative example and is not limited in this application.
[0257] After the user completes the stylus input, they can click Confirm 1302. As shown in Figure 13c, the tablet generates image 1303 in response to the received user input. Image 1303 includes the content entered by the user using the stylus. The tablet then transmits image 1303 to the mobile phone via Wi-Fi. Furthermore, the tablet displays the desktop.
[0258] For example, the mobile phone receives image 1303 sent by the tablet. The mobile phone deletes label 601. Furthermore, the mobile phone inserts image 1303 at the location of the original label 601. The specific insertion method can be referred to above and will not be repeated here.
[0259] It should be noted that the present application embodiment only uses the handwriting function as an example for illustration. In other embodiments, the called electronic device (such as the tablet in the present application embodiment) can provide more functions and can be set according to actual needs, which is not limited in this application.
[0260] It should be further explained that FIG13a only uses the example of a user selecting the handwriting function from option box 1301 for illustration. In this example, the option display area 403 in FIG4 (3) can also display the "Handwriting" option corresponding to the handwriting function provided by the tablet. After the user clicks the "Handwriting" option, the process executed by the mobile phone and the tablet is the same as that in FIG13b to FIG13c, and will not be repeated here.
[0261] In an embodiment of the present application, the user can also call the relevant function of the mobile phone to insert a specified object while taking notes. As shown in (2) of Figure 4, in an embodiment of the present application, the mobile phone displays the options corresponding to the first insertion object that the mobile phone can provide, such as but not limited to: "Select from Gallery" option, "Photo" option, "Document Scan" option, "Card Collection" option, etc. The user can click on the corresponding option to call the corresponding function of the mobile phone to insert the specified object. The mobile phone calls the corresponding function in response to the received user operation. For the specific implementation, please refer to the description in Figure 14a.
[0262] Figures 14a through 14e illustrate exemplary user interface diagrams. Referring to Figure 14a , for example, a user taps More option 6012 in tab 601 . In response to this user action, the phone displays tab options 901 . A description of each option in tab options 901 is provided in Figure 9b and is not repeated here.
[0263] Exemplarily, the user can click on the "From this machine" option to indicate the call of the relevant functions of this machine. As shown in Figure 14b, during the execution process, the mobile phone is calling the tablet's camera function. For a specific description, please refer to Figure 7a and will not be repeated here. In response to the received user operation, the mobile phone displays the options corresponding to the functions provided by this machine in the option box 9011. For example, the "take a photo" option, the "document scan" option, and the "select from gallery" option. In other words, the options corresponding to the functions provided by the tablet originally displayed in the option box 9011 are replaced with options corresponding to the functions provided by the mobile phone. That is, at the top of the option box 9011, the words "From this machine" are displayed to indicate that the options displayed in 9011 all correspond to the functions provided by the mobile phone.
[0264] Optionally, as shown in FIG14c, in response to receiving the user's click on the "From Local Device" option, the mobile phone displays option box 1401. In this example, option box 1401 can be considered as the next level option of the "From Local Device" option. That is, the mobile phone still displays option box 901, and displays option box 1401 in a position near option box 901 (which can be set according to the position of option box 901 in the interface, which is not limited by this application). A description of option box 1401 can be found in FIG14b and will not be repeated here.
[0265] In this example, the user clicks on the "Take a photo" option, which is used to instruct the local camera function to be called. As shown in Figure 14d, the mobile phone responds to the received user operation and determines that the user instructs to call the local camera function. The mobile phone sends an instruction message to the tablet to instruct the cancellation of the call to the tablet. In response to the received instruction message, the tablet cancels the call to the local camera and displays the desktop (it can also display the interface before the camera is called, which is not limited in this application). Optionally, the Wi-Fi connection between the mobile phone and the tablet can be disconnected or maintained, which is not limited in this application.
[0266] For example, a mobile phone uses its camera. The phone displays a photo preview interface 1401. The photo preview interface 1401 includes, but is not limited to, a photo preview window and multiple controls. The photo preview window displays images captured by the phone's camera. The controls include, but are not limited to, a photo control 1402 and a lens flip control.
[0267] The user clicks the photo control 1402. As shown in (1) of Figure 14e, in response to receiving the user's click on the photo control 1402, the mobile phone displays an image preview interface 1403. The image preview interface 1403 includes, but is not limited to, a confirmation option 1404, a cancel option 1405, and an image 1406. The image 1406 is the image captured by the camera.
[0268] The user can click the confirmation option 1404 to indicate the insertion of the image 1406. In response to the received user operation, the mobile phone deletes the label 601 and displays the image 1406 in the position of the original label 601. The specific insertion method can be referred to above and will not be repeated here.
[0269] In one possible implementation, the functions that can be called in the embodiment of the present application have already applied for corresponding permissions in advance. In one example, the permissions corresponding to the functions that can be called by the label application are default. For example, taking a mobile phone as an example, during the initialization process of the mobile phone, the label application can register the access permissions corresponding to the functions that need to be called with the permission management module, such as the permission to access the camera, the permission to access the gallery, etc. Correspondingly, in (1) of Figure 4, after the mobile phone responds to the user clicking the add option 4021, the mobile phone can detect the permissions possessed by the label application. For example, if the mobile phone detects that the label application has permissions such as access to the camera and the gallery, the mobile phone can display the corresponding options in the option display area 403 or the label option box 901. Optionally, when the label application of the mobile phone subsequently calls the camera function of the local machine, etc., the mobile phone can detect again whether it has the corresponding access permissions, or it can stop detecting after the initial detection of having the corresponding permissions. This application does not limit this. To illustrate, using a tablet as an example, during initialization, the tablet can register the access permissions corresponding to the functions to be invoked with the permissions management module. Accordingly, in an embodiment of the present application, after a mobile phone establishes a Wi-Fi connection with the tablet, the functions that the tablet's tag application sends to the mobile phone that can be invoked are the functions for which the tag application has already obtained permissions. In this example, the user can manually manage (e.g., add or remove) the tag application's access permissions in the settings app. For example, the user can remove the tablet's tag application's access permissions to the camera in the permissions management app in the tablet's settings app. When the mobile phone invokes the tablet to execute the invocation method described in an embodiment of the present application, the functions that can be invoked sent to the mobile phone via the Wi-Fi connection by the tablet will no longer include the camera function. Accordingly, the tablet's corresponding camera option will no longer be displayed in the phone's options display area 403 and the tag options box 901. In another example, when the tag application of an electronic device (e.g., a mobile phone or tablet) is first launched, it can display a permissions list. The permissions list may include, but is not limited to, permissions that can be accessed by the tag application, such as camera access permissions, gallery access permissions, etc. The user can manually select the access permissions corresponding to the tag application.
[0270] In each of the above embodiments, the example of a mobile phone invoking a corresponding function of a tablet is used for illustration. In other embodiments, the methods of the above embodiments can be applied to scenarios where an electronic device, such as a tablet, laptop, mobile phone, or in-vehicle device, invokes another electronic device (e.g., a tablet, laptop, mobile phone, or in-vehicle device), and this application does not limit this. For example, Figure 15a is a schematic diagram illustrating an exemplary scenario in which a tablet invokes the camera function of a mobile phone. Referring to Figure 15a, the tablet responds to a received user operation (the specific operation can be referred to in the description of Figure 4 and will not be repeated here), invoking the camera function of the mobile phone. A label 1502 is inserted into the tablet's memo application interface 1501. Label 1502 indicates that the "Magic 5" is being used to take a photo, i.e., the camera function of the mobile phone is being invoked. In response to the tablet's invocation request, the mobile phone displays a photo preview interface 1503, which displays an image 1504 captured by the mobile phone's camera. It should be noted that Figure 15a only shows a schematic diagram of the invocation process. The methods of each of the above embodiments of this application can be applied to this scenario. For other undescribed parts, please refer to the above and will not be repeated here. For another example, when a user is taking notes in a notebook, typically the notebook's camera is the front-facing camera. In this scenario, the user can use the notebook to access the phone's camera using the methods of the embodiments of the present application to insert images captured by the phone's camera. Figure 15b illustrates an exemplary scenario in which a notebook accesses the phone's camera function. Referring to Figure 15b, the notebook invokes the phone's camera function in response to a received user operation. In this scenario, the user operation may refer to an operation triggered by the user using a mouse or keyboard. In some embodiments, if the notebook's display is a touch screen, the user can also use operations similar to those shown in Figure 4 to cause the notebook to access the corresponding function on the phone. For example, a label 1506 is inserted into the notebook's memo application interface 1505. Label 1506 indicates that the user is using "Magic 5" to take a photo, i.e., that the phone's camera function is being accessed. In response to the notebook's request, the phone displays a photo preview interface 1503, which displays an image 1504 captured by the phone's camera. For other undescribed details, please refer to the above and will not be repeated here.
[0271] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.
[0272] In an example, FIG16 shows a schematic block diagram of a device 1600 according to an embodiment of the present application. The device 1600 may include: a processor 1601 and a transceiver / transceiver pin 1602 , and optionally, a memory 1603 .
[0273] The various components of the device 1600 are coupled together via a bus 1604, wherein the bus 1604 includes, in addition to a data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clarity, all buses are referred to as bus 1604 in the figure.
[0274] Optionally, the memory 1603 may be used for instructions in the aforementioned method embodiment. The processor 1601 may be used to execute instructions in the memory 1603 and control the receiving pin to receive a signal and control the transmitting pin to send a signal.
[0275] The apparatus 1600 may be the electronic device or a chip of the electronic device in the above method embodiment.
[0276] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.
[0277] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.
[0278] This embodiment further provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the method in the above-mentioned embodiment.
[0279] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the connection method in the above-mentioned method embodiments.
[0280] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0281] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A calling method, characterized in that: include: The first electronic device displays a first application interface, wherein the first application interface displays input content and a first option; The first electronic device receives a first operation on the first option; The first electronic device displays a first label operation block on the first application interface in response to the first operation, and the first electronic device sends a first call request to the second electronic device, wherein the first call request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate that the first electronic device is calling the first target function of the second electronic device; In the process of the first electronic device calling the first target function of the second electronic device, the first electronic device displays a first label option box in response to a received click operation on the first label operation block, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the first electronic device; The first electronic device updates the first tag information to second tag information in response to the received click operation on the first calling option, and the first electronic device sends a second calling request to the second electronic device; the second calling request is used to request to call a second target function of the second electronic device, the second tag information is used to indicate that the first electronic device is calling the second target function of the second electronic device, and the first calling option belongs to the at least one second electronic device calling option; The first electronic device receives a first insertion object sent by the second electronic device, wherein the first insertion object is acquired by the second electronic device based on the second target function; The first electronic device replaces the first tag operation block with the first insertion object.
2. The method according to claim 1, characterized in that The first electronic device replaces the first label operation block with the first insertion object, including: The first electronic device cancels display of the first label operation block; The first electronic device inserts the first insertion object at an original display position of the first label operation block.
3. The method according to claim 1, characterized in that The first label operation block is displayed at the end of the input content.
4. The method according to claim 1, characterized in that The first label operation block is displayed at a position corresponding to the last editing operation on the input content.
5. The method according to claim 1, characterized in that Before the first electronic device receives a first operation on a first option of the first application interface, the method further includes: The first electronic device displays a light at the first position in response to receiving a second operation on the first position. mark; The first electronic device displays the first label operation block at a first position of the first application interface, including: The first label operation block is inserted at the position of the cursor.
6. The method according to claim 1, characterized in that The first application interface also includes a second option, and the method further includes: The first electronic device displays a second label operation block on the first application interface in response to the received third operation on the second option, and the first electronic device sends a third calling request to the second electronic device, wherein the third calling request is used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, and the third label information is used to indicate that the first electronic device is calling the third target function of the second electronic device; During the process of the first electronic device calling the third target function of the second electronic device, the first electronic device displays a second label option box in response to receiving a click operation on the second label operation block; wherein the second label option box includes the at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the first electronic device, and the at least one device includes the first electronic device.
7. The method according to claim 6, characterized in that The second label option box also includes a temporary insertion option, and the temporary insertion option is used to indicate to suspend the calling of the second electronic device; the method also includes: The first electronic device updates the second label information in response to the received click operation on the temporarily inserted option, and the first electronic device sends a stop calling request to the second electronic device, wherein the stop calling request is used to instruct to stop calling the second electronic device; wherein the updated second label information is used to indicate that the second label operation block is a temporarily inserted label operation block; The first electronic device displays the second label option box in response to receiving a click operation on the second label operation block.
8. The method according to claim 6 or 7, characterized in that: The method further comprises: The first electronic device displays a third label option box in response to receiving a fourth operation on the first device option; wherein the third label option box includes at least one third electronic device calling option and the at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the first electronic device; The first electronic device receives a fifth operation in response to the received second calling option, updates the third tag information to fourth tag information, and the first electronic device sends a fourth calling request to the third electronic device, the fourth calling request is used to request to call the fourth target function of the third electronic device; wherein the fourth tag information is used to indicate that the first electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option; The first electronic device receives a second insertion object sent by the third electronic device, wherein the second insertion object is acquired by the third electronic device based on the fourth target function; The first electronic device replaces the second tag operation block with the second insertion object.
9. The method according to claim 8, characterized in that At least one function in the third electronic device that can be called by the first electronic device is completely or partially different from at least one function in the second electronic device that can be called by the first electronic device.
10. The method according to claim 8, characterized in that The third electronic device is the first electronic device.
11. The method according to claim 1, characterized in that: The first interface further includes a third option, and the method further includes: In response to receiving a fifth operation on the third option, the first electronic device displays a third label operation block on the first application interface, where the third label operation block includes third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.
12. The method according to any one of claims 1 to 11, characterized in that: The first electronic device responds to the first operation, after the first application interface displays a first label operation block, the method further includes: The first electronic device receives a drag operation on the first label operation block; The first electronic device moves the first label operation block from a current position to another position along with the drag operation; The first electronic device replaces the first label operation block with the first insertion object, including: The first electronic device cancels display of the first label operation block; The first electronic device is inserted into the first insertion object at the other position.
13. The method according to any one of claims 1 to 12, characterized in that: The first electronic device responds to the first operation, after the first application interface displays a first label operation block, the method further includes: During the process in which the first electronic device calls the first target function of the second electronic device, the first electronic device updates the input content in response to the received sixth operation.
14. An electronic device, characterized in that: include: One or more processors, memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: Displaying a first application interface, wherein the first application interface displays input content and a first option; receiving a first operation on the first option; In response to the first operation, a first label operation block is displayed on the first application interface, and a first call request is sent to the second electronic device, wherein the first call request is used to request to call a first target function of the second electronic device; wherein the first label operation block includes first label information, and the first label information is used to indicate indicating that the electronic device is calling the first target function of the second electronic device; In the process of calling the first target function of the second electronic device, in response to receiving a click operation on the first label operation block, displaying a first label option box, wherein the first label option box includes at least one second electronic device calling option, and the at least one second electronic device calling option corresponds to at least one function in the second electronic device that can be called by the electronic device; In response to a received click operation on a first calling option, the first tag information is updated to second tag information, and a second calling request is sent to the second electronic device; the second calling request is used to request to call a second target function of the second electronic device, the second tag information is used to indicate that the electronic device is calling the second target function of the second electronic device, and the first calling option belongs to the at least one second electronic device calling option; receiving a first insertion object sent by the second electronic device, wherein the first insertion object is acquired by the second electronic device based on the second target function; The first tag operation block is replaced by the first insertion object.
15. The electronic device according to claim 14, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: Cancel displaying the first label operation block; The first insertion object is inserted at the original display position of the first tab operation block.
16. The electronic device according to claim 14, characterized in that: The first label operation block is displayed at the end of the input content.
17. The electronic device according to claim 14, characterized in that: The first label operation block is displayed at a position corresponding to the last editing operation on the input content.
18. The electronic device according to claim 14, characterized in that: Before the electronic device receives a first operation on a first option of the first application interface, when the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to receiving a second operation on a first position, displaying a cursor at the first position; Displaying the first label operation block at a first position of the first application interface includes: The first label operation block is inserted at the position of the cursor.
19. The electronic device according to claim 14, characterized in that: The first application interface further includes a second option, which, when the computer program is executed by the one or more processors, causes the electronic device to perform the following steps: In response to receiving a third operation on the second option, displaying a second label operation block on the first application interface, and sending a third call request to the second electronic device, the third call request being used to request to call a third target function of the second electronic device; wherein the second label operation block includes third label information, The third tag information is used to indicate that the electronic device is calling the third target function of the second electronic device; In the process of calling the third target function of the second electronic device, in response to receiving a click operation on the second label operation block, a second label option box is displayed; wherein the second label option box includes the at least one second electronic device calling option and at least one device option, and the at least one device option is used to indicate at least one device that can be called by the electronic device, and the at least one device includes the electronic device.
20. The electronic device according to claim 19, characterized in that The second label option box also includes a temporary insertion option, and the temporary insertion option is used to indicate to suspend the call to the second electronic device; when the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to the received click operation on the temporarily inserted option, the second tag information is updated, and a stop calling request is sent to the second electronic device, wherein the stop calling request is used to instruct to stop calling the second electronic device; wherein the updated second tag information is used to indicate that the second tag operation block is a temporarily inserted tag operation block; In response to receiving a click operation on the second label operation block, the second label option box is displayed.
21. The electronic device according to claim 19 or 20, characterized in that: When the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to receiving a fourth operation on the first device option, displaying a third label option box; wherein the third label option box includes at least one third electronic device calling option and the at least one device option, wherein the at least one third electronic device calling option is used to indicate at least one function in the third electronic device that can be called by the electronic device; receiving a fifth operation in response to the received second calling option, updating the third tag information to fourth tag information, and sending a fourth calling request to the third electronic device, the fourth calling request being used to request calling the fourth target function of the third electronic device; wherein the fourth tag information is used to indicate that the electronic device is calling the fourth target function of the third electronic device, and the second calling option belongs to the at least one third electronic device calling option; receiving a second insertion object sent by the third electronic device, wherein the second insertion object is acquired by the third electronic device based on the fourth target function; The second label operation block is replaced by the second insertion object.
22. The electronic device according to claim 21, characterized in that: At least one function in the third electronic device that can be called by the electronic device is completely or partially different from at least one function in the second electronic device that can be called by the electronic device.
23. The electronic device according to claim 22, characterized in that: The third electronic device is the electronic device.
24. The electronic device according to claim 14, characterized in that: The first interface also includes a third option. When the computer program is executed by the one or more processors, the electronic device performs the following steps: in response to receiving a fifth operation on the third option, displaying a third label operation block on the first application interface, the third label operation block including third label information, and the third label information is used to indicate that the third label operation block is a temporarily inserted label operation block.
25. The electronic device according to any one of claims 14 to 24, characterized in that: In response to the first operation, after the first application interface displays a first label operation block, when the computer program is executed by the one or more processors, the first electronic device causes the electronic device to perform the following steps: receiving a drag operation on the first label operation block; Moving the first label operation block from a current position to another position along with the drag operation; Cancel displaying the first label operation block; The first insertion object is inserted into the other position.
26. The electronic device according to any one of claims 14 to 25, characterized in that: In response to the first operation, after the first application interface displays a first label operation block, when the computer program is executed by the one or more processors, the first electronic device causes the electronic device to perform the following steps: In the process of calling the first target function of the second electronic device, the input content is updated in response to a received sixth operation.
27. A computer storage medium, characterized in that The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 13.
28. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 13.
29. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor, wherein the signal includes a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device executes the method described in any one of claims 1 to 13.
Citation Information
Patent Citations
Calling method and electronic equipment
CN118939144A
Method and apparatus for operating additional function in mobile device
CN103543940A
Function calling method, function calling device and computer readable storage medium
CN111131603A
Cross-application data calling method and electronic device
CN111614837A
Information interaction method, readable storage medium and electronic equipment
CN111833917A
